Versatile Configuration and Control Framework for Real-Time Data Acquisition Systems

Modern physics experiments often utilize field-programmable gate array (FPGA)-based systems for real-time data acquisition (DAQ). Integrated analog electronics demand for complex calibration routines. Furthermore, versatile configuration and control of the whole system are key requirements. Besides...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on nuclear science Vol. 68; no. 8; pp. 1899 - 1906
Main Authors Karcher, N., Gebauer, R., Bauknecht, R., Illichmann, R., Sander, O.
Format Journal Article
LanguageEnglish
Published New York IEEE 01.08.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text
ISSN0018-9499
1558-1578
DOI10.1109/TNS.2021.3084355

Cover

Abstract Modern physics experiments often utilize field-programmable gate array (FPGA)-based systems for real-time data acquisition (DAQ). Integrated analog electronics demand for complex calibration routines. Furthermore, versatile configuration and control of the whole system are key requirements. Besides a low-level register interface to the FPGA, also, access to I 2 C and SPI buses is often needed to configure the complete system. Calibration through an FPGA is inflexible and yields a complex hardware implementation. On the contrary, calibration through a remote system is possible but considerably slower due to repetitive network accesses. By using system-on-chip (SoC)-FPGA solutions with a microprocessor, more sophisticated configuration and calibration solutions, as well as standard remote access protocols, can be efficiently integrated into the software. Based on Xilinx Zynq US+ SoC-FPGAs, we implemented a versatile control framework. This software framework offers convenient access to the hardware and a flexible abstraction via remote-procedure calls (RPCs). Based on the open-source RPC library gRPC, functionality with low-latency control flow, complex algorithms, data conversions and processing, and configuration via external buses can be provided to a client via Ethernet. Furthermore, client interfaces for various programming languages can be generated automatically, which eases collaboration among different working groups and integration into existing software. This contribution presents the framework and benchmarks regarding latency and data throughput.
AbstractList Modern physics experiments often utilize field-programmable gate array (FPGA)-based systems for real-time data acquisition (DAQ). Integrated analog electronics demand for complex calibration routines. Furthermore, versatile configuration and control of the whole system are key requirements. Besides a low-level register interface to the FPGA, also, access to I2C and SPI buses is often needed to configure the complete system. Calibration through an FPGA is inflexible and yields a complex hardware implementation. On the contrary, calibration through a remote system is possible but considerably slower due to repetitive network accesses. By using system-on-chip (SoC)-FPGA solutions with a microprocessor, more sophisticated configuration and calibration solutions, as well as standard remote access protocols, can be efficiently integrated into the software. Based on Xilinx Zynq US+ SoC-FPGAs, we implemented a versatile control framework. This software framework offers convenient access to the hardware and a flexible abstraction via remote-procedure calls (RPCs). Based on the open-source RPC library gRPC, functionality with low-latency control flow, complex algorithms, data conversions and processing, and configuration via external buses can be provided to a client via Ethernet. Furthermore, client interfaces for various programming languages can be generated automatically, which eases collaboration among different working groups and integration into existing software. This contribution presents the framework and benchmarks regarding latency and data throughput.
Modern physics experiments often utilize field-programmable gate array (FPGA)-based systems for real-time data acquisition (DAQ). Integrated analog electronics demand for complex calibration routines. Furthermore, versatile configuration and control of the whole system are key requirements. Besides a low-level register interface to the FPGA, also, access to I 2 C and SPI buses is often needed to configure the complete system. Calibration through an FPGA is inflexible and yields a complex hardware implementation. On the contrary, calibration through a remote system is possible but considerably slower due to repetitive network accesses. By using system-on-chip (SoC)-FPGA solutions with a microprocessor, more sophisticated configuration and calibration solutions, as well as standard remote access protocols, can be efficiently integrated into the software. Based on Xilinx Zynq US+ SoC-FPGAs, we implemented a versatile control framework. This software framework offers convenient access to the hardware and a flexible abstraction via remote-procedure calls (RPCs). Based on the open-source RPC library gRPC, functionality with low-latency control flow, complex algorithms, data conversions and processing, and configuration via external buses can be provided to a client via Ethernet. Furthermore, client interfaces for various programming languages can be generated automatically, which eases collaboration among different working groups and integration into existing software. This contribution presents the framework and benchmarks regarding latency and data throughput.
Author Karcher, N.
Gebauer, R.
Illichmann, R.
Bauknecht, R.
Sander, O.
Author_xml – sequence: 1
  givenname: N.
  orcidid: 0000-0001-5052-736X
  surname: Karcher
  fullname: Karcher, N.
  email: karcher@kit.edu
  organization: Institute for Data Processing and Electronics (IPE), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
– sequence: 2
  givenname: R.
  surname: Gebauer
  fullname: Gebauer, R.
  organization: Institute for Data Processing and Electronics (IPE), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
– sequence: 3
  givenname: R.
  surname: Bauknecht
  fullname: Bauknecht, R.
  organization: Institute for Data Processing and Electronics (IPE), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
– sequence: 4
  givenname: R.
  surname: Illichmann
  fullname: Illichmann, R.
  organization: Institute for Data Processing and Electronics (IPE), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
– sequence: 5
  givenname: O.
  orcidid: 0000-0002-0959-4744
  surname: Sander
  fullname: Sander, O.
  organization: Institute for Data Processing and Electronics (IPE), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
BookMark eNp9kE1Lw0AQhhepYFu9C14CnlN39iPJHku1KhQFG72GTTKRrWm23U2Q_nvTDzx48DTM8D4zzDMig8Y2SMg10AkAVXfpy3LCKIMJp4ngUp6RIUiZhCDjZECGlEISKqHUBRl5v-pbIakckvQDndetqTGY2aYyn53rO9sEuin3k9bZOpg7vcZv676CyrrgDXUdpmaNwb1udTAttp3x5gAtd77Ftb8k55WuPV6d6pi8zx_S2VO4eH18nk0XYcEUtCFLIspjkQsQpVaqooJGkEuUpRaUAwPB4iJRiFJzwCIvATTP47LiUseF1nxMbo97N85uO_RttrKda_qTGZMR4xApxvtUdEwVznrvsMoK0x6ebJ02dQY02xvMeoPZ3mB2MtiD9A-4cWat3e4_5OaIGET8jSshWBQz_gM-v32W
CODEN IETNAE
CitedBy_id crossref_primary_10_3103_S1060992X24010077
crossref_primary_10_3390_s23094349
crossref_primary_10_1145_3571820
Cites_doi 10.1109/TNS.2019.2914665
10.1119/1.1891170
10.1007/s10909-008-9793-7
10.1147/JRD.2018.2888987
10.1038/s41534-020-00291-0
10.1126/science.1231298
10.17487/rfc0707
10.1103/RevModPhys.79.135
10.22331/q-2018-08-06-79
10.1103/PhysRevA.76.042319
10.1038/nature15263
10.1038/nature17658
10.1038/srep00571
10.1137/S0036144598347011
10.1007/s10909-015-1348-0
10.1063/1.4973872
10.1109/ETFA.2014.7005074
10.1088/1748-0221/10/02/C02019
10.1021/acs.chemrev.9b00829
10.1088/0031-8949/2015/T166/014054
10.17487/rfc5531
10.1063/1.5089550
10.1109/TBC.2019.2901392
10.1126/science.1231930
10.1016/j.jnca.2007.11.009
10.1109/RTC.2016.7543117
10.1063/5.0011721
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
DBID 97E
RIA
RIE
AAYXX
CITATION
7QF
7QL
7QQ
7SC
7SE
7SP
7SR
7T7
7TA
7TB
7U5
7U9
8BQ
8FD
C1K
F28
FR3
H8D
H94
JG9
JQ2
KR7
L7M
L~C
L~D
M7N
P64
DOI 10.1109/TNS.2021.3084355
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Aluminium Industry Abstracts
Bacteriology Abstracts (Microbiology B)
Ceramic Abstracts
Computer and Information Systems Abstracts
Corrosion Abstracts
Electronics & Communications Abstracts
Engineered Materials Abstracts
Industrial and Applied Microbiology Abstracts (Microbiology A)
Materials Business File
Mechanical & Transportation Engineering Abstracts
Solid State and Superconductivity Abstracts
Virology and AIDS Abstracts
METADEX
Technology Research Database
Environmental Sciences and Pollution Management
ANTE: Abstracts in New Technology & Engineering
Engineering Research Database
Aerospace Database
AIDS and Cancer Research Abstracts
Materials Research Database
ProQuest Computer Science Collection
Civil Engineering Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
Algology Mycology and Protozoology Abstracts (Microbiology C)
Biotechnology and BioEngineering Abstracts
DatabaseTitle CrossRef
Materials Research Database
Technology Research Database
Computer and Information Systems Abstracts – Academic
Mechanical & Transportation Engineering Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Materials Business File
Environmental Sciences and Pollution Management
Aerospace Database
Engineered Materials Abstracts
Bacteriology Abstracts (Microbiology B)
Algology Mycology and Protozoology Abstracts (Microbiology C)
AIDS and Cancer Research Abstracts
Industrial and Applied Microbiology Abstracts (Microbiology A)
Advanced Technologies Database with Aerospace
ANTE: Abstracts in New Technology & Engineering
Civil Engineering Abstracts
Aluminium Industry Abstracts
Virology and AIDS Abstracts
Electronics & Communications Abstracts
Ceramic Abstracts
METADEX
Biotechnology and BioEngineering Abstracts
Computer and Information Systems Abstracts Professional
Solid State and Superconductivity Abstracts
Engineering Research Database
Corrosion Abstracts
DatabaseTitleList Materials Research Database

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1558-1578
EndPage 1906
ExternalDocumentID 10_1109_TNS_2021_3084355
9442672
Genre orig-research
GrantInformation_xml – fundername: Doctoral School “Karlsruhe School of Elementary and Astroparticle Physics: Science and Technology.”
– fundername: State Graduate Sponsorship Program (LGF)
– fundername: Helmholtz International Research School for Teratronics (HIRST)
GroupedDBID .DC
.GJ
0R~
29I
3O-
4.4
53G
5GY
5RE
5VS
6IK
8WZ
97E
A6W
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACGFS
ACIWK
ACNCT
ACPRK
AENEX
AETEA
AETIX
AFRAH
AGQYO
AGSQL
AHBIQ
AI.
AIBXA
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ASUFR
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
EJD
F5P
HZ~
H~9
IAAWW
IBMZZ
ICLAB
IDIHD
IFIPE
IFJZH
IPLJI
JAVBF
LAI
M43
MS~
O9-
OCL
P2P
RIA
RIE
RNS
TAE
TN5
VH1
VOH
AAYXX
CITATION
7QF
7QL
7QQ
7SC
7SE
7SP
7SR
7T7
7TA
7TB
7U5
7U9
8BQ
8FD
C1K
F28
FR3
H8D
H94
JG9
JQ2
KR7
L7M
L~C
L~D
M7N
P64
ID FETCH-LOGICAL-c291t-2860374b414da99f04061b5e5da403121427c89ee5a31ecbd11a3b7df35a7caa3
IEDL.DBID RIE
ISSN 0018-9499
IngestDate Mon Jun 30 08:41:22 EDT 2025
Thu Apr 24 22:53:21 EDT 2025
Wed Oct 01 04:24:01 EDT 2025
Wed Aug 27 02:25:46 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 8
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c291t-2860374b414da99f04061b5e5da403121427c89ee5a31ecbd11a3b7df35a7caa3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-0959-4744
0000-0001-5052-736X
PQID 2562316923
PQPubID 85457
PageCount 8
ParticipantIDs ieee_primary_9442672
crossref_primary_10_1109_TNS_2021_3084355
proquest_journals_2562316923
crossref_citationtrail_10_1109_TNS_2021_3084355
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2021-08-01
PublicationDateYYYYMMDD 2021-08-01
PublicationDate_xml – month: 08
  year: 2021
  text: 2021-08-01
  day: 01
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on nuclear science
PublicationTitleAbbrev TNS
PublicationYear 2021
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref35
ref13
gastaldo (ref6) 2017; 226
ref12
ref15
ref36
ref14
ref31
ref30
(ref33) 2004
ref11
ref10
ref17
ref38
ref16
(ref39) 2014
ref19
ref18
gebauer (ref2) 2020
gutiérrez (ref37) 2018
(ref27) 2021
(ref32) 1995
(ref29) 2021
ref23
ref26
nelson (ref24) 1981
ref25
ref20
ref22
ref21
bates (ref5) 2015; 184
(ref1) 2017
(ref28) 2018
dalesio (ref34) 1991
ref8
ref7
ref9
ref4
ref3
References_xml – ident: ref8
  doi: 10.1109/TNS.2019.2914665
– ident: ref11
  doi: 10.1119/1.1891170
– ident: ref4
  doi: 10.1007/s10909-008-9793-7
– year: 2020
  ident: ref2
  article-title: Accelerating complex control schemes on a heterogeneous MPSoC platform for quantum computing
  publication-title: arXiv 2004 07755
– ident: ref13
  doi: 10.1147/JRD.2018.2888987
– year: 2021
  ident: ref29
  publication-title: Potobuf Website
– ident: ref16
  doi: 10.1038/s41534-020-00291-0
– ident: ref17
  doi: 10.1126/science.1231298
– ident: ref26
  doi: 10.17487/rfc0707
– ident: ref18
  doi: 10.1103/RevModPhys.79.135
– ident: ref9
  doi: 10.22331/q-2018-08-06-79
– year: 2018
  ident: ref28
  publication-title: gRPC Concept
– ident: ref20
  doi: 10.1103/PhysRevA.76.042319
– start-page: 1
  year: 2004
  ident: ref33
– ident: ref19
  doi: 10.1038/nature15263
– ident: ref15
  doi: 10.1038/nature17658
– year: 1981
  ident: ref24
  article-title: Remote procedure call
– ident: ref12
  doi: 10.1038/srep00571
– volume: 226
  start-page: 1623
  year: 2017
  ident: ref6
  article-title: The electron capture in ¹?³Ho experiment-ECHo
  publication-title: EPJ ST
– year: 2018
  ident: ref37
  article-title: Real-time linux communications: An evaluation of the linux communication stack for real-time robotic applications
  publication-title: arXiv 1808 10821
– ident: ref10
  doi: 10.1137/S0036144598347011
– volume: 184
  start-page: 351
  year: 2015
  ident: ref5
  article-title: Direct detection of pu-242 with a metallic magnetic calorimeter gamma-ray detector
  publication-title: J Low Temp Phys
  doi: 10.1007/s10909-015-1348-0
– ident: ref7
  doi: 10.1063/1.4973872
– ident: ref30
  doi: 10.1109/ETFA.2014.7005074
– year: 1995
  ident: ref32
  publication-title: VMEbus extensions for Instrumentation
– ident: ref31
  doi: 10.1088/1748-0221/10/02/C02019
– ident: ref14
  doi: 10.1021/acs.chemrev.9b00829
– ident: ref3
  doi: 10.1088/0031-8949/2015/T166/014054
– year: 2021
  ident: ref27
  publication-title: grpc website
– ident: ref25
  doi: 10.17487/rfc5531
– year: 2017
  ident: ref1
  publication-title: Zynq UltraScale+ MPSoC Data Sheet Overview
– ident: ref22
  doi: 10.1063/1.5089550
– year: 2014
  ident: ref39
  publication-title: Annex A17 RoCEv2
– ident: ref36
  doi: 10.1109/TBC.2019.2901392
– year: 1991
  ident: ref34
  article-title: EPICS architecture
– ident: ref21
  doi: 10.1126/science.1231930
– ident: ref38
  doi: 10.1016/j.jnca.2007.11.009
– ident: ref35
  doi: 10.1109/RTC.2016.7543117
– ident: ref23
  doi: 10.1063/5.0011721
SSID ssj0014505
Score 2.3739831
Snippet Modern physics experiments often utilize field-programmable gate array (FPGA)-based systems for real-time data acquisition (DAQ). Integrated analog electronics...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1899
SubjectTerms Algorithms
Benchmarks
Calibration
Computer programs
Configuration management
Data acquisition
Ethernet
Field programmable gate arrays
Flow control
Hardware
Interfaces
Latency
Network latency
Procedure calls
Programming languages
Qubit
Real time
Real-time systems
remote control
Remote procedure calls
Software
software-defined radio
Source code
System on chip
system-on-chip (SoC)-field-programmable gate array (FPGA)
Task analysis
Title Versatile Configuration and Control Framework for Real-Time Data Acquisition Systems
URI https://ieeexplore.ieee.org/document/9442672
https://www.proquest.com/docview/2562316923
Volume 68
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 1558-1578
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0014505
  issn: 0018-9499
  databaseCode: RIE
  dateStart: 19630101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LSwMxEA61Jz34qmK1Sg5eBLdNdjf7OBa1FKE9aAu9LXmtFGXrY_fir3dmH8UX4m1ZkhAyk8yXzMw3hJwrowWzLHIkC1PHTyPmSDcKHCEDaQ1Ljccx33kyDcZz_3YhFi1yuc6FsdaWwWe2j5-lL9-sdIFPZYPYB3sSwoG7EUZBlau19hj4gtXVCmADA4xvXJIsHsym93ARdHnfYxGgA_HFBJU1VX4cxKV1Ge2QSTOvKqjksV_kqq_fv1E2_nfiu2S7hpl0WOnFHmnZbJ9sfSIf7JAZPpWBXJ4sxbS_5UNRKQOVmcE_GMFOR03sFgVwS-8AVTqYNEKvZS7pUL8Uyyrmi9bM5wdkPrqZXY2dusaCo92Y5w7IBRlolM99I-M4ZWjglbDCSB_2OxKyhTqKrRXS41Yrw7n0VGhST8hQS-kdkna2yuwRoejyA41I0xBAFpwESnHXlRbwmfX8wIRdMmiWPdE1ATnWwXhKyosIixMQVIKCSmpBdcnFusdzRb7xR9sOrvu6Xb3kXdJrJJvUu_MtcRH08QCw7fHvvU7IJo5dBfr1SDt_LewpgI9cnZVa9wHUvtW1
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LTxsxEB5FcAAOtOWhhobWBy6V2MTetfdxRNAoPJJDCRK3lV-LUFF47V766zuzj4gWVHFbrWzZ8ow9nz0z3wAcGGcV9zwNNE-KQBYpD3SYxoHSsfaOFy4SlO88ncWTK3l2ra57cLjMhfHe18FnfkiftS_f3duKnspGmUR7kuCBu6qklKrJ1lr6DKTibb0C3MII5DunJM9G89klXgVDMYx4ivhA_WWE6qoqr47i2r6MP8C0m1kTVvJrWJVmaH__Q9r43ql_hM0WaLKjRjM-Qc8vtmDjBf3gNszpsQwlc-cZJf7d3lSNOjC9cPSHYtjZuIveYghv2U_ElQGljbATXWp2ZB-r2ybqi7Xc5ztwNf4xP54EbZWFwIaZKAOUDHHQGCmk01lWcDLxRnnltMQdT5RsiU0z75WOhLfGCaEjk7giUjqxWke7sLK4X_jPwMjphzpRFAnCLDwLjBFhqD0iNB_J2CV9GHXLntuWgpwqYdzl9VWEZzkKKidB5a2g-vB92eOhod_4T9ttWvdlu3bJ-zDoJJu3-_M5Dwn2iRjR7d7bvb7B2mQ-vcgvTmfnX2CdxmnC_gawUj5Vfh-hSGm-1hr4BzA92QI
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Versatile+Configuration+and+Control+Framework+for+Real-Time+Data+Acquisition+Systems&rft.jtitle=IEEE+transactions+on+nuclear+science&rft.au=Karcher%2C+N.&rft.au=Gebauer%2C+R.&rft.au=Bauknecht%2C+R.&rft.au=Illichmann%2C+R.&rft.date=2021-08-01&rft.issn=0018-9499&rft.eissn=1558-1578&rft.volume=68&rft.issue=8&rft.spage=1899&rft.epage=1906&rft_id=info:doi/10.1109%2FTNS.2021.3084355&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TNS_2021_3084355
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9499&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9499&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9499&client=summon