Grid Technologies for High Throughput Data Acquisition
Sutter Michael 1, Jejkal Thomas 1, Stotzka Rainer 1, Hartmann Volker 1, Hardt Marcus 2, Gemmeke Hartmut 1
1 Forschungszentrum Karlsruhe Institute for Data Processing and Electronics
76344 Eggenstein–Leopoldshafen, Germany
e-mail: Michael.Sutter@ipe.fzk.de
2 Forschungszentrum Karlsruhe Steinbuch Centre for Computing
76344 Eggenstein–Leopoldshafen, Germany
Received:
Received: 1 December 2008; published online: 25 March 2009
DOI: 10.12921/cmst.2009.15.01.105-115
OAI: oai:lib.psnc.pl:658
Abstract:
The Grid is an upcoming technology, providing access to an unimaginable amount of storage and computation resources. In the final stage of the Grid nearly every computer worldwide offers its free capacities to the Grid, which gives access to the resources as simple as getting electricity from a power outlet. As process data processing has very high resource demands, growing up rapidly from project to project, the Grid offers the capabilities to fulfil the requirements for upcoming process data processing projects. This paper evaluates the already existing remote control software packages to be used in process data processing projects, explains the demands for developing a high throughput data acquisition system with the introduced requirements, shows the advantages of using Grid technologies and proposes an architecture for developing such a system.
Key words:
References:
[1] KATRIN Collaboration, KATRIN Design Report 2004. Tech. Rep. FZKA-7090, February 2005.
[2] ITER Technical Basis, ITER EDA Documentation Series, vol. 24, IAEA Vienna 2002.
[3] N. Ruiter, M. Zapf, R. Stotzka et al., First Images with a 3D– Prototype for Ultrasound Computer Tomography. IEEE International Ultrasonics Symposium, 2005.
[4] J. Abraham, M. Aglietta, I. C. Aguirre et al., Properties and performance of the prototype instrument for the Pierre Auger Observatory. Nuclear Instruments and Methods in
Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment 523 (1-2), 50-95, 2004.
[5] Wikipedia – The Free Encyclopedia. (2008, November) Welcome to Wikipedia. [Online]. Available: http://en. wikipedia.org/
[6] R. Pugliese, F. Asnicar, L. D. Cano, L. Chittaro, R. Ranon, L. D. Marco and A. Senerchia, Collaborative Environments For The GRID: The GRIDCC Multipurpose Collaborative Environment. Springer US, 2006, ch. IV.
[7] F. Lelli, E. Frizziero, M. Gulmini, G. Maron, S. Orlando, A. Petrucci and S. Squizzato, The many faces of the integration of instruments and the grid. International
Journal of Web and Grid Services 2007, 3 (3), 239-266 (2007).
[8] A. Götz, W.-D. Klotz, P. Mäkijärvi, J. Meyer, E. Taurel, and J. Quick, TACO: An object oriented system for PC’s running Linux, Windows/NT, OS-9, LynxOS or VxWorks. The second workshop on PCs and Particle Accelerator Control, Tsukuba, Japan, 1999.
[9] J.-M. Chaize, A. Götz, W.-D. Klotz, J. Meyer, M. Perez, and E. Taurel, TANGO an Object Oriented Control System based on CORBA. ICALEPCS, 1999.
[10] R. Lange, A. Johnson, M. R. Kraimer,W. E. Norum and J. Hill, Epics: Recent developments and future perspectives. 9th International Conference on Accelerator and Large Experimental Physics Control Systems, p. 278, 2003.
[11] RTEMS Steering Committee. (2008, September) Welcome to the RTEMS home page. [Online]. Available: http://www.rtems.com/
[12] Wind River Systems. (2008, September) Wind River. [Online]. Available: http://www.windriver.com/
[13] M. A. Howe, G. A. Cox, P. J. Harvey, F. McGirt, K. Rielage, J. F. Wilkerson and J. M. Wouters, Sudbury Neutrino Observatory Neutral Current Detector Acquisition Software Overview. IEEE Transactions on Nuclear Science 51 (3), 878-883 (2004).
[14] T. O’Reilly, D. Edgington, D. Davis, R. Henthorn, M. Mc-Cann, T. Meese, W. Radochonski, M. Risi, B. Roman and R. Schramm, Smart network. Infrastructure for the MBARI ocean observing system. OCEANS, 2001. MTS/IEEE Conference and Exhibition 2, 1276-1282 (2001).
[15] M. Ernst, P. Fuhrmann, M. Gasthuber, T. Mkrtchyan and C. Waldman, dCache, a Distributed Storage Data Caching System. Proceedings of the International CHEP 2001, Beijing, China, September 2001.
[16] A. Rajasekar, M. Wan, R. Moore, and W. Schroeder, A Prototype Rule-based Distributed Data Management System. HPDC workshop on ”Next Generation Distributed Data Management”, May 2006.
[17] F. Donno, A. Ghiselli, L. Magnoni and R. Zappi, STORM: GRID middleware for disk resource management. Proceedings of the International CHEP 2004, Interlaken, Switzerland, October 2004.
[18] Auger Collaboration, Properties and performance of the prototype instrument for the Pierre Auger Observatory, Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment 523 (1-2), 50-95 (2004).
[19] G. Giorgi and C. Narduzzi, Detection of Anomalous Behaviors in Networks From Traffic Measurements. IEEE Transactions on Instrumentation and Measurement 57 (12), 2782-2791 (2008).
[20] A. Depari, P. Ferrari, A. Flammini, D. Marioli and A. Taroni, A New Instrument for Real-Time Ethernet Performance Measurement. IEEE Transactions on Instrumentation and Measurement 57 (1), 121-127 (2008).
[21] P. Daponte, D. Grimaldi and M. Marinov, Real-Time Measurement and Control of an Industrial System Over a Standard Network: Implementation of a Prototype for Educational
Purposes. IEEE Transactions on Instrumentation and Measurement 51 (5), 962-969 (2002).
[22] J. D. Bregman, Towards a Concept Design for a LOFAR. The Universe at Low Radio Frequencies, Proceedings of IAU Symposium 199, 484 (2002).
[23] S. Achterop, M. Devos, K. V. D. Schaaf and L. Spaanenburg, Architectural Requirements for a LOFAR Generic Node. Proceedings of ProRise 2001.
The Grid is an upcoming technology, providing access to an unimaginable amount of storage and computation resources. In the final stage of the Grid nearly every computer worldwide offers its free capacities to the Grid, which gives access to the resources as simple as getting electricity from a power outlet. As process data processing has very high resource demands, growing up rapidly from project to project, the Grid offers the capabilities to fulfil the requirements for upcoming process data processing projects. This paper evaluates the already existing remote control software packages to be used in process data processing projects, explains the demands for developing a high throughput data acquisition system with the introduced requirements, shows the advantages of using Grid technologies and proposes an architecture for developing such a system.
Key words:
References:
[1] KATRIN Collaboration, KATRIN Design Report 2004. Tech. Rep. FZKA-7090, February 2005.
[2] ITER Technical Basis, ITER EDA Documentation Series, vol. 24, IAEA Vienna 2002.
[3] N. Ruiter, M. Zapf, R. Stotzka et al., First Images with a 3D– Prototype for Ultrasound Computer Tomography. IEEE International Ultrasonics Symposium, 2005.
[4] J. Abraham, M. Aglietta, I. C. Aguirre et al., Properties and performance of the prototype instrument for the Pierre Auger Observatory. Nuclear Instruments and Methods in
Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment 523 (1-2), 50-95, 2004.
[5] Wikipedia – The Free Encyclopedia. (2008, November) Welcome to Wikipedia. [Online]. Available: http://en. wikipedia.org/
[6] R. Pugliese, F. Asnicar, L. D. Cano, L. Chittaro, R. Ranon, L. D. Marco and A. Senerchia, Collaborative Environments For The GRID: The GRIDCC Multipurpose Collaborative Environment. Springer US, 2006, ch. IV.
[7] F. Lelli, E. Frizziero, M. Gulmini, G. Maron, S. Orlando, A. Petrucci and S. Squizzato, The many faces of the integration of instruments and the grid. International
Journal of Web and Grid Services 2007, 3 (3), 239-266 (2007).
[8] A. Götz, W.-D. Klotz, P. Mäkijärvi, J. Meyer, E. Taurel, and J. Quick, TACO: An object oriented system for PC’s running Linux, Windows/NT, OS-9, LynxOS or VxWorks. The second workshop on PCs and Particle Accelerator Control, Tsukuba, Japan, 1999.
[9] J.-M. Chaize, A. Götz, W.-D. Klotz, J. Meyer, M. Perez, and E. Taurel, TANGO an Object Oriented Control System based on CORBA. ICALEPCS, 1999.
[10] R. Lange, A. Johnson, M. R. Kraimer,W. E. Norum and J. Hill, Epics: Recent developments and future perspectives. 9th International Conference on Accelerator and Large Experimental Physics Control Systems, p. 278, 2003.
[11] RTEMS Steering Committee. (2008, September) Welcome to the RTEMS home page. [Online]. Available: http://www.rtems.com/
[12] Wind River Systems. (2008, September) Wind River. [Online]. Available: http://www.windriver.com/
[13] M. A. Howe, G. A. Cox, P. J. Harvey, F. McGirt, K. Rielage, J. F. Wilkerson and J. M. Wouters, Sudbury Neutrino Observatory Neutral Current Detector Acquisition Software Overview. IEEE Transactions on Nuclear Science 51 (3), 878-883 (2004).
[14] T. O’Reilly, D. Edgington, D. Davis, R. Henthorn, M. Mc-Cann, T. Meese, W. Radochonski, M. Risi, B. Roman and R. Schramm, Smart network. Infrastructure for the MBARI ocean observing system. OCEANS, 2001. MTS/IEEE Conference and Exhibition 2, 1276-1282 (2001).
[15] M. Ernst, P. Fuhrmann, M. Gasthuber, T. Mkrtchyan and C. Waldman, dCache, a Distributed Storage Data Caching System. Proceedings of the International CHEP 2001, Beijing, China, September 2001.
[16] A. Rajasekar, M. Wan, R. Moore, and W. Schroeder, A Prototype Rule-based Distributed Data Management System. HPDC workshop on ”Next Generation Distributed Data Management”, May 2006.
[17] F. Donno, A. Ghiselli, L. Magnoni and R. Zappi, STORM: GRID middleware for disk resource management. Proceedings of the International CHEP 2004, Interlaken, Switzerland, October 2004.
[18] Auger Collaboration, Properties and performance of the prototype instrument for the Pierre Auger Observatory, Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment 523 (1-2), 50-95 (2004).
[19] G. Giorgi and C. Narduzzi, Detection of Anomalous Behaviors in Networks From Traffic Measurements. IEEE Transactions on Instrumentation and Measurement 57 (12), 2782-2791 (2008).
[20] A. Depari, P. Ferrari, A. Flammini, D. Marioli and A. Taroni, A New Instrument for Real-Time Ethernet Performance Measurement. IEEE Transactions on Instrumentation and Measurement 57 (1), 121-127 (2008).
[21] P. Daponte, D. Grimaldi and M. Marinov, Real-Time Measurement and Control of an Industrial System Over a Standard Network: Implementation of a Prototype for Educational
Purposes. IEEE Transactions on Instrumentation and Measurement 51 (5), 962-969 (2002).
[22] J. D. Bregman, Towards a Concept Design for a LOFAR. The Universe at Low Radio Frequencies, Proceedings of IAU Symposium 199, 484 (2002).
[23] S. Achterop, M. Devos, K. V. D. Schaaf and L. Spaanenburg, Architectural Requirements for a LOFAR Generic Node. Proceedings of ProRise 2001.
