New Approach to Dynamic and Seamless Management of Network and Computational Resources in a Heterogeneous Grid Environment
Belter Bartosz, Binczewski Artur, Przywecki Miłosz, Stroiński Maciej
Poznań Supercomputing and Networking Center,
Z. Noskowskiego 12/14, 61-704 Poznań, Poland
{bart/artur/mprzyw/stroins}@ man.poznan.pl
Received:
Received: 25 August 2010; revised: 29 October 2010; published online: 23 November 2010
DOI: 10.12921/cmst.2010.SI.01.09-18
OAI: oai:lib.psnc.pl:677
Abstract:
The advent of network innovations in optical networks has a significant influence on computational infrastructures in research projects. Grid applications and middleware, not yet aware of underlying network and its services, have been recently equipped with powerful tools and plug-ins to control and manage not only the computational, but also network infrastructures. However, at this point of time, Grid middleware, even if aware of network services, is not capable of seamless control and management of both, Grid and network resources. The goal of this paper is to introduce a novel approach to dynamic and on-demand management of Grid and network resources in the PHOSPHORUS project.
Key words:
GMPLS, Grid infrastructure, network control plane, network management, NRPS, optical networks
References:
[1] Requirements and specifications of interfaces and architecture for interoperability between NRPS, GMPLS, Middleware, PHOSPHORUS deliverable D1.1, March 2007, http://phosphorus.pl/files/deliverables/Phosphorusdeliverable- D1.1.pdf
[2] Report on Harmony System Enhancements and Testing, PHOSPHORUS deliverable D1.10, June 2009, http://www.ist-phosphorus.eu/files/deliverables/ Phosphorus-deliverable-D1.10.pdf
[3] Network Service Plane Enhancements, PHOSPHORUS deliverable D1.8, September 2008, http://www.istphosphorus. eu/files/deliverables/Phosphorus-deliverable- D1.8.pdf
[4] C. Barz, M. Pilz, T. Eickermann, L. Kirtchakova, O. Waldrich, W. Ziegler: Co-Allocation of Compute and Network Resources in the VIOLA Testbed http://www.coregrid.net/- mambo/images/stories/TechnicalReports/tr-0051.pdf
[5] A. Tzanakaki, G. Markidis, N. Ciulli, G. Carrozzo, G. Giorgi, E. Escalona, A. Binczewski, M. Stroiński, J. Węglarz, B. Belter, D. Parniewicz, M. Strozyk, R. Krzywania, F. Hommes, D. Simeonidou, G. Zervas, R. Nejabati, W. Doonan, Deployment Models and Solutions of the Grid-GMPLS Control Plane, PHOSPHORUS deliverable D2.6, May 2007 http://www.ist-phosphorus.eu/files/deliverables/-Phosphorus-deliverable-D2.6.pdf
[6] O. Waldrich, P. Wieder, W. Ziegler, Meta-Scheduling Service for Co-allocating Arbitrary Types of Resources, CoreGRID Technical Report, Number TR-0010, December 2, 2005.
[7] http://www.nortel.com/DRAC
[8] http://dragon.maxgigapop.net/twiki/bin/view/DRAGON/ WebHome
[9] L. Battestilli, A. Hutanu, G. Karmous-Edwards, D.S. Katz, J. MacLaren, J. Mambretti, J.H. Moore, H.G. Seung-Jong Park Perros, S. Sundar, S. Tanwir, S.R. Thorpe, Yufeng Xin, EnLIGHTened Computing: An architecture for coallocating network, compute, and other grid resources for high-end applications, High Capacity Optical Networks and Enabling Technologies, 2007. HONET 2007, November 2007.
[10] http://enlightenedcomputing.org/
[11] T. Kudoh et al., G-lambda: Coordination of a Grid Scheduler and Lambda Path Service over GMPLS, Future Generation Computer Systems 22 (8), October 2006.
[12] http://www.geant2.net/server/show/nav.756
[13] http://sourceforge.net/projects/unicore/
[14] http://www.globus.org/toolkit/about.html
[15] http://www.gridge.org
[16] Report on initial adaptation of application, PHOSPHORUS Deliverable D3.3, September 2007, http://phosphorus.pl/ files/deliverables/Phosphorus-deliverable-D3.3.pdf
[17] Report on the Results of the Application Experiments During the Final Testbed Experiments, PHOSPHORUS deliverable D3.6, July 2008, http://phosphorus.pl/files/- deliverables/Phosphorus-deliverable-D3.6.pdf
[18] B. Belter, G. Bernini,A. Binczewski, G. Carrozzo, N. Ciulli, E. Escalona, G. Giorgi, R. Krzywania, R. Nejabati, D. Parniewicz, F. Salvestrini, D. Simeonidou, M. Strozyk, G. Zervas,
Routing and Signalling Extensions for the Grid- GMPLS Control Plane, PHOSPHORUS deliverable D2.2, September 2007, http://www.ist-phosphorus.eu/files/- deliverables/Phosphorus-deliverable-D2.2.pdf
[19] http://www.ist-phosphorus.eu/activities.php?id=2
[20] G. Zervas, E. Escalona, R. Nejabati, D. Simeonidou, G. Carrozzo, N. Ciulli, B. Belter, A. Binczewski, M. Stroiński, A. Tzanakaki, G. Markidis, Phosphorus Grid-enabled GMPLS Control Plane (G2MPLS): Architectures, Services and Interfaces. IEEE Communications Magazine under the Special call on “Multi-Domain Optical Networks: Issues and Challenges”, May 2008, http://www.ist-phosphorus.eu/files/publications/- ComMag_Phosphorus_v0_95.pdf
[21] B. Belter, A. Binczewski, G. Carrozzo, N. Ciulli, T. El Gorashi, J. Elmirghani, E. Escalona, G. Giorgi, R. Krzywania, G. Markidis, R. Nejabati, D. Parniewicz, F. Salvestrini, D. Simeonidou, M. Strozyk, A. Tzanakaki, O. Wäldrich, G. Zervas, Grid-GMPLS network interfaces specification, PHOSPHORUS deliverable D2.7, February 2008, http://www.ist-phosphorus.eu/files/deliverables/-Phosphorus-deliverable-D2.7_M17.pdf
[22] A. Anjomshoaa et al., “Job submission description language
(JSDL) specification v. 1.0”, Open Grid Forum document
GFD.56, November 2005,
http://www.gridforum.org/documents/GFD.56.pdf
[23] S. Andreozzi (Ed.), “GLUE Schema Specification – version 1.3”, Draft 3 – 16 Jan 2007, http://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/*check out*/v_1_3/spec/pdf/GLUESchema.pdf?rev=49&root=glue schema
[24] http://en.wikipedia.org/wiki/UNICORE
[25] http://www.ist-phosphorus.eu/software.php?id=gaaa_tk
[26] http://www.ist-phosphorus.eu/activities.php?id=1
[27] http://www.viola-testbed.de
[28] http://www.itu.int/ITU-T/ngn/definition.html
[29] http://www.oasis-open.org/committees/tc_home.php?wg_-abbrev=wsrf
[30] http://www.ist-phosphorus.eu
[31] http://www.geysers.eu/
The advent of network innovations in optical networks has a significant influence on computational infrastructures in research projects. Grid applications and middleware, not yet aware of underlying network and its services, have been recently equipped with powerful tools and plug-ins to control and manage not only the computational, but also network infrastructures. However, at this point of time, Grid middleware, even if aware of network services, is not capable of seamless control and management of both, Grid and network resources. The goal of this paper is to introduce a novel approach to dynamic and on-demand management of Grid and network resources in the PHOSPHORUS project.
Key words:
GMPLS, Grid infrastructure, network control plane, network management, NRPS, optical networks
References:
[1] Requirements and specifications of interfaces and architecture for interoperability between NRPS, GMPLS, Middleware, PHOSPHORUS deliverable D1.1, March 2007, http://phosphorus.pl/files/deliverables/Phosphorusdeliverable- D1.1.pdf
[2] Report on Harmony System Enhancements and Testing, PHOSPHORUS deliverable D1.10, June 2009, http://www.ist-phosphorus.eu/files/deliverables/ Phosphorus-deliverable-D1.10.pdf
[3] Network Service Plane Enhancements, PHOSPHORUS deliverable D1.8, September 2008, http://www.istphosphorus. eu/files/deliverables/Phosphorus-deliverable- D1.8.pdf
[4] C. Barz, M. Pilz, T. Eickermann, L. Kirtchakova, O. Waldrich, W. Ziegler: Co-Allocation of Compute and Network Resources in the VIOLA Testbed http://www.coregrid.net/- mambo/images/stories/TechnicalReports/tr-0051.pdf
[5] A. Tzanakaki, G. Markidis, N. Ciulli, G. Carrozzo, G. Giorgi, E. Escalona, A. Binczewski, M. Stroiński, J. Węglarz, B. Belter, D. Parniewicz, M. Strozyk, R. Krzywania, F. Hommes, D. Simeonidou, G. Zervas, R. Nejabati, W. Doonan, Deployment Models and Solutions of the Grid-GMPLS Control Plane, PHOSPHORUS deliverable D2.6, May 2007 http://www.ist-phosphorus.eu/files/deliverables/-Phosphorus-deliverable-D2.6.pdf
[6] O. Waldrich, P. Wieder, W. Ziegler, Meta-Scheduling Service for Co-allocating Arbitrary Types of Resources, CoreGRID Technical Report, Number TR-0010, December 2, 2005.
[7] http://www.nortel.com/DRAC
[8] http://dragon.maxgigapop.net/twiki/bin/view/DRAGON/ WebHome
[9] L. Battestilli, A. Hutanu, G. Karmous-Edwards, D.S. Katz, J. MacLaren, J. Mambretti, J.H. Moore, H.G. Seung-Jong Park Perros, S. Sundar, S. Tanwir, S.R. Thorpe, Yufeng Xin, EnLIGHTened Computing: An architecture for coallocating network, compute, and other grid resources for high-end applications, High Capacity Optical Networks and Enabling Technologies, 2007. HONET 2007, November 2007.
[10] http://enlightenedcomputing.org/
[11] T. Kudoh et al., G-lambda: Coordination of a Grid Scheduler and Lambda Path Service over GMPLS, Future Generation Computer Systems 22 (8), October 2006.
[12] http://www.geant2.net/server/show/nav.756
[13] http://sourceforge.net/projects/unicore/
[14] http://www.globus.org/toolkit/about.html
[15] http://www.gridge.org
[16] Report on initial adaptation of application, PHOSPHORUS Deliverable D3.3, September 2007, http://phosphorus.pl/ files/deliverables/Phosphorus-deliverable-D3.3.pdf
[17] Report on the Results of the Application Experiments During the Final Testbed Experiments, PHOSPHORUS deliverable D3.6, July 2008, http://phosphorus.pl/files/- deliverables/Phosphorus-deliverable-D3.6.pdf
[18] B. Belter, G. Bernini,A. Binczewski, G. Carrozzo, N. Ciulli, E. Escalona, G. Giorgi, R. Krzywania, R. Nejabati, D. Parniewicz, F. Salvestrini, D. Simeonidou, M. Strozyk, G. Zervas,
Routing and Signalling Extensions for the Grid- GMPLS Control Plane, PHOSPHORUS deliverable D2.2, September 2007, http://www.ist-phosphorus.eu/files/- deliverables/Phosphorus-deliverable-D2.2.pdf
[19] http://www.ist-phosphorus.eu/activities.php?id=2
[20] G. Zervas, E. Escalona, R. Nejabati, D. Simeonidou, G. Carrozzo, N. Ciulli, B. Belter, A. Binczewski, M. Stroiński, A. Tzanakaki, G. Markidis, Phosphorus Grid-enabled GMPLS Control Plane (G2MPLS): Architectures, Services and Interfaces. IEEE Communications Magazine under the Special call on “Multi-Domain Optical Networks: Issues and Challenges”, May 2008, http://www.ist-phosphorus.eu/files/publications/- ComMag_Phosphorus_v0_95.pdf
[21] B. Belter, A. Binczewski, G. Carrozzo, N. Ciulli, T. El Gorashi, J. Elmirghani, E. Escalona, G. Giorgi, R. Krzywania, G. Markidis, R. Nejabati, D. Parniewicz, F. Salvestrini, D. Simeonidou, M. Strozyk, A. Tzanakaki, O. Wäldrich, G. Zervas, Grid-GMPLS network interfaces specification, PHOSPHORUS deliverable D2.7, February 2008, http://www.ist-phosphorus.eu/files/deliverables/-Phosphorus-deliverable-D2.7_M17.pdf
[22] A. Anjomshoaa et al., “Job submission description language
(JSDL) specification v. 1.0”, Open Grid Forum document
GFD.56, November 2005,
http://www.gridforum.org/documents/GFD.56.pdf
[23] S. Andreozzi (Ed.), “GLUE Schema Specification – version 1.3”, Draft 3 – 16 Jan 2007, http://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/*check out*/v_1_3/spec/pdf/GLUESchema.pdf?rev=49&root=glue schema
[24] http://en.wikipedia.org/wiki/UNICORE
[25] http://www.ist-phosphorus.eu/software.php?id=gaaa_tk
[26] http://www.ist-phosphorus.eu/activities.php?id=1
[27] http://www.viola-testbed.de
[28] http://www.itu.int/ITU-T/ngn/definition.html
[29] http://www.oasis-open.org/committees/tc_home.php?wg_-abbrev=wsrf
[30] http://www.ist-phosphorus.eu
[31] http://www.geysers.eu/
