publication . Article . Other literature type . 2018

INDIGO-DataCloud: a Platform to Facilitate Seamless Access to E-Infrastructures

Salomoni, D.; Campos, I.; Gaido, L.; de Lucas, J.M.; Solagna, P.; Gomes, J.; Matyska, L.; Fuhrman, P.; Hardt, M.; Donvito, G.; ...
Open Access English
  • Published: 01 Sep 2018
  • Publisher: Springer
Abstract
This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications.
INDIGO-Datacloud has been funded by the European Commision H2020 research and innovation program under grant agreement RIA 653549.
Peer reviewed
Fields of Science and Technology classification (FOS)
02 engineering and technology, 0202 electrical engineering, electronic engineering, information engineering, 020201 artificial intelligence & image processing, 020203 distributed computing
Sustainable Development Goals (SDG)
1. No poverty
Subjects
free text keywords: Cloud computing; Platform as a service; Containers; Software management; Advanced user interfaces; Authorization and authentication, Settore INF/01 - Informatica, Cloud Computing ; Platform as a Service ; Containers ; Software Management ; Advanced User Interfaces ; Authorization and Authentication, Computer Networks and Communications, Hardware and Architecture, Information Systems, Software, Cloud computing, Platform as a service, Containers, Software management, Advanced user interfaces, Authorization and authentication, CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL, DATA processing & computer science, Advanced user interfaces, Authorization and authentication, Cloud computing, Containers, Platform as a service, Software management, Computing, Advanced user interfaces; Authorization and authentication; Cloud computing; Containers; Platform as a service; Software management, 004, Software engineering, business.industry, business, Cloud computing, E infrastructure, Platform as a service, Computer science, Information system, Software, ddc:004
Communities
  • DARIAH EU
  • EGI Federation
Funded by
EC| INDIGO-DataCloud
Project
INDIGO-DataCloud
INtegrating Distributed data Infrastructures for Global ExplOitation
  • Funder: European Commission (EC)
  • Project Code: 653549
  • Funding stream: H2020 | RIA
,
EC| EOSC-hub
Project
EOSC-hub
Integrating and managing services for the European Open Science Cloud
  • Funder: European Commission (EC)
  • Project Code: 777536
  • Funding stream: H2020 | RIA
64 references, page 1 of 5

1. Garc´ıa, A.L., Castillo, E.F.-d., Puel, M.: Identity federation with VOMS in cloud infrastructures. In: 2013 IEEE 5Th International Conference on Cloud Computing Technology and Science, pp 42-48 (2013)

2. Chadwick, D.W., Siu, K., Lee, C., Fouillat, Y., Germonville, D.: Adding federated identity management to OpenStack. Journal of Grid Computing 12(1), 3-27 (2014) [OpenAIRE]

3. Craig, A.L.: A design space review for general federation management using keystone. In: Proceedings of the 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing, pp 720-725. IEEE Computer Society (2014)

4. Pustchi, N., Krishnan, R., Sandhu, R.: Authorization federation in iaas multi cloud. In: Proceedings of the 3rd International Workshop on Security in Cloud Computing, pp 63-71. ACM (2015)

5. Lee, C.A., Desai, N., Brethorst, A.: A Keystone-Based Virtual Organization Management System. In: 2014 IEEE 6Th International Conference On Cloud Computing Technology and Science (Cloudcom), pp 727-730. IEEE (2014)

6. Castillo, E.F.-d., Scardaci, D., Garc´ıa, A.L.: The EGI Federated Cloud e-Infrastructure. Procedia Computer Science 68, 196-205 (2015)

7. AARC project: AARC Blueprint Architecture, see https:// aarc-project.eu/architecture. Technical report (2016)

8. Oesterle, F., Ostermann, S., Prodan, R., Mayr, G.J.: Experiences with distributed computing for meteorological applications: grid computing and cloud computing. Geosci. Model Dev. 8(7), 2067-2078 (2015)

9. Plasencia, I.C., Castillo, E.F.-d., Heinemeyer, S., Garc´ıa, A.L., Pahlen, F., Borges, G.: Phenomenology tools on cloud infrastructures using OpenStack. The European Physical Journal C 73(4), 2375 (2013)

10. Boettiger, C.: An introduction to docker for reproducible research. ACM SIGOPS Operating Systems Review 49(1), 71-79 (2015)

11. Docker: http://www.docker.com (2013)

12. Gomes, J., Campos, I., Bagnaschi, E., David, M., Alves, L., Martins, J., Pina, J., Alvaro, L.-G., Orviz, P.: Enabling rootless linux containers in multi-user environments: the udocker tool. Computing Physics Communications. https://doi.org/10.1016/j.cpc.2018.05.021 (2018)

13. Zhang, Z., Chuan, W., Cheung, D.W.L.: A survey on cloud interoperability taxonomies, standards, and practice. SIGMETRICS perform. Eval. Rev. 40(4), 13-22 (2013)

14. Lorido-Botran, T., Miguel-Alonso, J., Lozano, J.A.: A Review of Auto-scaling Techniques for Elastic Applications in Cloud Environments. Journal of Grid Computing 12(4), 559-592 (2014)

15. Nyre´n, R., Metsch, T., Edmonds, A., Papaspyrou, A.: Open Cloud Computing Interface-Core. Technical report, Open Grid Forum (2010)

64 references, page 1 of 5
29 research outcomes, page 1 of 3
29 research outcomes, page 1 of 3
Abstract
This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications.
INDIGO-Datacloud has been funded by the European Commision H2020 research and innovation program under grant agreement RIA 653549.
Peer reviewed
Fields of Science and Technology classification (FOS)
02 engineering and technology, 0202 electrical engineering, electronic engineering, information engineering, 020201 artificial intelligence & image processing, 020203 distributed computing
Sustainable Development Goals (SDG)
1. No poverty
Subjects
free text keywords: Cloud computing; Platform as a service; Containers; Software management; Advanced user interfaces; Authorization and authentication, Settore INF/01 - Informatica, Cloud Computing ; Platform as a Service ; Containers ; Software Management ; Advanced User Interfaces ; Authorization and Authentication, Computer Networks and Communications, Hardware and Architecture, Information Systems, Software, Cloud computing, Platform as a service, Containers, Software management, Advanced user interfaces, Authorization and authentication, CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL, DATA processing & computer science, Advanced user interfaces, Authorization and authentication, Cloud computing, Containers, Platform as a service, Software management, Computing, Advanced user interfaces; Authorization and authentication; Cloud computing; Containers; Platform as a service; Software management, 004, Software engineering, business.industry, business, Cloud computing, E infrastructure, Platform as a service, Computer science, Information system, Software, ddc:004
Communities
  • DARIAH EU
  • EGI Federation
Funded by
EC| INDIGO-DataCloud
Project
INDIGO-DataCloud
INtegrating Distributed data Infrastructures for Global ExplOitation
  • Funder: European Commission (EC)
  • Project Code: 653549
  • Funding stream: H2020 | RIA
,
EC| EOSC-hub
Project
EOSC-hub
Integrating and managing services for the European Open Science Cloud
  • Funder: European Commission (EC)
  • Project Code: 777536
  • Funding stream: H2020 | RIA
64 references, page 1 of 5

1. Garc´ıa, A.L., Castillo, E.F.-d., Puel, M.: Identity federation with VOMS in cloud infrastructures. In: 2013 IEEE 5Th International Conference on Cloud Computing Technology and Science, pp 42-48 (2013)

2. Chadwick, D.W., Siu, K., Lee, C., Fouillat, Y., Germonville, D.: Adding federated identity management to OpenStack. Journal of Grid Computing 12(1), 3-27 (2014) [OpenAIRE]

3. Craig, A.L.: A design space review for general federation management using keystone. In: Proceedings of the 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing, pp 720-725. IEEE Computer Society (2014)

4. Pustchi, N., Krishnan, R., Sandhu, R.: Authorization federation in iaas multi cloud. In: Proceedings of the 3rd International Workshop on Security in Cloud Computing, pp 63-71. ACM (2015)

5. Lee, C.A., Desai, N., Brethorst, A.: A Keystone-Based Virtual Organization Management System. In: 2014 IEEE 6Th International Conference On Cloud Computing Technology and Science (Cloudcom), pp 727-730. IEEE (2014)

6. Castillo, E.F.-d., Scardaci, D., Garc´ıa, A.L.: The EGI Federated Cloud e-Infrastructure. Procedia Computer Science 68, 196-205 (2015)

7. AARC project: AARC Blueprint Architecture, see https:// aarc-project.eu/architecture. Technical report (2016)

8. Oesterle, F., Ostermann, S., Prodan, R., Mayr, G.J.: Experiences with distributed computing for meteorological applications: grid computing and cloud computing. Geosci. Model Dev. 8(7), 2067-2078 (2015)

9. Plasencia, I.C., Castillo, E.F.-d., Heinemeyer, S., Garc´ıa, A.L., Pahlen, F., Borges, G.: Phenomenology tools on cloud infrastructures using OpenStack. The European Physical Journal C 73(4), 2375 (2013)

10. Boettiger, C.: An introduction to docker for reproducible research. ACM SIGOPS Operating Systems Review 49(1), 71-79 (2015)

11. Docker: http://www.docker.com (2013)

12. Gomes, J., Campos, I., Bagnaschi, E., David, M., Alves, L., Martins, J., Pina, J., Alvaro, L.-G., Orviz, P.: Enabling rootless linux containers in multi-user environments: the udocker tool. Computing Physics Communications. https://doi.org/10.1016/j.cpc.2018.05.021 (2018)

13. Zhang, Z., Chuan, W., Cheung, D.W.L.: A survey on cloud interoperability taxonomies, standards, and practice. SIGMETRICS perform. Eval. Rev. 40(4), 13-22 (2013)

14. Lorido-Botran, T., Miguel-Alonso, J., Lozano, J.A.: A Review of Auto-scaling Techniques for Elastic Applications in Cloud Environments. Journal of Grid Computing 12(4), 559-592 (2014)

15. Nyre´n, R., Metsch, T., Edmonds, A., Papaspyrou, A.: Open Cloud Computing Interface-Core. Technical report, Open Grid Forum (2010)

64 references, page 1 of 5
29 research outcomes, page 1 of 3
29 research outcomes, page 1 of 3
Any information missing or wrong?Report an Issue