The PON RECAS Infrastructure: present and future of grid/cloud computing and connectivity Guido Russo Università di Napoli Federico II & INFN Napoli On behalf of the ReCaS Collaboration KM3NeT Workshop, June 26th, 2013, INFN-LNS Catania Le regioni “Convergenza" The goals of the cohesion policy 2007/2013 Convergence: This goal refers to member states whose annual production value, averaged over all inhabitants, is less than 75% of the European union average. The goal is, of course, to decrease this difference. To reach the above mentioned goal, each membnre state has to act at regional level. In Italym there are four regions which are eligible for european benefits, that is european fundings: Campania, Puglia, Calabria and Sicilia. Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 2 The PON - Programma Operativo Nazionale Research and competitivity, 2007-2013 The National Operational Programme «Research and Competitivity» 20072013 (PON "R&C") is the organizational tool used in Italy to implement the cohesion policy. It is only devoted to the four «converging» regions. A significative part of the european fundings will be devoted to research activities, with the aim to stimulate the local companies. The overall sum to share is 6 billion euros, to share between public research institutions and private companies. The R&C Programme is divided into several subactivities, as shown below (picture taken from ministry sources, www.ponrec.it): Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 3 Our experience with PON 2000-2006 Programma Operativo Nazionale 2000-2006 “Research, Technological Development, High Level Learning” Axis II “Strengthening the scientific system in southern Italy” Measure II.2 “Information Society in Southern Italy” Action a – Computer Systems – High Level computing Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 4 An “Interoperability group” among five project was set up by our Ministry (MIUR) The group was coordinated by L. Merola, INFN and UniNA Results: Technical results on the interoperability among different platforms. Creation of a Collaboration Group named GRISU’ (Griglia del Sud) Partecipation to IGI/EGI SPACI GARR Other Institutions PI2S2 Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 5 The ReCaS PON Rete di Calcolo per SuperB e altre applicazioni Total fundings assigned: 13.7 M€ (instead of 44) Duration of the project: 1 October 2011 – 30 September 2014 A total of 47 projects out of 83 presented, have been funded, for an overall investment of 641,450 M€ Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 6 Subdivision of the Budget among the 3 Institutions UNINA UNIBA INFN-NA INFN-BA INFN-CT INFN-CS POTENZIAMENTO FORMAZIONE € 1.912.632 € 215.800 € %2.128.432 su Potenziamento: € 4.236.328 € 460.863 € 4.697.191 % CPU and storage € 1.234.217 € 107.495 € 40 1.341.712 % Networks € 1.730.688 € 190.153 € 10 1.920.841 30 % Infrastructure € 2.073.000 € 213.385 € 2.286.385 15 % Personnel € 1.250.439 € 75.000 € 1.325.439 € 12.437.304 € 1.262.696 € 13.700.000 Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 7 Original goals of the ReCaS project • Realization of a distributed infrastructure in southern Italy, with 4 main Data Centers: – Bari (partner INFN and UNIBA) – Napoli (partner INFN and UNINA) – Catania (partner INFN) – Cosenza (partner INFN) • To give support to several communities: – INFN Superb – Research groups in Physics, enviromental studies. Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania Health Sciences, Bioinformatics, 8 Changes in itinere The SuperB project was cancelled in october 2012 The other research group are still active and need support A new major user was introduced: the L H C experimens (ATLAS; CMS; ALICE; LHCb). ReCaS will be for the next three years the main computing facility in Italy for LHC Pledged resources (CPU, storage) for ATLAS and CMS and ALICE agli esperimenti LHC alle applicazioni scientifiche dei tre enti (INFN, UniNA e UniBA) ad altre applicazioni per le Imprese e la Pubblica amministrazione, Everything will be done in collaboration with other important institutions, e.g. GARR for internetworking and for the general scientific Italian cloud to. Note: the GARR Consortium has a new organziational structure, with a Network Department and a Computing Department Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 9 Internal organization for PON RECAS ( based on a MoU between INFN, UniNA, UniBA ) • • • Responsible for Building Up the infrastructure: Leonardo Merola (UNINA) Responsible for Learning activities: Roberto Bellotti (UNIBA) Responsible for contacts with funding agency: Guido Russo (UNINA) • A group of 9 scientist for strategical decisions 21 meeting so far (most via video/phone conferences) • A group of 9 scientist for learning activities: • • Coordinator for I level Master activities(UniNA): G. Laccetti Coordinator for I level Master activities(UnBA): R. Bellotti • Technical Group: Giuseppe Andronico (INFN-CT, coordinator). Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 10 Control Activities by funding Agency (MIUR) A general control session every six months Two scientific and technical referees: Domenico Laforenza (CNR), Francesco Beone (ENEA) One Project Officer: Laura Panunzio (MIUR) Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 11 Author List as of 2013.june.24th RECAS Collaboration Andronico G. a, Barbera R. b, Bellotti R. c, Boccia V. d, Bruno G.E. c, Bruno R. a, C afagna F. f , Carlino G. d, De Nardo G. e, Diacono D. f, Di Bari D. c, Donvito G. f, Doria A. d, Fargetta M. a, Laccetti G. e, Lapegna M. e, La Rocca G. a, Lattanzi G. c, Lo Re P. d, Maggi G. g, Mastroserio P. d, Merola L. e, Monaco A. c, Monforte S. a, Nuzzo S.V. c, Pardi S. d, Pompili A. c, Russo G. e, Selvaggi G. c, Silvestris L.f, Spinoso V. f, Stramaglia S. c, Tangaro S. f, Tarasio A. h, Tassi E. i a INFN sezione di Catania b Università di Catania e INFN sezione di Catania c Università di Bari Aldo Moro e INFN sezione di Bari d INFN sezione di Napoli e Università di Napoli Federico II e INF sezione di Napoli f INFN sezione di Bari g Politecnico di Bari e INFN sezione di Bari h INFN sezione di Napoli e INFN gruppo collegato di Cosenza i Università della Calabria e INFN gruppo collegato di Cosenza Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 12 Interactions with other projects • The ReCaS project is collaborating and will interoperate with a number of other projects, all over Europe, and with a number of other Institutions Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 13 Some of the products of the WPs • The four centers are working to buiold a series of software packages, to support the needs of the above mentioned communities • A short list of products follows: – – – – – – – Portal for accessing the resources Integration between Grid and Cloud services in a single, open sources, solution Science Gateways for an easier access Offering of virtualized computing and storage resources A single, integrated monitoring and control subsystem for distributed Data Centers Solutions for CPU/GPU integration Solutions for parallel and distributed file system Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 14 The model of the ReCaS sites Most of the hardware is under acquisition in these months. Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 15 The network connectivity (guaranteed by GARR) Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 16 Quantification of the resources (computing and storage) TOT 2.598 euro 1. 2. 3. The left table shows the list of resources under acquisition for INFN only Some of these resources will be pledged to LHC experiments Similar resources for UniNA and UNIBA Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 17 ReCas in NAPOLI 2 separated, but interconnected, sites • • • • A farm dedicated to develpoment and bechmarking: GlusterFS - Network 10GbE - GPGPU - Monitoring Production Farm – UNINA, INFN-NA Work for site expansion at INNF-NA already started (up to 12 more racks) Work for CPU, storage and network at UniNA in progress S.CO.P.E. Dept.PHYSICS/INFN CAMPUS GRID Monte Sant’Angelo Chemistry ai GARR Mathematics C.S.I. Data center SCOPE: 3000 cores, 300 TB + part of ATLAS Tier2 Cabina elettrica Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 1 MW 18 TIER 2 ATLAS ReCaS in Napoli Data Center SCoPE UniNA TIER 2 ATLAS POP GARR-X M.S. Angelo 10 Gbit 1 Gbit INFN NAPOLI 2x10 Gbit 1 Gbit 1 Gbit 1 Gbit 2x1 Gbit Control room remota ATLAS / CMS TIER 2 ATLAS UNINA TIER2 SCOPE 2x10 Gbit 19 ReCaS site in BARI A completely new Data Center is being built; tenders is under way, more than 2 M€ invested. 50 racks, including new power system, cooling, control room. Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 20 ReCaS site in BARI Development Farm UniBA+INFN already running (200 core, 400 TB) • Storage (HDFS) • Batch sytem (SLURM) • Production Monitoring (aggregated backend) Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 21 ReCaS site in CATANIA Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 22 ReCaS site in Cosenza • Sala 1 Sala 2 Sala 3 Sala 4 Sala 5 Fare clic per modificare stili del testo dello TIER 3 schema ATLAS Secondo livello RECAS Terzo livello Quarto livello Quinto livello 23 Teaching activities CASAP (CAlcolo Scientifico ad Alte Prestazioni) - A first level master in Napoli - A second level master in Bari - Summer schools in Catania and Cosenza Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 24 PON PRISMA (Avviso 84 Ric./2012) PON 2007-2013, SMART CITIES AND COMMUNITIES AND SOCIAL INNOVATION - AMBITO: Cloud Computing per smart technologies PIATTAFORME CLOUD INTEROPERABILI PER SMART-GOVERNMENT INFN together with 14 partners Total funding: euro 27.500.000 Money for INFN: euro 2.628.000 The project is developing an open-source software platform for Cloud Computing, based on Open Stack and other tools, dedicated to public entities. Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 25 GARR-X «PROGRESS» Proposing entity: GARR Consortium on behalf of the scientific community (INFN, ENEA, CNR, universities) Total funding: euro 46.500.000 First goal: high throughput network Second goal: cloud computing platform, hardware, software, resources Reruitment: already started Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 26 CONCLUSIONS • ReCaS will soon become a running infrastructure. • • The reference user is a scientist working on LHC experiments All physics experiments can be supported, thanks to a grid/cloud mixed environment • The computing model of each experiment must be investigated to understand how to make the best use of ReCaS • ReCaS has to be integrated with new GARR infrastructure (also in southern Italy) Workshop KM3NeT, June 26th, 2013, INFN-LNS Catania 27