Seminario – Portici 10.06.2009 ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT www.cresco.enea.it [email protected] ENEA-GRID and CRESCO project as part of Gateway infrastructure Silvio Migliori Andrea Quintiliani Salvatore Podda Giovanni Bracco Samuele Pierattini * * ENEA-Dipartimento Tecnologie Fisiche e Nuovi Materiali (FIM) Contents ENEA-GRID infrastructure (www.afs.enea.it/project/eneagrid) CRESCO project and the “Virtual Lab” (www.cresco.enea.it) www.cresco.enea.it [email protected] THE CONCEPT OF ENEA GRID INFRASTRUCTURE By-Mark Ellisman DATA ACQUISITION DATA ANALYSIS ADV.-COMP.-GRAPHICS NETWORK Cell Centered Data Base “CCDB” QuickTi me™ and a YU V420 codec decompressor are needed to see thi s pi ctur e. IMAGING-INSTRUMENTS COMP.-RESOURCES MULTI-SCALE-DATA-BASES www.cresco.enea.it [email protected] ENEA-GRID Born in 1998 with 6 Italian geographic clusters Main aim – Give to ENEA researchers a unified environment to use in an easy way heterogeneous computers and applications software – Build an homogeneous ICT infrastructure but with a distributed and delegated control – Integrate the ENEA-GRID with National and International GRIDS Application Software catalogs User Collective Resource Computers ENEA-GRID www.afs.enea.it/project/eneagrid Sensor nets Connectivity Fabric Colleagues & 3D www.cresco.enea.it Data archives [email protected] ENEA-GRID from the user point of view Main feature: – – – – – Access from any kind of connection Sharing data in world wide areas (geographical file system AFS) Access to the data from any kind of digital device client Running any kind of programs Access to National and International GRIDS ENEA-GRID Computers Computers Computers Computers Data archives Computers Sensor nets Sensor nets Software catalogs Trisaia Brindisi Portici ( Roma-1 Roma-2 Bologna www.cresco.enea.it EU… [email protected] ENEA-GRID from application point of view Potentiality: – – – – – Running all Software Model for any kind of computer architecture Only one installation for each software for all geographical computers All authorized users can have access the software from local site Any application can share the data in the common geographical file system All sensors can share the data easily using the geographical file systems Computers ENEA-GRID Software Model 1 Computers Computers Software Model 2 Rules Software Model 3 Computers Sensor nets Sensor nets Software Model .. Software catalogs Trisaia Brindisi Portici ( Roma-1 Roma-2 Bologna www.cresco.enea.it EU… [email protected] ENEA GRID WEB ICA Application Portal (ICA-Protocol) Monitoring, Automatic recovery Accaunting Quality of service Graphical User Interface User programs and commercial codes LSF multi-cluster as integrator LSF XTERM AFS Geographical cross platform & File System AIX SGI SUN HP Win www.cresco.enea.it Linux Linux Alpha [email protected] … A Simple view of ENEA GRID WEB ICA User programs & commercial code Graphic User Interface LSF multi-cluster as integrator Load LevelerTelnet LSF WEB WEB ICA ICA Cluster 5° ( Portici) Graphic User Interface Load Leveler Telnet User programs & commercial code Graphic User Interface LSF multi-cluster as integrator LSF Load Leveler & File System Telnet LSF AFS Geographical cross platform& File System Cluster 6° ( Brindisi) WEB Cluster 2° (Casaccia) ICA WEB ICA WEB User programs & commercial code Graphic User Interface LSF multi-cluster as integrator Load Leveler Telnet LSF AFS Geographical cross platform& File System User programs & commercial code Graphic User Interface LSF multi-cluster as integrator Load Leveler Telnet LSF AFS Geographical cross platform& File System ICA User programs & commercial code Graphic User Interface LSF multi-cluster as integrator Load Leveler Telnet LSF AFS Geographical cross platform& File System Cluster 1° ( Bologna) Cluster 3° (Frascati) Cluster 4° (Trisaia ) www.cresco.enea.it [email protected] 8 ENEA-GRID Computational & 3D Centers Ispra Saluggia 30 BOLOGNA S.Teresa #CPU/Core CASACCIA 140 FRASCATI Manfredonia 400 PORTICI 2750 90 45 BRINDISI TRISAIA www.cresco.enea.it [email protected] ENEA-GRID Computational Resources #CPU/Core Gflops AIX >300 3000 Linux x86 32/64 >3000 25000 Linux IA64 (Altix) 64 300 IRIX 26 40 Frascati(8), Casaccia(4), Portici(1),Trisaia(8), Brindisi(1), Bologna(5) Solaris 8 10 Trisaia(4), Casaccia(2), Bologna(2) Windows 32/64 46 100 Mac OS X 14 60 OS Frascati(258), Bologna(24), Portici(18),Brindisi(2) Frascati(140), Casaccia(54), Portici(2700),Trisaia(20), Brindisi(84) Casaccia Frascati(4), Portici(34),Trisaia(4), Brindisi(4) Frascati(1), Trisaia(13) Computational resources of Portici (NA) , Brindisi e Trisaia (MT) have been financed by Ministry of Research PON TELEGRID (Avv. MIUR 68) CRESCO (Avv. MUR 1575) www.cresco.enea.it [email protected] HPC CRESCO INFRASTRUCTURE Backup system CRESCO 17 TFlops SERVERS BACKUP IB Interconnections InfiniBand 4XDDR IB 3 Nodi IBM 3650 FC SERVERS GPFS 4 Nodi IBM 3650 FC 300 TByte IBM Tape Library TS3500 with 4 drives High speed disc 2 GByte/s 160 TByte IBM/DDN 9550 Section 1 Section 2 (Large memory) (MPP) 42 Nodi SMP IBM x3850-M2 with 4 Xeon Quad-Core Tigerton E7330 (32/64 GByte RAM 2.4GHz/ 1066MHz/6MB L2) total 672 cores Intel Tigerton 256 Nodi blades IBM HS21 with 2 Xeon Quad-Core Clovertown E5345 (2.33GHz/1333MH z/8MB L2), 16 GB RAM total 2048 cores Intel Clovertown Section 3 (Special) 4 Nodi blades IBM QS21 con 2 Cell BE Processors 3.2 Ghz each. 6 Nodi IBM x3755, 8 Core AMD 8222 FPGA VIRTEX5 4 Nodi IBM x 3755, 8 core AMD 8222 with NVIDIA Quadro FX 4500 X2 4 Nodi windows 8 core 16 Byte RAM Double interconnection at 1 Gbit & 1 network at 1 Gbit for management 35 Node for services Servers for : •Front-end •installations •AFS •… 4x10 Gbits Portici LAN www.cresco.enea.it 400 /1000 Mbits [email protected] GARR (WAN) CRESCO HPC hall www.cresco.enea.it [email protected] CRESCO HPC details Sections 1 & 3 Control room Corridor hot Sections 1 &2 network: IB/GB www.cresco.enea.it Section 2 & DDN backup system [email protected] CRESCO in the Top500 List June 2008 Italy (06/2008) 90 CINECA 125 ENEA 131 ENI 135 CILEA 156 CINECA 226 Telecom Jack Dongarra 2002 www.cresco.enea.it [email protected] Computational ability ENEA-GRID & CRESCO An heterogeneous system with more than 3000 CPU/cores Code Risorsa Serial Section 1 & ENEA-GRID Parallel hardly coupled Section 2 Embarrassing parallel Section 1, 2, ENEA-GRID System with several parallel codes Section 1, 2, Section 1+2 Special ( FPGA, GB, CELL) Section 3 windows (serial and parallel) Section 3 Not LINUX ENEA-GRID Large date “Data Base” Section 1,2,3 e GPFS www.cresco.enea.it [email protected] ENEA GRID and experimental facilities DNA Sequence system ( ABI Prism 3700) Trisaia DB_2 ENEA GRID Controlled Nuclear Fusion: FTU Frascati Tokamak Upgrade Video Acquisition WEB ICA SSH CPUS DB_1 DB_3 Electron Microscope (Brindisi) 300 KeV (sept. 2004) www.cresco.enea.it [email protected] La ENEA-GRID interoperability with others GRID ENEA has been developing the “shared proxy” solution EGEE ? EFDA •Maintain the GRID internal architecture and autonomy •Allow multiplatform impementations GARR GARR •Under production on EGEE Others Entity PI2S2 •Under production on GRISU •Required by EFDA for EGEE www.cresco.enea.it [email protected] ENEA-GRID & GRISU & IGI Ispra Saluggia IGI Italian GRID Infrastructure BOLOGNA S.Teresa CASACCIA Manfredonia FRASCATI PORTICI BRINDISI TRISAIA GRISU SPACI www.cresco.enea.it [email protected] CRESCO for EUROPEAN FUSION IB Cresco 25 Tflops pick System for development and test of computational codes for ITER (EFDA contract) 1 Tflops pick www.cresco.enea.it [email protected] GEANT 2008 boquad.bologna.enea.it dafne.casaccia.enea.it sp5_-1.frascati.enea.it ostro.portici.enea.it Portici infocal.trisia.enea.it Gateway to EGEE & GRISU Brindisi Accesso WEB ercules.brindisi.enea.it Accesso Client www.cresco.enea.it www.afs.enea.it/project/eneagrid Accesso [email protected] Diretto Main Interface ENEA GRID makes use of Citrix Metaframe to publish an application providing a unified GUI interface all the available resources Application components: ● Java (GUI) ● shell scripts ● EnginFrame www.cresco.enea.it [email protected] ENEA-GRID & CRESCO CRESCO is totally integrate in ENEA-GRID www.cresco.enea.it [email protected] Sicurezza ENEA External Users Sicurezza industriale Example of use of FLUENT on ENEA-GRID Submissions options Fluent options www.cresco.enea.it [email protected] New web Interface Es. Applicazione New Accesso web Interfaccia Specialistica www.cresco.enea.it Es. Xterm [email protected] ENEA-GRID & Virtual Lab architecture ENEA Li University and research institute Enterprise New collaborations www.cresco.enea.it [email protected] ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT www.cresco.enea.it [email protected]