CRESCO Meeting
Portici 30.Sett. 2008
ITALIAN NATIONAL AGENCY
FOR NEW TECNOLOGY, ENERGY
AND THE ENVIRONMENT
www.cresco.enea.it
[email protected]
ENEA-GRID and CRESCO project
Silvio Migliori, Giovanni Bracco, Salvatore Podda
ENEA-Dipartimento Tecnologie Fisiche e Nuovi Materiali (FIM)
Contents
ENEA-GRID infrastructure
(www.afs.enea.it/project/eneagrid)
CRESCO
project and the “Virtual Lab”
(www.cresco.enea.it)
www.cresco.enea.it
[email protected]
Ringraziamenti (1)







Ministero della Ricerca e dell’Università (MUR)
Direzione dell’ENEA
Capo Dipartimento Ing. Sandro Taglienti
Comitato Scientifico: J. Dongarra, A. Mathis, D.
Ferrari
Macrostruttura di progetto : Andrea Quintiliani, Vittorio
Rosato, Sandro Bologna
Collaboratori direttamente coinvolti : Giovanni Bracco,
Salvatore Podda, Samuele Pierattini, Pietro D’Angelo,
Daniele Remoli, Pasquale Cuomo, Francesco Beone,
Antonio Perozziello, Carlo Pinto, Erminia Mattei, Gloria
Tabili, Nadia Mencucci, CaterinaVinci, Dante Giammattei,
Alessandro De Stefano,Vincenzo Colaci,Gaziano Furini,
Matteo De Rosa
Il personale dell’Unità FIM-INFOGER coordinato da
Roberto Guadagni
www.cresco.enea.it
[email protected]
Ringraziamenti (2)






Il personale del Centro ENEA di Portici e il Direttore Ezio
Terzini
I ricercatori assegnisti di ricerca del progetto CRESCO
Università, Consorzi e Società Partner di progetto
Tutti i Ricercatori ENEA ed i rispettivi responsabili
coinvolti (circa 60 ricercatori dei Centri di Bologna,
Casaccia, Frascati, Portici, Trisaia, Brindisi)
I ricercatori che per primi hanno utilizzato il sistema ed
hanno condiviso con noi le problematiche iniziali
Il personale della ditta Computer Var e IBM per la
realizzazione dell’infrastruttura
www.cresco.enea.it
[email protected]
ENEA-GRID


Born in 1998 with 6 Italian geographic clusters
Main aim
– Give to ENEA researchers a unified environment to use in an easy way
heterogeneous computers and applications software
– Build an homogeneous ICT infrastructure but with a distributed and
delegated control
– Integrate the ENEA-GRID with National and International GRIDS
Application
Software
catalogs
User
Collective
Resource
Computers
ENEA-GRID
www.afs.enea.it/project/eneagrid
Sensor nets
Connectivity
Fabric
Colleagues & 3D
www.cresco.enea.it
Data archives
[email protected]
ENEA-GRID from the user point of view
Main feature:
–
–
–
–
–
Access from any kind of connection
Sharing data in world wide areas (geographical file system AFS)
Access to the data from any kind of digital device client
Running any kind of programs
Access to National and International GRIDS
ENEA-GRID

Computers
Computers
Computers
Computers
Data archives
Computers
Sensor nets
Sensor nets
Software catalogs
Trisaia
Brindisi
Portici
(
Roma-1 Roma-2 Bologna
www.cresco.enea.it
EU…
[email protected]
ENEA-GRID from application point of view
Potentiality:
–
–
–
–
–
Running all Software Model for any kind of computer architecture
Only one installation for each software for all geographical computers
All authorized users can have access the software from local site
Any application can share the data in the common geographical file system
All sensors can share the data easily using the geographical file systems
Computers
ENEA-GRID

Software Model 1
Computers
Computers
Software Model 2
Rules
Software Model 3
Computers
Sensor nets
Sensor nets
Software Model ..
Software catalogs
Trisaia
Brindisi
Portici
(
Roma-1 Roma-2 Bologna
www.cresco.enea.it
EU…
[email protected]
ENEA GRID
WEB
ICA
Application Portal (ICA-Protocol)
Monitoring, Automatic recovery
Accaunting
Quality of service
Graphical User Interface
User programs and commercial codes
LSF multi-cluster as integrator
LSF
XTERM
AFS Geographical cross platform & File System
AIX
SGI
SUN
HP
Win
www.cresco.enea.it
Linux
Linux
Alpha
[email protected]
…
A Simple view of ENEA GRID
WEB
ICA
User programs & commercial code
Graphic User Interface
LSF multi-cluster as integrator
Load LevelerTelnet
LSF
WEB
WEB
ICA
ICA
Cluster 5° ( Portici)
Graphic User Interface
Load Leveler
Telnet
User programs & commercial code
Graphic User Interface
LSF multi-cluster as integrator
LSF
Load Leveler
& File System
Telnet
LSF
AFS Geographical cross platform& File System
Cluster 6° ( Brindisi)
WEB
Cluster 2° (Casaccia)
ICA
WEB
ICA
WEB
User programs & commercial code
Graphic User Interface
LSF multi-cluster as integrator
Load Leveler
Telnet
LSF
AFS Geographical cross platform& File System
User programs & commercial code
Graphic User Interface
LSF multi-cluster as integrator
Load Leveler
Telnet
LSF
AFS Geographical cross platform& File System
ICA
User programs & commercial code
Graphic User Interface
LSF multi-cluster as integrator
Load Leveler
Telnet
LSF
AFS Geographical cross platform& File System
Cluster 1° ( Bologna)
Cluster 3° (Frascati)
Cluster 4° (Trisaia )
www.cresco.enea.it
[email protected]
9
ENEA-GRID Computational & 3D Centers
Ispra
Saluggia
30
BOLOGNA
S.Teresa
#CPU/Core
CASACCIA
140
FRASCATI
Manfredonia
400
PORTICI
2750
90
45
BRINDISI
TRISAIA
www.cresco.enea.it
[email protected]
ENEA-GRID Computational Resources
#CPU/Core
Gflops
AIX
>300
3000
Linux x86 32/64
>3000
25000
Linux IA64 (Altix)
64
300
IRIX
26
40
Frascati(8), Casaccia(4),
Portici(1),Trisaia(8), Brindisi(1),
Bologna(5)
Solaris
8
10
Trisaia(4), Casaccia(2), Bologna(2)
Windows 32/64
46
100
Mac OS X
14
60
OS
Frascati(258), Bologna(24),
Portici(18),Brindisi(2)
Frascati(140), Casaccia(54),
Portici(2700),Trisaia(20), Brindisi(84)
Casaccia
Frascati(4), Portici(34),Trisaia(4),
Brindisi(4)
Frascati(1), Trisaia(13)
Computational resources of Portici (NA) , Brindisi e Trisaia (MT) have been financed
by Ministry of Research PON TELEGRID (Avv. MIUR 68) CRESCO (Avv. MUR 1575)
www.cresco.enea.it
[email protected]
HPC CRESCO INFRASTRUCTURE
Backup system
CRESCO
17 TFlops
SERVERS BACKUP
IB
Interconnections InfiniBand
4XDDR
IB
3 Nodi IBM 3650
FC
SERVERS GPFS
4 Nodi IBM 3650
FC
300 TByte
IBM Tape Library
TS3500 with 4 drives
High speed disc
2 GByte/s
160 TByte
IBM/DDN 9550
Section 1
Section 2
(Large memory)
(MPP)
42 Nodi SMP IBM
x3850-M2 with 4
Xeon Quad-Core
Tigerton E7330
(32/64 GByte RAM
2.4GHz/
1066MHz/6MB L2)
total 672 cores
Intel
Tigerton
256 Nodi blades
IBM HS21 with 2
Xeon Quad-Core
Clovertown E5345
(2.33GHz/1333MH
z/8MB L2), 16 GB
RAM total 2048
cores Intel
Clovertown
Section 3
(Special)
4 Nodi blades IBM
QS21 con 2 Cell BE
Processors 3.2 Ghz
each.
6 Nodi IBM x3755, 8
Core AMD 8222
FPGA VIRTEX5
4 Nodi IBM x 3755,
8 core AMD 8222 with
NVIDIA Quadro FX
4500 X2
4 Nodi windows 8
core 16 Byte RAM
Double interconnection at 1 Gbit
& 1 network at 1 Gbit for management
35 Node for services
Servers for :
•Front-end
•installations
•AFS
•…
4x10 Gbits
Portici
LAN
www.cresco.enea.it
1000 Mbits
GARR
(WAN)
1000 Mbits
[email protected]
CRESCO HPC hall
www.cresco.enea.it
[email protected]
CRESCO HPC details
Sections 1 & 3
Control room
Corridor hot
Sections 1 &2
network: IB/GB
www.cresco.enea.it
Section 2 & DDN
backup system
[email protected]
Computational ability
ENEA-GRID & CRESCO
An heterogeneous system with more than 3000 CPU/cores
Code
Risorsa
Serial
Section 1 & ENEA-GRID
Parallel hardly coupled
Section 2
Embarrassing parallel
Section 1, 2, ENEA-GRID
System with several parallel
codes
Section 1, 2, Section 1+2
Special ( FPGA, GB, CELL)
Section 3
windows (serial and parallel)
Section 3
Not LINUX
ENEA-GRID
Large date “Data Base”
Section 1,2,3 e GPFS
www.cresco.enea.it
[email protected]
CRESCO in the Top500 List June 2008
Italy (06/2008)
90
CINECA
125
ENEA
131
ENI
135
CILEA
156
CINECA
226
Telecom
Jack Dongarra 2002
www.cresco.enea.it
[email protected]
ENEA GRID and experimental facilities
DNA Sequence
system
( ABI Prism 3700)
Trisaia
DB_2
ENEA GRID
Controlled Nuclear Fusion:
FTU
Frascati Tokamak Upgrade
Video Acquisition
WEB
ICA
SSH
CPUS
DB_1
DB_3
Electron Microscope
(Brindisi)
300 KeV (sept. 2004)
www.cresco.enea.it
[email protected]
La ENEA-GRID interoperability with others GRID
ENEA has been
developing the “shared
proxy” solution
EGEE
?
EFDA
•Maintain the GRID internal
architecture and autonomy
•Allow multiplatform
impementations
GARR
GARR
•Under production on EGEE
Others Entity
PI2S2
•Under production on GRISU
•Required by EFDA for EGEE
www.cresco.enea.it
[email protected]
ENEA-GRID & GRISU & IGI
Ispra
Saluggia
IGI
Italian GRID
Infrastructure
BOLOGNA
S.Teresa
CASACCIA
Manfredonia
FRASCATI
PORTICI
BRINDISI
TRISAIA
GRISU
SPACI
www.cresco.enea.it
[email protected]
CRESCO for EUROPEAN FUSION
IB
Cresco 25 Tflops peak
System for development and test of
computational codes for
ITER (EFDA contract)
1 Tflops peak
www.cresco.enea.it
[email protected]
GEANT
2008
boquad.bologna.enea.it
dafne.casaccia.enea.it
sp4_-1.frascati.enea.it
Kleos.portici.enea.it
Portici
infocal.trisia.enea.it
Gateway
to
EGEE & GRISU
Brindisi
Accesso
WEB
ercules.brindisi.enea.it
Accesso
Client
www.cresco.enea.it
www.afs.enea.it/project/eneagrid
Accesso
[email protected]
Diretto
ENEA-GRID & CRESCO
CRESCO is totally integrate
in ENEA-GRID
www.cresco.enea.it
[email protected]
Sicurezza ENEA
External Users
Sicurezza industriale
Example of use of FLUENT on
ENEA-GRID
Submissions options
Fluent options
www.cresco.enea.it
[email protected]
ENEA-GRID & Virtual Lab
architecture
ENEA
Li
University
and research
institute
Enterprise
New collaborations
www.cresco.enea.it
[email protected]
Per lavorare con CRESCO
www.cresco.enea.it
www.cresco.enea.it
[email protected]
ITALIAN NATIONAL AGENCY
FOR NEW TECNOLOGY, ENERGY
AND THE ENVIRONMENT
www.cresco.enea.it
[email protected]