Infrastruttura & Competenze ICT ENEA
Incontro
Confindustria Monza Brianza (7-3-2012)
ITALIAN NATIONAL AGENCY
FOR NEW TECNOLOGY, ENERGY
AND THE ENVIRONMENT
www.utict.enea.it
[email protected]
www.cresco.enea.it
L'infrastruttura ICT dei laboratori virtuali ENEA a
supporto della ricerca industria & territorio
Silvio Migliori
ENEA-Unità Tecnica Sviluppo sistemi per l'informatica e l'ICT (UTICT)
Contents
Infrastruttura
Approccio
www.utict.enea.it
ENEA-ICT & GRID/CLOUD
Metodologico “Virtual Lab”
[email protected]
www.cresco.enea.it
ENEA-GRID Story


Born in 1998 with 6 Italian geographic clusters
Main aim
– Give to ENEA researchers a unified environment to use in an easy way
heterogeneous computers and applications software
– Build an homogeneous ICT infrastructure but with a distributed and
delegated control
– Integrate the ENEA-GRID with National and International GRIDS
Application
Software
catalogs
User
Collective
Resource
Computers
ENEA-GRID
www.afs.enea.it/project/eneagrid
Sensor nets
Connectivity
Colleagues & 3D
Fabric
www.utict.enea.it
[email protected]
Data archives
www.cresco.enea.it
THE CONCEPT OF ENEA GRID INFRASTRUCTURE
By-Mark Ellisman
DATA ACQUISITION
DATA ANALYSIS
ADV.-COMP.-GRAPHICS
NETWORK
Cell Centered Data Base
“CCDB”
QuickTi me™ and a YU V420 codec decompressor are needed to see thi s pi ctur e.
IMAGING-INSTRUMENTS
COMP.-RESOURCES
www.utict.enea.it
[email protected]
MULTI-SCALE-DATA-BASES
www.cresco.enea.it
Softwares
Code
FLUENT, OpenFoam
ANSYS,ABAQUS,
NASTRAN
FLUKA,ERANOS
MCNP, MCNPX
MpCCI
USER codes
Web access
Application field
CFD
Structures
Nuclear
Neutronics
Fluid-structure interaction
Any type and platform
Instruments
www.utict.enea.it
[email protected]
www.cresco.enea.it
ENEA-GRID concept
Potentiality:
–
–
–
–
–
Running all Software Model for any kind of computer architecture
Only one installation for each software for all geographical computers
All authorized users can have access the software from local site
Any application can share the data in the common geographical file system
All sensors can share the data easily using the geographical file systems
Computers
ENEA-GRID

Computers
Computers
Software Model 2
Rules
Software Model 3
Computers
Sensor nets
Sensor nets
Software Model 1
Software Model ..
Software catalogs
Trisaia
Brindisi
www.utict.enea.it
Portici
(
Roma-1 Roma-2 Bologna
[email protected]
EU…
www.cresco.enea.it
ENEA-GRID Computational & 3D Centers
Ispra
(more then 4000 core)
Saluggia
30
BOLOGNA
S.Teresa
#CPU/Core
CASACCIA
200
FRASCATI
Manfredonia
900
PORTICI
>3000
90
45
BRINDISI
TRISAIA
New
1000 core AMD
12 core/soket
www.utict.enea.it
[email protected]
www.cresco.enea.it
CRESCO in the Top500 List June 2008
Italy (06/2008)
90
CINECA
125
ENEA
131
ENI
135
CILEA
156
CINECA
226
Telecom
Jack Dongarra 2002
www.utict.enea.it
[email protected]
www.cresco.enea.it
HPC CRESCO
INFRASTRUCTURE
Backup system
CRESCO
300 TByte
IBM Tape Library
TS3500 with 4 drives
SERVERS BACKUP
Peak: 28 TFlops
IB
Interconnections InfiniBand
4XDDR
IB
3 Nodes IBM 3650
FC
SERVERS GPFS
4 Nodes
IBM 3650
FC
High speed
storage
2 GByte/s
160 TByte
IBM/DDN 9550
Section 1
Section 2
Section 3
(Large memory)
(MPP)
42 Nodes SMP
IBM x3850-M2
with 4 Xeon QuadCore Tigerton
E7330
(32/64 GByte RAM
2.4GHz/
1066MHz/6MB L2)
total 672 cores
Intel
Tigerton
256 Nodes blades
IBM HS21 with 2
Xeon Quad-Core
Clovertown E5345
(2.33GHz/1333MH
z/8MB L2), 16 GB
RAM total 2048
cores Intel
Clovertown
New 28 Nodes (224
(Special)
4 Nodes blades IBM
core) Nehalem 2.4
GHz
QS21 con 2 Cell BE
Processors 3.2 Ghz
each.
6 Nodes IBM x3755,
8 Core AMD 8222
FPGA VIRTEX5
4 Nodes IBM x
3755, 8 core AMD
8222 with NVIDIA
Quadra FX 4500 X2
4 Nodes Windows
8 core 16 Byte RAM
35 Nodes for services
Servers for :
•Front-end
•installations
•AFS
New 10 Nodes for tools
Tools:
•Faro
•Jobrama
•Amaca
Portici
LAN
1000+1000 Mbits
Double interconnection at 1 Gbit
& 1 network at 1 Gbit for management
www.utict.enea.it
[email protected]
www.cresco.enea.it
GARR
(WAN)
CRESCO HPC hall
www.utict.enea.it
[email protected]
www.cresco.enea.it
Computational ability
ENEA-GRID & CRESCO
An heterogeneous system with more than 4000 CPU/cores
Code
Risorsa
Serial
Section 1 & ENEA-GRID
Parallel strongly coupled
Section 2
Embarrassing parallel
Section 1, 2, ENEA-GRID
System with several parallel
codes
Section 1, 2, Section 1+2
Special ( FPGA, GB, CELL)
Section 3
windows (serial and parallel)
Section 3
Not LINUX
ENEA-GRID
Large date “Data Base”
Section 1,2,3 e GPFS
www.utict.enea.it
[email protected]
www.cresco.enea.it
Some CRESCO HPC speed-up
Commercial code
Fluent
Open Source
OpenFoam
Spedup
CPMD
Combustion
Processors
procs
ENEA GRID and experimental facilities
DNA Sequence
system
( ABI Prism 3700)
Trisaia
DB_2
ENEA GRID
Controlled Nuclear Fusion:
FTU
Frascati Tokamak Upgrade
Video Acquisition
WEB
ICA
SSH
CPUS
DB_1
DB_3
Electron Microscope
(Brindisi)
300 KeV (sept. 2004)
www.utict.enea.it
[email protected]
www.cresco.enea.it
New ENEA-GRID feature under develops
for high resolution of microscope images
Conceptual structure
SITE 1
Site 2
www.utict.enea.it
Site …
MySQL structure
Logical access (AFS)
Microscope
High definition
images
New ENEA-GRD
Java/web technology
Low internet bandwidth for
•high resolution images
•3D scenes
CRESCO NX servers
with graphic board
[email protected]
www.cresco.enea.it
ENEA-GRID & CRESCO ACCESS
FARO
FARO
www.utict.enea.it
Graphics terminal
Frontend all O.S.
[email protected]
www.cresco.enea.it
ENEA-GRID & CRESCO ACCESS
FARO for Industry (Virtual LAB)
Graphics terminal
Frontend all O.S.
FARO for Virtual LAB
(Gateway)
SOFTWARE
www.utict.enea.it
[email protected]
www.cresco.enea.it
Conceptual structure from a remote user’s point of view
Main service
NX+FARO
Web conferencing
WEB Sever
Linux Cluster
Citrix XenApp
Windows
File server
Local Data
AFS Data Integration
> 4 TByte
Local GRID Cluster
www.utict.enea.it
Special Driver for TEM
Streaming server
ENEA GRID SOFTWARE INFRASTRUCTURE
Classroom
•View of TEM image
•Programs & Data
•E-learning tools
Remote Application Users
•View of TEM image
•Programs & Data
•Supercomputing
•3D Display
•E-learning tools
+
Remote operation
Remote Operation Users
NX + FARO
[email protected]
www.cresco.enea.it
www.utict.enea.it
[email protected]
Corso
SISM 9-10 Ottobre
www.cresco.enea.it
migliori@enea,it
A new ENEA-GRID & Virtual Lab
New material & TEM
ENEA
Li
University
and research
institute
Enterprise
New collaborations
www.utict.enea.it
[email protected]
www.cresco.enea.it
Cloud Computing in ENEA-GRID
Prima Fase



Fruizione di servizi e applicativi
software
Laboratori Virtuali
(Accesso WEB a documentazione e
software specifici di aree tematiche)
File system geograficamente distribuito
(OpenAFS)
Esperienza nuova
(work in progress)
Seconda Fase

Esperienza consolidata
Virtualizzazione
www.utict.enea.it
[email protected]
www.cresco.enea.it
• CMAST gathers all the CRESCO computational activities:
www.afs.enea.it/project/cmast
• ENEA researchers collaborate with industries and universities on several scientific
activities sharing codes and ideas
ACTIVITIES
•
•
•
•
•
•
•
•
•
•
Hydrogen storage and production
Photovoltaic
Metallic membranes
Organic-inorganic adhesion
Liquid and amorphous metallic and
semiconductor systems
Carbon and silicon based
Tungsten and its alloys
Quantum dots
Materials under pressure
etc
CODES
• CPMD, CP2K, Quantum Expresso, LAMMPS
• GROMACS
• Homemade for intermetallics and
semiconductors
OpenNebula e ENEA-GRID
Accessibilità integrata in FARO


Accesso integrato con il
portale FARO
Lista delle VM
disponibili
www.utict.enea.it
[email protected]
www.cresco.enea.it
To collaborate with ENEA ICT
www.utict.enea.it
www.utict.enea.it
[email protected]
www.cresco.enea.it
ITALIAN NATIONAL AGENCY
FOR NEW TECNOLOGY, ENERGY
AND THE ENVIRONMENT
www.utict.enea.it
[email protected]
www.cresco.enea.it