Servizio Centrale Informatica e Reti (Maggio-2003)
Ing. Silvio Migliori ([email protected])
Coordinatore Calcolo Scientifico
ENEA
INFRASTRUTTURA “GRID” PER IL CALCOLO
SCIENTIFICO in ENEA
Agenda
•Cenni sui concetti generali delle griglie computazionali
•Architettura dell'infrastruttura GRID ENEA
•Prossimi sviluppi per il SUD
•Esempi di funzionamento
Ing. Silvio Migliori
Coordinatore progetti calcolo scientifico in ENEA
Milano 7/5/2003
The Grid: The Web on Steroids
Ian Foster
http://
Web: Uniform
access to HTML
documents
http://
Software
catalogs
Grid: Flexible,
high-perf access
to all significant
resources
Computers
Sensor
nets
Colleagues
Data archives
On-demand creation of powerful virtual computing systems
Ian Foster

Network Exponentials
Network vs. computer performance
– Computer speed doubles every 18 months
– Network speed doubles every 9 months
– Difference = order of magnitude per 5 years

1986 to 2000
– Computers: x 500
– Networks: x 340,000

2001 to 2010
– Computers: x 60
– Networks: x 4000
Moore’s Law vs. storage improvements vs. optical improvements. Graph from Scientific American (Jan2001) by Cleo Vilett, source Vined Khoslan, Kleiner, Caufield and Perkins.
Jac. Dongarra SC2002
Performance Extrapolation
10 PFlop/s
1 PFlop/s
100 TFlop/s
10 TFlop/s Sum
1 TFlop/s
100 GFlop/s
N=1
10 GFlop/s
1 GFlop/s
PFlop/s
computer
Ju
n9
Ju 3
n9
Ju 4
n9
Ju 5
n9
Ju 6
n9
Ju 7
n9
Ju 8
n9
Ju 9
n0
Ju 0
n0
Ju 1
n0
Ju 2
n0
Ju 3
n0
Ju 4
n0
Ju 5
n0
Ju 6
n0
Ju 7
n0
Ju 8
n0
Ju 9
n10
100 MFlop/s
N=500
TFlop/s
To enter
the list
Ian Foster
Selected Major Grid Projects
URL & Sponsors
Name
Access Grid
www.mcs.anl.gov/FL/
g accessgrid; DOE, NSF
BlueGridNew g IBM
DISCOM
g www.cs.sandia.gov/
discom
DOE Defense Programs
Focus
Create & deploy group collaboration systems
using commodity technologies
Grid testbed linking IBM laboratories
Create operational Grid providing access to
resources at three U.S. DOE weapons
laboratories
DOE Science
sciencegrid.org
g DOE Office of Science
Grid
Create operational Grid providing access to
resources & applications at U.S. DOE science
laboratories & partner universities
Earth System
Grid (ESG)
Delivery and analysis of large climate model
datasets for the climate research community
New
European
Union (EU)
DataGrid
g
earthsystemgrid.org
DOE Office of Science
eu-datagrid.org
g European Union
Create & apply an operational grid for
applications in high energy physics,
environmental science, bioinformatics
Ian Foster
Selected Major Grid Projects
Name
TeraGrid
New
URL/Sponsor
g teragrid.org
NSF
Focus
U.S. science infrastructure linking four major
resource sites at 40 Gb/s
UK Grid Support g grid-support.ac.uk
Center
New U.K. eScience
Support center for Grid projects within the
U.K.
Unicore
Technologies for remote access to
supercomputers
BMBFT
Also many technology R&D projects:
e.g., Condor, NetSolve, Ninf, NWS
See also www.gridforum.org
boquad.frascati.enea.it
dafne.casaccia.enea.it
power3.frascati.enea.it
infocal.trisia.enea.it
Citrix
Nfuse
WEB(ICA)
ICA
Citrix
Metafram
e
ENEA
INFO
8
622 Mbps
25
Gflops
Cray 39 Gflops
17
0
12
0
Cluster Linux 50 Gflops
NEW
INFORMATICS CENTRAL FUNCTIONS
Software Conceptual Structure
Monitoring di sistema e d’utilizzo, Recupero
e Segnalazione Automatico anomalie, pianificazione
sviluppo
WEB
ICA
Portale Applicativo (Metaframe/Nfuse)
Qualità di servizio
New
User programs & commercial code
Graphic User Interface
LSF multi-cluster as integrator
Load Leveler
LSF
Telnet
AFS Geographical cross platform& File System
AIX
ITALIAN NATIONAL AGENCY FOR
NEW TECHNOLOGY ,ENERGY AND
THE ENVIRONMENT
SGI
SUN
Compa
q
NT
Linux
Quadric
s
…
Gestione generale di una specifica richiesta al sistema
Cluster
Configuration
(STATICO)
Stato delle
Risorse
(TEMPO REALE)
•Accoda la richiesta
Interfaccia
Grafica
(RICHIESTA)
LSF
•Assegna la risorsa
•Lancia il comando sul
calcolatore selezionato
Data Base Server
File Server
AFS
DATI
(SW/Prog.)
Politica
delle code
(STATICO)
•Risolve la piattaforma
•Verifica i diritti di accesso
•Mantiene la coerenza dei dati
Client AFS
Cache
locale
Graphic environment under
AFS
new
Cray
Octane 2Proc
Casaccia
Octane 2Proc
Bologna
INFO Graphic
Developers
Users
Robotica
new
IBM SP
Onyx2 4Proc
Casaccia
new
CATIA User
(AIX)
FUS Project
Users
ITALIAN NATIONAL AGENCY FOR
NEW TECHNOLOGY ,ENERGY AND
THE ENVIRONMENT
Onyx3 4Proc
Frascati
new
User
Interferometri
a
Oligrafia
Simulazione Robotica
Fig 2a
Visualizzazione Immersiva CR Frascati
Visualizzazione Immersiva CR Casaccia
Accesso WEB
“Verticalizzazione” dell’accesso alle Applicazioni
ACCESSO AI SERVIZI DELLA CELLA afs fusione.enea.it
ENEA
INFO
GEANT
8
622 Mbps
Cray 32 Gflops Linux\Alpha100 Gflops
70
grid0007
DataGrid
at
ESA\ESRIN
Cluster Linux 20 Gflo
NEW
Integrazione Impianti e Calcolo
DB_1
CPUS
WEB
ICA
SSH
ENEA GRID
DB_2
In fase di integrazioine
F
T
U
M
O
V
I
E
Test Program “GOME”
Output File
LIV2
List of path
Input File
LIV1
IDL “GOME”
Program
.jpg
Image
Input File
LIV1
List of
path
Input File
LIV1
Case-1
ENEA-Geographic
SUBMITION PROCEDURE
Case_2
List of path
Input File
LIV1
Case n
IDL Program
“GOME”
Output File
LIV2
User afs/home
WEB
Input File
LIV1
Input Files
LIV1
.jpg Image
Brindisi
New
ENEA
INFO
8
622 Mbps
25
Gflops
Cray 39 Gflops
17
0
Portici
Potenziamento
Brindisi
12
0
Cluster Linux 50 Gflops
NEW
Web di Grafica
http://onyx2ced.frascati.enea.it/grafica/
RESEARCH AND
TECHNOLOGY
AT THE NATION’S
SERVICE
ITALIAN NATIONAL AGENCY
FOR NEW TECNOLOGY, ENERGY
AND THE ENVIRONMENT