WP 1 (Globus) Status Report Massimo Sgaravatto INFN Padova for the INFN Globus group [email protected] Meetings 2 Meetings October 12, 2000 November 20, 2000 Agenda Report on on-going/completed tasks Planning activities for next future Next meeting: January 11, 2001 Security (GSI) Script to make host certificate requests easier (done [F. Prelz]) Scripts to manage distribution of CRL (done [C. Rocca]) Management of grid-mapfile updates (work in progress) Script to publish user certificates in LDAP server (done [G. Lo Biondo]) Members of groups published in LDAP server (update done by “administrators” of these groups) Web tool to “manage” groups (evaluation of existing tools) (to do [C. Rocca]) Tool (certretrieve) used to query the LDAP server (for example to get the members of a specific group): the results are grid-mapfile entries (done [G. Lo Biondo]) Tests with Kerberos (to do [Milano, Padova]) Information Service (GIS) Implementation of site’s GIISes almost completed Netscape LDAP server as mirror of top level GIIS (work in progress [G. Lo Biondo, G. Vita Finzi, F. Semeria, E. Fasanelli, Ferrara]) Review the information gathered from the various machines and published in the GIS (to do [G. Lo Biondo, G. Vita Finzi, F. Semeria, E. Fasanelli, Ferrara]) Tests on performance and scalability (work in progress [F. Semeria, G. Vita Finzi, G. Lo Biondo, E. Fasanelli, Ferrara]) Tools (MRTG based) to monitor the status of the GIS servers (done [G. Lo Biondo]) GIS Architecture (test phase) Implemented Top Level INFN GIIS Dc=infn,dc=it, o=grid Implemented using INFNGRID distribution To be implemented Exp=atlas, o=grid Dc=bo, Dc=infn, dc=it,o=grid Dc=mi,Dc=infn, GIIS dc=it,o=grid GIIS Bologna Milano INFN ATLAS GIIS GRIS Resource Management (GRAM) Tests with CMS HLT Many many many memory leaks in the Globus jobmanager Fixes provided by F. Prelz On-going merge with some fixes provided by Globus team Possible to repeat tests with next CMS productions Tests with GRAM API (to do [F. Giacomini]) Other tests with PBS (done [Torino]) GRAM – GIS “cooperation” (work in progress) Review and “integrate” the information concerning a FARM published in the GIS First proposal defined (considering LSF and Condor) (done [M. Biasotto, M. Sgaravatto]) Development of scripts for LSF (work in progress [M. Biasotto]) Tests with MPICH-G2 (work in progress [Alfieri, Spataro]) Necessary to integrate this proposal considering also PBS (to do [Milano, Torino]) When ready “submit” the proposal to Globus team MPICH-G2 vs MPICH Execution benchmarks (work in progress [Torino, F. Giacomini]) Test layout for CMS production Submit jobs Production manager (Ivano Lippi – Padova) condor_submit (Globus Universe) Condor-G Padova globusrun Local Resource Management Systems Globus GRAM Globus GRAM CONDOR LSF Farms Bologna Pisa Globus deployment INFNGRID 1.2 (done [Pisa]) INFNGRID 1.1’s functionalities Precompiled Globus 1.1.3 for Linux Red Hat 6.x gsiwuftpd Support for LSF and Condor as underlying resource management systems Possibility to implement INFN customizations Installation instructions Support for Solaris 2.6 Support for PBS as resource management system Support for GDMP (only for Linux) Tool to upgrade INFNGRID 1.1 INFNGRID 1.2 Installation instructions INFNGRID 1.1.1 (unofficial release) (done [Pisa]) Certificates signed by INFN CA Preliminary architecture for GIS INFNGRID 1.1 + first (not working) bug fixes for job manager INFNGRID 1.1.2 (unofficial release) (done[Pisa]) INFNGRID 1.1.1 + MPICH-G2 Globus deployment INFN-GRID 1.3 (work in progress [Pisa]) Fixes for Globus jobmanager memory leaks Support for Solaris 7 Full support for GDMP Distribution of various Globus compilations (Kerberos, MPICH-G2) Perl Certretrieve Other bug fixes Web software repository (work in progress [L. Fonti, G. Vita Finzi]) Subscription to mailing list Policies ???????? Data Management Tests with globusftp alpha release 2 (work in progress [Cnaf, Torino, Padova]) Collaboration with WP Network Tests with replica catalog software alpha release 2 (work in progress [Pisa, Padova]) Collaboration with WP Data Management Other info http://www.infn.it/globus NEW ! Futuro del WP 1 Durata e deliverables dopo 6 mesi (Gennaio 2001 ?) Tools, documentation and operational procedures for Globus deployment Final report on suitability of the Globus toolkit as basic Grid infrastructure E poi ???? Futuro del WP 1 Obiettivo del WP 1 (Globus) Prima valutazione del Globus toolkit Cosa puo` esserci utile ? Cosa non funziona/manca ? Cosa va modificato ? NON era previsto di “potenziare”/adattare i servizi di Globus alle nostre esigenze E` utile che si continui a “guardare” a Globus … … ma non crediamo opportuno che questo continui ad essere fatto in un WP “generico” per la valutazione di Globus Futuro del WP 1 … piu` opportuno che questo venga fatto nell’ambito dei WP dello sviluppo del middleware (che dovranno scegliere se e come usare questi servizi, ed eventualmente adattarli) Globus Resource Management (GRAM) Workload Management WP Globus Data Management stuff (globusftp, replica catalog software,…) Data Management WP + Network WP Distribuzioni INFNGRID Testbed Security Testbed (come nel progetto europeo) Information Service Testbed (come nel progetto europeo)