Consorzio COMETA “Progetto PI2S2”
FESR
Gestione del Top BDII
Giuseppe Platania, INFN Catania
Tutorial per Site Administrator Progetto PI2S2
Messina, 9-11.07.2007
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
1
Consorzio COMETA “Progetto PI2S2”
FESR
Outline
●
Top BDII
–
Overview
–
Differents between Top and Site BDII
–
Configuration file
–
Troubleshooting
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
2
Consorzio COMETA “Progetto PI2S2”
FESR
BDII overview
●
●
●
It's entirely based on LDAP
Every node (except UI,BDII and WNs) has a GRIS service
in order to publish its informations
A node in every site collects all site GRISes and
publishes them using a site BDII, by default installed on
the CE
●
The top BDII collects all site BDIIs
●
User can run a set of commands to query the top BDII.
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
3
Consorzio COMETA “Progetto PI2S2”
FESR
●
●
Site BDII
Top BDII vs Site BDII
–
By default it is installed on the CE
–
It collects all site GRISes* (for example SE,RB,LFC,etc..)
–
The name of the service is bdii
Top BDII
–
It collects all site BDIIs** (CE1,CE2 ..... CEn)
–
The name of the service is bdii
–
It gives to the RB all needed informations to match and dispatch
user's jobs
–
It can run in the same machine where the RB is running)
*GRIS=Grid Resource Information Service
martedi 8 novembre 2005
**BDII=Berkely Database Infomatin Index
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
4
Consorzio COMETA “Progetto PI2S2”
FESR
Configuration file : /opt/bdii/etc/bdii.conf
BDII_PORT_READ=2170
BDII_PORTS_WRITE="2171 2172 2173"
BDII_USER=edguser
BDII_BIND=mds-vo-name=local,o=grid
BDII_PASSWD=HTwv9pt4d
BDII_SEARCH_FILTER='(|(objectClass=GlueSchemaVersion)(objectClass=GlueTop))'
BDII_SEARCH_TIMEOUT=30
BDII_BREATHE_TIME=60
BDII_AUTO_UPDATE=yes
BDII_AUTO_MODIFY=no
BDII_DIR=/opt/bdii/
BDII_UPDATE_URL=http://www.pi2s2.it/conf/cometa/cometa-bdii.conf
BDII_UPDATE_LDIF=http://
martedi 8SLAPD=/usr/sbin/slapd
novembre 2005
SLAPADD=/usr/sbin/slapadd
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
5
Consorzio COMETA “Progetto PI2S2”
FESR
Configuration file : /opt/bdii/etc/bdii-update.conf
COMETA-INFN-CATANIA ldap://infn-ce-01.ct.pi2s2.it:2170/mds-vo-name=cometa-infncatania,o=grid
COMETA-INAF-CATANIA ldap://inaf-ce-01.ct.pi2s2.it:2170/mds-vo-name=cometa-inafcatania,o=grid
COMETA-INFNLNS-CATANIA ldap://infnlns-ce-01.ct.pi2s2.it:2170/mds-vo-name=cometainfnlns-catania,o=grid
COMETA-UNICT-DMI-CATANIA ldap://unict-dmi-ce-01.ct.pi2s2.it:2170/mds-voname=cometa-unict-dmi-catania,o=grid
COMETA-UNICT-DIIT-CATANIA ldap://unict-diit-ce-01.ct.pi2s2.it:2170/mds-voname=cometa-unict-diit-catania,o=grid
COMETA-INGEGNERIA-MESSINA ldap://unime-ce-01.me.pi2s2.it:2170/mds-voname=cometa-ingegneria-messina,o=grid
COMETA-UNIPA-PALERMO ldap://unipa-ce-01.pa.pi2s2.it:2170/mds-vo-name=cometaunipa-palermo,o=grid
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
6
Consorzio COMETA “Progetto PI2S2”
FESR
Top BDII
Site A
RB
Site C
Site BDII A
Site BDII C
Site B
Site BDII B
CE GRIS
SE GRIS
martedi 8 novembre 2005
CE GRIS
CE GRIS
SE GRIS
SE GRIS
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
7
Consorzio COMETA “Progetto PI2S2”
FESR
BDII testing
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
8
Consorzio COMETA “Progetto PI2S2”
FESR
BDII testing
You can ask the BDII in order to see if its database
is running:
ldapsearch –x –h <bdii hostname> -p 2170 –b mdsvo-name=local,o=grid
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
9
Consorzio COMETA “Progetto PI2S2”
FESR
BDII testing
From your account in the UI:
●
Set the BDII enviroenment:
[plt@ui-1:~]$ export LCG_GFAL_INFOSYS=<bdii hostname>:2170
[plt@ui-1:~]$ lcg-infosites –h
[plt@ui-1:~]$ lcg-info –h
they will show the help with all the possible queries to
obtain the sites’ informations
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
10
Consorzio COMETA “Progetto PI2S2”
FESR
lcg-infosites example / 1
[plt@genius plt]$ lcg-infosites --vo cometa se
Avail Space(Kb) Used Space(Kb) Type SEs
---------------------------------------------------------7720000000
21810000000
4090000000
14540000000
n.a
n.a
n.a
n.a
n.a
n.a
n.a
n.a
inaf-se-01.ct.pi2s2.it
infn-se-01.ct.pi2s2.it
unime-se-01.me.pi2s2.it
unipa-se-01.pa.pi2s2.it
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
11
Consorzio COMETA “Progetto PI2S2”
FESR
lcg-infosites example / 2
[plt@genius plt]$ lcg-infosites --vo cometa ce
#CPU
Free
Total Jobs
Running Waiting ComputingElement
---------------------------------------------------------60
60
0
0
0
inaf-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-short
60
60
0
0
0
inaf-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-long
60
60
0
0
0
inaf-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-infinite
40
40
0
0
0
infn-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-short
40
40
0
0
0
infn-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-long
40
40
0
0
0
infn-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-infinite
32
32
0
0
0
infnlns-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-short
32
32
0
0
0
infnlns-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-long
32 2005
0
martedi 32
8 novembre
0
0
infnlns-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-infinite
[ …..]
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
12
Consorzio COMETA “Progetto PI2S2”
FESR
Troubleshooting
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
13
Consorzio COMETA “Progetto PI2S2”
FESR
/opt/bdii/var/bdii.log
●
●
If a query to the BDII doesn’t show the information
about a site, you have to look at the bdii log file.
For example:
COMETA-INFN-CATANIA: ldap_bind: Can't contact LDAP
server
Check if:
–
globus-mds is up & running (ps aux |grep 2135)
martedi 8 novembre 2005
–
2170 port is open on the site BDII firewall (log a ticket)
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
14
Consorzio COMETA “Progetto PI2S2”
FESR
LDAP databases in lock status
●
●
If a query to the BDII is slow, probably the ldap
databases are corrupted.
Solution:
–
Stop bdii daemon
–
Remove all databases, temporary and cached files:
●
–
rm –f /opt/bdii/var/217*/* /opt/bdii/var/tmp/* /opt/bdii/var/cache/*
Start bdii daemon
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
15
Consorzio COMETA “Progetto PI2S2”
FESR
LINK of Top BDII troubleshooting
http://goc.grid.sinica.edu.tw/gocwiki/SiteProblemsFollowUpFaq
#head-d5bc714b734175fc25f3d387c0a46a9ff7ad421e
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
16
Consorzio COMETA “Progetto PI2S2”
Questions…
FESR
martedi 8 novembre 2005
Giuseppe Platania - Tutorial per Site Administrator Progetto PI2S2, Messina 9-11.07.2007
17