Globus FTP
Evaluation test
Catania – 10/04/2001
Antonio Forte – INFN Torino
Globus FTP
GlobusFTP is the Globus implementation of the GridFTP
Protocol.
The GridFTP protocol is a superset of a GSI-enabled
FTP protocol.
Catania – 10/04/2001
Antonio Forte – INFN Torino
Globus FTP Features
•
A high throughput, reliable, secure and robust
data transfer mechanism
•
GSSAPI security (PKI and Kerberos) support
•
Automatic negotiation of TPC buffer/window
sizes
•
Parallel data transfer
•
Third-party control of data transfer
•
Partial file transfer
•
Reliable data transfer
•
Replica catalogs mechanisms
Catania – 10/04/2001
Antonio Forte – INFN Torino
Globus FTP Implementation
Globus Data Grid Alpha Release 2:
a particular version of Globus containing a set of
production libraries and tools that allow the use of
GridFTP protocol.
GSI WUFTP v0.4b5:
a modified version of the wu-ftpd server, enhanced
with GridFTP's security plus the GridFTP partial file
transfer and parallel transfer capabilities.
GSI NCFTP v0.3:
a modified version of the ncftp client tools, enhanced
with GridFTP's GSI-based security.
Catania – 10/04/2001
Antonio Forte – INFN Torino
Test INFN sites and
resources
INFN CNAF
Pentium II 400MHz
WAN link 12Mbps
INFN PADOVA
Pentium III 450MHz
WAN link 16Mbps
INFN NAPOLI
Pentium 200MHz
WAN link 8Mbps
INFN TORINO
Pentium Pro 200MHz WAN link 12Mbps
Catania – 10/04/2001
Antonio Forte – INFN Torino
Test layout
Catania – 10/04/2001
Antonio Forte – INFN Torino
Tests
BASELINE MEASUREMENT
ROUND TRIP TIME (RTT)
•
Measurement of RTT with 500 icmp packets
THROUGHPUT WITH STANDARD FTP (GET and PUT)
•
Variable file size (1, 10, 50, 100, 500 MB)
TESTS WITH GSIFTP PROTOCOL (using globus-url-copy
command)
COMPARISON BETWEEN STANDARD GSI FTP AND
PARALLEL GSI FTP (GET and PUT)
•
•
•
streams (1, 2, 4, 8, 16, 32, 64), fixed file size (100MB)
streams (1, 2, 4, 8, 16, 32, 64), fixed file size (500MB)
fixed streams (8), variable file size (1, 10, 50, 100, 500 MB)
Catania – 10/04/2001
Antonio Forte – INFN Torino
Tests
EVALUATION OF GSIFTP PERFORMANCES VARING
TCP BUFFER SIZE (GET and PUT)
(Parameter: -tcp-bs buffer-size)
• fixed streams (1), variable TCP buffer size (4, 8, 16, 32, 64, 128,
256 KB)
• fixed streams (8), variable TCP buffer size (4, 8, 16, 32, 64, 128,
256 KB)
EVALUATION OF GSIFTP PERFORMANCES VARING
BLOCK SIZE (GET and PUT)
(Parameter: -bs block size)
• fixed streams (1), variable block size (4, 8, 16, 32, 64, 128, 256 KB)
• fixed streams (8), variable block size (4, 8, 16, 32, 64, 128, 256 KB)
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
COMPARISON BETWEEN STANDARD GSI FTP AND
PARALLEL GSI FTP (GET and PUT)
min/avg/max globus-url-copy with variable parallel streams
Data path: Torino-Padova - fixed file size 100 MB
12000
transfer rate (kbps)
11000
10000
9000
PUT
8000
GET
7000
6000
5000
4000
1
2
4
8
16
32
64
parallel streams
• asymmetrical throughput in different directions
• throughput increases for up to 16 streams and then keeps
constant or, alternatively, decreases
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
WAN Link statistics
INFN Padova – Link 16 Mbps
INFN Torino – Link 12 Mbps
Saturation with 500 MB file size
• the asymmetrical throughput depends on the different data path
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
COMPARISON BETWEEN STANDARD GSI FTP AND
PARALLEL GSI FTP (GET and PUT)
min/av g/max globus-url-copy with v ariable paralle l stre ams
Data path: Torino-Napoli - fixe d file size 100 M B
7500
transfer rate (kbps)
7000
6500
6000
PUT
5500
GET
5000
4500
4000
1
2
4
8
16
32
64
parallel streams
• asymmetrical throughput in different directions
• throughput increases for up to 8 streams, then decreases
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
COMPARISON BETWEEN STANDARD GSI FTP AND
PARALLEL GSI FTP (GET and PUT)
min/avg/max globus-url-copy with variable file size
Data path: Napoli-Torino - 8 fixed parallel streams
7500
transfer rate (kbps)
7000
6500
6000
PUT
GET
5500
5000
4500
4000
1
10
50
100
500
file size (MB)
• no significative throughput for 1 MB file size
• throughput slighty decreases for transfer of very large files (500 MB)
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
EVALUATION OF GSIFTP PERFORMANCES VARING
TCP BUFFER SIZE (GET and PUT)
min/avg/max globus-url-copy with variable tcp buffer size
Data path: Torino-Napoli - fixed 100MB file size
and 1 fixed stream
transfer rate (kbps)
8000
7000
6000
5000
4000
3000
PUT
GET
2000
1000
0
96
40
92
81
38
16
4
76
32
8
53
65
6
10
13
72
21
26
44
tcp-bs (byte)
• Optimal TCP buffer size is 32 KB
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
EVALUATION OF GSIFTP PERFORMANCES VARING
TCP BUFFER SIZE (GET and PUT)
min/avg/max globus-url-copy with variable tcp buffer size
Data path: Napoli-Torino - fixed 100MB file size
and 1 fixed stream
transfer rate (kbps)
8000
7000
6000
5000
PUT
4000
GET
3000
2000
1000
0
96
40
92
81
4
38
6
1
8
76
2
3
6
53
5
6
2
07
1
13
4
14
2
26
tcp-bs (byte)
• Optimal TCP buffer size is 32 KB
• Similar results in symmetrical tests (TO-NA, NA-TO)
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
EVALUATION OF GSIFTP PERFORMANCES VARING
TCP BUFFER SIZE (GET and PUT)
min/avg/max globus-url-copy with variable tcp buffer size
Data path: Torino-Napoli - fixed 100MB file size
and 8 fixed parallel streams
transfer rate (kbps)
7500
7000
6500
6000
PUT
5500
GET
5000
4500
4000
96
40
92
81
4
38
16
8
76
32
6
53
65
72
10
3
1
44
21
6
2
tcp-bs (byte)
• No influence on the performance with 8 parallel streams
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
EVALUATION OF GSIFTP PERFORMANCES VARING
BLOCK SIZE (GET and PUT)
min/avg/max globus-url-copy with variable block size
Data path: Napoli-Torino - fixed 100MB file size
and 1 fixed stream
transfer rate (kbps)
7500
7000
6500
6000
PUT
5500
GET
5000
4500
4000
96
40
92
81
4
38
6
1
8
76
2
3
6
53
5
6
2
07
1
13
4
14
2
26
block size (byte)
• No influence on the performance (no CPU bottleneck)
Catania – 10/04/2001
Antonio Forte – INFN Torino
Results
EVALUATION OF GSIFTP PERFORMANCES VARING
BLOCK SIZE (GET and PUT)
min/avg/max globus-url-copy with variable block size
Data path: Napoli-Torino - fixed 100MB file size
and 8 fixed parallel streams
transfer rate (kbps)
7500
7000
6500
6000
PUT
5500
GET
5000
4500
4000
96
40
92
81
4
38
6
1
8
76
2
3
6
53
5
6
2
07
1
13
4
14
2
26
block size (byte)
• No influence …
Catania – 10/04/2001
Antonio Forte – INFN Torino
Advantages
• No further authentication required (only grid-proxy-init
needed)
• Throughput increases with parallel streams
• Third-party control of data transfer is possible
• Partial and realible transfer works fine with GSI FTP
client (GSINCFTP)
Catania – 10/04/2001
Antonio Forte – INFN Torino
Troubles
•
No stable release (very frequently updated, we used the
version downloaded on the 9th Jan 2001)
•
System crash with globus-url-copy, 64 streams and 500
MB of data
•
Network interface sometimes in down state after parallel
transfers of large files (500 MB) which frequently freeze;
problems encountered with 16 streams between CNAF and
Padova, with 32 or 64 streams between Torino and Napoli.
These problems probably depend on bugs in the Linux
kernel (we used 2.2.12)
•
Production WAN links negatively influenced the tests:
dedicated links need!!!
Catania – 10/04/2001
Antonio Forte – INFN Torino
Latest release
Globus Data Grid Alpha Release 3 released on the
26th March 2001 (annunced by Lee Liming) not
tested yet!!!
Available at the following URL:
http://www.globus.org/gsiftp-alpha/releasealpha3.html
Catania – 10/04/2001
Antonio Forte – INFN Torino
More info
Available at the
WorkPackage 5 (Network) - INFN GRID Project
homepage:
http://www.infn.it/netgrid
Catania – 10/04/2001
Antonio Forte – INFN Torino