Grid FTP Benchmarking tests

Mission statement

This page is meant to gather information about GridFTP? scalability tests.

OSG CE GridFTP?

This test is meant to benchmark a standard OSG CE GridFTP? server.

The test server was a OSG v1.0.0 CE, with:

• 2 x AMD Opteron 275 (4 cores total)
• 8GB of memory
• 2TB disk space, mounted as RAID0
• CentOS? 5.2 (x86_64)

The first test was aimed at measuring the impact of security on the GridFTP? server.

• A single file of 1.5Gb was transfered over LAN. The file was in server memory cache at all times.
  Between 1 and 8 clients per node on either 1 or 2 client nodes were used.The clients were writing to /dev/null.
• The same test was repeated with the default settings (no security), intergrity checks (dcsafe) and full encryption (dcpriv).
• The OSG CE GridFTP? server was shown to saturate the available network bandwidth, given enough clients.
  
• CPU usage is substantially higher when using integrityand/or encryption (up to 10x), but the OSG CE GridFTP? server never used up all of the CPUs (at minimum 12% of all CPU resources were idle at any given time).
  
• Full details can be found at gridftp_ce_security.pdf and gridftp_ce_security.ods.

-- IgorSfiligoi - 2009/09/14