Grid FTP Benchmarking tests

Mission statement

This page is meant to gather information about GridFTP? scalability tests.

OSG CE GridFTP?

This test is meant to benchmark a standard OSG CE GridFTP? server.

The test server was a OSG v1.0.0 CE, with:

  • 2 x AMD Opteron 275 (4 cores total)
  • 8GB of memory
  • 2TB disk space, mounted as RAID0
  • CentOS? 5.2 (x86_64)

The first test was aimed at measuring the impact of security on the GridFTP? server.

  • A single file of 1.5Gb was transfered over LAN. The file was in server memory cache at all times.
    Between 1 and 8 clients per node on either 1 or 2 client nodes were used.The clients were writing to /dev/null.
  • The same test was repeated with the default settings (no security), intergrity checks (dcsafe) and full encryption (dcpriv).
  • The OSG CE GridFTP? server was shown to saturate the available network bandwidth, given enough clients.
    gridftp_ce_security_throughput.png
  • CPU usage is substantially higher when using integrityand/or encryption (up to 10x), but the OSG CE GridFTP? server never used up all of the CPUs (at minimum 12% of all CPU resources were idle at any given time).
    gridftp_ce_security_cpu.png
  • Full details can be found at gridftp_ce_security.pdf and gridftp_ce_security.ods.

-- IgorSfiligoi - 2009/09/14

Topic attachments
I Attachment Action Size Date Who Comment
elseods gridftp_ce_security.ods manage 44.5 K 2009/09/14 - 19:26 IgorSfiligoi OSG CE GridFTP? benchmark - Security
pdfpdf gridftp_ce_security.pdf manage 170.9 K 2009/09/14 - 19:26 IgorSfiligoi OSG CE GridFTP? benchmark - Security
pngpng gridftp_ce_security_cpu.png manage 9.6 K 2009/09/14 - 19:38 IgorSfiligoi OSG CE GridFTP? benchmark - Security - CPU used per Gb
pngpng gridftp_ce_security_throughput.png manage 8.4 K 2009/09/14 - 19:38 IgorSfiligoi OSG CE GridFTP? benchmark - Security - Throughput
Topic revision: r3 - 2009/09/14 - 19:43:35 - IgorSfiligoi
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback