GSIFTPTest < UCSDTier2

UCSDTier2 Web>GSIFTPTest (2009/09/14, IgorSfiligoi) (raw view)EditAttach

---+ Grid FTP Benchmarking tests

---++ Mission statement

This page is meant to gather information about GridFTP scalability tests.
---++ OSG CE GridFTP

This test is meant to benchmark a standard OSG CE GridFTP server.

The test server was a OSG v1.0.0 CE, with:
   * 2 x AMD Opteron 275 (4 cores total)
   * 8GB of memory
   * 2TB disk space, mounted as RAID0
   * CentOS 5.2 (x86_64)

The first test was aimed at measuring the impact of security on the GridFTP server.
   * A single file of 1.5Gb was transfered over LAN. The file was in server memory cache at all times.<br />Between 1 and 8 clients per node on either 1 or 2 client nodes were used.The clients were writing to /dev/null.
   * The same test was repeated with the default settings (no security), intergrity checks (dcsafe) and full encryption (dcpriv).
   * The OSG CE GridFTP server was shown to saturate the available network bandwidth, given enough clients.<br /> <img width="299" alt="gridftp_ce_security_throughput.png" src="%ATTACHURL%/gridftp_ce_security_throughput.png" height="199" />
   * CPU usage is substantially higher when using integrityand/or encryption (up to 10x), but the OSG CE GridFTP server never used up all of the CPUs (at minimum 12% of all CPU resources were idle at any given time). <br /><img width="293" alt="gridftp_ce_security_cpu.png" src="%ATTACHURL%/gridftp_ce_security_cpu.png" height="200" />
   * Full details can be found at [[%ATTACHURL%/gridftp_ce_security.pdf][gridftp_ce_security.pdf]] and [[%ATTACHURL%/gridftp_ce_security.ods][gridftp_ce_security.ods]].

-- Main.IgorSfiligoi - 2009/09/14

Attachments

Topic attachments
I	Attachment	Action	Size	Date	Who	Comment
ods	gridftp_ce_security.ods	manage	44.5 K	2009/09/14 - 19:26	IgorSfiligoi	OSG CE GridFTP? benchmark - Security
pdf	gridftp_ce_security.pdf	manage	170.9 K	2009/09/14 - 19:26	IgorSfiligoi	OSG CE GridFTP? benchmark - Security
png	gridftp_ce_security_cpu.png	manage	9.6 K	2009/09/14 - 19:38	IgorSfiligoi	OSG CE GridFTP? benchmark - Security - CPU used per Gb
png	gridftp_ce_security_throughput.png	manage	8.4 K	2009/09/14 - 19:38	IgorSfiligoi	OSG CE GridFTP? benchmark - Security - Throughput

Topic revision: r3 - 2009/09/14 - 19:43:35 - IgorSfiligoi

UCSDTier2

Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback