Test of Network Capacity for Downloading Data

Using the Load Test infrastructure PhEDEx data transfer system of the CMS experiment at CERN in Geneva, Switzerland, which transfers files on disk via SRM to disk at a remote site, we downloaded data simultaneously from Fermilab (over ESNet) and Caltech and Nebraska (over CENIC) to UCSD. FNAL uses dCache SRM while Caltech, Nebraska and UCSD all use BESTMAN SRM with a hadoop storage system. The total maximum throughput was 14.32 Gbps. The total used bandwidth separately on CENIC was 9.76 Gbps, and on ESNet 5.68 Gbps.

networkplot.jpg

For more information about the PhEDEx data transfer system and it LoadTest infrastructure, please see:

  • D. Bonacorsi et al., “PhEDEx High Throughput Data Transfer Management System,” CHEP06, Bombay, India, February 2006.
  • R. Egeland et al., “Data Transfer Infrastructure for CMS Data Taking”, ACAT08, Erice, Italy, November 2008.
  • G. Bagliesi et al., “The CMS LoadTest 2007: An Infrastructure to Exercise CMS Transfer Routes among WLCG Tiers”, CHEP07, Victoria, B.C., Canada, September 2007.
  • N. Magini et al., “The CMS Data Transfer Test Environment in Preparation for LHC Data Taking,” NSS-IEEE, Dresden 2008.

-- JamesLetts - 2010/07/16

Topic attachments
I Attachment Action Size Date WhoSorted ascending Comment
pngtiff Snapshot_2010-07-16_08-37-37.tiff manage 55.5 K 2010/07/16 - 15:40 JamesLetts  
jpgjpg networkplot.jpg manage 123.0 K 2010/07/16 - 15:41 JamesLetts Cacti graph
Topic revision: r3 - 2010/07/21 - 00:47:29 - JamesLetts
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback