Difference: DataTransferLatency (1 vs. 39)

Revision 392007/10/25 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 26 to 26
 
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 103h55m
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB 48m
17 October 00:02 /W0jet-alpgen/CMSSW_1_5_2-CSA07-2203/GEN-SIM-DIGI-RECO FNAL 12.9TB  
Changed:
<
<
17 October 01:31 /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO CERN 1.73TB  
>
>
17 October 01:31 /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO CERN 1.73TB 91h03m
 

-- FkW - 04 Oct 2007

Line: 107 to 107
 
  • /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO
    • Sample requested by Purdue from CERN but Purdue does not have a commissioned link from CERN. This is another peer-to-peer experiment in a relayed data transfer. We will record how long it takes to download from CERN but also to pass on to Purdue.
    • First file downloaded to UCSD at 2007-10-17 09:43:25 PDT, over 8h after the dataset was requested. File is also copied to Purdue already (before 11:13am).
Added:
>
>
    • All files downloaded and transferred to Purdue after about 3 days (91h).
 
  • /W0jet-alpgen/CMSSW_1_5_2-CSA07-2203/GEN-SIM-DIGI-RECO
    w0jet.png

Revision 382007/10/25 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 116 to 116
 
    • In addition, we got stuck on October 21st with 5 files left to transfer. All 5 supposedly existed at CERN and FNAL.
      • The detailed plot shows clearly that nothing moved despite the 5 missing files.
      • By October 24th, only one of the 5 files has moved to UCSD, i.e. still 4 files missing. At this point we are asking phedex ops for help.
Changed:
<
<
        • The 4 files are lost. The whole dataset existed only on disk at FNAL. Asked for clarification why this dataset was never written to tape.
>
>
        • The 4 files are lost. The whole dataset existed only on FNAL_buffer. Yujun says that files on FNAL_buffer are automatically saved to tape. Not clear why these 4 files got missed.
 
        • Yujun is going to request that these 4 files be deleted from TMDB as well as DBS.

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Revision 372007/10/24 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 116 to 116
 
    • In addition, we got stuck on October 21st with 5 files left to transfer. All 5 supposedly existed at CERN and FNAL.
      • The detailed plot shows clearly that nothing moved despite the 5 missing files.
      • By October 24th, only one of the 5 files has moved to UCSD, i.e. still 4 files missing. At this point we are asking phedex ops for help.
Added:
>
>
        • The 4 files are lost. The whole dataset existed only on disk at FNAL. Asked for clarification why this dataset was never written to tape.
        • Yujun is going to request that these 4 files be deleted from TMDB as well as DBS.
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Revision 362007/10/24 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 108 to 108
 
    • Sample requested by Purdue from CERN but Purdue does not have a commissioned link from CERN. This is another peer-to-peer experiment in a relayed data transfer. We will record how long it takes to download from CERN but also to pass on to Purdue.
    • First file downloaded to UCSD at 2007-10-17 09:43:25 PDT, over 8h after the dataset was requested. File is also copied to Purdue already (before 11:13am).
Added:
>
>
  • /W0jet-alpgen/CMSSW_1_5_2-CSA07-2203/GEN-SIM-DIGI-RECO
    w0jet.png w0jet-detail.png
    • The transfer of this dataset was very varied. We believe this is in part due to the CSA07 processing and skimming activities which put a lot of load on both CERN and FNAL.
    • In addition, we got stuck on October 21st with 5 files left to transfer. All 5 supposedly existed at CERN and FNAL.
      • The detailed plot shows clearly that nothing moved despite the 5 missing files.
      • By October 24th, only one of the 5 files has moved to UCSD, i.e. still 4 files missing. At this point we are asking phedex ops for help.
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

  • 04 Oct 2007 - Commissioned downlinks are available from T1_ASGC and T1_FNAL (as well as from T2 sites at T2_Caltech, T2_Purdue and T2_Estonia)
Line: 149 to 158
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192330002" name="w2+w5jet.png" path="w2+w5jet.png" size="61718" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192063567" name="photon120-170.png" path="photon120-170.png" size="58790" user="Main.FkW" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1193250128" name="w0jet-detail.png" path="w0jet-detail.png" size="55224" user="Main.FkW" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191902431" name="10-8.png" path="10-8.png" size="60288" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192165882" name="transfer-quality.png" path="transfer-quality.png" size="51023" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191648225" name="sample5.png" path="sample5.png" size="57917" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192030271" name="photon-80-120.png" path="photon-80-120.png" size="57096" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191508849" name="sample1.png" path="sample1.png" size="56746" user="Main.FkW" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1193250108" name="w0jet.png" path="w0jet.png" size="58686" user="Main.FkW" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191557325" name="tx3and4.png" path="tx3and4.png" size="52878" user="Main.JamesLetts" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192164445" name="w3jet0-100.png" path="w3jet0-100.png" size="58320" user="Main.FkW" version="1"

Revision 352007/10/17 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 106 to 106
 
  • /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO
    • Sample requested by Purdue from CERN but Purdue does not have a commissioned link from CERN. This is another peer-to-peer experiment in a relayed data transfer. We will record how long it takes to download from CERN but also to pass on to Purdue.
Added:
>
>
    • First file downloaded to UCSD at 2007-10-17 09:43:25 PDT, over 8h after the dataset was requested. File is also copied to Purdue already (before 11:13am).
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Line: 114 to 115
 
  • 16 Oct 2007 - Link from ASGC to UCSD disabled in Prod. ASGC has been affected by debiltating FTS problems since upgrading their FTS server to FTS 2.0 several days ago, and is in danger of decommissioning almost all of their downlinks from ASGC to T2 sites and links from several T1 sites as well.
  • New links added here when they become activated or deactivated.
Added:
>
>

Plot of Latency vs Data Set Size for Quickly Transferred Data Sets


 

History of some problem datasets

  • /W2jet_100ptw300-alpgen/CMSSW_1_5_2-CSA07-2222/GEN-SIM-DIGI-RECO
    • available only at RAL as of 10/09/07. No wonder that we have not seen any of it at UCSD for weeks.

Revision 342007/10/17 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 96 to 96
  We don't request files to be staged on disk if the LSF queue is bigger than 3K pending requests. CASTOR team suggestion.
Changed:
<
<
>
>
 
    • Asked again about the last file, and Douglas told me it was routed and was transferred by 2007-10-16 12:55:38 UTC.

  • /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224
    • This is the red little blip above.
    • 131 files downloaded to UCSD by 2007-10-13 05:11:41 UTC
Added:
>
>
  • /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO
    • Sample requested by Purdue from CERN but Purdue does not have a commissioned link from CERN. This is another peer-to-peer experiment in a relayed data transfer. We will record how long it takes to download from CERN but also to pass on to Purdue.
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

  • 04 Oct 2007 - Commissioned downlinks are available from T1_ASGC and T1_FNAL (as well as from T2 sites at T2_Caltech, T2_Purdue and T2_Estonia)

Revision 332007/10/17 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 25 to 25
 
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB 12h53m
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 103h55m
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB 48m
Changed:
<
<
16 October 11:21 /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO CERN 1.73TB  
17 October 00:02 /W0jet-alpgen/CMSSW_1_5_2-CSA07-2203/GEN-SIM-DIGI-RECO FNAL 12.9TB
>
>
17 October 00:02 /W0jet-alpgen/CMSSW_1_5_2-CSA07-2203/GEN-SIM-DIGI-RECO FNAL 12.9TB  
17 October 01:31 /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO CERN 1.73TB  
 

-- FkW - 04 Oct 2007

Revision 322007/10/17 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 26 to 26
 
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 103h55m
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB 48m
16 October 11:21 /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO CERN 1.73TB  
Added:
>
>
17 October 00:02 /W0jet-alpgen/CMSSW_1_5_2-CSA07-2203/GEN-SIM-DIGI-RECO FNAL 12.9TB
 

-- FkW - 04 Oct 2007

Revision 312007/10/16 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 25 to 25
 
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB 12h53m
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 103h55m
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB 48m
Added:
>
>
16 October 11:21 /Charmonium_Pt_20_inf/CMSSW_1_5_2-CSA07-2213/GEN-SIM-DIGI-RECO CERN 1.73TB  
 

-- FkW - 04 Oct 2007

Revision 302007/10/16 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 23 to 23
 
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 3h14m
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 5h13m
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB 12h53m
Changed:
<
<
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 1 file missing out of 3316
>
>
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 103h55m
 
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB 48m
Line: 84 to 84
 
    • most of this was transfered very fast from CERN. However, 5 files are still missing on 10/13/07 19:48. It's not clear that these remaining files even exist, given that CERN buffer has two more files than CERN MSS for a long time.
      w2+w5jet.png
    • Five files are still missing 15 October 2007 05:47 PDT. Total number of files on site at UCSD is 3311
Changed:
<
<
    • Four of the missing became routed to UCSD from CERN on 15 October and were transferred by 2007-10-15 15:15:02 UTC. The fifth file does even exist in T1_CERN_Buffer but not T1_CERN_MSS. This is the explanation from Douglas:
>
>
    • Four of the missing became routed to UCSD from CERN on 15 October after I asked about them and were transferred by 2007-10-15 15:15:02 UTC. The fifth file does even exist in T1_CERN_Buffer but not T1_CERN_MSS. This is the explanation from Douglas:
 
Those 5 files are routed to UCSD. They should move to there soon. I guess, 
it is probably due to the massive (and not well designed) T0 usage of the
Line: 95 to 95
 We don't request files to be staged on disk if the LSF queue is bigger than 3K pending requests. CASTOR team suggestion.
Added:
>
>
    • Asked again about the last file, and Douglas told me it was routed and was transferred by 2007-10-16 12:55:38 UTC.
 
  • /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224
    • This is the red little blip above.

Revision 292007/10/16 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 6 to 6
  We are measuring data transfer latencies by requesting one dataset per day via the Prod instance of PhEDEx, and tracking until the end of CAS07 how many of those actually arrived within a reasonable time. We will pick datasets that are around 1TB, and delete them hopefully once a day as well, assuming they complete within a day.
Changed:
<
<		The table below shows the request time (PDT) for each dataset, where it is availavle, size, and latency (time to completion of the transfer to our SE).
>
>		The table below shows the request time (PDT) for each dataset, where it is available, size, and latency (time to completion of the transfer to our SE).
  PhEDEx hourly plots for each dataset are linked in at the bottom of the page.
Line: 23 to 23
 
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 3h14m
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 5h13m
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB 12h53m
Changed:
<
<
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 5 files missing out of 3316
>
>
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 1 file missing out of 3316
 
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB 48m
Line: 72 to 79
  w3jet0-100.png
    • The transfer quality from fnal seems significantly worse during the period with the dribble than during the previous two peaks: transfer-quality.png
Changed:
<
<		 * /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221
    • most of this was transfered very fast from CERN. However, 5 files are still missing on 10/13/07 19:48. It's not clear that these remaining files even exist, given that CERN buffer has two more files than CERN MSS for a long time.
>
>
  • /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221
    • most of this was transfered very fast from CERN. However, 5 files are still missing on 10/13/07 19:48. It's not clear that these remaining files even exist, given that CERN buffer has two more files than CERN MSS for a long time.
  w2+w5jet.png
    • Five files are still missing 15 October 2007 05:47 PDT. Total number of files on site at UCSD is 3311
Added:
>
>
    • Four of the missing became routed to UCSD from CERN on 15 October and were transferred by 2007-10-15 15:15:02 UTC. The fifth file does even exist in T1_CERN_Buffer but not T1_CERN_MSS. This is the explanation from Douglas:
Those 5 files are routed to UCSD. They should move to there soon. I guess, 
it is probably due to the massive (and not well designed) T0 usage of the 
t0export for processing and copying files from pools to pools done by the 
T0 team, causing the exporting of those been delayed (it completely block 
CERN exports this weekend for instance).

We don't request files to be staged on disk if the LSF queue is bigger than
3K pending requests. CASTOR team suggestion.
 
  • /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224
Changed:
<
<
    • This is the red little blipp above.
>
>
    • This is the red little blip above.
 
    • 131 files downloaded to UCSD by 2007-10-13 05:11:41 UTC

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

  • 04 Oct 2007 - Commissioned downlinks are available from T1_ASGC and T1_FNAL (as well as from T2 sites at T2_Caltech, T2_Purdue and T2_Estonia)
  • 08 Oct 2007 - Link from CERN to UCSD enabled in Prod.
Changed:
<
<
  • New links added here when they become activated.
>
>
  • 16 Oct 2007 - Link from ASGC to UCSD disabled in Prod. ASGC has been affected by debiltating FTS problems since upgrading their FTS server to FTS 2.0 several days ago, and is in danger of decommissioning almost all of their downlinks from ASGC to T2 sites and links from several T1 sites as well.
  • New links added here when they become activated or deactivated.
 

History of some problem datasets

  • /W2jet_100ptw300-alpgen/CMSSW_1_5_2-CSA07-2222/GEN-SIM-DIGI-RECO

Revision 282007/10/15 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 17 to 17
 
04 October 19:09 /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB 1h37m
05 October 04:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK*, Caltech, Purdue 1.2TB 93h04m
Changed:
<
<
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB 4 files left
>
>
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC, CERN (near end) 522GB 192h22m
 
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB 63h43m
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB 28h09m
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 3h14m
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 5h13m
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB 12h53m
Changed:
<
<
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB  
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB  
>
>
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB 5 files missing out of 3316
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB 48m
 
Changed:
<
<		-- FkW - 04 Oct 2007
>
>		 -- FkW - 04 Oct 2007
 
  • /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO
    • It took several hours for the last few files to arrive.
Line: 49 to 50
 
    • Typhoon over, restarted ASGC download agent 19:10 PDT 07 October 2007
    • ASGC has CASTOR problems
    • ASGC is now affected by an FTS bug. Four files left to transfer. Files are also at CERN now. 12 October 2007.
Added:
>
>
    • We eventually got the last files from CERN on 13 October 2007.
    • ASGC still having FTS issues. Our link is in danger of DECOMMISSIONING because of extremely poor performance due to problems at ASGC (castor, fts)
 
  • /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049
    10-8.png
    • The "yellow" 6 hour spike starting at 3:00GMT belongs to this dataset.
Line: 68 to 71
 
    • last high spike is /PhotonJets_Pt_Pt_170_300/CMSSW_1_5_2-CSA07-2053 while the dribble over ~12hours is the /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223 w3jet0-100.png
    • The transfer quality from fnal seems significantly worse during the period with the dribble than during the previous two peaks:
Changed:
<
<		 transfer-quality.png
>
>		 transfer-quality.png
  * /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221
    • most of this was transfered very fast from CERN. However, 5 files are still missing on 10/13/07 19:48. It's not clear that these remaining files even exist, given that CERN buffer has two more files than CERN MSS for a long time.
Changed:
<
<		 w2+w5jet.png
  • /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224 This is the red little blipp above.
>
>		 w2+w5jet.png
    • Five files are still missing 15 October 2007 05:47 PDT. Total number of files on site at UCSD is 3311
  • /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224
    • This is the red little blipp above.
    • 131 files downloaded to UCSD by 2007-10-13 05:11:41 UTC
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Line: 104 to 110
  How come this isn't moving from CNAF to CERN?
    • CNAF's uplink to CERN wasn't commissioned. Once CNAF's link was back in production the data moved to CERN, and from there to UCSD.
Changed:
<
<		-- FkW - 09 Oct 2007
>
>		-- FkW - 09 Oct 2007
 -- JamesLetts - 05 Oct 2007

Revision 272007/10/14 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 24 to 24
 
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 5h13m
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB 12h53m
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB  
Changed:
<
<
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO 172GB  
>
>
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO CERN, FNAL 172GB  
  -- FkW - 04 Oct 2007
Line: 69 to 69
  w3jet0-100.png
    • The transfer quality from fnal seems significantly worse during the period with the dribble than during the previous two peaks: transfer-quality.png
Added:
>
>		 * /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221
    • most of this was transfered very fast from CERN. However, 5 files are still missing on 10/13/07 19:48. It's not clear that these remaining files even exist, given that CERN buffer has two more files than CERN MSS for a long time.
      w2+w5jet.png
  • /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224 This is the red little blipp above.
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Line: 104 to 109
 
Changed:
<
<
  • transfer-quality.png:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192330002" name="w2+w5jet.png" path="w2+w5jet.png" size="61718" user="Main.FkW" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192063567" name="photon120-170.png" path="photon120-170.png" size="58790" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191902431" name="10-8.png" path="10-8.png" size="60288" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"

Revision 262007/10/13 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 24 to 24
 
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 5h13m
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB 12h53m
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB  
Added:
>
>
12 October 21:23 /W5jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2224/GEN-SIM-DIGI-RECO 172GB  
  -- FkW - 04 Oct 2007
Line: 78 to 79
 

History of some problem datasets

  • /W2jet_100ptw300-alpgen/CMSSW_1_5_2-CSA07-2222/GEN-SIM-DIGI-RECO
    • available only at RAL as of 10/09/07. No wonder that we have not seen any of it at UCSD for weeks.
Changed:
<
<
    • 10/12/07 22:29 requested subscription for both FNAL and CERN. FNAL accepted. CERN hasn't yet. 41 files have by now made it to both FNAL and UCSD.
>
>
    • 10/11/07 22:29 requested subscription for both FNAL and CERN. FNAL accepted. CERN hasn't yet. 41 files have by now made it to both FNAL and UCSD.
    • 10/12/07 21:27 one day later, and still only 121 files made it to UCSD (141 to FNAL). It seems that data movement from RAL to FNAL is very slow!
 
  • /QCD_Pt_30_50/CMSSW_1_5_2-CSA07-2048/GEN-SIM-DIGI-RECO
    • As of 10/09/07 This datset has 2 missing files at UCSD for a long time. Same for FNAL and a lot of other sites. CERN_Buffer has the dataset complete. How can it be that the 2 missing files aren't moving from CERN to FNAL?

Revision 252007/10/12 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 46 to 46
 
  • /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM
    • ASGC shut down because of Typhoon
    • Typhoon over, restarted ASGC download agent 19:10 PDT 07 October 2007
Added:
>
>
    • ASGC has CASTOR problems
    • ASGC is now affected by an FTS bug. Four files left to transfer. Files are also at CERN now. 12 October 2007.
 
  • /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049
    10-8.png
    • The "yellow" 6 hour spike starting at 3:00GMT belongs to this dataset.

Revision 242007/10/12 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 11 to 11
 PhEDEx hourly plots for each dataset are linked in at the bottom of the page.

Request time (PDT) Dataset Available at Size Latency
Changed:
<
<
03 October 21:35 /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL, IN2P3? 1.4TB 6h14m
04 October 07:35 /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO CERN, FNAL 1.9TB 3h46m
04 October 12:40 /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO CERN, FNAL 841GB 2h13m
>
>
03 October 21:35 /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL, IN2P3? * 1.4TB 6h14m
04 October 07:35 /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO CERN*, FNAL 1.9TB 3h46m
04 October 12:40 /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO CERN*, FNAL 841GB 2h13m
 
04 October 19:09 /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB 1h37m
05 October 04:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
Changed:
<
<
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK, Caltech, Purdue 1.2TB 93h04m
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB  
>
>
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK*, Caltech, Purdue 1.2TB 93h04m
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB 4 files left
 
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB 63h43m
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB 28h09m
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 3h14m
Changed:
<
<
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB ~5hours
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB ~12hours
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN 4.9TB  
>
>
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 5h13m
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB 12h53m
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN, FZK* 4.9TB  
  -- FkW - 04 Oct 2007

Revision 232007/10/12 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 21 to 21
 
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB 63h43m
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB 28h09m
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 3h14m
Changed:
<
<
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB  
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB  
>
>
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB ~5hours
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB ~12hours
11 October 22:06 /W2jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2221/GEN-SIM-DIGI-RECO CERN 4.9TB  
  -- FkW - 04 Oct 2007
Line: 61 to 62
  photon120-170.png
  • /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053
  • /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO
Added:
>
>
    • last high spike is /PhotonJets_Pt_Pt_170_300/CMSSW_1_5_2-CSA07-2053 while the dribble over ~12hours is the /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223 w3jet0-100.png
    • The transfer quality from fnal seems significantly worse during the period with the dribble than during the previous two peaks: transfer-quality.png
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Line: 71 to 76
 

History of some problem datasets

  • /W2jet_100ptw300-alpgen/CMSSW_1_5_2-CSA07-2222/GEN-SIM-DIGI-RECO
    • available only at RAL as of 10/09/07. No wonder that we have not seen any of it at UCSD for weeks.
Changed:
<
<
  • /W4jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2206/GEN-SIM-DIGI-RECO
    • As of 10/09/07 we got 170 files. Nobody has more. No idea why this isn't complete.
>
>
    • 10/12/07 22:29 requested subscription for both FNAL and CERN. FNAL accepted. CERN hasn't yet. 41 files have by now made it to both FNAL and UCSD.
 
  • /QCD_Pt_30_50/CMSSW_1_5_2-CSA07-2048/GEN-SIM-DIGI-RECO
    • As of 10/09/07 This datset has 2 missing files at UCSD for a long time. Same for FNAL and a lot of other sites. CERN_Buffer has the dataset complete. How can it be that the 2 missing files aren't moving from CERN to FNAL? Or from CERN to UCSD for that matter?
Added:
>
>
      • Was told that the two files are on a tape at CERN that is inaccessible. Am told that this has been filed as a castor bug. Am told that these are not the only "lost files" at CERN. Am told that "Castor has a habit of loosing files".
 
  • /W4jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2206/GEN-SIM-DIGI-RECO
    • As of 10/09/07 We got 170 files. Nobody else in the world has more. Why isn't this considered complete?
Added:
>
>
    • Turns out that 59 files were stuck in FZK. CERN had no subscription for them, and neither RAL nor us had a link to FZK in production. Accordingly, neither of us could get the 59 files to complete our subscription.
    • fkw requested the data for both CERN and FNAL. The data stuck at FZK moved to FNAL, and we completed our subscription, apparently by getting the remaining files from FNAL.
      • Interestingly, FNAL got the FZK data quickly, but hasn't gotten the CERN data yet. As of now, CERN and RAL have 170 files, while FZK and FNAL have 59, and us have all 170+59.
 
  • /tt2j_mT_70-alpgen/CMSSW_1_5_2-CSA07-2232/GEN-SIM-DIGI-RECO
    • As of 10/09/07 we got 173 files. CERN has 185. CNAF has the full set of 192 files. How come this isn't moving from CNAF to CERN?
Added:
>
>
    • CNAF's uplink to CERN wasn't commissioned. Once CNAF's link was back in production the data moved to CERN, and from there to UCSD.
  -- FkW - 09 Oct 2007 -- JamesLetts - 05 Oct 2007

Added:
>
>
  • transfer-quality.png:
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192063567" name="photon120-170.png" path="photon120-170.png" size="58790" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191902431" name="10-8.png" path="10-8.png" size="60288" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192165882" name="transfer-quality.png" path="transfer-quality.png" size="51023" user="Main.FkW" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191648225" name="sample5.png" path="sample5.png" size="57917" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192030271" name="photon-80-120.png" path="photon-80-120.png" size="57096" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191508849" name="sample1.png" path="sample1.png" size="56746" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191557325" name="tx3and4.png" path="tx3and4.png" size="52878" user="Main.JamesLetts" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192164445" name="w3jet0-100.png" path="w3jet0-100.png" size="58320" user="Main.FkW" version="1"

Revision 222007/10/11 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 11 to 11
 PhEDEx hourly plots for each dataset are linked in at the bottom of the page.

Request time (PDT) Dataset Available at Size Latency
Changed:
<
<
03 October 21:35 /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB 6h14m
04 October 07:35 /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
04 October 12:40 /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO FNAL Buffer, CERN Buffer 841GB 2h13m
>
>
03 October 21:35 /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL, IN2P3? 1.4TB 6h14m
04 October 07:35 /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO CERN, FNAL 1.9TB 3h46m
04 October 12:40 /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO CERN, FNAL 841GB 2h13m
 
04 October 19:09 /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB 1h37m
05 October 04:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
Changed:
<
<
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK, Caltech, Purdue 1.2TB  
>
>
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK, Caltech, Purdue 1.2TB 93h04m
 
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB  
Changed:
<
<
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB ~6hours
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB ~3hours
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB ~3hours
>
>
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB 63h43m
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB 28h09m
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB 3h14m
 
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB  
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB  

Revision 212007/10/11 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 22 to 22
 
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB ~3hours
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB ~3hours
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB  
Added:
>
>
11 October 08:56 /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO CERN, FNAL 967GB  
  -- FkW - 04 Oct 2007
Line: 58 to 59
  photon-80-120.png
  • /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070
    photon120-170.png
Changed:
<
<
>
>
  • /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053
  • /W3jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2223/GEN-SIM-DIGI-RECO
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Revision 202007/10/11 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 19 to 19
 
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK, Caltech, Purdue 1.2TB  
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB  
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB ~6hours
Changed:
<
<
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB  
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB  
>
>
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB ~3hours
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB ~3hours
10 October 17:43 /PhotonJets_Pt_170_300/CMSSW_1_5_2-CSA07-2053/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB  
  -- FkW - 04 Oct 2007
Line: 55 to 56
 
    • the yellow spike is the transfer of this dataset. The "grass" in different colors are various problem datasets that are still coming in, as well as the dataset from ASGC listed above. photon-80-120.png
Added:
>
>
  • /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070
    photon120-170.png
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Line: 83 to 86
 -- JamesLetts - 05 Oct 2007

Changed:
<
<
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192063567" name="photon120-170.png" path="photon120-170.png" size="58790" user="Main.FkW" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191902431" name="10-8.png" path="10-8.png" size="60288" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191648225" name="sample5.png" path="sample5.png" size="57917" user="Main.FkW" version="1"

Revision 192007/10/10 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 20 to 20
 
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB  
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB ~6hours
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB  
Added:
>
>
10 October 08:49 /PhotonJets_Pt_120_170/CMSSW_1_5_2-CSA07-2070/GEN-SIM-DIGI-RECO CERN, FNAL 1.1TB  
  -- FkW - 04 Oct 2007
Line: 42 to 43
 
  • /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM
    • ASGC shut down because of Typhoon
    • Typhoon over, restarted ASGC download agent 19:10 PDT 07 October 2007
Changed:
<
<
  • /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049
>
>
  • /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049
  10-8.png
    • The "yellow" 6 hour spike starting at 3:00GMT belongs to this dataset.
    • The transfers from CERN soon thereafter are datasets that we requested a long time ago, before starting this exercise. They started moving only now because our link to CERN was commissioned and enabled only now.
    • The data from ASGC visible here is the /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139 which is still not complete at this point.
Added:
>
>
    • It should be noted that something weird happened with this dataset. It was fully transfered in the evening, and then magically disappeared partially. Since then, we have had trouble getting it completely moved again. As of 10-09-07 8:39am only 1.4TB is present out of 1.8TB at UCSD.
  • /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO
    • the yellow spike is the transfer of this dataset. The "grass" in different colors are various problem datasets that are still coming in, as well as the dataset from ASGC listed above. photon-80-120.png
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Line: 78 to 87
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191902431" name="10-8.png" path="10-8.png" size="60288" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191648225" name="sample5.png" path="sample5.png" size="57917" user="Main.FkW" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1192030271" name="photon-80-120.png" path="photon-80-120.png" size="57096" user="Main.FkW" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191508849" name="sample1.png" path="sample1.png" size="56746" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191557325" name="tx3and4.png" path="tx3and4.png" size="52878" user="Main.JamesLetts" version="1"

Revision 182007/10/09 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 55 to 55
 
  • 08 Oct 2007 - Link from CERN to UCSD enabled in Prod.
  • New links added here when they become activated.
Added:
>
>

History of some problem datasets

  • /W2jet_100ptw300-alpgen/CMSSW_1_5_2-CSA07-2222/GEN-SIM-DIGI-RECO
    • available only at RAL as of 10/09/07. No wonder that we have not seen any of it at UCSD for weeks.
  • /W4jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2206/GEN-SIM-DIGI-RECO
    • As of 10/09/07 we got 170 files. Nobody has more. No idea why this isn't complete.
  • /QCD_Pt_30_50/CMSSW_1_5_2-CSA07-2048/GEN-SIM-DIGI-RECO
    • As of 10/09/07 This datset has 2 missing files at UCSD for a long time. Same for FNAL and a lot of other sites. CERN_Buffer has the dataset complete. How can it be that the 2 missing files aren't moving from CERN to FNAL? Or from CERN to UCSD for that matter?
  • /W4jet_0ptw100-alpgen/CMSSW_1_5_2-CSA07-2206/GEN-SIM-DIGI-RECO
    • As of 10/09/07 We got 170 files. Nobody else in the world has more. Why isn't this considered complete?
  • /tt2j_mT_70-alpgen/CMSSW_1_5_2-CSA07-2232/GEN-SIM-DIGI-RECO
    • As of 10/09/07 we got 173 files. CERN has 185. CNAF has the full set of 192 files. How come this isn't moving from CNAF to CERN?

-- FkW - 09 Oct 2007

 -- JamesLetts - 05 Oct 2007

Revision 172007/10/09 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 18 to 18
 
05 October 04:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK, Caltech, Purdue 1.2TB  
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB  
Changed:
<
<
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB  
>
>
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB ~6hours
07 October 21:12 /PhotonJets_Pt_80_120/CMSSW_1_5_2-CSA07-2063/GEN-SIM-DIGI-RECO CERN, FNAL 953.6GB  
  -- FkW - 04 Oct 2007
Line: 41 to 42
 
  • /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM
    • ASGC shut down because of Typhoon
    • Typhoon over, restarted ASGC download agent 19:10 PDT 07 October 2007
Changed:
<
<
>
>
  • /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049 10-8.png
    • The "yellow" 6 hour spike starting at 3:00GMT belongs to this dataset.
    • The transfers from CERN soon thereafter are datasets that we requested a long time ago, before starting this exercise. They started moving only now because our link to CERN was commissioned and enabled only now.
    • The data from ASGC visible here is the /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139 which is still not complete at this point.
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Line: 52 to 57
  -- JamesLetts - 05 Oct 2007
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191902431" name="10-8.png" path="10-8.png" size="60288" user="Main.FkW" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191648225" name="sample5.png" path="sample5.png" size="57917" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191508849" name="sample1.png" path="sample1.png" size="56746" user="Main.FkW" version="1"

Revision 162007/10/08 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 47 to 47
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

  • 04 Oct 2007 - Commissioned downlinks are available from T1_ASGC and T1_FNAL (as well as from T2 sites at T2_Caltech, T2_Purdue and T2_Estonia)
Added:
>
>
  • 08 Oct 2007 - Link from CERN to UCSD enabled in Prod.
 
  • New links added here when they become activated.

-- JamesLetts - 05 Oct 2007

Revision 152007/10/08 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 18 to 18
 
05 October 04:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK, Caltech, Purdue 1.2TB  
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB  
Added:
>
>
07 October 20:15 /QCD_Pt_50_80/CMSSW_1_5_2-CSA07-2049/GEN-SIM-DIGI-RECO FNAL 1.8TB  
  -- FkW - 04 Oct 2007

Revision 142007/10/08 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 39 to 39
 
    • All transfer failures from sample /QCD_Pt_800_1000/CMSSW_1_5_2-CSA07-2028/GEN-SIM-DIGI-RECO, suspending ... it sits in the subscription list ahead of this sample ... is that the problem? Just blocking whats below it?
  • /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM
    • ASGC shut down because of Typhoon
Added:
>
>
    • Typhoon over, restarted ASGC download agent 19:10 PDT 07 October 2007
 

Revision 132007/10/07 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 36 to 36
 
    • Files started retransferring from FNAL at 14:49 PDT; however, FNAL does not have a complete dataset. Only Purdue and Caltech do and also have commissioned links to UCSD
    • We received 83 files in the first 30 minutes of transfers and then nothing since 15:16 PDT.
    • Made "High Priority" at 21:27 PDT.
Added:
>
>
    • All transfer failures from sample /QCD_Pt_800_1000/CMSSW_1_5_2-CSA07-2028/GEN-SIM-DIGI-RECO, suspending ... it sits in the subscription list ahead of this sample ... is that the problem? Just blocking whats below it?
  • /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM
    • ASGC shut down because of Typhoon
 

Revision 122007/10/06 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 17 to 17
 
04 October 19:09 /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB 1h37m
05 October 04:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK, Caltech, Purdue 1.2TB  
Added:
>
>
05 October 22:20 /Z1jet_0ptw100-alpgen/CMSSW_1_4_6-CSA07-2139/GEN-SIM ASGC 522GB  
  -- FkW - 04 Oct 2007
Line: 25 to 26
  sample1.png
  • /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026
    tx2.jpg
Changed:
<
<
  • /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740 and /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740
>
>
  • /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740 and /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164
  tx3and4.png
Added:
>
>
  • /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177 is the left-most spike. The middle small one is a relval sample, and the right-most is the beginning of BB2MuMu? below.
    sample5.png
 
  • /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO
    • 49 data files were lost in from a pool which went permanently offline
    • Triggered a dataset DELETION with the PhEDEx web page at 13:30 PDT
Line: 44 to 47
 -- JamesLetts - 05 Oct 2007

META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191648225" name="sample5.png" path="sample5.png" size="57917" user="Main.FkW" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191508849" name="sample1.png" path="sample1.png" size="56746" user="Main.FkW" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191557325" name="tx3and4.png" path="tx3and4.png" size="52878" user="Main.JamesLetts" version="1"

Revision 112007/10/06 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 30 to 30
 
  • /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO
    • 49 data files were lost in from a pool which went permanently offline
    • Triggered a dataset DELETION with the PhEDEx web page at 13:30 PDT
Changed:
<
<
    • Files started retransferring from FNAL at 14:49; however, FNAL does not have a complete dataset. Only Purdue and Caltech do and also have commissioned links to UCSD
>
>
    • Files started retransferring from FNAL at 14:49 PDT; however, FNAL does not have a complete dataset. Only Purdue and Caltech do and also have commissioned links to UCSD
    • We received 83 files in the first 30 minutes of transfers and then nothing since 15:16 PDT.
    • Made "High Priority" at 21:27 PDT.
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Changed:
<
<
  • 04 Oct 2007 - Commissioned downlinks are available from T1_ASGC and T1_FNAL (as well as from T2 sites at Caltech, Purdue and Estonia)
>
>
  • 04 Oct 2007 - Commissioned downlinks are available from T1_ASGC and T1_FNAL (as well as from T2 sites at T2_Caltech, T2_Purdue and T2_Estonia)
 
  • New links added here when they become activated.

-- JamesLetts - 05 Oct 2007

Revision 102007/10/05 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 15 to 15
 
04 October 07:35 /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
04 October 12:40 /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO FNAL Buffer, CERN Buffer 841GB 2h13m
04 October 19:09 /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB 1h37m
Changed:
<
<
05 October 4:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
>
>
05 October 04:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
05 October 13:30 /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO FNAL, FZK, Caltech, Purdue 1.2TB  
  -- FkW - 04 Oct 2007
Line: 26 to 27
  tx2.jpg
  • /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740 and /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740
    tx3and4.png
Added:
>
>
  • /BB2MuMu/CMSSW_1_3_4-Spring07-1947/GEN-SIM-DIGI-RECO
    • 49 data files were lost in from a pool which went permanently offline
    • Triggered a dataset DELETION with the PhEDEx web page at 13:30 PDT
    • Files started retransferring from FNAL at 14:49; however, FNAL does not have a complete dataset. Only Purdue and Caltech do and also have commissioned links to UCSD
 

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

Revision 92007/10/05 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 15 to 15
 
04 October 07:35 /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
04 October 12:40 /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO FNAL Buffer, CERN Buffer 841GB 2h13m
04 October 19:09 /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB 1h37m
Changed:
<
<
05 October 4:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB  
>
>
05 October 4:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB 2h04m
  -- FkW - 04 Oct 2007

  • /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO
Added:
>
>
    • It took several hours for the last few files to arrive.
  sample1.png
  • /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026
    tx2.jpg

Revision 82007/10/05 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 15 to 15
 
04 October 07:35 /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
04 October 12:40 /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO FNAL Buffer, CERN Buffer 841GB 2h13m
04 October 19:09 /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB 1h37m
Added:
>
>
05 October 4:42 /PhotonJets_Pt_20_30/CMSSW_1_5_2-CSA07-2177/GEN-SIM-DIGI-RECO FNAL 923GB  
  -- FkW - 04 Oct 2007

Revision 72007/10/05 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Measuring Data Transfer Latency

Added:
>
>		 We are measuring data transfer latencies by requesting one dataset per day via the Prod instance of PhEDEx, and tracking until the end of CAS07 how many of those actually arrived within a reasonable time. We will pick datasets that are around 1TB, and delete them hopefully once a day as well, assuming they complete within a day.

The table below shows the request time (PDT) for each dataset, where it is availavle, size, and latency (time to completion of the transfer to our SE).

 PhEDEx hourly plots for each dataset are linked in at the bottom of the page.
Changed:
<
<
Request time dataset available at size latency
October 3rd 9:35pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB 6h14m
October 4th 7:35am /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
October 4th 12:40pm /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO FNAL buffer, CERN buffer 841GB  
October 4th 7:09pm /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB  
>
>
Request time (PDT) Dataset Available at Size Latency
03 October 21:35 /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB 6h14m
04 October 07:35 /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
04 October 12:40 /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO FNAL Buffer, CERN Buffer 841GB 2h13m
04 October 19:09 /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB 1h37m
  -- FkW - 04 Oct 2007
Added:
>
>
 
  • /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO
    sample1.png
  • /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026
Line: 16 to 22
  sample1.png
  • /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026
    tx2.jpg
Added:
>
>
  • /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740 and /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740
    tx3and4.png

History of Commissioned Downlinks to UCSD (beginning 04 October 2007)

  • 04 Oct 2007 - Commissioned downlinks are available from T1_ASGC and T1_FNAL (as well as from T2 sites at Caltech, Purdue and Estonia)
  • New links added here when they become activated.

-- JamesLetts - 05 Oct 2007

 
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191508849" name="sample1.png" path="sample1.png" size="56746" user="Main.FkW" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191557325" name="tx3and4.png" path="tx3and4.png" size="52878" user="Main.JamesLetts" version="1"

Revision 62007/10/05 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 9 to 9
 
October 3rd 9:35pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB 6h14m
October 4th 7:35am /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
October 4th 12:40pm /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO FNAL buffer, CERN buffer 841GB  
Added:
>
>
October 4th 7:09pm /PhotonJets_Pt_15_20/CMSSW_1_5_2-CSA07-2164/GEN-SIM-DIGI-RECO FNAL 780GB  
  -- FkW - 04 Oct 2007
  • /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO

Revision 52007/10/04 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 8 to 8
 
Request time dataset available at size latency
October 3rd 9:35pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB 6h14m
October 4th 7:35am /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
Changed:
<
<
>
>
October 4th 12:40pm /PhotonJets_Pt_50_80/CMSSW_1_5_2-CSA07-1186411740/GEN-SIM-DIGI-RECO FNAL buffer, CERN buffer 841GB  
  -- FkW - 04 Oct 2007
  • /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO

Revision 42007/10/04 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Measuring Data Transfer Latency

Changed:
<
<		PhEDEx? hourly plots for each dataset are linked in at the bottom of the page.
>
>		PhEDEx hourly plots for each dataset are linked in at the bottom of the page.
 
Request time dataset available at size latency
Changed:
<
<
October 3rd 9:35pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB ~6hours
October 4th 7:35am /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB  
>
>
October 3rd 9:35pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB 6h14m
October 4th 7:35am /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB 3h46m
 

-- FkW - 04 Oct 2007

  • /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO
    sample1.png
Added:
>
>
  • /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026
    tx2.jpg
 
Changed:
<
<
META FILEATTACHMENT attachment="sample1.png" attr="" comment="" date="1191508848" name="sample1.png" path="sample1.png" size="56746" stream="sample1.png" user="Main.FkW" version="1"
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191524790" name="tx2.jpg" path="tx2.jpg" size="150670" user="Main.JamesLetts" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1191508849" name="sample1.png" path="sample1.png" size="56746" user="Main.FkW" version="1"

Revision 32007/10/04 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Measuring Data Transfer Latency

Added:
>
>		PhEDEx? hourly plots for each dataset are linked in at the bottom of the page.
 
Changed:
<
<
Request time dataset available at size arrival time
October 3rd 9:35pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB  
>
>
Request time dataset available at size latency
October 3rd 9:35pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB ~6hours
October 4th 7:35am /QCD_Pt_15_20/CMSSW_1_5_2-CSA07-2026/GEN-SIM-DIGI-RECO FNAL MSS, CERN MSS 1.9TB  
 

-- FkW - 04 Oct 2007 \ No newline at end of file

Added:
>
>
  • /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO
    sample1.png

META FILEATTACHMENT attachment="sample1.png" attr="" comment="" date="1191508848" name="sample1.png" path="sample1.png" size="56746" stream="sample1.png" user="Main.FkW" version="1"

Revision 22007/10/04 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Measuring Data Transfer Latency

Request time dataset available at size arrival time
Changed:
<
<
October 3rd 9:10pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB  
>
>
October 3rd 9:35pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB  
 

-- FkW - 04 Oct 2007

Revision 12007/10/04 - Main.FkW

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="WebHome"

Measuring Data Transfer Latency

Request time dataset available at size arrival time
October 3rd 9:10pm /Zee/CMSSW_1_3_1-Spring07-1353/GEN-SIM-DIGI-RECO FNAL MSS, IN2P3? MSS 1.4TB  

-- FkW - 04 Oct 2007

View topic | History: r39 < r38 < r37 < r36 | More topic actions...
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback