Dirty Crab Tricks

I call this page this way because it's a random selection of fixes that I needed to do at various times in order to get something done.

The structure here is such that I simply give a date as heading, and then whatever weird recipe I needed at that date to get going.

2009/09/07 CRAB creates but (silently) fails to submit

Problem description

Something got fucked up at CERN on lxplus and

 crab -create -submit -cfg TTbar_Summer09-MC_31X_V3-v1.cfg 

leads to my task never getting submitted. It stays in the created state forever.

There is no error message from crab that I can find.

Sanjay asks me to try:

asap-user-register --server glidein-2.t2.ucsd.edu --myproxy

and sure enough, that now fails on cms-tas01 that I was working with the last week or so.

Problem solution

Move all my junk from cms-tas01 to uaf-6.

source /code/osgcode/ucsdt2/gLite/etc/profile.d/grid-env.sh
#it might be a good idea to verify that the gLite environment works for you. Just try it with this:
voms-proxy-init -voms cms
voms-proxy-info -all
#this should have gotten, and shown you your proxy with cms membership
#let's move on and install Sanjay's crab client
cd ~/CMS/crab
scp lxplus.cern.ch:CRAB_2_6_1.tgz .
tar -xvzf CRAB_2_6_1.tgz
cd CRAB_2_6_1/python/
rm -f SchedulerCondor.py
rm -f SchedulerCondorCommon.py
rm -f SchedulerGlidein.py
rm -f SchedulerGrid.py
rm -f Status.py
rm -f Submitter.py
wget http://uaf-2.t2.ucsd.edu/~spadhi/Aug08-2009/client/SchedulerCondor.py
wget http://uaf-2.t2.ucsd.edu/~spadhi/Aug08-2009/client/SchedulerCondorCommon.py
wget http://uaf-2.t2.ucsd.edu/~spadhi/Aug08-2009/client/SchedulerGlidein.py
wget http://uaf-2.t2.ucsd.edu/~spadhi/Aug08-2009/client/SchedulerGrid.py
wget http://uaf-2.t2.ucsd.edu/~spadhi/Aug08-2009/client/Status.py
wget http://uaf-2.t2.ucsd.edu/~spadhi/Aug08-2009/client/Submitter.py
wget http://uaf-2.t2.ucsd.edu/~spadhi/Aug08-2009/client/readme
cd ..
./configure
#if you see any error messages here, assume things failed at this point.
source crab.sh

Now I had to:
   * make a new release directory for 3_1_2
   * checkout CMS2 with tag fkw_090906_test (actually checked out the head, but this is the tag that corresponds to it)
   * compile it
   * make the necessary changes in NtupleMacros/NtupleTools/makeCrabFiles.py
   * run that python script as follows:
./makeCrabFiles.py -CMS2cfg /home/users/fkw/CMS/cmsswWork/CMSSW_3_1_2/src/CMS2/NtupleMaker/test/testSimple_cfg.py -d /TTbar/Summer09-MC_31X_V3-v1/GEN-SIM-RECO


and then finally submit the thing.
 crab -create -submit -cfg TTbar_Summer09-MC_31X_V3-v1.cfg 

Things actually did not go quite as smoothly as described above.
So there may be steps I did that aren't accurately reconstructed above.
However, it did work in the end:
crab:   112 Total Jobs 
>>>>>>>>> 112 Jobs Running 


-- Main.FkW - 2009/09/07