Difference: CrabOnUAF (1 vs. 7)

Revision 72014/06/10 - Main.VinceWelke

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

HOW TO CONFIGURE AND RUN CRAB ON uaf-{7,8,9}.t2.ucsd.edu

Line: 25 to 25
 voms-proxy-init -valid 120:00 -voms cms:/cms
Added:
>
>		Any additional information on using crab is documented here.
  -- VinceWelke - 2014/06/09

Revision 62014/06/09 - Main.VinceWelke

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

HOW TO CONFIGURE AND RUN CRAB ON uaf-{7,8,9}.t2.ucsd.edu

Changed:
<
<		The following shows how to submit crab jobs from a CMSSW environment. In order to set up a CMSSW environment on the uaf, follow the instructions here? . More detailed documentation on CRAB can be found here.
>
>		The following shows how to submit crab jobs from a CMSSW environment. In order to set up a CMSSW environment on the uaf, follow the instructions here. More detailed documentation on CRAB can be found here. The instructions on this page assume you are already setup to submit jobs to the grid.
 
Changed:
<
<		source /code/osgcode/cmssoft/cmsset_default.sh > /dev/null 2>&1

#export a second time since above line changes the scram_arch

>
>		First you need to setup your environment with the following commands:
 
Added:
>
>
source /code/osgcode/cmssoft/cmsset_default.sh > /dev/null 2>&1
 export SCRAM_ARCH=slc5_amd64_gcc462
Added:
>
>		source /code/osgcode/ucsdt2/Crab/etc/crab.sh source /code/osgcode/ucsdt2/gLite-3.2.11-1/etc/profile.d/grid_env.sh
 
Changed:
<
<		In my .bash_profile I source /data/vdt/setup.sh
>
>		This will set you up to be able to use crab to submit CMSSW jobs. In order to actually use crab, you will need to make sure your grid credentials are up to date. This can be checked with the following command:
 
Changed:
<
<		#!/bin/sh TOP=$PWD

export SCRAM_ARCH=slc3_ia32_gcc323 export VDT_LOCATION=/data/vdt export EDG_WL_LOCATION=$VDT_LOCATION/edg source $VDT_LOCATION/setup.sh #Check for valid voms proxy, must be valid for at least 24hrs voms-proxy-info -exists -valid 24:00 if [ $? == 1 ] ; then echo please generate a new proxy fi

# define versions project=CMSSW #version=1_4_0_pre3 version=1_3_1 crab_version=CRAB_1_5_1_pre1

# clean up cd $TOP rm -rf $HOME/.bossrc $HOME/boss rm -rf $TOP/$crab_version rm -rf $TOP/${project}_${version}

# configure CRAB and boss CRAB_TARBALL=/code/osgcode/cmslocal/crab/$crab_version.tgz tar zxvf $CRAB_TARBALL cd $crab_version ./configure source ./crab.sh ./configureBoss source ./crab.sh

# set up a CMSSW area cd $TOP #source /code/osgcode/cmslocal/cms/cmsset_default.sh ${project}_${version} source /code/osgcode/cmssoft/cmsset_default.sh ${project}_${version} scramv1 project $project ${project}_${version} cd ${project}_${version}/src eval `scramv1 runtime -sh`

# make a crab configuration file cat > crab.cfg << EOF [CRAB] jobtype = cmssw scheduler = condor_g [CMSSW] datasetpath =/mc-onsel-120_Incl_ttbar/FEVT/CMSSW_1_2_0-FEVT-1166726158 pset=/code/osgcode/cmslocal/crab/CRAB/python/runSimHitAnalyzer.cfg total_number_of_events=200 number_of_jobs = 2 output_file = Histos.root [USER] return_data = 1 use_central_bossDB = 0 use_boss_rt = 1 boss_clads= [EDG] lcg_version = 2 proxy_server = myproxy.cern.ch additional_jdl_parameters = AllowZippedISB? = false; virtual_organization = cms retry_count = 2 lcg_catalog_type = lfc lfc_host = lfc-cms-test.cern.ch lfc_home = /grid/cms CE_white_list=ucsd.edu SE_white_list=ucsd.edu [CONDORG] EOF

# create crab jobs LOG=log_`date +%s`_$RANDOM crab -create -cfg ./crab.cfg | tee $LOG 2>&1 job=`grep "working directory" $LOG | awk -F/ '{print $(NF-1)}'` echo your job is $job crab -submit 1 -continue $job

exit

>
>		voms-proxy-info --all
 
Changed:
<
<		To run a crab command later (i.e. to check the job status, get output etc.) set up the environment and then run the command $1:
>
>		In order to refresh your credentials, do the following:
 
Changed:
<
<		#!/bin/sh TOP=$PWD export SCRAM_ARCH=slc3_ia32_gcc323 export VDT_LOCATION=/data/vdt export EDG_WL_LOCATION=$VDT_LOCATION/edg source $VDT_LOCATION/setup.sh project=CMSSW version=1_3_1 crab_version=CRAB_1_5_1_pre1 cd $crab_version source ./crab.sh cd $TOP source /code/osgcode/cmssoft/cmsset_default.sh ${project}_${version} cd ${project}_${version}/src eval `scramv1 runtime -sh` crab -$1 exit
>
>		voms-proxy-init -valid 120:00 -voms cms:/cms
 
Deleted:
<
<		-- JamesLetts - 08 May 2007
 \ No newline at end of file
Added:
>
>		 -- VinceWelke - 2014/06/09

Revision 52014/06/03 - Main.VinceWelke

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Changed:
<
<

HOW TO CONFIGURE AND RUN CRAB ON uaf-1.t2.ucsd.edu

>
>

HOW TO CONFIGURE AND RUN CRAB ON uaf-{7,8,9}.t2.ucsd.edu

 
Changed:
<
<		The following script configures BOSS, setups of a CMSSW area, creates a crab.cfg file, creates and submits a couple of jobs.
>
>		The following shows how to submit crab jobs from a CMSSW environment. In order to set up a CMSSW environment on the uaf, follow the instructions here? . More detailed documentation on CRAB can be found here.
 
Changed:
<
<		This example is set up for OSG sites.
>
>		source /code/osgcode/cmssoft/cmsset_default.sh > /dev/null 2>&1
 
Changed:
<
<		More detailed documentation on CRAB can be found here.
>
>		#export a second time since above line changes the scram_arch

export SCRAM_ARCH=slc5_amd64_gcc462

  In my .bash_profile I source /data/vdt/setup.sh

Revision 42007/06/26 - Main.MatthewLeBourgeois

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

HOW TO CONFIGURE AND RUN CRAB ON uaf-1.t2.ucsd.edu

Line: 18 to 18
 export VDT_LOCATION=/data/vdt export EDG_WL_LOCATION=$VDT_LOCATION/edg source $VDT_LOCATION/setup.sh
Changed:
<
<		voms-proxy-info -exists -hours 24
>
>		#Check for valid voms proxy, must be valid for at least 24hrs voms-proxy-info -exists -valid 24:00
 if [ $? == 1 ] ; then echo please generate a new proxy fi

Revision 32007/05/09 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Deleted:
<
<		WORKING DOCUMENT - DOES NOT WORK YET
 

HOW TO CONFIGURE AND RUN CRAB ON uaf-1.t2.ucsd.edu

The following script configures BOSS, setups of a CMSSW area, creates a crab.cfg file, creates and submits a couple of jobs.

Line: 10 to 8
  More detailed documentation on CRAB can be found here.
Added:
>
>		In my .bash_profile I source /data/vdt/setup.sh
 
#!/bin/sh
TOP=$PWD
Changed:
<
<		# clean up old boss configurations
>
>		export SCRAM_ARCH=slc3_ia32_gcc323 export VDT_LOCATION=/data/vdt export EDG_WL_LOCATION=$VDT_LOCATION/edg source $VDT_LOCATION/setup.sh voms-proxy-info -exists -hours 24 if [ $? == 1 ] ; then echo please generate a new proxy fi

# define versions project=CMSSW #version=1_4_0_pre3 version=1_3_1 crab_version=CRAB_1_5_1_pre1

# clean up cd $TOP

 rm -rf $HOME/.bossrc $HOME/boss
Added:
>
>		rm -rf $TOP/$crab_version rm -rf $TOP/${project}_${version}
 
Changed:
<
<		# configure boss export SCRAM_ARCH=slc3_ia32_gcc323 CRAB=/code/osgcode/cmslocal/crab/CRAB cd $CRAB
>
>		# configure CRAB and boss CRAB_TARBALL=/code/osgcode/cmslocal/crab/$crab_version.tgz tar zxvf $CRAB_TARBALL cd $crab_version ./configure source ./crab.sh ./configureBoss
 source ./crab.sh
Deleted:
<
<		$CRAB/configureBoss cd $TOP
  # set up a CMSSW area
Changed:
<
<		project=CMSSW version=1_3_1 source /code/osgcode/cmssoft/cmsset_default.sh $project_$version
>
>		cd $TOP #source /code/osgcode/cmslocal/cms/cmsset_default.sh ${project}_${version} source /code/osgcode/cmssoft/cmsset_default.sh ${project}_${version}
 scramv1 project $project ${project}_${version} cd ${project}_${version}/src
Changed:
<
<		eval `scram runtime -sh` cd $TOP
>
>		eval `scramv1 runtime -sh`
 
Added:
>
>		# make a crab configuration file
 cat > crab.cfg << EOF [CRAB] jobtype = cmssw
Line: 41 to 60
 [CMSSW] datasetpath =/mc-onsel-120_Incl_ttbar/FEVT/CMSSW_1_2_0-FEVT-1166726158 pset=/code/osgcode/cmslocal/crab/CRAB/python/runSimHitAnalyzer.cfg
Changed:
<
<		total_number_of_events=2000
>
>		total_number_of_events=200
 number_of_jobs = 2 output_file = Histos.root [USER]
Line: 65 to 84
  # create crab jobs LOG=log_`date +%s`_$RANDOM
Changed:
<
<		crab -create -cfg $TOP/crab.cfg | tee $LOG 2>&1
>
>		crab -create -cfg ./crab.cfg | tee $LOG 2>&1
 job=`grep "working directory" $LOG | awk -F/ '{print $(NF-1)}'`
Changed:
<
<		echo $job
>
>		echo your job is $job
 crab -submit 1 -continue $job

exit

Line: 74 to 94
 
Added:
>
>		To run a crab command later (i.e. to check the job status, get output etc.) set up the environment and then run the command $1: 
#!/bin/sh
TOP=$PWD
export SCRAM_ARCH=slc3_ia32_gcc323
export VDT_LOCATION=/data/vdt
export EDG_WL_LOCATION=$VDT_LOCATION/edg
source $VDT_LOCATION/setup.sh
project=CMSSW
version=1_3_1
crab_version=CRAB_1_5_1_pre1
cd $crab_version
source ./crab.sh
cd $TOP
source /code/osgcode/cmssoft/cmsset_default.sh ${project}_${version}
cd ${project}_${version}/src
eval `scramv1 runtime -sh`
crab -$1
exit
  -- JamesLetts - 08 May 2007

Revision 22007/05/08 - Main.JamesLetts

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Changed:
<
<		Please put crab related user documentation here.
>
>		WORKING DOCUMENT - DOES NOT WORK YET
 
Added:
>
>

HOW TO CONFIGURE AND RUN CRAB ON uaf-1.t2.ucsd.edu

 
Changed:
<
<		-- TerrenceMartin - 02 Oct 2006
>
>		The following script configures BOSS, setups of a CMSSW area, creates a crab.cfg file, creates and submits a couple of jobs.

This example is set up for OSG sites.

More detailed documentation on CRAB can be found here. 

#!/bin/sh
TOP=$PWD

# clean up old boss configurations
rm -rf $HOME/.bossrc $HOME/boss

# configure boss
export SCRAM_ARCH=slc3_ia32_gcc323
CRAB=/code/osgcode/cmslocal/crab/CRAB
cd $CRAB
source ./crab.sh
$CRAB/configureBoss
cd $TOP

# set up a CMSSW area
project=CMSSW
version=1_3_1
source /code/osgcode/cmssoft/cmsset_default.sh $project_$version
scramv1 project $project ${project}_${version}
cd ${project}_${version}/src
eval `scram runtime -sh`
cd $TOP

cat > crab.cfg << EOF
[CRAB]
jobtype = cmssw
scheduler = condor_g
[CMSSW]
datasetpath =/mc-onsel-120_Incl_ttbar/FEVT/CMSSW_1_2_0-FEVT-1166726158
pset=/code/osgcode/cmslocal/crab/CRAB/python/runSimHitAnalyzer.cfg
total_number_of_events=2000
number_of_jobs = 2
output_file = Histos.root
[USER]
return_data = 1
use_central_bossDB = 0
use_boss_rt = 1 
boss_clads=
[EDG]
lcg_version = 2
proxy_server = myproxy.cern.ch 
additional_jdl_parameters = AllowZippedISB = false;
virtual_organization = cms
retry_count = 2
lcg_catalog_type = lfc
lfc_host = lfc-cms-test.cern.ch
lfc_home = /grid/cms
CE_white_list=ucsd.edu
SE_white_list=ucsd.edu
[CONDORG]
EOF

# create crab jobs
LOG=log_`date +%s`_$RANDOM
crab -create -cfg $TOP/crab.cfg | tee $LOG 2>&1
job=`grep "working directory" $LOG | awk -F/ '{print $(NF-1)}'`
echo $job
crab -submit 1 -continue $job

exit

-- JamesLetts - 08 May 2007

Revision 12006/10/02 - Main.TerrenceMartin

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="WebHome"
Please put crab related user documentation here.

-- TerrenceMartin - 02 Oct 2006

View topic | History: r7 < r6 < r5 < r4 | More topic actions...
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback