Difference: CREAMTest (9 vs. 10)

Revision 102010/05/06 - Main.IgorSfiligoi

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

CREAM Tests

Introduction

Line: 27 to 27
 Massimo Sgaravatto helpped with the installation, resulting in the following instructions:

Installation

Changed:
<
<

- Copied in /etc/yum.repos.d the following repos:

http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.2/dag.repo
http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.2/lcg-CA.repo
http://etics-repository.cern.ch:8080/repository/pm/registered/repomd/name/patch_3179/etics-registered-build-by-name.repo (CREAM repo)


The third one will be replaced with a "cleaner" one as soon as glite patch #3179 will be in production
(current state is certified)



- Of course also the OS repo files are needed as well


- yum install yum-protectbase
Set protect=1 in the dag and OS repos
This is needed because the temporary CREAM repo can contain also rpms provided by the OS/DAG.
This won't be needed anymore when the temporary CREAM repo will be replaced with the production
one


- yum clean all
- yum update
- yum install java-1.6.0-openjdk tomcat5
- yum install lcg-CA
- yum install xml-commons-apis
- yum install glite-CREAM


- Installed/updated these RPMs (this won't be needed anymore when glite-CONDOR_utils is released):

http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/glite-info-dynamic-scheduler-condor/1.0.0/noarch/glite-info-dynamic-scheduler-condor-1.0.0-1.noarch.rpm

http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/glite-yaim-condor-utils/5.1.0/noarch/glite-yaim-condor-utils-5.1.0-1.noarch.rpm

http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/org.glite.apel.condor/2.0.6/slc4_ia32_gcc346/glite-apel-condor-2.0.6-2.noarch.rpm
>
>

Copied in /etc/yum.repos.d the following repos:
http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.2/dag.repo
http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.2/lcg-CA.repo
http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.2/glite-CREAM.repo


Of course also the OS repo files are needed as well


yum clean all
yum update
yum install java-1.6.0-openjdk tomcat5
yum install lcg-CA
yum install xml-commons-apis
yum install glite-CREAM


Installed/updated these RPMs (this won't be needed anymore when glite-CONDOR_utils is released):
http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/glite-info-dynamic-scheduler-condor/1.0.0/noarch/glite-info-dynamic-scheduler-condor-1.0.0-1.noarch.rpm
http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/glite-yaim-condor-utils/5.1.0/noarch/glite-yaim-condor-utils-5.1.0-1.noarch.rpm
http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/org.glite.apel.condor/2.0.6/slc4_ia32_gcc346/glite-apel-condor-2.0.6-2.noarch.rpm
 

Configuration and customizations:

Changed:
<
<

- Customized the conf files (/root/SiteInfo/site-info.def and
/root/SiteInfo/services/glite-creamce)
siteinfo.def file (/opt/glite/yaim/examples/siteinfo/site-info.def)



- Run yaim:

/opt/glite/yaim/bin/yaim -c -s /root/SiteInfo/site-info.def -n creamCE -n CONDOR_utils



- Because in the WN the proper environment is not already defined, it was needed
to customize the CREAM JobWrapper? .
This was done following the instructions reported at:

http://grid.pd.infn.it/cream/field.php?n=Main.HowToCustomizeTheCREAMJobWrapper

("Instructions for CREAM CE >= 1.6 (glite-ce-cream >= 1.12)" section)

adding the following 2 lines:

export OSG_GRID=/code/osgcode/wn-client
. $OSG_GRID/setup.sh


after:

for((idx=0; idx<${#__environment[*]}; idx++)); do
eval export ${__environment[$idx]}
done


- Because the UCSD Condor installation requires a special arguments setting
in the Condor submit file, /opt/glite/bin/condor_submit.sh was mofified changing:

arguments = $arguments

into:

arguments = -wrapper_iwd $_CONDOR_SCRATCH_DIR $arguments
>
>
Customized the conf files (/root/SiteInfo/site-info.def and
/root/SiteInfo/services/glite-creamce)
siteinfo.def file (/opt/glite/yaim/examples/siteinfo/site-info.def)

(attached is the siteinfo used on osg-gw-3)

Run yaim:

/opt/glite/yaim/bin/yaim -c -s /root/SiteInfo/site-info.def -n creamCE -n CONDOR_utils



Because in the WN the proper environment is not already defined, it was needed
to customize the CREAM JobWrapper? .
This was done following the instructions reported at:

http://grid.pd.infn.it/cream/field.php?n=Main.HowToCustomizeTheCREAMJobWrapper

("Instructions for CREAM CE >= 1.6 (glite-ce-cream >= 1.12)" section)

adding the following 2 lines:

export OSG_GRID=/code/osgcode/wn-client
. $OSG_GRID/setup.sh

after:

for((idx=0; idx<${#__environment[*]}; idx++)); do
eval export ${__environment[$idx]}
done


Because the UCSD Condor installation requires a special arguments setting
in the Condor submit file, /opt/glite/bin/condor_submit.sh was mofified changing:

arguments = $arguments

into:

arguments = -wrapper_iwd $_CONDOR_SCRATCH_DIR $arguments

 

Service startup

- service tomcat5 stop
- /opt/glite/etc/init.d/glite-ce-blahparser stop
- service tomcat5 start

Line: 71 to 77
 
META FILEATTACHMENT attachment="cream_10k.ods" attr="" comment="Running 10k jobs against CREAM (and compared to GT2) - UCSD LAN - Condor 7.5.0" date="1266646200" name="cream_10k.ods" path="cream_10k.ods" size="60966" stream="cream_10k.ods" tmpFilename="/tmp/IVOFTiqgVF" user="IgorSfiligoi" version="2"
META FILEATTACHMENT attachment="cream_10k_abs.png" attr="" comment="Abs values of the 10k run" date="1266644968" name="cream_10k_abs.png" path="cream_10k_abs.png" size="46510" stream="cream_10k_abs.png" tmpFilename="/tmp/Q4t329jNvH" user="IgorSfiligoi" version="1"
META FILEATTACHMENT attachment="cream_30min_job_spread.png" attr="" comment="Time spread of the 30min jobs" date="1266645487" name="cream_30min_job_spread.png" path="cream_30min_job_spread.png" size="27875" stream="cream_30min_job_spread.png" tmpFilename="/tmp/teUDV7dcWY" user="IgorSfiligoi" version="1"
Added:
>
>
META FILEATTACHMENT attachment="SiteInfo_gw3.tgz" attr="" comment="SiteInfo used on the test machine (osg-gw-3)" date="1273165702" name="SiteInfo_gw3.tgz" path="SiteInfo_gw3.tgz" size="7786" stream="SiteInfo_gw3.tgz" tmpFilename="/tmp/adzSutv4Ur" user="IgorSfiligoi" version="1"
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback