Cross OSG CE - Schedd and CE installation instructions

Location

osg-glidein-ce.t2.ucsd.edu

Node type

CentOS? 6

Maintenance

The usual

service condor 
service globus-gatekeeper 
service globus-gridftp-server 

Detailed instructions

# Node came pre-installed with the osg-ca-certs
# If not, follow the instructions at
# https://twiki.grid.iu.edu/bin/view/Documentation/Release3/InstallOSGClient#Install_the_CA_Certificates_A_qu

# make sure crls are running
chkconfig fetch-crl-boot on
chkconfig fetch-crl-cron on
service fetch-crl-cron start

# Install basic condor
yum install condor

# Install glideinWMS RPM
# Note: Not fully ready yet, so I had to hack around it a bit
yum install --enablerepo=osg-development glideinwms-userschedd

# fix list of daemons started
echo -e "# Fix gwms temp problem\nDAEMON_LIST = MASTER,SCHEDD,SHARED_PORT" >/etc/condor/config.d/20_daemons.config

# put in place the common files
wget http://www.t2.ucsd.edu/twiki2/pub/UCSDTier2/CrossOSGCE/80_crossosgce_domain.config -O /etc/condor/config.d/80_crossosgce_domain.config
wget http://www.t2.ucsd.edu/twiki2/pub/UCSDTier2/CrossOSGCEInstCE/81_crossosgce_ce.config -O /etc/condor/config.d/81_crossosgce_ce.config

# Add the DNs  

cd /root 
# had to use a dev branch since the needed tools were not yet merged into the v2_7_1 series 
# but they are supposed to be 
git clone -b branch_v2plus_igor_3777 http://cdcvs.fnal.gov/projects/glideinwms 

# load the list of DNs
wget http://www.t2.ucsd.edu/twiki2/pub/UCSDTier2/CrossOSGCEInstCE/dns.ce.list -O dns.list

# now create the necessary files 
cd /root/glideinwms/install 
./glidecondor_addDN -recreate -disable-checks -import /root/dns.list

#
# Condor is fully configured now 
# 
 
# Now install the CE itself
yum install osg-ce-condor
yum install globus-gram-job-manager-managedfork

# this one is needed for the jobmanager patch
yum install perl-VOMS-Lite

# configure it
wget http://www.t2.ucsd.edu/twiki2/pub/UCSDTier2/CrossOSGCEInstCE/crossosg_osg.patch -O /root/osg.patch
cd /etc/osg
patch -p0 </root/osg.patch

# we need to create the dummy file in tmp for app_dir to be happy
mkdir /tmp/etc

# verify and let it finish the config
cd /root
osg-configure -v
osg-configure -c

#
# Now patch the OSG SW to work in the CrossOSG CE mode
#

wget http://www.t2.ucsd.edu/twiki2/pub/UCSDTier2/CrossOSGCEInstCE/jobmanager.patch -O /root/jobmanager.patch
patch /usr/share/perl5/vendor_perl/Globus/GRAM/JobManager/condor.pm /root/jobmanager.patch

wget http://www.t2.ucsd.edu/twiki2/pub/UCSDTier2/CrossOSGCEInstCE/gratia.patch -O /root/gratia.patch
patch /usr/share/gratia/condor/condor_meter /root/gratia.patch

# May need a gratia patch, but still evaluating

#
# Create the needed user accounts
# together with the service proxy holding directory
# and permission for the FE to scp into it
#

#... this will change in time ...
#... the plan is to support only a few users ...

# GLOW pilot
useradd glow
mkdir ~glow/.crossosg ~glow/.ssh
wget http://www.t2.ucsd.edu/twiki2/pub/UCSDTier2/CrossOSGCEInstCE/authkeys_ce.list -O ~glow/.ssh/authorized_keys
chown -R glow:glow ~glow/.crossosg ~glow/.ssh

# open up the firewall
# 9615 for shared port, 2119&2811 for globus, 10k-18k for GRAM
# the following patch can be handy, but you may want to do the changes by hand
wget http://www.t2.ucsd.edu/twiki2/pub/UCSDTier2/CrossOSGCEInstCE/iptables_ce.patch -O /root/iptables.patch
patch /etc/sysconfig/iptables /root/iptables.patch

# start the services
service condor start
chkconfig condor on

service gums-client-cron start
chkconfig gums-client-cron on

service globus-gatekeeper start
chkconfig globus-gatekeeper on
service globus-gridftp-server start
chkconfig globus-gridftp-server on

service tomcat6 start
chkconfig tomcat6 on
service gratia-probes-cron start
chkconfig gratia-probes-cron on
service osg-cleanup-cron start
chkconfig osg-cleanup-cron on

-- IgorSfiligoi - 2013/05/02

Topic attachments
I Attachment Action Size Date Who Comment
elseconfig 81_crossosgce_ce.config manage 0.8 K 2013/05/13 - 20:49 IgorSfiligoi CE specific Condor config
elselist authkeys_ce.list manage 0.4 K 2013/05/13 - 21:52 IgorSfiligoi The FE ssh pub key
elsepatch crossosg_osg.patch manage 3.6 K 2013/05/13 - 21:38 IgorSfiligoi The patch fle containing the changes needed to finalze the OSG configuration on the CE
elselist dns.ce.list manage 0.3 K 2013/05/03 - 18:22 IgorSfiligoi List of all the DNs used in the CrossOSGCE pool
elsepatch gratia.patch manage 0.5 K 2013/05/16 - 23:32 IgorSfiligoi Patch to the gratia probe, so it reports the right VO
elsepatch iptables_ce.patch manage 0.6 K 2013/05/05 - 23:17 IgorSfiligoi Patch to the iptables rules for the CE
elsepatch jobmanager.patch manage 4.6 K 2013/05/16 - 23:28 IgorSfiligoi Patch for the jobmanager-condor, so it uses the right proxy
Edit | Attach | Print version | History: r12 < r11 < r10 < r9 < r8 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r10 - 2013/05/16 - 23:33:43 - IgorSfiligoi
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback