Upgrading Glidein Condor

Contents

Download Condor

Go to the Condor website and download tarballs:

https://research.cs.wisc.edu/htcondor/tarball/

For organization, we recommend to download all currently used tarballs to /root/Downloads/tarballs.

cd /root/Downloads/tarballs wget http://parrot.cs.wisc.edu//symlink/tmp_path_to_tarball/condor-rel-x86_RedHat6-stripped.tar.gz 

Download each permutation for the needed release (as of 2014-01-09):

• condor-rel-x86_RedHat5-stripped.tar.gz
• condor-rel-x86_64_RedHat5-stripped.tar.gz
• condor-rel-x86_RedHat6-stripped.tar.gz
• condor-rel-x86_64_RedHat6-stripped.tar.gz

NOTE as of 2016-02-05 we only have sites with x86_64 arch and mostly rhel6. Keeping the above list for ref.

The downloaded tarballs are also symlinked to here, other factories can then access the history as needed:

http://gfactory-1.t2.ucsd.edu/debug/tarballs/

Refactor Tarball Structure

This replaces the section below. As of condor 8.9.13 the create_condor_tarball command will create a corrupt tarball. do NOT use it.

Until further notice the glidein assumes there is no base condor-* dir inside the tarball. to fix this, perform the following instructions. As an example suppose the downloaded tarball is condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz.

cd /tmp
tar -xzf /root/Downloads/tarballs/condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz
cd condor-8.9.13-1-x86_64_Ubuntu18-stripped/
tar -czf condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz *
mv condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz /var/lib/gwms-factory/condor/

The new tarballs need to be added to the Factory config in the condor_tarballs section. Hints on how to properly add them are described in the sections starting with Possible Config Values. When ready, continue on to the section, Update, Reconfigure and Restart Factory.

Create Stripped Tarballs OBSOLETE

Go to the prestage dir:

cd /var/lib/gwms-factory/condor

Append gfactory-g_rel-*in front of stripped tarballs where *g_rel is the current glideinWMS version. An example for 64-bit rhel6:

create_condor_tarball gfactory-g_rel-condor-rel-x86_64_RedHat6-stripped.tar.gz /root/Downloads/tarballs/condor-rel-x86_64_RedHat6-stripped.tar.gz 

Alternatively you can recreate all tarballs from /root/Downloads/tarballs using a for loop:

G_REL=g_rel for i in /root/Downloads/tarballs/condor-*.tar.gz; do echo -n "creating gfactory-${G_REL}-`basename $i`..." create_condor_tarball gfactory-${G_REL}-`basename $i` $i echo " done." done

The new tarballs need to be added to the Factory config in the condor_tarballs section. Hints on how to properly add them are described in the sections that follow. When ready, continue on to the section, Update, Reconfigure and Restart Factory.

Possible Config Values

arch attribute:

os attribute:

version attribute:

Declaring a "default" or a ".x" or both can be done on the same tarball entry as the explicit version number using a coma separated list, e.g.: version="7.8.7,default" or version="7.8.7,7.8.x,default"

Tarball Section Ordering

A few guidelines to keep organized:

• Keep latest versions above older versions
• For each version follow the pattern below for arch / os permutations.
  • For other OS's, order doesn't matter but keep them below rhel and always start with 32-bit

Release permutation pattern:

Update, Reconfigure and Restart Factory

1. Edit /etc/gwms-factory/glideinWMS.xml
2. Stop the factory, reconfigure, and then restart:

   service gwms-factory stop
   service gwms-factory reconfig
   service gwms-factory start
   

Authors

-- JeffreyDost - 2012/09/22