Difference: UpgradeGlideCondor (1 vs. 20)

Revision 202021/07/28 - Main.JeffreyDost

Line: 1 to 1
 
META TOPICPARENT name="GlideinFactoryFAQ"

Upgrading Glidein Condor

Line: 34 to 34
  Until further notice the glidein assumes there is no base condor-* dir inside the tarball. to fix this, perform the following instructions. As an example suppose the downloaded tarball is condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz.
Changed:
<
<
cd /tmp tar -xzf /root/Downloads/tarballs/condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz

>
>
cd /tmp
tar -xzf /root/Downloads/tarballs/condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz

 cd condor-8.9.13-1-x86_64_Ubuntu18-stripped/ tar -czf condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz * mv condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz /var/lib/gwms-factory/condor/

Revision 192021/06/08 - Main.JeffreyDost

Line: 1 to 1
 
META TOPICPARENT name="GlideinFactoryFAQ"

Upgrading Glidein Condor

Line: 10 to 10
  Go to the Condor website and download tarballs:
Changed:
<
<
http://research.cs.wisc.edu/htcondor/downloads/
>
>
https://research.cs.wisc.edu/htcondor/tarball/
  For organization, we recommend to download all currently used tarballs to /root/Downloads/tarballs.
Changed:
<
<
cd /root/Downloads/tarballs
wget http://parrot.cs.wisc.edu//symlink/tmp_path_to_tarball/condor-rel-x86_RedHat6-stripped.tar.gz
>
>
cd /root/Downloads/tarballs wget http://parrot.cs.wisc.edu//symlink/tmp_path_to_tarball/condor-rel-x86_RedHat6-stripped.tar.gz 
  Download each permutation for the needed release (as of 2014-01-09):
  • condor-rel-x86_RedHat5-stripped.tar.gz
Line: 30 to 28
  http://gfactory-1.t2.ucsd.edu/debug/tarballs/
Changed:
<
<

Create Stripped Tarballs

>
>

Refactor Tarball Structure

This replaces the section below. As of condor 8.9.13 the create_condor_tarball command will create a corrupt tarball. do NOT use it.

Until further notice the glidein assumes there is no base condor-* dir inside the tarball. to fix this, perform the following instructions. As an example suppose the downloaded tarball is condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz.

cd /tmp tar -xzf /root/Downloads/tarballs/condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz
cd condor-8.9.13-1-x86_64_Ubuntu18-stripped/
tar -czf condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz *
mv condor-8.9.13-x86_64_Ubuntu18-stripped.tar.gz /var/lib/gwms-factory/condor/

The new tarballs need to be added to the Factory config in the condor_tarballs section. Hints on how to properly add them are described in the sections starting with Possible Config Values. When ready, continue on to the section, Update, Reconfigure and Restart Factory.

Create Stripped Tarballs OBSOLETE

  Go to the prestage dir:
cd /var/lib/gwms-factory/condor
Line: 39 to 51
 
create_condor_tarball gfactory-g_rel-condor-rel-x86_64_RedHat6-stripped.tar.gz /root/Downloads/tarballs/condor-rel-x86_64_RedHat6-stripped.tar.gz 

Alternatively you can recreate all tarballs from /root/Downloads/tarballs using a for loop:

Changed:
<
<
G_REL=g_rel
for i in /root/Downloads/tarballs/condor-*.tar.gz; do
echo -n "creating gfactory-${G_REL}-`basename $i`..."
create_condor_tarball gfactory-${G_REL}-`basename $i` $i
echo " done."
done
>
>
G_REL=g_rel for i in /root/Downloads/tarballs/condor-*.tar.gz; do echo -n "creating gfactory-${G_REL}-`basename $i`..." create_condor_tarball gfactory-${G_REL}-`basename $i` $i echo " done." done
  The new tarballs need to be added to the Factory config in the condor_tarballs section. Hints on how to properly add them are described in the sections that follow. When ready, continue on to the section, Update, Reconfigure and Restart Factory.

Revision 182018/05/04 - Main.JeffreyDost

Line: 1 to 1
 
META TOPICPARENT name="GlideinFactoryFAQ"

Upgrading Glidein Condor

Line: 39 to 39
 
create_condor_tarball gfactory-g_rel-condor-rel-x86_64_RedHat6-stripped.tar.gz /root/Downloads/tarballs/condor-rel-x86_64_RedHat6-stripped.tar.gz 

Alternatively you can recreate all tarballs from /root/Downloads/tarballs using a for loop:

Changed:
<
<
G_REL=g_rel for i in /root/Downloads/tarballs/condor-*.tar.gz; do

>
>
G_REL=g_rel
for i in /root/Downloads/tarballs/condor-*.tar.gz; do

 echo -n "creating gfactory-${G_REL}-`basename $i`..." create_condor_tarball gfactory-${G_REL}-`basename $i` $i echo " done."

Revision 172017/05/15 - Main.JeffreyDost

Changed:
<
<
Revision 16 is unreadable
>
>
META TOPICPARENT name="GlideinFactoryFAQ"

Upgrading Glidein Condor

Contents

Download Condor

Go to the Condor website and download tarballs:

http://research.cs.wisc.edu/htcondor/downloads/

For organization, we recommend to download all currently used tarballs to /root/Downloads/tarballs.

cd /root/Downloads/tarballs
wget http://parrot.cs.wisc.edu//symlink/tmp_path_to_tarball/condor-rel-x86_RedHat6-stripped.tar.gz

Download each permutation for the needed release (as of 2014-01-09):

  • condor-rel-x86_RedHat5-stripped.tar.gz
  • condor-rel-x86_64_RedHat5-stripped.tar.gz
  • condor-rel-x86_RedHat6-stripped.tar.gz
  • condor-rel-x86_64_RedHat6-stripped.tar.gz

NOTE as of 2016-02-05 we only have sites with x86_64 arch and mostly rhel6. Keeping the above list for ref.

The downloaded tarballs are also symlinked to here, other factories can then access the history as needed:

http://gfactory-1.t2.ucsd.edu/debug/tarballs/

Create Stripped Tarballs

Go to the prestage dir:

cd /var/lib/gwms-factory/condor

Append gfactory-g_rel- in front of stripped tarballs where g_rel is the current glideinWMS version. An example for 64-bit rhel6:

create_condor_tarball gfactory-g_rel-condor-rel-x86_64_RedHat6-stripped.tar.gz /root/Downloads/tarballs/condor-rel-x86_64_RedHat6-stripped.tar.gz 

Alternatively you can recreate all tarballs from /root/Downloads/tarballs using a for loop:

G_REL=g_rel for i in /root/Downloads/tarballs/condor-*.tar.gz; do
echo -n "creating gfactory-${G_REL}-`basename $i`..."
create_condor_tarball gfactory-${G_REL}-`basename $i` $i
echo " done."
done

The new tarballs need to be added to the Factory config in the condor_tarballs section. Hints on how to properly add them are described in the sections that follow. When ready, continue on to the section, Update, Reconfigure and Restart Factory.

Possible Config Values

arch attribute:

Value Meaning
x86 32-bit
default 64-bit

os attribute:

Value Meaning
rhel5 Red Hat Enterprise Linux 5
default Red Hat Enterprise Linux 6

version attribute:

Value Meaning
7.8.7 For each condor rel create an entry with explicit version number
default There must always be exactly one version declared as "default"
7.8.x For each major condor rel (e.g. 7.8) declare one as a ".x" entry.

Declaring a "default" or a ".x" or both can be done on the same tarball entry as the explicit version number using a coma separated list, e.g.: version="7.8.7,default" or version="7.8.7,7.8.x,default"

Tarball Section Ordering

A few guidelines to keep organized:

  • Keep latest versions above older versions
  • For each version follow the pattern below for arch / os permutations.
    • For other OS's, order doesn't matter but keep them below rhel and always start with 32-bit

Release permutation pattern:

arch os
x86 rhel5
default rhel5
x86 default
default default

Update, Reconfigure and Restart Factory

  1. Edit /etc/gwms-factory/glideinWMS.xml
  2. Stop the factory, reconfigure, and then restart:
    service gwms-factory stop
    service gwms-factory reconfig
    service gwms-factory start
    

Authors

-- JeffreyDost - 2012/09/22

<-- TWIKI VARIABLES 
  • Set UCSD_VERS = Production_v4_3
-->

Revision 162016/12/16 - Main.KristaLarson

Changed:
<
<
Revision 15 is unreadable
>
>
Revision 16 is unreadable

Revision 152016/02/05 - Main.JeffreyDost

Changed:
<
<
Revision 14 is unreadable
>
>
Revision 15 is unreadable

Revision 142015/01/15 - Main.JeffreyDost

Changed:
<
<
Revision 13 is unreadable
>
>
Revision 14 is unreadable

Revision 132014/01/09 - Main.JeffreyDost

Changed:
<
<
Revision 12 is unreadable
>
>
Revision 13 is unreadable

Revision 122013/11/05 - Main.LuisLinares

Changed:
<
<
Revision 11 is unreadable
>
>
Revision 12 is unreadable

Revision 112013/09/11 - Main.LuisLinares

Changed:
<
<
Revision 10 is unreadable
>
>
Revision 11 is unreadable

Revision 102013/07/22 - Main.DanielKlein

Changed:
<
<
Revision 9 is unreadable
>
>
Revision 10 is unreadable

Revision 92013/05/21 - Main.LuisLinares

Changed:
<
<
Revision 8 is unreadable
>
>
Revision 9 is unreadable

Revision 82013/03/21 - Main.JeffreyDost

Changed:
<
<
Revision 7 is unreadable
>
>
Revision 8 is unreadable

Revision 72013/01/22 - Main.JeffreyDost

Changed:
<
<
Revision 6 is unreadable
>
>
Revision 7 is unreadable

Revision 62013/01/08 - Main.JeffreyDost

Changed:
<
<
Revision 5 is unreadable
>
>
Revision 6 is unreadable

Revision 52012/12/20 - Main.JeffreyDost

Changed:
<
<
Revision 4 is unreadable
>
>
Revision 5 is unreadable

Revision 42012/12/20 - Main.JeffreyDost

Changed:
<
<
Revision 3 is unreadable
>
>
Revision 4 is unreadable

Revision 32012/10/22 - Main.JeffreyDost

Added:
>
>
Revision 3 is unreadable
Deleted:
<
<
META TOPICPARENT name="GlideinFactoryFAQ"
<-- TWIKI VARIABLES 
  • Set UCSD_VERS = Production_v4_3
-->

Upgrading Glidein Condor

Contents

Download Condor

Go to the Condor website and download tarballs:

http://www.cs.wisc.edu/condor/downloads-v2/download.pl

cd ~/Downloads
wget http://parrot.cs.wisc.edu//symlink/tmp_path_to_tarball/condor-rel-x86_rhap_5.x-stripped.tar.gz

Download each permutation for the needed release (as of 2012-09-22):

  • condor-rel-x86_rhap_5.x-stripped.tar.gz
  • condor-rel-x86_64_rhap_5.x-stripped.tar.gz
  • condor-rel-x86_rhap_6.x-stripped.tar.gz
  • condor-rel-x86_64_rhap_6.x-stripped.tar.gz
  • condor-rel-x86_64_deb_6.x-stripped.tar.gz

Create Stripped Tarballs

Append gfactory-g_rel- in front of stripped tarballs where g_rel is the current glideinWMS version.

Example for 32-bit rhel5:

cd ${GLIDEIN_FACTORY_DIR}.cfg/Prestage
$GLIDEIN_SRC_DIR}/creation/create_condor_tarball gfactory-g_rel-condor-rel-x86_rhap_5.x-stripped.tar.gz ~/Downloads/condor-rel-x86_rhap_5.x-stripped.tar.gz

The new tarballs need to be added to the Factory config in the condor_tarballs section. Hints on how to properly add them are described in the sections that follow. When ready, continue on to the section, Update, Reconfigure and Restart Factory.

Possible Config Values

arch attribute:

Value Meaning
default 32-bit
x86_64 64-bit

os attribute:

Value Meaning
default Red Hat Enterprise Linux 5
rhel6 Red Hat Enterprise Linux 6
deb6 Debian 6

version attribute:

Value Meaning
default There must always be exactly one version declared as "default"
7.8.2 For each condor rel create an entry with explicit version number
7.8.x For each major condor rel (e.g. 7.8) maintain a ".x" entry

If the new downloaded release is intended to become the current "default", and / or ".x" for its major release, update the tar_file attributes of the "default" and / or ".x" entries accordingly.

Typically we just make it available with the explicit version number first while testing.

Tarball Section Ordering

A few guidelines to keep organized:

  • Default versions go on top
  • Keep latest versions above older versions
  • For each major version block keep the .x above the full version entries
  • For each version follow the pattern below for arch / os permutations.
    • For other OS's, order doesn't matter but keep them below rhel and always start with 32-bit (default)

Release permutation pattern:

arch os
default default
x86_64 default
default rhel6
x86_64 rhel6

Update, Reconfigure and Restart Factory

  1. Edit /etc/gwms-factory/glideinWMS.xml
  2. Stop the factory, reconfigure, and then restart:
    service gwms-factory stop
    service gwms-factory reconfig
    service gwms-factory start
    

Authors

-- JeffreyDost - 2012/09/22

Revision 22012/09/22 - Main.JeffreyDost

Line: 1 to 1
 
META TOPICPARENT name="GlideinFactoryFAQ"

Revision 12012/09/22 - Main.JeffreyDost

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="GlideinFactoryFAQ"
<-- TWIKI VARIABLES 
  • Set UCSD_VERS = Production_v4_3
-->

Upgrading Glidein Condor

Contents

Download Condor

Go to the Condor website and download tarballs:

http://www.cs.wisc.edu/condor/downloads-v2/download.pl

cd ~/Downloads
wget http://parrot.cs.wisc.edu//symlink/tmp_path_to_tarball/condor-rel-x86_rhap_5.x-stripped.tar.gz

Download each permutation for the needed release (as of 2012-09-22):

  • condor-rel-x86_rhap_5.x-stripped.tar.gz
  • condor-rel-x86_64_rhap_5.x-stripped.tar.gz
  • condor-rel-x86_rhap_6.x-stripped.tar.gz
  • condor-rel-x86_64_rhap_6.x-stripped.tar.gz
  • condor-rel-x86_64_deb_6.x-stripped.tar.gz

Create Stripped Tarballs

Append gfactory-grel- in front of stripped tarballs where grel is the current glideinWMS version.

Example for 32-bit rhel5:

cd ${GLIDEIN_FACTORY_DIR}.cfg/Prestage
$GLIDEIN_SRC_DIR}/creation/create_condor_tarball gfactory-grel-condor-rel-x86_rhap_5.x-stripped.tar.gz ~/Downloads/condor-rel-x86_rhap_5.x-stripped.tar.gz

The new tarballs need to be added to the Factory config in the condor_tarballs section. Hints on how to properly add them are described in the sections that follow. When ready, continue on to the section, Update, Reconfigure and Restart Factory.

Possible Config Values

arch attribute:

Value Meaning
default 32-bit
x86_64 64-bit

os attribute:

Value Meaning
default Red Hat Enterprise Linux 5
rhel6 Red Hat Enterprise Linux 6
deb6 Debian 6

Update, Reconfigure and Restart Factory

  1. Edit /etc/gwms-factory/glideinWMS.xml
  2. Stop the factory, reconfigure, and then restart:
    service gwms-factory stop
    service gwms-factory reconfig
    service gwms-factory start
    

Authors

-- JeffreyDost - 2012/09/22

 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback