service gwms-factory upgrade

gwms-factory upgrade

Start all services (rhel6):

service httpd start
service condor start
service gwms-factory start

rhel7:

<entries>
</entries>

http://www.t2.ucsd.edu/twiki2/bin/view/UCSDTier2/SharedFactoryConf

useradd gfactory

http://www.t2.ucsd.edu/twiki2/bin/view/UCSDTier2/AddFrontend

Create the glidein tarballs the usual way but note they should now go into /var/lib/gwms-factory/condor:

http://www.t2.ucsd.edu/twiki2/bin/view/UCSDTier2/UpgradeGlideCondor#Create_Stripped_Tarballs

sed -i 's/enabled=1/enabled=0/' /etc/yum.repos.d/epel.repo
sed -i 's/enabled=1/enabled=0/' /etc/yum.repos.d/osg-el6.repo

yum install --enablerepo=epel --enablerepo=osg-development condor-cream-gahp

/etc/gwms-factory

Contents

Instructions

Notable Differences in RPM Installation

The factory config file is now located at:

/etc/gwms-factory/glideinWMS.xml

Commands to start, stop, reconfg, etc all use the init.d script, e.g.:

/etc/init.d/gwms-factory start

The factory working directory is now:

/var/lib/gwms-factory/work-dir

The web monitoring url has changed to:

http://hostname/factory/monitor/

Command line tools are now located in

/usr/bin

Some are even renamed without extensions, e.g. cat_StartdLog

valid-caller-uids = _gfactory
valid-caller-gids = _gfactory

Create the FE DN file:

touch /etc/condor/config.d/90_gwms_dns.config

Add the FE user(s) in the usual way:

http://www.t2.ucsd.edu/twiki2/bin/view/UCSDTier2/AddFrontend

Add our usual 99_local_tweaks.config file and add the needed local settings

Special settings for GOC:

# added IN_ prefix to not limit outgoing connections 2014-08-08 --Jeff
IN_LOWPORT=20000
IN_HIGHPORT=50000

#goc uses nonstandard locations here
GSI_DAEMON_CERT =  /etc/grid-security/host/cert.pem
GSI_DAEMON_KEY  =  /etc/grid-security/host/key.pem

Special settings for CERN:

# added IN_ prefix to not limit outgoing connections 2014-08-08 --Jeff
IN_LOWPORT=20000
IN_HIGHPORT=25000

# change to whatever uid / gid cern actually uses
CONDOR_IDS = 100003.100003

Create the glidein tarballs the usual way but note they should now go into /var/lib/gwms-factory/condor:

http://www.t2.ucsd.edu/twiki2/bin/view/UCSDTier2/UpgradeGlideCondor#Create_Stripped_Tarballs

Modify /etc/gwms-factory/glideinWMS.xml as needed. Everything should look like our usual config, except keep the following:

glidein_name="gfactory_instance"
factory_versioning="False"

Factory versioning doesn't make sense for rpm installations.

Also don't modify any of the rpm default path settings.

When finished modding glideinWMS.xml, run upgrade:

/etc/init.d/gwms-factory upgrade

Start all services:

/etc/init.d/httpd start
/etc/init.d/condor start
/etc/init.d/gwms-factory start

for ((i = 1;i <= 9;i++));do
install -o condor -g condor -d /var/lib/condor/schedd_glideins${i}/execute
install -o condor -g condor -d /var/lib/condor/schedd_glideins${i}/lock
install -o condor -g condor -d /var/lib/condor/schedd_glideins${i}/procd_pipe
install -o condor -g condor -d /var/lib/condor/schedd_glideins${i}/spool
done

Create secondary schedd dirs (cern):

for ((i = 1;i <= 9;i++));do
install -o _condor -g _condor -d /var/lib/condor/schedd_glideins${i}/execute
install -o _condor -g _condor -d /var/lib/condor/schedd_glideins${i}/lock
install -o _condor -g _condor -d /var/lib/condor/schedd_glideins${i}/procd_pipe
install -o _condor -g _condor -d /var/lib/condor/schedd_glideins${i}/spool
done

cd /etc/condor/config.d
rm 01_gwms_factory_collectors.config
wget --no-check-certificate https://raw.githubusercontent.com/jdost321/factools/dev/etc/condor_config/generic/01_gwms_factory_collectors.config
echo "# zero out but don't delete" > 03_gwms_factory_local.config
wget --no-check-certificate https://raw.githubusercontent.com/jdost321/factools/dev/etc/condor_config/generic/03_gwms_local.config
echo "# zero out but don't delete" > 11_gwms_factory_secondary_collectors.config

Fix QUEUE_SUPER_USERS (non-cern):

sed -i 's/wmsfactory/gfactory/' 00_gwms_factory_general.config

Fix QUEUE_SUPER_USERS (cern):

sed -i 's/wmsfactory/_gfactory/' 00_gwms_factory_general.config

cd /opt
git clone https://github.com/jdost321/factools.git
cd factools
git checkout dev

Factory RPM Install

Install epel and osg 3.2 repos as outlined:

https://twiki.grid.iu.edu/bin/view/Documentation/Release3/YumRepositories

Install OSG CA certs:

yum install osg-ca-certs

Install fetch-crl, and enable and start both boot and cron:

https://twiki.grid.iu.edu/bin/view/Documentation/Release3/InstallCertAuth#Managing_Certificate_Revocation

Disable epel and osg repos, we will explicitly enable them only when we need to upgrade factory and condor components:

sed -i 's/enabled=1/enabled=0/' /etc/yum.repos.d/epel.repo
sed -i 's/enabled=1/enabled=0/' /etc/yum.repos.d/osg.repo

Create special factory and condor users (cern only):

useradd _condor
useradd _gfactory

Install condor and factory rpms:

yum --enablerepo=epel --enablerepo=osg install condor
yum --enablerepo=epel --enablerepo=osg install glideinwms-factory

Chown rpm files to correct user (cern only):

for f in `rpm -ql condor`;do if [ `stat -c %U $f` = condor ];then chown _condor:_condor $f;fi;done
for f in `rpm -ql glideinwms-factory-condor`;do if [ `stat -c %U $f` = condor ];then chown _condor:_condor $f;fi;done
for f in `rpm -ql glideinwms-factory`;do if [ `stat -c %U $f` = gfactory ];then chown _gfactory:_gfactory $f;fi;done

Modify factry startup script to use _gfactory (cern only):

sed -i 's/^FACTORY_USER=gfactory/FACTORY_USER=_gfactory/' /etc/init.d/gwms-factory

As of condor 8.3.2, disable LOCAL_CONFIG_FILE to prevent overriding config.d files:

sed -i 's/^LOCAL_CONFIG_FILE/#LOCAL_CONFIG_FILE/' /etc/condor/condor_config