Difference: GlideinWMSInstallationNotesFromChrisBoynton (8 vs. 9)

Revision 92009/10/29 - Main.ChrisBoynton

Line: 1 to 1
 
META TOPICPARENT name="GlideinWMS"

Installation Walkthrough and Notes on the GlideinWMS System

Line: 190 to 189
 
  • The javascriptRRD package (0.4 or later)
  • The perl-Time-HiRes rpm
  • The glideinWMS software
Deleted:
<
<
Let's assume we've already installed these components. If not, follow the steps in part 1. First, we need to create a user account to host the frontend software installation:
 
Changed:
<
<
su - root
groupadd -g 5002 frontend
useradd -c "Frontend Daemon" -g 5002 -m -s /bin/bash -u 5002 frontend
>
>
Let's assume we've already installed these components. If not, follow the steps in part 1.

We need a user for condor to run under.

su - root
groupadd -g 5003 condor
useradd -c "Condor Daemon" -g 5003 -m -s /bin/bash -u 5003 condor

 
Changed:
<
<
Make sure to get a copy of condor into the frontend's home directory:
>
>
BEGIN WARNING -- MISSING CONDOR INSTALL (DO THIS PROXY STUFF ON OTHER SERVER AND COPY IT OVER)

We also need our proxy certificate to identify ourselves (this could be the same as the one generated on SL1):

 
Changed:
<
<
cp condor-7.3.1-linux-x86_64-rhel5-dynamic.tar.gz /home/frontend/
chown frontend:frontend /home/frontend/condor-7.3.1-linux-x86_64-rhel5-dynamic.tar.gz
>
>
su - frontend
mkdir .globus
scp -c blowfish -P 4221 gfactory@sl1:/home/gfactory/cert.p12 /home/frontend/
. /home/frontend/vdt/setup.sh
openssl pkcs12 -in cert.p12 -out cert.key
 
Changed:
<
<
Copy the glideinWMS software into the frontend user's directory from CVS:
>
>
Now remove the public keys from the private key file:
 
Changed:
<
<
su - frontend
cvs -d :pserver:anonymous@cdcvs.fnal.gov:/cvs/cd_read_only co -r v2_1 glideinWMS
>
>
vi cert.key

Now the permissions need to be adjusted on these files in order to generate the proxy:

chmod 644 /home/frontend/cert.p12
chmod 400 /home/frontend/cert.key

 
Changed:
<
<
Now, let's being by installing Condor, select option 6 in the installer's menu:
/home/frontend/glideinWMS/install/glideinWMS_install
Do you have already a VDT installation?: (y/n) n
Do you want to install the full OSG VDT client?: (y/n) n
Do you want to install a minimal Grid VDT client?: (y/n) y
Where do you want the VDT installed?: [/home/frontend/vdt]
Directory '/home/frontend/vdt' does not exist, should I create it?: (y/n) y
What pacman version should I use?: [pacman-3.26]
What VDT cache should I use?: [http://vdt.cs.wisc.edu/vdt_1101_cache]
Which platform do you want to use (leave empty for autodetect):
Do you agree to the licenses? [y/n] y
Where would you like to install CA files? l
Where should I fetch the CAs from?: [http://software.grid.iu.edu/pacman/cadist/ca-certs-version]
Where do you have the Condor tarball? /home/frontend/condor-7.3.1-linux-x86_64-rhel5-dynamic.tar.gz
Where do you want to install it?: [/home/frontend/glidecondor]
Directory '/home/frontend/glidecondor' does not exist, should I create it?: (y/n) y
If something goes wrong with Condor, who should get email about it?: me@mydomain.ext
Do you want to split the config files between condor_config and condor_config.local?: (y/n) [y]
What node is the collector running (i.e. CONDOR_HOST)?: sl1
>
>
Run this command to generate the proxy for 500 hours:
 
Changed:
<
<
Condor for VO Frontend is installed
>
>
/home/frontend/vdt/glite/bin/voms-proxy-init -cert /home/frontend/cert.p12 -key /home/frontend/cert.key -out /home/frontend/.globus/x509_service_proxy -valid 500:0.0
 
Changed:
<
<
Now we need the HTTP server installation:
>
>
Now, let's make the cert and key owned by root to prevent any bad stuff from happening:
 
Changed:
<
<
su - root
/home/frontend/glideinWMS/install/glideinWMS_install
Please select: 8
Please select: c
What port do you want to use?: [80]
Select install method: ... select: 1
>
>
su - root
chown root:root /home/frontend/cert.p12
chown root:root /home/frontend/cert.key
 
Changed:
<
<
HTTPD is installed
>
>
Proxy was created and installed successfully!
 
Changed:
<
<
Copy over the JavaScriptRRD? package into the frontend's home directory:
>
>
END WARNING
 
Added:
>
>
Now we need to move the proxy certificate into a global location:
 
Changed:
<
<
cp javascriptrrd-0.4.2.zip /home/frontend/
chown frontend:frontend /home/frontend/javascriptrrd-0.4.2.zip
su - frontend
unzip javascriptrrd-0.4.2.zip
>
>
mkdir /etc/grid-security/
cp x509_service_proxy /etc/grid-security/
 
Changed:
<
<
JavaScriptRRD is installed
>
>
Let's install the "condor collector" and "condor schedd" AT THE SAME TIME (by selecting 4,5) as root.
 
Changed:
<
<
We also need our proxy certificate to identify ourselves (this could be the same as the one generated on SL1):
>
>
su - root
/root/glideinWMS/install/glideinWMS_install
Please select: 4,5
Do you have already a VDT installation?: (y/n) n
Do you want to install the full OSG VDT client?: (y/n) n
Do you want to install a minimal Grid VDT client?: (y/n) y
Where do you want the VDT installed?: [/opt/vdt]
Directory '/opt/vdt' does not exist, should I create it?: (y/n) y
What pacman version should I use?: [pacman-3.26]
What VDT cache should I use?: [http://vdt.cs.wisc.edu/vdt_1101_cache]
Which platform do you want to use (leave empty for autodetect):
Do you agree to the licenses? [y/n] y
Would you like to setup daily rotation of VDT log files? y
Do you want to update the CA certification revocation lists (CRLs) automatically? [y/n] y
Where would you like to install CA files? r
Do you want to automatically update your CA Certificates? [y/n] y
Where should I fetch the CAs from?: [http://software.grid.iu.edu/pacman/cadist/ca-certs-version]
Which user should Condor run under?: [condor]
Where do you have the Condor tarball? /root/condor-7.3.2-linux-x86_64-rhel5-dynamic.tar.gz
Where do you want to install it?: [/opt/glidecondor]
Directory '/opt/glidecondor' does not exist, should I create it?: (y/n) y
If something goes wrong with Condor, who should get email about it?: me@mydomain.ext
Do you want to split the config files between condor_config and condor_config.local?: (y/n) [y]
Will you be using a proxy or a cert? (proxy/cert) proxy
Where is your proxy located?: /etc/grid-security/x509_service_proxy
DN:
How many slave collectors do you want?: [5]
What name would you like to use for this pool?: [My pool] devg5-pool
Do you want to use the more efficient Match authentication (works for Condor v7.1.3 and later)?: (y/n) y
GCB node:
How many secondary schedds do you want?: [9]
 
Added:
>
>
Let's restart condor:
 
Changed:
<
<
su - frontend
mkdir .globus
scp -c blowfish -P 4221 gfactory@sl1:/home/gfactory/cert.p12 /home/frontend/
. /home/frontend/vdt/setup.sh
openssl pkcs12 -in cert.p12 -out cert.key
>
>
killall condor_master
/opt/glidecondor/start_condor.sh
 
Changed:
<
<
Now remove the public keys from the private key file:
>
>
Condor Collector and Schedd is installed on the frontend system.
 
Added:
>
>
Now, we can begin installing the frontend user. We need to create a user account to host the frontend software installation:
 
Changed:
<
<
vi cert.key
>
>
su - root
groupadd -g 5002 frontend
useradd -c "Frontend Daemon" -g 5002 -m -s /bin/bash -u 5002 frontend
 
Changed:
<
<
Now the permissions need to be adjusted on these files in order to generate the proxy:
>
>
Make sure to get a copy of condor into the frontend's home directory:
 
Changed:
<
<
chmod 644 /home/frontend/cert.p12
chmod 400 /home/frontend/cert.key
>
>
cp condor-7.3.2-linux-x86_64-rhel5-dynamic.tar.gz /home/frontend/
chown frontend:frontend /home/frontend/condor-7.3.2-linux-x86_64-rhel5-dynamic.tar.gz
 
Changed:
<
<
Run this command to generate the proxy for 500 hours:
>
>
Copy the glideinWMS software into the frontend user's directory from CVS:
 
Changed:
<
<
/home/frontend/vdt/glite/bin/voms-proxy-init -cert /home/frontend/cert.p12 -key /home/frontend/cert.key -out /home/frontend/.globus/x509_service_proxy -valid 500:0.0
>
>
su - frontend
cvs -d :pserver:anonymous@cdcvs.fnal.gov:/cvs/cd_read_only co -r v2_1 glideinWMS
 
Changed:
<
<
Now, let's make the cert and key owned by root to prevent any bad stuff from happening:
>
>
Now we need the HTTP server installation:

su - root
yum install httpd

HTTPD is installed

Copy over the JavaScriptRRD? package into the frontend's home directory:

 
Changed:
<
<
su - root
chown root:root /home/frontend/cert.p12
chown root:root /home/frontend/cert.key
>
>
cp javascriptrrd-0.4.2.zip /home/frontend/
chown frontend:frontend /home/frontend/javascriptrrd-0.4.2.zip
su - frontend
unzip javascriptrrd-0.4.2.zip
 
Changed:
<
<
Proxy was created and installed successfully!
>
>
JavaScriptRRD is installed
  Let's also install Flot:
Added:
>
>
  wget http://flot.googlecode.com/files/flot-0.5.tar.gz
gunzip -c flot-0.5.tar.gz | tar xvf -
Added:
>
>
  Flot was installed successfully!
Line: 286 to 312
 Now comes time to install the frontend. Let's begin:
Changed:
<
<
. /home/frontend/vdt/setup.sh /home/frontend/glideinWMS/install/glideinWMS_install
Please select: 7
Do you have already a javascriptRRD installation?: (y/n) y
Where is javascriptRRD installed?: /home/frontend/javascriptrrd-0.4.2
Do you have already a Flot installation?: (y/n) y
Where is Flot installed?: /home/frontend/flot
Where is your proxy located?: /home/frontend/.globus/x509_service_proxy
Where will you host your config and log files?: [/home/frontend/frontstage]
Where will the web data be hosted?: [/var/www/html/vofrontend]
What Web URL will you use?: [http://sl2.minialienship.homeip.net/vofrontend/] http://sl2/vofrontend/
Give a name to this VO Frontend?: [myVO-sl2] frontend-sl2
Give a name to this VO Frontend instance?: [v1_0]
What node is the WMS collector running?: sl1
Collector name(s): [sl1]
Do you want to monitor all of them?: (y/n) y
What kind of jobs do you want to monitor?: [(JobUniverse? ==5)&&(GLIDEIN_Is_Monitor ! TRUE)&&(JOB_Is_Monitor ! TRUE)]
Give a name to the main group: [main]
Match string: [True]
Job attributes: []
Factory attributes: []
Do you want to use is to submit glideins: (y/n) [y] y
An empty entry means you are done. ... proxy fname:
DN (leave empty when finished):
Do you want to use the more efficient Match authentication (works for Condor v7.1.3 and later)?: (y/n) y
Do you want to expose the Grid env. to the user jobs?: (y/n) y
Do you want to create the VO Frontend instance (as opposed to just the config file)?: (y/n) [n] n
>
>
su - frontend
/home/frontend/glideinWMS/install/glideinWMS_install
Please select: 7
Do you have already a javascriptRRD installation?: (y/n) y
Where is javascriptRRD installed?: /home/frontend/javascriptrrd-0.4.2
Do you have already a Flot installation?: (y/n) y
Where is Flot installed?: /home/frontend/flot
Where is your proxy located?: /etc/grid-security/x509_service_proxy
Where will you host your config and log files?: [/home/frontend/frontstage]
Where will the web data be hosted?: [/var/www/html/vofrontend]
What Web URL will you use?: [http://devg-5.t2.ucsd.edu/vofrontend/]
Give a name to this VO Frontend?: [myVO-devg-5] devg5-vo
Give a name to this VO Frontend instance?: [v1_0]
What node is the WMS collector running?: devg-4.t2.ucsd.edu
Collector name(s): [devg-5.t2.ucsd.edu]
Do you want to monitor all of them?: (y/n) y
What kind of jobs do you want to monitor?: [(JobUniverse? ==5)&&(GLIDEIN_Is_Monitor ! TRUE)&&(JOB_Is_Monitor ! TRUE)]
Give a name to the main group: [main]
Match string: [True]
Job attributes: []
Factory attributes: []
Do you want to use is to submit glideins: (y/n) [y] y
An empty entry means you are done. ... proxy fname:
DN (leave empty when finished):
Do you want to use the more efficient Match authentication (works for Condor v7.1.3 and later)?: (y/n) y
Do you want to expose the Grid env. to the user jobs?: (y/n) y
Do you want to create the VO Frontend instance (as opposed to just the config file)?: (y/n) [n] n
  Ok, now add these lines to .bashrc:
Changed:
<
<
vi ~/.bashrc
. /home/frontend/vdt/setup.sh
export X509_USER_PROXY=/home/frontend/.globus/x509_service_proxy
>
>
vi ~/.bashrc
export X509_USER_PROXY=/etc/grid-security/x509_service_proxy
 

Let's create the VO Frontend instance:

Line: 301 to 327
 /home/frontend/glideinWMS/creation/create_frontend /home/frontend/frontstage/instance_v1_0.cfg/frontend.xml
Changed:
<
<
Let's restart Condor:

killall condor_master
/home/frontend/glidecondor/start_condor.sh

Let's also restart the VO Frontend:

>
>
Let's also restart the VO Frontend:
 
Changed:
<
<
/home/frontend/frontstage/frontend_frontend-sl2-v1_0/frontend_startup stop
/home/frontend/frontstage/frontend_frontend-sl2-v1_0/frontend_startup start
>
>
/home/frontend/frontstage/frontend_devg5-vo-v1_0/frontend_startup stop
/home/frontend/frontstage/frontend_devg5-vo-v1_0/frontend_startup start
 

If the frontend fails to start, consult the frontend's log directory:

 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback