Difference: UAFNodeConfig (1 vs. 19)

Revision 192011/11/28 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 320 to 320
 yum --enablerepo=hadoop-unstable install xrootd
Added:
>
>

JSON for CMS

Install JSON so that the users do not have to source CMSSW

wget http://download.fedora.redhat.com/pub/epel/5/x86_64/python-json-3.4-3.el5.noarch.rpm;rpm -ivh python-json-3.4-3.el5.noarch.rpm
 -- TerrenceMartin - 2011/10/13

Revision 182011/10/13 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 206 to 206
 

Adding iptables

Changed:
<
<
scp uaf-2.t2.ucsd.edu:/etc/sysconfig/iptables /etc/sysconfig/iptables
>
>
scp uaf-5.t2.ucsd.edu:/etc/sysconfig/iptables /etc/sysconfig/iptables
 /etc/init.d/iptables restart
Line: 244 to 244
 

Install some X applications

Changed:
<
<
yum -y install xemacs xclock xterm
yum -y install  ImageMagick ggv xpdf gpdf  
 wget http://dag.wieers.com/rpm/packages/acroread/acroread-5.0.10-1.2.el4.rf.i386.rpm ; rpm -ivh acroread-5.0.10-1.2.el4.rf.i386.rpm
>
>
http://www.if-not-true-then-false.com/2010/install-adobe-acrobat-pdf-reader-on-fedora-centos-red-hat-rhel/
 

ViewVC?

Line: 324 to 320
 yum --enablerepo=hadoop-unstable install xrootd
Deleted:
<
<
-- TerrenceMartin - 31 Jul 2008
 \ No newline at end of file
Added:
>
>
-- TerrenceMartin - 2011/10/13

Revision 172011/07/11 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 68 to 68
 

Condor Configuration

Added:
>
>
WARNING!!: We have replaced this section with a GlideinWMS install to support a wider array of targets Please see T2CondorClient for details.
 Copy the existing uaf configuration for the current node

Note: This step must be done on the central manager

Revision 162011/07/06 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 275 to 275
 yum -y install gcc4-gfortran
Added:
>
>

Install Tetex

yum -y install tetex*
 

Setup the server server

  • Edit /etc/httpd/conf/httpd.conf
  • Comment out UserDir? disable * Uncomment UserDir? public_html

Revision 152010/04/06 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 299 to 299
 

Setup of XRootd HDFS

Added:
>
>
Make sure hadoop fs -ls works, and add the following (or confirm it) to /etc/sysconfig/hadoop

HADOOP_CONF_DIR=/etc/hadoop
 Install the osg hadoop repo

Revision 142010/04/06 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 296 to 296
 
  • Add the Option Indexes to Directory /
Added:
>
>

Setup of XRootd HDFS

Install the osg hadoop repo

 rpm -Uvh http://vdt.cs.wisc.edu/hadoop/osg-hadoop-1-2.el5.noarch.rpm

Currently you need to install xrootd from unstable

yum --enablerepo=hadoop-unstable install xrootd

 -- TerrenceMartin - 31 Jul 2008 \ No newline at end of file

Revision 132010/03/24 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 164 to 164
 chmod 1777 /data/tmp
Added:
>
>
--++ Add the TMPFS Area

Add the following to rc.local, create the swapfile1 if it does not exist, 20GB in size.

mkdir -p /data/tmpfs/
swapon /data/swap/swapfile1
mount -t tmpfs -osize=10G  mode=1777 /data/tmpfs/

for i in c d; do echo "32" > /sys/block/sd${i}/queue/iosched/quantum; done
for i in c d; do echo 256 > /sys/block/sd${i}/queue/read_ahead_kb; done
 

Adding the Compat packages

Revision 122010/03/04 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 183 to 183
 

Add packages for CMS

Changed:
<
<
yum -y install glibc coreutils bash tcsh zsh perl tcl tk readline openssl ncurses e2fsprogs krb5-libs freetype fontconfig compat-libstdc++-33 libidn libX11 libXmu libSM libICE libXcursor libXrender libXpm mesa-libGLU
>
>
yum -y install glibc coreutils bash tcsh zsh perl tcl tk readline openssl ncurses yum -y install e2fsprogs krb5-libs freetype fontconfig compat-libstdc++-33 yum -y install libidn libX11 libXmu libSM libICE libXcursor libXrender libXpm mesa-libGLU
 

Adding iptables

Revision 112009/12/15 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 123 to 123
 export VDTSETUP_ENABLE_ROTATE=y export VDTSETUP_CA_CERT_UPDATER=y
Changed:
<
<
pacman -get http://software.grid.iu.edu/osg-1.2:wn-client
>
>
pacman -get http://software.grid.iu.edu/osg-1.2:client
 

Say yes to the questions

Line: 131 to 131
 

Install the Gridftp server

Changed:
<
<
cd /data/pacman/pacman-3.26
>
>
cd /data/pacman/pacman-3.29
 source setup.sh cd /data/vdt pacman -get http://vdt.cs.wisc.edu/vdt_200_cache:Globus-Base-Data-Server
Line: 210 to 210
 

Install i386 and x64 versions of libz

Changed:
<
<
yum -y install zlib-devel-1.2.1.2-1.2
>
>
yum -y install zlib-devel
 

KRB Config

Line: 230 to 230
 
yum -y install xemacs xclock xterm
yum -y install  ImageMagick ggv xpdf gpdf  
Changed:
<
<
wget http://dag.wieers.com/rpm/packages/acroread/acroread-5.0.10-1.2.el4.rf.i386.rpm ; rpm -ivh acroread-5.0.10-1.2.el4.rf.i386.rpm
>
>
wget http://dag.wieers.com/rpm/packages/acroread/acroread-5.0.10-1.2.el4.rf.i386.rpm ; rpm -ivh acroread-5.0.10-1.2.el4.rf.i386.rpm
 

ViewVC?

Line: 260 to 260
 yum -y install gcc4-gfortran
Added:
>
>

Setup the server server

  • Edit /etc/httpd/conf/httpd.conf
  • Comment out UserDir? disable * Uncomment UserDir? public_html
  • Uncomment
<Directory /home/*/public_html>
    AllowOverride FileInfo AuthConfig Limit
    Options MultiViews Indexes SymLinksIfOwnerMatch IncludesNoExec
    <Limit GET POST OPTIONS>
        Order allow,deny
        Allow from all
    </Limit>
    <LimitExcept GET POST OPTIONS>
        Order deny,allow
        Deny from all
    </LimitExcept>
</Directory>

  • Add the Option Indexes to Directory /
 -- TerrenceMartin - 31 Jul 2008

Revision 102009/12/15 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 105 to 105
 
cd /data
Added:
>
>
export http_proxy=http://proxy-1.t2.ucsd.edu:3128
 mkdir vdt mkdir pacman cd pacman
Changed:
<
<
wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-3.26.tar.gz tar zxvf pacman-3.26.tar.gz cd pacman-3.26
>
>
wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-3.29.tar.gz tar zxvf pacman-3.29.tar.gz cd pacman-3.29
 source setup.sh cd /data/vdt export VDTSETUP_CONDOR_LOCATION=/condor/release
Line: 122 to 123
 export VDTSETUP_ENABLE_ROTATE=y export VDTSETUP_CA_CERT_UPDATER=y
Changed:
<
<
pacman -get OSG:client
>
>
pacman -get http://software.grid.iu.edu/osg-1.2:wn-client
 

Say yes to the questions

Line: 134 to 134
 cd /data/pacman/pacman-3.26 source setup.sh cd /data/vdt
Changed:
<
<
pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:Globus-Base-Data-Server
>
>
pacman -get http://vdt.cs.wisc.edu/vdt_200_cache:Globus-Base-Data-Server
 

Say yes to the questions

Line: 176 to 176
  yum -y install glibc-devel*
Added:
>
>

Install Java

Grab the JDK and install it

Add packages for CMS

yum -y install glibc coreutils bash tcsh zsh perl tcl tk readline openssl ncurses e2fsprogs krb5-libs freetype fontconfig compat-libstdc++-33 libidn libX11 libXmu libSM libICE libXcursor libXrender libXpm mesa-libGLU
 

Adding iptables

Line: 183 to 193
 /etc/init.d/iptables restart
Changed:
<
<

Install the Latest DCCP client

>
>

install Hadoop

rpm -ivh http://newman.ultralight.org/repos/hadoop/4/i386/caltech-hadoop-4-1.noarch.rpm
yum install hadoop hadoop-fuse
 
Changed:
<
<
Download the client rpm from the dcache website http://www.dcache.org/
>
>
Add the following to the /etc/rc.local file
 
Changed:
<
<
rpm -ivh dcache-dcap-1.8.0-4.x86_64.rpm
>
>
modprobe fuse
/usr/bin/hdfs -o server=proxy-1.t2.ucsd.edu,port=9000,rdbuffer=131072,allow_other /hadoop/
 

Install i386 and x64 versions of libz

Revision 92009/08/10 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 236 to 236
 session required pam_limits.so
Added:
>
>

Add Gfortran

yum -y install gcc4-gfortran
 -- TerrenceMartin - 31 Jul 2008 \ No newline at end of file

Revision 82009/05/28 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 214 to 214
 yum -y install ImageMagick? ggv xpdf gpdf wget http://dag.wieers.com/rpm/packages/acroread/acroread-5.0.10-1.2.el4.rf.i386.rpm ; rpm -ivh acroread-5.0.10-1.2.el4.rf.i386.rpm
Added:
>
>

ViewVC?

Versions 1.0 is preferred as it uses highlight, at least for RHEL4

Limits.conf and Ulimit

Add the following to /etc/security/limits.conf

*       soft    rss 33554432
*       hard    rss 41943040
*       soft    nofile 2048
*       hard    nofile 2048

Add the following to /etc/pam.d/login

session    required     pam_limits.so
 -- TerrenceMartin - 31 Jul 2008

Revision 72008/11/17 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 205 to 205
  Grab bwm-ng RPM for DAG and install it
Changed:
<
<
http://www.gropp.org/?id=projects&sub=bwm-ng
>
>
http://www.gropp.org/?id=projects⊂=bwm-ng
 

Install some X applications

yum -y install xemacs xclock xterm
Changed:
<
<
>
>
yum -y install ImageMagick? ggv xpdf gpdf wget http://dag.wieers.com/rpm/packages/acroread/acroread-5.0.10-1.2.el4.rf.i386.rpm ; rpm -ivh acroread-5.0.10-1.2.el4.rf.i386.rpm
  -- TerrenceMartin - 31 Jul 2008

Revision 62008/08/14 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 201 to 201
  /etc/krb5.conf
Added:
>
>

BWM-NG

Grab bwm-ng RPM for DAG and install it

http://www.gropp.org/?id=projects&sub=bwm-ng

Install some X applications

yum -y install xemacs xclock xterm
 -- TerrenceMartin - 31 Jul 2008 \ No newline at end of file

Revision 52008/08/14 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 195 to 195
 yum -y install zlib-devel-1.2.1.2-1.2
Added:
>
>

KRB Config

Copy from another working UAF

/etc/krb5.conf

 -- TerrenceMartin - 31 Jul 2008

Revision 42008/08/13 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 189 to 189
  rpm -ivh dcache-dcap-1.8.0-4.x86_64.rpm
Added:
>
>

Install i386 and x64 versions of libz

yum -y install zlib-devel-1.2.1.2-1.2
 -- TerrenceMartin - 31 Jul 2008 \ No newline at end of file

Revision 32008/08/09 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 183 to 183
 /etc/init.d/iptables restart
Added:
>
>

Install the Latest DCCP client

Download the client rpm from the dcache website http://www.dcache.org/

rpm -ivh dcache-dcap-1.8.0-4.x86_64.rpm

 -- TerrenceMartin - 31 Jul 2008

Revision 22008/08/01 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Line: 70 to 70
  Copy the existing uaf configuration for the current node
Changed:
<
<
This must be done on the central manager
>
>
Note: This step must be done on the central manager
 
cd /condor/release/etc
Line: 132 to 132
 
cd  /data/pacman/pacman-3.26
Added:
>
>
source setup.sh
 cd /data/vdt pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:Globus-Base-Data-Server
Line: 145 to 146
 vdt-control --on gsiftp
Changed:
<
<
Configure the authentication by copying over /etc/grid-security/gridmap-file, add a host key using certify
>
>
Configure the authentication by copying over /etc/grid-security/grid-mapfile, add a host key using certify
 

Setup the NTP server

Added:
>
>
ntpdate us.pool.ntp.org
scp uaf-2.t2.ucsd.edu:/etc/ntp.conf /etc/
/etc/init.d/ntpd restart
chkconfig ntpd on

Create the data tmp area

mkdir /data/tmp
chmod 1777 /data/tmp

Adding the Compat packages

yum -y install compat* 

Add the i386 glibc

 yum -y install glibc-devel*

Adding iptables

scp uaf-2.t2.ucsd.edu:/etc/sysconfig/iptables /etc/sysconfig/iptables 
/etc/init.d/iptables restart
 -- TerrenceMartin - 31 Jul 2008

Revision 12008/07/31 - Main.TerrenceMartin

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="WebHome"

Configuration of a new UAF Node

Table of Contents

Create an Logical Volume from all spare disk space

First partition the disks accordinging and reboot so the machine picks up the current tables.

Create the Physical Volumes

pvcreate /dev/sda4 /dev/sdb4 /dev/sdc1 /dev/sdd1

Create the volume groups

vgcreate uaf_vg /dev/sda4 /dev/sdb4 /dev/sdc1 /dev/sdd1

Create the logical Volume

lvcreate -L 3550G -i 4 -I 256 uaf_vg -n uaf_lv

Create the file system

mkfs.ext3 /dev/uaf_vg/uaf_lv
tune2fs -m0 /dev/uaf_vg/uaf_lv

Add the file system to fstab

/dev/uaf_vg/uaf_lv      /data                   ext3    defaults        1 3

Mount the file system

mkdir /data
mount /data

Files to copy from an existing UAF Node

scp root@uaf-2.t2.ucsd.edu:.ssh/auth* /root/.ssh
scp root@uaf-2.t2.ucsd.edu:/etc/auto.* /etc/
scp root@uaf-2.t2.ucsd.edu:/etc/passwd root@uaf-2.t2.ucsd.edu:/etc/group root@uaf-2.t2.ucsd.edu:/etc/shadow /etc/
scp root@uaf-2.t2.ucsd.edu:/etc/profile.d/custom.sh /etc/profile.d/
scp root@uaf-2.t2.ucsd.edu:/etc/init.d/condor /etc/init.d/
scp root@uaf-2.t2.ucsd.edu:/etc/DIR_COLORS /etc/

Autofs configuration

chkconfig autofs on
/etc/init.d/autofs restart

Condor Configuration

Copy the existing uaf configuration for the current node

This must be done on the central manager

cd /condor/release/etc
cp uaf-X.local uaf-NEW.local

Edit the uaf-NEW.local file and make the appropriate changes.

Create the following links

mkdir /etc/condor
ln -s /condor/release/etc/condor_config /etc/condor/
ln -s /condor/release/bin/* /usr/bin/
ln -s /condor/release/sbin/* /usr/sbin/

Create the following directory tree

mkdir -p /state/data/condor_local

Start Condor

chkconfig condor on
/etc/rc.d/init.d/condor start

Install the OSG Client

cd /data
mkdir vdt
mkdir pacman
cd pacman
wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-3.26.tar.gz
tar zxvf pacman-3.26.tar.gz
cd pacman-3.26
source setup.sh
cd /data/vdt
export VDTSETUP_CONDOR_LOCATION=/condor/release
export VDTSETUP_CONDOR_CONFIG=/etc/condor/condor_config
export VDTSETUP_AGREE_TO_LICENSES=y
export VDTSETUP_ENABLE_CONDOR=
export VDTSETUP_INSTALL_CERTS=r
export VDTSETUP_EDG_CRL_UPDATE=y
export VDTSETUP_ENABLE_ROTATE=y
export VDTSETUP_CA_CERT_UPDATER=y


pacman -get OSG:client

Say yes to the questions

Install the Gridftp server

cd  /data/pacman/pacman-3.26
cd /data/vdt
pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:Globus-Base-Data-Server

Say yes to the questions

Enable the gftp server

source /data/vdt/setup.sh
vdt-control --on gsiftp

Configure the authentication by copying over /etc/grid-security/gridmap-file, add a host key using certify

Setup the NTP server

-- TerrenceMartin - 31 Jul 2008

 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback