Difference: FAQ (1 vs. 98)

Revision 982017/03/17 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 801 to 801
  xrdcp -d 2 -f root://cmsxrootd.fnal.gov//store/test/xrootd/T2_US_UCSD//store/mc/SAM/GenericTTbar/GEN-SIM-RECO/CMSSW_5_3_1_START53_V5-v1/0013/CE4D66EB-5AAE-E111-96D6-003048D37524.root /dev/null xrdcp -d 2 -f root://cms-xrd-global.cern.ch//store/test/xrootd/T2_US_UCSD//store/mc/SAM/GenericTTbar/GEN-SIM-RECO/CMSSW_5_3_1_START53_V5-v1/0013/CE4D66EB-5AAE-E111-96D6-003048D37524.root /dev/nul
Added:
>
>
 

Authors

Deleted:
<
<
-- TerrenceMartin - 7 May 2012
 \ No newline at end of file
Added:
>
>
-- TerrenceMartin - 3/17/2017
 \ No newline at end of file

Revision 972016/09/26 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 14 to 14
  http://www.t2.ucsd.edu/twiki2/bin/view/UCSDTier2/FkwUafCondorC
Added:
>
>

Specifying how many CPU you want your job to request


+request_cpus=8

 

Information

Site Readiness

Revision 962016/09/15 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 786 to 786
 glidecondor_createSecSched ""
Added:
>
>

Xrootd Testing

  xrdcp -d 2 -f root://xrootd.t2.ucsd.edu//store/test/xrootd/T2_US_UCSD//store/mc/SAM/GenericTTbar/GEN-SIM-RECO/CMSSW_5_3_1_START53_V5-v1/0013/CE4D66EB-5AAE-E111-96D6-003048D37524.root /dev/null
  xrdcp -d 2 -f root://cmsxrootd.fnal.gov//store/test/xrootd/T2_US_UCSD//store/mc/SAM/GenericTTbar/GEN-SIM-RECO/CMSSW_5_3_1_START53_V5-v1/0013/CE4D66EB-5AAE-E111-96D6-003048D37524.root /dev/null
  xrdcp -d 2 -f root://cms-xrd-global.cern.ch//store/test/xrootd/T2_US_UCSD//store/mc/SAM/GenericTTbar/GEN-SIM-RECO/CMSSW_5_3_1_START53_V5-v1/0013/CE4D66EB-5AAE-E111-96D6-003048D37524.root /dev/nul
 

Authors

-- TerrenceMartin - 7 May 2012 \ No newline at end of file

Revision 952015/12/19 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 540 to 536
 
lcg-cp -v -b -D srmv2 file:/home/users/tmartin/smallfile.zero srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/deleteme
Deleted:
<
<
 
Changed:
<
<
>
>
  srmcp -2 --debug=true -delegate=false srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/srmtest/testfile-today file://localhost//tmp/testfile-b.zero
Line: 581 to 577
 
cat /proc/net/rpc/nfsd
Deleted:
<
<
 
Changed:
<
<
>
>
 fh 278562 0 0 0 0 io 4244458892 3311147501 th 96 72034 108604.717 46238.689 43326.894 1563.190 980.777 1653.901 105.886 73.850 58.314 102.676
Line: 652 to 648
 
export GLEXEC_CLIENT_CERT=/tmp/x509up_u583 
export X509_USER_PROXY=/tmp/x509up_u583
Changed:
<
<
/glexec/glexec-osg/sbin/glexec /usr/bin/id
>
>
/usr/sbin/glexec /usr/bin/id
 

Grub Installing on second raid device

Line: 723 to 719
 cd /cert-inf source setup.sh vdt-control --off
Deleted:
<
<
 
Changed:
<
<
>
>
 rpm -Uvh http://dl.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm rpm -Uvh http://repo.grid.iu.edu/osg-el5-release-latest.rpm
Line: 773 to 768
 Install, in order:

  1. condor
Changed:
<
<
  1. glideinwms-userschedd
>
>
  1. glideinwms-userschedd
  Add in /etc/condor/config.d/99_local.config

Revision 942015/06/16 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 477 to 477
 export LIBHDFS_OPTS=-Xmx4096m
Changed:
<
<

Remounting hadoop on UAF 6

Remounting hadoop on UAF 6 is like the worker nodes with the script

/etc/init.d/mount-hdfs

eg.

>
>

Remounting hadoop on UAF

 
Changed:
<
<
/etc/init.d/mount-hdfs restart
>
>
umount -l /hadoop mount /hadoop
 
Deleted:
<
<
Configuration of mount-hdfs is in /etc/sysconfig/mount-hdfs

Set MOUNTS to 0 for RHEL5 UAF

 
Deleted:
<
<
The installation of this script if via RPM
 

New CRL check script

Revision 932015/03/31 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 8 to 8
 

Added:
>
>

Users

Condor C Submission

http://www.t2.ucsd.edu/twiki2/bin/view/UCSDTier2/FkwUafCondorC

 

Information

Site Readiness

Line: 36 to 43
  http://glidein-mon.t2.ucsd.edu/ucsd/overview.html
Deleted:
<
<

Static Hadoop Storage Report

http://www.t2.ucsd.edu/reports/

Local Gratia Reporting Server

http://www.t2.ucsd.edu:8100/gratia/xml

Gratia

https://www.t2.ucsd.edu:8443/gratia-administration/index.html

 

Administrative Questions

Revision 922014/05/14 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 774 to 774
 condor_cron_qedit -const 'Owner=!=UNDEFINED' Requirements '( TARGET.Arch = "X86_64" ) && ( OpSys? = "LINUX" )'
Added:
>
>

Create a mirrored Logical Volume

Create the physical and volume groups as normal.

lvcreate -L 223G -m1 --mirrorlog mirrored --alloc anywhere -n osg-ce-2_vol vg_osg-ce-2
 

Installing Condor UAF Glidein

Install, in order:

Revision 912014/02/25 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 789 to 789
 Run security stuff
glidecondor_addDN -daemon "My own DN from hostcert" /etc/grid-security/hostcert.pem condor
Changed:
<
<
glidecondor_addDN -daemon "The collector of the UAF pool" '/DC=org/DC=doegrids/OU=Services/CN=uaf-2.t2.ucsd.edu' coll
>
>
glidecondor_addDN -daemon "The collector of the UAF pool" '/DC=com/DC=DigiCert-Grid/O=Open Science Grid/OU=Services/CN=uaf-2.t2.ucsd.edu' coll
 

Disable the second schedd that is enable by default

Revision 902014/02/25 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 777 to 777
 

Installing Condor UAF Glidein

Install, in order:

Changed:
<
<
1) condor 2) glideinwms-userschedd
>
>
  1. condor
  2. glideinwms-userschedd
  Add in /etc/condor/config.d/99_local.config

Revision 892014/02/22 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 774 to 774
 condor_cron_qedit -const 'Owner=!=UNDEFINED' Requirements '( TARGET.Arch = "X86_64" ) && ( OpSys? = "LINUX" )'
Added:
>
>

Installing Condor UAF Glidein

Install, in order: 1) condor 2) glideinwms-userschedd

Add in /etc/condor/config.d/99_local.config

CONDOR_HOST = uaf-2.t2.ucsd.edu

Run security stuff

glidecondor_addDN -daemon "My own DN from hostcert" /etc/grid-security/hostcert.pem condor
glidecondor_addDN -daemon "The collector of the UAF pool" '/DC=org/DC=doegrids/OU=Services/CN=uaf-2.t2.ucsd.edu' coll

Disable the second schedd that is enable by default

glidecondor_createSecSched ""
 

Authors

-- TerrenceMartin - 7 May 2012 \ No newline at end of file

Revision 882013/05/28 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 665 to 665
 
export GLEXEC_CLIENT_CERT=/tmp/x509up_u583 
Added:
>
>
export X509_USER_PROXY=/tmp/x509up_u583
 /glexec/glexec-osg/sbin/glexec /usr/bin/id

Revision 872013/05/07 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 774 to 774
 

Authors

Deleted:
<
<
-- RamiVanguri - 03 Aug 2006

-- TerrenceMartin - 4 Jan 2012

 \ No newline at end of file
Added:
>
>
-- TerrenceMartin - 7 May 2012
 \ No newline at end of file

Revision 862012/10/31 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 765 to 765
  Mtest is a process that runs once an hour in Cron on the worker nodes to check for the hadoop mount. If it is not there mtest tries to remount the hadoop filesystem at /hadoop. The process creates a lot of logs in hadoop from the nodes that process the test.
Added:
>
>

Condor Requirements change

Example of changing a condor requirements line for all jobs.

condor_cron_qedit -const 'Owner=!=UNDEFINED' Requirements '( TARGET.Arch == "X86_64" ) && ( TARGET.OpSys == "LINUX" )'
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 852012/10/31 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 761 to 761
 
Added:
>
>

mtest

Mtest is a process that runs once an hour in Cron on the worker nodes to check for the hadoop mount. If it is not there mtest tries to remount the hadoop filesystem at /hadoop. The process creates a lot of logs in hadoop from the nodes that process the test.

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 842012/10/17 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 718 to 718
 
https://www.opensciencegrid.org/bin/view/Documentation/Release3/BanningUsersAtSite
Added:
>
>

Install certificate components and fetch-crl

First remove any existing soft links to old pacman certificate install and disable the cron based crl and cert updates for the pacman based install.

To install the OSG 3 CRL infrastucture

First remove the soft link for the old pacman based cert-inf install

rm /etc/grid-security/certificates

Then remove the cron jobs

cd /cert-inf
source setup.sh
vdt-control --off

rpm -Uvh http://dl.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
rpm -Uvh http://repo.grid.iu.edu/osg-el5-release-latest.rpm

yum -y install osg-ca-certs
yum -y install fetch-crl
chkconfig fetch-crl-cron on
service fetch-crl-cron start

To grab the latest immediately run

To grab the latest immediately run
/usr/sbin/fetch-crl

Remove the old pacman cert area

rm -rf /cert-inf
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 832012/09/06 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 474 to 474
  This can be caused by the hadoop namenode getting stuck in a loop, this is often obvious when the hadoop namenode is sitting at around 100% of a single CPU under normal operating conditions, it should be much lower. After carefully checking the namespace backup restart the namenode.
Added:
>
>
If the mount process for fuse is at 100% then remount it. There is possibly a memory issue. Add to the file

/etc/hadoop/conf/hadoop-env.sh

export LIBHDFS_OPTS=-Xmx4096m
 

Remounting hadoop on UAF 6

Remounting hadoop on UAF 6 is like the worker nodes with the script

Revision 822012/08/30 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 704 to 704
 http://www.t2.ucsd.edu/tastwiki/bin/view/TWiki/TWikiRealRegistration
Added:
>
>

GUMS

Banning a user

https://www.opensciencegrid.org/bin/view/Documentation/Release3/BanningUsersAtSite
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 812012/08/06 - Main.TimMortensen

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Revision 802012/06/15 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 696 to 696
 
Added:
>
>

Tastwiki

New User Registration

http://www.t2.ucsd.edu/tastwiki/bin/view/TWiki/TWikiRealRegistration
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 792012/06/12 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 660 to 660
 /glexec/glexec-osg/sbin/glexec /usr/bin/id
Added:
>
>

Grub Installing on second raid device

# grub
Probing devices to guess BIOS drives. This may take a long time.


    GNU GRUB  version 0.97  (640K lower / 3072K upper memory)

 [ Minimal BASH-like line editing is supported.  For the first word, TAB
   lists possible command completions.  Anywhere else TAB lists the possible
   completions of a device/filename.]
grub> find /grub/stage1
find /grub/stage1
 (hd0,0)
 (hd1,0)
grub> device (hd0) /dev/sdb 
device (hd0) /dev/sdb 
grub> root (hd0,0)
root (hd0,0)
 Filesystem type is ext2fs, partition type 0xfd
grub> setup (hd0)
setup (hd0)
 Checking if "/boot/grub/stage1" exists... no
 Checking if "/grub/stage1" exists... yes
 Checking if "/grub/stage2" exists... yes
 Checking if "/grub/e2fs_stage1_5" exists... yes
 Running "embed /grub/e2fs_stage1_5 (hd0)"...  15 sectors are embedded.
succeeded
 Running "install /grub/stage1 (hd0) (hd0)1+15 p (hd0,0)/grub/stage2 /grub/grub.conf"... succeeded
Done.
grub> quit
quit

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 782012/05/23 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 548 to 548
 lcg-cp -v -b -D srmv2 file:/home/users/tmartin/smallfile.zero srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/deleteme
Added:
>
>
 srmcp -2 --debug=true -delegate=false srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/srmtest/testfile-today file://localhost//tmp/testfile-b.zero
 List

Revision 772012/03/08 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 649 to 649
 
Added:
>
>

GLEXEC Test

export GLEXEC_CLIENT_CERT=/tmp/x509up_u583 
/glexec/glexec-osg/sbin/glexec /usr/bin/id
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 762012/03/05 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 640 to 640
 
Added:
>
>

Apache build modules

 apxs -I /usr/include/libxml -I . -i -c mod_proxy_html.c
 apxs -I /usr/include/libxml -I . -i -c mod_proxy_html.c
 apxs -I /usr/include/libxml -I . -i -c mod_xml2enc.c

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 752012/01/04 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 643 to 643
 

Authors

-- RamiVanguri - 03 Aug 2006
Changed:
<
<
-- TerrenceMartin - 19 Mar 2007
>
>
-- TerrenceMartin - 4 Jan 2012
 \ No newline at end of file

Revision 742011/12/09 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 598 to 598
 
  • Count you have used between 1 and 12 threads (10%) for 108604.717 seconds
  • Count you have used between 13 and 25 threads for 46238.689 seconds
Added:
>
>

GUMS Manual Account mapping instructions for RSV


Very sorry about letting this lie dormant. I haven't yet sent instructions.

The plan is to add to the Maven-generated GUMS documentation a recipe
for doing the one-to-one user mappings. I'll make sure the info makes it
into the next release.

Briefly, the recipe would be:

1) Under User Groups, create a User Group for the user, e.g.
JohnSmithUserGroup
2) Under Manual User Group Members, add the intended user's DN and
optional FQAN and email to the group created in #1
3) Under Account Mappers, create a new Account Mapper, e.g.
JohnSmithMapper of type "manual" pointed at the UNIX account you want
John Smith to go to (e.g. jsmith).
4) Under Group To Account Mappings, create a Group To Account Mapping,
e.g. JohnSmithGTAMapping using user group from #1 and Account Mapper
from #3, defining VO accounting info.
5) Under Host To Group Mappings, create or edit a relevant host to group
mapping definition and include the GroupToAccount mapping from #4.

Note that where a name is defined, I've chosen a distinct name that
includes what kind of thing it is. In theory the namespace shouldn't
matter, but it makes what you're doing clearer.

Note also that this is all quite complicated to do on a per-user basis.
That is because GUMS was never designed or intended to do manual
per-user mapping. Rather it was intended to be a Grid-ID-to-UNIX-ID
*policy* tool where you handle a whole VO with one chain.

Hope this made sense.

Cheers,

--john

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 732011/07/05 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 577 to 577
 xm create -c devg-2 extra=" init 1 xencons=xvc0"
Added:
>
>

Tuning NFS Server

Number of threads

cat /proc/net/rpc/nfsd

fh 278562 0 0 0 0
io 4244458892 3311147501
th 96 72034 108604.717 46238.689 43326.894 1563.190 980.777 1653.901 105.886 73.850 58.314 102.676
ra 192 1422103166 0 0 0 0 0 0 0 0 0 2354117

th

  • How many threads you have
  • The number of times you have used the last thread
  • Count you have used between 1 and 12 threads (10%) for 108604.717 seconds
  • Count you have used between 13 and 25 threads for 46238.689 seconds
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 722011/06/03 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 10 to 10
 

Information

Added:
>
>

Site Readiness

http://lhcweb.pic.es/cms/SiteReadinessReports/SiteReadinessReport.html

 

Static Condor Information

Static Condor information updated every few minutes

Line: 44 to 48
  https://www.t2.ucsd.edu:8443/gratia-administration/index.html
Deleted:
<
<

Zenoss Monitoring

http://sentry.t2.ucsd.edu:8080/zport/dmd/

 

Administrative Questions

Revision 712011/05/23 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 570 to 570
 

Creating a Xen instance

Changed:
<
<
First copy the default config to the name of the instance you are creating. Edit as necessary. Then run;
>
>
First copy the default config to the name of the instance you are creating. Edit as needed, Then run;
 
xm create -c devg-2 extra=" init 1 xencons=xvc0"

Revision 702011/05/10 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 568 to 568
 srmrmdir -2 -delegate=false srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/dirfordelete
Added:
>
>

Creating a Xen instance

First copy the default config to the name of the instance you are creating. Edit as necessary. Then run;

xm create -c devg-2 extra=" init 1 xencons=xvc0"
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 692011/03/09 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 20 to 20
  Cacti Plots
Changed:
<
<
https://t2sentry0.t2.ucsd.edu/cacti/
>
>
https://sentry.t2.ucsd.edu/cacti/
 

Ganglia Plots

Revision 682010/12/13 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 540 to 539
  xm create -c domain
Added:
>
>

Useful SRM Commands

Copy

lcg-cp -v -b -D srmv2 file:/home/users/tmartin/smallfile.zero srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/deleteme

List

lcg-ls  -l -v -b -D srmv2 srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/deleteme

Delete

srmrm -2 -delegate=false srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/deleteme
Note: You need to run once per file, so you probably want to iterate over a list of files with a for loop in bash

Make a directory

srmmkdir -2 -delegate=false  srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/dirfordelete

Remove a directory

srmrmdir -2 -delegate=false  srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server?SFN=/hadoop/cms/store/user/tmartin/dirfordelete
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 672010/10/06 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 40 to 40
  http://www.t2.ucsd.edu:8100/gratia/xml
Added:
>
>

Gratia

https://www.t2.ucsd.edu:8443/gratia-administration/index.html

 

Zenoss Monitoring

Revision 662010/09/23 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 394 to 394
 tune2fs -j /dev/md2
Added:
>
>
or

debugfs -w -R "feature ^has_journal,^needs_recovery" /dev/md1 && fsck -y /dev/md1 && tune2fs -j /dev/md1
 

Bulk CA Certs for Web Browsers

TACAR keeps a repository of all the IGTF CAs. You can individually install the ones you care about directly in your browser (or try a bulk download and install)

Line: 527 to 533
  https://twiki.cern.ch/twiki/bin/view/Main/HdfsXrootdInstall
Added:
>
>

Gaining access to Grub prompt in DomU?

xm create -c domain

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 652010/09/22 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 523 to 523
  http://uscms.org/uscms_at_work/data_computing/facility_operations/uaf.shtml
Added:
>
>

XrootD? Install

https://twiki.cern.ch/twiki/bin/view/Main/HdfsXrootdInstall

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 642010/09/01 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 40 to 40
  http://www.t2.ucsd.edu:8100/gratia/xml
Added:
>
>

Zenoss Monitoring

http://sentry.t2.ucsd.edu:8080/zport/dmd/

 

Administrative Questions

How to generate a grid host cert

Revision 632010/08/26 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 514 to 514
  GlideinFactoryFAQ
Added:
>
>

Kerberos Help for Mac Users

http://uscms.org/uscms_at_work/data_computing/facility_operations/uaf.shtml

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 622010/08/17 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 510 to 510
  http://www.andremolnar.com/how_to_set_up_ssh_keys_with_putty_and_not_get_server_refused_our_key
Added:
>
>

Glidein Factory FAQ

GlideinFactoryFAQ

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 612010/07/13 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 506 to 506
  OSGCMSCertificateSetup
Added:
>
>

Setting up Putty with RSA keys

http://www.andremolnar.com/how_to_set_up_ssh_keys_with_putty_and_not_get_server_refused_our_key

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 602010/06/30 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 501 to 501
  https://hepix.caspur.it/benchmarks/doku.php?id=bench:results
Added:
>
>

Converting P12 Certificates to x509

OSGCMSCertificateSetup

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 592010/06/04 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 497 to 497
 3) the gfactory (~/glideinsubmit/glidein_Productio3_1 as gfactory)
Added:
>
>

HKspecInt?

https://hepix.caspur.it/benchmarks/doku.php?id=bench:results

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 582010/05/28 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 487 to 487
  Log into the glide 1
Added:
>
>

Restarting the Glidein 1 Factory


When you you finished moving the stuff, remember to start (in this order):
1) the httpd (/etc/init.d as root)
2) Condor (/etc/init.d as root)
3) the gfactory (~/glideinsubmit/glidein_Productio3_1 as gfactory)
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 572010/05/03 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 483 to 483
  root@codefs /code/osgcode/tmartin# cat /etc/cron.d/checkcrl 22 0,3,6,9,12,15,18,22 * * * root /code/osgcode/tmartin/checkcrl.sh root@codefs /code/osgcode/tmartin#
Added:
>
>
--++ Adding a site to Glidein Factory

Log into the glide 1

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 562010/04/14 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 156 to 156
 

Fixing broken CRLs by hand

Changed:
<
<
The CRLs come with the wn-client installation of OSG. This is exported from codefs to all the worker nodes. A CRL is a set of several files, one of which is updated via cron on codefs. The one that is updated has the ending .r0
>
>
The CRLs come with the wn-client installation of OSG. This is exported from codefs to all the worker nodes. A CRL is a set of several files, one of which is updated via cron on codefs. The one that is updated has the ending .r0
 
Changed:
<
<
Over Xmass 2009, we developed 3 CRLs that failed to update properly. They had zero filesize, and could no longer be overwritten by the CRL updater. It seems to refuse to update the zero size files. I thus had to copy by hand from the VDT client that's installed on the uaf the three .r0 files with zero filesize.
>
>
Over Xmass 2009, we developed 3 CRLs that failed to update properly. They had zero filesize, and could no longer be overwritten by the CRL updater. It seems to refuse to update the zero size files. I thus had to copy by hand from the VDT client that's installed on the uaf the three .r0 files with zero filesize.
  Once the files were copied, all worker nodes worked again.
Line: 380 to 377
 Make the file systems
Changed:
<
<
mkfs.ext3 /dev/md0; mkfs.ext3 /dev/md1
>
>
mkfs.ext3 -i 16384 /dev/md0; mkfs.ext3 -i 16384 /dev/md1
 tune2fs -m0 /dev/md0; tune2fs -m0 /dev/md1
Line: 394 to 391
 

Bulk CA Certs for Web Browsers

Changed:
<
<
TACAR keeps a repository of all the IGTF CAs. You can individually install the ones you care about directly in your browser (or try a bulk download and install)
>
>
TACAR keeps a repository of all the IGTF CAs. You can individually install the ones you care about directly in your browser (or try a bulk download and install)
  https://www.tacar.org/repos/
Line: 436 to 428
 

Memory copy of hadoop fsimage when restarting

Changed:
<
<
First put hadoop into safe mode then run
>
>
First put hadoop into safe mode then run
 
hadoop dfsadmin -metasave
Line: 491 to 481
  The following is the new CRL check script location and cron job on codefs. It will confirm all of the CRL are valid CRL files and force a re-run of the fetch-crl script of they are not.
Changed:
<
<
root@codefs /code/osgcode/tmartin# cat /etc/cron.d/checkcrl 22 0,3,6,9,12,15,18,22 * * * root /code/osgcode/tmartin/checkcrl.sh root@codefs /code/osgcode/tmartin#
>
>
root@codefs /code/osgcode/tmartin# cat /etc/cron.d/checkcrl 22 0,3,6,9,12,15,18,22 * * * root /code/osgcode/tmartin/checkcrl.sh root@codefs /code/osgcode/tmartin#
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 552010/04/01 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 32 to 32
  http://glidein-mon.t2.ucsd.edu/ucsd/overview.html
Added:
>
>

Static Hadoop Storage Report

http://www.t2.ucsd.edu/reports/

Local Gratia Reporting Server

http://www.t2.ucsd.edu:8100/gratia/xml

 

Administrative Questions

Revision 542010/03/29 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 7 to 7
 



Added:
>
>

Information

Static Condor Information

Static Condor information updated every few minutes

http://www.t2.ucsd.edu/condorstatus/

Cacti

Cacti Plots

https://t2sentry0.t2.ucsd.edu/cacti/

Ganglia Plots

Ganglia Plots

http://t2gw02.t2.ucsd.edu/ganglia/

Glidein Mon

http://glidein-mon.t2.ucsd.edu/ucsd/overview.html

 

Administrative Questions

How to generate a grid host cert

Revision 532010/02/04 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 71 to 71
  https://twiki.grid.iu.edu/twiki/bin/view/Main/OSGConfigurationParameters
Added:
>
>

Retrieving ERT Times for the Site

Login to a gatekeeper, source the VDT and run

ldapsearch -xLLL -h is.grid.iu.edu:2170 -b mds-vo-name=UCSDT2,mds-vo-name=local,o=grid '(&(GlueCEAccessControlBaseRule=VO:cms)(GlueCEUniqueID=*))' GlueCEStateEstimatedResponseTime
 

How to Output the Text form of Grid Certificates (Host Cert)

Revision 522010/01/04 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 428 to 428
  This can be caused by the hadoop namenode getting stuck in a loop, this is often obvious when the hadoop namenode is sitting at around 100% of a single CPU under normal operating conditions, it should be much lower. After carefully checking the namespace backup restart the namenode.
Added:
>
>

Remounting hadoop on UAF 6

Remounting hadoop on UAF 6 is like the worker nodes with the script

/etc/init.d/mount-hdfs

eg.

/etc/init.d/mount-hdfs restart

Configuration of mount-hdfs is in /etc/sysconfig/mount-hdfs

Set MOUNTS to 0 for RHEL5 UAF

The installation of this script if via RPM

New CRL check script

The following is the new CRL check script location and cron job on codefs. It will confirm all of the CRL are valid CRL files and force a re-run of the fetch-crl script of they are not.

root@codefs /code/osgcode/tmartin# cat /etc/cron.d/checkcrl 22 0,3,6,9,12,15,18,22 * * * root /code/osgcode/tmartin/checkcrl.sh root@codefs /code/osgcode/tmartin#

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 512009/12/29 - Main.FkW

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 111 to 111
 # pacman -update CA-Certificates



Added:
>
>


Fixing broken CRLs by hand

The CRLs come with the wn-client installation of OSG. This is exported from codefs to all the worker nodes. A CRL is a set of several files, one of which is updated via cron on codefs. The one that is updated has the ending .r0

Over Xmass 2009, we developed 3 CRLs that failed to update properly. They had zero filesize, and could no longer be overwritten by the CRL updater. It seems to refuse to update the zero size files. I thus had to copy by hand from the VDT client that's installed on the uaf the three .r0 files with zero filesize.

Once the files were copied, all worker nodes worked again.

 

Useful Grid Twiki for GRAM Errors

http://goc.grid.sinica.edu.tw/gocwiki/SiteProblemsFollowUpFaq

Revision 502009/12/15 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 392 to 392
 

Checking for black hole nodes with condor

Added:
>
>
Remote
 
globus-job-run osg-gw-2.t2.ucsd.edu /bin/sh -c 'source 
$OSG_LOCATION/setup.sh; condor_history  -constraint "RemoteWallClockTime 
Line: 400 to 402
 uniq -c | sort -r -n
Added:
>
>
Local

condor_history  -constraint "RemoteWallClockTime 
< 120 && Owner == \"cmsprod\" && CurrentTime-EnteredCurrentStatus < 
3600*24*4" -format "%s\n" LastRemoteHost  | sed 's/slot.*@//g' | sort | 
uniq -c | sort -r -n
 

Hadoop mount is responding slow

Revision 492009/12/07 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 400 to 400
 uniq -c | sort -r -n
Added:
>
>

Hadoop mount is responding slow

This can be caused by the hadoop namenode getting stuck in a loop, this is often obvious when the hadoop namenode is sitting at around 100% of a single CPU under normal operating conditions, it should be much lower. After carefully checking the namespace backup restart the namenode.

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 482009/11/24 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 389 to 389
 hadoop dfsadmin -metasave
Added:
>
>

Checking for black hole nodes with condor

globus-job-run osg-gw-2.t2.ucsd.edu /bin/sh -c 'source 
$OSG_LOCATION/setup.sh; condor_history  -constraint "RemoteWallClockTime 
< 120 && Owner == \"cmsprod\" && CurrentTime-EnteredCurrentStatus < 
3600*24*4" -format "%s\n" LastRemoteHost ' | sed 's/slot.*@//g' | sort | 
uniq -c | sort -r -n
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 472009/11/10 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 380 to 380
 rocks add appliance cabinet-7 membership="Cabinet 7" short-name='c' node='cab7-compute'
Added:
>
>

Memory copy of hadoop fsimage when restarting

First put hadoop into safe mode then run

hadoop dfsadmin -metasave
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 462009/08/05 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 371 to 371
 Check to make sure the hadoop-site.xml is properly configured, or the CLASSPATH is set correctly.
Added:
>
>

Rocks Command Add Appliance at UCSD

rocks add appliance cabinet-5 membership="Cabinet 5" short-name='c' node='cab5-compute'
rocks add appliance cabinet-4 membership="Cabinet 4" short-name='c' node='cab4-compute'
rocks add appliance cabinet-6 membership="Cabinet 6" short-name='c' node='cab6-compute' 
rocks add appliance cabinet-7 membership="Cabinet 7" short-name='c' node='cab7-compute'
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 452009/05/26 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 356 to 356
  https://twiki.cern.ch/twiki/bin/view/CMS/PhedexAdminDocsVomsProxies
Added:
>
>

HADOOP

Error 1

Exception in thread "main" java.io.IOException: Mkdirs failed to create /cms/store/user/tmartin                        
        at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:358)                                 
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:487)                                                 
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:468)                                                 
Call to org.apache.hadoop.conf.FileSystem::create((Lorg/apache/hadoop/fs/Path;ZISJ)Lorg/apache/hadoop/fs/FSDataOutputStream;) failed!                 

Check to make sure the hadoop-site.xml is properly configured, or the CLASSPATH is set correctly.

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 442009/05/07 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 347 to 347
  https://www.tacar.org/repos/
Added:
>
>

SRM Ping

srm-ping srm://bsrm-1.t2.ucsd.edu:8443/srm/v2/server

VOMS Proxy and FTS

https://twiki.cern.ch/twiki/bin/view/CMS/PhedexAdminDocsVomsProxies

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 432009/03/30 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 338 to 338
 tune2fs -j /dev/md2
Added:
>
>

Bulk CA Certs for Web Browsers

TACAR keeps a repository of all the IGTF CAs. You can individually install the ones you care about directly in your browser (or try a bulk download and install)

https://www.tacar.org/repos/

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 422009/02/26 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 82 to 82
 
cd ~/.globus
Changed:
<
<
cat usercert.pem userkey.pem > somefile.pem openssl pkcs12 -export -in somefile.pem -out NewCert? .p12
>
>
openssl pkcs12 -in foo.pem -inkey bar.pem -export -out foo.p12
 

It will then ask for your password, this is the same password that you would use e.g. when you run voms-proxy-init. NewCert? .p12 can then be imported into your browser!

Revision 412009/01/12 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 331 to 331
 tune2fs -m0 /dev/md0; tune2fs -m0 /dev/md1
Added:
>
>

Fixing a corrupt ext3 Journal

debugfs -w -R "feature ^has_journal,^needs_recovery" /dev/md2
fsck -y /dev/md2
tune2fs -j /dev/md2
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 402009/01/07 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 286 to 286
 

OSG-RSV Commands at UCSD

Changed:
<
<

osg-gw-4t

>
>

osg-gw-4

 
$VDT_LOCATION/osg-rsv/setup/configure_osg_rsv --user rsv --init --server y  --ce-probes --ce-uri "osg-gw-4.t2.ucsd.edu" --srm-probes --srm-uri "srm-3.t2.ucsd.edu" -srm-dir /pnfs/t2.ucsd.edu/data4/cms/phedex/store/user/tmartin --gridftp-probes  --gratia --grid-type "OSG"  --consumers --verbose --setup-for-apache --proxy /tmp/x509up_u59001

Revision 392008/12/09 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 100 to 96
 

Preserving the RSL file from submitted grid jobs

Changed:
<
<
On the server side, edit $VDT_LOCATION/globus/etc/globus-job-manager.conf and set "-save-logfile always"
>
>
On the server side, edit $VDT_LOCATION/globus/etc/globus-job-manager.conf and set "-save-logfile always"
  That should preserve the gram_job_mgr files in the user home dir for debugging.
Line: 175 to 168
  Error:
Changed:
<
<
SCRAM Error: It appears that the module "Template.pm" is not installed. Please check your installaion. If you are an administrator, you can find the Perl Template Toolkit at www.cpan.org or at the web site of the author (Andy Wardley):
>
>
SCRAM Error: It appears that the module "Template.pm" is not installed. Please check your installaion. If you are an administrator, you can find the Perl Template Toolkit at www.cpan.org or at the web site of the author (Andy Wardley):
  Fix: Install perl-Template-Toolkit and supporting packages

Line: 188 to 178
 To fully purge the CE of jobs you need to

  1. Remove or move the contents of the condor home area (eg. /state/data/condor_local)
Changed:
<
<
  1. Remove or move the contents of the GRAM area $GLOBUS_LOCATION/tmp/gram_job_state/gram_condor_log.*
>
>
  1. Remove or move the contents of the GRAM area $GLOBUS_LOCATION/tmp/gram_job_state/gram_condor_log.*
 

Installing the cert infrastructure only from the VDT

Line: 323 to 308
 

Gratia Search Links

Changed:
<
<
https://t2.unl.edu/gratia/xml/dn_efficiency_summary?vo=cms&facility=UCSD&fixed-height=False https://t2.unl.edu/gratia/xml/dn_wasted_summary?vo=cms&facility=UCSD&fixed-height=False
>
>
https://t2.unl.edu/gratia/xml/dn_efficiency_summary?vo=cms&facility=UCSD&fixed-height=False https://t2.unl.edu/gratia/xml/dn_wasted_summary?vo=cms&facility=UCSD&fixed-height=False
 

Making the RAID devices on the nodes by hand

Revision 382008/12/03 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 334 to 334
 Create the partitions on the new disk

Stop the devices

Changed:
<
<
>
>
 mdadm --stop /dev/md0 mdadm --stop /dev/md1 mdadm --create /dev/md0 --chunk=256 --level=0 --raid-devices=4 /dev/sda2 /dev/sdb1 /dev/sdc1 /dev/sdd1 mdadm --create /dev/md1 --chunk=256 --level=0 --raid-devices=4 /dev/sda5 /dev/sdb3 /dev/sdc3 /dev/sdd3
Added:
>
>
 
Added:
>
>
Make the file systems
 
Changed:
<
<
>
>
mkfs.ext3 /dev/md0; mkfs.ext3  /dev/md1
tune2fs -m0 /dev/md0; tune2fs -m0 /dev/md1
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 372008/12/03 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 326 to 326
 https://t2.unl.edu/gratia/xml/dn_efficiency_summary?vo=cms&facility=UCSD&fixed-height=False https://t2.unl.edu/gratia/xml/dn_wasted_summary?vo=cms&facility=UCSD&fixed-height=False
Added:
>
>

Making the RAID devices on the nodes by hand

In the event you need to do this by hand

Create the partitions on the new disk

Stop the devices

mdadm --stop /dev/md0 mdadm --stop /dev/md1 mdadm --create /dev/md0 --chunk=256 --level=0 --raid-devices=4 /dev/sda2 /dev/sdb1 /dev/sdc1 /dev/sdd1 mdadm --create /dev/md1 --chunk=256 --level=0 --raid-devices=4 /dev/sda5 /dev/sdb3 /dev/sdc3 /dev/sdd3

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 362008/09/30 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 321 to 321
  su rsv -c "./cacert-crl-expiry-probe -m org.osg.certificates.cacert-expiry -u osg-gw-4.t2.ucsd.edu -x /tmp/x509up_u59001"
Added:
>
>

Gratia Search Links

https://t2.unl.edu/gratia/xml/dn_efficiency_summary?vo=cms&facility=UCSD&fixed-height=False https://t2.unl.edu/gratia/xml/dn_wasted_summary?vo=cms&facility=UCSD&fixed-height=False

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 352008/09/30 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 313 to 313
 $VDT_LOCATION/osg-rsv/setup/configure_osg_rsv --user rsv --init --server y --ce-probes --ce-uri "osg-gw-2.t2.ucsd.edu" --srm-probes --srm-uri "srm-3.t2.ucsd.edu" -srm-dir /pnfs/t2.ucsd.edu/data4/cms/phedex/store/user/tmartin --gridftp-probes --gratia --grid-type "OSG" --consumers --verbose --setup-for-apache --proxy /tmp/x509up_u59001
Added:
>
>

OSG RSV

Testing CA Cert Probe by hand

 su rsv -c "./cacert-crl-expiry-probe -m org.osg.certificates.cacert-expiry -u osg-gw-4.t2.ucsd.edu -x /tmp/x509up_u59001"
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 342008/07/15 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 299 to 299
 
Added:
>
>

OSG-RSV Commands at UCSD

osg-gw-4t

$VDT_LOCATION/osg-rsv/setup/configure_osg_rsv --user rsv --init --server y  --ce-probes --ce-uri "osg-gw-4.t2.ucsd.edu" --srm-probes --srm-uri "srm-3.t2.ucsd.edu" -srm-dir /pnfs/t2.ucsd.edu/data4/cms/phedex/store/user/tmartin --gridftp-probes  --gratia --grid-type "OSG"  --consumers --verbose --setup-for-apache --proxy /tmp/x509up_u59001

osg-gw-2

$VDT_LOCATION/osg-rsv/setup/configure_osg_rsv --user rsv --init --server y  --ce-probes --ce-uri "osg-gw-2.t2.ucsd.edu" --srm-probes --srm-uri "srm-3.t2.ucsd.edu" -srm-dir /pnfs/t2.ucsd.edu/data4/cms/phedex/store/user/tmartin --gridftp-probes  --gratia --grid-type "OSG"  --consumers --verbose --setup-for-apache --proxy /tmp/x509up_u59001
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 332008/06/20 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 290 to 290
 
Added:
>
>

Rocks Commands

 
Added:
>
>

Adding a cabinet to rocks

rocks add appliance cabinet-5 membership="Cabinet 5" short-name='c' node='cab5-compute'
 

Revision 322008/05/30 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 280 to 280
 ./lcg/etc/alter-attributes.conf
Added:
>
>

Getting a slot wn-client environment on a node interactively

Log into a node as root

# chroot /chroot/cafuser1
# su - cafuser1
# source /code/osgcode/wn-client-itb/setup.sh

 

Revision 312008/05/29 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 196 to 196
 This will install the parts needed to request host certs as well as keep CRLs and CAs up to date on a machine.
Added:
>
>
 #!/bin/sh
Added:
>
>
mkdir -p /data/vdt cd /data/vdt wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-3.25.tar.gz tar zxvf pacman-3.25.tar.gz chown root:root -R pacman-3.25 cd pacman-3.25 source setup.sh cd /data/vdt
 VDTSETUP_AGREE_TO_LICENSES=y export VDTSETUP_AGREE_TO_LICENSES
Added:
>
>
VDTSETUP_ENABLE_ROTATE=y export VDTSETUP_ENABLE_ROTATE
 VDTSETUP_EDG_CRL_UPDATE=y export VDTSETUP_EDG_CRL_UPDATE
Deleted:
<
<
VDTSETUP_INSTALL_CERTS=r export VDTSETUP_INSTALL_CERTS
 VDTSETUP_CA_CERT_UPDATER=y export VDTSETUP_CA_CERT_UPDATER
Added:
>
>
VDTSETUP_INSTALL_CERTS=r export VDTSETUP_INSTALL_CERTS
  pacman -pretend-platform:linux-rhel-4
Changed:
<
<
pacman -http-proxy http://clarens-1.local:3128 pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:CA-Certificates pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:CA-Certificates-Updater pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:PPDG-Cert-Scripts
>
>
pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:CA-Certificates pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:CA-Certificates-Updater pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:PPDG-Cert-Scripts
 



Revision 302008/02/12 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 210 to 210
 pacman -pretend-platform:linux-rhel-4 pacman -http-proxy http://clarens-1.local:3128 pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:CA-Certificates
Changed:
<
<
pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:CA-Certificates-Update
>
>
pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:CA-Certificates-Updater
 pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:PPDG-Cert-Scripts

Revision 292008/02/07 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 254 to 254
 

Additional CMS Config for OSG

Deleted:
<
<

add-attributes.conf

 Copy the following file from the old install to the new
Added:
>
>

add-attributes.conf

 ./lcg/etc/add-attributes.conf
Added:
>
>

alter-attributes.conf

./lcg/etc/alter-attributes.conf

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 282008/01/18 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 252 to 252
  Check that Java is installed and the condor_config correctl points to its location
Added:
>
>

Additional CMS Config for OSG

add-attributes.conf

Copy the following file from the old install to the new

./lcg/etc/add-attributes.conf

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 272008/01/14 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 246 to 246
 
Added:
>
>

WS GRAM Errors

Error initializing GAHP

Check that Java is installed and the condor_config correctl points to its location

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 262008/01/10 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 224 to 224
  http://www-unix.globus.org/toolkit/docs/4.0/execution/wsgram/WS_GRAM_Performance_Guide.html
Added:
>
>

Resting priority factors on the Condor cluster

for i in `condor_userprio -all -allusers |grep "@" | awk -F"@" '{print $1}'|grep ligo`; do for j in `seq 2 5`; do condor_userprio -setfactor ${i}@osg-gw-${j}.t2.ucsd.edu 100; done; done

Local Users Mappings

uscms048
uscms1581
uscms099
uscms1658
uscms1633
uscms076
uscms1586
uscms1285
uscms1674
 

Authors

Revision 252007/12/20 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 139 to 139
  https://osg-gw-3.t2.ucsd.edu:8443/rsv/
Added:
>
>

Query the ITB Ress and BDII

condor_status -pool osg-ress-4.fnal.gov -constraint 'GlueSiteName=="UCSDT2-ITB1"' -l 

ldapsearch -x -h is-itb.grid.iu.edu -p 2170 -b mds-vo-name=UCSDT2-ITB1,mds-vo-name=local,o=grid   

 

Checking BDII publishing

Sites to check to see whether UCSD is properly reporting to the BDII?

Revision 242007/11/26 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 79 to 79
  openssl x509 -in cert.pem -text
Added:
>
>

Converting PEM x509 Format Files to P12(DER) for import into Mozilla/Firefox

Log into the machine on which you have you x509 PEM files for your cert.

cd ~/.globus
cat usercert.pem userkey.pem > somefile.pem
openssl pkcs12 -export -in somefile.pem -out NewCert.p12

It will then ask for your password, this is the same password that you would use e.g. when you run voms-proxy-init. NewCert? .p12 can then be imported into your browser!

 

Entering a UCSD ACT Customer Service Request

Revision 232007/10/19 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 122 to 122
  Links, tools and sites related to monitoring the UCSD Tier2.
Added:
>
>

UCSDT2 ITB RSV Monitoring Link

https://osg-gw-3.t2.ucsd.edu:8443/rsv/

 

Checking BDII publishing

Sites to check to see whether UCSD is properly reporting to the BDII?

Revision 222007/09/28 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 194 to 194
  Due to remounting order is important, check to make sure all underlying file systems are mounted before the remounts.
Added:
>
>

WS Gram Performance Optimization

http://www-unix.globus.org/toolkit/docs/4.0/execution/wsgram/WS_GRAM_Performance_Guide.html

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 212007/09/21 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 190 to 190
 

Added:
>
>

Condor jobs cannot find /state/data/condor_local/execute/dir_XXXX

Due to remounting order is important, check to make sure all underlying file systems are mounted before the remounts.

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 202007/09/20 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 163 to 163
 
  1. Remove or move the contents of the condor home area (eg. /state/data/condor_local)
  2. Remove or move the contents of the GRAM area $GLOBUS_LOCATION/tmp/gram_job_state/gram_condor_log.*
Added:
>
>


Installing the cert infrastructure only from the VDT

This will install the parts needed to request host certs as well as keep CRLs and CAs up to date on a machine.

#!/bin/sh

VDTSETUP_AGREE_TO_LICENSES=y
export VDTSETUP_AGREE_TO_LICENSES
VDTSETUP_EDG_CRL_UPDATE=y
export VDTSETUP_EDG_CRL_UPDATE
VDTSETUP_INSTALL_CERTS=r
export VDTSETUP_INSTALL_CERTS
VDTSETUP_CA_CERT_UPDATER=y
export VDTSETUP_CA_CERT_UPDATER

pacman -pretend-platform:linux-rhel-4
pacman -http-proxy http://clarens-1.local:3128
pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:CA-Certificates
pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:CA-Certificates-Update
pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:PPDG-Cert-Scripts  



 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 192007/09/20 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 156 to 156
  Fix: Install perl-Template-Toolkit and supporting packages

Added:
>
>

Purging CE Jobs

To fully purge the CE of jobs you need to

  1. Remove or move the contents of the condor home area (eg. /state/data/condor_local)
  2. Remove or move the contents of the GRAM area $GLOBUS_LOCATION/tmp/gram_job_state/gram_condor_log.*
 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 182007/08/22 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions



Line: 145 to 145
 http://vors.grid.iu.edu/cgi-bin/index.cgi



Added:
>
>

SCRAM Template.pm Error

Error:

SCRAM Error: It appears that the module "Template.pm" is not installed. Please check your installaion. If you are an administrator, you can find the Perl Template Toolkit at www.cpan.org or at the web site of the author (Andy Wardley):

Fix: Install perl-Template-Toolkit and supporting packages

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 172007/08/22 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Changed:
<
<
>
>


 

Contents

Added:
>
>


 

Administrative Questions

How to generate a grid host cert

Line: 17 to 18
 ./globus/bin/grid-cert-request -host
Added:
>
>


 

How do I adjust the memory parameter on the kernel config line in a rocks CDROM kernel roll

The purpose of this fix is to allow Rocks to create very large raid partitions on 64bit machines.

Line: 51 to 53
  # make roll
Added:
>
>


 

Why does /dev not appear with the right files on RHEL4 in chroot?

/dev is not a directory but a mount.

mount -t tmpfs --bind /dev /sysroot/dev

Added:
>
>


 

LCG VOMSRS

https://lcg-voms.cern.ch:8443/vo/cms/vomrs

Deleted:
<
<

Checking the Job Robot Report

http://jobrobot.web.cern.ch/JobRobot/

VORS

http://vors.grid.iu.edu/cgi-bin/index.cgi

 
Added:
>
>


 

Complete Listing of OSG Configuration Variables

A complete list of OSG Configuration variables

https://twiki.grid.iu.edu/twiki/bin/view/Main/OSGConfigurationParameters

Deleted:
<
<

SAM Test Page

https://twiki.cern.ch/twiki/bin/view/CMS/SAMForCMS

 
Added:
>
>


 

How to Output the Text form of Grid Certificates (Host Cert)

openssl x509 -in cert.pem -text

Changed:
<
<

Checking BDII publishing

Sites to check to see whether UCSD is properly reporting to the BDII?

http://is.grid.iu.edu/cgi-bin/status.cgi

>
>


 

Entering a UCSD ACT Customer Service Request

http://blink.ucsd.edu/go/csr

Added:
>
>


 

Preserving the RSL file from submitted grid jobs

On the server side, edit

Line: 101 to 92
  That should preserve the gram_job_mgr files in the user home dir for debugging.
Added:
>
>


 

Updating OSG CA Certificates

http://vdt.cs.wisc.edu/releases/1.6.1/certificate_authorities.html

Line: 111 to 103
  # pacman -update CA-Certificates
Added:
>
>


Useful Grid Twiki for GRAM Errors

http://goc.grid.sinica.edu.tw/gocwiki/SiteProblemsFollowUpFaq



 

Installing Ubuntu on a Mac Mini

Using Grub

http://doc.gwos.org/index.php/UbuntuOnApple#Introduction_to_Linux_Installation_on_i386_Mac_Mini

Deleted:
<
<

Useful Grid Twiki for GRAM Errors

 
Changed:
<
<
http://goc.grid.sinica.edu.tw/gocwiki/SiteProblemsFollowUpFaq
>
>


UCSD Testing and Monitoring Links

 
Added:
>
>
Links, tools and sites related to monitoring the UCSD Tier2.

Checking BDII publishing

Sites to check to see whether UCSD is properly reporting to the BDII?

http://is.grid.iu.edu/cgi-bin/status.cgi

SAM Test Page

https://twiki.cern.ch/twiki/bin/view/CMS/SAMForCMS

CMS Prod Exit Code Results (CMS)

http://t2.unl.edu/pa/xml/quality_map_query?team=OSG

Job Robot Report

http://jobrobot.web.cern.ch/JobRobot/

VORS Monitoring

http://vors.grid.iu.edu/cgi-bin/index.cgi



 

Authors

-- RamiVanguri - 03 Aug 2006
Added:
>
>
 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 162007/08/21 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 117 to 117
  http://doc.gwos.org/index.php/UbuntuOnApple#Introduction_to_Linux_Installation_on_i386_Mac_Mini
Added:
>
>

Useful Grid Twiki for GRAM Errors

http://goc.grid.sinica.edu.tw/gocwiki/SiteProblemsFollowUpFaq

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 152007/08/07 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 111 to 111
  # pacman -update CA-Certificates
Added:
>
>

Installing Ubuntu on a Mac Mini

Using Grub

http://doc.gwos.org/index.php/UbuntuOnApple#Introduction_to_Linux_Installation_on_i386_Mac_Mini

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 142007/07/11 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 101 to 101
  That should preserve the gram_job_mgr files in the user home dir for debugging.
Added:
>
>

Updating OSG CA Certificates

http://vdt.cs.wisc.edu/releases/1.6.1/certificate_authorities.html

From

Run the following in $VDT_LOCATION

# pacman -update CA-Certificates

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 132007/07/10 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 94 to 94
  http://blink.ucsd.edu/go/csr
Added:
>
>

Preserving the RSL file from submitted grid jobs

On the server side, edit $VDT_LOCATION/globus/etc/globus-job-manager.conf and set "-save-logfile always"

That should preserve the gram_job_mgr files in the user home dir for debugging.

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 122007/07/06 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 90 to 90
  http://is.grid.iu.edu/cgi-bin/status.cgi
Added:
>
>

Entering a UCSD ACT Customer Service Request

http://blink.ucsd.edu/go/csr

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 112007/07/05 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 84 to 84
  openssl x509 -in cert.pem -text
Added:
>
>

Checking BDII publishing

Sites to check to see whether UCSD is properly reporting to the BDII?

http://is.grid.iu.edu/cgi-bin/status.cgi

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 102007/06/06 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 75 to 75
  https://twiki.grid.iu.edu/twiki/bin/view/Main/OSGConfigurationParameters
Added:
>
>

SAM Test Page

https://twiki.cern.ch/twiki/bin/view/CMS/SAMForCMS

 

How to Output the Text form of Grid Certificates (Host Cert)

openssl x509 -in cert.pem -text

Revision 92007/05/21 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 75 to 75
  https://twiki.grid.iu.edu/twiki/bin/view/Main/OSGConfigurationParameters
Added:
>
>

How to Output the Text form of Grid Certificates (Host Cert)

openssl x509 -in cert.pem -text

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 82007/05/21 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 69 to 69
  http://vors.grid.iu.edu/cgi-bin/index.cgi
Added:
>
>

Complete Listing of OSG Configuration Variables

A complete list of OSG Configuration variables

https://twiki.grid.iu.edu/twiki/bin/view/Main/OSGConfigurationParameters

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 72007/05/18 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 65 to 65
  http://jobrobot.web.cern.ch/JobRobot/
Added:
>
>

VORS

http://vors.grid.iu.edu/cgi-bin/index.cgi

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 62007/05/18 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 61 to 61
  https://lcg-voms.cern.ch:8443/vo/cms/vomrs
Added:
>
>

Checking the Job Robot Report

http://jobrobot.web.cern.ch/JobRobot/

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007 \ No newline at end of file

Revision 52007/04/03 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 57 to 57
  mount -t tmpfs --bind /dev /sysroot/dev
Added:
>
>

LCG VOMSRS

https://lcg-voms.cern.ch:8443/vo/cms/vomrs

 

Authors

-- RamiVanguri - 03 Aug 2006

Revision 42007/03/28 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 51 to 51
  # make roll
Added:
>
>

Why does /dev not appear with the right files on RHEL4 in chroot?

/dev is not a directory but a mount.

mount -t tmpfs --bind /dev /sysroot/dev

 

Authors

-- RamiVanguri - 03 Aug 2006 -- TerrenceMartin - 19 Mar 2007

Revision 32007/03/19 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Frequently Asked Questions

Line: 17 to 17
 ./globus/bin/grid-cert-request -host
Added:
>
>

How do I adjust the memory parameter on the kernel config line in a rocks CDROM kernel roll

The purpose of this fix is to allow Rocks to create very large raid partitions on 64bit machines.

Edit the following file:

rocks/src/roll/kernel/src/rocks-boot/enterprise/4/images/x86_64/isolinux.cfg

change:

label internal
       kernel vmlinuz
       append ramdisk_size=150000 initrd=initrd.img devfs=nomount ks
ksdevice=eth0 kssendmac selinux=0

to:

label internal
       kernel vmlinuz
       append ramdisk_size=150000 initrd=initrd.img devfs=nomount ks
ksdevice=eth0 kssendmac selinux=0 mem=1024M

then rebuild the kernel roll:

   # cd rocks/src/roll/kernel
   # make roll 

Authors

 -- RamiVanguri - 03 Aug 2006
Added:
>
>
-- TerrenceMartin - 19 Mar 2007

Revision 22007/01/03 - Main.TerrenceMartin

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Added:
>
>

Frequently Asked Questions

 
Added:
>
>

Contents

 
Added:
>
>
 
Added:
>
>

Administrative Questions

How to generate a grid host cert

After backing up the old cert files run the following.

source $VDT_LOCATION/setup.sh
./globus/bin/grid-cert-request -host <hostname> 
  -- RamiVanguri - 03 Aug 2006 \ No newline at end of file

Revision 12006/08/03 - Main.RamiVanguri

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="WebHome"

-- RamiVanguri - 03 Aug 2006

 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback