Difference: WSGramTests (4 vs. 5)

Revision 52008/01/18 - Main.RamiVanguri

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

WS Gram Testing

Line: 9 to 9
 

Introduction

Changed:
<
<
The following is results from UCSD WS Gram testing with Pre-WS Gram for comparision.
>
>
The following is results from UCSD WS Gram testing with Pre-WS Gram for comparison.

Test Setup

Gatekeeper

Dual Core Dual CPU Opteron 275 (64bit) 8GB RAM Centos 5 (RHEL) OSG 0.8.0 CE Condor 6.9.5

Submitters

Dual Processor Single Core 3.06Ghz Intel (32bit) 4GB RAM Centos 4 (RHEL) OSG 0.8.0 Client Condor 6.9.5

Dual Processor Dual Core 2.0Ghz Intel (64bit) 8GB RAM Centos 4 (RHEL) OSG 0.8.0 Client Condor 6.9.5

Test Scripts

Condor Submit Script WS GRAM

Universe=grid
Grid_Type = gt4
Jobmanager_Type = Condor
GlobusScheduler=https://osg-gw-5.t2.ucsd.edu:9443
executable=/home/users/tmartin/Cluster_Tests/ENV_test/re.sh
globus_rsl=(condor_submit=('+SleepSlot' 'TRUE'))
transfer_executable=True
stream_output = False
stream_error  = False
WhenToTransferOutput = ON_EXIT
transfer_input_files = /data/tmp/myscript.sh
log    = /tmp/wsgram.log

arguments = 3600
output = output/wsgram.out.$(Process)
error  = output/wsgram.err.$(Process)
notification=Never
queue 2000

Condor Submit Script PreWS? (GT2) GRAM

universe=globus
GlobusScheduler=osg-gw-5.t2.ucsd.edu:/jobmanager-condor
executable=/home/users/tmartin/Cluster_Tests/ENV_test/re.sh
globus_rsl=(condor_submit=('+SleepSlot' 'TRUE'))
transfer_executable=True
stream_output = False
stream_error  = False
WhenToTransferOutput = ON_EXIT
transfer_input_files = /data/tmp/myscript.sh
log    = /tmp/wsgram.log

arguments = 3600
output = output/wsgram.out.$(Process)
error  = output/wsgram.err.$(Process)
notification=Never
queue 2000

Test Program

#!/bin/sh

echo "starting WS Test...."
/usr/bin/whoami
/bin/hostname
chmod 755 myscript.sh
./myscript.sh
COUNT=$1
sleep $COUNT
echo "done WS Test.

Test Script

Downloaded to the node via GRAM and then called from the test program.

#!/bin/sh

echo "I am myscript!!!"

Gridmanager Settings

These settings were the ones used for most of the results below including the pre WS GT2 comparisons.

MAX_GRIDMANAGER_LOG     = 10000000
GRIDMANAGER_DEBUG       = D_COMMAND D_FULLDEBUG

# GT4 requires a gftp server to be running locally
#GRIDFTP_URL_BASE = gsiftp://$(FULL_HOSTNAME)
GRIDFTP_SERVER = $(LIBEXEC)/globus-gridftp-server
GRIDFTP_SERVER_WRAPPER = $(LIBEXEC)/gridftp_wrapper.sh

# Bump up the max jobs that can be submitted via condor-g
GRIDMANAGER_MAX_SUBMITTED_JOBS_PER_RESOURCE=2000
GRIDMANAGER_MAX_PENDING_SUBMITS_PER_RESOURCE=50

JAVA_EXTRA_ARGUMENTS = -Xmx1024M
GRIDMANAGER_GAHP_CALL_TIMEOUT = 600

Submitter GFTP server configuration

control_preauth_timeout 300

Gatekeeper GFTP server configuration

control_preauth_timeout 300

GT4 Server Side Settings

inetd 1
log_level ERROR,WARN,INFO
log_single /osglocal/osgce/globus/var/log/gridftp-auth.log
log_transfer /osglocal/osgce/globus/var/log/gridftp.log
control_preauth_timeout 300

GT4 Server Configuration

See Attachments

 

Tests

Line: 201 to 343
 
META FILEATTACHMENT attr="" autoattached="1" comment="UAF 1 Load 2K" date="1200614946" name="uaf-1-load-2k.png" path="uaf-1-load-2k.png" size="31368" user="Main.TerrenceMartin" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="OSG 5 Condor Load 2K" date="1200614808" name="osg-5-condor-load-2K.png" path="osg-5-condor-load-2K.png" size="30651" user="Main.TerrenceMartin" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="OSG 5 Load 1K" date="1200614220" name="gw5-load.png" path="gw5-load.png" size="27977" user="Main.TerrenceMartin" version="1"
Added:
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="GT4 Server Configuration" date="1200696015" name="server-config.wsdd" path="server-config.wsdd" size="14671" user="Main.RamiVanguri" version="1"
 
META FILEATTACHMENT attr="" autoattached="1" comment="UAF Load 1K" date="1200614420" name="uaf-1-load.png" path="uaf-1-load.png" size="25876" user="Main.TerrenceMartin" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="OSG GW5 Load 2kx2 Test 2" date="1200627926" name="osg-gw-5-load-2kx2-2.png" path="osg-gw-5-load-2kx2-2.png" size="37049" user="Main.TerrenceMartin" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="Comparison Condor Load WS vs Pre WS (long view)" date="1200641467" name="comparisonload.png" path="comparisonload.png" size="34830" user="Main.TerrenceMartin" version="1"
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback