Squid Proxy Customizations at UCSD T2

Contents

Introduction

UCSD runs a squid proxy for the use of any OSG users that would like to take advantage of the benefits of a local HTTP/FTP proxy. The most significant benefits are for those VOs that use http protocol for the distribution of code, data or meta-data to individual jobs. Instead of each job generating a request to a central VO source the squid proxy can use its cache ability to make subsequent data requests come from the local proxy instead of the remote VO source.

Using the UCSD Squid Proxy

The UCSD CE sets two environment variables to assist jobs in the use of the squid proxy.

http_proxy

The environment variable http_proxy is set for all jobs submitted to the UCSD T2 center. The http_proxy variable is a widely used standard for specifying a local http proxy to a variety of web tools including links(1), wget(1) and curl(1).

Some HTTP agent libraries for various scripting languages also honor the *_proxy environment variables including Perl's LWP::UserAgent(3).

OSG_SQUID_LOCATION

UCSD sets the OSG_SQUID_LOCATION variable to the same value as http_proxy. OSG_SQUID_LOCATION is an OSG standard environment variable and can be used to pass the correct http proxy location to custom programs or programs that do not adhere to the http_proxy standard.

Authors

-- TerrenceMartin - 17 May 2007

Topic revision: r1 - 2007/05/17 - 23:14:45 - TerrenceMartin
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback