"Seegrid will be due for a migration to confluence on the 1st of August. Any update on or after the 1st of August will NOT be migrated"

Basic Usage of Globus

To start and stop the Globus Container

As the globus user "globus" obtain a proxy certificate from the container by going: grid-proxy-init -cert /etc/grid-security/containercert.pem -key /etc/grid-security/containerkey.pem

To start the container: globus-start-container

To stop the container: globus-stop-container

To run a simple job

Using the Globus Toolkit 4 Clients

As a user (with certificates)
Get a proxy certificate: grid-proxy-init

Then run a job: globusrun-ws -s -F localhost -submit -job-command /bin/hostname

To run a useful job that stages in files etc....

globusrun-ws -s -F localhost -submit -f test.xml

(Note you may need to delegate your credentials before hand if so:

globus-credential-delegate -h delegationOutputFile

then:

globusrun-ws -s -F localhost -Jf delegationOutputFile -Sf delegationOutputFile -Tf delegationOutputFile -submit -f test.xml

where test.xml looks like:

<job>
    <job>
    <factoryEndpoint
                xmlns:gram="http://www.globus.org/namespaces/2004/10/gram/job"
                xmlns:wsa="http://schemas.xmlsoap.org/ws/2004/03/addressing">
        <wsa:Address>https://ng2.ivec.org:8443/wsrf/services/ManagedJobFactoryService</wsa:Address>
        <wsa:ReferenceProperties>
            <gram:ResourceID>PBS</gram:ResourceID>
        </wsa:ReferenceProperties>
    </factoryEndpoint>

    <!-- full path on cognac - cant work out how to make "modules add " work. -->
    <executable>/bin/echo</executable>

    <!-- MUST BE IN your group shared dir - NO access via staging to home dirs. -->
    <directory>/short/PROJECT_CODE/</directory>

    <!-- all file names need full path - cos mpirun does weird junk -->
    <argument>arg</argument>


    <stdout>/short/PROJECT_CODE/stdout</stdout>
    <stderr>/short/PROJECT_CODE/stderr</stderr>

    <!-- NOT optinal, ask darren for your project or log into cognac and you should be prompted for it -->

    <!--optional -->
    <hostCount>2</hostCount>


    <project>PROJECT_CODE</project>
<!--specify queue type-->
    <queue>express</queue>
    <maxWallTime>integer - minutes</maxWallTime>
    <maxMemory>integer- how many Mbs</maxMemory>

    <!-- file staging bit here -->
<fileStageIn>
        <transfer>
            <sourceUrl>gsiftp://localhost:2811/fileToTransfer</sourceUrl>
            <destinationUrl>gsiftp://remotehost:2811/CopiedFile</destinationUrl>
        </transfer>
   </fileStageIn>

   <fileStageOut>
        <transfer>
            <sourceUrl>gsiftp://remotehost:2811/outputFileToTransfer</sourceUrl>
            <destinationUrl>gsiftp://localhost:2811/CopiedOutputfile</destinationUrl>
        </transfer>
   </fileStageOut>

    <!-- NOT optinal, for staging to work - delegation must be apssed on -->
    <extensions>
        <globusrunAnnotation>
            <automaticJobDelegation>true</automaticJobDelegation>
            <automaticStagingDelegation>true</automaticStagingDelegation>
            <automaticStageInDelegation>true</automaticStageInDelegation>
            <automaticStageOutDelegation>true</automaticStageOutDelegation>
            <automaticCleanUpDelegation>true</automaticCleanUpDelegation>
        </globusrunAnnotation>
        </extensions>


</job>

   

To run more complex jobs: http://www.globus.org/toolkit/docs/4.0/execution/wsgram/user-index.html

To gridftp files

Simple use case
To get files: globus-url-copy -vb gsiftp://remote.machine.my.edu/tmp/bar file:///tmp/foo

To put files: globus-url-copy -vb file:///tmp/foo gsiftp://remote.machine.my.edu/tmp/bar

More information can be found at: http://www.globus.org/toolkit/docs/4.0/data/gridftp/user-index.html -- RyanFraser - 20 Dec 2005
Topic revision: r4 - 15 Oct 2010, UnknownUser
 

Current license: All material on this collaboration platform is licensed under a Creative Commons Attribution 3.0 Australia Licence (CC BY 3.0).