[gram-user] job cannot be submiited by globusws-run

Peter G Lane lane at mcs.anl.gov
Mon May 15 17:00:37 CDT 2006


The container log doesn't make any sense. It only has logging statements
for a restarted job. Please delete the container owner's
~/.globus/persisted directory, restart the container, and submit a job.
Then send the container log.

Peter

On Mon, 2006-05-15 at 14:24 -0700, wenwen LI wrote:
> Today I test the GRAM again, the same problems before has comes out
> again. I followed the instuction you told me but the job status is
> still unsubmitted.
> I attached the container log and thank you very much to help me!
>  
>              Wenwen
> 
> Peter G Lane <lane at mcs.anl.gov> wrote:
>         On Tue, 2006-05-09 at 12:19 -0700, wenwen LI wrote:
>         > Thanks very much! It works now!
>         > I have followed your instruction, uncomment the debug line,
>         then start
>         > globus-scheduler-event-generator -s..., then I started
>         > globus-start-container, 
>         > then by user 'wenwen', I submit a job, its status comes out
>         as active!
>         > Thanks a lot!
>         > But can you tell me why this happens? Why I can submit a job
>         before I
>         > run globus-scheduler-event-generator?
>         
>         You shouldn't have to start the SEG manually. GRAM is supposed
>         to start
>         it for you (that's where those log statements come from). In
>         fact, GRAM
>         is using it's own SEG daemon instead of the one you started.
>         I'm just
>         not sure why starting one manually would make it work. Does
>         GRAM work
>         now if you don't start the SEG manually?
>         
>         Peter
>         
>         > 
>         > 
>         > Peter G Lane wrote: 
>         > What version of the Globus Toolkit are you using? I can't
>         > figure out why
>         > it's trying to recover the same job twice. The recover
>         method
>         > is
>         > synchronized and also checks a flag to make sure it doesn't
>         > run twice.
>         > This should be impossible. Do you have two deployments of
>         the
>         > GRAM
>         > services by any chance?
>         > 
>         > I guess for now you can just delete your
>         ~/.globus/persisted/
>         > directory
>         > to clean up all the job persistence data. Then we can
>         address
>         > the
>         > original problem. Can you turn on full GRAM debug logging in
>         > container-log4j.properties (just uncomment the appropriate
>         > line) and
>         > just start your container (don't submit any jobs). You
>         should
>         > see some
>         > lines that list the command-line arguments for running the
>         > Fork SEG. If
>         > not, send me the container log. If you do, reconstruct the
>         > command-line
>         > from those logging statements and run it by hand. If you
>         don't
>         > see any
>         > output, adjust the timestamp (it's in seconds since the
>         epoch)
>         > so that
>         > it represents an earlier time and try again. You should
>         > eventually see
>         > something like the following (the command should "hang"):
>         > 
>         > logan%
>         > $GLOBUS_LOCATION/libexec/globus-scheduler-event-generator -s
>         > fork
>         > -t 1145994457
>         > 001;1145994457;58d45b32-d494-11da-8c01-000d61215ff0:6616;2;0
>         > 001;1145994457;58d45b32-d494-11da-8c01-000d61215ff0:6616;8;0
>         > 001;1145994584;a4ceee44-d494-11da-8600-000d61215ff0:6709;2;0
>         > 001;1145994584;a4ceee44-d494-11da-8600-000d61215ff0:6709;8;0
>         >
>         001;1146023492;f36ab716-d4d7-11da-9124-000d61215ff0:11605;2;0
>         >
>         001;1146023492;f36ab716-d4d7-11da-9124-000d61215ff0:11605;8;0
>         > 
>         > Peter
>         > 
>         > On Fri, 2006-04-28 at 10:56 -0700, wenwen LI wrote:
>         > > Here is the result:
>         > >
>         >
>         --------------------------------------------------------------------------------------------------------------------
>         > > total 40
>         > > -rw-rw-r-- 1 globus globus 6925 Apr 27 16:22
>         > > 111fb780-d590-11da-b53b-00093d1067b1.xml
>         > > -rw-rw-r-- 1 globus globus 6925 Apr 27 16:22
>         > > 17889586-d579-11da-830a-00093d1067b1.xml
>         > > -rw-rw-r-- 1 globus globus 6926 Apr 27 16:22
>         > > 362de86c-d57c-11da-82c7-00093d1067b1.xml
>         > > -rw-rw-r-- 1 globus globus 6925 Apr 27 16:22
>         > > 438ae57e-d580-11da-babc-00093d1067b1.xml
>         > > -rw-rw-r-- 1 globus globus 6925 Apr 27 16:22
>         > > b6f4ab42-d59b-11da-a021-00093d1067b1.xml
>         > > -rw-rw-r-- 1 globus globus 0 Apr 21 00:09 xph27814.tmp
>         > > 
>         > >
>         >
>         -------------------------------------------------------------------------------------------------------------------
>         > > And I have attached the
>         > 111fb780-d590-11da-b53b-00093d1067b1.xml file
>         > > in the mail.
>         > > Thank you very much!
>         > > 
>         > > 
>         > > Peter G Lane wrote:
>         > > On Thu, 2006-04-27 at 12:17 -0700, wenwen LI wrote:
>         > > > Here is the result:
>         > > > [root at srb var]# ls -l
>         > > > total 24
>         > > > -rw-r--r-- 1 globus globus 4831 Apr 12 15:46
>         container.log
>         > > > -rw-rw-rw- 1 globus globus 1346 Apr 26 23:12
>         > > > globus-fork.log
>         > > > -rw-rw-r-- 1 globus globus 46 Apr 27 04:02
>         > > > globus-jsm-fork.stamp
>         > > > -rw-rw-r-- 1 globus globus 46 Apr 27 04:02
>         > > > globus-jsm-multi.stamp
>         > > > drwxrwxr-x 3 globus globus 4096 Mar 30 17:19 lib
>         > > > I think it has the right permissions.
>         > > > But today when I start the web service container by user
>         > > 'globus', it
>         > > > has such errors that never comes before,
>         > > >
>         > >
>         >
>         -------------------------------------------------------------------------------------------------------------------
>         > > > [globus at srb postgre]$ globus-start-container
>         > > > 2006-04-27 16:22:07,937 INFO
>         exec.ManagedExecutableJobHome
>         > > > [Thread-3,recover:163] Recovered resource with ID
>         > > > 438ae57e-d580-11da-babc-00093d1067b1.
>         > > > 2006-04-27 16:22:07,944 INFO exec.RunQueue
>         [Thread-3,:54]
>         > > > Starting state machine with 16 run queues.
>         > > > 2006-04-27 16:22:09,027 INFO
>         exec.ManagedExecutableJobHome
>         > > > [Thread-3,recover:163] Recovered resource with ID
>         > > > 111fb780-d590-11da-b53b-00093d1067b1.
>         > > > 2006-04-27 16:22:12,918 INFO
>         exec.ManagedExecutableJobHome
>         > > > [Thread-6,recover:163] Recovered resource with ID
>         > > > 438ae57e-d580-11da-babc-00093d1067b1.
>         > > > 2006-04-27 16:22:12,919 INFO
>         exec.ManagedExecutableJobHome
>         > > > [Thread-6,recover:163] Recovered resource with ID
>         > > > 111fb780-d590-11da-b53b-00093d1067b1.
>         > > > 2006-04-27 16:22:12,958 ERROR
>         > > utils.JobStateMonitorSubscriptionManager
>         > > > [Thread-23,subscribe:179] unable to monitor job for
>         state
>         > > changes
>         > > > org.globus.exec.monitoring.AlreadyRegisteredException
>         > > 
>         > > I don't understand how, but it looks like a job is being
>         > > recovered twice
>         > > (111fb780-d590-11da-b53b-00093d1067b1). What version of
>         the
>         > > toolkit are
>         > > you using? Would it be possible for you to find the file
>         in
>         > > the
>         > > container owner's
>         > >
>         ~/.globus/persisted/-/ManagedExecutableJobResourceStateType/
>         > > directory named 111fb780-d590-11da-b53b-00093d1067b1.xml
>         and
>         > > attach it
>         > > to your response. I'm wondering if the persistence data
>         got
>         > > corrupted.
>         > > After that, if you delete that directory then you won't
>         have
>         > > all these
>         > > jobs being recovered.
>         > > 
>         > > Peter
>         > > 
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.exec.monitoring.JobStateMonitor.registerJobID(JobStateMonitor.java:227)
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.exec.service.exec.utils.JobStateMonitorSubscriptionManager.subscribe(JobStateMonitorSubscriptionManager.java:171)
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.exec.service.exec.utils.JobStateMonitorSubscriptionManager.run(JobStateMonitorSubscriptionManager.java:136)
>         > > > 2006-04-27 16:22:12,963 ERROR
>         > > utils.JobStateMonitorSubscriptionManager
>         > > > [Thread-23,subscribe:179] unable to monitor job for
>         state
>         > > changes
>         > > > org.globus.exec.monitoring.AlreadyRegisteredException
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.exec.monitoring.JobStateMonitor.registerJobID(JobStateMonitor.java:227)
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.exec.service.exec.utils.JobStateMonitorSubscriptionManager.subscribe(JobStateMonitorSubscriptionManager.java:171)
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.exec.service.exec.utils.JobStateMonitorSubscriptionManager.run(JobStateMonitorSubscriptionManager.java:136)
>         > > > 2006-04-27 16:22:12,963 WARN
>         > > factory.ManagedJobFactoryResource
>         > > > [Thread-3,run:164] Recovery exception
>         > > > org.globus.wsrf.NoSuchResourceException
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.wsrf.impl.ResourceHomeImpl.get(ResourceHomeImpl.java:285)
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.wsrf.impl.ResourceHomeImpl.find(ResourceHomeImpl.java:262)
>         > > > at
>         > > >
>         > >
>         >
>         org.globus.exec.service.exec.ManagedExecutableJobHome.recover(ManagedExecutableJobHome.java:160)
>         > > > at
>         > org.globus.exec.service.factory.ManagedJobFactoryResource
>         > > > $1RecoveryThread.run(ManagedJobFactoryResource.java:161)
>         > > > 2006-04-27 16:22:13,084 INFO
>         exec.ManagedExecutableJobHome
>         > > > [Thread-6,recover:163] Recovered resource with ID
>         > > > 9a8bbb5c-d56a-11da-bb0b-00093d1067b1.
>         > > > 2006-04-27 16:22:13,206 INFO
>         exec.ManagedExecutableJobHome
>         > > > [Thread-6,recover:163] Recovered resource with ID
>         > > > 17889586-d579-11da-830a-00093d1067b1.
>         > > > 2006-04-27 16:22:13,324 INFO
>         exec.ManagedExecutableJobHome
>         > > > [Thread-6,recover:163] Recovered resource with ID
>         > > > 362de86c-d57c-11da-82c7-00093d1067b1.
>         > > > 2006-04-27 16:22:13,438 INFO
>         exec.ManagedExecutableJobHome
>         > > > [Thread-6,recover:163] Recovered resource with ID
>         > > > b6f4ab42-d59b-11da-a021-00093d1067b1.
>         > > > 
>         > > >
>         > >
>         >
>         -------------------------------------------------------------------------------------------------------------------
>         > > > 
>         > > > What's wrong with it? 
>         > > > 
>         > > > Peter G Lane wrote:
>         > > > On Wed, 2006-04-26 at 19:17 -0700, wenwen LI wrote:
>         > > > > Hi,
>         > > > > This is the information for globus-fork.conf:
>         > > > >
>         > > >
>         > >
>         >
>         ----------------------------------------------------------------------------------------------------------------------------
>         > > > > [root at srb etc]# ls -l globus-fork.conf
>         > > > > -rw-rw-rw- 1 globus globus 47 Mar 30 17:20
>         > > > > globus-fork.conf
>         > > > 
>         > > > I wasn't clear enough. I want you to look *in*
>         > > > globus-fork.conf. It is a
>         > > > configuration file that contains a path to the fork SEG
>         > log
>         > > > file. It is
>         > > > the fork SEG log file that I want you to check for
>         > > > permissions. The
>         > > > globus-fork.conf file only needs to be -rw for the
>         owner.
>         > > > 
>         > > > Peter
>         > > > 
>         > > > >
>         > > >
>         > >
>         >
>         ---------------------------------------------------------------------------------------------------------------------------
>         > > > > After that I run the TESTS.pl by the user 'wenwen' ,
>         but
>         > > > still get
>         > > > > this
>         > > > >
>         > > >
>         > >
>         >
>         ----------------------------------------------------------------------------------------------------------------------------
>         > > > > [wenwen at srb
>         > > > globus_scheduler_event_generator_fork_test]$ ./TESTS.pl
>         > > > > Warning: Do not start a service container while this
>         > test
>         > > > script is
>         > > > > running.
>         > > > > test-fork-seg....ok 
>         > > > > 1/1 skipped: Fork SEG not configured
>         > > > > All tests successful, 1 subtest skipped.
>         > > > > Files=1, Tests=1, 0 wallclock secs ( 0.01 cusr + 0.02
>         > csys
>         > > =
>         > > > 0.03
>         > > > > CPU)
>         > > > >
>         > > >
>         > >
>         >
>         ----------------------------------------------------------------------------------------------------------------------------
>         > > > > Then I submit a job, it says "job
>         > status:unsubmitted",then
>         > > > nothing
>         > > > > comes out under that sentence.
>         > > > > I think the webservice server cannot received my job
>         > > > request,
>         > > > > What's wrong with it?
>         > > > > Thanks in advance!
>         > > > > 
>         > > > > Wenwen
>         > > > > 
>         > > > > 
>         > > > > Peter G Lane wrote:
>         > > > > On Wed, 2006-04-26 at 15:50 -0700, wenwen LI wrote:
>         > > > > > Hi,everyone:
>         > > > > > 
>         > > > > > I start POSTGRESQL under user 'postgre',success;
>         Then
>         > I
>         > > > run
>         > > > > the web
>         > > > > > service container in user 'globus', it starts
>         well;but
>         > > > when
>         > > > > I run :
>         > > > > > globusrun-ws -submit -c /bin/true 
>         > > > > > by user 'wenwen' , I got such results:
>         > > > > > Submitting job...Done.
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         -------------------------------------------------------------------------------------------------------
>         > > > > > Job ID: uuid:362de86c-d57c-11da-82c7-00093d1067b1
>         > > > > > Termination time: 04/27/2006 23:27 GMT
>         > > > > > (after waiting 2 minutes,I got)
>         > > > > > Current job state: Unsubmitted
>         > > > > > (Then nothing comes out in this window and in the
>         web
>         > > > > service
>         > > > > > container window,
>         > > > > > nothing comes out, either)
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         -------------------------------------------------------------------------------------------------------
>         > > > > > Then I run TESTS.pl by user 'wenwen' like this:
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         ------------------------------------------------------------------------------------------------------
>         > > > > > [wenwen at srb
>         > > > > globus_scheduler_event_generator_test]$ ./TESTS.pl
>         > > > > > seg-api-test............ok 
>         > > > > > seg-module-load-test....ok 
>         > > > > > seg-timestamp-test......ok 
>         > > > > > All tests successful.
>         > > > > > Files=3, Tests=6, 1 wallclock secs ( 0.09 cusr +
>         0.05
>         > > csys
>         > > > =
>         > > > > 0.14
>         > > > > > CPU)
>         > > > > > [wenwen at srb globus_scheduler_event_generator_test]$
>         cd
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         $GLOBUS_LOCATION/test/globus_scheduler_event_generator_fork_test
>         > > > > > [wenwen at srb
>         > > > >
>         globus_scheduler_event_generator_fork_test]$ ./TESTS.pl
>         > > > > > Warning: Do not start a service container while this
>         > > test
>         > > > > script is
>         > > > > > running.
>         > > > > > test-fork-seg....ok 
>         > > > > > 1/1 skipped: Fork SEG not configured
>         > > > > 
>         > > > > Check $GLOBUS_LOCATION/etc/globus-fork.conf for a
>         valid
>         > > > path.
>         > > > > Check the
>         > > > > file pointed to by that path for proper permissions.
>         It
>         > > > should
>         > > > > be world
>         > > > > readable and writable.
>         > > > > 
>         > > > > Peter
>         > > > > 
>         > > > > > All tests successful, 1 subtest skipped.
>         > > > > > Files=1, Tests=1, 0 wallclock secs ( 0.04 cusr +
>         0.00
>         > > csys
>         > > > =
>         > > > > 0.04
>         > > > > > CPU)
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         ------------------------------------------------------------------------------------------------------
>         > > > > > But I restart web service container:
>         > > > > > It gives such informations:
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         ------------------------------------------------------------------------------------------------------
>         > > > > > globus-start-container
>         > > > > > 2006-04-26 19:52:02,266 WARN
>         > > > > factory.ManagedJobFactoryResource
>         > > > > > [Thread-3,run:164] Recovery exception
>         > > > > > org.globus.wsrf.NoSuchResourceException
>         > > > > > at
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         org.globus.wsrf.impl.ResourceHomeImpl.get(ResourceHomeImpl.java:285)
>         > > > > > at
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         org.globus.wsrf.impl.ResourceHomeImpl.find(ResourceHomeImpl.java:262)
>         > > > > > at
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         org.globus.exec.service.exec.ManagedExecutableJobHome.recover(ManagedExecutableJobHome.java:160)
>         > > > > > at
>         > > >
>         org.globus.exec.service.factory.ManagedJobFactoryResource
>         > > > > >
>         > $1RecoveryThread.run(ManagedJobFactoryResource.java:161)
>         > > > > > 2006-04-26 19:52:05,222 INFO exec.RunQueue
>         > > [Thread-6,:54]
>         > > > > > Starting state machine with 16 run queues.
>         > > > > > 2006-04-26 19:52:07,289 WARN
>         > > > > factory.ManagedJobFactoryResource
>         > > > > > [Thread-6,run:164] Recovery exception
>         > > > > > org.globus.wsrf.NoSuchResourceException
>         > > > > > at
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         org.globus.wsrf.impl.ResourceHomeImpl.get(ResourceHomeImpl.java:285)
>         > > > > > at
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         org.globus.wsrf.impl.ResourceHomeImpl.find(ResourceHomeImpl.java:262)
>         > > > > > at
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         org.globus.exec.service.exec.ManagedExecutableJobHome.recover(ManagedExecutableJobHome.java:160)
>         > > > > > at
>         > > >
>         org.globus.exec.service.factory.ManagedJobFactoryResource
>         > > > > >
>         > $1RecoveryThread.run(ManagedJobFactoryResource.java:161)
>         > > > > > Starting SOAP server at:
>         > > > > https://129.174.124.107:8443/wsrf/services/ 
>         > > > > > With the following services:
>         > > > > > [1]:
>         > > > >
>         > > >
>         > >
>         >
>         https://129.174.124.107:8443/wsrf/services/TriggerFactoryService
>         > > > > > [2]:
>         > > > >
>         > > >
>         > >
>         >
>         https://129.174.124.107:8443/wsrf/services/DelegationTestService
>         > > > > > [3]:
>         > > > >
>         > > >
>         > >
>         >
>         https://129.174.124.107:8443/wsrf/services/SecureCounterService
>         > > > > > [4]:
>         > > > >
>         > >
>         https://129.174.124.107:8443/wsrf/services/IndexServiceEntry
>         > > > > > [5]:
>         > > > >
>         > >
>         https://129.174.124.107:8443/wsrf/services/DelegationService
>         > > > > > [6]:
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         https://129.174.124.107:8443/wsrf/services/InMemoryServiceGroupFactory
>         > > > > > [7]:
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         https://129.174.124.107:8443/wsrf/services/mds/test/execsource/IndexService
>         > > > > > [8]:
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         https://129.174.124.107:8443/wsrf/services/mds/test/subsource/IndexSe
>         > > > > > ......
>         > > > > > [51]
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         ------------------------------------------------------------------------------------------------------
>         > > > > > Can any body help??
>         > > > > > Thank you very much!
>         > > > > > 
>         > > > > > 
>         > > > > > Wenwen
>         > > > > > 
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         ______________________________________________________________________
>         > > > > > Yahoo! Messenger with Voice. PC-to-Phone calls for
>         > > > > ridiculously low
>         > > > > > rates.
>         > > > > > 
>         > > > > > 
>         > > > > >
>         > > > >
>         > > >
>         > >
>         >
>         ______________________________________________________________________
>         > > > > > Yahoo! Messenger with Voice. PC-to-Phone calls for
>         > > > > ridiculously low
>         > > > > > rates.
>         > > > > 
>         > > > > 
>         > > > > 
>         > > > > 
>         > > > >
>         > > >
>         > >
>         >
>         ______________________________________________________________________
>         > > > > Talk is cheap. Use Yahoo! Messenger to make
>         PC-to-Phone
>         
>         === message truncated ===
> 
> 
> 
> 
> ______________________________________________________________________
> Blab-away for as little as 1¢/min. Make PC-to-Phone Calls using Yahoo!
> Messenger with Voice.
> plain text document attachment (web container log.txt),
> "3519036990-web container log.txt"
>      
> 2006-05-15 18:08:58,521 DEBUG factory.ManagedJobFactoryService 
> [main,<init>:67] Creating ManagedJobFactoryService 
> org.globus.exec.service.factory.ManagedJobFactoryService at 10e35d5
> 2006-05-15 18:08:59,827 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:84] Creating ManagedJobFactoryHome
> 2006-05-15 18:08:59,840 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:103] Register to MDS: true
> 2006-05-15 18:08:59,843 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:115] JNDI: binding found securityProp: 
> org.apache.naming.SynchronizedContext:org.apache.naming.SynchronizedContext at e14d81
> 2006-05-15 18:08:59,844 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:123] boundJNDIObjectClazz=class 
> org.apache.naming.SynchronizedContext
> 2006-05-15 18:08:59,847 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:115] JNDI: binding found mdsConfiguration: 
> org.globus.wsrf.impl.servicegroup.client.MDSConfiguration:org.globus.wsrf.impl.servicegroup.client.MDSConfiguration at 1df5f21
> 2006-05-15 18:08:59,848 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:123] boundJNDIObjectClazz=class 
> org.globus.wsrf.impl.servicegroup.client.MDSConfiguration
> 2006-05-15 18:08:59,849 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:115] JNDI: binding found ForkResourceConfiguration: 
> org.globus.wsrf.jndi.ServiceResourceRef:ResourceRef[className=org.globus.exec.service.factory.FactoryResourceConfiguration,factoryClassLocation=null,factoryClassName=org.apache.naming.factory.ResourceFactory,{type=localResourceManagerName,content=Fork},{type=factory,content=org.globus.wsrf.jndi.BeanFactory}]
> 2006-05-15 18:08:59,850 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:123] boundJNDIObjectClazz=class 
> org.globus.exec.service.factory.FactoryResourceConfiguration
> 2006-05-15 18:08:59,855 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:132] Creating factory resource for Fork
> 2006-05-15 18:08:59,867 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}localResourceManager
> 2006-05-15 18:08:59,878 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}globusLocation
> 2006-05-15 18:08:59,880 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}hostCPUType
> 2006-05-15 18:08:59,881 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}hostManufacturer
> 2006-05-15 18:08:59,883 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}hostOSName
> 2006-05-15 18:08:59,884 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}hostOSVersion
> 2006-05-15 18:08:59,885 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}scratchBaseDirectory
> 2006-05-15 18:08:59,886 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}delegationFactoryEndpoint
> 2006-05-15 18:08:59,892 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}stagingDelegationFactoryEndpoint
> 2006-05-15 18:08:59,899 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}condorArchitecture
> 2006-05-15 18:08:59,900 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}condorOS
> 2006-05-15 18:08:59,901 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://mds.globus.org/glue/ce/1.1}GLUECE
> 2006-05-15 18:09:00,074 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://mds.globus.org/glue/ce/1.1}GLUECESummary
> 2006-05-15 18:09:00,077 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://mds.globus.org/metadata/2005/02}ServiceMetaDataInfo
> 2006-05-15 18:09:05,165 DEBUG exec.ManagedExecutableJobHome 
> [main,<init>:90] Entering ManagedExecutableJobHome()
> 2006-05-15 18:09:05,166 DEBUG exec.ManagedExecutableJobHome 
> [main,<init>:91] Leaving ManagedExecutableJobHome()
> 2006-05-15 18:09:05,200 DEBUG exec.ManagedExecutableJobHome 
> [main,initialize:101] Entering initialize()
> 2006-05-15 18:09:05,231 DEBUG exec.ManagedExecutableJobHome 
> [main,initialize:113] Leaving initialize()
> 2006-05-15 18:09:05,233 DEBUG exec.ManagedExecutableJobHome 
> [main,getHome:482] created MEJH instance
> 2006-05-15 18:09:05,240 DEBUG monitoring.JobStateMonitor 
> [main,<init>:185] Constructing JobStateMonitor
> 2006-05-15 18:09:05,246 DEBUG monitoring.JobStateMonitor 
> [main,<init>:200] Setting SEG daemon status to true
> 2006-05-15 18:09:05,252 DEBUG monitoring.JobStateMonitor 
> [main,start:261] Entering start()
> 2006-05-15 18:09:05,256 DEBUG monitoring.JobStateMonitor 
> [main,start:268] starting seg with timestamp Tue May 09 16:10:50 EDT 2006
> 2006-05-15 18:09:05,257 DEBUG monitoring.SchedulerEventGenerator 
> [main,start:315] Starting seg thread
> 2006-05-15 18:09:05,258 DEBUG monitoring.JobStateMonitor 
> [main,start:275] creating flush task
> 2006-05-15 18:09:05,259 DEBUG monitoring.JobStateMonitor 
> [main,start:287] creating recovery update task
> 2006-05-15 18:09:05,259 DEBUG monitoring.JobStateMonitor 
> [main,start:296] Exiting start()
> 2006-05-15 18:09:05,260 DEBUG factory.ManagedJobFactoryHome 
> [main,add:175] In custom add
> 2006-05-15 18:09:05,265 DEBUG factory.ManagedJobFactoryHome 
> [main,add:182] registering to MDS
> 2006-05-15 18:09:05,298 DEBUG factory.ManagedJobFactoryResource 
> [Thread-3,run:152] recovery thread active
> 2006-05-15 18:09:05,298 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,recover:135] Entering recover()
> 2006-05-15 18:09:05,298 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,recover:143] Loading the home's list of resource keys
> 2006-05-15 18:09:05,309 DEBUG utils.PersistenceHelper 
> [Thread-3,load:138] loading resource 
> org.globus.exec.service.exec.PersistentManagedExecutableJobResource at 40afb9 of key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:05,346 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:266] throttleRestart called
> 2006-05-15 18:09:05,346 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:216] Starting seg process
> 2006-05-15 18:09:05,368 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:235] executing command: 
> 2006-05-15 18:09:05,368 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:09:05,369 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-s
> 2006-05-15 18:09:05,369 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->fork
> 2006-05-15 18:09:05,369 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-t
> 2006-05-15 18:09:05,369 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->1147205450
> 2006-05-15 18:09:05,389 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:123] getting seg input
> 2006-05-15 18:09:05,397 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:128] Seg input buffer is not ready
> 2006-05-15 18:09:05,562 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:266] throttleRestart called
> 2006-05-15 18:09:05,562 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:09:05,661 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:115] JNDI: binding found MultiResourceConfiguration: 
> org.globus.wsrf.jndi.ServiceResourceRef:ResourceRef[className=org.globus.exec.service.factory.FactoryResourceConfiguration,factoryClassLocation=null,factoryClassName=org.apache.naming.factory.ResourceFactory,{type=localResourceManagerName,content=Multi},{type=factory,content=org.globus.wsrf.jndi.BeanFactory}]
> 2006-05-15 18:09:05,662 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:123] boundJNDIObjectClazz=class 
> org.globus.exec.service.factory.FactoryResourceConfiguration
> 2006-05-15 18:09:05,664 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:132] Creating factory resource for Multi
> 2006-05-15 18:09:05,665 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}localResourceManager
> 2006-05-15 18:09:05,665 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}globusLocation
> 2006-05-15 18:09:05,909 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}hostCPUType
> 2006-05-15 18:09:05,909 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}hostManufacturer
> 2006-05-15 18:09:05,910 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}hostOSName
> 2006-05-15 18:09:05,911 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}hostOSVersion
> 2006-05-15 18:09:05,979 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}scratchBaseDirectory
> 2006-05-15 18:09:05,980 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}delegationFactoryEndpoint
> 2006-05-15 18:09:05,981 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}stagingDelegationFactoryEndpoint
> 2006-05-15 18:09:05,981 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}condorArchitecture
> 2006-05-15 18:09:05,982 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://www.globus.org/namespaces/2004/10/gram/job}condorOS
> 2006-05-15 18:09:05,983 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://mds.globus.org/glue/ce/1.1}GLUECE
> 2006-05-15 18:09:05,988 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://mds.globus.org/glue/ce/1.1}GLUECESummary
> 2006-05-15 18:09:05,989 DEBUG factory.ManagedJobFactoryResource 
> [main,createNewResourceProperty:275] Creating resource property for: 
> {http://mds.globus.org/metadata/2005/02}ServiceMetaDataInfo
> 2006-05-15 18:09:05,989 DEBUG monitoring.JobStateMonitor 
> [main,<init>:185] Constructing JobStateMonitor
> 2006-05-15 18:09:05,990 DEBUG monitoring.JobStateMonitor 
> [main,<init>:200] Setting SEG daemon status to true
> 2006-05-15 18:09:05,990 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initialize:173] Entering 
> initialize()
> 2006-05-15 18:09:05,991 DEBUG monitoring.JobStateMonitor 
> [main,start:261] Entering start()
> 2006-05-15 18:09:05,991 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initialize:178] at 
> super.initialize()
> 2006-05-15 18:09:05,992 DEBUG monitoring.JobStateMonitor 
> [main,start:268] starting seg with timestamp Thu Apr 13 12:32:31 EDT 2006
> 2006-05-15 18:09:06,160 DEBUG monitoring.SchedulerEventGenerator 
> [main,start:315] Starting seg thread
> 2006-05-15 18:09:06,161 DEBUG monitoring.JobStateMonitor 
> [main,start:275] creating flush task
> 2006-05-15 18:09:06,162 DEBUG monitoring.JobStateMonitor 
> [main,start:287] creating recovery update task
> 2006-05-15 18:09:06,162 DEBUG monitoring.JobStateMonitor 
> [main,start:296] Exiting start()
> 2006-05-15 18:09:06,163 DEBUG factory.ManagedJobFactoryHome 
> [main,add:175] In custom add
> 2006-05-15 18:09:06,164 DEBUG factory.ManagedJobFactoryHome 
> [main,add:182] registering to MDS
> 2006-05-15 18:09:06,167 DEBUG factory.ManagedJobFactoryResource 
> [Thread-6,run:152] recovery thread active
> 2006-05-15 18:09:06,168 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:266] throttleRestart called
> 2006-05-15 18:09:06,168 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:216] Starting seg process
> 2006-05-15 18:09:06,168 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:235] executing command: 
> 2006-05-15 18:09:06,168 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:09:06,169 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-s
> 2006-05-15 18:09:06,169 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->multi
> 2006-05-15 18:09:06,169 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-t
> 2006-05-15 18:09:06,169 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->1144945951
> 2006-05-15 18:09:06,180 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:123] getting seg input
> 2006-05-15 18:09:06,180 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:128] Seg input buffer is not ready
> 2006-05-15 18:09:06,180 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:266] throttleRestart called
> 2006-05-15 18:09:06,181 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:09:06,201 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:115] JNDI: binding found homeConfiguration: 
> org.globus.exec.service.factory.FactoryHomeConfiguration:org.globus.exec.service.factory.FactoryHomeConfiguration at 159054d
> 2006-05-15 18:09:06,202 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:123] boundJNDIObjectClazz=class 
> org.globus.exec.service.factory.FactoryHomeConfiguration
> 2006-05-15 18:09:06,202 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:115] JNDI: binding found configuration: 
> org.globus.exec.service.factory.FactoryServiceConfiguration:org.globus.exec.service.factory.FactoryServiceConfiguration at 16b321b
> 2006-05-15 18:09:06,203 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:123] boundJNDIObjectClazz=class 
> org.globus.exec.service.factory.FactoryServiceConfiguration
> 2006-05-15 18:09:06,204 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:115] JNDI: binding found home: 
> org.globus.wsrf.jndi.ServiceResourceRef:ResourceRef[className=org.globus.exec.service.factory.ManagedJobFactoryHome,factoryClassLocation=null,factoryClassName=org.apache.naming.factory.ResourceFactory,{type=resourceKeyType,content=java.lang.String},{type=resourceClass,content=org.globus.exec.service.factory.ManagedJobFactoryResource},{type=factory,content=org.globus.wsrf.jndi.BeanFactory}]
> 2006-05-15 18:09:06,205 DEBUG factory.ManagedJobFactoryHome 
> [main,initialize:123] boundJNDIObjectClazz=class 
> org.globus.exec.service.factory.ManagedJobFactoryHome
> 2006-05-15 18:09:06,701 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initialize:184] at initSecurity()
> 2006-05-15 18:09:06,702 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initSecurity:310] Entering 
> initSecurity()
> 2006-05-15 18:09:06,705 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:43] entering getInstance()
> 2006-05-15 18:09:06,744 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:50] INSTANCE is null. Creating new instance...
> 2006-05-15 18:09:06,744 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:60] globusLocation: /usr/local/globus
> 2006-05-15 18:09:06,745 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:75] leaving getInstance()
> 2006-05-15 18:09:06,749 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,getUserHomeDirectory:515] Executing command:
> /usr/bin/perl -e print '' . (getpwnam('wenwen'))[7] . "\n"
> 2006-05-15 18:09:06,954 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initSecurity:347] resource 
> credential subject:
> null
> 2006-05-15 18:09:06,955 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initSecurity:355] setting resource 
> securty grid map...
> Subject: 
> /O=Grid/OU=GlobusTest/OU=simpleCA-srb.scs.gmu.edu/OU=scs.gmu.edu/CN=wenwen
> Local user ID: wenwen
> 2006-05-15 18:09:06,956 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initSecurity:365] Leaving 
> initSecurity()
> 2006-05-15 18:09:07,103 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initialize:192] at initVariableMap()
> 2006-05-15 18:09:07,104 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:43] entering getInstance()
> 2006-05-15 18:09:07,104 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:75] leaving getInstance()
> 2006-05-15 18:09:07,104 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,getUserHomeDirectory:515] Executing command:
> /usr/bin/perl -e print '' . (getpwnam('wenwen'))[7] . "\n"
> 2006-05-15 18:09:07,116 DEBUG factory.ManagedJobFactoryHome 
> [Thread-3,getHome:248] getHome() called
> 2006-05-15 18:09:07,117 DEBUG factory.ManagedJobFactoryHome 
> [Thread-3,getHome:254] getHome() returning 
> org.globus.exec.service.factory.ManagedJobFactoryHome at 29d65b
> 2006-05-15 18:09:07,121 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initVariableMap:630] 
> GLOBUS_SCRATCH_DIR:${GLOBUS_USER_HOME}/.globus/scratch
> 2006-05-15 18:09:07,197 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariables:702] Entering 
> resolveVariables()
> 2006-05-15 18:09:07,481 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1217] 
> resolving variables in attribute executable
> 2006-05-15 18:09:07,481 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1319] Final 
> string is /bin/true
> 2006-05-15 18:09:07,482 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1217] 
> resolving variables in attribute directory
> 2006-05-15 18:09:07,482 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1319] Final 
> string is /home/wenwen
> 2006-05-15 18:09:07,483 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1217] 
> resolving variables in attribute stdout
> 2006-05-15 18:09:07,483 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1319] Final 
> string is /dev/null
> 2006-05-15 18:09:07,484 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1217] 
> resolving variables in attribute stderr
> 2006-05-15 18:09:07,484 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1319] Final 
> string is /dev/null
> 2006-05-15 18:09:07,484 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariables:1198] Leaving 
> resolveVariables()
> 2006-05-15 18:09:07,488 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initialize:232] at 
> initPerlJobDescription()
> 2006-05-15 18:09:07,488 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:43] entering getInstance()
> 2006-05-15 18:09:07,492 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:75] leaving getInstance()
> 2006-05-15 18:09:07,496 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,getUserHomeDirectory:515] Executing command:
> /usr/bin/perl -e print '' . (getpwnam('wenwen'))[7] . "\n"
> 2006-05-15 18:09:07,508 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,getJobCredential:382] Entering 
> getJobCredential()
> 2006-05-15 18:09:07,509 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,getJobCredential:399] Leaving 
> getJobCredential()
> 2006-05-15 18:09:07,509 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:43] entering getInstance()
> 2006-05-15 18:09:07,510 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:75] leaving getInstance()
> 2006-05-15 18:09:07,510 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,getUserHomeDirectory:515] Executing command:
> /usr/bin/perl -e print '' . (getpwnam('wenwen'))[7] . "\n"
> 2006-05-15 18:09:07,746 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1217] 
> resolving variables in attribute environment
> 2006-05-15 18:09:07,746 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1222] 
> looking at string ${GLOBUS_USER_HOME}
> 2006-05-15 18:09:07,747 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1223] found 
> $ at index 0
> 2006-05-15 18:09:07,747 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1229] found 
> '{'---looks like a reference
> 2006-05-15 18:09:07,748 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1275] 
> looking up GLOBUS_USER_HOME in {GLOBUS_USER_HOME=/home/wenwen, 
> GLOBUS_USER_NAME=wenwen, GLOBUS_SCRATCH_DIR=${GLOBUS_USER_HOME}/.globus/scratch, 
> GLOBUS_LOCATION=/usr/local/globus}
> 2006-05-15 18:09:07,748 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1280] mapped 
> GLOBUS_USER_HOME to value /home/wenwen
> 2006-05-15 18:09:07,749 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1319] Final 
> string is /home/wenwen
> 2006-05-15 18:09:07,750 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1217] 
> resolving variables in attribute environment
> 2006-05-15 18:09:07,750 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1222] 
> looking at string ${GLOBUS_USER_NAME}
> 2006-05-15 18:09:07,750 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1223] found 
> $ at index 0
> 2006-05-15 18:09:07,751 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1229] found 
> '{'---looks like a reference
> 2006-05-15 18:09:07,995 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1275] 
> looking up GLOBUS_USER_NAME in {GLOBUS_USER_HOME=/home/wenwen, 
> GLOBUS_USER_NAME=wenwen, GLOBUS_SCRATCH_DIR=${GLOBUS_USER_HOME}/.globus/scratch, 
> GLOBUS_LOCATION=/usr/local/globus}
> 2006-05-15 18:09:07,995 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1280] mapped 
> GLOBUS_USER_NAME to value wenwen
> 2006-05-15 18:09:07,996 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,resolveVariableInString:1319] Final 
> string is wenwen
> 2006-05-15 18:09:07,999 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:49] processing 28 properties...
> 2006-05-15 18:09:07,999 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property argument...
> 2006-05-15 18:09:07,999 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property count...
> 2006-05-15 18:09:08,000 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property directory...
> 2006-05-15 18:09:08,001 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property environment...
> 2006-05-15 18:09:08,001 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property executable...
> 2006-05-15 18:09:08,001 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property extensions...
> 2006-05-15 18:09:08,004 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property factoryEndpoint...
> 2006-05-15 18:09:08,005 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property fileCleanUp...
> 2006-05-15 18:09:08,009 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property fileStageIn...
> 2006-05-15 18:09:08,009 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property fileStageOut...
> 2006-05-15 18:09:08,010 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property holdState...
> 2006-05-15 18:09:08,010 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property hostCount...
> 2006-05-15 18:09:08,010 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property jobCredentialEndpoint...
> 2006-05-15 18:09:08,012 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property jobType...
> 2006-05-15 18:09:08,012 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property libraryPath...
> 2006-05-15 18:09:08,012 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property localUserId...
> 2006-05-15 18:09:08,013 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property maxCpuTime...
> 2006-05-15 18:09:08,013 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property maxMemory...
> 2006-05-15 18:09:08,013 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property maxTime...
> 2006-05-15 18:09:08,014 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property maxWallTime...
> 2006-05-15 18:09:08,014 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property minMemory...
> 2006-05-15 18:09:08,261 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property project...
> 2006-05-15 18:09:08,264 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property queue...
> 2006-05-15 18:09:08,264 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property stagingCredentialEndpoint...
> 2006-05-15 18:09:08,265 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property stderr...
> 2006-05-15 18:09:08,265 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property stdin...
> 2006-05-15 18:09:08,265 DEBUG utils.JobDescriptionMap 
> [Thread-3,<init>:60] processing property stdout...
> 2006-05-15 18:09:08,266 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initExtraAttributes:539] Adding 
> extra attributes to the Perl job attribute map
> 2006-05-15 18:09:08,268 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:43] entering getInstance()
> 2006-05-15 18:09:08,268 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:75] leaving getInstance()
> 2006-05-15 18:09:08,282 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,getUserHomeDirectory:515] Executing command:
> /usr/bin/perl -e print '' . (getpwnam('wenwen'))[7] . "\n"
> 2006-05-15 18:09:08,527 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initExtraAttributes:563] checking 
> for condorness of Fork
> 2006-05-15 18:09:08,528 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name directory/directory
> 2006-05-15 18:09:08,529 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute directory is of type java.lang.String
> 2006-05-15 18:09:08,531 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name maxCpuTime/maxcputime
> 2006-05-15 18:09:08,531 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name condorOs/condoros
> 2006-05-15 18:09:08,532 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute condoros is of type java.lang.String
> 2006-05-15 18:09:08,532 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name fileStageIn/filestagein
> 2006-05-15 18:09:08,532 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name maxMemory/maxmemory
> 2006-05-15 18:09:08,533 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name minMemory/minmemory
> 2006-05-15 18:09:08,533 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name condorArch/condorarch
> 2006-05-15 18:09:08,533 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute condorarch is of type java.lang.String
> 2006-05-15 18:09:08,768 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name stderr/stderr
> 2006-05-15 18:09:08,768 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute stderr is of type java.lang.String
> 2006-05-15 18:09:08,769 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name environment/environment
> 2006-05-15 18:09:08,769 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute environment is of type 
> [Lorg.globus.exec.generated.NameValuePairType;
> 2006-05-15 18:09:08,770 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:180] Attribute environment has component type 
> org.globus.exec.generated.NameValuePairType
> 2006-05-15 18:09:08,770 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:186] Attribute environment being processed as NameValuePairType[]
> 2006-05-15 18:09:08,771 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name extensions/extensions
> 2006-05-15 18:09:08,771 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name 
> jobCredentialEndpoint/jobcredentialendpoint
> 2006-05-15 18:09:09,023 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name hostCount/hostcount
> 2006-05-15 18:09:09,023 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name queue/queue
> 2006-05-15 18:09:09,024 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name localUserId/localuserid
> 2006-05-15 18:09:09,024 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name arguments/arguments
> 2006-05-15 18:09:09,024 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name fileStageOut/filestageout
> 2006-05-15 18:09:09,025 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name executable/executable
> 2006-05-15 18:09:09,025 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute executable is of type java.lang.String
> 2006-05-15 18:09:09,025 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name 
> stagingCredentialEndpoint/stagingcredentialendpoint
> 2006-05-15 18:09:09,025 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name factoryEndpoint/factoryendpoint
> 2006-05-15 18:09:09,026 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute factoryendpoint is of type 
> org.apache.axis.message.addressing.EndpointReferenceType
> 2006-05-15 18:09:09,039 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name holdState/holdstate
> 2006-05-15 18:09:09,286 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name stdin/stdin
> 2006-05-15 18:09:09,286 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:151] appending stdin = /dev/null
> 2006-05-15 18:09:09,287 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name fileCleanUp/filecleanup
> 2006-05-15 18:09:09,287 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name jobdir/jobdir
> 2006-05-15 18:09:09,287 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute jobdir is of type java.lang.String
> 2006-05-15 18:09:09,288 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name jobType/jobtype
> 2006-05-15 18:09:09,288 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name stdout/stdout
> 2006-05-15 18:09:09,288 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute stdout is of type java.lang.String
> 2006-05-15 18:09:09,289 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name maxWallTime/maxwalltime
> 2006-05-15 18:09:09,289 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name project/project
> 2006-05-15 18:09:09,289 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name jobid/jobid
> 2006-05-15 18:09:09,290 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute jobid is of type java.lang.String
> 2006-05-15 18:09:09,290 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name count/count
> 2006-05-15 18:09:09,290 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute count is of type 
> org.apache.axis.types.PositiveInteger
> 2006-05-15 18:09:09,291 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name libraryPath/librarypath
> 2006-05-15 18:09:09,291 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name useForkStarter/useforkstarter
> 2006-05-15 18:09:09,294 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:172] Attribute useforkstarter is of type java.lang.String
> 2006-05-15 18:09:09,294 DEBUG exec.PerlJobDescription 
> [Thread-3,toPerlString:130] processing attribute name maxTime/maxtime
> 2006-05-15 18:09:09,294 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initialize:237] Perl Job 
> Description: $description = {
>     directory => [ '/home/wenwen' ],
>     condoros => [ 'LINUX' ],
>     condorarch => [ 'INTEL' ],
>     stderr => [ '/dev/null' ],
>     environment => [ [ 'GLOBUS_LOCATION', '/usr/local/globus' ], [ 
> 'X509_CERT_DIR', '/etc/grid-security/certificates' ], [ 'X509_USER_PROXY', 
> '' ], [ 'X509_USER_CERT', '' ], [ 'X509_USER_KEY', '' ], [ 'HOME', 
> '/home/wenwen' ], [ 'LOGNAME', 'wenwen' ], [ 'JAVA_HOME', 
> '/usr/java/j2sdk1.4.2_10/jre' ], [ 'GLOBUS_GRAM_JOB_HANDLE', 
> 'https://129.174.124.107:8443/wsrf/services/ManagedExecutableJobService?0afb530e-e45f-11da-89e2-00093d1067b1' 
> ],  ],
>     executable => [ '/bin/true' ],
>     factoryendpoint => [ 'Address: 
> https://localhost:8443/wsrf/services/ManagedJobFactoryService
> Reference property[0]:
> <ns5:ResourceID ns04:type="ns05:string" 
> xmlns:ns04="http://www.w3.org/2001/XMLSchema-instance" 
> xmlns:ns05="http://www.w3.org/2001/XMLSchema" 
> xmlns:ns5="http://www.globus.org/namespaces/2004/10/gram/job">Fork</ns5:ResourceID>
> ' ],
>     stdin => [ '/dev/null' ],
>     jobdir => [ 
> '/home/wenwen/.globus/0afb530e-e45f-11da-89e2-00093d1067b1' ],
>     jobtype => [ 'multiple' ],
>     stdout => [ '/dev/null' ],
>     jobid => [ '3389' ],
>     count => [ '1' ],
>     useforkstarter => [ '1' ],
> };
> 
> 2006-05-15 18:09:09,295 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:43] entering getInstance()
> 2006-05-15 18:09:09,295 DEBUG utils.GlobusShToolsProperties 
> [Thread-3,getInstance:75] leaving getInstance()
> 2006-05-15 18:09:09,295 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,getUserHomeDirectory:515] Executing command:
> /usr/bin/perl -e print '' . (getpwnam('wenwen'))[7] . "\n"
> 2006-05-15 18:09:09,307 DEBUG factory.ManagedJobFactoryHome 
> [Thread-3,getHome:248] getHome() called
> 2006-05-15 18:09:09,308 DEBUG factory.ManagedJobFactoryHome 
> [Thread-3,getHome:254] getHome() returning 
> org.globus.exec.service.factory.ManagedJobFactoryHome at 29d65b
> 2006-05-15 18:09:09,312 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initVariableMap:630] 
> GLOBUS_SCRATCH_DIR:${GLOBUS_USER_HOME}/.globus/scratch
> 2006-05-15 18:09:09,312 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,initialize:245] Leaving initialize()
> 2006-05-15 18:09:09,313 DEBUG utils.PersistenceHelper 
> [Thread-3,load:155] reconstructing topic listeners based on deserialized persisted 
> subscriptions
> 2006-05-15 18:09:09,313 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,getResourceDatum:212] getting resource 
> datum topicListener
> 2006-05-15 18:09:09,313 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,314 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,314 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,314 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-3,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,622 DEBUG utils.SubscriptionPersistenceUtils 
> [Thread-3,addSubscriptionListenersToTopics:158] Registered listener of 
> subscription key 0b3045f0-e45f-11da-89f6-a069a8718993 with topic starting 
> with {http://www.globus.org/namespaces/2004/10/gram/job/types}state
> 2006-05-15 18:09:09,623 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-3,setDirty:295] setting dirty flag to false
> 2006-05-15 18:09:09,623 DEBUG utils.PersistenceHelper 
> [Thread-3,load:176] done loading  resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> with state Unsubmitted
> 2006-05-15 18:09:09,624 DEBUG PersistenceHelper.performance 
> [Thread-3,stop:71] [load(ResourceKey)][Thread-3][4315]
> 2006-05-15 18:09:09,627 INFO  exec.ManagedExecutableJobHome 
> [Thread-3,recover:163] Recovered resource with ID 
> 0afb530e-e45f-11da-89e2-00093d1067b1.
> 2006-05-15 18:09:09,627 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,recover:185] Adding to RunQueue.
> 2006-05-15 18:09:09,632 INFO  exec.RunQueue [Thread-3,<clinit>:54] 
> Starting state machine with 16 run queues.
> 2006-05-15 18:09:09,635 DEBUG exec.RunQueue [Thread-3,add:100] Entering 
> add()
> 2006-05-15 18:09:09,635 DEBUG exec.RunQueue [Thread-3,add:104] adding 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> to queue.
> 2006-05-15 18:09:09,635 DEBUG exec.RunQueue [Thread-7,run:144] 
> Queue Graph: *
> 2006-05-15 18:09:09,635 DEBUG exec.RunQueue [Thread-7,run:152] 
> Processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:09,636 DEBUG exec.StateMachine 
> [Thread-7,processState:174] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Entering 
> processState()
> 2006-05-15 18:09:09,636 DEBUG exec.StateMachine 
> [Thread-7,processState:181] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Finding 
> resource reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:09,636 DEBUG exec.StateMachine 
> [Thread-7,processState:202] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Found resource 
> reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:09,637 DEBUG exec.RunQueue [Thread-3,add:112] Leaving 
> add()
> 2006-05-15 18:09:09,637 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:212] getting resource 
> datum internalState
> 2006-05-15 18:09:09,637 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,637 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,637 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,638 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,638 DEBUG exec.ManagedExecutableJobHome 
> [Thread-3,recover:193] Leaving recover()
> 2006-05-15 18:09:09,638 DEBUG factory.ManagedJobFactoryResource 
> [Thread-6,run:166] recovery thread finished
> 2006-05-15 18:09:09,638 DEBUG factory.ManagedJobFactoryResource 
> [Thread-3,run:166] recovery thread finished
> 2006-05-15 18:09:09,639 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:212] getting resource 
> datum canceled
> 2006-05-15 18:09:09,640 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,892 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,892 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,892 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,892 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:212] getting resource 
> datum userCancelRequested
> 2006-05-15 18:09:09,893 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,893 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,893 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,893 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,894 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:212] getting resource 
> datum systemCancelRequested
> 2006-05-15 18:09:09,894 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,894 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,894 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,894 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,895 DEBUG exec.StateMachine 
> [Thread-7,processState:308] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] processing 
> internal state Restart
> 2006-05-15 18:09:09,895 DEBUG exec.StateMachine 
> [Thread-7,processState:316] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] 
> ------------------------------------------------------
> PROCESSING INTERNAL STATE:  -- Restart --
> ------------------------------------------------------
> 2006-05-15 18:09:09,895 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:212] getting resource 
> datum notifiedJobData
> 2006-05-15 18:09:09,895 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,896 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,896 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,896 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,903 DEBUG exec.StateMachine 
> [Thread-7,processRestartState:594] Entering processRestartState()
> 2006-05-15 18:09:09,905 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:212] getting resource 
> datum restartInternalState
> 2006-05-15 18:09:09,905 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,905 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,905 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,906 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,906 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:212] getting resource 
> datum transferEndpoint
> 2006-05-15 18:09:09,906 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,907 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,907 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,907 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,910 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:212] getting resource 
> datum localJobId
> 2006-05-15 18:09:09,910 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,911 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:09,911 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:09,911 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:09,914 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-7,add:92] Entering add()
> 2006-05-15 18:09:09,915 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-7,add:98] adding 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> to queue.
> 2006-05-15 18:09:09,916 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-7,add:107] Leaving add()
> 2006-05-15 18:09:09,917 DEBUG utils.GlobusShToolsProperties 
> [Thread-7,getInstance:43] entering getInstance()
> 2006-05-15 18:09:09,917 DEBUG utils.GlobusShToolsProperties 
> [Thread-7,getInstance:75] leaving getInstance()
> 2006-05-15 18:09:09,919 DEBUG exec.ManagedExecutableJobHome 
> [Thread-7,getUserHomeDirectory:515] Executing command:
> /usr/bin/perl -e print '' . (getpwnam('wenwen'))[7] . "\n"
> 2006-05-15 18:09:09,932 DEBUG exec.StateMachine 
> [Thread-7,processRestartState:685] processRestartState with restartInternalState == 
> WaitingForStateChanges
> 2006-05-15 18:09:09,933 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:141] Setting resource 
> datum internalState to value WaitingForStateChanges
> 2006-05-15 18:09:09,933 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:09,934 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,171 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,172 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:09:10,172 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-7,setDirty:295] setting dirty flag to true
> 2006-05-15 18:09:10,172 DEBUG utils.PersistenceHelper 
> [Thread-7,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 with state Unsubmitted
> 2006-05-15 18:09:10,175 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:141] Setting resource 
> datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@126ba64
> 2006-05-15 18:09:10,175 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:10,176 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,176 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,176 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-7,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:09:10,182 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-23,subscribe:160] subscribing resource for JSM notifications
> 2006-05-15 18:09:10,183 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:212] getting resource 
> datum localJobId
> 2006-05-15 18:09:10,183 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:10,183 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,183 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,184 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:10,184 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-23,subscribe:168] Registering job ID 3389 for JSM subscriber 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:10,184 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getJobStateMonitor:1447] job 
> monitor is null
> 2006-05-15 18:09:10,184 DEBUG factory.ManagedJobFactoryHome 
> [Thread-23,getHome:248] getHome() called
> 2006-05-15 18:09:10,185 DEBUG factory.ManagedJobFactoryHome 
> [Thread-23,getHome:254] getHome() returning 
> org.globus.exec.service.factory.ManagedJobFactoryHome at 29d65b
> 2006-05-15 18:09:10,185 DEBUG monitoring.JobStateMonitor 
> [Thread-23,registerJobID:223] Entering registerJobID: 3389
> 2006-05-15 18:09:10,185 DEBUG monitoring.JobStateMonitor 
> [Thread-23,getCachedEvents:396] Entering getCachedEvents()
> 2006-05-15 18:09:10,442 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-7,setDirty:295] setting dirty flag to false
> 2006-05-15 18:09:10,442 DEBUG utils.PersistenceHelper 
> [Thread-7,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:10,442 DEBUG exec.StateMachine 
> [Thread-7,processNewState:2250] Adding to RunQueue.
> 2006-05-15 18:09:10,443 DEBUG exec.RunQueue [Thread-7,add:100] Entering 
> add()
> 2006-05-15 18:09:10,443 DEBUG exec.RunQueue [Thread-7,add:104] adding 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> to queue.
> 2006-05-15 18:09:10,443 DEBUG exec.RunQueue [Thread-8,run:144] 
> Queue Graph: *
> 2006-05-15 18:09:10,444 DEBUG exec.RunQueue [Thread-8,run:152] 
> Processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:10,444 DEBUG exec.StateMachine 
> [Thread-8,processState:174] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Entering 
> processState()
> 2006-05-15 18:09:10,444 DEBUG exec.StateMachine 
> [Thread-8,processState:181] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Finding 
> resource reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:10,444 DEBUG exec.StateMachine 
> [Thread-8,processState:202] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Found resource 
> reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:10,447 DEBUG monitoring.JobStateMonitor 
> [Thread-23,getCachedEvents:412] Exiting getCachedEvents()
> 2006-05-15 18:09:10,449 DEBUG monitoring.JobStateMonitor 
> [Thread-23,registerJobID:239] Exiting registerJobID
> 2006-05-15 18:09:10,450 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-23,subscribe:183] Exiting subscribeForNotifications()
> 2006-05-15 18:09:10,450 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-23,run:145] Done processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:10,468 DEBUG exec.RunQueue [Thread-7,add:112] Leaving 
> add()
> 2006-05-15 18:09:10,468 DEBUG exec.StateMachine 
> [Thread-7,processRestartState:691] Leaving processRestartState()
> 2006-05-15 18:09:10,469 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:212] getting resource 
> datum internalState
> 2006-05-15 18:09:10,469 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:10,469 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,469 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,469 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:10,470 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:212] getting resource 
> datum canceled
> 2006-05-15 18:09:10,470 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:10,470 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,473 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,473 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:10,473 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:212] getting resource 
> datum userCancelRequested
> 2006-05-15 18:09:10,474 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:10,474 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,474 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,474 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:10,474 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:212] getting resource 
> datum systemCancelRequested
> 2006-05-15 18:09:10,475 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:10,475 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,475 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,475 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:10,475 DEBUG exec.StateMachine 
> [Thread-8,processState:308] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] processing 
> internal state WaitingForStateChanges
> 2006-05-15 18:09:10,476 DEBUG exec.StateMachine 
> [Thread-8,processState:316] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] 
> ------------------------------------------------------
> PROCESSING INTERNAL STATE:  -- WaitingForStateChanges --
> ------------------------------------------------------
> 2006-05-15 18:09:10,476 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:212] getting resource 
> datum notifiedJobData
> 2006-05-15 18:09:10,476 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:10,476 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,477 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,477 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:10,477 DEBUG exec.StateMachine 
> [Thread-8,processWaitingForStateChangesState:1296] Entering 
> processWaitingForStateChangesState()
> 2006-05-15 18:09:10,477 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:212] getting resource 
> datum notifiedJobData
> 2006-05-15 18:09:10,478 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:09:10,478 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:09:10,481 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:09:10,481 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-8,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:09:10,481 DEBUG exec.StateMachine 
> [Thread-8,processState:376] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Leaving 
> processState()
> 2006-05-15 18:09:10,481 DEBUG exec.RunQueue [Thread-8,run:168] 
> processState returned
> 2006-05-15 18:09:10,482 DEBUG exec.RunQueue [Thread-8,run:173] Done 
> processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:09:10,478 DEBUG exec.StateMachine 
> [Thread-7,processState:376] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Leaving 
> processState()
> 2006-05-15 18:09:10,482 DEBUG exec.RunQueue [Thread-7,run:168] 
> processState returned
> 2006-05-15 18:09:10,482 DEBUG exec.RunQueue [Thread-7,run:173] Done 
> processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> Starting SOAP server at: https://129.174.124.107:8443/wsrf/services/ 
> With the following services:
> 
> [1]: https://129.174.124.107:8443/wsrf/services/TriggerFactoryService
> [2]: https://129.174.124.107:8443/wsrf/services/DelegationTestService
> [3]: https://129.174.124.107:8443/wsrf/services/SecureCounterService
> [4]: https://129.174.124.107:8443/wsrf/services/IndexServiceEntry
> [5]: https://129.174.124.107:8443/wsrf/services/DelegationService
> [6]: 
> https://129.174.124.107:8443/wsrf/services/InMemoryServiceGroupFactory
> [7]: 
> https://129.174.124.107:8443/wsrf/services/mds/test/execsource/IndexService
> [8]: 
> https://129.174.124.107:8443/wsrf/services/mds/test/subsource/IndexService
> [9]: 
> https://129.174.124.107:8443/wsrf/services/SubscriptionManagerService
> [10]: https://129.174.124.107:8443/wsrf/services/TestServiceWrongWSDL
> [11]: https://129.174.124.107:8443/wsrf/services/SampleAuthzService
> [12]: 
> https://129.174.124.107:8443/wsrf/services/WidgetNotificationService
> [13]: https://129.174.124.107:8443/wsrf/services/AdminService
> [14]: 
> https://129.174.124.107:8443/wsrf/services/DefaultIndexServiceEntry
> [15]: https://129.174.124.107:8443/wsrf/services/CounterService
> [16]: https://129.174.124.107:8443/wsrf/services/TestService
> [17]: https://129.174.124.107:8443/wsrf/services/InMemoryServiceGroup
> [18]: https://129.174.124.107:8443/wsrf/services/SecurityTestService
> [19]: 
> https://129.174.124.107:8443/wsrf/services/ContainerRegistryEntryService
> [20]: 
> https://129.174.124.107:8443/wsrf/services/NotificationConsumerFactoryService
> [21]: https://129.174.124.107:8443/wsrf/services/TestServiceRequest
> [22]: https://129.174.124.107:8443/wsrf/services/IndexFactoryService
> [23]: 
> https://129.174.124.107:8443/wsrf/services/ReliableFileTransferService
> [24]: 
> https://129.174.124.107:8443/wsrf/services/mds/test/subsource/IndexServiceEntry
> [25]: https://129.174.124.107:8443/wsrf/services/Version
> [26]: 
> https://129.174.124.107:8443/wsrf/services/NotificationConsumerService
> [27]: https://129.174.124.107:8443/wsrf/services/IndexService
> [28]: 
> https://129.174.124.107:8443/wsrf/services/NotificationTestService
> [29]: 
> https://129.174.124.107:8443/wsrf/services/ReliableFileTransferFactoryService
> [30]: 
> https://129.174.124.107:8443/wsrf/services/DefaultTriggerServiceEntry
> [31]: https://129.174.124.107:8443/wsrf/services/TriggerServiceEntry
> [32]: 
> https://129.174.124.107:8443/wsrf/services/PersistenceTestSubscriptionManager
> [33]: 
> https://129.174.124.107:8443/wsrf/services/mds/test/execsource/IndexServiceEntry
> [34]: https://129.174.124.107:8443/wsrf/services/DefaultTriggerService
> [35]: https://129.174.124.107:8443/wsrf/services/TriggerService
> [36]: 
> https://129.174.124.107:8443/wsrf/services/gsi/AuthenticationService
> [37]: https://129.174.124.107:8443/wsrf/services/TestRPCService
> [38]: https://129.174.124.107:8443/wsrf/services/ManagedMultiJobService
> [39]: 
> https://129.174.124.107:8443/wsrf/services/RendezvousFactoryService
> [40]: https://129.174.124.107:8443/wsrf/services/WidgetService
> [41]: https://129.174.124.107:8443/wsrf/services/ManagementService
> [42]: 
> https://129.174.124.107:8443/wsrf/services/ManagedExecutableJobService
> [43]: 
> https://129.174.124.107:8443/wsrf/services/InMemoryServiceGroupEntry
> [44]: 
> https://129.174.124.107:8443/wsrf/services/AuthzCalloutTestService
> [45]: 
> https://129.174.124.107:8443/wsrf/services/DelegationFactoryService
> [46]: https://129.174.124.107:8443/wsrf/services/DefaultIndexService
> [47]: https://129.174.124.107:8443/wsrf/services/ShutdownService
> [48]: 
> https://129.174.124.107:8443/wsrf/services/ContainerRegistryService
> [49]: https://129.174.124.107:8443/wsrf/services/TestAuthzService
> [50]: https://129.174.124.107:8443/wsrf/services/CASService
> [51]: 
> https://129.174.124.107:8443/wsrf/services/ManagedJobFactoryService
> 2006-05-15 18:09:36,169 INFO  impl.DefaultIndexService 
> [ServiceThread-28,processConfigFile:107] Reading default registration configuration 
> from file: /usr/local/globus/etc/globus_wsrf_mds_index/hierarchy.xml
> 2006-05-15 18:10:05,267 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:10:05,268 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:10:06,177 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:10:06,177 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:10:16,410 DEBUG utils.PersistenceHelper 
> [ServiceThread-28,store:77] Dirty flag not set: resource will not be stored
> 2006-05-15 18:10:17,361 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getSecurityDescriptor:1579] 
> MJR security descriptor authz: gridmap
> 2006-05-15 18:10:17,363 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getSecurityDescriptor:1579] 
> MJR security descriptor authz: gridmap
> 2006-05-15 18:10:17,363 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getSecurityDescriptor:1579] 
> MJR security descriptor authz: gridmap
> 2006-05-15 18:10:17,364 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getSecurityDescriptor:1579] 
> MJR security descriptor authz: gridmap
> 2006-05-15 18:10:17,364 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getSecurityDescriptor:1579] 
> MJR security descriptor authz: gridmap
> 2006-05-15 18:10:17,365 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,remove:260] acquring lock on 
> resource...
> 2006-05-15 18:10:17,366 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,remove:262] acquired lock on 
> resource...
> 2006-05-15 18:10:17,366 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:212] getting 
> resource datum canceled
> 2006-05-15 18:10:17,367 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:218] Obtaining 
> lock on resourceData
> 2006-05-15 18:10:17,370 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:221] Obtained 
> lock on resourceData
> 2006-05-15 18:10:17,370 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:261] Releasing 
> lock on resourceData
> 2006-05-15 18:10:17,371 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:263] Released 
> lock on resourceData
> 2006-05-15 18:10:17,371 DEBUG utils.JobStateMonitorSubscriptionManager 
> [ServiceThread-27,add:92] Entering add()
> 2006-05-15 18:10:17,372 DEBUG utils.JobStateMonitorSubscriptionManager 
> [ServiceThread-27,add:98] adding 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> to queue.
> 2006-05-15 18:10:17,372 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-23,unsubscribe:191] unsubscribing resource for JSM 
> notifications
> 2006-05-15 18:10:17,372 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:212] getting resource 
> datum localJobId
> 2006-05-15 18:10:17,372 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,373 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,373 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,373 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-23,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,373 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-23,unsubscribe:203] Unregistering job ID from JSM subscribers
> 2006-05-15 18:10:17,373 DEBUG monitoring.JobStateMonitor 
> [Thread-23,unregisterJobID:429] Entering unregisterJobID: 3389
> 2006-05-15 18:10:17,374 DEBUG monitoring.JobStateMonitor 
> [Thread-23,unregisterJobID:439] Exiting unregisterJobID()
> 2006-05-15 18:10:17,374 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-23,unsubscribe:211] Job ID Unregistered.
> 2006-05-15 18:10:17,374 DEBUG utils.JobStateMonitorSubscriptionManager 
> [Thread-23,run:145] Done processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,374 DEBUG utils.JobStateMonitorSubscriptionManager 
> [ServiceThread-27,add:107] Leaving add()
> 2006-05-15 18:10:17,380 DEBUG utils.FaultUtils 
> [ServiceThread-27,makeFault:460] Fault Class: class org.globus.exec.generated.FaultType
> 2006-05-15 18:10:17,381 DEBUG utils.FaultUtils 
> [ServiceThread-27,makeFault:461] Resource Key: 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,381 DEBUG utils.FaultUtils 
> [ServiceThread-27,makeFault:462] Description: The job was canceled by the user.
> 2006-05-15 18:10:17,382 DEBUG utils.FaultUtils 
> [ServiceThread-27,makeFault:463] Cause: null
> 2006-05-15 18:10:17,382 DEBUG utils.FaultUtils 
> [ServiceThread-27,makeFault:464] State when failure occurred Unsubmitted
> 2006-05-15 18:10:17,383 DEBUG utils.FaultUtils 
> [ServiceThread-27,makeFault:466] Script Command: null
> 2006-05-15 18:10:17,383 DEBUG utils.FaultUtils 
> [ServiceThread-27,makeFault:467] GT2 Error Code: 0
> 2006-05-15 18:10:17,388 DEBUG utils.FaultUtils 
> [ServiceThread-27,makeFault:519] Script Command: null
> 2006-05-15 18:10:17,388 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setFault:341] fault element name: 
> FaultType
> 2006-05-15 18:10:17,391 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setFault:345] fault element name: 
> Fault
> 2006-05-15 18:10:17,392 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setFault:348] fault element name: 
> fault
> 2006-05-15 18:10:17,393 DEBUG 
> exec.PersistentManagedExecutableJobResource [ServiceThread-27,setDirty:295] setting dirty flag to true
> 2006-05-15 18:10:17,393 DEBUG utils.PersistenceHelper 
> [ServiceThread-27,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> with state Unsubmitted
> 2006-05-15 18:10:17,394 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:141] Setting 
> resource datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@1dbe135
> 2006-05-15 18:10:17,394 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:146] Obtaining 
> lock on resourceData
> 2006-05-15 18:10:17,395 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:149] Obtained 
> lock on resourceData
> 2006-05-15 18:10:17,395 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:190] Releasing 
> lock on resourceData
> 2006-05-15 18:10:17,396 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:192] Released 
> lock on resourceData
> 2006-05-15 18:10:17,406 DEBUG 
> exec.PersistentManagedExecutableJobResource [ServiceThread-27,setDirty:295] setting dirty flag to false
> 2006-05-15 18:10:17,407 DEBUG utils.PersistenceHelper 
> [ServiceThread-27,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,407 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:212] getting 
> resource datum started
> 2006-05-15 18:10:17,407 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:218] Obtaining 
> lock on resourceData
> 2006-05-15 18:10:17,408 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:221] Obtained 
> lock on resourceData
> 2006-05-15 18:10:17,408 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:261] Releasing 
> lock on resourceData
> 2006-05-15 18:10:17,409 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:263] Released 
> lock on resourceData
> 2006-05-15 18:10:17,412 DEBUG exec.StateMachine 
> [ServiceThread-27,cancel:453] Entering cancel()
> 2006-05-15 18:10:17,412 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:212] getting 
> resource datum canceled
> 2006-05-15 18:10:17,412 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:218] Obtaining 
> lock on resourceData
> 2006-05-15 18:10:17,413 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:221] Obtained 
> lock on resourceData
> 2006-05-15 18:10:17,413 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:261] Releasing 
> lock on resourceData
> 2006-05-15 18:10:17,414 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,getResourceDatum:263] Released 
> lock on resourceData
> 2006-05-15 18:10:17,415 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:141] Setting 
> resource datum userCancelRequested to value true
> 2006-05-15 18:10:17,415 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:146] Obtaining 
> lock on resourceData
> 2006-05-15 18:10:17,415 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:149] Obtained 
> lock on resourceData
> 2006-05-15 18:10:17,416 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:190] Releasing 
> lock on resourceData
> 2006-05-15 18:10:17,416 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:192] Released 
> lock on resourceData
> 2006-05-15 18:10:17,417 DEBUG 
> exec.PersistentManagedExecutableJobResource [ServiceThread-27,setDirty:295] setting dirty flag to true
> 2006-05-15 18:10:17,417 DEBUG utils.PersistenceHelper 
> [ServiceThread-27,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> with state Unsubmitted
> 2006-05-15 18:10:17,418 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:141] Setting 
> resource datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@132b038
> 2006-05-15 18:10:17,418 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:146] Obtaining 
> lock on resourceData
> 2006-05-15 18:10:17,419 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:149] Obtained 
> lock on resourceData
> 2006-05-15 18:10:17,419 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:190] Releasing 
> lock on resourceData
> 2006-05-15 18:10:17,419 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,setResourceDatum:192] Released 
> lock on resourceData
> 2006-05-15 18:10:17,432 DEBUG 
> exec.PersistentManagedExecutableJobResource [ServiceThread-27,setDirty:295] setting dirty flag to false
> 2006-05-15 18:10:17,433 DEBUG utils.PersistenceHelper 
> [ServiceThread-27,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,433 DEBUG exec.StateMachine 
> [ServiceThread-27,cancel:468] Adding to RunQueue.
> 2006-05-15 18:10:17,434 DEBUG exec.RunQueue [ServiceThread-27,add:100] 
> Entering add()
> 2006-05-15 18:10:17,434 DEBUG exec.RunQueue [ServiceThread-27,add:104] 
> adding 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 to queue.
> 2006-05-15 18:10:17,434 DEBUG exec.RunQueue [ServiceThread-27,add:112] 
> Leaving add()
> 2006-05-15 18:10:17,435 DEBUG exec.RunQueue [Thread-9,run:144] 
> Queue Graph: *
> 2006-05-15 18:10:17,435 DEBUG exec.StateMachine 
> [ServiceThread-27,cancel:477] Leaving cancel()
> 2006-05-15 18:10:17,435 DEBUG exec.RunQueue [Thread-9,run:152] 
> Processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,436 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,remove:278] Remove called 
> with external state Unsubmitted and internal state WaitingForStateChanges
> 2006-05-15 18:10:17,436 DEBUG exec.StateMachine 
> [Thread-9,processState:174] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Entering 
> processState()
> 2006-05-15 18:10:17,436 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,remove:286] Waiting to be 
> Done or Failed. Current state: WaitingForStateChanges
> 2006-05-15 18:10:17,436 DEBUG exec.StateMachine 
> [Thread-9,processState:181] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Finding 
> resource reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,437 DEBUG exec.StateMachine 
> [Thread-9,processState:202] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Found resource 
> reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,437 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:212] getting resource 
> datum internalState
> 2006-05-15 18:10:17,437 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,438 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,438 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,438 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,438 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:212] getting resource 
> datum canceled
> 2006-05-15 18:10:17,438 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,438 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,439 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,439 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,439 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:212] getting resource 
> datum userCancelRequested
> 2006-05-15 18:10:17,439 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,439 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,439 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,440 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,440 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:212] getting resource 
> datum systemCancelRequested
> 2006-05-15 18:10:17,440 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,441 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,442 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,443 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,443 DEBUG exec.StateMachine 
> [Thread-9,processState:285] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Setting 
> internal state to UserCancel
> 2006-05-15 18:10:17,443 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:141] Setting resource 
> datum internalState to value UserCancel
> 2006-05-15 18:10:17,443 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,443 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,444 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,444 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,444 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-9,setDirty:295] setting dirty flag to true
> 2006-05-15 18:10:17,446 DEBUG utils.PersistenceHelper 
> [Thread-9,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 with state Unsubmitted
> 2006-05-15 18:10:17,447 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:141] Setting resource 
> datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@1e8614a
> 2006-05-15 18:10:17,447 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,447 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,447 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,448 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,459 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-9,setDirty:295] setting dirty flag to false
> 2006-05-15 18:10:17,459 DEBUG utils.PersistenceHelper 
> [Thread-9,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,459 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:141] Setting resource 
> datum canceled to value true
> 2006-05-15 18:10:17,459 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,460 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,460 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,460 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,460 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-9,setDirty:295] setting dirty flag to true
> 2006-05-15 18:10:17,460 DEBUG utils.PersistenceHelper 
> [Thread-9,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 with state Unsubmitted
> 2006-05-15 18:10:17,461 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:141] Setting resource 
> datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@18eb00c
> 2006-05-15 18:10:17,461 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,461 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,461 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,461 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,469 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-9,setDirty:295] setting dirty flag to false
> 2006-05-15 18:10:17,469 DEBUG utils.PersistenceHelper 
> [Thread-9,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,469 DEBUG exec.StateMachine 
> [Thread-9,processState:308] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] processing 
> internal state UserCancel
> 2006-05-15 18:10:17,469 DEBUG exec.StateMachine 
> [Thread-9,processState:316] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] 
> ------------------------------------------------------
> PROCESSING INTERNAL STATE:  -- UserCancel --
> ------------------------------------------------------
> 2006-05-15 18:10:17,470 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:212] getting resource 
> datum notifiedJobData
> 2006-05-15 18:10:17,470 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,470 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,471 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,471 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,472 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name directory/directory
> 2006-05-15 18:10:17,473 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute directory is of type java.lang.String
> 2006-05-15 18:10:17,475 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name maxCpuTime/maxcputime
> 2006-05-15 18:10:17,475 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name condorOs/condoros
> 2006-05-15 18:10:17,475 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute condoros is of type java.lang.String
> 2006-05-15 18:10:17,475 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name fileStageIn/filestagein
> 2006-05-15 18:10:17,475 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name maxMemory/maxmemory
> 2006-05-15 18:10:17,476 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name minMemory/minmemory
> 2006-05-15 18:10:17,476 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name condorArch/condorarch
> 2006-05-15 18:10:17,476 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute condorarch is of type java.lang.String
> 2006-05-15 18:10:17,476 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name stderr/stderr
> 2006-05-15 18:10:17,477 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute stderr is of type java.lang.String
> 2006-05-15 18:10:17,477 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name environment/environment
> 2006-05-15 18:10:17,477 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute environment is of type 
> [Lorg.globus.exec.generated.NameValuePairType;
> 2006-05-15 18:10:17,477 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:180] Attribute environment has component type 
> org.globus.exec.generated.NameValuePairType
> 2006-05-15 18:10:17,477 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:186] Attribute environment being processed as NameValuePairType[]
> 2006-05-15 18:10:17,478 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name extensions/extensions
> 2006-05-15 18:10:17,478 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name 
> jobCredentialEndpoint/jobcredentialendpoint
> 2006-05-15 18:10:17,478 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name hostCount/hostcount
> 2006-05-15 18:10:17,478 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name queue/queue
> 2006-05-15 18:10:17,479 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name localUserId/localuserid
> 2006-05-15 18:10:17,479 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name arguments/arguments
> 2006-05-15 18:10:17,479 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name fileStageOut/filestageout
> 2006-05-15 18:10:17,479 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name executable/executable
> 2006-05-15 18:10:17,480 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute executable is of type java.lang.String
> 2006-05-15 18:10:17,480 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name 
> stagingCredentialEndpoint/stagingcredentialendpoint
> 2006-05-15 18:10:17,480 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name factoryEndpoint/factoryendpoint
> 2006-05-15 18:10:17,480 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute factoryendpoint is of type 
> org.apache.axis.message.addressing.EndpointReferenceType
> 2006-05-15 18:10:17,483 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name holdState/holdstate
> 2006-05-15 18:10:17,483 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name stdin/stdin
> 2006-05-15 18:10:17,483 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:151] appending stdin = /dev/null
> 2006-05-15 18:10:17,485 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name fileCleanUp/filecleanup
> 2006-05-15 18:10:17,485 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name jobdir/jobdir
> 2006-05-15 18:10:17,486 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute jobdir is of type java.lang.String
> 2006-05-15 18:10:17,486 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name jobType/jobtype
> 2006-05-15 18:10:17,486 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name stdout/stdout
> 2006-05-15 18:10:17,486 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute stdout is of type java.lang.String
> 2006-05-15 18:10:17,488 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name maxWallTime/maxwalltime
> 2006-05-15 18:10:17,489 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name project/project
> 2006-05-15 18:10:17,489 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name jobid/jobid
> 2006-05-15 18:10:17,489 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute jobid is of type java.lang.String
> 2006-05-15 18:10:17,489 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name count/count
> 2006-05-15 18:10:17,490 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute count is of type 
> org.apache.axis.types.PositiveInteger
> 2006-05-15 18:10:17,490 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name libraryPath/librarypath
> 2006-05-15 18:10:17,490 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name useForkStarter/useforkstarter
> 2006-05-15 18:10:17,490 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:172] Attribute useforkstarter is of type java.lang.String
> 2006-05-15 18:10:17,491 DEBUG exec.PerlJobDescription 
> [Thread-9,toPerlString:130] processing attribute name maxTime/maxtime
> 2006-05-15 18:10:17,491 DEBUG exec.StateMachine 
> [Thread-9,runScript:2646] Perl Job Description: $description = {
>     directory => [ '/home/wenwen' ],
>     condoros => [ 'LINUX' ],
>     condorarch => [ 'INTEL' ],
>     stderr => [ '/dev/null' ],
>     environment => [ [ 'GLOBUS_LOCATION', '/usr/local/globus' ], [ 
> 'X509_CERT_DIR', '/etc/grid-security/certificates' ], [ 'X509_USER_PROXY', 
> '' ], [ 'X509_USER_CERT', '' ], [ 'X509_USER_KEY', '' ], [ 'HOME', 
> '/home/wenwen' ], [ 'LOGNAME', 'wenwen' ], [ 'JAVA_HOME', 
> '/usr/java/j2sdk1.4.2_10/jre' ], [ 'GLOBUS_GRAM_JOB_HANDLE', 
> 'https://129.174.124.107:8443/wsrf/services/ManagedExecutableJobService?0afb530e-e45f-11da-89e2-00093d1067b1' 
> ],  ],
>     executable => [ '/bin/true' ],
>     factoryendpoint => [ 'Address: 
> https://localhost:8443/wsrf/services/ManagedJobFactoryService
> Reference property[0]:
> <ns5:ResourceID ns04:type="ns05:string" 
> xmlns:ns04="http://www.w3.org/2001/XMLSchema-instance" 
> xmlns:ns05="http://www.w3.org/2001/XMLSchema" 
> xmlns:ns5="http://www.globus.org/namespaces/2004/10/gram/job">Fork</ns5:ResourceID>
> ' ],
>     stdin => [ '/dev/null' ],
>     jobdir => [ 
> '/home/wenwen/.globus/0afb530e-e45f-11da-89e2-00093d1067b1' ],
>     jobtype => [ 'multiple' ],
>     stdout => [ '/dev/null' ],
>     jobid => [ '3389' ],
>     count => [ '1' ],
>     useforkstarter => [ '1' ],
> };
> 
> 2006-05-15 18:10:17,494 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:212] getting resource 
> datum localResourceManager
> 2006-05-15 18:10:17,495 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,495 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,495 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,496 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,496 DEBUG exec.JobManagerScript 
> [Thread-9,<init>:108] Initializing script thread
> 2006-05-15 18:10:17,511 DEBUG utils.GlobusShToolsProperties 
> [Thread-9,getInstance:43] entering getInstance()
> 2006-05-15 18:10:17,511 DEBUG utils.GlobusShToolsProperties 
> [Thread-9,getInstance:75] leaving getInstance()
> 2006-05-15 18:10:17,512 DEBUG exec.StateMachine 
> [Thread-9,runScript:2661] running script cancel
> 2006-05-15 18:10:17,512 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:141] Setting resource 
> datum internalState to value FailureFileCleanUp
> 2006-05-15 18:10:17,513 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,513 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,513 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,514 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,514 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-9,setDirty:295] setting dirty flag to true
> 2006-05-15 18:10:17,514 DEBUG utils.PersistenceHelper 
> [Thread-9,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 with state Unsubmitted
> 2006-05-15 18:10:17,517 DEBUG exec.JobManagerScript [Thread-32,run:187] 
> Executing command:
> /usr/bin/sudo -H -u wenwen -S 
> /usr/local/globus/libexec/globus-gridmap-and-execute -g /etc/grid-security/grid-mapfile 
> /usr/local/globus/libexec/globus-job-manager-script.pl -m fork -f 
> /usr/local/globus/tmp/gram_job_mgr17483.tmp -c cancel
> 2006-05-15 18:10:17,517 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:141] Setting resource 
> datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@1f49969
> 2006-05-15 18:10:17,518 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,524 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,525 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,525 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-9,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,535 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-9,setDirty:295] setting dirty flag to false
> 2006-05-15 18:10:17,535 DEBUG utils.PersistenceHelper 
> [Thread-9,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,535 DEBUG exec.StateMachine 
> [Thread-9,processNewState:2250] Adding to RunQueue.
> 2006-05-15 18:10:17,536 DEBUG exec.RunQueue [Thread-9,add:100] Entering 
> add()
> 2006-05-15 18:10:17,536 DEBUG exec.RunQueue [Thread-9,add:104] adding 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> to queue.
> 2006-05-15 18:10:17,536 DEBUG exec.RunQueue [Thread-10,run:144] 
> Queue Graph: *
> 2006-05-15 18:10:17,536 DEBUG exec.RunQueue [Thread-10,run:152] 
> Processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,537 DEBUG exec.StateMachine 
> [Thread-10,processState:174] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Entering 
> processState()
> 2006-05-15 18:10:17,537 DEBUG exec.StateMachine 
> [Thread-10,processState:181] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Finding 
> resource reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,537 DEBUG exec.StateMachine 
> [Thread-10,processState:202] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Found resource 
> reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,537 DEBUG exec.RunQueue [Thread-9,add:112] Leaving 
> add()
> 2006-05-15 18:10:17,538 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:212] getting resource 
> datum internalState
> 2006-05-15 18:10:17,538 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,538 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,539 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,539 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,539 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:212] getting resource 
> datum canceled
> 2006-05-15 18:10:17,539 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,539 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,540 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,540 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,540 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:212] getting resource 
> datum userCancelRequested
> 2006-05-15 18:10:17,540 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,540 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,540 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,541 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,541 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:212] getting resource 
> datum systemCancelRequested
> 2006-05-15 18:10:17,541 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,541 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,541 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,542 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,542 DEBUG exec.StateMachine 
> [Thread-10,processState:308] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] processing 
> internal state FailureFileCleanUp
> 2006-05-15 18:10:17,542 DEBUG exec.StateMachine 
> [Thread-10,processState:316] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] 
> ------------------------------------------------------
> PROCESSING INTERNAL STATE:  -- FailureFileCleanUp --
> ------------------------------------------------------
> 2006-05-15 18:10:17,542 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:212] getting resource 
> datum notifiedJobData
> 2006-05-15 18:10:17,542 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,542 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,543 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,547 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,548 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:141] Setting resource 
> datum internalState to value FailureCacheCleanUp
> 2006-05-15 18:10:17,548 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,548 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,549 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,549 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,549 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-10,setDirty:295] setting dirty flag to true
> 2006-05-15 18:10:17,549 DEBUG utils.PersistenceHelper 
> [Thread-10,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 with state Unsubmitted
> 2006-05-15 18:10:17,550 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:141] Setting resource 
> datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@183e895
> 2006-05-15 18:10:17,550 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,550 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,550 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,551 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-10,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,561 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-10,setDirty:295] setting dirty flag to false
> 2006-05-15 18:10:17,561 DEBUG utils.PersistenceHelper 
> [Thread-10,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,561 DEBUG exec.StateMachine 
> [Thread-10,processNewState:2250] Adding to RunQueue.
> 2006-05-15 18:10:17,561 DEBUG exec.RunQueue [Thread-10,add:100] 
> Entering add()
> 2006-05-15 18:10:17,562 DEBUG exec.RunQueue [Thread-10,add:104] adding 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> to queue.
> 2006-05-15 18:10:17,562 DEBUG exec.RunQueue [Thread-10,add:112] Leaving 
> add()
> 2006-05-15 18:10:17,562 DEBUG exec.StateMachine 
> [Thread-10,processState:376] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Leaving 
> processState()
> 2006-05-15 18:10:17,562 DEBUG exec.RunQueue [Thread-10,run:168] 
> processState returned
> 2006-05-15 18:10:17,562 DEBUG exec.RunQueue [Thread-10,run:173] Done 
> processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,562 DEBUG exec.RunQueue [Thread-11,run:144] 
> Queue Graph: *
> 2006-05-15 18:10:17,563 DEBUG exec.RunQueue [Thread-11,run:152] 
> Processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,563 DEBUG exec.StateMachine 
> [Thread-11,processState:174] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Entering 
> processState()
> 2006-05-15 18:10:17,563 DEBUG exec.StateMachine 
> [Thread-11,processState:181] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Finding 
> resource reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,563 DEBUG exec.StateMachine 
> [Thread-11,processState:202] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Found resource 
> reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,563 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:212] getting resource 
> datum internalState
> 2006-05-15 18:10:17,563 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,564 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,564 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,566 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,567 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:212] getting resource 
> datum canceled
> 2006-05-15 18:10:17,567 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,567 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,567 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,567 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,567 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:212] getting resource 
> datum userCancelRequested
> 2006-05-15 18:10:17,568 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,568 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,568 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,568 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,568 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:212] getting resource 
> datum systemCancelRequested
> 2006-05-15 18:10:17,568 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,569 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,569 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,569 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,569 DEBUG exec.StateMachine 
> [Thread-11,processState:308] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] processing 
> internal state FailureCacheCleanUp
> 2006-05-15 18:10:17,569 DEBUG exec.StateMachine 
> [Thread-11,processState:316] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] 
> ------------------------------------------------------
> PROCESSING INTERNAL STATE:  -- FailureCacheCleanUp --
> ------------------------------------------------------
> 2006-05-15 18:10:17,569 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:212] getting resource 
> datum notifiedJobData
> 2006-05-15 18:10:17,570 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,570 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,570 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,570 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,570 DEBUG exec.StateMachine 
> [Thread-11,processFailureCacheCleanUpState:1976] Entering processFailureCacheCleanUpState()
> 2006-05-15 18:10:17,571 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name directory/directory
> 2006-05-15 18:10:17,571 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute directory is of type java.lang.String
> 2006-05-15 18:10:17,571 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name maxCpuTime/maxcputime
> 2006-05-15 18:10:17,571 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name condorOs/condoros
> 2006-05-15 18:10:17,572 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute condoros is of type java.lang.String
> 2006-05-15 18:10:17,572 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name fileStageIn/filestagein
> 2006-05-15 18:10:17,572 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name maxMemory/maxmemory
> 2006-05-15 18:10:17,572 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name minMemory/minmemory
> 2006-05-15 18:10:17,573 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name condorArch/condorarch
> 2006-05-15 18:10:17,573 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute condorarch is of type java.lang.String
> 2006-05-15 18:10:17,573 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name stderr/stderr
> 2006-05-15 18:10:17,573 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute stderr is of type java.lang.String
> 2006-05-15 18:10:17,573 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name environment/environment
> 2006-05-15 18:10:17,574 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute environment is of type 
> [Lorg.globus.exec.generated.NameValuePairType;
> 2006-05-15 18:10:17,574 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:180] Attribute environment has component type 
> org.globus.exec.generated.NameValuePairType
> 2006-05-15 18:10:17,574 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:186] Attribute environment being processed as 
> NameValuePairType[]
> 2006-05-15 18:10:17,574 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name extensions/extensions
> 2006-05-15 18:10:17,575 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name 
> jobCredentialEndpoint/jobcredentialendpoint
> 2006-05-15 18:10:17,575 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name hostCount/hostcount
> 2006-05-15 18:10:17,575 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name queue/queue
> 2006-05-15 18:10:17,577 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name localUserId/localuserid
> 2006-05-15 18:10:17,577 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name arguments/arguments
> 2006-05-15 18:10:17,578 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name fileStageOut/filestageout
> 2006-05-15 18:10:17,578 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name executable/executable
> 2006-05-15 18:10:17,578 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute executable is of type java.lang.String
> 2006-05-15 18:10:17,578 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name 
> stagingCredentialEndpoint/stagingcredentialendpoint
> 2006-05-15 18:10:17,578 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name factoryEndpoint/factoryendpoint
> 2006-05-15 18:10:17,579 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute factoryendpoint is of type 
> org.apache.axis.message.addressing.EndpointReferenceType
> 2006-05-15 18:10:17,581 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name holdState/holdstate
> 2006-05-15 18:10:17,582 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name stdin/stdin
> 2006-05-15 18:10:17,582 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:151] appending stdin = /dev/null
> 2006-05-15 18:10:17,582 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name fileCleanUp/filecleanup
> 2006-05-15 18:10:17,582 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name jobdir/jobdir
> 2006-05-15 18:10:17,582 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute jobdir is of type java.lang.String
> 2006-05-15 18:10:17,583 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name jobType/jobtype
> 2006-05-15 18:10:17,583 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name stdout/stdout
> 2006-05-15 18:10:17,583 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute stdout is of type java.lang.String
> 2006-05-15 18:10:17,583 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name maxWallTime/maxwalltime
> 2006-05-15 18:10:17,584 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name project/project
> 2006-05-15 18:10:17,584 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name jobid/jobid
> 2006-05-15 18:10:17,584 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute jobid is of type java.lang.String
> 2006-05-15 18:10:17,584 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name count/count
> 2006-05-15 18:10:17,584 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute count is of type 
> org.apache.axis.types.PositiveInteger
> 2006-05-15 18:10:17,585 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name libraryPath/librarypath
> 2006-05-15 18:10:17,585 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name useForkStarter/useforkstarter
> 2006-05-15 18:10:17,585 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:172] Attribute useforkstarter is of type java.lang.String
> 2006-05-15 18:10:17,585 DEBUG exec.PerlJobDescription 
> [Thread-11,toPerlString:130] processing attribute name maxTime/maxtime
> 2006-05-15 18:10:17,586 DEBUG exec.StateMachine 
> [Thread-11,runScript:2646] Perl Job Description: $description = {
>     directory => [ '/home/wenwen' ],
>     condoros => [ 'LINUX' ],
>     condorarch => [ 'INTEL' ],
>     stderr => [ '/dev/null' ],
>     environment => [ [ 'GLOBUS_LOCATION', '/usr/local/globus' ], [ 
> 'X509_CERT_DIR', '/etc/grid-security/certificates' ], [ 'X509_USER_PROXY', 
> '' ], [ 'X509_USER_CERT', '' ], [ 'X509_USER_KEY', '' ], [ 'HOME', 
> '/home/wenwen' ], [ 'LOGNAME', 'wenwen' ], [ 'JAVA_HOME', 
> '/usr/java/j2sdk1.4.2_10/jre' ], [ 'GLOBUS_GRAM_JOB_HANDLE', 
> 'https://129.174.124.107:8443/wsrf/services/ManagedExecutableJobService?0afb530e-e45f-11da-89e2-00093d1067b1' 
> ],  ],
>     executable => [ '/bin/true' ],
>     factoryendpoint => [ 'Address: 
> https://localhost:8443/wsrf/services/ManagedJobFactoryService
> Reference property[0]:
> <ns5:ResourceID ns04:type="ns05:string" 
> xmlns:ns04="http://www.w3.org/2001/XMLSchema-instance" 
> xmlns:ns05="http://www.w3.org/2001/XMLSchema" 
> xmlns:ns5="http://www.globus.org/namespaces/2004/10/gram/job">Fork</ns5:ResourceID>
> ' ],
>     stdin => [ '/dev/null' ],
>     jobdir => [ 
> '/home/wenwen/.globus/0afb530e-e45f-11da-89e2-00093d1067b1' ],
>     jobtype => [ 'multiple' ],
>     stdout => [ '/dev/null' ],
>     jobid => [ '3389' ],
>     count => [ '1' ],
>     useforkstarter => [ '1' ],
> };
> 
> 2006-05-15 18:10:17,586 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:212] getting resource 
> datum localResourceManager
> 2006-05-15 18:10:17,588 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,589 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,589 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,589 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,547 DEBUG exec.StateMachine 
> [Thread-9,processState:376] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Leaving 
> processState()
> 2006-05-15 18:10:17,590 DEBUG exec.RunQueue [Thread-9,run:168] 
> processState returned
> 2006-05-15 18:10:17,590 DEBUG exec.RunQueue [Thread-9,run:173] Done 
> processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,592 DEBUG exec.JobManagerScript 
> [Thread-11,<init>:108] Initializing script thread
> 2006-05-15 18:10:17,603 DEBUG utils.GlobusShToolsProperties 
> [Thread-11,getInstance:43] entering getInstance()
> 2006-05-15 18:10:17,603 DEBUG utils.GlobusShToolsProperties 
> [Thread-11,getInstance:75] leaving getInstance()
> 2006-05-15 18:10:17,604 DEBUG exec.StateMachine 
> [Thread-11,runScript:2661] running script cache_cleanup
> 2006-05-15 18:10:17,604 DEBUG exec.JobManagerScript [Thread-33,run:187] 
> Executing command:
> /usr/bin/sudo -H -u wenwen -S 
> /usr/local/globus/libexec/globus-gridmap-and-execute -g /etc/grid-security/grid-mapfile 
> /usr/local/globus/libexec/globus-job-manager-script.pl -m fork -f 
> /usr/local/globus/tmp/gram_job_mgr17486.tmp -c cache_cleanup
> 2006-05-15 18:10:17,692 DEBUG exec.JobManagerScript [Thread-33,run:204] 
> first line: null
> 2006-05-15 18:10:17,693 DEBUG exec.JobManagerScript 
> [Thread-33,setDone:320] script is done, setting done flag
> 2006-05-15 18:10:17,694 DEBUG exec.StateMachine 
> [Thread-11,cacheCleanUp:2591] Done waiting for cache_cleanup script
> 2006-05-15 18:10:17,694 DEBUG exec.StateMachine 
> [Thread-11,cacheCleanUp:2598] script return code: 0
> 2006-05-15 18:10:17,694 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:141] Setting resource 
> datum internalState to value Failed
> 2006-05-15 18:10:17,694 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,695 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,695 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,695 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,696 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-11,setDirty:295] setting dirty flag to true
> 2006-05-15 18:10:17,696 DEBUG utils.PersistenceHelper 
> [Thread-11,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 with state Unsubmitted
> 2006-05-15 18:10:17,697 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:141] Setting resource 
> datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@11f56a3
> 2006-05-15 18:10:17,697 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,697 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,698 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,698 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-11,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,713 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-11,setDirty:295] setting dirty flag to false
> 2006-05-15 18:10:17,713 DEBUG utils.PersistenceHelper 
> [Thread-11,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,713 DEBUG exec.StateMachine 
> [Thread-11,processNewState:2250] Adding to RunQueue.
> 2006-05-15 18:10:17,714 DEBUG exec.RunQueue [Thread-11,add:100] 
> Entering add()
> 2006-05-15 18:10:17,714 DEBUG exec.RunQueue [Thread-11,add:104] adding 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> to queue.
> 2006-05-15 18:10:17,714 DEBUG exec.RunQueue [Thread-12,run:144] 
> Queue Graph: *
> 2006-05-15 18:10:17,714 DEBUG exec.RunQueue [Thread-12,run:152] 
> Processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,715 DEBUG exec.StateMachine 
> [Thread-12,processState:174] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Entering 
> processState()
> 2006-05-15 18:10:17,715 DEBUG exec.StateMachine 
> [Thread-12,processState:181] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Finding 
> resource reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,715 DEBUG exec.StateMachine 
> [Thread-12,processState:202] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Found resource 
> reference for key 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,715 DEBUG exec.RunQueue [Thread-11,add:112] Leaving 
> add()
> 2006-05-15 18:10:17,715 DEBUG exec.StateMachine 
> [Thread-11,processFailureCacheCleanUpState:1985] Leaving processFailureCacheCleanUpState()
> 2006-05-15 18:10:17,716 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:212] getting resource 
> datum internalState
> 2006-05-15 18:10:17,716 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,716 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,716 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,716 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,716 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:212] getting resource 
> datum canceled
> 2006-05-15 18:10:17,717 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,717 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,717 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,718 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,718 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:212] getting resource 
> datum userCancelRequested
> 2006-05-15 18:10:17,718 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,718 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,718 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,718 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,719 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:212] getting resource 
> datum systemCancelRequested
> 2006-05-15 18:10:17,719 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,719 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,719 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,719 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,720 DEBUG exec.StateMachine 
> [Thread-12,processState:308] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] processing 
> internal state Failed
> 2006-05-15 18:10:17,720 DEBUG exec.StateMachine 
> [Thread-12,processState:316] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] 
> ------------------------------------------------------
> PROCESSING INTERNAL STATE:  -- Failed --
> ------------------------------------------------------
> 2006-05-15 18:10:17,720 DEBUG exec.StateMachine 
> [Thread-11,processState:376] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Leaving 
> processState()
> 2006-05-15 18:10:17,720 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:212] getting resource 
> datum notifiedJobData
> 2006-05-15 18:10:17,721 DEBUG exec.RunQueue [Thread-11,run:168] 
> processState returned
> 2006-05-15 18:10:17,721 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,721 DEBUG exec.RunQueue [Thread-11,run:173] Done 
> processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,721 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,722 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,722 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,723 DEBUG exec.StateMachine 
> [Thread-12,processFailedState:2134] Entering processFailedState()
> 2006-05-15 18:10:17,723 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:212] getting resource 
> datum holdState
> 2006-05-15 18:10:17,723 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,723 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,723 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,724 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,728 DEBUG exec.StateMachine 
> [Thread-12,processFailedState:2152] fault:
> 
> AxisFault
>  faultCode: 
> {http://schemas.xmlsoap.org/soap/envelope/}Server.generalException
>  faultSubcode: 
>  faultString: 
>  faultActor: 
>  faultNode: 
>  faultDetail: 
> 	
> {http://xml.apache.org/axis/}exceptionName:org.globus.exec.generated.FaultType
> 	{http://xml.apache.org/axis/}hostname:srb.scs.gmu.edu
> 
> 
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> 	at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> 	at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:274)
> 	at java.lang.Class.newInstance0(Class.java:308)
> 	at java.lang.Class.newInstance(Class.java:261)
> 	at org.globus.exec.utils.FaultUtils.makeFault(FaultUtils.java:485)
> 	at 
> org.globus.exec.service.exec.StateMachine.userCancel(StateMachine.java:391)
> 	at 
> org.globus.exec.service.exec.ManagedExecutableJobResource.remove(ManagedExecutableJobResource.java:273)
> 	at 
> org.globus.exec.service.exec.PersistentManagedExecutableJobResource.remove(PersistentManagedExecutableJobResource.java:254)
> 	at 
> org.globus.wsrf.impl.ResourceHomeImpl.remove(ResourceHomeImpl.java:332)
> 	at 
> org.globus.wsrf.impl.lifetime.DestroyProvider.destroy(DestroyProvider.java:40)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:324)
> 	at 
> org.apache.axis.providers.java.RPCProvider.invokeMethod(RPCProvider.java:384)
> 	at 
> org.globus.axis.providers.RPCProvider.invokeMethodSub(RPCProvider.java:107)
> 	at 
> org.globus.axis.providers.PrivilegedInvokeMethodAction.run(PrivilegedInvokeMethodAction.java:42)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:379)
> 	at org.globus.gsi.jaas.GlobusSubject.runAs(GlobusSubject.java:55)
> 	at org.globus.gsi.jaas.JaasSubject.doAs(JaasSubject.java:90)
> 	at 
> org.globus.axis.providers.RPCProvider.invokeMethod(RPCProvider.java:97)
> 	at 
> org.apache.axis.providers.java.RPCProvider.processMessage(RPCProvider.java:281)
> 	at 
> org.apache.axis.providers.java.JavaProvider.invoke(JavaProvider.java:319)
> 	at 
> org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32)
> 	at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118)
> 	at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83)
> 	at 
> org.apache.axis.handlers.soap.SOAPService.invoke(SOAPService.java:450)
> 	at org.apache.axis.server.AxisServer.invoke(AxisServer.java:285)
> 	at 
> org.globus.wsrf.container.ServiceThread.doPost(ServiceThread.java:677)
> 	at 
> org.globus.wsrf.container.ServiceThread.process(ServiceThread.java:398)
> 	at 
> org.globus.wsrf.container.GSIServiceThread.process(GSIServiceThread.java:130)
> 	at org.globus.wsrf.container.ServiceThread.run(ServiceThread.java:302)
> 2006-05-15 18:10:17,730 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setState:1364] receiving request 
> for state change to Failed
> 2006-05-15 18:10:17,730 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setState:533] Setting new state RP value 
> Failed
> 2006-05-15 18:10:17,730 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setState:1386] State of job 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 
> changed to: Failed
> 2006-05-15 18:10:17,731 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setState:1394] Holding: false
> 2006-05-15 18:10:17,733 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setState:1427] exitCode is null
> 2006-05-15 18:10:17,734 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setState:1440] Notifying of job 
> state change to topic listeners
> 2006-05-15 18:10:17,734 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-12,setDirty:295] setting dirty flag to true
> 2006-05-15 18:10:17,734 DEBUG utils.PersistenceHelper 
> [Thread-12,store:82] storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1 with state Failed
> 2006-05-15 18:10:17,735 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setResourceDatum:141] Setting resource 
> datum topicListener to value 
> [Lorg.globus.exec.generated.TopicListenerDescriptionType;@14382c6
> 2006-05-15 18:10:17,735 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setResourceDatum:146] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,735 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setResourceDatum:149] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,735 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setResourceDatum:190] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,736 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,setResourceDatum:192] Released lock on 
> resourceData
> 2006-05-15 18:10:17,745 DEBUG 
> exec.PersistentManagedExecutableJobResource [Thread-12,setDirty:295] setting dirty flag to false
> 2006-05-15 18:10:17,745 DEBUG utils.PersistenceHelper 
> [Thread-12,store:121] done storing resource 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:17,749 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:212] getting resource 
> datum creationTime
> 2006-05-15 18:10:17,750 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,750 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,750 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,753 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,754 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:212] getting resource 
> datum localResourceManager
> 2006-05-15 18:10:17,754 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:218] Obtaining lock on 
> resourceData
> 2006-05-15 18:10:17,754 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:221] Obtained lock on 
> resourceData
> 2006-05-15 18:10:17,754 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:261] Releasing lock on 
> resourceData
> 2006-05-15 18:10:17,755 DEBUG 
> ManagedJobResourceImpl.0afb530e-e45f-11da-89e2-00093d1067b1 [Thread-12,getResourceDatum:263] Released lock on 
> resourceData
> 2006-05-15 18:10:17,755 DEBUG exec.StateMachine 
> [Thread-12,processFailedState:2166] Leaving processFailedState()
> 2006-05-15 18:10:17,756 DEBUG exec.StateMachine 
> [Thread-12,processState:376] [resourceKey:0afb530e-e45f-11da-89e2-00093d1067b1] Leaving 
> processState()
> 2006-05-15 18:10:17,756 DEBUG exec.RunQueue [Thread-12,run:168] 
> processState returned
> 2006-05-15 18:10:17,756 DEBUG exec.RunQueue [Thread-12,run:173] Done 
> processing state for 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:19,447 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,remove:299] releasing lock 
> on resource...
> 2006-05-15 18:10:19,447 DEBUG 
> ManagedExecutableJobResource.0afb530e-e45f-11da-89e2-00093d1067b1 [ServiceThread-27,remove:301] released lock on 
> resource...
> 2006-05-15 18:10:19,448 DEBUG ManagedExecutableJobResource.performance 
> [ServiceThread-27,stop:71] [remove][ServiceThread-27][2083]
> 2006-05-15 18:10:19,448 DEBUG utils.PersistenceHelper 
> [ServiceThread-27,remove:184] Removing XML resource state file
> 2006-05-15 18:10:19,449 DEBUG utils.PersistenceHelper 
> [ServiceThread-27,remove:185] resource class: 
> org.globus.exec.service.exec.PersistentManagedExecutableJobResource
> 2006-05-15 18:10:19,449 DEBUG utils.PersistenceHelper 
> [ServiceThread-27,remove:187] resource id: 
> {http://www.globus.org/namespaces/2004/10/gram/job}ResourceID=0afb530e-e45f-11da-89e2-00093d1067b1
> 2006-05-15 18:10:22,617 DEBUG exec.JobManagerScript [Thread-32,run:204] 
> first line: GRAM_SCRIPT_JOB_STATE:4
> 2006-05-15 18:10:22,617 DEBUG exec.JobManagerScript [Thread-32,run:207] 
> Read line: GRAM_SCRIPT_JOB_STATE:4
> 2006-05-15 18:10:22,620 DEBUG exec.JobManagerScript 
> [Thread-32,setDone:320] script is done, setting done flag
> 2006-05-15 18:11:05,277 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:11:05,277 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:11:05,657 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:216] Starting seg process
> 2006-05-15 18:11:05,657 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:235] executing command: 
> 2006-05-15 18:11:05,657 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:11:05,658 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-s
> 2006-05-15 18:11:05,658 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->fork
> 2006-05-15 18:11:05,658 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-t
> 2006-05-15 18:11:05,658 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->1147205450
> 2006-05-15 18:11:05,672 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:123] getting seg input
> 2006-05-15 18:11:05,672 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:128] Seg input buffer is not ready
> 2006-05-15 18:11:05,673 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:266] throttleRestart called
> 2006-05-15 18:11:05,673 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:11:06,187 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:216] Starting seg process
> 2006-05-15 18:11:06,187 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:235] executing command: 
> 2006-05-15 18:11:06,187 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:11:06,188 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-s
> 2006-05-15 18:11:06,188 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->multi
> 2006-05-15 18:11:06,188 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-t
> 2006-05-15 18:11:06,188 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->1144945951
> 2006-05-15 18:11:06,189 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:11:06,189 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:11:06,199 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:123] getting seg input
> 2006-05-15 18:11:06,200 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:128] Seg input buffer is not ready
> 2006-05-15 18:11:06,200 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:266] throttleRestart called
> 2006-05-15 18:11:06,201 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:12:05,287 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:12:05,287 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:12:06,207 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:12:06,208 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:13:05,297 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:13:05,297 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:13:05,677 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:216] Starting seg process
> 2006-05-15 18:13:05,677 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:235] executing command: 
> 2006-05-15 18:13:05,677 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:13:05,678 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-s
> 2006-05-15 18:13:05,678 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->fork
> 2006-05-15 18:13:05,678 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-t
> 2006-05-15 18:13:05,678 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->1147205450
> 2006-05-15 18:13:05,691 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:123] getting seg input
> 2006-05-15 18:13:05,691 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:128] Seg input buffer is not ready
> 2006-05-15 18:13:05,691 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:266] throttleRestart called
> 2006-05-15 18:13:05,692 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:13:06,207 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:216] Starting seg process
> 2006-05-15 18:13:06,207 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:235] executing command: 
> 2006-05-15 18:13:06,207 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:13:06,207 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-s
> 2006-05-15 18:13:06,208 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->multi
> 2006-05-15 18:13:06,208 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-t
> 2006-05-15 18:13:06,208 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->1144945951
> 2006-05-15 18:13:06,218 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:13:06,218 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:13:06,219 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:123] getting seg input
> 2006-05-15 18:13:06,219 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:128] Seg input buffer is not ready
> 2006-05-15 18:13:06,219 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:266] throttleRestart called
> 2006-05-15 18:13:06,219 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:14:05,307 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:14:05,307 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:14:06,237 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:14:06,237 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:15:05,317 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:15:05,317 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:15:05,697 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:216] Starting seg process
> 2006-05-15 18:15:05,697 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:235] executing command: 
> 2006-05-15 18:15:05,697 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:15:05,698 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-s
> 2006-05-15 18:15:05,698 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->fork
> 2006-05-15 18:15:05,698 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-t
> 2006-05-15 18:15:05,698 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->1147205450
> 2006-05-15 18:15:05,708 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:123] getting seg input
> 2006-05-15 18:15:05,708 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:128] Seg input buffer is not ready
> 2006-05-15 18:15:05,710 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:266] throttleRestart called
> 2006-05-15 18:15:05,711 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:15:06,227 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:216] Starting seg process
> 2006-05-15 18:15:06,227 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:235] executing command: 
> 2006-05-15 18:15:06,227 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:15:06,227 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-s
> 2006-05-15 18:15:06,228 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->multi
> 2006-05-15 18:15:06,228 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-t
> 2006-05-15 18:15:06,228 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->1144945951
> 2006-05-15 18:15:06,238 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:123] getting seg input
> 2006-05-15 18:15:06,239 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:128] Seg input buffer is not ready
> 2006-05-15 18:15:06,239 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:266] throttleRestart called
> 2006-05-15 18:15:06,239 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:15:06,247 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:15:06,247 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:16:05,327 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:16:05,327 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:16:06,257 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:16:06,257 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:17:05,337 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:17:05,337 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:17:05,717 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:216] Starting seg process
> 2006-05-15 18:17:05,717 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:235] executing command: 
> 2006-05-15 18:17:05,717 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:17:05,717 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-s
> 2006-05-15 18:17:05,717 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->fork
> 2006-05-15 18:17:05,718 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->-t
> 2006-05-15 18:17:05,718 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,startSegProcess:238] ->1147205450
> 2006-05-15 18:17:05,728 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:123] getting seg input
> 2006-05-15 18:17:05,728 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,run:128] Seg input buffer is not ready
> 2006-05-15 18:17:05,729 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:266] throttleRestart called
> 2006-05-15 18:17:05,729 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-2,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:17:06,247 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:216] Starting seg process
> 2006-05-15 18:17:06,247 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:235] executing command: 
> 2006-05-15 18:17:06,247 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] 
> ->/usr/local/globus/libexec/globus-scheduler-event-generator
> 2006-05-15 18:17:06,247 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-s
> 2006-05-15 18:17:06,248 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->multi
> 2006-05-15 18:17:06,248 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->-t
> 2006-05-15 18:17:06,248 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,startSegProcess:238] ->1144945951
> 2006-05-15 18:17:06,258 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:123] getting seg input
> 2006-05-15 18:17:06,259 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,run:128] Seg input buffer is not ready
> 2006-05-15 18:17:06,259 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:266] throttleRestart called
> 2006-05-15 18:17:06,259 DEBUG monitoring.SchedulerEventGenerator 
> [Thread-5,throttleRestart:273] Throttling the restart as we just restarted 
> the SEG
> 2006-05-15 18:17:06,267 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:17:06,267 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:18:05,347 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:18:05,347 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 2006-05-15 18:18:06,277 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:329] Entering flushCache()
> 2006-05-15 18:18:06,277 DEBUG monitoring.JobStateMonitor 
> [Thread-1,flushCache:369] Exiting flushCache()
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 3720 bytes
Desc: not available
URL: <http://lists.globus.org/pipermail/gram-user/attachments/20060515/3e5125b5/attachment.bin>


More information about the gram-user mailing list