[gridway-user] INPUT/OUTPUT and executable files not copied (Grid Gateway)
Tino Vazquez
tinova79 at gmail.com
Tue Jun 26 05:49:33 CDT 2007
Hi Daniel,
Not really sure why. Does the job in the GridGateWay finish correctly?
Is the $GW_LOCATION/var/globus-gw.log of the GridGateWay being populated?
Regards,
Tino
Daniel Tapiador wrote:
> Hi Tino,
>
> I haven't managed to try it out since notifications are not delivered
> back to the first GW instance. Do you know why?
>
> Regards,
> Daniel
>
> Tino Vazquez wrote:
>> Hi Daniel,
>>
>> Seems like we are getting there. Please let me know if this new
>> package I am sending solves your issues.
>>
>> Regards,
>>
>> Tino
>>
>> On 6/18/07, * Daniel Tapiador* <Daniel.Tapiador at sciops.esa.int
>> <mailto:Daniel.Tapiador at sciops.esa.int>> wrote:
>>
>> Hi Tino,
>>
>> First of all, thanks for your great support.
>>
>> I have installed the patch you have given me and it works pretty
>> fine except that it doesn't copy back the standard output and
>> error files. Once the job is finished, the files exist though they
>> are always empty..
>>
>> Best regards,
>> Daniel
>>
>>
>> Tino Vazquez wrote:
>>> Hi Daniel,
>>>
>>> I was able to reproduce all your problems. Please find attached a
>>> patched .tar.gz that hopefully will solve most, ideally all, the
>>> problems (well, it did for me, anyway ;) ).
>>>
>>> Just in case, you should do a gpt-build and a gpt-postinstall on
>>> this package, with the --force option,
>>>
>>> Please let me know if you still have the notification problem or
>>> any other issues.
>>>
>>> I will test this more thoroughly and once I am happy with it, a
>>> new GGW 1.0.3 will come out.
>>>
>>> Thank you very much for your feedback,
>>>
>>> Tino Vazquez
>>>
>>> On 6/15/07, *Daniel Tapiador* <Daniel.Tapiador at sciops.esa.int
>>> <mailto:Daniel.Tapiador at sciops.esa.int>> wrote:
>>>
>>> Dear all,
>>>
>>> I just downloaded the last version of GW (5.2.1) and the Grid
>>> Gateway (GGW) packages and install a GW client configured for
>>> submitting jobs to a GGW which in the end submits jobs to a
>>> EGEE (LCG) resource. The job launched from the first GW
>>> instance seems to start working fine though no notifications
>>> are received and the job keeps in wrap-pend state forever. On
>>> the other hand, the job submitted by the GGW GW instance to
>>> the EGEE Computing Element doesn't run fine because the job
>>> template built is in my opinion wrong because of the following:
>>>
>>> * The executable contains an absolute path (so GW
>>> believes it is a system executable and doesn't transfer
>>> it to the remote resource).
>>> * INPUT_FILES and OUTPUT_FILES variables are duplicated
>>> when {INPUT,OUTPUT}_FILES are filled out in the GW
>>> client instance.
>>> * {STDOUT,STDERR}_FILES contain also an absolute path so
>>> are not filled in with the proper stdout and stderr
>>> contents of the remote job execution.
>>> * The ARGUMENTS are joint without the blank spaces
>>> between them.
>>>
>>> Could you please give me a hand on this?
>>>
>>> I attach the job templates of the different steps:
>>>
>>> First job template (in the GW instance running on the client):
>>> EXECUTABLE=script2.sh
>>> ARGUMENTS="one two three"
>>> INPUT_FILES=input
>>> OUTPUT_FILES=input
>>>
>>> Job templates in the GGW host:
>>> Job template in file /home/user/.gw_user_JOBID/gwt
>>>
>>> EXECUTABLE = /home/dtapiador/.gw_dtapiador_0/script2.sh
>>> ARGUMENTS = onetwothree
>>> ENVIRONMENT = GW_TASK_ID=0, GW_ARRAY_ID=-1, GW_TOTAL_TASKS=0,
>>> GW_RESTARTED=0,
>>> SCRATCH_DIRECTORY=/home/dtapiador/.globus/scratch,
>>> STDIN_FILE = /dev/null
>>> STDOUT_FILE = /home/dtapiador/.gw_dtapiador_0/stdout.execution
>>> STDERR_FILE = /home/dtapiador/.gw_dtapiador_0/stderr.execution
>>> INPUT_FILES =
>>> OUTPUT_FILES =
>>>
>>> CPULOAD_THRESHOLD=50
>>> SUSPENSION_TIMEOUT=900
>>> INPUT_FILES=input
>>> OUTPUT_FILES=input
>>>
>>>
>>> Job template in
>>> $GW_LOCATION/var/JOB_ID_GGW_GW_INSTANCE/job.template
>>>
>>> NAME=gwt
>>> EXECUTABLE=/home/dtapiador/.gw_dtapiador_0/script2.sh
>>> ARGUMENTS=onetwothree
>>> INPUT_FILES=input
>>> OUTPUT_FILES=input
>>> ENVIRONMENT=GW_TASK_ID="0", GW_ARRAY_ID="-1",
>>> GW_TOTAL_TASKS="0", GW_RESTARTED="0",
>>> SCRATCH_DIRECTORY="/home/dtapiador/.globus/scratch"
>>> STDIN_FILE=/dev/null
>>> STDOUT_FILE=/home/dtapiador/.gw_dtapiador_0/stdout.execution
>>> STDERR_FILE=/home/dtapiador/.gw_dtapiador_0/stderr.execution
>>> REQUIREMENTS=
>>> RANK=
>>> RESCHEDULING_INTERVAL=0
>>> RESCHEDULING_THRESHOLD=300
>>> SUSPENSION_TIMEOUT=900
>>> CPULOAD_THRESHOLD=50
>>> RESCHEDULE_ON_FAILURE=yes
>>> NUMBER_OF_RETRIES=3
>>> CHECKPOINT_INTERVAL=0
>>> CHECKPOINT_URL=
>>> WRAPPER=/opt/gridway/libexec/gw_wrapper.sh
>>> MONITOR=
>>> PRE_WRAPPER=
>>> PRE_WRAPPER_ARGUMENTS=
>>> TYPE=single
>>> NP=1
>>> DEADLINE=0:00:00
>>>
>>> Best regards,
>>> Daniel
>>>
>>> --
>>> Daniel Tapiador de Pedro - INSA
>>> European Space Astronomy Centre (ESAC)
>>> European Space Agency (ESA)
>>>
>>> E-mail:
>>>
>>>
>>> Daniel.Tapiador at esa.int <mailto:Daniel.Tapiador at esa.int>
>>> Tel: +34 91 8131 339, Fax: +34 91 8131 322
>>> P.0. Box 50727, 28080 Madrid - SPAIN.
>>>
>>>
>>> ------------------------------------------------------------------------
>>> This message and any attachments are intended for the use of
>>> the addressee or addressees only. The unauthorised
>>> disclosure, use, dissemination or copying (either in whole or
>>> in part) of its content is prohibited. If you received this
>>> message in error, please delete it from your system and
>>> notify the sender. E-mails can be altered and their integrity
>>> cannot be guaranteed. ESA shall not be liable for any e-mail
>>> if modified.
>>> ------------------------------------------------------------------------
>>>
>>>
>>>
>>>
>>> --
>>> +-----------------------------------------------------------+
>>> Tino Vázquez
>>> Grid Technology Engineer/Researcher
>>> Dpto. Arquitectura de Computadores y Automatica
>>> Facultad de Informatica
>>> Universidad Complutense 28040 Madrid
>>> Phone : +34 91 394 75 74
>>> http://asds.dacya.ucm.es/ <http://asds.dacya.ucm.es/>
>>> +-----------------------------------------------------------+
>>>
>>> GridWay, The Way to Grid! http://www.gridway.org
>>
>> --
>> Daniel Tapiador de Pedro - INSA
>> European Space Astronomy Centre (ESAC)
>> European Space Agency (ESA)
>>
>> E-mail:
>> Daniel.Tapiador at esa.int <mailto:Daniel.Tapiador at esa.int>
>> Tel: +34 91 8131 339, Fax: +34 91 8131 322
>> P.0. Box 50727, 28080 Madrid - SPAIN.
>>
>>
>> ------------------------------------------------------------------------
>> This message and any attachments are intended for the use of the
>> addressee or addressees only. The unauthorised disclosure, use,
>> dissemination or copying (either in whole or in part) of its
>> content is prohibited. If you received this message in error,
>> please delete it from your system and notify the sender. E-mails
>> can be altered and their integrity cannot be guaranteed. ESA shall
>> not be liable for any e-mail if modified.
>> ------------------------------------------------------------------------
>>
>>
>>
>>
>> --
>> +-----------------------------------------------------------+
>> Tino Vázquez
>> Grid Technology Engineer/Researcher
>> Dpto. Arquitectura de Computadores y Automatica
>> Facultad de Informatica
>> Universidad Complutense 28040 Madrid
>> Phone : +34 91 394 75 74
>> http://asds.dacya.ucm.es/
>> +-----------------------------------------------------------+
>>
>> GridWay, The Way to Grid! http://www.gridway.org
>
> --
> Daniel Tapiador de Pedro - INSA
> European Space Astronomy Centre (ESAC)
> European Space Agency (ESA)
>
> E-mail: Daniel.Tapiador at esa.int
> Tel: +34 91 8131 339, Fax: +34 91 8131 322
> P.0. Box 50727, 28080 Madrid - SPAIN.
>
> ------------------------------------------------------------------------
> This message and any attachments are intended for the use of the
> addressee or addressees only. The unauthorised disclosure, use,
> dissemination or copying (either in whole or in part) of its content is
> prohibited. If you received this message in error, please delete it from
> your system and notify the sender. E-mails can be altered and their
> integrity cannot be guaranteed. ESA shall not be liable for any e-mail
> if modified.
> ------------------------------------------------------------------------
--
+-----------------------------------------------------------+
Tino Vázquez
Grid Technology Engineer/Researcher
Dpto. Arquitectura de Computadores y Automatica
Facultad de Informatica
Universidad Complutense phone : +34 91 394 75 74
28040 Madrid fax : +34 91 394 75 27
Spain email : tinova at fdi.ucm.es
http://asds.dacya.ucm.es/
+-----------------------------------------------------------+
GridWay, The Way to Grid! http://www.gridway.org
More information about the gridway-user
mailing list