[Iplant-api-dev] Job status from Agave

Duvick, Jonathan P [GDCBS] jduvick at iastate.edu
Thu Jun 25 11:36:33 MST 2015


I find the job status returns from my webhook are unreliably ordered; sometimes a QUEUED status is returned after RUNNING status, for instance.  My app is assuming a fixed order of QUEUED -> RUNNING -> CLEANING UP


I wonder if this might be due to packet delay over HTTPS that gets things out of order? These are small test jobs so status changes could be occurring over a matter of seconds, and processing times are about 15 sec. Otherwise I'm stumped as to why this would be.


here is a recent example (my webhook is returning '${JOB_STATUS}&error=\${JOB_ERROR}' and my app concatenates these in a formatted string):


SUBMITTED: 2015-06-25 11:05:00 |  | PROCESSING_INPUTS: 2015-06-25 11:05:04 | Attempt 1 to stage job inputs | PROCESSING_INPUTS: 2015-06-25 11:05:04 | Identifying input files for staging | STAGING_INPUTS: 2015-06-25 11:05:06 | Identifying input files for staging | STAGING_INPUTS: 2015-06-25 11:05:06 | Staging /jduvick/keys/gth.lic to remote job directory | STAGING_INPUTS: 2015-06-25 11:05:11 | Staging /jduvick/keys/gth.lic to remote job directory | STAGING_INPUTS: 2015-06-25 11:05:11 | Staging /jduvick/GDB003_hpcs/Protein/GDB003prot.fa to remote job directory | STAGING_INPUTS: 2015-06-25 11:05:16 | Staging /jduvick/GDB003_hpcs/Protein/GDB003prot.fa to remote job directory | STAGING_INPUTS: 2015-06-25 11:05:16 | Staging /jduvick/GDB003_hpcs/SCFDIR/GDB003gdna.fa to remote job directory | STAGED: 2015-06-25 11:05:18 | Job inputs staged to execution system | SUBMITTING: 2015-06-25 11:05:20 | Preparing job for submission. | SUBMITTING: 2015-06-25 11:05:20 | Preparing job for submission. | SUBMITTING: 2015-06-25 11:05:20 | Preparing job for submission. | QUEUED: 2015-06-25 11:06:14 | Attempt 1 to submit job | RUNNING: 2015-06-25 11:09:16 | HPC job successfully placed into queue | QUEUED: 2015-06-25 11:09:17 | Job started running | CLEANING_UP: 2015-06-25 11:09:29 | ${JOB_ERROR} |



Thanks,


Jon

Jon Duvick
PlantGDB Manager
http://www.plantgdb.org/
Department of Genetics, Development and Cell Biology
2258 Molecular Biology Building
Iowa State University
Ames IA 50011

(515) 294-2360
(515) 294-6755 FAX
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.iplantcollaborative.org/pipermail/iplant-api-dev/attachments/20150625/0228313b/attachment.html 


More information about the Iplant-api-dev mailing list