[Iplant-api-dev] Agave jobs

[Rion Dooley]

I noticed that too. I have a fix, but I'm mobile atm. I'll push by eod today.

--
Rion

----- Reply message -----
From: "Duvick, Jonathan P [GDCBS]" <jduvick at iastate.edu>
To: "Rion Dooley" <dooley at tacc.utexas.edu>
Cc: "iPlant API Developers Mailing List" <iplant-api-dev at iplantcollaborative.org>
Subject: [Iplant-api-dev] Agave jobs
Date: Fri, Jul 24, 2015 3:20 PM


Thanks. Digging a bit deeper, it turns out my webhook is not receiving callbacks from Agave, which I confirmed by checking /var/log/httpd/ssl_access_log. (Email callbacks are also silent). So my app never updated the initial status in my GUI, leading me to believe jobs weren't executing. However when I use the API to check status of individual jobs, they return FINISHED.  Ergo, not a job queue problem.


So that leaves the question of what happened to the webhook and email callbacks. Is it possible something went awry in the latest commits to the API?  Nothing has changed in my app code that sends a json string including email and webhook urls, e.g.


{"name":"gdb007-example-1-4-scaffold-test-for-hpc","appId":"gth-stampede-1.6.5u2","nodeCount":"1","processorsPerNode":"16","maxRunTime":"00:10:00","memoryPerNode":"2","archive":"1","archiveSystem":"data.iplantcollaborative.org","notifications":[{"url":"jduvick at iastate.edu","event":"RUNNING","persistent":false},{"url":"jduvick at iastate.edu","event":"FAILED","persistent":false},{"url":"jduvick at iastate.edu","event":"FINISHED","persistent":false},{"url":"https://128.196.64.141/XGDB/jobs/webhook.php?nonce=efbeac0f1697922a4b16b6058a2e32a86fa2c9a3337cd612461a24525b497a5530de22cac9df1be9be7ea97423f1d04b6a5e882c1fd7c45a8dc3fcc8261110ec&job_id=${JOB_ID}&status=${JOB_STATUS}&error=${JOB_ERROR}","event":"*","persistent":true}],"inputs":{"inputGenomic":"/jduvick/GDB007_hpcs/SCFDIR/GDB007gdna.fa","inputProtein":"/jduvick/GDB007_hpcs/Protein/GDB007prot.fa","licenseFile":"/jduvick/keys/gth.lic"},"parameters":{"speciesName":"rice","splitSize":"16","outputName":"GDB007prot.gth"}}


Compare a job from a week ago where all callbacks were normal:


9210747924657008155-e0bd34dffff8de6-0001-007


...versus a recent job, which actually  completed but failed to return status callbacks:


3370207028980674075-e0bd34dffff8de6-0001-007


Jon Duvick
PlantGDB Manager
http://www.plantgdb.org/
Department of Genetics, Development and Cell Biology
2258 Molecular Biology Building
Iowa State University
Ames IA 50011

(515) 294-2360
(515) 294-6755 FAX


________________________________
From: Matthew Vaughn <vaughn at tacc.utexas.edu>
Sent: Friday, July 24, 2015 10:21 AM
To: Duvick, Jonathan P [GDCBS]
Subject: Re: [Iplant-api-dev] Agave jobs

Jon,

Shoot me a couple exemplar job IDs and I'll take a look for you.

My end-to-end testing jobs are working OK (see below)

testing.sh
Checking credentials...
OAuth2 token 1ca5e938195a753af59a941b63d239
Done
Submitting test job...
Submitted 7600095951400145381-e0bd34dffff8de6-0001-007
Done
Monitoring job...
In progress... SUBMITTING 15 sec
In progress... SUBMITTING 31 sec
In progress... FINISHED 46 sec
Done
######################################################################## 100.0%


On Jul 24, 2015, at 10:12 AM, Duvick, Jonathan P [GDCBS] <jduvick at iastate.edu<mailto:jduvick at iastate.edu>> wrote:

Anyone else getting jobs to process? Mine are all 'Pending' for up to 2 days...
Jon

Jon Duvick
PlantGDB Manager
http://www.plantgdb.org/
Department of Genetics, Development and Cell Biology
2258 Molecular Biology Building
Iowa State University
Ames IA 50011

(515) 294-2360
(515) 294-6755 FAX
_______________________________________________
Iplant-api-dev Mailing List: Iplant-api-dev at iplantcollaborative.org<mailto:Iplant-api-dev at iplantcollaborative.org>
List Info and Archives: http://mail.iplantcollaborative.org/mailman/listinfo/iplant-api-dev
One-click Unsubscribe: http://mail.iplantcollaborative.org/mailman/options/iplant-api-dev/vaughn%40tacc.utexas.edu?unsub=1&unsubconfirm=1

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.iplantcollaborative.org/pipermail/iplant-api-dev/attachments/20150724/d000274a/attachment-0001.html