Heshan Suriyaarachchi created AIRAVATA-489:
----------------------------------------------
Summary: Intermittent failures while submitting grid jobs
Key: AIRAVATA-489
URL: https://issues.apache.org/jira/browse/AIRAVATA-489
Project: Airavata
Issue Type: Bug
Affects Versions: 0.3-INCUBATING
Environment: Ubuntu 10.04
JDK 1.6
Reporter: Heshan Suriyaarachchi
I'm getting an ArrayIndexOutOfBoundsException when submitting jobs to Ranger.
This is an intermittent issue and I'm unable to reproduce it consistently.
Following is the exception stack trace.
135588 [Thread-24] INFO
org.apache.airavata.core.gfac.provider.utils.JobSubmissionListener - job
https://gridftp1.ranger.tacc.utexas.edu:50384/16217746756200987461/17606392074284839320/
have same status: PENDING
195589 [Thread-24] INFO
org.apache.airavata.core.gfac.provider.utils.JobSubmissionListener - job
https://gridftp1.ranger.tacc.utexas.edu:50384/16217746756200987461/17606392074284839320/
have same status: PENDING
211085 [Thread-28] INFO
org.apache.airavata.core.gfac.provider.utils.JobSubmissionListener - Status of
job
https://gridftp1.ranger.tacc.utexas.edu:50384/16217746756200987461/17606392074284839320/is
ACTIVE
211191 [Thread-28] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - Notifier:
class org.apache.airavata.core.gfac.notification.impl.LoggingNotification
211191 [Thread-28] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification -
-----DATA-----
211191 [Thread-28] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - Status of
job
https://gridftp1.ranger.tacc.utexas.edu:50384/16217746756200987461/17606392074284839320/is
ACTIVE
211191 [Thread-28] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - -----END
DATA-----
255590 [Thread-24] INFO
org.apache.airavata.core.gfac.provider.utils.JobSubmissionListener - job
https://gridftp1.ranger.tacc.utexas.edu:50384/16217746756200987461/17606392074284839320/
have same status: ACTIVE
303881 [Thread-14] INFO org.apache.airavata.wsmg.commons.storage.JdbcStorage -
Problem: 0 rows affected by insert/update/delete statement.
315591 [Thread-24] INFO
org.apache.airavata.core.gfac.provider.utils.JobSubmissionListener - job
https://gridftp1.ranger.tacc.utexas.edu:50384/16217746756200987461/17606392074284839320/
have same status: ACTIVE
358003 [Thread-29] INFO
org.apache.airavata.core.gfac.provider.utils.JobSubmissionListener - Status of
job
https://gridftp1.ranger.tacc.utexas.edu:50384/16217746756200987461/17606392074284839320/is
DONE
358102 [Thread-29] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - Notifier:
class org.apache.airavata.core.gfac.notification.impl.LoggingNotification
358102 [Thread-29] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification -
-----DATA-----
358102 [Thread-29] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - Status of
job
https://gridftp1.ranger.tacc.utexas.edu:50384/16217746756200987461/17606392074284839320/is
DONE
358102 [Thread-29] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - -----END
DATA-----
380924 [Thread-24] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - Notifier:
class org.apache.airavata.core.gfac.notification.impl.LoggingNotification
380924 [Thread-24] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification -
-----DATA-----
380924 [Thread-24] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - Finish
execution
380924 [Thread-24] INFO
org.apache.airavata.core.gfac.notification.impl.LoggingNotification - -----END
DATA-----
org.globus.gsi.gssapi.GlobusGSSCredentialImpl@2bbe3d02
380926 [Thread-24] INFO
org.apache.airavata.core.gfac.provider.impl.GramProvider -
STDOUT:gsiftp://gridftp.ranger.tacc.teragrid.org:2811//scratch/01437/ogce/test/Application1_Mon_Jun_25_16_13_39_EDT_2012_30b03d4f-c6bc-4182-a6ba-32400223b591/Application1.stdout
380926 [Thread-24] INFO
org.apache.airavata.core.gfac.provider.impl.GramProvider -
STDERR:gsiftp://gridftp.ranger.tacc.teragrid.org:2811//scratch/01437/ogce/test/Application1_Mon_Jun_25_16_13_39_EDT_2012_30b03d4f-c6bc-4182-a6ba-32400223b591/Application1.stderr
380927 [Thread-24] INFO org.apache.airavata.core.gfac.external.GridFtp - The
local temp file is
/tmp/EchoService_Mon_Jun_25_16_18_54_EDT_2012_af7f3d91-2f20-4109-a164-7a2ed48cc3a93731227270041424931stdout
380927 [Thread-24] INFO org.apache.airavata.core.gfac.external.GridFtp - the
remote file is
//scratch/01437/ogce/test/Application1_Mon_Jun_25_16_13_39_EDT_2012_30b03d4f-c6bc-4182-a6ba-32400223b591/Application1.stdout
383815 [Thread-24] INFO org.apache.airavata.core.gfac.external.GridFtp -
Download file
to://scratch/01437/ogce/test/Application1_Mon_Jun_25_16_13_39_EDT_2012_30b03d4f-c6bc-4182-a6ba-32400223b591/Application1.stdout
is done
383860 [Thread-24] INFO org.apache.airavata.core.gfac.external.GridFtp - The
local temp file is
/tmp/EchoService_Mon_Jun_25_16_18_54_EDT_2012_af7f3d91-2f20-4109-a164-7a2ed48cc3a97867529937455138816stderr
383860 [Thread-24] INFO org.apache.airavata.core.gfac.external.GridFtp - the
remote file is
//scratch/01437/ogce/test/Application1_Mon_Jun_25_16_13_39_EDT_2012_30b03d4f-c6bc-4182-a6ba-32400223b591/Application1.stderr
386656 [Thread-24] INFO org.apache.airavata.core.gfac.external.GridFtp -
Download file
to://scratch/01437/ogce/test/Application1_Mon_Jun_25_16_13_39_EDT_2012_30b03d4f-c6bc-4182-a6ba-32400223b591/Application1.stderr
is done
386702 [Thread-24] ERROR
org.apache.airavata.services.gfac.axis2.reciever.GFacMessageReciever - Error
invoking GFac Service
java.lang.ArrayIndexOutOfBoundsException: -20
at java.util.ArrayList.get(ArrayList.java:324)
at
org.apache.airavata.core.gfac.provider.impl.GramProvider.readLastLinesofStdOut(GramProvider.java:509)
at
org.apache.airavata.core.gfac.provider.impl.GramProvider.processOutput(GramProvider.java:360)
at
org.apache.airavata.core.gfac.provider.AbstractProvider.execute(AbstractProvider.java:75)
at
org.apache.airavata.core.gfac.services.impl.AbstractSimpleService.execute(AbstractSimpleService.java:118)
at org.apache.airavata.core.gfac.GfacAPI.gridJobSubmit(GfacAPI.java:136)
at
org.apache.airavata.services.gfac.axis2.reciever.GFacMessageReciever.invokeApplication(GFacMessageReciever.java:196)
at
org.apache.airavata.services.gfac.axis2.reciever.GFacMessageReciever.access$000(GFacMessageReciever.java:73)
at
org.apache.airavata.services.gfac.axis2.reciever.GFacMessageReciever$1.run(GFacMessageReciever.java:142)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
