Amila Jayasekara created AIRAVATA-972: -----------------------------------------
Summary: Unable to submit jobs to GRID machines Key: AIRAVATA-972 URL: https://issues.apache.org/jira/browse/AIRAVATA-972 Project: Airavata Issue Type: Bug Components: GFac Affects Versions: 0.11 Environment: Linux Reporter: Amila Jayasekara Assignee: Amila Jayasekara Priority: Blocker Fix For: 0.11 When submitting a job we get following error; org.globus.gram.internal.gramerrors.properties not found [ERROR] An error occurred while submitting a job, job id = null Error code: 10. Caused by unwrap failed. Caused by Token had invalid integrity check. Caused by javax.net.ssl.SSLException: bad record MAC at com.sun.net.ssl.internal.ssl.Alerts.getSSLException(Alerts.java:190) at com.sun.net.ssl.internal.ssl.SSLEngineImpl.fatal(SSLEngineImpl.java:1429) at com.sun.net.ssl.internal.ssl.SSLEngineImpl.fatal(SSLEngineImpl.java:1397) at com.sun.net.ssl.internal.ssl.SSLEngineImpl.readRecord(SSLEngineImpl.java:932) at com.sun.net.ssl.internal.ssl.SSLEngineImpl.readNetRecord(SSLEngineImpl.java:837) at com.sun.net.ssl.internal.ssl.SSLEngineImpl.unwrap(SSLEngineImpl.java:713) at javax.net.ssl.SSLEngine.unwrap(SSLEngine.java:607) at org.globus.gsi.gssapi.GlobusGSSContextImpl.sslDataUnwrap(GlobusGSSContextImpl.java:813) at org.globus.gsi.gssapi.GlobusGSSContextImpl.unwrap(GlobusGSSContextImpl.java:1694) at org.globus.gsi.gssapi.GlobusGSSContextImpl.unwrap(GlobusGSSContextImpl.java:1631) at org.globus.gsi.gssapi.net.GssInputStream.unwrap(GssInputStream.java:43) at org.globus.gsi.gssapi.net.impl.GSIGssInputStream.readMsg(GSIGssInputStream.java:47) at org.globus.gsi.gssapi.net.GssInputStream.hasData(GssInputStream.java:85) at org.globus.gsi.gssapi.net.GssInputStream.read(GssInputStream.java:72) at org.globus.util.http.HttpResponse.readLine(HttpResponse.java:55) at org.globus.util.http.HttpResponse.parse(HttpResponse.java:106) at org.globus.util.http.HttpResponse.<init>(HttpResponse.java:43) at org.globus.gram.internal.GatekeeperReply.<init>(GatekeeperReply.java:43) at org.globus.gram.Gram.request(Gram.java:391) at org.globus.gram.Gram.request(Gram.java:321) at org.globus.gram.GramJob.request(GramJob.java:373) at org.apache.airavata.gfac.provider.impl.GramProvider.submitJobs(GramProvider.java:182) at org.apache.airavata.gfac.provider.impl.GramProvider.execute(GramProvider.java:153) at org.apache.airavata.gfac.GFacAPI.executeProvider(GFacAPI.java:93) at org.apache.airavata.gfac.GFacAPI.schedule(GFacAPI.java:72) at org.apache.airavata.gfac.GFacAPI.submitJob(GFacAPI.java:54) at org.apache.airavata.xbaya.invoker.EmbeddedGFacInvoker.invoke(EmbeddedGFacInvoker.java:332) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.handleWSComponent(WorkflowInterpreter.java:749) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.executeDynamically(WorkflowInterpreter.java:569) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.access$000(WorkflowInterpreter.java:117) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter$1.run(WorkflowInterpreter.java:235) [ERROR] Error while executing provider org.apache.airavata.gfac.provider.impl.GramProvider functionality. org.apache.airavata.gfac.GFacException: An error occurred while submitting a job, job id = null at org.apache.airavata.gfac.provider.impl.GramProvider.submitJobs(GramProvider.java:236) at org.apache.airavata.gfac.provider.impl.GramProvider.execute(GramProvider.java:153) at org.apache.airavata.gfac.GFacAPI.executeProvider(GFacAPI.java:93) at org.apache.airavata.gfac.GFacAPI.schedule(GFacAPI.java:72) at org.apache.airavata.gfac.GFacAPI.submitJob(GFacAPI.java:54) at org.apache.airavata.xbaya.invoker.EmbeddedGFacInvoker.invoke(EmbeddedGFacInvoker.java:332) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.handleWSComponent(WorkflowInterpreter.java:749) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.executeDynamically(WorkflowInterpreter.java:569) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.access$000(WorkflowInterpreter.java:117) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter$1.run(WorkflowInterpreter.java:235) Caused by: org.globus.gram.GramException: Error code: 10 [Caused by: unwrap failed [Caused by: Token had invalid integrity check [Caused by: bad record MAC]]] at org.globus.gram.Gram.request(Gram.java:394) at org.globus.gram.Gram.request(Gram.java:321) at org.globus.gram.GramJob.request(GramJob.java:373) at org.apache.airavata.gfac.provider.impl.GramProvider.submitJobs(GramProvider.java:182) ... 9 more [INFO] GFac event of type ExecutionFailEvent received. [ERROR] Execution failed.ExecutionFailEvent [ERROR] Error while executing provider org.apache.airavata.gfac.provider.impl.GramProvider functionality. org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.provider.impl.GramProvider functionality. at org.apache.airavata.gfac.GFacAPI.executeProvider(GFacAPI.java:95) at org.apache.airavata.gfac.GFacAPI.schedule(GFacAPI.java:72) at org.apache.airavata.gfac.GFacAPI.submitJob(GFacAPI.java:54) at org.apache.airavata.xbaya.invoker.EmbeddedGFacInvoker.invoke(EmbeddedGFacInvoker.java:332) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.handleWSComponent(WorkflowInterpreter.java:749) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.executeDynamically(WorkflowInterpreter.java:569) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.access$000(WorkflowInterpreter.java:117) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter$1.run(WorkflowInterpreter.java:235) Caused by: org.apache.airavata.gfac.GFacException: An error occurred while submitting a job, job id = null at org.apache.airavata.gfac.provider.impl.GramProvider.submitJobs(GramProvider.java:236) at org.apache.airavata.gfac.provider.impl.GramProvider.execute(GramProvider.java:153) at org.apache.airavata.gfac.GFacAPI.executeProvider(GFacAPI.java:93) ... 7 more Caused by: org.globus.gram.GramException: Error code: 10 [Caused by: unwrap failed [Caused by: Token had invalid integrity check [Caused by: bad record MAC]]] at org.globus.gram.Gram.request(Gram.java:394) at org.globus.gram.Gram.request(Gram.java:321) at org.globus.gram.GramJob.request(GramJob.java:373) at org.apache.airavata.gfac.provider.impl.GramProvider.submitJobs(GramProvider.java:182) ... 9 more [ERROR] Error while executing provider org.apache.airavata.gfac.provider.impl.GramProvider functionality. org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.provider.impl.GramProvider functionality. at org.apache.airavata.gfac.GFacAPI.schedule(GFacAPI.java:79) at org.apache.airavata.gfac.GFacAPI.submitJob(GFacAPI.java:54) at org.apache.airavata.xbaya.invoker.EmbeddedGFacInvoker.invoke(EmbeddedGFacInvoker.java:332) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.handleWSComponent(WorkflowInterpreter.java:749) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.executeDynamically(WorkflowInterpreter.java:569) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter.access$000(WorkflowInterpreter.java:117) at org.apache.airavata.xbaya.interpretor.WorkflowInterpreter$1.run(WorkflowInterpreter.java:235) Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.provider.impl.GramProvider functionality. at org.apache.airavata.gfac.GFacAPI.executeProvider(GFacAPI.java:95) at org.apache.airavata.gfac.GFacAPI.schedule(GFacAPI.java:72) ... 6 more Caused by: org.apache.airavata.gfac.GFacException: An error occurred while submitting a job, job id = null at org.apache.airavata.gfac.provider.impl.GramProvider.submitJobs(GramProvider.java:236) at org.apache.airavata.gfac.provider.impl.GramProvider.execute(GramProvider.java:153) at org.apache.airavata.gfac.GFacAPI.executeProvider(GFacAPI.java:93) ... 7 more Caused by: org.globus.gram.GramException: Error code: 10 [Caused by: unwrap failed [Caused by: Token had invalid integrity check [Caused by: bad record MAC]]] at org.globus.gram.Gram.request(Gram.java:394) at org.globus.gram.Gram.request(Gram.java:321) at org.globus.gram.GramJob.request(GramJob.java:373) at org.apache.airavata.gfac.provider.impl.GramProvider.submitJobs(GramProvider.java:182) ... 9 more [ERROR] Error execution workflow Node : Echo_invoke [ERROR] An error occurred while submitting a job, job id = null -- This message was sent by Atlassian JIRA (v6.1.5#6160)