[
https://issues.apache.org/jira/browse/OOZIE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596139#comment-15596139
]
Ruben Aguilar commented on OOZIE-2716:
--
A coworker of mine ran into the same issue doing a spark submit, and he linked
me to this: https://issues.apache.org/jira/browse/SPARK-17814
It appears yarn cluster mode is the issue. Should I close this ticket?
> Oozie Truncates Workflow Parameter Values which contain '}}'
>
>
> Key: OOZIE-2716
> URL: https://issues.apache.org/jira/browse/OOZIE-2716
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.1.0
> Environment: Using Oozie 4.1.0-cdh5.8.2, Java 1.8.0_60-b27
>Reporter: Ruben Aguilar
>
> When submitting a workflow job to oozie through the web api, if the value of
> a substituted workflow parameter contains a {{"\}\}"}} then the rest of the
> value is truncated. This happens quite often which json data. I tried
> delimiting by
> {code:javascript}
> }} =>
> }} => \}\}
> }} => '}''}'
> {code}
> but none of these worked.
> Example:
> Expected value received in {{jar}} (ending double braces):
> {code:javascript}
> {"hdfsArtifacts":null,"azureSqlArtifacts":null,"osdbArtifacts":{"username":"","password":"","server":"","database":"","schema":"","scriptsPath":"","outputType":""}}
> {code}
> Actual value received in {{jar}} (lacking ending double braces):
> {code:javascript}
> {"hdfsArtifacts":null,"azureSqlArtifacts":null,"osdbArtifacts":{"username":"","password":"","server":"","database":"","schema":"","scriptsPath":"","outputType":""
> {code}
> {{workflow.xml}}:
> {code:xml}
>
>
>
>
> ${jobTracker}
> ${nameNode}
> ${master}
> cluster
> ${jobName}
> ${classToExecute}
> ${nameNode}${executableJarPath}
>
> ${artifactSpecification}
>
>
>
>
>
> Spark Action failed, error
> message[${wf:errorMessage(wf:lastErrorNode())}]
>
>
>
> {code}
> Configuration sent to web api:
> {code:xml}
>
>
> jobName
> end-2-end-test
>
>
> oozie.use.system.libpath
> True
>
>
> executableJarPath
>
> /oozie-jars/e2e-job-test/version-14/E2EJobTest-assembly-1.20.jar
>
>
> user.name
> oozie
>
>
> mapreduce.job.user.name
> oozie
>
>
> master
> yarn-cluster
>
>
> oozie.wf.application.path
>
> hdfs://some-hdfs:8020/oozie-workflow/e2e-job-test/version-14/workflow.xml
>
>
> artifactSpecification
>
> {"hdfsArtifacts":null,"azureSqlArtifacts":null,"osdbArtifacts":{"username":"","password":"","server":"","database":"","schema":"","scriptsPath":"","outputType":""}}
>
>
> jobTracker
> some-namenode:8032
>
>
> nameNode
> hdfs://some-namenode:8020
>
>
> classToExecute
> E2EJob
>
>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
