[ https://issues.apache.org/jira/browse/SPARK-17814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968816#comment-16968816 ]
Juan Ramos Fuentes commented on SPARK-17814: -------------------------------------------- Looks like I'm about 3 years too late, but I just encountered this same issue. I'm also passing a string of JSON as an arg to spark-submit and seeing the last two curly braces being replaced with empty string. My temporary solution is to avoid having two curly braces next to each other, but I was wondering if you have any thoughts for how to solve this issue [~jerryshao] [~shreyass123] > spark submit arguments are truncated in yarn-cluster mode > --------------------------------------------------------- > > Key: SPARK-17814 > URL: https://issues.apache.org/jira/browse/SPARK-17814 > Project: Spark > Issue Type: Bug > Components: Spark Submit, YARN > Affects Versions: 1.6.1 > Reporter: shreyas subramanya > Priority: Minor > > {noformat} > One of our customers is trying to pass in json through spark-submit as > follows: > spark-submit --verbose --class SimpleClass --master yarn-cluster ./simple.jar > "{\"mode\":\"wf\", \"arrays\":{\"array\":[1]}}" > The application reports the passed arguments as: {"mode":"wf", > "arrays":{"array":[1] > If the same application is submitted in yarn-client mode, as follows: > spark-submit --verbose --class SimpleClass --master yarn-client ./simple.jar > "{\"mode\":\"wf\", \"arrays\":{\"array\":[1]}}" > The application reports the passed args as: {"mode":"wf", > "arrays":{"array":[1]}} > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org