[
https://issues.apache.org/jira/browse/SPARK-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152323#comment-14152323
]
Sotos Matzanas commented on SPARK-3732:
---------------------------------------
[~tgraves] this jira is the first step for us to move forward with our own
(very limited for now) version of programmatic job submits. I can add another
jira to address the big issue, but we would like to see this one resolved
first. Once we are confident with our solution we can contribute to the second
jira. Let us know what you think
> Yarn Client: Add option to NOT System.exit() at end of main()
> -------------------------------------------------------------
>
> Key: SPARK-3732
> URL: https://issues.apache.org/jira/browse/SPARK-3732
> Project: Spark
> Issue Type: Improvement
> Affects Versions: 1.1.0
> Reporter: Sotos Matzanas
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> We would like to add the ability to create and submit Spark jobs
> programmatically via Scala/Java. We have found a way to hack this and submit
> jobs via Yarn, but since
> org.apache.spark.deploy.yarn.Client.main()
> exits with either 0 or 1 in the end, this will mean exit of our own program.
> We would like to add an optional spark conf param to NOT exit at the end of
> the main
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
