GitHub user dalaro opened a pull request:
https://github.com/apache/tinkerpop/pull/497
Limit JVM system props passed around in Spark jobs
Prior to this commit, SGC indiscriminately set the entire job config
as JVM system properties on Spark executors. It didn't account for
the fact that some config values (e.g. spark.job.description) could
have spaces. A value with a space wouldn't get quoted. This led to
Spark workers failing to start, because part of the unquoted value
would be erroneously interpreted as the JVM main class.
This commit makes SGC only pass two config settings as system props:
* gremlin.io.registry
* gremlin.io.kryoShimService
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dalaro/incubator-tinkerpop
TINKERPOP-1389-jvm-arg-fix
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tinkerpop/pull/497.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #497
----
commit 69877a20ceb9156ecf8ed7062ba3b64f56ab9134
Author: Dan LaRocque <[email protected]>
Date: 2016-11-17T16:33:58Z
Limit JVM system props passed around in Spark jobs
Prior to this commit, SGC indiscriminately set the entire job config
as JVM system properties on Spark executors. It didn't account for
the fact that some config values (e.g. spark.job.description) could
have spaces. A value with a space wouldn't get quoted. This led to
Spark workers failing to start, because part of the unquoted value
would be erroneously interpreted as the JVM main class.
This commit makes SGC only pass two config settings as system props:
* gremlin.io.registry
* gremlin.io.kryoShimService
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
