GitHub user RussellSpitzer opened a pull request:
https://github.com/apache/incubator-tinkerpop/pull/105
Persist spark
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/RussellSpitzer/incubator-tinkerpop
PersistSpark
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-tinkerpop/pull/105.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #105
----
commit 0c487bcae3ceb2f2c14d6041e9b2d8ca60abc37f
Author: Russell Spitzer <russell.spit...@gmail.com>
Date: 2015-10-06T18:27:29Z
Allows SparkGraphComputer to Preserve Spark Contexts between Jobs
Previously every traversal on a SparkGraphComputer would require
creating a brand new Spark Context. This adds a lot of overhead for
doing a bunch of operations in a row. To alliveate this we allow the
option of passing in a spark.persistContext paramter as part of the
HadoopConf. When this is enabled Spark Contexts will not be closed at
the end of the job. The getOrCreate context then allows a new
SparkGraphComputer get a handle on a previously running context.
commit 7c35ac1fcf12a78ce246c85c2947fb72d32db8dc
Author: Russell Spitzer <russell.spit...@gmail.com>
Date: 2015-10-07T00:54:59Z
Updated Documentation to note new parameter
Changed the underlying ascii to note the spark.persistContext parameter
and additionally made a new table for other Spark-Gremlin specific
properties
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
