GitHub user amarouni opened a pull request:
https://github.com/apache/incubator-beam/pull/401
[BEAM-313] Enable the use of an existing spark context with the
SparkPipelineRunner
The general use case is that the SparkPipelineRunner creates its own Spark
context and uses it for the pipeline execution.
Another alternative is to provide the SparkPipelineRunner with an existing
spark context. This can be interesting for a lot of use cases where the Spark
context is managed outside of beam (context reuse, advanced context management,
spark job server, ...).
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/amarouni/incubator-beam mycbeam313
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/401.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #401
----
commit fec04dee06cad9bb6d8914c6ba027a5574c73e41
Author: Abbass MAROUNI <amaro...@talend.com>
Date: 2016-05-31T12:45:32Z
[BEAM-313] Enable the use of an existing spark context with the
SparkPipelineRunner
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
