GitHub user kennknowles opened a pull request:
https://github.com/apache/incubator-beam/pull/1399
[BEAM-25] Direct runner state
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [x] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [x] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [x] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [x] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.txt).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kennknowles/incubator-beam DirectRunner-state
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/1399.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1399
----
commit 9d35e9f715f2c76ae54f3b304e41d1dbdf8c0f92
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-16T05:33:01Z
Reject stateful DoFn in ApexRunner
commit aab81549a70d1ac3f6580f66759566f673c243b8
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-16T05:33:13Z
Reject stateful DoFn in SparkRunner
commit 0c2aa666ecaf7def9fa28c6dc81b90c3ad0dc873
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-16T05:33:28Z
Reject stateful DoFn in FlinkRunner
commit ec12dd3102d0a76e5b4cf7ad0a503b746e165d01
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-16T05:35:03Z
Reject stateful DoFn in DataflowRunner
commit a66e71fb92734f6d423ce9ee012812322992ba40
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-10T05:10:51Z
Add State parameter support to SimpleDoFnRunner
commit 8a058b14ab4084ee122d396f96ef2b76d86d3368
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-21T19:34:45Z
Remove overspecified type in ParDoEvaluator
commit 677155a6148ea383065c1792db49e283e466cef1
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-10T05:59:15Z
Add support for Stateful ParDo in the Direct runner
This adds overrides and new evaluators to ensure that
state is accessed in a single-threaded manner per key
and is cleaned up when a window expires.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
