[GitHub] beam pull request #4153: [BEAM-3219] DataflowRunner: delegate @Setup and @Te...

2017-11-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4153 [BEAM-3219] DataflowRunner: delegate @Setup and @Teardown in stateful ParDo Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #4135: [BEAM-3194] Add @RequiresStableInput annotation

2017-11-15 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4135 [BEAM-3194] Add @RequiresStableInput annotation Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4093: Remove extraneous use of runner profiles

2017-11-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4093 Remove extraneous use of runner profiles Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4092: [BEAM-3150] Fix syntax error in ReadSpannerSchema

2017-11-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4092 [BEAM-3150] Fix syntax error in ReadSpannerSchema Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4090: [BEAM-3074] Stage the portable pipeline; put URL in...

2017-11-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4090 [BEAM-3074] Stage the portable pipeline; put URL in pipeline options Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[GitHub] beam pull request #4089: [BEAM-2884] Stage the portable pipeline; put URL in...

2017-11-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4089 [BEAM-2884] Stage the portable pipeline; put URL in pipeline options Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #4069: Fix working dir in website precommits

2017-11-01 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4069 Fix working dir in website precommits R: @tgroh CC: @melap You can merge this pull request into a Git repository by running: $ git pull https://github.com/kennknowles/beam staging-src

[GitHub] beam pull request #3487: [BEAM-2272] Enforce dependency convergence

2017-10-31 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3487 ---

[GitHub] beam pull request #4058: [BEAM-3081] NonNull by default in the rest of the c...

2017-10-29 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4058 [BEAM-3081] NonNull by default in the rest of the core SDK and shared runner code Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #4056: [BEAM-3116] Temporarily disable Dataflow metadata

2017-10-28 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4056 [BEAM-3116] Temporarily disable Dataflow metadata Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4049: [BEAM-3081] NonNull by default for sdk/transforms a...

2017-10-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4049 [BEAM-3081] NonNull by default for sdk/transforms and below Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #4048: Miscellaneous touch ups

2017-10-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4048 Miscellaneous touch ups R: @iemejia (randomly chosen victim) Very trivial PR for warnings that I kept seeing and addressed just because they were there. You can merge this pull request

[GitHub] beam pull request #4043: Remove coveralls invocations from all Jenkins jobs

2017-10-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4043 Remove coveralls invocations from all Jenkins jobs It is flaking, and I don't think it has added such value that we need to put effort into it. You can merge this pull request into a Git

[GitHub] beam pull request #4039: [BEAM-3081] Findbugs stragglers

2017-10-25 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4039 [BEAM-3081] Findbugs stragglers Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https://issues.apache.org

[GitHub] beam pull request #4037: [BEAM-3081] NonNull by default for sdk/transforms a...

2017-10-25 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/4037 ---

[GitHub] beam pull request #4038: Increase Java postcommit timeout to 240

2017-10-25 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4038 Increase Java postcommit timeout to 240 This matches the precommit. The postcommit is currently timing out when it is believed to be OK. Follow this checklist to help us incorporate

[GitHub] beam pull request #4037: [BEAM-3081] NonNull by default for sdk/transforms a...

2017-10-25 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4037 [BEAM-3081] NonNull by default for sdk/transforms and friends Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue

[GitHub] beam pull request #4033: [BEAM-3094] Fix typo in seed job, process it first

2017-10-24 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4033 [BEAM-3094] Fix typo in seed job, process it first Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4032: Rename seed job to re-seed it first in glob

2017-10-24 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/4032 ---

[GitHub] beam pull request #4032: Rename seed job to re-seed it first in glob

2017-10-24 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4032 Rename seed job to re-seed it first in glob Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4031: [BEAM-3094] Increase seed job(s) timeout to 30 minu...

2017-10-24 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4031 [BEAM-3094] Increase seed job(s) timeout to 30 minutes Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3566: (WIP) Display data translation

2017-10-23 Thread kennknowles
GitHub user kennknowles reopened a pull request: https://github.com/apache/beam/pull/3566 (WIP) Display data translation Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3566: (WIP) Display data translation

2017-10-23 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3566 ---

[GitHub] beam pull request #4027: [BEAM-3092] Fix RAT plugin configuration

2017-10-23 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4027 [BEAM-3092] Fix RAT plugin configuration Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4021: [BEAM-3081] Findbugs: NonNull by default

2017-10-19 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4021 [BEAM-3081] Findbugs: NonNull by default Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4019: [BEAM-3066] Make the main seed job standalone

2017-10-19 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4019 [BEAM-3066] Make the main seed job standalone Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4018: Do not crash when RawPTransform has null spec

2017-10-19 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4018 Do not crash when RawPTransform has null spec Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4017: Java DataflowRunner: snapshot pipeline before apply...

2017-10-19 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/4017 ---

[GitHub] beam pull request #4017: Java DataflowRunner: snapshot pipeline before apply...

2017-10-19 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4017 Java DataflowRunner: snapshot pipeline before applying overrides Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #4010: [BEAM-3074] Stage the pipeline in Python DataflowRu...

2017-10-18 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4010 [BEAM-3074] Stage the pipeline in Python DataflowRunner Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue

[GitHub] beam pull request #4006: [BEAM-3056] Set Dataflow container version to 2.2.0

2017-10-17 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4006 [BEAM-3056] Set Dataflow container version to 2.2.0 Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4004: [BEAM-3066] Add standalone version of seed job

2017-10-16 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4004 [BEAM-3066] Add standalone version of seed job Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4003: [BEAM-3049] Relocate everything shaded by Java SDK ...

2017-10-16 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4003 [BEAM-3049] Relocate everything shaded by Java SDK harness Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #4001: [BEAM-3052] Set end-of-window timer in AfterWaterma...

2017-10-16 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4001 [BEAM-3052] Set end-of-window timer in AfterWatermarkStateMachine Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3988: [BEAM-3052] ReduceFnRunner: unconditionally set onl...

2017-10-12 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3988 [BEAM-3052] ReduceFnRunner: unconditionally set only GC hold and timer; AfterWatermarkStateMachine: always set EOW timer Follow this checklist to help us incorporate your contribution quickly

[GitHub] beam pull request #3978: [BEAM-230] Remove deprecated WindowedValue.valueInE...

2017-10-11 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3978 [BEAM-230] Remove deprecated WindowedValue.valueInEmptyWindows Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3977: [BEAM-2963] Stage pipeline in DataflowRunner

2017-10-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3977 [BEAM-2963] Stage pipeline in DataflowRunner Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3976: Clone source to a distinguished subdirectory of Jen...

2017-10-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3976 Clone source to a distinguished subdirectory of Jenkins workspace Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3968: Only fail nightly release at end, for more detailed...

2017-10-09 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3968 Only fail nightly release at end, for more detailed signal Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #3964: [BEAM-3037] Relocate sdks.common.v1 and portability...

2017-10-09 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3964 [BEAM-3037] Relocate sdks.common.v1 and portability.v1 in Java direct runner Currently these two namespaces are mistakenly left as-is, even though they link to other relocated proto

[GitHub] beam pull request #3963: Extend nightly build timeout to 4 hours

2017-10-09 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3963 Extend nightly build timeout to 4 hours Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3956: Restore Python precommit; enable phrase triggering ...

2017-10-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3956 Restore Python precommit; enable phrase triggering for precommits in general Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3954: Limit Java postcommit to Java SDK and related

2017-10-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3954 Limit Java postcommit to Java SDK and related Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3938: [BEAM-2674] Add custom rehydration; reinstate proto...

2017-10-03 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3938 [BEAM-2674] Add custom rehydration; reinstate proto roundtrip for Java DirectRunner Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3186: [BEAM-1062] Shade the SDK more fully; everything bu...

2017-10-03 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3186 ---

[GitHub] beam pull request #3935: [BEAM-2596] Split Java and Python precommit jobs

2017-10-03 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3935 [BEAM-2596] Split Java and Python precommit jobs Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3926: Increase precommit timeout to 150 minutes

2017-09-30 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3926 Increase precommit timeout to 150 minutes Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3924: [BEAM-2576] Split Beam portability framework into c...

2017-09-29 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3924 [BEAM-2576] Split Beam portability framework into construction, job, and execution modules Follow this checklist to help us incorporate your contribution quickly and easily: - [x

[GitHub] beam pull request #3920: Package util

2017-09-28 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3920 Package util Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects/BEAM

[GitHub] beam pull request #3889: [BEAM-2981] Update Dataflow worker version to attai...

2017-09-22 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3889 [BEAM-2981] Update Dataflow worker version to attain ProtoCoder serialVersionUID fix Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3887: [BEAM-2884] Revert "This closes #3859: Send portabl...

2017-09-22 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3887 [BEAM-2884] Revert "This closes #3859: Send portable protos for ParDo in DataflowRunner" Follow this checklist to help us incorporate your contribution quickly and easily:

[GitHub] beam pull request #3859: [BEAM-2884] Send portable protos for ParDo in Dataf...

2017-09-17 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3859 [BEAM-2884] Send portable protos for ParDo in DataflowRunner Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #3858: [BEAM-2884] Move DoFnInfo to SDK util

2017-09-17 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3858 [BEAM-2884] Move DoFnInfo to SDK util Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3843: [BEAM-2516] Add fast path to ParDoTranslation for k...

2017-09-12 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3843 [BEAM-2516] Add fast path to ParDoTranslation for known ParDo class Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3842: [BEAM-2516] Key DirectRunner DoFn cache off step ra...

2017-09-12 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3842 [BEAM-2516] Key DirectRunner DoFn cache off step rather than DoFn Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3818: [BEAM-2866] Key StateTable off ID

2017-09-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3818 [BEAM-2866] Key StateTable off ID Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org

[GitHub] beam pull request #3813: [BEAM-2795] Key FlinkRunner streaming translation o...

2017-09-05 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3813 [BEAM-2795] Key FlinkRunner streaming translation off URN Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #3564: Update Dataflow container to 20170714

2017-08-29 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3564 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3750: [BEAM-2430] DoFnRunner for processing a bundle over...

2017-08-23 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3750 [BEAM-2430] DoFnRunner for processing a bundle over the Fn API Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3745: [BEAM-2791] Add a test for an event time timer loop...

2017-08-22 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3745 [BEAM-2791] Add a test for an event time timer loop in ParDo Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #3610: [BEAM-2371] Use dehydration-insensitive APIs in Par...

2017-07-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3610 [BEAM-2371] Use dehydration-insensitive APIs in ParDoEvaluatorFactory R: @tgroh Peeled off #3334 so it can be a trivial review. Ignore the base commit, which is #3601. You can merge

[GitHub] beam pull request #3609: [BEAM-2371] Use dehydration-insensitive APIs in Win...

2017-07-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3609 [BEAM-2371] Use dehydration-insensitive APIs in WindowEvaluatorFactory R: @tgroh Peeled off #3334 so it can be a trivial review. Ignore the base commit, which is #3601. You can merge

[GitHub] beam pull request #3608: Uniquify application nodes in TextIOReadTest (HACK)

2017-07-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3608 Uniquify application nodes in TextIOReadTest (HACK) These nodes have never had stable unique names in the original pipeline. - We have always mutated the pipeline before adding

[GitHub] beam pull request #3601: [BEAM-2333] Use RehydratedComponents for memoized r...

2017-07-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3601 [BEAM-2333] Use RehydratedComponents for memoized rehydration Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #3599: ReduceFnRunner: test when watermark leapfrogs EOW a...

2017-07-19 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3599 ReduceFnRunner: test when watermark leapfrogs EOW and GC This is known to fail in older versions; forward porting regression test. You can merge this pull request into a Git repository

[GitHub] beam pull request #3577: [BEAM-2626] Fix split package in SDK harness

2017-07-17 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3577 [BEAM-2626] Fix split package in SDK harness Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3575: [BEAM-2625] Update pull request template

2017-07-17 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3575 [BEAM-2625] Update pull request template Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #3566: (WIP) Display data translation

2017-07-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3566 (WIP) Display data translation Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3564: Update Dataflow container to 20170714

2017-07-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3564 Update Dataflow container to 20170714 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3562: Test GBK immediately followed by stateful ParDo

2017-07-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3562 Test GBK immediately followed by stateful ParDo Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3542: Remove dead (and wrong) viewFromProto overload

2017-07-11 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3542 Remove dead (and wrong) viewFromProto overload Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3536: [BEAM-2371] Use URNs, not Java classes, in immutabi...

2017-07-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3536 [BEAM-2371] Use URNs, not Java classes, in immutability enforcements Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3518: [BEAM-2557] Move DirectRunner knob out of core SDK ...

2017-07-09 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3518 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3519: [BEAM-2486] Cherry pick for 2.1.0: Reject stateful ...

2017-07-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3519 [BEAM-2486] Cherry pick for 2.1.0: Reject stateful ParDo if coder not deterministic KvCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3518: [BEAM-2557] Move DirectRunner knob out of core SDK ...

2017-07-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3518 [BEAM-2557] Move DirectRunner knob out of core SDK (Cherry pick for 2.1.0) … of core SDK Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] beam pull request #3516: [BEAM-2557] Move DirectRunner knob for suppressing ...

2017-07-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3516 [BEAM-2557] Move DirectRunner knob for suppressing runner-determined sharding out… … of core SDK Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #3511: [BEAM-2505, BEAM-2502] Fixes to ReduceFnRunner.onTi...

2017-07-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3511 [BEAM-2505, BEAM-2502] Fixes to ReduceFnRunner.onTimers (cherry pick to release-2.1.0) Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3510: Update Dataflow container version to 20170706

2017-07-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3510 Update Dataflow container version to 20170706 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3509: [BEAM-2371] Port DirectRunner overrides to SDK-agno...

2017-07-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3509 [BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3330: [BEAM-2371] Port DirectRunner overrides to SDK-agno...

2017-07-05 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3330 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3488: [BEAM-1984] Run dependency analysis on all maven li...

2017-07-05 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3505: [BEAM-2508] Fix DoFn javadoc: StateSpec does not re...

2017-07-05 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3505 [BEAM-2508] Fix DoFn javadoc: StateSpec does not require a key Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3502: [BEAM-2486] Reject stateful ParDo if coder not dete...

2017-07-05 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3502 [BEAM-2486] Reject stateful ParDo if coder not deterministic KvCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3489: [BEAM-2508] Fix DoFn javadoc: StateSpec does not re...

2017-06-30 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3489 [BEAM-2508] Fix DoFn javadoc: StateSpec does not require a key Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3488: [BEAM-2272] Run dependency analysis on all maven li...

2017-06-30 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3488 [BEAM-2272] Run dependency analysis on all maven lifecycle phases In this way, tests can also have IWYU enforced. The number of runtime-only and provided dependencies should be very small so

[GitHub] beam pull request #3487: [BEAM-2272] Enforce dependency convergence

2017-06-30 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3487 [BEAM-2272] Enforce dependency convergence Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #3476: [BEAM-2529] Fix dependency scope error in GCP IO mo...

2017-06-29 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3476 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3476: [BEAM-2529] Fix dependency scope error in GCP IO mo...

2017-06-29 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3476 [BEAM-2529] Fix dependency scope error in GCP IO module Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3459: [BEAM-2529] Only use letters to generate Spanner da...

2017-06-28 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3459 [BEAM-2529] Only use letters to generate Spanner database names Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3429: [BEAM-2502] Ignore processing time timers in expire...

2017-06-22 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3429 [BEAM-2502] Ignore processing time timers in expired windows Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3425: [BEAM-2502, BEAM-2504, BEAM-2505] Fix processing ti...

2017-06-22 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3425 [BEAM-2502, BEAM-2504, BEAM-2505] Fix processing time timer handling in ReduceFnRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3419: [BEAM-2485] DataflowRunner: Reject merging windowin...

2017-06-21 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3419 [BEAM-2485] DataflowRunner: Reject merging windowing for stateful ParDo Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #3355: [BEAM-1287] Add support for PipelineOptions paramet...

2017-06-13 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3355 [BEAM-1287] Add support for PipelineOptions parameters This is a step towards eliminating catch-all context parameters and making DoFns express their fine-grained data needs. Be sure

[GitHub] beam pull request #3352: [BEAM-2371] Fix getAdditionalInputs, etc, for Direc...

2017-06-13 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3352 [BEAM-2371] Fix getAdditionalInputs, etc, for DirectRunner stateful ParDo override Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3351: [BEAM-2371] Fix getAdditionInputs for SplittablePar...

2017-06-13 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3351 [BEAM-2371] Fix getAdditionInputs for SplittableParDo transforms Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3338: [BEAM-2371] Port some DirectRunner overrides to SDK...

2017-06-09 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3338 [BEAM-2371] Port some DirectRunner overrides to SDK-agnostic APIs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3330: [BEAM-2371] Port DirectRunner overrides to SDK-agno...

2017-06-08 Thread kennknowles
GitHub user kennknowles reopened a pull request: https://github.com/apache/beam/pull/3330 [BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3330: [BEAM-2371] Port DirectRunner overrides to SDK-agno...

2017-06-08 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3330 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3330: [BEAM-2371] Port DirectRunner overrides to SDK-agno...

2017-06-08 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3330 [BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3283: [BEAM-3271] Add TestStream translation

2017-06-01 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3283 [BEAM-3271] Add TestStream translation Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like

  1   2   3   >