[13/50] incubator-beam git commit: [BEAM-799] Support GroupByKey directly.

2016-10-28 Thread thw
[BEAM-799] Support GroupByKey directly. Remove runner override for GroupByKey. Avoid NPE if no sideInputs are available in reader. Handle CombineFn with or without context. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incuba

[38/50] incubator-beam git commit: Update Dataflow worker image pointer

2016-10-28 Thread thw
Update Dataflow worker image pointer Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/95bf7a83 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/95bf7a83 Diff: http://git-wip-us.apache.org/repos

[16/50] incubator-beam git commit: This closes #1171

2016-10-28 Thread thw
This closes #1171 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/78e2c038 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/78e2c038 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[17/50] incubator-beam git commit: Closes #1180

2016-10-28 Thread thw
Closes #1180 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7091a012 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7091a012 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[20/50] incubator-beam git commit: Add utility to handle JSON option manipulation

2016-10-28 Thread thw
Add utility to handle JSON option manipulation Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/35244a68 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/35244a68 Diff: http://git-wip-us.apache

[22/50] incubator-beam git commit: [BEAM-658] Support Read.Unbounded primitive.

2016-10-28 Thread thw
[BEAM-658] Support Read.Unbounded primitive. Changed mapSourceFunction to use scala's native Option. Upgrade to kryo-serializers 0.39 that provides support for ReverseList (used by Top). Better logging. Allow a longer read time-frame for read in tests. Assert initial parallelism is gerater th

[01/50] incubator-beam git commit: Encode bundle elements in the DirectRunner

2016-10-28 Thread thw
Repository: incubator-beam Updated Branches: refs/heads/apex-runner fa3a6aa8d -> 968eb32b8 Encode bundle elements in the DirectRunner This ensures that any changes that are caused when an element is encoded and decoded is caught within the pipeline. Project: http://git-wip-us.apache.org/repo

[25/50] incubator-beam git commit: This closes #1185

2016-10-28 Thread thw
This closes #1185 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f30b21a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9f30b21a Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[35/50] incubator-beam git commit: [BEAM-813] support metadata in Avro sink

2016-10-28 Thread thw
[BEAM-813] support metadata in Avro sink Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/eba099f5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/eba099f5 Diff: http://git-wip-us.apache.org/r

[45/50] incubator-beam git commit: Separate package-info.java compilation to avoid spurious rebuilds

2016-10-28 Thread thw
Separate package-info.java compilation to avoid spurious rebuilds Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/324a36d5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/324a36d5 Diff: http:

[23/50] incubator-beam git commit: This closes #1143

2016-10-28 Thread thw
This closes #1143 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dc61a001 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/dc61a001 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[21/50] incubator-beam git commit: Closes #1105

2016-10-28 Thread thw
Closes #1105 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c94b8eac Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c94b8eac Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[50/50] incubator-beam git commit: Adjust for merge from master.

2016-10-28 Thread thw
Adjust for merge from master. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/968eb32b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/968eb32b Diff: http://git-wip-us.apache.org/repos/asf/in

[18/50] incubator-beam git commit: Set up Maven settings globally for Travis CI builds

2016-10-28 Thread thw
Set up Maven settings globally for Travis CI builds Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3af2c1e7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3af2c1e7 Diff: http://git-wip-us.a

[06/50] incubator-beam git commit: This closes #1163

2016-10-28 Thread thw
This closes #1163 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7abdcbfb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7abdcbfb Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[34/50] incubator-beam git commit: Port some example utils from OldDoFn to DoFn

2016-10-28 Thread thw
Port some example utils from OldDoFn to DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3bec5e03 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3bec5e03 Diff: http://git-wip-us.apache.o

[2/2] incubator-beam git commit: Closes #1194

2016-10-26 Thread thw
Closes #1194 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fa3a6aa8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fa3a6aa8 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[1/2] incubator-beam git commit: BEAM-261 Skip integration tests unless running with -Plocal-runnable-on-service-tests

2016-10-26 Thread thw
Repository: incubator-beam Updated Branches: refs/heads/apex-runner e92157b37 -> fa3a6aa8d BEAM-261 Skip integration tests unless running with -Plocal-runnable-on-service-tests Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/

[1/2] incubator-beam git commit: BEAM-784 Checkpointing for StateInternals

2016-10-26 Thread thw
Repository: incubator-beam Updated Branches: refs/heads/apex-runner 8827ccf6b -> e92157b37 BEAM-784 Checkpointing for StateInternals Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1db4ff63 Tree: http://g

[2/2] incubator-beam git commit: Closes #1186

2016-10-26 Thread thw
Closes #1186 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e92157b3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e92157b3 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[2/2] incubator-beam git commit: Closes #1167

2016-10-25 Thread thw
Closes #1167 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8827ccf6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8827ccf6 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[1/2] incubator-beam git commit: [BEAM-815] Fix ApexPipelineOptions conversion and add ApexRunnerRegistrar

2016-10-25 Thread thw
Repository: incubator-beam Updated Branches: refs/heads/apex-runner 989e39987 -> 8827ccf6b [BEAM-815] Fix ApexPipelineOptions conversion and add ApexRunnerRegistrar Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-bea

[incubator-beam] Git Push Summary [forced push!] [Forced Update!]

2016-10-25 Thread thw
Repository: incubator-beam Updated Branches: refs/heads/apex-runner 638117dc8 -> 989e39987 (forced update)

[1/2] incubator-beam git commit: [BEAM-815] Fix ApexPipelineOptions conversion and add ApexRunnerRegistrar

2016-10-25 Thread thw
Repository: incubator-beam Updated Branches: refs/heads/apex-runner 989e39987 -> 638117dc8 [BEAM-815] Fix ApexPipelineOptions conversion and add ApexRunnerRegistrar Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-bea

[2/2] incubator-beam git commit: Closes #1167

2016-10-25 Thread thw
Closes #1167 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/638117dc Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/638117dc Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[01/50] incubator-beam git commit: Add access to original DoFn on ParDo

2016-10-25 Thread thw
Repository: incubator-beam Updated Branches: refs/heads/apex-runner c9f140666 -> 0a1b27895 Add access to original DoFn on ParDo Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0db32631 Tree: http://git-wi

[04/50] incubator-beam git commit: Simplify DoFnRunners to be somewhat compositional

2016-10-25 Thread thw
Simplify DoFnRunners to be somewhat compositional Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f043865e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f043865e Diff: http://git-wip-us.apa

[2/2] incubator-beam git commit: Closes #1139

2016-10-25 Thread thw
Closes #1139 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/989e3998 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/989e3998 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[1/2] incubator-beam git commit: BEAM-783 Add test to cover side inputs and outputs.

2016-10-25 Thread thw
Repository: incubator-beam Updated Branches: refs/heads/apex-runner 0a1b27895 -> 989e39987 BEAM-783 Add test to cover side inputs and outputs. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7105d925 Tree

[02/50] incubator-beam git commit: Add SimpleDoFnRunner for new DoFn and construction via DoFnRunners

2016-10-25 Thread thw
Add SimpleDoFnRunner for new DoFn and construction via DoFnRunners Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fe0b7bff Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fe0b7bff Diff: http

[13/50] incubator-beam git commit: [BEAM-790] Refactor PipelineOptionsFactory validation.

2016-10-25 Thread thw
[BEAM-790] Refactor PipelineOptionsFactory validation. This closes #1151 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4c905823 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4c905823 Dif

[24/50] incubator-beam git commit: Fix flipped conditional in SimpleDoFnRunner

2016-10-25 Thread thw
Fix flipped conditional in SimpleDoFnRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f0c8d30d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f0c8d30d Diff: http://git-wip-us.apache.or

[17/50] incubator-beam git commit: Move AggregatorFactory to runners-core and deprecate SDK version

2016-10-25 Thread thw
Move AggregatorFactory to runners-core and deprecate SDK version Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/08dd1498 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/08dd1498 Diff: http:/

[15/50] incubator-beam git commit: This closes #1153

2016-10-25 Thread thw
This closes #1153 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a9a41eb9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a9a41eb9 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[33/50] incubator-beam git commit: Closes #1091

2016-10-25 Thread thw
Closes #1091 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/43beb1ea Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/43beb1ea Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[03/50] incubator-beam git commit: Rename SimpleDoFnRunner to SimpleOldDoFnRunner and remove public access

2016-10-25 Thread thw
Rename SimpleDoFnRunner to SimpleOldDoFnRunner and remove public access Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8ff6c9d9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8ff6c9d9 Diff:

[11/50] incubator-beam git commit: [BEAM-755] Fix typo and dependencies in beam-runners-direct-java

2016-10-25 Thread thw
[BEAM-755] Fix typo and dependencies in beam-runners-direct-java This closes #1140 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ea8583c4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ea

[45/50] incubator-beam git commit: Add timestamps to maven output on Travis CI

2016-10-25 Thread thw
Add timestamps to maven output on Travis CI Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7f82a573 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7f82a573 Diff: http://git-wip-us.apache.or

[46/50] incubator-beam git commit: Closes #1135

2016-10-25 Thread thw
Closes #1135 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d285e85d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d285e85d Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[48/50] incubator-beam git commit: Closes #1175

2016-10-25 Thread thw
Closes #1175 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7de8d571 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7de8d571 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[50/50] incubator-beam git commit: Adjust for merge from master.

2016-10-25 Thread thw
Adjust for merge from master. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0a1b2789 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0a1b2789 Diff: http://git-wip-us.apache.org/repos/asf/in

[49/50] incubator-beam git commit: Merge branch 'master' into apex-runner

2016-10-25 Thread thw
Merge branch 'master' into apex-runner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6a971d6b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6a971d6b Diff: http://git-wip-us.apache.org/rep

[47/50] incubator-beam git commit: pom.xml: make Dataflow runner like every other runner

2016-10-25 Thread thw
pom.xml: make Dataflow runner like every other runner Pom dependencies no longer require it to be treated specially. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6291a6f6 Tree: http://git-wip-us.apache.or

[30/50] incubator-beam git commit: Fix Javadoc of ReadableState

2016-10-25 Thread thw
Fix Javadoc of ReadableState Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/caf1fb70 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/caf1fb70 Diff: http://git-wip-us.apache.org/repos/asf/inc

[19/50] incubator-beam git commit: Port some of ParDoTest to new DoFn

2016-10-25 Thread thw
Port some of ParDoTest to new DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/30940179 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/30940179 Diff: http://git-wip-us.apache.org/repos/a

[29/50] incubator-beam git commit: Fix ReduceFnRunner.cancelEndOfWindowAndGarbageCollectionTimers()

2016-10-25 Thread thw
Fix ReduceFnRunner.cancelEndOfWindowAndGarbageCollectionTimers() Before, it was only removing the end-of-window timer. Now, it also removed that GC timer. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/59f0

[23/50] incubator-beam git commit: Port direct runner to use new DoFn directly

2016-10-25 Thread thw
Port direct runner to use new DoFn directly Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1919d8b3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1919d8b3 Diff: http://git-wip-us.apache.or

[20/50] incubator-beam git commit: Move shared DelegatingAggregator out of OldDoFn

2016-10-25 Thread thw
Move shared DelegatingAggregator out of OldDoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/139437bd Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/139437bd Diff: http://git-wip-us.apach

[12/50] incubator-beam git commit: [BEAM-790] Refactor PipelineOptionsFactory validation into separate methods.

2016-10-25 Thread thw
[BEAM-790] Refactor PipelineOptionsFactory validation into separate methods. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b8098838 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b8098838

[10/50] incubator-beam git commit: Fix typo and dependencies in beam-runners-direct-java

2016-10-25 Thread thw
Fix typo and dependencies in beam-runners-direct-java Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5f946c6c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5f946c6c Diff: http://git-wip-us

[06/50] incubator-beam git commit: Switch the DirectRunner to use new DoFnRunner code path

2016-10-25 Thread thw
Switch the DirectRunner to use new DoFnRunner code path This does not yet switch to run new DoFn directly, but to use the generic DoFnRunner dispatch in preparation for switching over to the original DoFn instead of the wrapper as an OldDoFn. Project: http://git-wip-us.apache.org/repos/asf/incub

[22/50] incubator-beam git commit: Port ReifyTimestampAndWindowsDoFn to RequiresWindowAccess

2016-10-25 Thread thw
Port ReifyTimestampAndWindowsDoFn to RequiresWindowAccess This should become either a DoFn or probably more appropriately, just something internal to runners that actually require it to be manifested as a DoFn at all. As an intermediate migration step, this lessens the level to which it depends o

[05/50] incubator-beam git commit: Add OldDoFn.toDoFn() adapter

2016-10-25 Thread thw
Add OldDoFn.toDoFn() adapter Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/44878e57 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/44878e57 Diff: http://git-wip-us.apache.org/repos/asf/inc

[16/50] incubator-beam git commit: Add adapter from OldDoFn.RequiresWindowAccess to DoFn

2016-10-25 Thread thw
Add adapter from OldDoFn.RequiresWindowAccess to DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/164ee56b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/164ee56b Diff: http://git-wip-us

[25/50] incubator-beam git commit: Fix binding of aggregator creating in OldDoFn

2016-10-25 Thread thw
Fix binding of aggregator creating in OldDoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4e185d0b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4e185d0b Diff: http://git-wip-us.apache.

[09/50] incubator-beam git commit: Closes #1155

2016-10-25 Thread thw
Closes #1155 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/18e5d128 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/18e5d128 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[28/50] incubator-beam git commit: Make aggregator registration idempotent in FlinkRunner

2016-10-25 Thread thw
Make aggregator registration idempotent in FlinkRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2089c5cd Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2089c5cd Diff: http://git-wip-u

[18/50] incubator-beam git commit: Add setupDelegatingAggregators for DoFn (for now)

2016-10-25 Thread thw
Add setupDelegatingAggregators for DoFn (for now) Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c2e751f4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c2e751f4 Diff: http://git-wip-us.apa

[07/50] incubator-beam git commit: This closes #1141

2016-10-25 Thread thw
This closes #1141 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/15335112 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/15335112 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[34/50] incubator-beam git commit: Choose BigQuery Write implementation based on Input PCollection

2016-10-25 Thread thw
Choose BigQuery Write implementation based on Input PCollection Stop using PipelineOptions, and instead use the boundedness of the input to choose how to write to BigQuery. This means that runners that don't use the streaming flag still function appropriately. Fixes BEAM-746 Project: http://git

[08/50] incubator-beam git commit: Use DisplayData delegate in Dataflow Read transform override

2016-10-25 Thread thw
Use DisplayData delegate in Dataflow Read transform override Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4869ef19 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4869ef19 Diff: http://git

[27/50] incubator-beam git commit: Make DoFnTester aggregator initialization idempotent

2016-10-25 Thread thw
Make DoFnTester aggregator initialization idempotent Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/043ebeca Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/043ebeca Diff: http://git-wip-us.

[21/50] incubator-beam git commit: Fix NPE in SimpleDoFnRunner

2016-10-25 Thread thw
Fix NPE in SimpleDoFnRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0d500efe Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0d500efe Diff: http://git-wip-us.apache.org/repos/asf/incu

[26/50] incubator-beam git commit: Fix binding of aggregator delegation in DoFnAdapters

2016-10-25 Thread thw
Fix binding of aggregator delegation in DoFnAdapters Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2ab955d5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2ab955d5 Diff: http://git-wip-us.

[31/50] incubator-beam git commit: [BEAM-769] Spark: Make graceful stop the default.

2016-10-25 Thread thw
[BEAM-769] Spark: Make graceful stop the default. streaming tests fail on "nothing processed" if runtime env. is slow because timeout is hit before processing is done. Keep "pumping-in" the last batch in a mocked stream to handle overflowing batches in case of a graceful stop. Change tests acc

[37/50] incubator-beam git commit: [maven-release-plugin] prepare branch release-0.3.0-incubating

2016-10-25 Thread thw
[maven-release-plugin] prepare branch release-0.3.0-incubating Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c26b63ba Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c26b63ba Diff: http://g

[43/50] incubator-beam git commit: OffsetBasedSource: allow empty sources

2016-10-25 Thread thw
OffsetBasedSource: allow empty sources As one example, empty files exist. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7e9ad995 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7e9ad995 Di

[14/50] incubator-beam git commit: [BEAM-794] Differ combining in case of merging windows with sideInputs.

2016-10-25 Thread thw
[BEAM-794] Differ combining in case of merging windows with sideInputs. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a7cc8206 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a7cc8206 Diff:

[42/50] incubator-beam git commit: Closes #1169

2016-10-25 Thread thw
Closes #1169 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dfaf2a89 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/dfaf2a89 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[38/50] incubator-beam git commit: [maven-release-plugin] prepare for next development iteration

2016-10-25 Thread thw
[maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8dfadbf0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8dfadbf0 Diff: http://gi

[35/50] incubator-beam git commit: Add property name to RuntimeValueProvider

2016-10-25 Thread thw
Add property name to RuntimeValueProvider Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/462a6417 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/462a6417 Diff: http://git-wip-us.apache.org/

[32/50] incubator-beam git commit: Closes #1161

2016-10-25 Thread thw
Closes #1161 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6d9d8bc6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6d9d8bc6 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[39/50] incubator-beam git commit: This closes #1157

2016-10-25 Thread thw
This closes #1157 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c390a2a7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c390a2a7 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[44/50] incubator-beam git commit: Closes #1168

2016-10-25 Thread thw
Closes #1168 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/44b9f4eb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/44b9f4eb Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[41/50] incubator-beam git commit: [BEAM-806] update archetype poms in master

2016-10-25 Thread thw
[BEAM-806] update archetype poms in master Per the linked JIRA, maven release:branch did not do the right thing. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5d011847 Tree: http://git-wip-us.apache.org/re

[36/50] incubator-beam git commit: Closes #1107

2016-10-25 Thread thw
Closes #1107 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/69ae8bd7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/69ae8bd7 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

[40/50] incubator-beam git commit: This closes #1166

2016-10-25 Thread thw
This closes #1166 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b437c6b9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b437c6b9 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

<    1   2