[beam] branch master updated: [BEAM-3126] Adding a new Flatten test to Python SDK. (#4463)

2018-01-24 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new e70b068 [BEAM-3126] Adding a new Flatten test

[beam] branch master updated (3920cd7 -> d682042)

2018-01-23 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 3920cd7 Merge pull request #4454 [BEAM-3490] Explicitly use direct runner in non-portable tests. add 9b10739

[beam] 01/01: Merge pull request #4212 Remove legacy windowfn translation.

2018-01-23 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit d682042741079226af3ce2bf87a7a4452a2c9ba5 Merge: 3920cd7 9b10739 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] 01/01: Merge pull request #4454 [BEAM-3490] Explicitly use direct runner in non-portable tests.

2018-01-23 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 3920cd7b1270f658b79480b61ac15766d38f Merge: 19663de 4f92495 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (19663de -> 3920cd7)

2018-01-23 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 19663de Merge pull request #4278 from itamaro/patch-1 add 9641567 Manually specify direct runner for global

[beam] branch master updated (55844fa -> 94d5c0b)

2018-01-22 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 55844fa Merge pull request #4266 add 4719468 Curry CombineFn arguments into runner API protos. new

[beam] 01/01: Merge pull request #4437 from robertwb/runner-api-combine-fn

2018-01-22 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 94d5c0b71fa3017c855f59ced6c94fa5c7c735e0 Merge: 55844fa 4719468 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] 01/01: Merge pull request #4451 from robertwb/fn-api-pickle-side

2018-01-22 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit a5398118a81874a4c33f7c43be87a6496d0ccf97 Merge: 53e4b93 916caaf Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (53e4b93 -> a539811)

2018-01-22 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 53e4b93 Merge pull request #4459 from iemejia/BEAM-3492-spark-e2e-wordcount add 916caaf [BEAM-3490

[beam] branch master updated (49c839c -> 8982772)

2018-01-19 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 49c839c Merge pull request #4427 add 1f1904d [BEAM-3490] Wrap DistributionData in a DistributionResult

[beam] 01/01: Merge pull request #4450 [BEAM-3490] Wrap DistributionData in a DistributionResult

2018-01-19 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 898277297be7160900fdb48ed486a257a6bc92c0 Merge: 49c839c 1f1904d Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] 01/01: Merge pull request #4423 [BEAM-3486] Fixing Work Progress reporting

2018-01-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 1260a7da57530f100feb7773be737d2202c9d772 Merge: ca63b05 b0fc52e Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (ca63b05 -> 1260a7d)

2018-01-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from ca63b05 Merge pull request #4435 add b0fc52e Fixing Work Progress reporting new 1260a7d Merge pull

[beam] branch master updated: [BEAM-2732] Starting refactor of state tracking in Python (#4375)

2018-01-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 24e6bf8 [BEAM-2732] Starting refactor of state

[beam] 01/01: Merge pull request #4438 from robertwb/source-counters

2018-01-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit ed68f23eba0d8501dab04f086a38133fad1f3cd8 Merge: 1edea72 a1804f0 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (1edea72 -> ed68f23)

2018-01-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 1edea72 Merge pull request #4431 from robertwb/reshuffle add a1804f0 Enable counters from sources on workers

[beam] branch master updated (6f12558 -> 1edea72)

2018-01-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 6f12558 [BEAM-2863] Fix translation of side inputs due to missing method. add b65d4fa Fix reshuffle test

[beam] 01/01: Merge pull request #4431 from robertwb/reshuffle

2018-01-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 1edea725389e2d3dc32201a7a416b4daa0bf5dc9 Merge: 6f12558 2a972fc Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] 01/01: Merge pull request #4408 from youngoli/beam3126

2018-01-16 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 70a520ce9c0930742cf44efad6dbad1a5df29734 Merge: 441e30b bdcac3d Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (441e30b -> 70a520c)

2018-01-16 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 441e30b Merge pull request #4413 from DariuszAniszewski/use-virtualenv-for-perfkit-jobs add bdcac3d [BEAM

[beam] branch master updated (aff2a1e -> 5fd97c0)

2018-01-09 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from aff2a1e Merge pull request #4366 from udim/baseexception add c2a0883 Return state from wait_until_finish

[beam] branch go-sdk updated (f68f05e -> 2a0ba98)

2018-01-09 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch go-sdk in repository https://gitbox.apache.org/repos/asf/beam.git. from f68f05e Merge pull request #4350: Integrate master into go-sdk add d4b3624 Type-specialize custom decoders

[beam] 01/01: Merge pull request #4336 from herohde/runtime5

2018-01-09 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch go-sdk in repository https://gitbox.apache.org/repos/asf/beam.git commit 2a0ba9818c7f8468cdd1e2f8d28206882a5686bf Merge: f68f05e 0b43308 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] 01/01: Merge pull request #4344 from robertwb/user-metrics

2018-01-05 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit d2690fae0cd3c16b18973ed68f514a2f2319af2b Merge: 63e2696 a59b767 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (63e2696 -> d2690fa)

2018-01-05 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 63e2696 Merge pull request #4342 from chamikaramj/beam_sdf_cython_fix add a59b767 Plumb user metrics through

[beam] branch master updated: Correctly handle pass-through "composites" in the Fn Api Runner. (#4326)

2018-01-02 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 7d9bf07 Correctly handle pass-through

[beam] branch master updated (180e19b -> 5a72437)

2018-01-02 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 180e19b Avoid importing testing hierarchy for Javadoc comments. add 694c050 Clean data receive queue new

[beam] branch master updated (95e1751 -> aaa0ae6)

2017-12-22 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 95e1751 Merge pull request #4325 from tvalentyn/all_released_sdks_use_containers_tagged_with_beam_version add

[beam] branch master updated: Fix for side inputs following flatten/gbk. (#4281)

2017-12-20 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new d468d4a Fix for side inputs following flatten

[beam] branch master updated: [BEAM-2937] Basic PGBK combiner lifting. (#4290)

2017-12-20 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new e92f718 [BEAM-2937] Basic PGBK combiner

[beam] 01/01: Merge pull request #4293 from robertwb/BEAM-3369

2017-12-19 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 157787eceaf8e358e82508d0ea173164a6a97237 Merge: 0aa943d 550d6a5 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (0aa943d -> 157787e)

2017-12-19 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0aa943d Merge pull request #4292 from robertwb/BEAM-3369 add 550d6a5 [BEAM-3369] Allow any coder to specify

[beam] branch master updated (6709419 -> 0aa943d)

2017-12-19 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 6709419 Merge pull request #3817 from jkff/fileio-write add 76d32e2 [BEAM-3369] Fix typehint errors

[beam] 01/01: Merge pull request #4292 from robertwb/BEAM-3369

2017-12-19 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 0aa943df8e4a15669bd32672a587c69020161da7 Merge: 6709419 76d32e2 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] 01/01: Merge pull request #4247 from robertwb/runner-run

2017-12-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 1ff54bb17a45a532ffc1c9377da6e63760618180 Merge: 1acd1ae 8cf222d Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (1acd1ae -> 1ff54bb)

2017-12-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 1acd1ae Merge pull request #4282 from robertwb/type-inference add 8cf222d [BEAM-3183] Add runner.run

[beam] 01/01: Merge pull request #4282 from robertwb/type-inference

2017-12-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 1acd1ae901eefbcc8249d90e12ca82db0f91e41e Merge: 26560d0 8103010 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (26560d0 -> 1acd1ae)

2017-12-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 26560d0 Guard against closing data channel twice (#4283) add 8103010 Fix getitem and list comprehension type

[beam] branch master updated: Guard against closing data channel twice (#4283)

2017-12-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 26560d0 Guard against closing data channel

[beam] branch go-sdk updated: [BEAM-3356] Add Go SDK int and varint custom coders (#4276)

2017-12-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch go-sdk in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/go-sdk by this push: new 14eb2cd [BEAM-3356] Add Go SDK int and varint

[beam] branch master updated: [BEAM-3143] Type Inference Python 3 Compatibility (#4183)

2017-12-18 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new a424c64 [BEAM-3143] Type Inference Python 3

[beam] branch master updated (02c766a -> e4a187b)

2017-12-15 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 02c766a Merge pull request #4257 add e4a187b Allow Java Harness to understand Fns the Java Runner produces

[beam] 01/01: Merge pull request #4255 from robertwb/output-to-receive

2017-12-14 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit aba5b0d056a555922680e3530ca826857ed208ba Merge: 511c91e 7011651 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (511c91e -> aba5b0d)

2017-12-14 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 511c91e Fix javadoc in FnDataReceiver add 7011651 Followup fix to pr/4195. new aba5b0d Merge pull

[beam] branch master updated: [BEAM-1872] Add IdentityWindowFn for use in Reshuffle (#4040)

2017-12-06 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 9c1eeb2 [BEAM-1872] Add IdentityWindowFn

[beam] branch master updated (a26f124 -> fcdc49f)

2017-12-01 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from a26f124 Merge pull request #4174 from iemejia/BEAM-3244-dofn-flink add c773586 Ensure producers are always

[beam] 01/01: Merge pull request #4071 from robertwb/interactive-context

2017-12-01 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit fcdc49f0f5b922c68f791f214da9cd91907a7092 Merge: a26f124 c773586 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated: Various worker cleanups. (#4195)

2017-11-30 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 8f7517d Various worker cleanups. (#4195

[beam] branch master updated (ead5d43 -> fc56f09)

2017-11-29 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from ead5d43 This closes #4177: [BEAM-2870] Strips partition decorators when creating/patching tables in batch add

[beam] 01/01: Merge pull request #4126 from holdenk/BEAM-3164-capture-gen-prot-errors

2017-11-29 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit fc56f094738e6678b47d3072da70804db016d1f1 Merge: ead5d43 3651bf9 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] 01/01: Merge pull request #4186 from robertwb/retry

2017-11-29 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 06b52a0fbd820f2d41b7a6204d373db2f7090837 Merge: 26b0f9d 032c2d8 Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated (26b0f9d -> 06b52a0)

2017-11-29 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 26b0f9d This closes #4192 add 032c2d8 Also backoff on IO Exceptions. new 06b52a0 Merge pull request

[beam] branch robertwb-patch-1 deleted (was 442320e)

2017-11-27 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch robertwb-patch-1 in repository https://gitbox.apache.org/repos/asf/beam.git. was 442320e Fix typo The revisions that were on this branch are still contained in other references

[beam] branch master updated (5ee52e4 -> 4fde68b)

2017-11-27 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 5ee52e4 Fix typo in proto files. add 442320e Fix typo new 4fde68b Merge pull request #4181 from apache

[beam] 01/01: Merge pull request #4181 from apache/robertwb-patch-1

2017-11-27 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 4fde68b68c2a89dbe327c0781e5e7bc9f4b46664 Merge: 5ee52e4 442320e Author: Robert Bradshaw <rober...@gmail.com> Auth

[beam] branch master updated: Fix typo in proto files.

2017-11-27 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 5ee52e4 Fix typo in proto files. 5ee52e4

[2/2] beam git commit: Remove obsolete dependence of FnApiRunner on MapTaskExecutorRunner.

2017-11-21 Thread robertwb
: @@ -817,218 +808,6 @@ class FnApiRunner(maptask_executor_runner.MapTaskExecutorRunner): raise NotImplementedError(pcoll_id) return result - # This is the "old" way of executing pipelines. - # TODO(robertwb): Remove once runner API supports side inputs. - - def

[1/2] beam git commit: Closes #4104

2017-11-21 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 969c94390 -> b548e1f0f Closes #4104 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b548e1f0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b548e1f0 Diff:

[2/2] beam git commit: Cleanup temp file handling in tests.

2017-11-21 Thread robertwb
Cleanup temp file handling in tests. Also reduces flakiness when temp files were not properly isolated. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/151bc263 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/151bc263

[1/2] beam git commit: Closes #4156

2017-11-21 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 603f86a26 -> 969c94390 Closes #4156 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/969c9439 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/969c9439 Diff:

[2/2] beam git commit: Closes #4159

2017-11-21 Thread robertwb
Closes #4159 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e9d746a3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e9d746a3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e9d746a3 Branch: refs/heads/master

[1/2] beam git commit: Add logging and test aborting for timeouts.

2017-11-21 Thread robertwb
Repository: beam Updated Branches: refs/heads/master fb41b2950 -> e9d746a34 Add logging and test aborting for timeouts. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/768c854f Tree:

[GitHub] beam pull request #4159: [BEAM-3040] Add logging and test aborting for timeo...

2017-11-21 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/4159 [BEAM-3040] Add logging and test aborting for timeouts. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4156: Cleanup temp file handling in tests.

2017-11-21 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/4156 Cleanup temp file handling in tests. Also reduces flakiness when temp files were not properly isolated. Follow this checklist to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #4152: Test GitHub pr 4123

2017-11-21 Thread robertwb
Github user robertwb closed the pull request at: https://github.com/apache/beam/pull/4152 ---

[2/3] beam git commit: Add option to run PTransform steps from PipelineRunner

2017-11-21 Thread robertwb
Add option to run PTransform steps from PipelineRunner Added PipelineRunner.run(PTransform) method. Added PipelineTest.testRunPTransform() test case. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9bd5e6f9 Tree:

[1/3] beam git commit: Minor cleanup.

2017-11-21 Thread robertwb
Repository: beam Updated Branches: refs/heads/master ed40093d8 -> fb41b2950 Minor cleanup. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1b8abfba Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1b8abfba Diff:

[GitHub] beam pull request #4152: Test GitHub pr 4123

2017-11-20 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/4152 Test GitHub pr 4123 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects

[1/2] beam git commit: Closes #4132

2017-11-14 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 4ddfc5844 -> 9f780c960 Closes #4132 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9f780c96 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9f780c96 Diff:

[2/2] beam git commit: Update minimum cython version to 0.26.1

2017-11-14 Thread robertwb
Update minimum cython version to 0.26.1 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0f738087 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0f738087 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0f738087

[2/2] beam git commit: [BEAM-3150] Fix threading for progress reporting in SDKHarness

2017-11-14 Thread robertwb
[BEAM-3150] Fix threading for progress reporting in SDKHarness Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4403b348 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4403b348 Diff:

[1/2] beam git commit: Closes #4094

2017-11-14 Thread robertwb
Repository: beam Updated Branches: refs/heads/master a5254e730 -> 4ddfc5844 Closes #4094 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4ddfc584 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4ddfc584 Diff:

[GitHub] beam pull request #4104: Remove obsolete dependence of FnApiRunner on MapTas...

2017-11-08 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/4104 Remove obsolete dependence of FnApiRunner on MapTaskExecutorRunner. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[1/2] beam git commit: [BEAM-3040] Disable flaky subprocess variant of ULR test.

2017-11-08 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 598774738 -> 29399fde8 [BEAM-3040] Disable flaky subprocess variant of ULR test. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/30740a53 Tree:

[2/2] beam git commit: Closes #4099

2017-11-08 Thread robertwb
Closes #4099 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/29399fde Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/29399fde Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/29399fde Branch: refs/heads/master

[GitHub] beam pull request #4099: [BEAM-3040] Disable flaky subprocess variant of ULR...

2017-11-08 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/4099 [BEAM-3040] Disable flaky subprocess variant of ULR test. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4071: Ensure producers are always set on unpickling from ...

2017-11-01 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/4071 Ensure producers are always set on unpickling from runner api protos. Also add (optional) access to the contexts on serializing and deserializing pipelines. Follow this checklist

[2/2] beam git commit: Implement FnApi side inputs in Python.

2017-10-22 Thread robertwb
led in later, the key point is that the # same object is returned for the same pcollection id. return PCollection(None, element_type=pickler.loads(proto.coder_id)) @@ -288,6 +289,81 @@ class AsSideInput(object): def element_type(self): return typehints.Any + # TODO(robert

[1/2] beam git commit: Closes #4020

2017-10-22 Thread robertwb
Repository: beam Updated Branches: refs/heads/master a71f00078 -> 77c77add1 Closes #4020 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/77c77add Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/77c77add Diff:

[GitHub] beam pull request #4020: [BEAM-2927] Python SDK support for portable side in...

2017-10-19 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/4020 [BEAM-2927] Python SDK support for portable side input Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[1/2] beam git commit: Closes #3939

2017-10-16 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 014614b69 -> 245d77338 Closes #3939 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/245d7733 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/245d7733 Diff:

[2/2] beam git commit: Add progress metrics to Python SDK.

2017-10-16 Thread robertwb
# but special side input writes may go here. raise NotImplementedError(pcoll_id) +return result # This is the "old" way of executing pipelines. # TODO(robertwb): Remove once runner API supports side inputs. @@ -1071,6 +1074,12 @@ class FnApiRunner(maptask_exe

[1/2] beam git commit: Closes #3971

2017-10-13 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 3dc755994 -> 7f5753f1f Closes #3971 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7f5753f1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7f5753f1 Diff:

[2/2] beam git commit: Add an element batching transform.

2017-10-13 Thread robertwb
Add an element batching transform. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d226c767 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d226c767 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d226c767

[1/3] beam git commit: Closes #3941

2017-10-13 Thread robertwb
Repository: beam Updated Branches: refs/heads/master a3a7807fe -> 3dc755994 Closes #3941 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3dc75599 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3dc75599 Diff:

[3/3] beam git commit: Align names with those produced by the dataflow runner harness.

2017-10-13 Thread robertwb
Align names with those produced by the dataflow runner harness. These will be unused once the runner harness produces the correct transform payloads. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ec192d15 Tree:

[2/3] beam git commit: Fix from any -> bytes transition.

2017-10-13 Thread robertwb
Fix from any -> bytes transition. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d91ebd9f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d91ebd9f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d91ebd9f Branch:

[16/18] beam git commit: Break out the exclusion list for futurize

2017-10-12 Thread robertwb
Break out the exclusion list for futurize Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cf2be415 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/cf2be415 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/cf2be415

[07/18] beam git commit: re-order imports (AUTOMATED isort)

2017-10-12 Thread robertwb
re-order imports (AUTOMATED isort) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/94739377 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/94739377 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/94739377

[05/18] beam git commit: Cleanup whitespace (AUTOMATED autopep8)

2017-10-12 Thread robertwb
Cleanup whitespace (AUTOMATED autopep8) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7d0040db Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7d0040db Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7d0040db

[15/18] beam git commit: Clarify docstring and update run_pylint to be more clear about what steps the developer can take

2017-10-12 Thread robertwb
Clarify docstring and update run_pylint to be more clear about what steps the developer can take Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bf910c11 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bf910c11 Diff:

[17/18] beam git commit: Change the examples with long-lambdas which were pulled out into defs to use explicit tuple unpacking instead of indexing. Note: this still keeps the lambdas which are short e

2017-10-12 Thread robertwb
Change the examples with long-lambdas which were pulled out into defs to use explicit tuple unpacking instead of indexing. Note: this still keeps the lambdas which are short enough and those use indexing (as required). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[12/18] beam git commit: Fix snippets

2017-10-12 Thread robertwb
Fix snippets Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9de10e2d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9de10e2d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9de10e2d Branch: refs/heads/master

[10/18] beam git commit: Restore license position that got screwed up

2017-10-12 Thread robertwb
Restore license position that got screwed up Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c0bc5840 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c0bc5840 Diff:

[08/18] beam git commit: Parallelize pylint

2017-10-12 Thread robertwb
Parallelize pylint Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/252c6798 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/252c6798 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/252c6798 Branch:

[06/18] beam git commit: Fix remaining style issues from auto conversion, switch ref in pylint to stage 1 (stages in futurize are apparently 1 indexed)

2017-10-12 Thread robertwb
Fix remaining style issues from auto conversion, switch ref in pylint to stage 1 (stages in futurize are apparently 1 indexed) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cd702b3e Tree:

[14/18] beam git commit: pr/cl-feedback from c-y-koo

2017-10-12 Thread robertwb
pr/cl-feedback from c-y-koo Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3a04dbe4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3a04dbe4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3a04dbe4 Branch:

[03/18] beam git commit: Add special work to handle indexable return types. Introduce a base IndexableTypeConstraint.

2017-10-12 Thread robertwb
Add special work to handle indexable return types. Introduce a base IndexableTypeConstraint. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f364248b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f364248b Diff:

[09/18] beam git commit: Add future to deps and explicitly set isort req and update pylint in tox ini

2017-10-12 Thread robertwb
Add future to deps and explicitly set isort req and update pylint in tox ini Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fe0dc2e2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fe0dc2e2 Diff:

[01/18] beam git commit: Add futurize to pylint script

2017-10-12 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 655227ab0 -> 9c2a6e771 Add futurize to pylint script Break down futurize pylint Fix the pylint script checking futurize Consists of: Quote the futurize options shell scripting Jenkins seems to be having weird behaviour with

<    9   10   11   12   13   14   15   16   17   18   >