[1/2] beam git commit: Port fn_api_runner to be able to use runner protos.

2017-06-20 Thread robertwb
# Record the contents of each side input for access via the state api. +side_input_extras = [] +for si in operation.side_inputs: + assert isinstance(si.source, iobase.BoundedSource) + element_coder = si.source.default_output_coder() + # TODO(robertwb):

[2/2] beam git commit: Closes #3361

2017-06-20 Thread robertwb
Closes #3361 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e4ef23e1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e4ef23e1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e4ef23e1 Branch: refs/heads/master Com

[1/2] beam git commit: Closes #3385

2017-06-19 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 1fb430442 -> 1476f3412 Closes #3385 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1476f341 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1476f341 Diff: http://g

[2/2] beam git commit: Add dry run option to DataflowRunner

2017-06-19 Thread robertwb
Add dry run option to DataflowRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c2683e87 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c2683e87 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c2683e87 Branc

[1/2] beam git commit: Populate PBegin input when decoding from Runner API

2017-06-16 Thread robertwb
Repository: beam Updated Branches: refs/heads/master e827642ef -> 0cabdf6e7 Populate PBegin input when decoding from Runner API Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4519681e Tree: http://git-wip-us.apache.org/repo

[2/2] beam git commit: Closes #3373

2017-06-16 Thread robertwb
Closes #3373 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0cabdf6e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0cabdf6e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0cabdf6e Branch: refs/heads/master Com

[2/2] beam git commit: [BEAM-1585] Add beam plugins as pipeline options

2017-06-14 Thread robertwb
[BEAM-1585] Add beam plugins as pipeline options Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/329bf1e7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/329bf1e7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/329

[1/2] beam git commit: Closes #3359

2017-06-14 Thread robertwb
Repository: beam Updated Branches: refs/heads/master c96208347 -> 42c88f415 Closes #3359 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/42c88f41 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/42c88f41 Diff: http://g

[GitHub] beam pull request #3361: [BEAM-115] Port fn_api_runner to be able to use run...

2017-06-14 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3361 [BEAM-115] Port fn_api_runner to be able to use runner protos. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[2/2] beam git commit: Closes #3354

2017-06-13 Thread robertwb
Closes #3354 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/eebff908 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/eebff908 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/eebff908 Branch: refs/heads/master Com

[1/2] beam git commit: Move Runner API protos to portability/api

2017-06-13 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 646caf255 -> eebff9089 Move Runner API protos to portability/api Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7e4e51fd Tree: http://git-wip-us.apache.org/repos/asf/beam

[1/2] beam git commit: Closes #3339

2017-06-13 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 7126fdc6e -> bd83612f2 Closes #3339 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bd83612f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bd83612f Diff: http://g

[2/2] beam git commit: Actually test the fn_api_runner.

2017-06-13 Thread robertwb
Actually test the fn_api_runner. The test suite was not being run due to a typo. Fix breakage due to changes in the code in the meantime. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e71eb66a Tree: http://git-wip-us.apache.o

[GitHub] beam pull request #3339: Actually test the fn_api_runner.

2017-06-09 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3339 Actually test the fn_api_runner. The test suite was not being run due to a typo. Fix breakage due to changes in the code in the meantime. Be sure to do all of the following to help us

[2/2] beam git commit: Use beam.Map rather than beam.ParDo for PubSub encoding.

2017-06-09 Thread robertwb
Use beam.Map rather than beam.ParDo for PubSub encoding. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fb61c540 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fb61c540 Diff: http://git-wip-us.apache.org/repos/asf/beam/

[1/2] beam git commit: Closes #3332

2017-06-09 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 97957ea0e -> d2c4093ed Closes #3332 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d2c4093e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d2c4093e Diff: http://g

[GitHub] beam pull request #3332: Use beam.Map rather than beam.ParDo for PubSub enco...

2017-06-08 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3332 Use beam.Map rather than beam.ParDo for PubSub encoding. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[2/2] beam git commit: Use inner module for non-public coders.

2017-06-08 Thread robertwb
Use inner module for non-public coders. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/36aea2d2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/36aea2d2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/36aea2d2 Br

[1/2] beam git commit: Closes #3325

2017-06-08 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 4aef93854 -> 7c5a70edb Closes #3325 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7c5a70ed Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7c5a70ed Diff: http://g

[GitHub] beam pull request #3325: Use inner module for non-public coders.

2017-06-07 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3325 Use inner module for non-public coders. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3324: Avoid flakiness in data channel for empty streams.

2017-06-07 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3324 Avoid flakiness in data channel for empty streams. As empty stream is used as end-of-stream marker, don't ever send it as the data itself. Be sure to do all of the following to he

[1/2] beam git commit: Closes #3317

2017-06-07 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 0a0a1bc74 -> 86e1fab69 Closes #3317 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/86e1fab6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/86e1fab6 Diff: http://g

[2/2] beam git commit: Add coder info to pubsub io

2017-06-07 Thread robertwb
cription) if transform.source.id_label: step.add_property(PropertyNames.PUBSUB_ID_LABEL, transform.source.id_label) @@ -639,7 +641,12 @@ class DataflowRunner(PipelineRunner): # step should be the type of value outputted by each step. Read steps

[GitHub] beam pull request #3308: Fix imports in sdk_worker.

2017-06-06 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3308 Fix imports in sdk_worker. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM

[1/5] beam git commit: Unify Java and Python WindowingStrategy representations.

2017-06-02 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 7a075cc34 -> 2f9428c3e Unify Java and Python WindowingStrategy representations. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/de757860 Tree: http://git-wip-us.apache.org

[4/5] beam git commit: Closes #3222

2017-06-02 Thread robertwb
Closes #3222 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2f9428c3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2f9428c3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2f9428c3 Branch: refs/heads/master Com

[2/5] beam git commit: Ignore all proto generated files.

2017-06-02 Thread robertwb
Ignore all proto generated files. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4c20bfa9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4c20bfa9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4c20bfa9 Branch:

[3/5] beam git commit: Increase dataflow worker version.

2017-06-02 Thread robertwb
Increase dataflow worker version. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/99907b94 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/99907b94 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/99907b94 Branch:

[5/5] beam git commit: Add known window serialization for Java.

2017-06-02 Thread robertwb
Add known window serialization for Java. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b490e84e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b490e84e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b490e84e B

[1/2] beam git commit: Closes #3226

2017-05-26 Thread robertwb
Repository: beam Updated Branches: refs/heads/master b0fb5b24d -> 2994fce73 Closes #3226 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2994fce7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2994fce7 Diff: http://g

[2/2] beam git commit: [BEAM-2365] Use the highest pickle protocol available.

2017-05-26 Thread robertwb
[BEAM-2365] Use the highest pickle protocol available. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/86912a23 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/86912a23 Diff: http://git-wip-us.apache.org/repos/asf/beam/di

[1/2] beam git commit: [BEAM-2366] Don't try to pickle gen_protos in tests.

2017-05-26 Thread robertwb
Repository: beam Updated Branches: refs/heads/master c7a37b4b1 -> b70e25cf9 [BEAM-2366] Don't try to pickle gen_protos in tests. Tests that pickle the main session but are run from setup.py attempt to pickle everything visible in setup.py. Project: http://git-wip-us.apache.org/repos/asf/beam

[2/2] beam git commit: Closes #3228

2017-05-26 Thread robertwb
Closes #3228 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b70e25cf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b70e25cf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b70e25cf Branch: refs/heads/master Com

[1/2] beam git commit: Additional explicit file cleanup in gen_protos.

2017-05-25 Thread robertwb
Repository: beam Updated Branches: refs/heads/master f10ee01fb -> 7bb10a694 Additional explicit file cleanup in gen_protos. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a75f41cc Tree: http://git-wip-us.apache.org/repos/as

[2/2] beam git commit: Closes #3229

2017-05-25 Thread robertwb
Closes #3229 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7bb10a69 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7bb10a69 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7bb10a69 Branch: refs/heads/master Com

[GitHub] beam pull request #3229: Additional explicit file cleanup in gen_protos.

2017-05-25 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3229 Additional explicit file cleanup in gen_protos. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #3228: [BEAM-2366] Don't try to pickle gen_protos in tests...

2017-05-25 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3228 [BEAM-2366] Don't try to pickle gen_protos in tests. Tests that pickle the main session but are run from setup.py attempt to pickle everything visible in setup.py. Be sure to do a

[GitHub] beam pull request #3226: [BEAM-2365] Use the highest pickle protocol availab...

2017-05-25 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3226 [BEAM-2365] Use the highest pickle protocol available. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[2/2] beam git commit: More robust gen_protos on jenkins.

2017-05-25 Thread robertwb
More robust gen_protos on jenkins. Don't use the globally shared build directory, which pip may refuse to use if there's a failed install. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6b21ea66 Tree: http://git-wip-us.apache.

[1/2] beam git commit: Closes #3224

2017-05-25 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 36436768d -> a03a638e0 Closes #3224 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a03a638e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a03a638e Diff: http://g

[GitHub] beam pull request #3224: More robust gen_protos on jenkins.

2017-05-25 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3224 More robust gen_protos on jenkins. Don't use the globally shared build directory, which pip may refuse to use if there's a failed install. Be sure to do all of the following

[GitHub] beam pull request #3222: [BEAM-115] Unify Java and Python WindowingStragegy ...

2017-05-24 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3222 [BEAM-115] Unify Java and Python WindowingStragegy representations. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[2/2] beam git commit: Closes #3200

2017-05-24 Thread robertwb
Closes #3200 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c0d19f9f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c0d19f9f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c0d19f9f Branch: refs/heads/master Com

[1/2] beam git commit: Adding a snippet for metrics

2017-05-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 4084f71a1 -> c0d19f9f7 Adding a snippet for metrics Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f32cacb7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f32cacb

[2/2] beam git commit: Closes #3170

2017-05-24 Thread robertwb
Closes #3170 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4084f71a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4084f71a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4084f71a Branch: refs/heads/master Com

[1/2] beam git commit: A couple of worker fixes.

2017-05-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 24fb4cda6 -> 4084f71a1 A couple of worker fixes. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e9cb40dc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e9cb40dc D

[3/6] beam git commit: Remove auto-generated proto and grpc files.

2017-05-24 Thread robertwb
http://git-wip-us.apache.org/repos/asf/beam/blob/c2e85daa/sdks/python/apache_beam/runners/api/beam_fn_api_pb2_grpc.py -- diff --git a/sdks/python/apache_beam/runners/api/beam_fn_api_pb2_grpc.py b/sdks/python/apache_beam/runners/ap

[1/6] beam git commit: Closes #3214

2017-05-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 539e229fe -> 24fb4cda6 Closes #3214 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/24fb4cda Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/24fb4cda Diff: http://g

[4/6] beam git commit: Remove auto-generated proto and grpc files.

2017-05-24 Thread robertwb
http://git-wip-us.apache.org/repos/asf/beam/blob/c2e85daa/sdks/python/apache_beam/runners/api/beam_fn_api_pb2.py -- diff --git a/sdks/python/apache_beam/runners/api/beam_fn_api_pb2.py b/sdks/python/apache_beam/runners/api/beam_fn_

[2/6] beam git commit: Remove auto-generated proto and grpc files.

2017-05-24 Thread robertwb
http://git-wip-us.apache.org/repos/asf/beam/blob/c2e85daa/sdks/python/apache_beam/runners/api/beam_runner_api_pb2.py -- diff --git a/sdks/python/apache_beam/runners/api/beam_runner_api_pb2.py b/sdks/python/apache_beam/runners/api/

[6/6] beam git commit: Automatically generate Python proto and grpc files.

2017-05-24 Thread robertwb
Automatically generate Python proto and grpc files. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bb2b7064 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bb2b7064 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/

[5/6] beam git commit: Remove auto-generated proto and grpc files.

2017-05-24 Thread robertwb
Remove auto-generated proto and grpc files. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c2e85daa Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c2e85daa Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c2e85daa

[GitHub] beam pull request #3214: Automatically generate proto files for Python

2017-05-23 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3214 Automatically generate proto files for Python Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[2/3] beam git commit: Automatically convert examples to use with syntax.

2017-05-23 Thread robertwb
Automatically convert examples to use with syntax. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3a62b4f7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3a62b4f7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3

[1/3] beam git commit: Automatically convert examples to use with syntax.

2017-05-23 Thread robertwb
Repository: beam Updated Branches: refs/heads/master d0601b30c -> 474345f59 http://git-wip-us.apache.org/repos/asf/beam/blob/3a62b4f7/sdks/python/apache_beam/examples/snippets/snippets_test.py -- diff --git a/sdks/python/apache

[3/3] beam git commit: Closes #3180

2017-05-23 Thread robertwb
Closes #3180 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/474345f5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/474345f5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/474345f5 Branch: refs/heads/master Com

[GitHub] beam pull request #3180: Update examples to use (less error prone) pipeline ...

2017-05-18 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3180 Update examples to use (less error prone) pipeline as context. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3170: A couple of worker fixes.

2017-05-17 Thread robertwb
GitHub user robertwb reopened a pull request: https://github.com/apache/beam/pull/3170 A couple of worker fixes. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3170: A couple of worker fixes.

2017-05-17 Thread robertwb
Github user robertwb closed the pull request at: https://github.com/apache/beam/pull/3170 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3170: A couple of worker fixes.

2017-05-17 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3170 A couple of worker fixes. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM

[2/2] beam git commit: Closes #3101

2017-05-11 Thread robertwb
Closes #3101 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/07e5536b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/07e5536b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/07e5536b Branch: refs/heads/master Com

[1/2] beam git commit: Fix due to GBKO name change.

2017-05-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 37e0b437e -> 07e5536bc Fix due to GBKO name change. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fc3e28de Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fc3e28d

[GitHub] beam pull request #3101: Fix due to GBKO name change.

2017-05-11 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3101 Fix due to GBKO name change. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[2/2] beam git commit: Closes #3086

2017-05-11 Thread robertwb
Closes #3086 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1b31167f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1b31167f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1b31167f Branch: refs/heads/master Com

[1/2] beam git commit: Move assert_that, equal_to, is_empty to apache_beam.testing.util

2017-05-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 4a62fabdb -> 1b31167fb Move assert_that, equal_to, is_empty to apache_beam.testing.util Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0b7356e3 Tree: http://git-wip-us.ap

[2/4] beam git commit: [BEAM-1345] Annotate public members of pvalue.

2017-05-11 Thread robertwb
[BEAM-1345] Annotate public members of pvalue. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d531219f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d531219f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d5312

[3/4] beam git commit: [BEAM-1345] Clearly delineate public api in apache_beam/typehints.

2017-05-11 Thread robertwb
[BEAM-1345] Clearly delineate public api in apache_beam/typehints. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7881fd5e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7881fd5e Diff: http://git-wip-us.apache.org/repos

[1/4] beam git commit: [BEAM-1345] Mark apache_beam/internal as internal.

2017-05-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 0fd0409bf -> 4a62fabdb [BEAM-1345] Mark apache_beam/internal as internal. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/16a3fff1 Tree: http://git-wip-us.apache.org/repos

[4/4] beam git commit: Closes #3094

2017-05-11 Thread robertwb
Closes #3094 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4a62fabd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4a62fabd Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4a62fabd Branch: refs/heads/master Com

[1/2] beam git commit: [BEAM-1340] Add __all__ tags to modules in package apache_beam/transforms

2017-05-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master e10662df9 -> 463f1ee7b [BEAM-1340] Add __all__ tags to modules in package apache_beam/transforms Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2e6451df Tree: http://git-

[2/2] beam git commit: Closes #3075

2017-05-11 Thread robertwb
Closes #3075 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/463f1ee7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/463f1ee7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/463f1ee7 Branch: refs/heads/master Com

[1/2] beam git commit: Add __all__ tags to modules in package apache_beam/testing

2017-05-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 0cc6dd727 -> d26f27b48 Add __all__ tags to modules in package apache_beam/testing Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/101141da Tree: http://git-wip-us.apache.o

[2/2] beam git commit: Closes #3076

2017-05-11 Thread robertwb
Closes #3076 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d26f27b4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d26f27b4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d26f27b4 Branch: refs/heads/master Com

[1/2] beam git commit: [BEAM-1340] Adds __all__ tags to classes in package apache_beam/io.

2017-05-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 47cbabbd2 -> 0cc6dd727 [BEAM-1340] Adds __all__ tags to classes in package apache_beam/io. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b8196295 Tree: http://git-wip-us

[2/2] beam git commit: Closes #3089

2017-05-11 Thread robertwb
Closes #3089 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0cc6dd72 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0cc6dd72 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0cc6dd72 Branch: refs/heads/master Com

[2/2] beam git commit: Closes #3090

2017-05-11 Thread robertwb
Closes #3090 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/47cbabbd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/47cbabbd Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/47cbabbd Branch: refs/heads/master Com

[1/2] beam git commit: [BEAM-1345] Clearly delineate public api in apache_beam/coders.

2017-05-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master b1c51ccbe -> 47cbabbd2 [BEAM-1345] Clearly delineate public api in apache_beam/coders. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/05557c85 Tree: http://git-wip-us.apa

[2/3] beam git commit: [BEAM-1345] Clearly delineate public api in runners package.

2017-05-11 Thread robertwb
[BEAM-1345] Clearly delineate public api in runners package. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c8317345 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c8317345 Diff: http://git-wip-us.apache.org/repos/asf/b

[3/3] beam git commit: Closes #3096

2017-05-11 Thread robertwb
Closes #3096 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b1c51ccb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b1c51ccb Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b1c51ccb Branch: refs/heads/master Com

[1/3] beam git commit: [BEAM-1345] Mark Pipeline as public.

2017-05-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 5eab219b7 -> b1c51ccbe [BEAM-1345] Mark Pipeline as public. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1b89697e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree

[GitHub] beam pull request #3096: [BEAM-1345] Clearly delineate public api in pipelin...

2017-05-11 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3096 [BEAM-1345] Clearly delineate public api in pipeline and runners. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3094: Pvalue all

2017-05-11 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3094 Pvalue all Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description

[GitHub] beam pull request #3090: [BEAM-1345] Clearly delineate public api in apache_...

2017-05-11 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3090 [BEAM-1345] Clearly delineate public api in apache_beam/coders. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3065: Make a couple more things private in the Python SDK

2017-05-10 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3065 Make a couple more things private in the Python SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #3056: [BEAM-2240] Cherry Pick #3012 onto release-2.0.0

2017-05-10 Thread robertwb
Github user robertwb closed the pull request at: https://github.com/apache/beam/pull/3056 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-2240] Always augment exception with step name.

2017-05-10 Thread robertwb
[BEAM-2240] Always augment exception with step name. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/baa17835 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/baa17835 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff

[1/2] beam git commit: Closes #3012

2017-05-10 Thread robertwb
Repository: beam Updated Branches: refs/heads/master df1704b6f -> 7af59374c Closes #3012 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7af59374 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7af59374 Diff: http://g

[GitHub] beam pull request #3056: [BEAM-2240] Cherry Pick #3012 onto release-2.0.0

2017-05-10 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3056 [BEAM-2240] Cherry Pick #3012 onto release-2.0.0 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #3012: [BEAM-2240] Always augment exception with step name...

2017-05-09 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3012 [BEAM-2240] Always augment exception with step name. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #2960: [BEAM-2166] Cherry-pick #2930 and #2933 onto releas...

2017-05-09 Thread robertwb
Github user robertwb closed the pull request at: https://github.com/apache/beam/pull/2960 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2924: [BEAM-2166] Mark coders using context as experiment...

2017-05-09 Thread robertwb
Github user robertwb closed the pull request at: https://github.com/apache/beam/pull/2924 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2978: [BEAM-2224] Cherry-pick #2965, #2971, #2975 onto re...

2017-05-09 Thread robertwb
Github user robertwb closed the pull request at: https://github.com/apache/beam/pull/2978 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/4] beam git commit: [BEAM-2224] Fix temp file management on Windows.

2017-05-09 Thread robertwb
Repository: beam Updated Branches: refs/heads/release-2.0.0 f7e85e230 -> 3c6316abf [BEAM-2224] Fix temp file management on Windows. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/40699172 Tree: http://git-wip-us.apache.org/

[3/4] beam git commit: [BEAM-2184] Rename OutputTimeFn to TimestampCombiner.

2017-05-09 Thread robertwb
runner_api(context), accumulation_mode=self.accumulation_mode, -output_time=self.output_time_fn, +output_time=self.timestamp_combiner, # TODO(robertwb): Support EMIT_IF_NONEMPTY closing_behavior=beam_runner_api_pb2.EMIT_ALWAYS, allowed_lateness=0)

[2/4] beam git commit: Don't log full exception traceback in direct runner.

2017-05-09 Thread robertwb
Don't log full exception traceback in direct runner. It will be logged later if not caught. This reduces duplication for failing tests, and noise for tests expecting failure. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f3f

[4/4] beam git commit: Closes #2978

2017-05-09 Thread robertwb
Closes #2978 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3c6316ab Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3c6316ab Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3c6316ab Branch: refs/heads/release-2.

[2/2] beam git commit: Closes #2976

2017-05-09 Thread robertwb
Closes #2976 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/395d14e3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/395d14e3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/395d14e3 Branch: refs/heads/master Com

[1/2] beam git commit: Actually run after-count tests.

2017-05-09 Thread robertwb
Repository: beam Updated Branches: refs/heads/master e10fbdaa2 -> 395d14e33 Actually run after-count tests. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1f194057 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1f19

[2/2] beam git commit: Closes #2963

2017-05-08 Thread robertwb
Closes #2963 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d96fd173 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d96fd173 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d96fd173 Branch: refs/heads/master Com

[1/2] beam git commit: [BEAM-1925] validate DoFn at pipeline creation time

2017-05-08 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 844762d10 -> d96fd173c [BEAM-1925] validate DoFn at pipeline creation time Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9283a5e8 Tree: http://git-wip-us.apache.org/repo

<    12   13   14   15   16   17   18   19   20   >