[1/3] incubator-beam git commit: Add Parameters to finishSpecifying

2016-12-21 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 57d9bbd79 -> 7984fe3fc Add Parameters to finishSpecifying Remove the need to use getProducingTransformInternal in TypedPValue. Ensure that all nodes are finished specifying before a call to TransformHierarchy#visit. This ensures

[2/3] incubator-beam git commit: Use CountingSource in ForceStreamingTest

2016-12-21 Thread tgroh
Use CountingSource in ForceStreamingTest Removes the requirement to have a FakeUnboundedSource, plus the read is fully specified. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b053be46 Tree:

[3/3] incubator-beam git commit: This closes #1582

2016-12-21 Thread tgroh
This closes #1582 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7984fe3f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7984fe3f Diff:

[GitHub] incubator-beam pull request #1677: Add a Test for Flatten with Heterogeneous...

2016-12-21 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1677 Add a Test for Flatten with Heterogeneous Coders Add a category, and suppress in the Flink and Apex runners Be sure to do all of the following to help us incorporate your

[1/2] incubator-beam git commit: This closes #1569

2016-12-20 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 6a05d7f17 -> aadcf3a12 This closes #1569 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/aadcf3a1 Tree:

[2/2] incubator-beam git commit: Provide local tags in PInput, POutput expansions

2016-12-20 Thread tgroh
Provide local tags in PInput, POutput expansions Output an ordered colleciton in PInput and POutput expansions. This provides information that is necessary to reconstruct a PInput or POutput from its expansion. Implement PCollectionList.equals, PCollectionTuple.equals Project:

[1/2] incubator-beam git commit: Add PTransformOverrideFactory to the Core SDK

2016-12-16 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 217c29bfc -> cc28f0cb4 Add PTransformOverrideFactory to the Core SDK This migrates PTransformOverrideFactory from the DirectRunner to the Core SDK, as part of BEAM-646. Add getOriginalToReplacements to provide a mapping from the

[2/2] incubator-beam git commit: This closes #1547

2016-12-16 Thread tgroh
This closes #1547 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cc28f0cb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cc28f0cb Diff:

[2/2] incubator-beam git commit: This closes #1625

2016-12-15 Thread tgroh
This closes #1625 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c09fbd43 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c09fbd43 Diff:

[1/2] incubator-beam git commit: Don't incorrectly log error in MetricsEnvironment

2016-12-15 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/release-0.4.0-incubating 5dcffe066 -> c09fbd43b Don't incorrectly log error in MetricsEnvironment Using getCurrentContainer() logs an error if metrics are not supported. This is because it acts as the common point of access for user code

[1/2] incubator-beam git commit: [BEAM-1033] Retry Bigquery Verifier when Query Fails

2016-12-14 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 4927cc1ab -> 0b0a1b797 [BEAM-1033] Retry Bigquery Verifier when Query Fails Update Junit to 4.12 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: This closes #1479

2016-12-14 Thread tgroh
This closes #1479 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0b0a1b79 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0b0a1b79 Diff:

[1/2] incubator-beam git commit: This closes #1583

2016-12-14 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 5a51ace8d -> fdf07318f This closes #1583 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fdf07318 Tree:

[2/2] incubator-beam git commit: Implement GetDefaultOutputCoder in DirectGroupByKey

2016-12-14 Thread tgroh
Implement GetDefaultOutputCoder in DirectGroupByKey This uses the standard Coder Inference path to set coders, rather than explicitly setting the output coders for intermediate PCollections. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/3] incubator-beam git commit: Add Tests for Kryo Serialization of URFBS

2016-12-12 Thread tgroh
Add Tests for Kryo Serialization of URFBS Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/47cc2dca Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/47cc2dca Diff:

[3/3] incubator-beam git commit: Add no-arg constructor for UnboundedReadFromBoundedSource

2016-12-12 Thread tgroh
Add no-arg constructor for UnboundedReadFromBoundedSource This allows Kryo to work with the type, currently required by the Apex runner. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3c2e550a Tree:

[1/3] incubator-beam git commit: This closes #1586

2016-12-12 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master d9657ffc3 -> 91cc606b4 This closes #1586 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/91cc606b Tree:

[GitHub] incubator-beam pull request #1586: [BEAM-1139] Add no-arg constructor for Un...

2016-12-12 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1586 [BEAM-1139] Add no-arg constructor for UnboundedReadFromBoundedSource Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] incubator-beam pull request #1583: Implement GetDefaultOutputCoder in Direct...

2016-12-12 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1583 Implement GetDefaultOutputCoder in DirectGroupByKey Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[2/2] incubator-beam git commit: Stop expanding PValues in DirectRunner visitors

2016-12-12 Thread tgroh
Stop expanding PValues in DirectRunner visitors A PValue always expands to itself, and these calls are unneccessary. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8ef74a74 Tree:

[1/2] incubator-beam git commit: This closes #1570

2016-12-12 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 5d619e8e3 -> 59f1fb26a This closes #1570 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/59f1fb26 Tree:

[GitHub] incubator-beam pull request #1582: [BEAM-646] Add Parameters to finishSpecif...

2016-12-12 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1582 [BEAM-646] Add Parameters to finishSpecifying Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[2/2] incubator-beam git commit: Migrate AppliedPTransform to use AutoValue

2016-12-12 Thread tgroh
Migrate AppliedPTransform to use AutoValue Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8f52b5e1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8f52b5e1 Diff:

[GitHub] incubator-beam pull request #1570: Stop expanding PValues in DirectRunner vi...

2016-12-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1570 Stop expanding PValues in DirectRunner visitors Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1569: [BEAM-646] Provide local tags in PInput, ...

2016-12-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1569 [BEAM-646] Provide local tags in PInput, POutput expansions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[1/4] incubator-beam-site git commit: [BEAM-835] Added IntelliJ instructions to the contribution guide

2016-12-09 Thread tgroh
Repository: incubator-beam-site Updated Branches: refs/heads/asf-site 37adeb9ba -> 59f789b97 [BEAM-835] Added IntelliJ instructions to the contribution guide Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit:

[2/4] incubator-beam-site git commit: Reword IntelliJ Annotation Processor section

2016-12-09 Thread tgroh
Reword IntelliJ Annotation Processor section Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/01ec343e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/01ec343e Diff:

[3/4] incubator-beam-site git commit: Regenerate Content

2016-12-09 Thread tgroh
Regenerate Content Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/c676efe7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/c676efe7 Diff:

[4/4] incubator-beam-site git commit: This closes #95

2016-12-09 Thread tgroh
This closes #95 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/59f789b9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/59f789b9 Diff:

[GitHub] incubator-beam pull request #1567: Copy Runner Profiles to Java8 Archetype P...

2016-12-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1567 Copy Runner Profiles to Java8 Archetype POM Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1563: Enable the DirectRunner by default in Exa...

2016-12-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1563 Enable the DirectRunner by default in Examples Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[2/2] incubator-beam git commit: This closes #1525

2016-12-08 Thread tgroh
This closes #1525 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/40bd2760 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/40bd2760 Diff:

[1/2] incubator-beam git commit: Fix a bug in SplittableDoFn Checkpointing

2016-12-08 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 409b5dfcf -> 40bd27602 Fix a bug in SplittableDoFn Checkpointing Call checkpoint() only once if the SDF emits output several times per claim call. Calling checkpoint multiple times would clobber an existing checkpoint, and the

[GitHub] incubator-beam pull request #1547: [BEAM-646] Add PTransformOverrideFactory ...

2016-12-07 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1547 [BEAM-646] Add PTransformOverrideFactory to the Core SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] incubator-beam pull request #1442: [BEAM-646] Add Replacement Methods to Tra...

2016-12-07 Thread tgroh
Github user tgroh closed the pull request at: https://github.com/apache/incubator-beam/pull/1442 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[2/2] incubator-beam git commit: This closes #1511

2016-12-07 Thread tgroh
This closes #1511 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5b31a369 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5b31a369 Diff:

[1/2] incubator-beam git commit: Only provide expanded Inputs and Outputs

2016-12-07 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master ae52ec1bc -> 5b31a3699 Only provide expanded Inputs and Outputs This removes PInput and POutput from the immediate API Surface of TransformHierarchy.Node, and forces Pipeline Visitors to access only the expanded version of the

[1/2] incubator-beam git commit: This closes #1527

2016-12-07 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 02bb8c375 -> 1526184ae This closes #1527 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1526184a Tree:

[2/2] incubator-beam git commit: Port most of DoFnRunner Javadoc to new DoFn

2016-12-07 Thread tgroh
Port most of DoFnRunner Javadoc to new DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b2d72237 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b2d72237 Diff:

[2/4] incubator-beam git commit: Add DirectGraphs to DirectRunner Tests

2016-12-06 Thread tgroh
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d6c6ad37/runners/direct-java/src/test/java/org/apache/beam/runners/direct/WatermarkManagerTest.java -- diff --git

[1/4] incubator-beam git commit: Remove getProducingTransformInternal from DirectGraphVisitorTest

2016-12-06 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 077d9118d -> ca6ab6c68 Remove getProducingTransformInternal from DirectGraphVisitorTest Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[4/4] incubator-beam git commit: This closes #1495

2016-12-06 Thread tgroh
This closes #1495 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ca6ab6c6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ca6ab6c6 Diff:

[GitHub] incubator-beam pull request #1495: [BEAM-646] Add DirectTestUtils

2016-12-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1495 [BEAM-646] Add DirectTestUtils Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[2/3] incubator-beam git commit: Rename ConsumerTrackingPipelineVisitor to DirectGraphVisitor

2016-12-02 Thread tgroh
Rename ConsumerTrackingPipelineVisitor to DirectGraphVisitor Reduce visibility of Visitor. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/662416a4 Tree:

[3/3] incubator-beam git commit: This closes #1487

2016-12-02 Thread tgroh
This closes #1487 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1abbb900 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1abbb900 Diff:

[1/3] incubator-beam git commit: Stop using Maps of Transforms in the DirectRunner

2016-12-02 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 8cb2689f8 -> 1abbb9007 Stop using Maps of Transforms in the DirectRunner Instead, add a "DirectGraph" class, which adds a layer of indirection to all lookup methods. Remove all remaining uses of getProducingTransformInternal, and

[1/2] incubator-beam git commit: Explicitly Throw in TransformExecutorTest

2016-12-02 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 37e891fe9 -> 8cb2689f8 Explicitly Throw in TransformExecutorTest Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4ee8b73 Tree:

[2/2] incubator-beam git commit: This closes #1490

2016-12-02 Thread tgroh
This closes #1490 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8cb2689f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8cb2689f Diff:

[2/3] incubator-beam git commit: Move Towards removing WindowedValue from SDK

2016-12-02 Thread tgroh
Move Towards removing WindowedValue from SDK - Introduces ValueInSingleWindow for purposes of PAssert - Uses ValueInSingleWindow inside DoFnTester - Moves WindowMatchers{,Test} to runners-core After this commit, WindowedValue does not appear in any SDK APIs used by Pipeline authors. Project:

[1/3] incubator-beam git commit: Move Towards removing WindowedValue from SDK

2016-12-02 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 0fb561068 -> a0884492a http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d9891234/sdks/java/core/src/test/java/org/apache/beam/sdk/testing/PaneExtractorsTest.java

[3/3] incubator-beam git commit: This closes #1260

2016-12-02 Thread tgroh
This closes #1260 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a0884492 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a0884492 Diff:

[GitHub] incubator-beam pull request #1490: Explicitly Throw in TransformExecutorTest

2016-12-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1490 Explicitly Throw in TransformExecutorTest Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1487: Stop using Maps of Transforms in the Dire...

2016-12-01 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1487 Stop using Maps of Transforms in the DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[1/3] incubator-beam git commit: This closes #1484

2016-12-01 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 24fab9f53 -> 63491bf21 This closes #1484 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/63491bf2 Tree:

[3/3] incubator-beam git commit: Migrate TransformTreeNode to an Inner Class

2016-12-01 Thread tgroh
Migrate TransformTreeNode to an Inner Class TransformTreeNode requires access to the hierarchy it is contained within, and generally cannot be separated from TransformHierarchy. It is primarily an implementation detail of TransformHierarchy, so can be relocated to within it. Project:

[2/3] incubator-beam git commit: Reduce the visibility of TransformHierarchy Node Mutators

2016-12-01 Thread tgroh
Reduce the visibility of TransformHierarchy Node Mutators These mutators should not be accessible when visiting the nodes. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c5c7910 Tree:

[1/2] incubator-beam git commit: Improve Splittable DoFn

2016-12-01 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master fd4b631f1 -> 24fab9f53 Improve Splittable DoFn Makes Splittable DoFn be more like a real DoFn: - Adds support for side inputs and outputs to SDF - Teaches `ProcessFn` to work with exploded windows inside the `KeyedWorkItem`. It

[2/2] incubator-beam git commit: This closes #1261

2016-12-01 Thread tgroh
This closes #1261 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/24fab9f5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/24fab9f5 Diff:

[GitHub] incubator-beam pull request #1484: Migrate TransformTreeNode to an Inner Cla...

2016-12-01 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1484 Migrate TransformTreeNode to an Inner Class Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[1/2] incubator-beam git commit: Move TransformHierarchy Maintenance into it

2016-12-01 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 0c875ba70 -> 48130f718 Move TransformHierarchy Maintenance into it This reduces the complexity of Pipeline.applyInternal by keeping the responsiblities to passing a node into the Transform Hierarchy, enforcing name uniqueness, and

[2/2] incubator-beam git commit: This closes #1469

2016-12-01 Thread tgroh
This closes #1469 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/48130f71 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/48130f71 Diff:

[2/2] incubator-beam git commit: Preserves compressed windows in PushbackSideInputDoFnRunner

2016-11-30 Thread tgroh
Preserves compressed windows in PushbackSideInputDoFnRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/38f0b11c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/38f0b11c Diff:

[1/2] incubator-beam git commit: This closes #1471

2016-11-30 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 565e99fbf -> a20bc4793 This closes #1471 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a20bc479 Tree:

[1/2] incubator-beam git commit: Revert "Improvements to ReduceFnRunner prefetching"

2016-11-30 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 4b682039d -> c8f2cdb22 Revert "Improvements to ReduceFnRunner prefetching" This reverts commit 4282c67c5fa4dea2fe6c8695e0ea23f383c6457b, which contained some incompatibilities outside of runners-core. Project:

[2/2] incubator-beam git commit: This closes #1474

2016-11-30 Thread tgroh
This closes #1474 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c8f2cdb2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c8f2cdb2 Diff:

[GitHub] incubator-beam pull request #1470: [BEAM-1063] Shutdown DynamicSplit Executo...

2016-11-30 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1470 [BEAM-1063] Shutdown DynamicSplit Executor in Cleanup Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] incubator-beam pull request #1469: [BEAM-646] Move TransformHierarchy Mainte...

2016-11-30 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1469 [BEAM-646] Move TransformHierarchy Maintenance into it Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[1/2] incubator-beam git commit: This closes #1382

2016-11-29 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 5ce75a2ea -> 70c1de9b9 This closes #1382 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/70c1de9b Tree:

[2/2] incubator-beam git commit: Support ValidatesRunner Attribute in Python

2016-11-29 Thread tgroh
Support ValidatesRunner Attribute in Python This is roughly equivalent to "RunnableOnService" in the Java SDK. See BEAM-655 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/81e7a0f6 Tree:

[2/2] incubator-beam git commit: This closes #1457

2016-11-29 Thread tgroh
This closes #1457 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b1f7013d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b1f7013d Diff:

[1/2] incubator-beam git commit: Remove TransformApplicationsForTesting

2016-11-29 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 8d127beb8 -> b1f7013d8 Remove TransformApplicationsForTesting This field is mutated but never queried. Remove Pipeline#addValueInternal This method is never called and not suitable for use. Project:

[GitHub] incubator-beam pull request #1457: Remove TransformApplicationsForTesting

2016-11-29 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1457 Remove TransformApplicationsForTesting Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[1/2] incubator-beam git commit: Remove the Experimental Annotation from the DirectRunner

2016-11-28 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 4bcef03d9 -> cdb7ba165 Remove the Experimental Annotation from the DirectRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0ae18124

[GitHub] incubator-beam pull request #1447: Remove the Experimental Annotation from t...

2016-11-28 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1447 Remove the Experimental Annotation from the DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[2/2] incubator-beam git commit: Add direct runner dependency to starter archetype

2016-11-28 Thread tgroh
Add direct runner dependency to starter archetype Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/14502a31 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/14502a31 Diff:

[1/2] incubator-beam git commit: This closes #1414

2016-11-28 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 33c687069 -> d5aeee9c1 This closes #1414 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d5aeee9c Tree:

[GitHub] incubator-beam pull request #1442: [BEAM-646] Add Replacement Methods to Tra...

2016-11-28 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1442 [BEAM-646] Add Replacement Methods to TransformHierarchy, PValue Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[2/2] incubator-beam git commit: Add input type to TransformResult

2016-11-28 Thread tgroh
Add input type to TransformResult This would likely have caught some hard-to-diagnose type safety errors during the development of StatefulParDoEvaluatorFactory, so adding it should hopefully catch similar bugs in the future. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo

[1/2] incubator-beam git commit: This closes #1424

2016-11-28 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 9fbd2d24e -> 5e9a80cf6 This closes #1424 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5e9a80cf Tree:

[GitHub] incubator-beam pull request #1425: Add TransformHierarchyTest

2016-11-22 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1425 Add TransformHierarchyTest Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] incubator-beam pull request #1422: Output Keyed Bundles in GroupAlsoByWindow...

2016-11-22 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1422 Output Keyed Bundles in GroupAlsoByWindowEvaluator Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[2/2] incubator-beam git commit: Simplify the API for managing MetricsEnvironment

2016-11-22 Thread tgroh
Simplify the API for managing MetricsEnvironment 1. setCurrentContainer returns the previous MetricsEnvironment 2. setCurrentContainer(null) resets the thread local 3. scopedCurrentContainer sets the container and returns a Closeable to reset the previous container. Project:

[1/2] incubator-beam git commit: This closes #1417

2016-11-22 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 6ec45f7e7 -> b41789e9c This closes #1417 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b41789e9 Tree:

[2/2] incubator-beam git commit: Support @ValidatesRunner(RunnableOnService) in Python [1/2]

2016-11-22 Thread tgroh
Support @ValidatesRunner(RunnableOnService) in Python [1/2] Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cc706608 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cc706608 Diff:

[1/2] incubator-beam git commit: This closes #1376

2016-11-22 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 9060f8395 -> 28bfd9090 This closes #1376 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/28bfd909 Tree:

[1/2] incubator-beam git commit: Update StarterPipeline

2016-11-22 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master e53d6d458 -> c2dc38639 Update StarterPipeline Convert StarterPipeline ParDo to MapElements. Use the new DoFn for non-outputting transforms. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: This closes #1406

2016-11-22 Thread tgroh
This closes #1406 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c2dc3863 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c2dc3863 Diff:

[1/2] incubator-beam git commit: Block earlier in BoundedReadEvaluatorFactoryTest

2016-11-17 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 1543ea952 -> 212fec4eb Block earlier in BoundedReadEvaluatorFactoryTest This ensures that the reader doesn't claim the split point, which in turn ensures the dynamic split request will not be refused by the OffsetBasedSource. If

[2/2] incubator-beam git commit: This closes #1377

2016-11-17 Thread tgroh
This closes #1377 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/212fec4e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/212fec4e Diff:

[GitHub] incubator-beam pull request #1377: [BEAM-999] Block earlier in BoundedReadEv...

2016-11-17 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1377 [BEAM-999] Block earlier in BoundedReadEvaluatorFactoryTest Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[2/2] incubator-beam git commit: This closes #1373

2016-11-16 Thread tgroh
This closes #1373 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/abd9fb3d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/abd9fb3d Diff:

[1/2] incubator-beam git commit: Properly apply Transform Overrides in the Direct Runner

2016-11-16 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 15e93c58e -> abd9fb3d7 Properly apply Transform Overrides in the Direct Runner Previously the direct runner would use the transform override to .apply(), but would keep the original transform in the pipeline, e.g. it would use the

[4/4] incubator-beam git commit: Reduce incidence of Namespace StringKey comparisons

2016-11-16 Thread tgroh
Reduce incidence of Namespace StringKey comparisons If the Namespace of a TimerData reports itself as being equal to the other namespace, immediately return 0 rather than generating the string keys and comparing them. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/4] incubator-beam git commit: This closes #1319

2016-11-16 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master c695ef48b -> 15e93c58e This closes #1319 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/15e93c58 Tree:

[3/4] incubator-beam git commit: Reduce Visibility of PCollectionViewWriter

2016-11-16 Thread tgroh
Reduce Visibility of PCollectionViewWriter This is an internal implementation detail of the DirectRunner and should not be exposed. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bf4c504d Tree:

[2/4] incubator-beam git commit: Remove unused Thread variable in TransformExecutor

2016-11-16 Thread tgroh
Remove unused Thread variable in TransformExecutor Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5ba4d181 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5ba4d181 Diff:

[1/2] incubator-beam git commit: Remove Pipeline#getFullNameForTesting

2016-11-16 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 938ac91a9 -> c695ef48b Remove Pipeline#getFullNameForTesting Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1cdaa4e7 Tree:

[2/2] incubator-beam git commit: This closes #1363

2016-11-16 Thread tgroh
This closes #1363 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c695ef48 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c695ef48 Diff:

[1/2] incubator-beam git commit: Exercise Dynamic Splitting in the DirectRunner

2016-11-16 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master dc94dbdd7 -> 938ac91a9 Exercise Dynamic Splitting in the DirectRunner For sources that are above a certain size, the DirectRunner will run a Thread which will split off half of the remaining work. This exercises the concurrent

[2/2] incubator-beam git commit: This closes #1254

2016-11-16 Thread tgroh
This closes #1254 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/938ac91a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/938ac91a Diff:

  1   2   3   4   >