Repository: incubator-beam
Updated Branches:
refs/heads/master 57d9bbd79 -> 7984fe3fc
Add Parameters to finishSpecifying
Remove the need to use getProducingTransformInternal in TypedPValue.
Ensure that all nodes are finished specifying before a call to
TransformHierarchy#visit. This ensures
Use CountingSource in ForceStreamingTest
Removes the requirement to have a FakeUnboundedSource, plus the read is
fully specified.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b053be46
Tree:
This closes #1582
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7984fe3f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7984fe3f
Diff:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1677
Add a Test for Flatten with Heterogeneous Coders
Add a category, and suppress in the Flink and Apex runners
Be sure to do all of the following to help us incorporate your
Repository: incubator-beam
Updated Branches:
refs/heads/master 6a05d7f17 -> aadcf3a12
This closes #1569
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/aadcf3a1
Tree:
Provide local tags in PInput, POutput expansions
Output an ordered colleciton in PInput and POutput expansions.
This provides information that is necessary to reconstruct a PInput
or POutput from its expansion.
Implement PCollectionList.equals, PCollectionTuple.equals
Project:
Repository: incubator-beam
Updated Branches:
refs/heads/master 217c29bfc -> cc28f0cb4
Add PTransformOverrideFactory to the Core SDK
This migrates PTransformOverrideFactory from the DirectRunner to the
Core SDK, as part of BEAM-646.
Add getOriginalToReplacements to provide a mapping from the
This closes #1547
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cc28f0cb
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cc28f0cb
Diff:
This closes #1625
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c09fbd43
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c09fbd43
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/release-0.4.0-incubating 5dcffe066 -> c09fbd43b
Don't incorrectly log error in MetricsEnvironment
Using getCurrentContainer() logs an error if metrics are not supported.
This is because it acts as the common point of access for user code
Repository: incubator-beam
Updated Branches:
refs/heads/master 4927cc1ab -> 0b0a1b797
[BEAM-1033] Retry Bigquery Verifier when Query Fails
Update Junit to 4.12
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
This closes #1479
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0b0a1b79
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0b0a1b79
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 5a51ace8d -> fdf07318f
This closes #1583
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fdf07318
Tree:
Implement GetDefaultOutputCoder in DirectGroupByKey
This uses the standard Coder Inference path to set coders, rather than
explicitly setting the output coders for intermediate PCollections.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Add Tests for Kryo Serialization of URFBS
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/47cc2dca
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/47cc2dca
Diff:
Add no-arg constructor for UnboundedReadFromBoundedSource
This allows Kryo to work with the type, currently required by
the Apex runner.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3c2e550a
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/master d9657ffc3 -> 91cc606b4
This closes #1586
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/91cc606b
Tree:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1586
[BEAM-1139] Add no-arg constructor for UnboundedReadFromBoundedSource
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1583
Implement GetDefaultOutputCoder in DirectGroupByKey
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
Stop expanding PValues in DirectRunner visitors
A PValue always expands to itself, and these calls are unneccessary.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8ef74a74
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/master 5d619e8e3 -> 59f1fb26a
This closes #1570
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/59f1fb26
Tree:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1582
[BEAM-646] Add Parameters to finishSpecifying
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
Migrate AppliedPTransform to use AutoValue
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8f52b5e1
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8f52b5e1
Diff:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1570
Stop expanding PValues in DirectRunner visitors
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1569
[BEAM-646] Provide local tags in PInput, POutput expansions
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure
Repository: incubator-beam-site
Updated Branches:
refs/heads/asf-site 37adeb9ba -> 59f789b97
[BEAM-835] Added IntelliJ instructions to the contribution guide
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo
Commit:
Reword IntelliJ Annotation Processor section
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo
Commit:
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/01ec343e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/01ec343e
Diff:
Regenerate Content
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo
Commit:
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/c676efe7
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/c676efe7
Diff:
This closes #95
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo
Commit:
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/59f789b9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/59f789b9
Diff:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1567
Copy Runner Profiles to Java8 Archetype POM
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1563
Enable the DirectRunner by default in Examples
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
This closes #1525
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/40bd2760
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/40bd2760
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 409b5dfcf -> 40bd27602
Fix a bug in SplittableDoFn Checkpointing
Call checkpoint() only once if the SDF emits output several times per
claim call.
Calling checkpoint multiple times would clobber an existing checkpoint,
and the
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1547
[BEAM-646] Add PTransformOverrideFactory to the Core SDK
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
Github user tgroh closed the pull request at:
https://github.com/apache/incubator-beam/pull/1442
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
This closes #1511
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5b31a369
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5b31a369
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master ae52ec1bc -> 5b31a3699
Only provide expanded Inputs and Outputs
This removes PInput and POutput from the immediate API Surface of
TransformHierarchy.Node, and forces Pipeline Visitors to access only
the expanded version of the
Repository: incubator-beam
Updated Branches:
refs/heads/master 02bb8c375 -> 1526184ae
This closes #1527
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1526184a
Tree:
Port most of DoFnRunner Javadoc to new DoFn
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b2d72237
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b2d72237
Diff:
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d6c6ad37/runners/direct-java/src/test/java/org/apache/beam/runners/direct/WatermarkManagerTest.java
--
diff --git
Repository: incubator-beam
Updated Branches:
refs/heads/master 077d9118d -> ca6ab6c68
Remove getProducingTransformInternal from DirectGraphVisitorTest
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
This closes #1495
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ca6ab6c6
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ca6ab6c6
Diff:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1495
[BEAM-646] Add DirectTestUtils
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
Rename ConsumerTrackingPipelineVisitor to DirectGraphVisitor
Reduce visibility of Visitor.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/662416a4
Tree:
This closes #1487
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1abbb900
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1abbb900
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 8cb2689f8 -> 1abbb9007
Stop using Maps of Transforms in the DirectRunner
Instead, add a "DirectGraph" class, which adds a layer of indirection to
all lookup methods.
Remove all remaining uses of getProducingTransformInternal, and
Repository: incubator-beam
Updated Branches:
refs/heads/master 37e891fe9 -> 8cb2689f8
Explicitly Throw in TransformExecutorTest
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4ee8b73
Tree:
This closes #1490
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8cb2689f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8cb2689f
Diff:
Move Towards removing WindowedValue from SDK
- Introduces ValueInSingleWindow for purposes of PAssert
- Uses ValueInSingleWindow inside DoFnTester
- Moves WindowMatchers{,Test} to runners-core
After this commit, WindowedValue does not appear in any SDK APIs
used by Pipeline authors.
Project:
Repository: incubator-beam
Updated Branches:
refs/heads/master 0fb561068 -> a0884492a
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d9891234/sdks/java/core/src/test/java/org/apache/beam/sdk/testing/PaneExtractorsTest.java
This closes #1260
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a0884492
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a0884492
Diff:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1490
Explicitly Throw in TransformExecutorTest
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1487
Stop using Maps of Transforms in the DirectRunner
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
Repository: incubator-beam
Updated Branches:
refs/heads/master 24fab9f53 -> 63491bf21
This closes #1484
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/63491bf2
Tree:
Migrate TransformTreeNode to an Inner Class
TransformTreeNode requires access to the hierarchy it is contained
within, and generally cannot be separated from TransformHierarchy. It is
primarily an implementation detail of TransformHierarchy, so can be
relocated to within it.
Project:
Reduce the visibility of TransformHierarchy Node Mutators
These mutators should not be accessible when visiting the nodes.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c5c7910
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/master fd4b631f1 -> 24fab9f53
Improve Splittable DoFn
Makes Splittable DoFn be more like a real DoFn:
- Adds support for side inputs and outputs to SDF
- Teaches `ProcessFn` to work with exploded windows inside the
`KeyedWorkItem`. It
This closes #1261
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/24fab9f5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/24fab9f5
Diff:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1484
Migrate TransformTreeNode to an Inner Class
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
Repository: incubator-beam
Updated Branches:
refs/heads/master 0c875ba70 -> 48130f718
Move TransformHierarchy Maintenance into it
This reduces the complexity of Pipeline.applyInternal by keeping the
responsiblities to passing a node into the Transform Hierarchy,
enforcing name uniqueness, and
This closes #1469
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/48130f71
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/48130f71
Diff:
Preserves compressed windows in PushbackSideInputDoFnRunner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/38f0b11c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/38f0b11c
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 565e99fbf -> a20bc4793
This closes #1471
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a20bc479
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/master 4b682039d -> c8f2cdb22
Revert "Improvements to ReduceFnRunner prefetching"
This reverts commit 4282c67c5fa4dea2fe6c8695e0ea23f383c6457b, which
contained some incompatibilities outside of runners-core.
Project:
This closes #1474
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c8f2cdb2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c8f2cdb2
Diff:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1470
[BEAM-1063] Shutdown DynamicSplit Executor in Cleanup
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1469
[BEAM-646] Move TransformHierarchy Maintenance into it
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 5ce75a2ea -> 70c1de9b9
This closes #1382
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/70c1de9b
Tree:
Support ValidatesRunner Attribute in Python
This is roughly equivalent to "RunnableOnService" in the Java SDK. See
BEAM-655
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/81e7a0f6
Tree:
This closes #1457
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b1f7013d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b1f7013d
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 8d127beb8 -> b1f7013d8
Remove TransformApplicationsForTesting
This field is mutated but never queried.
Remove Pipeline#addValueInternal
This method is never called and not suitable for use.
Project:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1457
Remove TransformApplicationsForTesting
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted
Repository: incubator-beam
Updated Branches:
refs/heads/master 4bcef03d9 -> cdb7ba165
Remove the Experimental Annotation from the DirectRunner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0ae18124
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1447
Remove the Experimental Annotation from the DirectRunner
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
Add direct runner dependency to starter archetype
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/14502a31
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/14502a31
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 33c687069 -> d5aeee9c1
This closes #1414
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d5aeee9c
Tree:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1442
[BEAM-646] Add Replacement Methods to TransformHierarchy, PValue
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [x] Make sure
Add input type to TransformResult
This would likely have caught some hard-to-diagnose type safety errors
during the development of StatefulParDoEvaluatorFactory, so adding it
should hopefully catch similar bugs in the future.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Repository: incubator-beam
Updated Branches:
refs/heads/master 9fbd2d24e -> 5e9a80cf6
This closes #1424
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5e9a80cf
Tree:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1425
Add TransformHierarchyTest
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1422
Output Keyed Bundles in GroupAlsoByWindowEvaluator
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
Simplify the API for managing MetricsEnvironment
1. setCurrentContainer returns the previous MetricsEnvironment
2. setCurrentContainer(null) resets the thread local
3. scopedCurrentContainer sets the container and returns a Closeable to
reset the previous container.
Project:
Repository: incubator-beam
Updated Branches:
refs/heads/master 6ec45f7e7 -> b41789e9c
This closes #1417
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b41789e9
Tree:
Support @ValidatesRunner(RunnableOnService) in Python [1/2]
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cc706608
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cc706608
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 9060f8395 -> 28bfd9090
This closes #1376
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/28bfd909
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/master e53d6d458 -> c2dc38639
Update StarterPipeline
Convert StarterPipeline ParDo to MapElements.
Use the new DoFn for non-outputting transforms.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
This closes #1406
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c2dc3863
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c2dc3863
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 1543ea952 -> 212fec4eb
Block earlier in BoundedReadEvaluatorFactoryTest
This ensures that the reader doesn't claim the split point, which in
turn ensures the dynamic split request will not be refused by the
OffsetBasedSource. If
This closes #1377
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/212fec4e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/212fec4e
Diff:
GitHub user tgroh opened a pull request:
https://github.com/apache/incubator-beam/pull/1377
[BEAM-999] Block earlier in BoundedReadEvaluatorFactoryTest
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure
This closes #1373
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/abd9fb3d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/abd9fb3d
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 15e93c58e -> abd9fb3d7
Properly apply Transform Overrides in the Direct Runner
Previously the direct runner would use the transform override to
.apply(), but would keep the original transform in the pipeline,
e.g. it would use the
Reduce incidence of Namespace StringKey comparisons
If the Namespace of a TimerData reports itself as being equal to the
other namespace, immediately return 0 rather than generating the string
keys and comparing them.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Repository: incubator-beam
Updated Branches:
refs/heads/master c695ef48b -> 15e93c58e
This closes #1319
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/15e93c58
Tree:
Reduce Visibility of PCollectionViewWriter
This is an internal implementation detail of the DirectRunner and should
not be exposed.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bf4c504d
Tree:
Remove unused Thread variable in TransformExecutor
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5ba4d181
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5ba4d181
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 938ac91a9 -> c695ef48b
Remove Pipeline#getFullNameForTesting
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1cdaa4e7
Tree:
This closes #1363
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c695ef48
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c695ef48
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master dc94dbdd7 -> 938ac91a9
Exercise Dynamic Splitting in the DirectRunner
For sources that are above a certain size, the DirectRunner will run a
Thread which will split off half of the remaining work. This exercises
the concurrent
This closes #1254
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/938ac91a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/938ac91a
Diff:
1 - 100 of 319 matches
Mail list logo