GitHub user manuzhang opened a pull request:
https://github.com/apache/incubator-beam/pull/1507
merge master into gearpump-runner branch
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.txt).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/manuzhang/incubator-beam gearpump-runner-sync
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/1507.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1507
----
commit 73d0af9151340d85df1f720e88366f8a463b44bc
Author: Thomas Groh <tg...@google.com>
Date: 2016-11-23T00:14:29Z
Add TransformHierarchyTest
This tests basic features of TransformHierarchy
commit 3ae9425b3a36e34890980647952c61cedbd91ff3
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-23T06:24:37Z
This closes #1425
commit 09986e9433d49812d5061fe6543dff90d78eba6a
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-23T06:16:29Z
Use more natural class to find class loader in ReflectHelpers
commit 5f3e7787d7e724b827af8924b2773ed3b5c2b036
Author: Luke Cwik <lc...@google.com>
Date: 2016-11-23T15:42:13Z
Use more natural class to find class loader in ReflectHelpers
This closes #1427
commit 2e2146b1869807d69658592de8ed5ff339c28507
Author: Thomas Weise <t...@apache.org>
Date: 2016-11-22T19:38:00Z
Update transitive dependencies for Apex 3.5.0 snapshot version.
commit 26a30a22d28e034d16b5f0c4ea0be1b4f8c464f6
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-23T17:56:17Z
This closes #1418
commit ef74e192eaee79e4cb8c7c901a296dd76559d76d
Author: Daniel Kulp <dk...@apache.org>
Date: 2016-11-22T18:31:19Z
[BEAM-1034] Clean up tmp area in tests
commit 6d0c205a306d6cdca346fe2aaf662b03b4959a0e
Author: Jean-Baptiste Onofré <jbono...@apache.org>
Date: 2016-11-24T07:43:09Z
[BEAM-1034] This closes #1415
commit 7b314aad1c7c62ad61e09e610c60f53ac056d75d
Author: Jean-Baptiste Onofré <jbono...@apache.org>
Date: 2016-11-17T16:07:21Z
[BEAM-959] Improve validation messages in JdbcIO
commit 3e4b2fd0d96ff2757de7782b7c80dc1881eb451b
Author: Jean-Baptiste Onofré <jbono...@apache.org>
Date: 2016-11-24T09:31:52Z
[BEAM-959] This closes #1374
commit 4a097729ac9fc65283f4f11f85812188589c8df3
Author: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Date: 2016-11-08T10:03:21Z
Replace WindowAssignment OldDoFn by FlatMap in Flink Runner
The streaming runner had an OldDoFn that was used for assigning windows
using a WindowFn. This is now done with a FlatMap.
commit 8d1214a3ba94b21102b74d346e73f24ecd9056f2
Author: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Date: 2016-11-24T14:20:49Z
This closes #1435
commit 8d7d46c6e407c738a61b236078d002d178da0b9f
Author: manuzhang <owenzhang1...@gmail.com>
Date: 2016-11-23T01:24:05Z
[BEAM-800] add getFn to DoFnInvoker
commit 632576b5be00f050ff86981bfe55b170dec41759
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-26T04:34:12Z
This closes #1428
commit 07544ef3a47bbdfacc00c75af875c3533a5fe477
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-23T19:22:08Z
Remove unused body of StreamingPCollectionViewWriterFn
commit 803bbe2a3026424f509e13809a8eecb79990e5fe
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-23T19:23:07Z
Remove unused WindowingInternals.writePCollectionViewData
commit 3ad7677503977108b5a67c315bd1cc6ead3ee998
Author: Sela <ans...@paypal.com>
Date: 2016-11-26T10:50:01Z
[BEAM-498] Remove obsolete WindowingInternals#writePCollectionViewData
This closes #1430
commit cc96b1381b6db849adf69daddecf30b9c61acf73
Author: Ismaël MejÃa <ieme...@gmail.com>
Date: 2016-11-25T13:52:26Z
[BEAM-851] Determine if the pipeline must be translated into streaming mode
(if not set)
Now an Evaluator (visitor) detects if there are Unbonded.Read transforms.
This approach is based on Flink's PipelineTranslationOptimizer
commit 8cc43aa701807009ec826e752b2f1bb95442450f
Author: Sela <ans...@paypal.com>
Date: 2016-11-27T11:19:59Z
This closes #1436
commit f6005593ccf6bdef7c975622d5af39792c7db44c
Author: Ismaël MejÃa <ieme...@gmail.com>
Date: 2016-11-27T10:39:08Z
[BEAM-1049] Update spark version to 1.6.3
commit 9fbd2d24e532221fdbe7ed29f62f315fd4a1eab1
Author: Jean-Baptiste Onofré <jbono...@apache.org>
Date: 2016-11-27T17:53:10Z
[BEAM-1049] This closes #1437
commit 7502adda3262bce9d6d4fe4499bde8d8b5273029
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-23T00:01:45Z
Add input type to TransformResult
This would likely have caught some hard-to-diagnose type safety errors
during the development of StatefulParDoEvaluatorFactory, so adding it
should hopefully catch similar bugs in the future.
commit 5e9a80cf61c4666edb5febd9a0fface2d2c26261
Author: Thomas Groh <tg...@google.com>
Date: 2016-11-28T18:06:31Z
This closes #1424
commit 1b7b065f4ccae7c52934b1e73fd1fbfb33c3398d
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-21T19:34:45Z
Remove overspecified type in ParDoEvaluator
commit e17dc4af9f7de717872d6c6f0ab52e0498f3b782
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-10T05:10:51Z
Add State parameter support to SimpleDoFnRunner
commit 7e158e4e583372dd79ffaa380ac7c2dbb4846c50
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-21T23:41:27Z
Add simple tests for stateful ParDo
commit ec2c0e0698c1380b309a609eb642aba445c77e27
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-10T05:59:15Z
Add support for Stateful ParDo in the Direct runner
This adds overrides and new evaluators to ensure that
state is accessed in a single-threaded manner per key
and is cleaned up when a window expires.
commit 33c687069adc1ce4481a0c9637b2a77abb9450b8
Author: Kenneth Knowles <k...@google.com>
Date: 2016-11-28T21:03:51Z
This closes #1399
commit 14502a3122bd1c1652196881797ffb60d480164e
Author: Scott Wegner <sweg...@google.com>
Date: 2016-11-22T16:56:17Z
Add direct runner dependency to starter archetype
commit d5aeee9c17a75307ff539e40b3ddc176790ec559
Author: Thomas Groh <tg...@google.com>
Date: 2016-11-28T21:17:46Z
This closes #1414
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
