GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/2610
Merge master into gearpump-runner branch Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-<Jira issue #>] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/manuzhang/incubator-beam merge_master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2610.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2610 ---- commit e0e39a97560933f99eaee98549877fd5f8f49a52 Author: Dan Halperin <dhalp...@google.com> Date: 2017-04-10T17:16:06Z This closes #2481 commit a3a15a5370467db72f8be2fa031483349e49f6ab Author: Ahmet Altay <al...@google.com> Date: 2017-04-08T00:54:14Z enable test_multi_valued_singleton_side_input test commit 80d2548f258074931a62e412609363dfd2305086 Author: Ahmet Altay <al...@google.com> Date: 2017-04-10T17:49:16Z This closes #2467 commit 74e31c350986d093be1a0b53d001b3376def8b69 Author: Thomas Weise <t...@apache.org> Date: 2017-04-08T20:01:01Z BEAM-1053 ApexGroupByKeyOperator serialization issues commit 836e8e4aab239dd41f81de2f1553850b3fd3d716 Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-04-10T17:55:50Z This closes #2473 commit 33d4a02bb28e5a1c09513dc3e7701b30df148943 Author: Vikas Kedigehalli <vika...@google.com> Date: 2017-04-03T17:01:45Z Create as custom source commit fc1006500d14afd01a3a34527c0ea9dc94ac09e9 Author: Chamikara Jayalath <chamik...@google.com> Date: 2017-04-10T21:18:30Z This closes #2446 commit b7d7adc879694cf5b22f80a26a46982730a483ec Author: Thomas Groh <tg...@google.com> Date: 2017-04-07T16:17:19Z Add SdkComponents This takes SDK objects and assigns IDs to them. It is effectively a ComponentsBuilder context where a component is referred to by the Java object which is being translated, rather than by an opaque string or protocol buffer. commit 8afa62398d51e3b11215970b139ab839ccb2e91a Author: Thomas Groh <tg...@google.com> Date: 2017-04-10T22:14:34Z This closes #2459 commit 11a3af8474998bd2b874cfeede82f353999ae3e3 Author: Ahmet Altay <al...@google.com> Date: 2017-04-10T21:13:00Z Upgrade dependencies. Minor version changes to use latest versions of avro, pyyaml, google-apitools, googledatastore. commit 1c7a974ab00b8f4a8c089520aeb15ec29e128977 Author: Ahmet Altay <al...@google.com> Date: 2017-04-10T22:18:37Z This closes #2484 commit 678833096550cf81da0fe026ab978626e395ef11 Author: Maria Garcia Herrero <mari...@google.com> Date: 2017-04-09T06:08:44Z Skip query metrics when creating a template commit 1761d1cabf47e34fd9107c5673339aa966148f0e Author: Ahmet Altay <al...@google.com> Date: 2017-04-10T22:23:21Z This closes #2475 commit 9e453fabe2bf448552ab5706130495e5ea4cf1c2 Author: Vikas Kedigehalli <vika...@google.com> Date: 2017-04-08T02:22:27Z Fix GroupByKeyInputVisitor for Direct Runner commit 7fd9c6516e2222a5f3d290fd95507559b0c99940 Author: Ahmet Altay <al...@google.com> Date: 2017-04-10T22:28:12Z This closes #2470 commit 40b36686bac65995d606fe5cea7aa957d0ef3f9d Author: Thomas Groh <tg...@google.com> Date: 2017-04-10T21:35:59Z Move WindowingStrategies to runners-core-construction commit 0a0b1c80c97949954add4b4357fe29409a08197d Author: Thomas Groh <tg...@google.com> Date: 2017-04-11T02:24:52Z This closes #2486 commit 62e23b71e3b964033c15707629b560dfc8204654 Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-04-08T00:54:18Z Removes DoFn.ProcessContinuation completely commit 159ac58122258e42b8faa94dad20e9fb82a4fe34 Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-04-10T22:44:14Z Bump Dataflow worker to 20170410 commit c58f4f89b3026e130b63dc14731a8ee8615e92f5 Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-04-11T05:51:54Z This closes #2468 commit 5f7c772cc4d21b220fa3b5dcec8b7d5bdba8685f Author: Dan Halperin <dhalp...@google.com> Date: 2017-04-07T21:50:42Z PubsubIO: remove support for BoundedReader Google Cloud Pub/Sub is not currently that useful in bounded mode -- it's a streaming source. Years ago, before the DirectRunner supported unbounded PCollections and sources, however, we were unable to run the streaming source in any SDK -- so we added a trivial bounded mode for testing. That trivial mode is no longer necessary. Additionally, it may confuse users into thinking it's reliable (it's not), performant (it's not), or has well defined semantics (it doesn't) -- it's really intended just for testing. Now that the DirectRunner supports everything we need -- unbounded PCollections, non-blocking execution with cancelation, etc. -- we can delete the bounded mode. commit 84a96297c4f790249890cd41775472240181cb62 Author: Dan Halperin <dhalp...@google.com> Date: 2017-04-11T12:11:44Z This closes #2471 commit b615013b9c941038d3e9fd96a153f0894f52f183 Author: Stephen Sisk <s...@google.com> Date: 2017-04-07T19:59:28Z Move HashingFn to io/common, switch to better hash commit c46b256d7dbde1cfde311994faed31e78f143957 Author: Dan Halperin <dhalp...@google.com> Date: 2017-04-11T15:15:51Z This closes #2463 commit 17733e375ec057678d947076e2e83d955d8f8440 Author: Dan Halperin <dhalp...@google.com> Date: 2017-04-11T12:59:25Z Flip dependency edge between Dataflow runner and IO-GCP This will stop integration tests from running. commit 986fcefcad1e48be951babf8a8ce4aeeaece07e3 Author: Ismaël MejÃa <ieme...@apache.org> Date: 2017-04-11T15:16:37Z This closes #2489 commit 01e5a8d5c7517f511d5d7bfc524319a02e6d2e21 Author: Thomas Groh <tg...@google.com> Date: 2017-04-07T18:46:24Z Add Coder utilities for Proto conversions Include Known Coders commit 8beea73c1b57414dfb2b0a3f44f5bee29f088b4e Author: Thomas Groh <tg...@google.com> Date: 2017-04-11T16:58:44Z This closes #2487 commit c08b7b1771481b77c94ec78a96db5b34fec29841 Author: Dipti Kulkarni <dipti_dkulka...@persistent.co.in> Date: 2017-04-10T10:13:12Z Improve HadoopInputFormatIO DisplayData and Cassandra tests commit d255fa25f1a1a0bf61ea159e2922f014d36eda43 Author: Dan Halperin <dhalp...@google.com> Date: 2017-04-11T17:20:35Z This closes #2460 ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---