GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/2241
Sync gearpump-runner branch with master Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-<Jira issue #>] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/manuzhang/incubator-beam gearpump-runner-merge Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2241.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2241 ---- commit 3120fd9a499b01b08659edc4e045f5abbcc3ae07 Author: Kenneth Knowles <k...@google.com> Date: 2017-02-24T02:06:56Z Condense FunctionSpec and remove SdkFunctionSpec, merging data and params commit 49c9de1e84e0f322dfd4426d8f1d523aee1529e9 Author: Kenneth Knowles <k...@google.com> Date: 2017-02-24T22:39:19Z This closes #2094: Concretize generic bits of the Runner API graph structure Condense FunctionSpec and remove SdkFunctionSpec, merging data and params Inline PTransform to GraphNode, removing generic design commit 8a06134c6543394849a5f8856418dd699fd2e2a7 Author: Kenneth Knowles <k...@google.com> Date: 2017-02-24T23:07:35Z This closes #2103: Ignore HBaseIOTest temporarily commit 1b1bb0b9aeb8f4b131fbcf62b117ef3f55db2f61 Author: Ahmet Altay <al...@google.com> Date: 2017-02-24T21:29:01Z Change the package name to apache-beam Also, allow direct installations from PyPI (once the package is published.) This will eventually make sdk_location an optional argument. commit b1fd55f0c0a10c9376ee084582532df1e6fd7359 Author: Ahmet Altay <al...@google.com> Date: 2017-02-24T23:13:25Z This closes #2102 commit fa13c7b9362c65d8d61e914d3822dea025400d5b Author: Vikas Kedigehalli <vika...@google.com> Date: 2017-02-24T19:04:55Z Ignore undeclared outputs in the java fn harness commit d79fb3e06ddc8ff7d06645d0c4a2c685a90c250b Author: Dan Halperin <dhalp...@google.com> Date: 2017-02-24T23:16:15Z This closes #2100 commit 7162964f058002db76232fd04d720ce9c3e75585 Author: Ahmet Altay <al...@google.com> Date: 2017-02-24T23:43:17Z Update python sdk readme commit 639f9f4b7195eee3528acabc358f3790f4549c57 Author: Ahmet Altay <al...@google.com> Date: 2017-02-24T23:55:43Z This closes #2105 commit a5b8cb1e11deee7fe7ed152a4718a1f971f58eab Author: Pablo <pabl...@google.com> Date: 2017-02-15T23:16:12Z Making metrics queriable in Python SDK. commit 415546eda7916f6f43b5d101ef5c15aa7948dac9 Author: Ahmet Altay <al...@google.com> Date: 2017-02-25T01:39:06Z This closes #2016 commit 2736c4ae901ad428f8e05fb7a80ad72f0318735e Author: Ismaël MejÃa <ieme...@gmail.com> Date: 2017-02-24T15:46:17Z [BEAM-1554] Add verification of Coder structural equality after enc/dec This also improves the class documentation. commit 437ba250525f5b611a3e3c31bee782aea24a16ce Author: Kenneth Knowles <k...@google.com> Date: 2017-02-25T03:23:13Z This closes #2098: Add verification of Coder structural equality after encoding/decoding commit 32cd4836d2441c10fa71df4344c6b546c2c0ca3a Author: Ahmet Altay <al...@google.com> Date: 2017-02-25T04:19:49Z Disable newly added tests, that is failing is post-commits. commit 38a01e9cf8d959ace3baa1593f8dc17d4f12954d Author: Ahmet Altay <al...@google.com> Date: 2017-02-26T02:30:50Z This closes #2107 commit acc10130982168ad5c4f29b2af3be67e53f7c967 Author: Stas Levin <stasle...@gmail.com> Date: 2017-02-23T22:02:14Z Updated TestPipeline's javadoc. commit 4bba380cb011e38bd78c1ec899a6672a6b02fd05 Author: Stas Levin <stasle...@apache.org> Date: 2017-02-26T15:28:26Z This closes #2089 commit b74f8fa30aea130f990c152a1c91a509c3b6d6c9 Author: Aviem Zur <aviem...@gmail.com> Date: 2017-02-23T05:09:55Z Remove periods from step name in SparkBeamMetric to avoid inconsistent hierarchies in Graphite metric sink commit 3082178b3a35143573caa2b3d9afbf2babb5b2b5 Author: Stas Levin <stasle...@apache.org> Date: 2017-02-27T12:16:55Z This closes #2083 commit 0ae2a3851cbfe1ec2f2c7237954b18c9951c76a3 Author: JingsongLi <lzljs3620...@aliyun.com> Date: 2017-02-27T10:08:34Z [BEAM-1560] Use provided Function Runners in Flink Batch Runner commit b261d489061e9a92b7df28ca71bce00844f7dfa6 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2017-02-27T12:22:49Z This closes #2112: Use provided Function Runners in Flink Batch Runner commit d1f6a8af12d7db01c45c269551b1e3ec92a8afa0 Author: Ismaël MejÃa <ieme...@gmail.com> Date: 2017-02-23T20:13:19Z [BEAM-1541] Create hadoop-common and refactor HdfsIO and HBaseIO to use it commit 9e4b140ed5351ee437520ff9485a38747b07d9b5 Author: Dan Halperin <dhalp...@google.com> Date: 2017-02-27T16:43:37Z This closes #2087 commit a6cd8c3842cc1e3f72e02b5a9d1332bc6cddd35c Author: Thomas Groh <tg...@google.com> Date: 2017-02-16T21:57:21Z Get DataflowRunner out of the #apply() Use Pipeline Surgery in the Dataflow Runner Add additional override factories for Dataflow overrides. commit f5c04e1566ab3b743494a8e58577262344a9c47b Author: Thomas Groh <tg...@google.com> Date: 2017-02-23T23:24:10Z Update Dataflow Container Version commit aaf0884d50eae620fc76e906ef4591c514ccb4d7 Author: Thomas Groh <tg...@google.com> Date: 2017-02-27T17:06:13Z This closes #2039 commit 63035de82d5e484804e0cf3160a788041e6fe3d3 Author: Neville Li <nevi...@spotify.com> Date: 2017-02-21T16:34:22Z Add DEFLATE to CompressedSource and TextIO * add DEFLATE to CompressedSource * update docs in CompressedSource.java * update CompressedSourceTest * add DELATE to TextIO * update TextIOTest * add DEFLATE to FileBasedSink * update FileBasedSinkTest commit 0b7515e5e56c56e89aa75889ec4c08fba9645b8e Author: Dan Halperin <dhalp...@google.com> Date: 2017-02-27T17:37:58Z This closes #2056 commit c183a7bd172044459e5f0255c447b882d5586409 Author: Aviem Zur <aviem...@gmail.com> Date: 2017-02-24T09:18:02Z Add Create#withTypeDescriptor This permits creates that cannot infer a coder based on the input elements to pass a Type Descriptor and use Coder Inference, rather than requiring a coder be provided. commit 063fbd4ed4ed34dece6490e791f0e5c91ec52895 Author: Thomas Groh <tg...@google.com> Date: 2017-02-27T17:39:47Z This closes #2095 ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---