[GitHub] beam pull request #4166: Fix test runtime class conflicts and get hbase test...

2017-11-22 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4166 Fix test runtime class conflicts and get hbase tests passing. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue

[GitHub] beam pull request #4163: Update sdks/java/io/hadoop/jdk1.8-tests to run and ...

2017-11-21 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4163 Update sdks/java/io/hadoop/jdk1.8-tests to run and pass for Gradle build. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a

[GitHub] beam pull request #4160: Add precommit integration tests to examples/java

2017-11-21 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4160 Add precommit integration tests to examples/java Also make Jenkins run a common root task which enumerates all the tasks that it should run. Follow this checklist to help us incorporate

[GitHub] beam pull request #4154: Re-apply PR/3976 and disable the Jenkins Gradle bui...

2017-11-20 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4154 Re-apply PR/3976 and disable the Jenkins Gradle build to fix the other precommits. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #4146: Enable Java Gradle Precommit in Jenkins

2017-11-17 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4146 Enable Java Gradle Precommit in Jenkins Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4140: [BEAM-3202] Ensure that PipelineOptions.getOptionsI...

2017-11-16 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4140 [BEAM-3202] Ensure that PipelineOptions.getOptionsId is always populated. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a

[GitHub] beam pull request #4096: Enable building Apache Beam using Gradle

2017-11-07 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4096 Enable building Apache Beam using Gradle Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4046: Reset Jenkins config

2017-10-26 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/4046 ---

[GitHub] beam pull request #4046: Reset Jenkins config

2017-10-26 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4046 Reset Jenkins config Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects

[GitHub] beam pull request #4045: Reset Jenkins config

2017-10-26 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/4045 ---

[GitHub] beam pull request #4042: [BEAM-3105] Cancel Jenkins builds when an update to...

2017-10-26 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/4042 ---

[GitHub] beam pull request #4045: Reset Jenkins config

2017-10-26 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4045 Reset Jenkins config Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects

[GitHub] beam pull request #4042: [BEAM-3105] Cancel Jenkins builds when an update to...

2017-10-26 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4042 [BEAM-3105] Cancel Jenkins builds when an update to a PR makes a prior build irrelevant Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #4016: [BEAM-2566] Decouple SDK harness from Dataflow runn...

2017-10-19 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4016 [BEAM-2566] Decouple SDK harness from Dataflow runner by elevating experiments and SDK harness configuration to java-sdk-core. Follow this checklist to help us incorporate your contribution quickly

[GitHub] beam pull request #4011: [BEAM-2926] Migrate to using a trivial multimap mat...

2017-10-18 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4011 [BEAM-2926] Migrate to using a trivial multimap materialization within the Java SDK. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #4000: [BEAM-3063] Improve VoidCoder structural value to u...

2017-10-16 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4000 [BEAM-3063] Improve VoidCoder structural value to use a single shared instance. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there

[GitHub] beam pull request #3992: [BEAM-1487, BEAM-3016] Address termination correctn...

2017-10-13 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3992 [BEAM-1487, BEAM-3016] Address termination correctness issues in BufferingStreamObserver & BeamFnLoggingClient The issue with BeamFnLoggingClient is that we can't arriveAndDeregiste

[GitHub] beam pull request #3987: [BEAM-3048] Remove RAND_RANGE in WindowedWordCount

2017-10-12 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3987 [BEAM-3048] Remove RAND_RANGE in WindowedWordCount Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3944: [BEAM-3016] Fix blocking issue within run() when ch...

2017-10-06 Thread lukecwik
GitHub user lukecwik reopened a pull request: https://github.com/apache/beam/pull/3944 [BEAM-3016] Fix blocking issue within run() when channel terminates while blocking within DirectStreamObserver. Follow this checklist to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3944: [BEAM-3016] Fix blocking issue within run() when ch...

2017-10-06 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/3944 ---

[GitHub] beam pull request #3952: [BEAM-2926] Add initial support to be able to read ...

2017-10-05 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3952 [BEAM-2926] Add initial support to be able to read singleton and iterable side inputs to Java SDK harness. Follow this checklist to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3944: [BEAM-3016] Fix blocking issue within run() when ch...

2017-10-04 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3944 [BEAM-3016] Fix blocking issue within run() when channel terminates while blocking within DirectStreamObserver. Follow this checklist to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3931: [BEAM-3007] Add test which covers PCollection consu...

2017-10-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3931 [BEAM-3007] Add test which covers PCollection consumed by Flatten and another primitive. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #3913: [BEAM-2959] Encapsulate enums within a message so t...

2017-09-27 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3913 [BEAM-2959] Encapsulate enums within a message so that C++/Python have meaningful namespaces when importing. Follow this checklist to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3904: [BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED...

2017-09-26 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3904 [BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED" as the first declared enum. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #3856: [BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED...

2017-09-15 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3856 [BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED" as the first declared field. Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #3849: [BEAM-2956] Attempt to correctly report the Dataflo...

2017-09-13 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3849 [BEAM-2956] Attempt to correctly report the Dataflow distribution in GCP related modules. Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #3832: [BEAM-2862] Add PTransform overrides specific to ex...

2017-09-08 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3832 [BEAM-2862] Add PTransform overrides specific to execution of StatefulDoFns over the Fn API using the DataflowRunner. Follow this checklist to help us incorporate your contribution quickly and

[GitHub] beam pull request #3824: Add ThrowingBiConsumer to the set of functional int...

2017-09-08 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3824 Add ThrowingBiConsumer to the set of functional interfaces Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #3795: [BEAM-1347] Wire up the BeamFnStateGrpcClientCache ...

2017-08-30 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3795 [BEAM-1347] Wire up the BeamFnStateGrpcClientCache implementation into the ProcessBundleHandler Follow this checklist to help us incorporate your contribution quickly and easily: - [x

[GitHub] beam pull request #3788: [BEAM-1347] Implement a BeamFnStateClient which com...

2017-08-29 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3788 [BEAM-1347] Implement a BeamFnStateClient which communicates over gRPC. Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[GitHub] beam pull request #3783: [BEAM-1347] Create value state, combining state, an...

2017-08-29 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3783 [BEAM-1347] Create value state, combining state, and bag state views over the BagUserState. Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #3766: Ensure Dataflow service version matches Google API ...

2017-08-25 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3766 Ensure Dataflow service version matches Google API service version 1.22.0 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a

[GitHub] beam pull request #3760: [BEAM-1347] Add a BagUserState implementation over ...

2017-08-24 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3760 [BEAM-1347] Add a BagUserState implementation over the BeamFnStateClient Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a

[GitHub] beam pull request #3761: [BEAM-1347] Remove unused FakeStepContext now that ...

2017-08-24 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3761 [BEAM-1347] Remove unused FakeStepContext now that FnApiDoFnRunner has its own implementation Follow this checklist to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3736: [BEAM-1347] Provide an abstraction which creates an...

2017-08-18 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3736 [BEAM-1347] Provide an abstraction which creates an Iterator view over the Beam Fn State API Combining this with the DataStreams.DataStreamDecoder converts the Beam Fn State API into a an

[GitHub] beam pull request #3724: [BEAM-1347] Convert an InputStream into an Iterable...

2017-08-16 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3724 [BEAM-1347] Convert an InputStream into an Iterable using the Beam Fn data specification Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #3723: [BEAM-1347] Plumb through a yet to be created state...

2017-08-16 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3723 [BEAM-1347] Plumb through a yet to be created state client through PTransformRunnerFactory Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #3638: [BEAM-1347] Add utility to be able to model inbound...

2017-07-25 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3638 [BEAM-1347] Add utility to be able to model inbound reading as a single input stream Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3622: [BEAM-2642] Update Google Auth to 0.7.1

2017-07-23 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3622 [BEAM-2642] Update Google Auth to 0.7.1 Google auth libraries 0.6.1 and 0.7.1 have the same versions of dependencies. Follow this checklist to help us incorporate your contribution quickly

[GitHub] beam pull request #3621: [BEAM-2662] Fix Java quickstart for Spark to includ...

2017-07-23 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3621 [BEAM-2662] Fix Java quickstart for Spark to include Spark version Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[GitHub] beam pull request #3620: [BEAM-2662] Fix Java quickstart for Spark to includ...

2017-07-23 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3620 [BEAM-2662] Fix Java quickstart for Spark to include Spark version Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[GitHub] beam pull request #3596: [BEAM-2642] Update Google Auth to 0.7.1

2017-07-19 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3596 [BEAM-2642] Update Google Auth to 0.7.1 Google auth libraries 0.6.1 and 0.7.1 have the same versions of dependencies. Follow this checklist to help us incorporate your contribution quickly

[GitHub] beam pull request #3495: [BEAM-2552] Update Dataflow Java container version ...

2017-07-05 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/3495 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3495: [BEAM-2552] Update Dataflow Java container version ...

2017-07-05 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3495 [BEAM-2552] Update Dataflow Java container version for 2.1.0 release Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the

[GitHub] beam pull request #3494: [BEAM-2553] Update Maven exec plugin to 1.6.0 to in...

2017-07-05 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3494 [BEAM-2553] Update Maven exec plugin to 1.6.0 to incorporate messaging improvements Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3482: [BEAM-1348] Remove deprecated concepts in Fn API (n...

2017-06-30 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3482 [BEAM-1348] Remove deprecated concepts in Fn API (now replaced with Runner API concepts). Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3432: [BEAM-1347] Create a DoFnRunner specific for the Fn...

2017-06-23 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3432 [BEAM-1347] Create a DoFnRunner specific for the Fn API Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is

[GitHub] beam pull request #3430: [BEAM-1187] Improve logging to contain the number o...

2017-06-23 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3430 [BEAM-1187] Improve logging to contain the number of retries done due to IOException and unsuccessful response codes. Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam-site pull request #257: [BEAM-2500] List Amazon S3 File System as a pla...

2017-06-22 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam-site/pull/257 [BEAM-2500] List Amazon S3 File System as a planned I/O. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lukecwik/incubator-beam-site asf

[GitHub] beam pull request #3397: [BEAM-1348] Fix type error introduced into Python S...

2017-06-19 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3397 [BEAM-1348] Fix type error introduced into Python SDK because of PR/3268 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3375: [BEAM-1347] Break apart ProcessBundleHandler to use...

2017-06-15 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3375 [BEAM-1347] Break apart ProcessBundleHandler to use service locator pattern based upon URNs. This cleans up ProcessBundleHandler and allows for separate improvements of the various PTransform

[GitHub] beam pull request #3366: [BEAM-1348] Mark Runner API like types declared wit...

2017-06-14 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3366 [BEAM-1348] Mark Runner API like types declared within Fn API as deprecated Add additional documentation. Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #3312: Swap to use an Impulse primitive + DoFn for Create ...

2017-06-07 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3312 Swap to use an Impulse primitive + DoFn for Create when executing with the Fn API. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x

[GitHub] beam pull request #3310: [BEAM-1231] Add missed "kind:bytes" to CloudObjectK...

2017-06-07 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3310 [BEAM-1231] Add missed "kind:bytes" to CloudObjectKinds/CloudObjectTranslators Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[GitHub] beam pull request #3297: [BEAM-1347] Migrate to Runner API constructs within...

2017-06-05 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3297 [BEAM-1347] Migrate to Runner API constructs within the Java SDK harness Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3296: [BEAM-1347] Add additional logging

2017-06-05 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3296 [BEAM-1347] Add additional logging Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like

[GitHub] beam pull request #3271: [BEAM-1348] Add Runner API constructs to ProcessBun...

2017-05-31 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3271 [BEAM-1348] Add Runner API constructs to ProcessBundleDescriptor. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3268: [BEAM-1348] Model the Fn State Api as per https://s...

2017-05-31 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3268 [BEAM-1348] Model the Fn State Api as per https://s.apache.org/beam-fn-state-api-and-bundle-processing Be sure to do all of the following to help us incorporate your contribution quickly and

[GitHub] beam pull request #3260: [BEAM-1347] Remove the usage of a thread local on a...

2017-05-30 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3260 [BEAM-1347] Remove the usage of a thread local on a potentially hot path Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3223: [BEAM-2354] Add a ReadStringsFromPubSub/WriteString...

2017-05-24 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3223 [BEAM-2354] Add a ReadStringsFromPubSub/WriteStringsToPubSub PTransform Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3212: [BEAM-2354] Enable a native pubsub source within th...

2017-05-23 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/3212 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3212: [BEAM-2354] Enable a native pubsub source within th...

2017-05-23 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3212 [BEAM-2354] Enable a native pubsub source within the Dataflow Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[GitHub] beam pull request #3159: [BEAM-2252] Use resource transformer plugin to use ...

2017-05-15 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3159 [BEAM-2252] Use resource transformer plugin to use versions defined in root pom.xml within maven archetype poms Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #3152: [BEAM-2252] Use pluginManagement instead of redefin...

2017-05-15 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3152 [BEAM-2252] Use pluginManagement instead of redefining maven-shade-plugin to inherit build order from root pom.xml Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #3143: [BEAM-2299] Run maven install on Windows machine fo...

2017-05-15 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3143 [BEAM-2299] Run maven install on Windows machine for build/test coverage on Windows. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3134: [BEAM-1345] Remove FileSystems.setDefaultConfigInWo...

2017-05-12 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3134 [BEAM-1345] Remove FileSystems.setDefaultConfigInWorkers since Dataflow no longer depends on this Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3120: Cherry pick #2854: [BEAM-2095] Made SourceRDD.Bound...

2017-05-12 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/3120 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3120: Cherry pick #2854: [BEAM-2095] Made SourceRDD.Bound...

2017-05-12 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3120 Cherry pick #2854: [BEAM-2095] Made SourceRDD.Bounded iterator's hasNext idempotent Be sure to do all of the following to help us incorporate your contribution quickly and e

[GitHub] beam pull request #3119: Cherry pick #2854: [BEAM-2095] Made SourceRDD.Bound...

2017-05-12 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/3119 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3119: Cherry pick #2854: [BEAM-2095] Made SourceRDD.Bound...

2017-05-12 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3119 Cherry pick #2854: [BEAM-2095] Made SourceRDD.Bounded iterator's hasNext idempotent Be sure to do all of the following to help us incorporate your contribution quickly and e

[GitHub] beam pull request #3100: Cherry pick #3093: [BEAM-2256] Add the last previou...

2017-05-11 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/3100 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3100: Cherry pick #3093: [BEAM-2256] Add the last previou...

2017-05-11 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3100 Cherry pick #3093: [BEAM-2256] Add the last previous range filter Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3066: Cherry-pick #3062: Skip generating empty jars for p...

2017-05-10 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/3066 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3066: Cherry-pick #3063: Skip generating empty jars for p...

2017-05-10 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3066 Cherry-pick #3063: Skip generating empty jars for parent poms Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3061: Cherry-pick #3034: [BEAM-2242] Ensure that jars are...

2017-05-10 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/3061 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3061: Cherry-pick #3034: [BEAM-2242] Ensure that jars are...

2017-05-10 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3061 Cherry-pick #3034: [BEAM-2242] Ensure that jars are shaded correctly by running the jar plugin before the shade plugin Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #3034: [BEAM-2242] Ensure that the test jar is shaded corr...

2017-05-09 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3034 [BEAM-2242] Ensure that the test jar is shaded correctly This required listing the maven jar plugin earlier within the file so that the jar/test jar ran before shade within the package phase

[GitHub] beam pull request #2980: PR to run tests for #2933 using updated Dataflow wo...

2017-05-08 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2980 PR to run tests for #2933 using updated Dataflow worker image Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #2941: PR to run tests for #2930 on Jenkins

2017-05-06 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/2941 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2941: PR to run tests for #2930 on Jenkins

2017-05-06 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2941 PR to run tests for #2930 on Jenkins Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2929: [BEAM-2187] Fix build break in SparkRuntimeContextT...

2017-05-05 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/2929 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2929: [BEAM-2187] Fix build break in SparkRuntimeContextT...

2017-05-05 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2929 [BEAM-2187] Fix build break in SparkRuntimeContextTest Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #2910: [BEAM-2174] Update CoderRegistry to allow creating ...

2017-05-04 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2910 [BEAM-2174] Update CoderRegistry to allow creating coders through CoderFactory for a wider range of types Be sure to do all of the following to help us incorporate your contribution quickly and

[GitHub] beam pull request #2905: [BEAM-1871] Move out test only utilities used only ...

2017-05-04 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2905 [BEAM-1871] Move out test only utilities used only in examples/java out of sdks/java/core. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2881: [BEAM-2135] Update Dataflow to support serializing/...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2881 [BEAM-2135] Update Dataflow to support serializing/deserializing custom user types configured via Jackson modules This also updates the runner harness and existing tests to use a properly

[GitHub] beam pull request #2880: [BEAM-2165] Update Apex to support serializing/dese...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2880 [BEAM-2165] Update Apex to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] beam pull request #2879: [BEAM-2165] Update Flink to support serializing/des...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2879 [BEAM-2165] Update Flink to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #2877: [BEAM-2135] Update Spark to support serializing/des...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2877 [BEAM-2135] Update Spark to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #2868: [BEAM-1871] Migrate ReleaseInfo away from Google AP...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2868 [BEAM-1871] Migrate ReleaseInfo away from Google API client GenericJson Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2862: [BEAM-1871] Move GCP specific serialization CloudOb...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2862 [BEAM-1871] Move GCP specific serialization CloudObject and supporting translation code to Dataflow runner module Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #2844: [BEAM-2135] Fix pointers to sdks/java/io/hadoop-fil...

2017-05-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2844 [BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2825: Remove Coder.asCloudObject and related methods

2017-05-02 Thread lukecwik
Github user lukecwik closed the pull request at: https://github.com/apache/beam/pull/2825 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2828: [BEAM-2135] Move hdfs to hadoop-file-system

2017-05-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2828 [BEAM-2135] Move hdfs to hadoop-file-system Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #2827: [BEAM-2135] Move gcp-core to google-cloud-platform-...

2017-05-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2827 [BEAM-2135] Move gcp-core to google-cloud-platform-core Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #2825: Remove Coder.asCloudObject and related methods

2017-05-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2825 Remove Coder.asCloudObject and related methods Rebase #2806 on top of apache/master If this passes, will merge in #2806 You can merge this pull request into a Git repository by running

[GitHub] beam pull request #2804: [BEAM-1871] Remove deprecated org.apache.beam.sdk.o...

2017-05-01 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2804 [BEAM-1871] Remove deprecated org.apache.beam.sdk.options.GcsOptions after updating Dataflow worker Worker has been migrated to org.apache.beam.sdk.extensions.gcp.options.GcsOptions Be

[GitHub] beam pull request #2803: [BEAM-1871] Hide CloudResourceManager client in sdk...

2017-05-01 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2803 [BEAM-1871] Hide CloudResourceManager client in sdks/java/extensions/gcp-core Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2794: [BEAM-2130] Ensure the options id is never null.

2017-04-30 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2794 [BEAM-2130] Ensure the options id is never null. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #2777: [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2...

2017-04-28 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2777 [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2033, BEAM-2070] Base implementation of HadoopFileSystem. TODO: * Add multiplexing FileSystem that is able to route requests based upon the

  1   2   >