[GitHub] beam pull request #4122: [BEAM-3172] Fix flakiness in sideinputs_test

2017-11-13 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/4122 [BEAM-3172] Fix flakiness in sideinputs_test This change also does a slight clean-up of the exception handling logic. R: @chamikaramj You can merge this pull request into a Git

[GitHub] beam pull request #4114: [BEAM-3172] CP PR 4113: Properly handle side input ...

2017-11-10 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/4114 [BEAM-3172] CP PR 4113: Properly handle side input exception when all reader threads complete R: @reuvenlax CC: @chamikaramj You can merge this pull request into a Git repository by

[GitHub] beam pull request #4112: [BEAM-3172] Properly handle side input exception wh...

2017-11-10 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/4112 [BEAM-3172] Properly handle side input exception when all reader threads complete R: @chamikaramj You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] beam pull request #3975: Do not merge: scratch work 3

2017-10-10 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3975 Do not merge: scratch work 3 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org

[GitHub] beam pull request #3874: Update Beam Python version for 2.1.1 release

2017-09-20 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/beam/pull/3874 ---

[GitHub] beam pull request #3875: Fix Jenkins presubmits by reverting #3255

2017-09-20 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3875 Fix Jenkins presubmits by reverting #3255 Currently, presubmits at head are broken with the following error: ``` [EnvInject] - Variables injected successfully. Parsing POMs

[GitHub] beam pull request #3874: Update Beam Python version for 2.1.1 release

2017-09-20 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3874 Update Beam Python version for 2.1.1 release R: @robertwb You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam update-211

[GitHub] beam pull request #3872: Exclude incompatible six release, part 2

2017-09-20 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3872 Exclude incompatible six release, part 2 R: @robertwb You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam fix-six-2

[GitHub] beam pull request #3742: Avoid passing extra argument to object() constructo...

2017-08-21 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3742 Avoid passing extra argument to object() constructor in GcsIO This change fixes the following warning in gcsio_test: ``` apache_beam/io/gcp/gcsio.py:108: DeprecationWarning: object

[GitHub] beam pull request #3741: [BEAM-2785] Allow termination of DirectRunner execu...

2017-08-21 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3741 [BEAM-2785] Allow termination of DirectRunner execution with Ctrl-C R: @aaltay You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] beam pull request #3646: Do not merge: scratch work 2

2017-07-28 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/beam/pull/3646 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3646: Do not merge: scratch work 2

2017-07-26 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3646 Do not merge: scratch work 2 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org

[GitHub] beam pull request #3594: Do not submit: scratch work

2017-07-25 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/beam/pull/3594 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3594: Do not submit: scratch work

2017-07-19 Thread charlesccychen
GitHub user charlesccychen reopened a pull request: https://github.com/apache/beam/pull/3594 Do not submit: scratch work Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org

[GitHub] beam pull request #3594: Do not submit: scratch work

2017-07-19 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/beam/pull/3594 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3594: Do not submit: scratch work

2017-07-19 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3594 Do not submit: scratch work Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org

[GitHub] beam pull request #3157: [BEAM-1265] Do not merge: streaming scratch work

2017-07-17 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/beam/pull/3157 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3499: [BEAM-1265] Fix PValue input in _PubSubReadEvaluato...

2017-07-05 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3499 [BEAM-1265] Fix PValue input in _PubSubReadEvaluator This incorporates @davidcavazos' change proposed in #3483 You can merge this pull request into a Git repository by running:

[GitHub] beam pull request #3454: Add PubSub I/O support to Python DirectRunner

2017-06-27 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3454 Add PubSub I/O support to Python DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #3444: Implement streaming GroupByKey in Python DirectRunn...

2017-06-26 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3444 Implement streaming GroupByKey in Python DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3440: Remove old deprecated PubSub code

2017-06-26 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3440 Remove old deprecated PubSub code Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3423: Clean up test_stream_test and remove stray print st...

2017-06-22 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3423 Clean up test_stream_test and remove stray print statement Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3409: Allow production of unprocessed bundles, introduce ...

2017-06-20 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3409 Allow production of unprocessed bundles, introduce TestStream evaluator in DirectRunner This change depends on #3405. You can merge this pull request into a Git repository by running

[GitHub] beam pull request #3405: Use state / timer API for DirectRunner timer firing...

2017-06-20 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3405 Use state / timer API for DirectRunner timer firings Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3373: Populate PBegin input when decoding from Runner API

2017-06-15 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3373 Populate PBegin input when decoding from Runner API Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3370: Introduce pending bundles and RootBundleProvider in...

2017-06-15 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3370 Introduce pending bundles and RootBundleProvider in DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3362: Migrate DirectRunner evaluators to use Beam state A...

2017-06-14 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3362 Migrate DirectRunner evaluators to use Beam state API This change depends on #3318. You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] beam pull request #3354: Move Runner API protos to portability/api

2017-06-13 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3354 Move Runner API protos to portability/api Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #3346: Reverse removal of NativeWrite evaluator in Python ...

2017-06-12 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3346 Reverse removal of NativeWrite evaluator in Python DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3322: Refine Python DirectRunner watermark advancement be...

2017-06-07 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3322 Refine Python DirectRunner watermark advancement behavior This change helps prepare for streaming pipeline execution. You can merge this pull request into a Git repository by running

[GitHub] beam pull request #3321: Remove support for NativeSinks from the Python Dire...

2017-06-07 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3321 Remove support for NativeSinks from the Python DirectRunner You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam remove

[GitHub] beam pull request #3318: Choose GroupAlsoByWindows implementation based on s...

2017-06-07 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3318 Choose GroupAlsoByWindows implementation based on streaming flag This change depends on https://github.com/apache/beam/pull/3315. You can merge this pull request into a Git repository by

[GitHub] beam pull request #3315: Move Runner API protos to portability/runners/api

2017-06-07 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3315 Move Runner API protos to portability/runners/api This fixes a circular import issue between transforms/ and runners/ Be sure to do all of the following to help us incorporate your

[GitHub] beam pull request #3299: Migrate Python tests to not depend on fix sharding ...

2017-06-05 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3299 Migrate Python tests to not depend on fix sharding for file output Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3242: Fix Python Dataflow execution errors due to #3223

2017-05-26 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3242 Fix Python Dataflow execution errors due to #3223 PR #3223 should have first updated the Dataflow Beam worker container before changing the public API in `gcp/pubsub.py`. This partially

[GitHub] beam pull request #3198: Update Dataflow BATCH_ENVIRONMENT_MAJOR_VERSION to ...

2017-05-22 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3198 Update Dataflow BATCH_ENVIRONMENT_MAJOR_VERSION to 6 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3157: [BEAM-1265] Do not merge: streaming scratch work

2017-05-15 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3157 [BEAM-1265] Do not merge: streaming scratch work Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #3148: Remove "Dataflow" from apache_beam __init__.py file

2017-05-15 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3148 Remove "Dataflow" from apache_beam __init__.py file Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure th

[GitHub] beam pull request #3095: [BEAM-1345] Clearly delineate public API in apache_...

2017-05-11 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3095 [BEAM-1345] Clearly delineate public API in apache_beam/options Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3086: [BEAM-1340] Move assert_that, equal_to, is_empty to...

2017-05-11 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3086 [BEAM-1340] Move assert_that, equal_to, is_empty to apache_beam.testing.util Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3076: Add __all__ tags to modules in package apache_beam/...

2017-05-10 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3076 Add __all__ tags to modules in package apache_beam/testing Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3075: [BEAM-1340] Add __all__ tags to modules in package ...

2017-05-10 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3075 [BEAM-1340] Add __all__ tags to modules in package apache_beam/tranforms Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3021: Update Apache Beam Python version to 2.0.0

2017-05-09 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3021 Update Apache Beam Python version to 2.0.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam update-python-200-version

[GitHub] beam pull request #3020: Update Apache Beam Python version to 2.1.0.dev

2017-05-09 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3020 Update Apache Beam Python version to 2.1.0.dev You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam update-python-master

[GitHub] beam pull request #2571: Remove overloading of __call__ in DirectRunner

2017-04-18 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/2571 Remove overloading of __call__ in DirectRunner This change makes the usage of CallableTask easier to understand--previously, there was no easy way to discover where the __call__ method of

[GitHub] beam pull request #2570: Clean up TransformResult class

2017-04-18 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/2570 Clean up TransformResult class You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam clean-up-transformresult

[GitHub] beam pull request #2567: Fix GCP import check in bigquery.py

2017-04-17 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/2567 Fix GCP import check in bigquery.py This change fixes the following warning which occurs when "import apache_beam" is run in an interactive session directly from the "sdks/pyth

[GitHub] beam pull request #2427: Test

2017-04-04 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/2427 Test Do not submit You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam py_custom_create Alternatively you can review and

[GitHub] beam pull request #2427: Test

2017-04-04 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/beam/pull/2427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2389: Add TestStream to Python SDK

2017-03-30 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/2389 Add TestStream to Python SDK The TestStream will be used for verifying streaming runner semantics. You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] beam pull request #2027: Add Windowing snippets for Python SDK.

2017-02-16 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/2027 Add Windowing snippets for Python SDK. You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam add-python-snippets

[GitHub] beam pull request #1914: Retry GCS partial-file read when API call hangs

2017-02-03 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/1914 Retry GCS partial-file read when API call hangs You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam gcsio-fix-hang

[GitHub] beam pull request #1733: Improve performance of fileio._CompressedFile

2017-01-06 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/beam/pull/1733 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #1733: Improve performance of fileio._CompressedFile

2017-01-04 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/1733 Improve performance of fileio._CompressedFile This change fixes the timing out of "python setup.py test" for the Python SDK. You can merge this pull request into a Git repository