GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/4122
[BEAM-3172] Fix flakiness in sideinputs_test
This change also does a slight clean-up of the exception handling logic.
R: @chamikaramj
You can merge this pull request into a Git
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/4114
[BEAM-3172] CP PR 4113: Properly handle side input exception when all
reader threads complete
R: @reuvenlax
CC: @chamikaramj
You can merge this pull request into a Git repository by
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/4112
[BEAM-3172] Properly handle side input exception when all reader threads
complete
R: @chamikaramj
You can merge this pull request into a Git repository by running:
$ git pull https
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3975
Do not merge: scratch work 3
Follow this checklist to help us incorporate your contribution quickly and
easily:
- [ ] Make sure there is a [JIRA
issue](https://issues.apache.org
Github user charlesccychen closed the pull request at:
https://github.com/apache/beam/pull/3874
---
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3875
Fix Jenkins presubmits by reverting #3255
Currently, presubmits at head are broken with the following error:
```
[EnvInject] - Variables injected successfully.
Parsing POMs
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3874
Update Beam Python version for 2.1.1 release
R: @robertwb
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam update-211
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3872
Exclude incompatible six release, part 2
R: @robertwb
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam fix-six-2
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3742
Avoid passing extra argument to object() constructor in GcsIO
This change fixes the following warning in gcsio_test:
```
apache_beam/io/gcp/gcsio.py:108: DeprecationWarning: object
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3741
[BEAM-2785] Allow termination of DirectRunner execution with Ctrl-C
R: @aaltay
You can merge this pull request into a Git repository by running:
$ git pull https://github.com
Github user charlesccychen closed the pull request at:
https://github.com/apache/beam/pull/3646
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3646
Do not merge: scratch work 2
Follow this checklist to help us incorporate your contribution quickly and
easily:
- [ ] Make sure there is a [JIRA
issue](https://issues.apache.org
Github user charlesccychen closed the pull request at:
https://github.com/apache/beam/pull/3594
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user charlesccychen reopened a pull request:
https://github.com/apache/beam/pull/3594
Do not submit: scratch work
Follow this checklist to help us incorporate your contribution quickly and
easily:
- [ ] Make sure there is a [JIRA
issue](https://issues.apache.org
Github user charlesccychen closed the pull request at:
https://github.com/apache/beam/pull/3594
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3594
Do not submit: scratch work
Follow this checklist to help us incorporate your contribution quickly and
easily:
- [ ] Make sure there is a [JIRA
issue](https://issues.apache.org
Github user charlesccychen closed the pull request at:
https://github.com/apache/beam/pull/3157
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3499
[BEAM-1265] Fix PValue input in _PubSubReadEvaluator
This incorporates @davidcavazos' change proposed in #3483
You can merge this pull request into a Git repository by running:
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3454
Add PubSub I/O support to Python DirectRunner
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3444
Implement streaming GroupByKey in Python DirectRunner
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3440
Remove old deprecated PubSub code
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3423
Clean up test_stream_test and remove stray print statement
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3409
Allow production of unprocessed bundles, introduce TestStream evaluator in
DirectRunner
This change depends on #3405.
You can merge this pull request into a Git repository by running
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3405
Use state / timer API for DirectRunner timer firings
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3373
Populate PBegin input when decoding from Runner API
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3370
Introduce pending bundles and RootBundleProvider in DirectRunner
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3362
Migrate DirectRunner evaluators to use Beam state API
This change depends on #3318.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3354
Move Runner API protos to portability/api
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3346
Reverse removal of NativeWrite evaluator in Python DirectRunner
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3322
Refine Python DirectRunner watermark advancement behavior
This change helps prepare for streaming pipeline execution.
You can merge this pull request into a Git repository by running
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3321
Remove support for NativeSinks from the Python DirectRunner
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam remove
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3318
Choose GroupAlsoByWindows implementation based on streaming flag
This change depends on https://github.com/apache/beam/pull/3315.
You can merge this pull request into a Git repository by
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3315
Move Runner API protos to portability/runners/api
This fixes a circular import issue between transforms/ and runners/
Be sure to do all of the following to help us incorporate your
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3299
Migrate Python tests to not depend on fix sharding for file output
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3242
Fix Python Dataflow execution errors due to #3223
PR #3223 should have first updated the Dataflow Beam worker container
before changing the public API in `gcp/pubsub.py`. This partially
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3198
Update Dataflow BATCH_ENVIRONMENT_MAJOR_VERSION to 6
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3157
[BEAM-1265] Do not merge: streaming scratch work
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3148
Remove "Dataflow" from apache_beam __init__.py file
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure th
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3095
[BEAM-1345] Clearly delineate public API in apache_beam/options
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3086
[BEAM-1340] Move assert_that, equal_to, is_empty to apache_beam.testing.util
Be sure to do all of the following to help us incorporate your contribution
quickly and easily
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3076
Add __all__ tags to modules in package apache_beam/testing
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3075
[BEAM-1340] Add __all__ tags to modules in package apache_beam/tranforms
Be sure to do all of the following to help us incorporate your contribution
quickly and easily
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3021
Update Apache Beam Python version to 2.0.0
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam update-python-200-version
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/3020
Update Apache Beam Python version to 2.1.0.dev
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam
update-python-master
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/2571
Remove overloading of __call__ in DirectRunner
This change makes the usage of CallableTask easier to
understand--previously, there was no easy way to discover where the __call__
method of
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/2570
Clean up TransformResult class
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam clean-up-transformresult
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/2567
Fix GCP import check in bigquery.py
This change fixes the following warning which occurs when "import
apache_beam" is run in an interactive session directly from the "sdks/pyth
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/2427
Test
Do not submit
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam py_custom_create
Alternatively you can review and
Github user charlesccychen closed the pull request at:
https://github.com/apache/beam/pull/2427
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/2389
Add TestStream to Python SDK
The TestStream will be used for verifying streaming runner semantics.
You can merge this pull request into a Git repository by running:
$ git pull https
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/2027
Add Windowing snippets for Python SDK.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam add-python-snippets
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/1914
Retry GCS partial-file read when API call hangs
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/charlesccychen/beam gcsio-fix-hang
Github user charlesccychen closed the pull request at:
https://github.com/apache/beam/pull/1733
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user charlesccychen opened a pull request:
https://github.com/apache/beam/pull/1733
Improve performance of fileio._CompressedFile
This change fixes the timing out of "python setup.py test" for the Python
SDK.
You can merge this pull request into a Git repository
54 matches
Mail list logo