This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from a3af5d54e25 feat(BigQueryWriteSchemaTransformProvider): add output
collection names and error handling check (#36937)
add f7a5bbd4a35 Revert "SolaceIO data loss - remove message ack from close
and advance as it may lead to data loss during work rebalancing or retry. "
(#37162)
add 78eb4a2a2d7 fix: Enable `create_test` to correctly parse and apply
external providers defined in YAML pipeline specifications. (#37216)
add ab14c432dad Support for EnvoyRateLimiter in Beam Python SDK (#37135)
add 44ed498ee5c Add Picosecond timestamp support to storage API
WriteTableRows (#37091)
add 19f9eb06fb5 [yaml] - add multi-line windowing json support (#37174)
No new revisions were added by this update.
Summary of changes:
runners/google-cloud-dataflow-java/build.gradle | 2 +
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 63 ++++
.../io/gcp/bigquery/TableRowToStorageApiProto.java | 106 +++++-
.../io/gcp/bigquery/BigQueryTimestampPicosIT.java | 414 +++++++++++++++++++++
.../sdk/io/gcp/bigquery/BigQueryUtilsTest.java | 94 +++++
.../bigquery/TableRowToStorageApiProtoTest.java | 142 ++++++-
.../sdk/io/solace/read/SolaceCheckpointMark.java | 9 +-
.../sdk/io/solace/read/UnboundedSolaceReader.java | 33 +-
.../beam/sdk/io/solace/SolaceIOReadTest.java | 73 +---
.../apache_beam/examples/rate_limiter_simple.py | 93 +++++
.../apache_beam/io/components/rate_limiter.py | 226 +++++++++++
.../apache_beam/io/components/rate_limiter_test.py | 143 +++++++
sdks/python/apache_beam/yaml/yaml_testing.py | 21 +-
sdks/python/apache_beam/yaml/yaml_testing_test.py | 39 ++
sdks/python/apache_beam/yaml/yaml_transform.py | 15 +
.../python/apache_beam/yaml/yaml_transform_test.py | 55 +++
16 files changed, 1436 insertions(+), 92 deletions(-)
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryTimestampPicosIT.java
create mode 100644 sdks/python/apache_beam/examples/rate_limiter_simple.py
create mode 100644 sdks/python/apache_beam/io/components/rate_limiter.py
create mode 100644 sdks/python/apache_beam/io/components/rate_limiter_test.py