This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 0c370589685 Remove Beam SQL Data Catalog provider (#40663)
add f40b7169d96 Bump distlib from 0.4.3 to 0.4.4 in /sdks/python (#40679)
add 41df604063f Add missing properties (#40684)
add 4dbf0d78952 Fix Release NightlySnapshot after enabling errorprone for
Java17+ build (#40668)
add d746d747ef3 [Python] Fix GCS client creation in non-default universes
(#40674)
add 62f901f6bfd Upgrade google-api-client to 2.7.2 and use bomupgrade to
manage (#40670)
add cdf9c3ada89 Update google-adk dependency
add bf57625b7ab Revert errant google-adk bump on master (#40687)
add d8ef6a9dc3e Bump github.com/klauspost/compress in /playground/backend
(#40688)
add a412e69657e enable canceling SQL streaming pipeline (#40666)
add 2fdcfb830db Render ARRAY and ITERABLE fields that are not backed by a
List (#39750)
add f014f5aa053 Update test case for numpy 2.4.6 (#40692)
add 7bdc6fff5c9 Fix Release Nightly Snapshot job (#40685)
add 14be1c06097 Update google-adk dependency range (#40689)
add 8a9afdccb5d Fix bigquery_tools_test to mock gcp_bigquery library
instead... (#40676)
add 45e6dd25d0e Fix chown
add 9ea82538701 Add -R flag
add 9146ff289ca Merge pull request #40693 from apache/fix-publish-website
add d50c0a8235c [RunInference] Reject use_model_manager with a multi-model
KeyedModelHandler (#40574)
add 0724ef9ce58 [Spark 4] Clear the watermark of keys without timers or
state in the streaming stateful ParDo (#40550)
add 11e1ce2c1d3 Add an option to set the Dataflow container base
repository (Python, Java, Go) (#40690)
add d37ad248e76 [Python] Support max_batch_weight in BatchElements and
honor element_size_fn in stateful batching
add 86d036c2b0a Apply element_size_fn and batch_length_fn to examples in
keyed RunInference handlers.
add a8d6afdf5cb Finish max_batch_weight support for RunInference: issue
number in CHANGES.md and pipeline-level regression tests
add ceeb5fa975b Merge pull request #40682 from
Eliaaazzz/fix/runinference-max-batch-weight
No new revisions were added by this update.
Summary of changes:
.../trigger_files/beam_PreCommit_Python_ML.json | 2 +-
CHANGES.md | 4 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 21 +-
playground/backend/go.mod | 2 +-
playground/backend/go.sum | 3 +-
.../beam/runners/dataflow/DataflowRunner.java | 25 +-
.../options/DataflowPipelineWorkerPoolOptions.java | 17 ++
.../beam/runners/dataflow/DataflowRunnerTest.java | 53 ++++
.../google-cloud-dataflow-java/worker/build.gradle | 2 +-
.../streaming/state/BeamStatefulProcessor.java | 13 +-
.../streaming/StatefulParDoStreamingTest.java | 49 ++++
scripts/tools/bomupgrader.py | 1 +
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 74 +++++-
sdks/go/pkg/beam/runners/dataflow/dataflow_test.go | 65 +++++
.../org/apache/beam/sdk/schemas/SchemaUtils.java | 32 +--
.../apache/beam/sdk/schemas/SchemaUtilsTest.java | 67 +++++
.../sql/impl/rel/BeamEnumerableConverter.java | 123 ++++++++--
.../sdk/extensions/sql/impl/JdbcDriverTest.java | 51 ++++
.../sql/impl/rel/BeamEnumerableConverterTest.java | 13 +-
.../beam/sdk/io/delta/DeltaWriteTestUtils.java | 1 +
sdks/java/io/iceberg/build.gradle | 4 +
.../java/org/apache/beam/sdk/io/jms/JmsIO.java | 6 -
.../apache_beam/io/gcp/bigquery_tools_test.py | 10 +-
sdks/python/apache_beam/io/gcp/gcsio.py | 21 +-
sdks/python/apache_beam/io/gcp/gcsio_test.py | 46 ++++
sdks/python/apache_beam/ml/inference/base.py | 74 +++++-
sdks/python/apache_beam/ml/inference/base_test.py | 161 ++++++++++++
sdks/python/apache_beam/ml/transforms/base_test.py | 4 +-
.../python/apache_beam/options/pipeline_options.py | 21 +-
.../apache_beam/options/pipeline_options_test.py | 52 ++++
.../runners/dataflow/dataflow_runner.py | 7 +
.../runners/dataflow/dataflow_runner_test.py | 50 ++++
.../runners/dataflow/internal/apiclient.py | 31 ++-
.../runners/dataflow/internal/apiclient_test.py | 75 ++++++
sdks/python/apache_beam/transforms/util.py | 272 +++++++++++++++++++--
sdks/python/apache_beam/transforms/util_test.py | 174 ++++++++++++-
sdks/python/pyproject.toml | 2 +-
sdks/python/setup.py | 8 +-
website/build.gradle | 2 +-
39 files changed, 1528 insertions(+), 110 deletions(-)
