This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 85bf3888959 More efficient map side inputs for small maps. (#29587)
add 209b0959ce8 Bump github.com/aws/aws-sdk-go-v2/config from 1.25.8 to
1.26.0 in /sdks (#29678)
add a7976f54908 [Python][RRIO] Call PTransform with setup teardown (#29585)
add ff03c129e07 Shrink Java PreCommit timeout (#29671)
add 5c670da47c9 Add Data Sampling support for periodic sampling (#29590)
add e19ace02a28 [#29605] Go SDK: Eagerly create timer writers to ensure
is_last sent, minmize lock contention. (#29607)
add b7530a24fcc Retry building a wheel up to 3 times. (#29676)
add d23ed6f7f03 Bump cloud.google.com/go/bigtable from 1.20.0 to 1.21.0 in
/sdks (#29677)
add 98a26906bfa Guard keys-values multi map input with a flag. (#29690)
add 4891a81a544 [YAML] Add and cleanup documentation for several builtin
transforms. (#29673)
No new revisions were added by this update.
Summary of changes:
.github/workflows/beam_PreCommit_Java.yml | 1 +
.../fnexecution/control/RemoteExecutionTest.java | 13 +-
sdks/go.mod | 26 +--
sdks/go.sum | 52 +++---
sdks/go/examples/timer_wordcap/wordcap.go | 1 -
sdks/go/pkg/beam/core/runtime/exec/datasampler.go | 153 +++++++++++++++++
.../pkg/beam/core/runtime/exec/datasampler_test.go | 148 +++++++++++++++++
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 1 +
sdks/go/pkg/beam/core/runtime/exec/pcollection.go | 32 +++-
.../pkg/beam/core/runtime/exec/pcollection_test.go | 4 +-
sdks/go/pkg/beam/core/runtime/exec/to_string.go | 1 +
sdks/go/pkg/beam/core/runtime/exec/translate.go | 18 +-
.../pkg/beam/core/runtime/exec/translate_test.go | 4 +-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 2 +
sdks/go/pkg/beam/core/runtime/harness/datamgr.go | 23 +++
.../pkg/beam/core/runtime/harness/datamgr_test.go | 12 ++
sdks/go/pkg/beam/core/runtime/harness/harness.go | 33 +++-
.../pkg/beam/core/runtime/harness/harness_test.go | 2 +-
sdks/go/pkg/beam/core/runtime/harness/init/init.go | 23 ++-
sdks/go/pkg/beam/core/typex/fulltype.go | 11 +-
.../pkg/beam/runners/dataflow/dataflowlib/job.go | 1 +
.../transforms/SchemaTransformProvider.java | 5 +
.../sdk/expansion/service/ExpansionService.java | 1 +
.../SqlTransformSchemaTransformProvider.java | 17 +-
.../beam/fn/harness/state/MultimapSideInput.java | 120 ++++++++------
.../fn/harness/state/MultimapSideInputTest.java | 12 +-
sdks/python/apache_beam/io/requestresponseio.py | 181 +++++++++++++++++++--
.../apache_beam/io/requestresponseio_it_test.py | 18 +-
.../apache_beam/io/requestresponseio_test.py | 88 ++++++++++
.../apache_beam/runners/worker/bundle_processor.py | 62 +++----
sdks/python/apache_beam/transforms/external.py | 22 ++-
.../apache_beam/yaml/standard_providers.yaml | 14 +-
sdks/python/apache_beam/yaml/yaml_mapping.py | 22 +++
sdks/python/apache_beam/yaml/yaml_provider.py | 90 ++++++++--
sdks/python/build.gradle | 5 +-
35 files changed, 1015 insertions(+), 203 deletions(-)
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/datasampler.go
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/datasampler_test.go
create mode 100644 sdks/python/apache_beam/io/requestresponseio_test.py
