This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 3aad50b99e8 [Security] Bump ActiveMQ from 5.14.5 to 5.19.2 (#37944)
add 012f825245d [Java] Optimize beam pubsub message to serialized pubsub
protobuf message (#37896)
add 8e90c36ff1b [Java] Optimize StreamUtils to avoid copying bytes (#37912)
add b6d8f428e29 Iceberg Add Files (#37701)
add 683ecebe3af Fix typo in arc readme (#37948)
add 7431dea675b [#37930][Runners] Reap child processes in ProcessManager
to prevent zombie accumulation (#37932)
add 08685524465 Pin setuptools below 82 for TensorFlow Hub pkg_resources
compatibility (#37929)
add 40951024bfe Iceberg AddFiles -- handle FileNotFound exceptions (#37952)
add 97da2d69121 Update changes.md (#37936)
add dcb1b756e7d Add OrderedListState support in Go SDK (#37629)
add 2eb71e989b4 Bump picomatch from 2.2.2 to 2.3.2 in /website/www (#37955)
No new revisions were added by this update.
Summary of changes:
.../gh-actions-self-hosted-runners/arc/README.md | 2 +-
.../IO_Iceberg_Integration_Tests.json | 2 +-
CHANGES.md | 8 +
.../fnexecution/environment/ProcessManager.java | 20 +-
.../ordered_list_state/ordered_list_state.go | 93 +++
sdks/go/examples/snippets/04transforms.go | 32 +
sdks/go/pkg/beam/core/graph/fn.go | 4 +-
sdks/go/pkg/beam/core/runtime/exec/data.go | 6 +
.../pkg/beam/core/runtime/exec/sideinput_test.go | 15 +
sdks/go/pkg/beam/core/runtime/exec/translate.go | 2 +
sdks/go/pkg/beam/core/runtime/exec/userstate.go | 150 +++++
.../pkg/beam/core/runtime/exec/userstate_test.go | 25 +-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 16 +-
sdks/go/pkg/beam/core/runtime/harness/statemgr.go | 82 +++
sdks/go/pkg/beam/core/state/state.go | 133 ++++
sdks/go/pkg/beam/core/state/state_test.go | 243 ++++++-
sdks/go/test/integration/integration.go | 6 +
sdks/go/test/integration/primitives/state.go | 38 ++
sdks/go/test/integration/primitives/state_test.go | 5 +
.../java/org/apache/beam/sdk/util/StreamUtils.java | 47 +-
.../apache/beam/sdk/util/UnownedInputStream.java | 4 +
.../org/apache/beam/sdk/util/CoderUtilsTest.java | 10 +
.../org/apache/beam/sdk/util/StreamUtilsTest.java | 95 +++
.../beam/sdk/io/gcp/pubsub/PubsubMessages.java | 52 +-
.../beam/sdk/io/gcp/pubsub/PubsubMessagesTest.java | 176 +++++
sdks/java/io/iceberg/build.gradle | 7 +-
.../org/apache/beam/sdk/io/iceberg/AddFiles.java | 706 +++++++++++++++++++++
.../iceberg/AddFilesSchemaTransformProvider.java | 190 ++++++
.../apache/beam/sdk/io/iceberg/PartitionUtils.java | 5 +-
.../org/apache/beam/sdk/io/iceberg/ReadUtils.java | 30 +
.../org/apache/beam/sdk/io/iceberg/AddFilesIT.java | 536 ++++++++++++++++
.../apache/beam/sdk/io/iceberg/AddFilesTest.java | 678 ++++++++++++++++++++
.../org/apache/beam/sdk/io/parquet/ParquetIO.java | 4 +-
.../ml/inference/tensorflow_tests_requirements.txt | 3 +
.../content/en/documentation/programming-guide.md | 4 +
website/www/yarn.lock | 13 +-
36 files changed, 3386 insertions(+), 56 deletions(-)
create mode 100644 sdks/go/examples/ordered_list_state/ordered_list_state.go
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubMessagesTest.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/AddFiles.java
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/AddFilesSchemaTransformProvider.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/AddFilesIT.java
create mode 100644
sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/AddFilesTest.java
