This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from e705e28ecfd Merge pull request #32589 from jaehyeon-kim/master
add ac01dccfd28 represenation->representation (#32588)
add 48f836aae06 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#32595)
add e640b2578fb Force BQIO to output elements in the correct row (#32584)
add 9487927adce [#32562] Incorporate Prism into the Beam Website. (#32563)
add 7da6c89592b [Go] Update Go version used by Beam repo to go1.23.1
(#32575)
add 543d2ce97de Keep string FQN as a way to add lineage information
(#32585)
add 9b85f718cb8 [yaml] Preserve windowing for windowed input when using
FileIO Java providers (#32586)
add 40a5524d65d Update environments.py
add 111f4c34ab2 Merge pull request #32602 from apache/tvalentyn-patch-2
add deb4b4ada3a Managed Iceberg dynamic destinations (#32565)
add aadb695348d Fix a bug in _get_function_body_without_inners for module
sdks.python.transforms.core (#32591)
add 301286fd6a8 default null array to empty array (#32604)
No new revisions were added by this update.
Summary of changes:
.../test-properties.json | 2 +-
.../actions/setup-environment-action/action.yml | 2 +-
.github/autolabeler.yml | 7 +-
.../arc/images/Dockerfile | 2 +-
.../IO_Iceberg_Integration_Tests.json | 2 +-
.github/trigger_files/beam_PostCommit_Python.json | 2 +-
...tCommit_Python_ValidatesContainer_Dataflow.json | 3 +-
.github/workflows/build_release_candidate.yml | 2 +-
CHANGES.md | 5 +
README.md | 1 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +-
dev-support/docker/Dockerfile | 2 +-
release/src/main/Dockerfile | 4 +-
sdks/go.mod | 14 +-
sdks/go.sum | 28 +--
sdks/go/run_with_go_version.sh | 2 +-
.../java/org/apache/beam/sdk/metrics/Lineage.java | 10 +-
.../java/org/apache/beam/sdk/util/RowFilter.java | 30 ++-
.../beam/sdk/util/RowStringInterpolator.java | 10 +-
.../org/apache/beam/sdk/util/RowFilterTest.java | 8 +-
.../beam/sdk/util/RowStringInterpolatorTest.java | 34 +++-
.../csv/providers/CsvWriteTransformProvider.java | 17 +-
.../io/gcp/bigquery/BeamRowToStorageApiProto.java | 3 +
.../gcp/bigquery/BeamRowToStorageApiProtoTest.java | 23 ++-
.../beam/sdk/io/iceberg/AssignDestinations.java | 30 ++-
.../beam/sdk/io/iceberg/DynamicDestinations.java | 13 +-
.../org/apache/beam/sdk/io/iceberg/IcebergIO.java | 22 ++-
.../IcebergWriteSchemaTransformProvider.java | 32 +++-
.../io/iceberg/OneTableDynamicDestinations.java | 31 +--
.../io/iceberg/PortableIcebergDestinations.java | 81 ++++++++
.../sdk/io/iceberg/WriteGroupedRowsToFiles.java | 12 +-
.../beam/sdk/io/iceberg/WriteToDestinations.java | 43 +++--
.../sdk/io/iceberg/WriteUngroupedRowsToFiles.java | 12 +-
.../apache/beam/sdk/io/iceberg/IcebergIOIT.java | 196 ++++++++++++++++---
.../beam/sdk/io/iceberg/IcebergIOWriteTest.java | 43 +++--
.../IcebergWriteSchemaTransformProviderTest.java | 208 ++++++++++++++++++++-
.../json/providers/JsonWriteTransformProvider.java | 13 +-
sdks/python/apache_beam/io/gcp/bigquery.py | 59 +++---
.../apache_beam/io/gcp/bigquery_write_it_test.py | 1 +
sdks/python/apache_beam/transforms/core.py | 4 +-
sdks/python/apache_beam/transforms/environments.py | 6 +-
website/www/site/content/en/blog/beam-2.59.0.md | 2 +-
.../documentation/pipelines/test-your-pipeline.md | 4 +-
.../content/en/documentation/runners/direct.md | 1 +
.../site/content/en/documentation/runners/prism.md | 145 ++++++++++++++
website/www/site/content/en/roadmap/_index.md | 4 +-
.../www/site/content/en/roadmap/prism-runner.md | 35 ++++
.../www/site/data/en/documentation_runners.yaml | 3 +
.../layouts/partials/section-menu/en/roadmap.html | 1 +
.../layouts/partials/section-menu/en/runners.html | 1 +
50 files changed, 977 insertions(+), 240 deletions(-)
create mode 100644
sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/PortableIcebergDestinations.java
create mode 100644 website/www/site/content/en/documentation/runners/prism.md
create mode 100644 website/www/site/content/en/roadmap/prism-runner.md
