This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git.
from c57c983 Merge pull request #16074 from [BEAM-13323][Playground] [Bugfix] Fix CI checks add d39cb0a Merge pull request #16050 from [BEAM-13307][Playground] Support Python SDK add 645e102 Merge pull request #16071 from [BEAM-13306][Playground] Add using of Preparators add f6e4aef [BEAM-11943] Fix wrong Klio logo being displayed (#16078) add b09a028 Merge pull request #15954 from [BEAM-960][BEAM-1675] Improvements to JdbcIO coder inference add d500129 [BEAM-13284] Respect expiration time for all Redis write methods. (#16052) add f05bcfe Increase timeout for Dataflow Streaming VR add 3769d75 Merge pull request #16040 from kileys/BEAM-13238-timeout add 9160ba2 [BEAM-12697] Add SBE module and initial classes (#15733) add 792a057 [Playground][Beam-13316][Bugfix] Fix Playground Frontend Precommit (#16075) add 2155c8c [BEAM-13115][Playground] Security – Mock Storage (#16047) add 7a5bdcd [BEAM-13337] Periodically delete stale spanner databases. add 2b5087a Merge pull request #16082 from ibzib/BEAM-13337 add 8d75633 [BEAM-13220] Update release instructions. add 5fc55f3 Merge pull request #16065 from ibzib/BEAM-13220 add e6734b9 [BEAM-13335] Use shorter, numerical indices for dataframe reads. (#16066) add 3ce6138 Be more conservative about rebatching. (#16058) add 33bcdf6 [BEAM-12587] Allow None in Python's Any logical type. (#16055) No new revisions were added by this update. Summary of changes: .github/workflows/build_playground_frontend.yml | 3 + ..._Java_ValidatesRunner_Dataflow_Streaming.groovy | 2 +- .test-infra/tools/stale_dataflow_jobs_cleaner.sh | 7 + playground/backend/cmd/server/controller.go | 2 +- playground/backend/configs/SDK_PYTHON.json | 6 + .../backend/containers/{java => python}/Dockerfile | 18 +- playground/backend/containers/python/app.yaml | 22 ++ .../containers/{java => python}/build.gradle | 7 +- .../containers/{java => python}/settings.gradle | 2 +- .../internal/code_processing/code_processing.go | 23 +- .../internal/environment/environment_service.go | 2 +- .../backend/internal/executors/executor_test.go | 2 +- playground/backend/internal/fs_tool/fs.go | 2 + .../backend/internal/fs_tool/lc_constructor.go | 18 ++ .../internal/fs_tool/{go_fs.go => python_fs.go} | 9 +- .../fs_tool/{go_fs_test.go => python_fs_test.go} | 30 ++- .../{preparator.go => go_preparators.go} | 7 +- .../{preparator.go => python_preparators.go} | 9 +- .../compile_builder/compile_builder_setuper.go | 6 + .../setup_tools/run_builder/run_builder_setuper.go | 2 + .../run_builder/run_builder_setuper_test.go | 4 +- .../{validators_utils.go => preparators_utils.go} | 16 +- .../backend/internal/utils/validators_utils.go | 2 + .../{go_validators.go => python_validators.go} | 6 +- playground/terraform/applications/backend/main.tf | 9 + .../terraform/applications/backend/variables.tf | 12 + .../main/scripts/publish_github_release_notes.sh | 2 +- release/src/main/scripts/run_rc_validation.sh | 128 +--------- release/src/main/scripts/script.config | 2 - .../apache/beam/sdk/annotations/Experimental.java | 3 + .../sbe/build.gradle} | 25 +- .../beam/sdk/extensions/sbe/SbeLogicalTypes.java | 263 +++++++++++++++++++++ .../beam/sdk/extensions/sbe}/package-info.java | 6 +- .../sdk/extensions/sbe/SbeLogicalTypesTest.java | 99 ++++++++ .../java/org/apache/beam/sdk/io/jdbc/JdbcIO.java | 112 ++++++--- .../java/org/apache/beam/sdk/io/jdbc/JdbcIOIT.java | 4 +- .../org/apache/beam/sdk/io/jdbc/JdbcIOTest.java | 19 ++ .../java/org/apache/beam/sdk/io/redis/RedisIO.java | 16 +- .../org/apache/beam/sdk/io/redis/RedisIOTest.java | 45 ++++ sdks/python/apache_beam/dataframe/convert_test.py | 7 + sdks/python/apache_beam/dataframe/io.py | 39 ++- sdks/python/apache_beam/dataframe/transforms.py | 23 +- sdks/python/apache_beam/typehints/schemas.py | 8 +- sdks/python/apache_beam/typehints/schemas_test.py | 3 +- settings.gradle.kts | 2 + .../site/content/en/contribute/release-guide.md | 20 +- website/www/site/data/en/quotes.yaml | 2 +- 47 files changed, 776 insertions(+), 280 deletions(-) create mode 100644 playground/backend/configs/SDK_PYTHON.json copy playground/backend/containers/{java => python}/Dockerfile (73%) create mode 100644 playground/backend/containers/python/app.yaml copy playground/backend/containers/{java => python}/build.gradle (88%) copy playground/backend/containers/{java => python}/settings.gradle (93%) copy playground/backend/internal/fs_tool/{go_fs.go => python_fs.go} (73%) copy playground/backend/internal/fs_tool/{go_fs_test.go => python_fs_test.go} (63%) copy playground/backend/internal/preparators/{preparator.go => go_preparators.go} (83%) copy playground/backend/internal/preparators/{preparator.go => python_preparators.go} (81%) copy playground/backend/internal/utils/{validators_utils.go => preparators_utils.go} (69%) copy playground/backend/internal/validators/{go_validators.go => python_validators.go} (83%) copy sdks/java/{io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/data/text/SnowflakeString.java => extensions/sbe/build.gradle} (65%) create mode 100644 sdks/java/extensions/sbe/src/main/java/org/apache/beam/sdk/extensions/sbe/SbeLogicalTypes.java copy sdks/java/{io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/kinesis => extensions/sbe/src/main/java/org/apache/beam/sdk/extensions/sbe}/package-info.java (87%) create mode 100644 sdks/java/extensions/sbe/src/test/java/org/apache/beam/sdk/extensions/sbe/SbeLogicalTypesTest.java