This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git
from aa0a35dabf9 Fix checkArgument format string in TestStream (#24134) add a9da2abee64 Fix checkArgument format string in ExecutionStateTracker add 223768f782f Merge pull request #24136: Fix checkArgument format string in ExecutionStateTracker add 105ed6fedcb [Website] update go-dependencies.md java-dependencies.md programming-guide.md links #24084 add 4e39ef20410 Merge pull request #24115: [Website] update go-dependencies.md java-dependencies.md links add 623083cd0a7 [Website] change headers size from h4,h3 to h2 #24082 add 2bb03d62e2d Merge pull request #24000: [Website] Change headers size from h4,h3 to h2 add 451f6b3e7f5 Bump golang.org/x/net from 0.1.0 to 0.2.0 in /sdks (#24153) add caabd9be528 Make MonotonicWatermarkEstimator work like its Java SDK equivalent (#24146) add d001a69e1a5 Test Dataproc 2.1 with Flink load tests (#24129) add 137799672eb Fix checkArgument format string in AvroIO add ee0a5836d69 Merge pull request #24132: Fix checkArgument format string in AvroIO add 0633fe9634f Remove extraneous jetbrains annotation add 5a72696bfda Merge pull request #24149: Remove extraneous jetbrains annotation add 50d591d6cb3 Change DataflowBatchWorkerHarness doWork error level to INFO (#24135) add 71785de5286 Bump github.com/aws/aws-sdk-go-v2/config from 1.17.10 to 1.18.0 in /sdks (#24151) add 1ad0cbc4459 Fix checkArgument format in GcsPath add 774923e0dd0 Merge pull request #24141: Fix checkArgument format in GcsPath add e563b9dd2f3 [Tour Of Beam] verify that unit exists when saving progress (#24118) add 5bd75c25de2 Updates Multi-lang Java quickstart add 4a044999b8e Merge pull request #24076 from chamikaramj/multilang_java_updates add 330cc2010c9 Cleanup stale BQ datasets (#24158) add d5d76b97459 Support SqlTypes Date and Timestamp (MicrosInstant) in AvroUtils (#23969) add c600444e1df Bump loader-utils add 9e9c6d797ba Merge pull request #24029 from apache/dependabot/npm_and_yarn/sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel/loader-utils-1.4.1 add 9c83de646ab Add more tests for S3 filesystem (#24138) add 48c70cc3074 Merge pull request #23333: Track time on Cloud Dataflow streaming data reads and export via heartbeats add 2adb68bd127 Adding a quickstart to README for the TS SDK (#23509) add eddac841261 More dataset templates to clean up (#24162) add 10337d28685 Rename the test_splits flag to direct_test_splits. add e1bf6c42950 Merge pull request #24160 Rename the test_splits flag to direct_test_splits. add 689e70b5131 Implement embedded WebAssembly example (#24081) No new revisions were added by this update. Summary of changes: .test-infra/dataproc/flink_cluster.sh | 20 +- .test-infra/jenkins/CommonTestProperties.groovy | 2 +- .test-infra/jenkins/Flink.groovy | 2 +- ...wJobs.groovy => job_CleanUpGCPResources.groovy} | 12 +- .../jenkins/job_LoadTests_Combine_Flink_Go.groovy | 2 +- .../job_LoadTests_Combine_Flink_Python.groovy | 2 +- .../jenkins/job_LoadTests_GBK_Flink_Go.groovy | 2 +- .../jenkins/job_LoadTests_GBK_Flink_Python.groovy | 2 +- .../jenkins/job_LoadTests_ParDo_Flink_Go.groovy | 2 +- .../job_LoadTests_ParDo_Flink_Python.groovy | 2 +- .../job_LoadTests_SideInput_Flink_Go.groovy | 2 +- .../jenkins/job_LoadTests_coGBK_Flink_Go.groovy | 2 +- .../job_LoadTests_coGBK_Flink_Python.groovy | 2 +- ...Commit_Python_Chicago_Taxi_Example_Flink.groovy | 2 +- .test-infra/tools/build.gradle | 4 + .test-infra/tools/stale_bq_datasets_cleaner.sh | 44 + learning/tour-of-beam/backend/function.go | 8 + .../backend/integration_tests/auth_test.go | 111 +- .../backend/integration_tests/client.go | 23 +- .../backend/integration_tests/function_test.go | 18 +- .../backend/internal/service/content.go | 8 + .../backend/internal/storage/datastore.go | 27 +- .../tour-of-beam/backend/internal/storage/iface.go | 2 + .../backend/internal/storage/index.yaml | 5 + .../tour-of-beam/backend/internal/storage/mock.go | 9 + .../backend/samples/api/get_user_progress.json | 4 +- .../core/metrics/ExecutionStateTracker.java | 2 +- .../worker/DataflowBatchWorkerHarness.java | 2 +- .../dataflow/worker/StreamingDataflowWorker.java | 237 ++-- .../dataflow/worker/WindmillStateReader.java | 25 +- .../dataflow/worker/FakeWindmillServer.java | 122 ++- .../worker/StreamingDataflowWorkerTest.java | 1147 ++++++++++++++------ sdks/go.mod | 18 +- sdks/go.sum | 302 +----- sdks/go/examples/wasm/Cargo.toml | 40 + sdks/go/examples/wasm/README.md | 137 +++ sdks/go/examples/wasm/greet.rs | 139 +++ sdks/go/examples/wasm/greet.wasm | Bin 0 -> 62570 bytes sdks/go/examples/wasm/wasm.go | 201 ++++ sdks/go/pkg/beam/io/filesystem/s3/helper_test.go | 154 +++ sdks/go/pkg/beam/io/filesystem/s3/s3_test.go | 389 +++++++ sdks/go/pkg/beam/io/filesystem/s3/writer_test.go | 94 ++ .../main/java/org/apache/beam/sdk/io/AvroIO.java | 2 +- .../apache/beam/sdk/schemas/utils/AvroUtils.java | 91 +- .../beam/sdk/schemas/utils/AvroUtilsTest.java | 33 + .../sdk/extensions/gcp/util/gcsfs/GcsPath.java | 2 +- .../beam/sdk/io/gcp/spanner/SpannerIOReadTest.java | 2 - sdks/python/apache_beam/io/watermark_estimators.py | 15 +- .../apache_beam/io/watermark_estimators_test.py | 8 +- .../python/apache_beam/options/pipeline_options.py | 2 +- .../apache-beam-jupyterlab-sidepanel/yarn.lock | 13 +- .../runners/portability/fn_api_runner/fn_runner.py | 5 +- .../portability/fn_api_runner/fn_runner_test.py | 2 +- sdks/typescript/README.md | 60 + sdks/typescript/build.sh | 3 +- sdks/typescript/test/primitives_test.ts | 2 +- .../www/site/content/en/documentation/basics.md | 26 +- .../content/en/documentation/programming-guide.md | 6 +- .../en/documentation/sdks/go-dependencies.md | 4 +- .../en/documentation/sdks/java-dependencies.md | 2 +- .../sdks/java-multi-language-pipelines.md | 10 +- .../en/documentation/sdks/python-dependencies.md | 2 +- website/www/site/content/en/get-started/_index.md | 10 +- 63 files changed, 2770 insertions(+), 858 deletions(-) copy .test-infra/jenkins/{job_CancelStaleDataflowJobs.groovy => job_CleanUpGCPResources.groovy} (81%) create mode 100755 .test-infra/tools/stale_bq_datasets_cleaner.sh create mode 100644 sdks/go/examples/wasm/Cargo.toml create mode 100644 sdks/go/examples/wasm/README.md create mode 100644 sdks/go/examples/wasm/greet.rs create mode 100644 sdks/go/examples/wasm/greet.wasm create mode 100644 sdks/go/examples/wasm/wasm.go create mode 100644 sdks/go/pkg/beam/io/filesystem/s3/helper_test.go create mode 100644 sdks/go/pkg/beam/io/filesystem/s3/s3_test.go create mode 100644 sdks/go/pkg/beam/io/filesystem/s3/writer_test.go