This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/npm_and_yarn/sdks/typescript/multi-f252619caf
in repository https://gitbox.apache.org/repos/asf/beam.git
omit e20dc42514b Bump protobufjs in /sdks/typescript
add fbe61eab131 [Python] Python] Bound the memory used for fnapi outbound
data messages and receiving messages. (#38407)
add cf5e517db67 update ruff to pyproject (#38474)
add 1f3d66546e7 Expose StorageWriteApiMaxRequestCallbackWaitTimeSec in BQ
storage write. (#38470)
add 89dde7c7a1b Upgrade gcsio to 3.1.16 (#38419)
add fa0eef96567 Add retry in connecting manager in MultiProcessShared
(#38456)
add ec65d642ccc [Prism] Fix gRPC deadline exceeded errors during bundle
failure by passing errgroup context (#38472)
add e7cb9f77973 [Website] add drain update to docs (#38450)
add 79ed7cc166d Remove legacy processContext usage across and replace it
with argument provider (#38366)
add e6fed0a2e08 Bump google.golang.org/api from 0.278.0 to 0.279.0 in
/sdks (#38480)
add 7ded0e0ce6f Setup Validates runner tests for Spark4 runner (#38478)
add bd52fce27a3 Moving to 2.75.0-SNAPSHOT on master branch.
add 13d36eb3b19 update port for jdbc test (#38485)
add 632f1e45d16 [runners-spark] Spark 4 follow-up: Announce in CHANGES.md
and address remaining review comments from #38255 (#38489)
add 3dbd7c8c35b Sickbay two failed tests due to new schema coder urn.
(#38497)
add f74b45af2cd Bump Java dev image for Dataflow (#38496)
add 10304c9cd78 Fix gradle command
add 442d6ff7bf2 Merge pull request #38499 from apache/fix-spark4-batch
add 39632ef2134 Fix iceberg gcs dependency after gcsio 3.0 upgrade (#38488)
add 1d6cdc0b4b6 Isolate tests in multi_process_shared with unique temp
path. (#38498)
add 5b5cd657c98 Bump @protobufjs/utf8 from 1.1.0 to 1.1.1 in
/sdks/typescript (#38475)
add a1ef61e8515 Bump protobufjs in /sdks/typescript
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (e20dc42514b)
\
N -- N -- N
refs/heads/dependabot/npm_and_yarn/sdks/typescript/multi-f252619caf
(a1ef61e8515)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 1 +
..._ValidatesRunner_Spark4StructuredStreaming.json | 3 -
.../beam_PostCommit_Java_ValidatesRunner_ULR.json | 3 +-
.github/trigger_files/beam_PostCommit_SQL.json | 2 +-
.../trigger_files/beam_PostCommit_XVR_Direct.json | 2 +-
.../beam_PreCommit_Java_Spark4_Versions.json | 3 -
.github/workflows/README.md | 4 +-
...l => beam_PostCommit_Java_PVR_Spark4_Batch.yml} | 22 +-
... beam_PostCommit_Java_PVR_Spark4_Streaming.yml} | 20 +-
...eam_PostCommit_Java_ValidatesRunner_Spark4.yml} | 19 +-
...a_ValidatesRunner_Spark4StructuredStreaming.yml | 97 --------
.pre-commit-config.yaml | 2 +-
CHANGES.md | 3 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 6 +-
.../examples/iceberg/IcebergBatchWriteExample.java | 15 +-
.../beam/examples/SchemaTransformExample.java | 10 +-
.../apache/beam/examples/SqlTransformExample.java | 10 +-
.../beam/examples/ApproximateQuantilesExample.java | 10 +-
.../beam/examples/CoCombineTransformExample.java | 19 +-
.../apache/beam/examples/CoGroupByKeyExample.java | 10 +-
.../org/apache/beam/examples/CombineExample.java | 10 +-
.../org/apache/beam/examples/CountExample.java | 10 +-
.../apache/beam/examples/CountPerKeyExample.java | 10 +-
.../org/apache/beam/examples/CreateExample.java | 10 +-
.../apache/beam/examples/DebuggingWordCount.java | 15 +-
.../org/apache/beam/examples/DistinctExample.java | 10 +-
.../beam/examples/FlatMapElementsExample.java | 10 +-
.../beam/examples/GroupIntoBatchesExample.java | 10 +-
.../beam/examples/KafkaPassengerCountJson.java | 21 +-
.../org/apache/beam/examples/KafkaStreaming.java | 33 +--
.../apache/beam/examples/KafkaWordCountAvro.java | 11 +-
.../apache/beam/examples/KafkaWordCountJson.java | 11 +-
.../java/org/apache/beam/examples/KeysExample.java | 10 +-
.../org/apache/beam/examples/KvSwapExample.java | 10 +-
.../org/apache/beam/examples/LatestExample.java | 10 +-
.../apache/beam/examples/MapElementsExample.java | 10 +-
.../java/org/apache/beam/examples/MaxExample.java | 10 +-
.../org/apache/beam/examples/MaxPerKeyExample.java | 10 +-
.../java/org/apache/beam/examples/MeanExample.java | 10 +-
.../apache/beam/examples/MeanPerKeyExample.java | 10 +-
.../java/org/apache/beam/examples/MinExample.java | 10 +-
.../org/apache/beam/examples/MinPerKeyExample.java | 10 +-
.../org/apache/beam/examples/PartitionExample.java | 10 +-
.../beam/examples/RateLimitedPubSubReader.java | 6 +-
.../apache/beam/examples/RateLimiterSimple.java | 8 +-
.../org/apache/beam/examples/RegexExample.java | 10 +-
.../org/apache/beam/examples/SampleExample.java | 10 +-
.../java/org/apache/beam/examples/SumExample.java | 10 +-
.../org/apache/beam/examples/SumPerKeyExample.java | 10 +-
.../org/apache/beam/examples/ToStringExample.java | 10 +-
.../java/org/apache/beam/examples/TopExample.java | 10 +-
.../org/apache/beam/examples/ValuesExample.java | 10 +-
.../java/org/apache/beam/examples/ViewExample.java | 19 +-
.../org/apache/beam/examples/WindowExample.java | 10 +-
.../beam/examples/complete/AutoComplete.java | 60 +++--
.../examples/complete/StreamingWordExtract.java | 16 +-
.../org/apache/beam/examples/complete/TfIdf.java | 77 +++---
.../examples/complete/TopWikipediaSessions.java | 32 ++-
.../beam/examples/complete/TrafficMaxLaneFlow.java | 32 ++-
.../beam/examples/complete/TrafficRoutes.java | 48 ++--
.../transforms/DataProtectors.java | 21 +-
.../transforms/io/TokenizationBigQueryIO.java | 7 +-
.../transforms/io/TokenizationBigTableIO.java | 6 +-
.../datatokenization/utils/CsvConverters.java | 107 +++++---
.../datatokenization/utils/ErrorConverters.java | 30 ++-
.../beam/examples/complete/game/GameStats.java | 45 ++--
.../examples/complete/game/HourlyTeamScore.java | 6 +-
.../beam/examples/complete/game/LeaderBoard.java | 18 +-
.../examples/complete/game/StatefulTeamScore.java | 18 +-
.../beam/examples/complete/game/UserScore.java | 14 +-
.../complete/game/utils/WriteToBigQuery.java | 22 +-
.../examples/complete/game/utils/WriteToText.java | 21 +-
.../game/utils/WriteWindowedToBigQuery.java | 15 +-
.../cookbook/BigQueryStreamingTornadoes.java | 21 +-
.../beam/examples/cookbook/BigQueryTornadoes.java | 16 +-
.../examples/cookbook/CombinePerKeyExamples.java | 14 +-
.../beam/examples/cookbook/FilterExamples.java | 31 +--
.../beam/examples/cookbook/JoinExamples.java | 32 +--
.../beam/examples/cookbook/MaxPerKeyExamples.java | 17 +-
.../cookbook/MinimalBigQueryTornadoes.java | 20 +-
.../beam/examples/cookbook/TriggerExample.java | 47 ++--
.../apache/beam/examples/snippets/Snippets.java | 40 +--
.../examples/subprocess/ExampleEchoPipeline.java | 10 +-
.../beam/examples/cookbook/TriggerExampleTest.java | 8 +-
.../subprocess/ExampleEchoPipelineTest.java | 10 +-
.../beam/examples/kotlin/DebuggingWordCount.kt | 12 +-
.../examples/kotlin/cookbook/BigQueryTornadoes.kt | 15 +-
.../kotlin/cookbook/CombinePerKeyExamples.kt | 13 +-
.../examples/kotlin/cookbook/FilterExamples.kt | 30 +--
.../beam/examples/kotlin/cookbook/JoinExamples.kt | 31 +--
.../examples/kotlin/cookbook/MaxPerKeyExamples.kt | 15 +-
.../examples/kotlin/cookbook/TriggerExample.kt | 42 ++--
.../beam/examples/kotlin/snippets/Snippets.kt | 13 +-
gradle.properties | 4 +-
runners/google-cloud-dataflow-java/build.gradle | 4 +-
runners/portability/java/build.gradle | 5 +
runners/spark/4/build.gradle | 12 +-
scripts/beam-sql.sh | 2 +-
sdks/go.mod | 2 +-
sdks/go.sum | 4 +-
sdks/go/pkg/beam/core/core.go | 2 +-
sdks/go/pkg/beam/runners/prism/internal/execute.go | 6 +-
.../beam/runners/prism/internal/execute_test.go | 22 ++
.../beam/runners/prism/internal/testdofns_test.go | 5 +
.../go/test/integration/io/xlang/jdbc/jdbc_test.go | 4 +-
.../beam/sdk/extensions/gcp/util/GcsUtilV1.java | 62 ++---
.../beam/sdk/extensions/gcp/util/GcsUtilTest.java | 19 +-
sdks/java/extensions/sql/iceberg/build.gradle | 1 +
sdks/java/io/expansion-service/build.gradle | 10 +-
.../beam/sdk/io/gcp/bigquery/BigQueryOptions.java | 7 +
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 10 +
.../apache_beam/runners/worker/data_plane.py | 70 +++---
.../utils/{counters.pxd => byte_limited_queue.pxd} | 21 +-
.../python/apache_beam/utils/byte_limited_queue.py | 204 ++++++++++++++++
.../apache_beam/utils/byte_limited_queue_test.py | 270 +++++++++++++++++++++
.../apache_beam/utils/multi_process_shared.py | 17 +-
.../apache_beam/utils/multi_process_shared_test.py | 63 +++--
sdks/python/apache_beam/version.py | 2 +-
sdks/python/setup.py | 1 +
sdks/typescript/package-lock.json | 18 +-
sdks/typescript/package.json | 2 +-
website/www/site/content/en/blog/looping-timers.md | 11 +-
.../content/en/documentation/programming-guide.md | 83 +++++++
website/www/site/data/capability_matrix.yaml | 2 +-
124 files changed, 1748 insertions(+), 874 deletions(-)
delete mode 100644
.github/trigger_files/beam_PostCommit_Java_ValidatesRunner_Spark4StructuredStreaming.json
delete mode 100644
.github/trigger_files/beam_PreCommit_Java_Spark4_Versions.json
copy .github/workflows/{beam_PostCommit_Java_PVR_Spark_Batch.yml =>
beam_PostCommit_Java_PVR_Spark4_Batch.yml} (86%)
copy .github/workflows/{beam_PostCommit_Java_PVR_Spark3_Streaming.yml =>
beam_PostCommit_Java_PVR_Spark4_Streaming.yml} (85%)
copy .github/workflows/{beam_PostCommit_Java_ValidatesRunner_Twister2.yml =>
beam_PostCommit_Java_ValidatesRunner_Spark4.yml} (87%)
delete mode 100644
.github/workflows/beam_PostCommit_Java_ValidatesRunner_Spark4StructuredStreaming.yml
copy sdks/python/apache_beam/utils/{counters.pxd => byte_limited_queue.pxd}
(65%)
create mode 100644 sdks/python/apache_beam/utils/byte_limited_queue.py
create mode 100644 sdks/python/apache_beam/utils/byte_limited_queue_test.py
