(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 62f52e69297 Updating config from bot
62f52e69297 is described below

commit 62f52e69297ed8039c6df8bf6e6a38d24fd6ba5f
Author: github-actions 
AuthorDate: Tue Dec 5 12:14:09 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index 192694021a1..f8da356d7cd 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -10,7 +10,7 @@
 "y1chi": 1667002607045,
 "damccorm": 1701741340223,
 "jrmccluskey": 1701303574446,
-"riteshghorse": 1701221393327,
+"riteshghorse": 1701778446496,
 "liferoad": 170122135
   }
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new db4dbaf0058 Updating config from bot
db4dbaf0058 is described below

commit db4dbaf0058b7d8abf15ac2ea13f8f7814e708bd
Author: github-actions 
AuthorDate: Tue Dec 5 12:14:08 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29366.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29366.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29366.json
index 88d1920a8bb..c43704aa814 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29366.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29366.json
@@ -1,7 +1,7 @@
 {
   "commentedAboutFailingChecks": false,
   "reviewersAssignedForLabels": {
-"python": "damccorm"
+"python": "riteshghorse"
   },
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 5d2615ca606 Updating config from bot
5d2615ca606 is described below

commit 5d2615ca6064e7e891f7444c7ac0d6ab89900be0
Author: github-actions 
AuthorDate: Tue Dec 5 14:31:10 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29366.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29366.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29366.json
index c43704aa814..308b64fdbea 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29366.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29366.json
@@ -3,7 +3,7 @@
   "reviewersAssignedForLabels": {
 "python": "riteshghorse"
   },
-  "nextAction": "Reviewers",
+  "nextAction": "Author",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
   "committerAssigned": false



(beam) branch dependabot/github_actions/actions/labeler-5 deleted (was 293c2d6f88d)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch dependabot/github_actions/actions/labeler-5
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 293c2d6f88d Bump actions/labeler from 4 to 5

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch master updated: Bump cloud.google.com/go/spanner from 1.53.0 to 1.53.1 in /sdks (#29610)

2023-12-05 Thread jrmccluskey
This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 6973255b3d0 Bump cloud.google.com/go/spanner from 1.53.0 to 1.53.1 in 
/sdks (#29610)
6973255b3d0 is described below

commit 6973255b3d078a5181c8e3d43d2adc8ade6cb246
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
AuthorDate: Tue Dec 5 10:19:29 2023 -0500

Bump cloud.google.com/go/spanner from 1.53.0 to 1.53.1 in /sdks (#29610)

Bumps 
[cloud.google.com/go/spanner](https://github.com/googleapis/google-cloud-go) 
from 1.53.0 to 1.53.1.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- 
[Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- 
[Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.53.0...spanner/v1.53.1)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/spanner
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] 
Co-authored-by: dependabot[bot] 
<49699333+dependabot[bot]@users.noreply.github.com>
---
 sdks/go.mod | 2 +-
 sdks/go.sum | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)

diff --git a/sdks/go.mod b/sdks/go.mod
index 33c575deed5..34d633febc4 100644
--- a/sdks/go.mod
+++ b/sdks/go.mod
@@ -28,7 +28,7 @@ require (
cloud.google.com/go/datastore v1.15.0
cloud.google.com/go/profiler v0.4.0
cloud.google.com/go/pubsub v1.33.0
-   cloud.google.com/go/spanner v1.53.0
+   cloud.google.com/go/spanner v1.53.1
cloud.google.com/go/storage v1.35.1
github.com/aws/aws-sdk-go-v2 v1.23.4
github.com/aws/aws-sdk-go-v2/config v1.25.8
diff --git a/sdks/go.sum b/sdks/go.sum
index 94ced030dec..22955e00e75 100644
--- a/sdks/go.sum
+++ b/sdks/go.sum
@@ -38,8 +38,8 @@ cloud.google.com/go/pubsub v1.1.0/go.mod 
h1:EwwdRX2sKPjnvnqCa270oGRyludottCI76h+
 cloud.google.com/go/pubsub v1.2.0/go.mod 
h1:jhfEVHT8odbXTkndysNHCcx0awwzvfOlguIAii9o8iA=
 cloud.google.com/go/pubsub v1.33.0 
h1:6SPCPvWav64tj0sVX/+npCBKhUi/UjJehy9op/V3p2g=
 cloud.google.com/go/pubsub v1.33.0/go.mod 
h1:f+w71I33OMyxf9VpMVcZbnG5KSUkCOUHYpFd5U1GdRc=
-cloud.google.com/go/spanner v1.53.0 
h1:/NzWQJ1MEhdRcffiutRKbW/AIGVKhcTeivWTDjEyCCo=
-cloud.google.com/go/spanner v1.53.0/go.mod 
h1:liG4iCeLqm5L3fFLU5whFITqP0e0orsAW1uUSrd4rws=
+cloud.google.com/go/spanner v1.53.1 
h1:xNmE0SXMSxNBuk7lRZ5G/S+A49X91zkSTt7Jn5Ptlvw=
+cloud.google.com/go/spanner v1.53.1/go.mod 
h1:liG4iCeLqm5L3fFLU5whFITqP0e0orsAW1uUSrd4rws=
 cloud.google.com/go/storage v1.0.0/go.mod 
h1:IhtSnM/ZTZV8YYJWCY8RULGVqBDmpoyjwiyrjsg+URw=
 cloud.google.com/go/storage v1.5.0/go.mod 
h1:tpKbwo567HUNpVclU5sGELwQWBDZ8gh0ZeosJ0Rtdos=
 cloud.google.com/go/storage v1.6.0/go.mod 
h1:N7U0C8pVQ/+NIKOBQyamJIeKQKkZ+mxpohlUTyfDhBk=



(beam) branch dependabot/go_modules/sdks/cloud.google.com/go/spanner-1.53.1 deleted (was 6b7b7227f77)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/cloud.google.com/go/spanner-1.53.1
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 6b7b7227f77 Bump cloud.google.com/go/spanner from 1.53.0 to 1.53.1 in 
/sdks

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch dependabot/go_modules/sdks/golang.org/x/net-0.19.0 deleted (was 668737e8e10)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/golang.org/x/net-0.19.0
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 668737e8e10 Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch master updated: Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks (#29574)

2023-12-05 Thread jrmccluskey
This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new c53f0af09f9 Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks 
(#29574)
c53f0af09f9 is described below

commit c53f0af09f983203c9ccf9c09327010436ae0b8c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
AuthorDate: Tue Dec 5 10:20:07 2023 -0500

Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks (#29574)

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.18.0 to 
0.19.0.
- [Commits](https://github.com/golang/net/compare/v0.18.0...v0.19.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] 
Co-authored-by: dependabot[bot] 
<49699333+dependabot[bot]@users.noreply.github.com>
---
 sdks/go.mod |  6 +++---
 sdks/go.sum | 12 ++--
 2 files changed, 9 insertions(+), 9 deletions(-)

diff --git a/sdks/go.mod b/sdks/go.mod
index 34d633febc4..a914cd6793d 100644
--- a/sdks/go.mod
+++ b/sdks/go.mod
@@ -54,10 +54,10 @@ require (
github.com/xitongsys/parquet-go v1.6.2
github.com/xitongsys/parquet-go-source 
v0.0.0-20220315005136-aec0fe3e777c
go.mongodb.org/mongo-driver v1.12.1
-   golang.org/x/net v0.18.0
+   golang.org/x/net v0.19.0
golang.org/x/oauth2 v0.14.0
golang.org/x/sync v0.5.0
-   golang.org/x/sys v0.14.0
+   golang.org/x/sys v0.15.0
golang.org/x/text v0.14.0
google.golang.org/api v0.152.0
google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
@@ -173,7 +173,7 @@ require (
github.com/youmark/pkcs8 v0.0.0-20181117223130-1be2e3e5546d // indirect
github.com/zeebo/xxh3 v1.0.2 // indirect
go.opencensus.io v0.24.0 // indirect
-   golang.org/x/crypto v0.15.0 // indirect
+   golang.org/x/crypto v0.16.0 // indirect
golang.org/x/mod v0.11.0 // indirect
golang.org/x/tools v0.10.0 // indirect
golang.org/x/xerrors v0.0.0-20220907171357-04be3eba64a2 // indirect
diff --git a/sdks/go.sum b/sdks/go.sum
index 22955e00e75..e868d783d4a 100644
--- a/sdks/go.sum
+++ b/sdks/go.sum
@@ -495,8 +495,8 @@ golang.org/x/crypto 
v0.0.0-20201002170205-7f63de1d35b0/go.mod h1:LzIPMQfyMNhhGPh
 golang.org/x/crypto v0.0.0-20210513164829-c07d793c2f9a/go.mod 
h1:P+XmwS30IXTQdn5tA2iutPOUgjI07+tq3H3K9MVA1s8=
 golang.org/x/crypto v0.0.0-20210921155107-089bfa567519/go.mod 
h1:GvvjBRRGRdwPK5ydBHafDWAxML/pGHZbMvKqRZ5+Abc=
 golang.org/x/crypto v0.0.0-20220622213112-05595931fe9d/go.mod 
h1:IxCIyHEi3zRg3s0A5j5BB6A9Jmi73HwBIUl50j+osU4=
-golang.org/x/crypto v0.15.0 h1:frVn1TEaCEaZcn3Tmd7Y2b5KKPaZ+I32Q2OA3kYp5TA=
-golang.org/x/crypto v0.15.0/go.mod 
h1:4ChreQoLWfG3xLDer1WdlH5NdlQ3+mwnQq1YTKY+72g=
+golang.org/x/crypto v0.16.0 h1:mMMrFzRSCF0GvB7Ne27XVtVAaXLrPmgPC7/v0tkwHaY=
+golang.org/x/crypto v0.16.0/go.mod 
h1:gCAAfMLgwOJRpTjQ2zCCt2OcSfYMTeZVSRtQlPC7Nq4=
 golang.org/x/exp v0.0.0-20190121172915-509febef88a4/go.mod 
h1:CJ0aWSM057203Lf6IL+f9T1iT9GByDxfZKAQTCR3kQA=
 golang.org/x/exp v0.0.0-20190306152737-a1d7652674e8/go.mod 
h1:CJ0aWSM057203Lf6IL+f9T1iT9GByDxfZKAQTCR3kQA=
 golang.org/x/exp v0.0.0-20190510132918-efd6b22b2522/go.mod 
h1:ZjyILWgesfNpC6sMxTJOJm9Kp84zZh5NQWvqDGG3Qr8=
@@ -555,8 +555,8 @@ golang.org/x/net v0.0.0-20201224014010-6772e930b67b/go.mod 
h1:m0MpNAwzfU5UDzcl9v
 golang.org/x/net v0.0.0-20210226172049-e18ecbb05110/go.mod 
h1:m0MpNAwzfU5UDzcl9v0D8zg8gWTRqZa9RBIspLL5mdg=
 golang.org/x/net v0.0.0-2022202133-69e39bad7dc2/go.mod 
h1:9nx3DQGgdP8bBQD5qxJ1jj9UTztislL4KSBs9R2vV5Y=
 golang.org/x/net v0.0.0-20220722155237-a158d28d115b/go.mod 
h1:XRhObCWvk6IyKnWLug+ECip1KBveYUHfp+8e9klMJ9c=
-golang.org/x/net v0.18.0 h1:mIYleuAkSbHh0tCv7RvjL3F6ZVbLjq4+R7zbOn3Kokg=
-golang.org/x/net v0.18.0/go.mod h1:/czyP5RqHAH4odGYxBJ1qz0+CE5WZ+2j1YgoEo8F2jQ=
+golang.org/x/net v0.19.0 h1:zTwKpTd2XuCqf8huc7Fo2iSy+4RHPd10s4KzeTnVr1c=
+golang.org/x/net v0.19.0/go.mod h1:CfAk/cbD4CthTvqiEl8NpboMuiuOYsAr/7NOjZJtv1U=
 golang.org/x/oauth2 v0.0.0-20180821212333-d2e6202438be/go.mod 
h1:N/0e6XlmueqKjAGxoOufVs8QHGRruUQn6yWY3a++T0U=
 golang.org/x/oauth2 v0.0.0-20190226205417-e64efc72b421/go.mod 
h1:gOpvHmFTYa4IltrdGE7lF6nIHvwfUNPOp7c8zoXwtLw=
 golang.org/x/oauth2 v0.0.0-20190604053449-0f29369cfe45/go.mod 
h1:gOpvHmFTYa4IltrdGE7lF6nIHvwfUNPOp7c8zoXwtLw=
@@ -616,8 +616,8 @@ golang.org/x/sys v0.5.0/go.mod 
h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
 golang.org/x/sys v0.8.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
 golang.org/x/sys v0.11.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
 golang.org/x/sys v0.12.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
-golang.org/x/sys v0.14.0 h1:Vz7Qs629MkJkGyHxUlRHizWJRG2j8fbQKjELVSNhy7Q=
-gola

(beam) branch dependabot/go_modules/sdks/go.mongodb.org/mongo-driver-1.13.0 updated (dbd19f20c87 -> c24aa5ebf19)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/go.mongodb.org/mongo-driver-1.13.0
in repository https://gitbox.apache.org/repos/asf/beam.git


omit dbd19f20c87 Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in 
/sdks
 add 70ef5072bf5 Update Java Healthcare Dependency (#29594)
 add 367e4ecb5e2 Replace usage of custom `gradle-command-action` with 
`gradle-build-action` (#29480)
 add c9c89fe7d5f Use UUIDs instead of object hashes to avoid collisions 
(#29542)
 add 6973255b3d0 Bump cloud.google.com/go/spanner from 1.53.0 to 1.53.1 in 
/sdks (#29610)
 add c53f0af09f9 Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks 
(#29574)
 add c24aa5ebf19 Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in 
/sdks

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (dbd19f20c87)
\
 N -- N -- N   
refs/heads/dependabot/go_modules/sdks/go.mongodb.org/mongo-driver-1.13.0 
(c24aa5ebf19)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .github/actions/gradle-command-action  |   1 -
 .../gradle-command-self-hosted-action/action.yml   |   6 +-
 .github/workflows/java_tests.yml   |  40 +++
 .gitmodules|   3 -
 CHANGES.md |   9 ++
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |   2 +-
 sdks/go.mod|   8 +-
 sdks/go.sum|  16 +--
 .../transforms/elementwise/mltransform_test.py |   1 +
 sdks/python/apache_beam/ml/transforms/handlers.py  | 119 +++--
 .../apache_beam/ml/transforms/handlers_test.py |  46 
 11 files changed, 147 insertions(+), 104 deletions(-)
 delete mode 16 .github/actions/gradle-command-action



(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5 updated (9f244641062 -> e55ee5088e0)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5
in repository https://gitbox.apache.org/repos/asf/beam.git


 discard 9f244641062 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks
 add 6973255b3d0 Bump cloud.google.com/go/spanner from 1.53.0 to 1.53.1 in 
/sdks (#29610)
 add c53f0af09f9 Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks 
(#29574)
 add e55ee5088e0 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (9f244641062)
\
 N -- N -- N   
refs/heads/dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5 
(e55ee5088e0)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 sdks/go.mod |  8 
 sdks/go.sum | 16 
 2 files changed, 12 insertions(+), 12 deletions(-)



(beam) branch master updated (c53f0af09f9 -> 17f3f0532c2)

2023-12-05 Thread jrmccluskey
This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from c53f0af09f9 Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks 
(#29574)
 add 17f3f0532c2 [#29568] Use gcr clone of images by default on Dataflow. 
(#29608)

No new revisions were added by this update.

Summary of changes:
 sdks/go/pkg/beam/runners/dataflow/dataflow.go  | 13 -
 sdks/go/pkg/beam/runners/dataflow/dataflow_test.go | 10 ++
 2 files changed, 22 insertions(+), 1 deletion(-)



(beam) 01/01: Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in /sdks

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5
in repository https://gitbox.apache.org/repos/asf/beam.git

commit fd76c761c10fd1fad26f20591fa5bc4ab3a937ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
AuthorDate: Tue Dec 5 15:25:26 2023 +

Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in /sdks

Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) 
from 1.23.4 to 1.23.5.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.23.4...v1.23.5)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] 
---
 sdks/go.mod | 2 +-
 sdks/go.sum | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)

diff --git a/sdks/go.mod b/sdks/go.mod
index a914cd6793d..b55c0bb474b 100644
--- a/sdks/go.mod
+++ b/sdks/go.mod
@@ -30,7 +30,7 @@ require (
cloud.google.com/go/pubsub v1.33.0
cloud.google.com/go/spanner v1.53.1
cloud.google.com/go/storage v1.35.1
-   github.com/aws/aws-sdk-go-v2 v1.23.4
+   github.com/aws/aws-sdk-go-v2 v1.23.5
github.com/aws/aws-sdk-go-v2/config v1.25.8
github.com/aws/aws-sdk-go-v2/credentials v1.16.8
github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.13.8
diff --git a/sdks/go.sum b/sdks/go.sum
index e868d783d4a..ed4921bfacc 100644
--- a/sdks/go.sum
+++ b/sdks/go.sum
@@ -81,8 +81,8 @@ github.com/aws/aws-sdk-go v1.30.19/go.mod 
h1:5zCpMtNQVjRREroY7sYe8lOMRSxkhG6MZve
 github.com/aws/aws-sdk-go v1.34.0 
h1:brux2dRrlwCF5JhTL7MUT3WUwo9zfDHZZp3+g3Mvlmo=
 github.com/aws/aws-sdk-go v1.34.0/go.mod 
h1:5zCpMtNQVjRREroY7sYe8lOMRSxkhG6MZveU8YkpAk0=
 github.com/aws/aws-sdk-go-v2 v1.7.1/go.mod 
h1:L5LuPC1ZgDr2xQS7AmIec/Jlc7O/Y1u2KxJyNVab250=
-github.com/aws/aws-sdk-go-v2 v1.23.4 
h1:2P20ZjH0ouSAu/6yZep8oCmTReathLuEu6dwoqEgjts=
-github.com/aws/aws-sdk-go-v2 v1.23.4/go.mod 
h1:t3szzKfP0NeRU27uBFczDivYJjsmSnqI8kIvKyWb9ds=
+github.com/aws/aws-sdk-go-v2 v1.23.5 
h1:xK6C4udTyDMd82RFvNkDQxtAd00xlzFUtX4fF2nMZyg=
+github.com/aws/aws-sdk-go-v2 v1.23.5/go.mod 
h1:t3szzKfP0NeRU27uBFczDivYJjsmSnqI8kIvKyWb9ds=
 github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.5.1 
h1:ZY3108YtBNq96jNZTICHxN1gSBSbnvIdYwwqnvCV4Mc=
 github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.5.1/go.mod 
h1:t8PYl/6LzdAqsU4/9tz28V/kU+asFePvpOMkdul0gEQ=
 github.com/aws/aws-sdk-go-v2/config v1.5.0/go.mod 
h1:RWlPOAW3E3tbtNAqTwvSW54Of/yP3oiZXMI0xfUdjyA=



(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5 updated (e55ee5088e0 -> fd76c761c10)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5
in repository https://gitbox.apache.org/repos/asf/beam.git


omit e55ee5088e0 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks
 add 17f3f0532c2 [#29568] Use gcr clone of images by default on Dataflow. 
(#29608)
 new fd76c761c10 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (e55ee5088e0)
\
 N -- N -- N   
refs/heads/dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5 
(fd76c761c10)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/go/pkg/beam/runners/dataflow/dataflow.go  | 13 -
 sdks/go/pkg/beam/runners/dataflow/dataflow_test.go | 10 ++
 2 files changed, 22 insertions(+), 1 deletion(-)



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 738ed1cbf08 Updating config from bot
738ed1cbf08 is described below

commit 738ed1cbf0831bbf2591cde3b805058e02a8c6b5
Author: github-actions 
AuthorDate: Tue Dec 5 16:04:23 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29616.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29616.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29616.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29616.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 69bcd19755a Updating config from bot
69bcd19755a is described below

commit 69bcd19755ad5e73e502e6de4ff4ebdf8cfb2712
Author: github-actions 
AuthorDate: Tue Dec 5 16:30:16 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29366.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29366.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29366.json
index 308b64fdbea..c43704aa814 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29366.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29366.json
@@ -3,7 +3,7 @@
   "reviewersAssignedForLabels": {
 "python": "riteshghorse"
   },
-  "nextAction": "Author",
+  "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
   "committerAssigned": false



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 71c91f7ba18 Updating config from bot
71c91f7ba18 is described below

commit 71c91f7ba186c3cbad8bfec2918c8389062c8c4b
Author: github-actions 
AuthorDate: Tue Dec 5 17:35:05 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29548.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29548.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29548.json
index 12105dd4cc9..2546686024e 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29548.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29548.json
@@ -8,5 +8,5 @@
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
-  "committerAssigned": false
+  "committerAssigned": true
 }
\ No newline at end of file



(beam) branch master updated: Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in /sdks (#29611)

2023-12-05 Thread lostluck
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 59930cd2584 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks (#29611)
59930cd2584 is described below

commit 59930cd2584a8f9d63124be8650aba76a9678464
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
AuthorDate: Tue Dec 5 10:22:34 2023 -0800

Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in /sdks (#29611)

Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) 
from 1.23.4 to 1.23.5.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.23.4...v1.23.5)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] 
Co-authored-by: dependabot[bot] 
<49699333+dependabot[bot]@users.noreply.github.com>
---
 sdks/go.mod | 2 +-
 sdks/go.sum | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)

diff --git a/sdks/go.mod b/sdks/go.mod
index a914cd6793d..b55c0bb474b 100644
--- a/sdks/go.mod
+++ b/sdks/go.mod
@@ -30,7 +30,7 @@ require (
cloud.google.com/go/pubsub v1.33.0
cloud.google.com/go/spanner v1.53.1
cloud.google.com/go/storage v1.35.1
-   github.com/aws/aws-sdk-go-v2 v1.23.4
+   github.com/aws/aws-sdk-go-v2 v1.23.5
github.com/aws/aws-sdk-go-v2/config v1.25.8
github.com/aws/aws-sdk-go-v2/credentials v1.16.8
github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.13.8
diff --git a/sdks/go.sum b/sdks/go.sum
index e868d783d4a..ed4921bfacc 100644
--- a/sdks/go.sum
+++ b/sdks/go.sum
@@ -81,8 +81,8 @@ github.com/aws/aws-sdk-go v1.30.19/go.mod 
h1:5zCpMtNQVjRREroY7sYe8lOMRSxkhG6MZve
 github.com/aws/aws-sdk-go v1.34.0 
h1:brux2dRrlwCF5JhTL7MUT3WUwo9zfDHZZp3+g3Mvlmo=
 github.com/aws/aws-sdk-go v1.34.0/go.mod 
h1:5zCpMtNQVjRREroY7sYe8lOMRSxkhG6MZveU8YkpAk0=
 github.com/aws/aws-sdk-go-v2 v1.7.1/go.mod 
h1:L5LuPC1ZgDr2xQS7AmIec/Jlc7O/Y1u2KxJyNVab250=
-github.com/aws/aws-sdk-go-v2 v1.23.4 
h1:2P20ZjH0ouSAu/6yZep8oCmTReathLuEu6dwoqEgjts=
-github.com/aws/aws-sdk-go-v2 v1.23.4/go.mod 
h1:t3szzKfP0NeRU27uBFczDivYJjsmSnqI8kIvKyWb9ds=
+github.com/aws/aws-sdk-go-v2 v1.23.5 
h1:xK6C4udTyDMd82RFvNkDQxtAd00xlzFUtX4fF2nMZyg=
+github.com/aws/aws-sdk-go-v2 v1.23.5/go.mod 
h1:t3szzKfP0NeRU27uBFczDivYJjsmSnqI8kIvKyWb9ds=
 github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.5.1 
h1:ZY3108YtBNq96jNZTICHxN1gSBSbnvIdYwwqnvCV4Mc=
 github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.5.1/go.mod 
h1:t8PYl/6LzdAqsU4/9tz28V/kU+asFePvpOMkdul0gEQ=
 github.com/aws/aws-sdk-go-v2/config v1.5.0/go.mod 
h1:RWlPOAW3E3tbtNAqTwvSW54Of/yP3oiZXMI0xfUdjyA=



(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5 deleted (was fd76c761c10)

2023-12-05 Thread lostluck
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2-1.23.5
in repository https://gitbox.apache.org/repos/asf/beam.git


 was fd76c761c10 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.4 updated (070d05ee7cb -> 8b035d2a746)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.4
in repository https://gitbox.apache.org/repos/asf/beam.git


omit 070d05ee7cb Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in 
/sdks
 add a7b1f036445 Bump cloud.google.com/go/spanner from 1.51.0 to 1.53.0 in 
/sdks (#29448)
 add c86971158a5 Bump google.golang.org/api from 0.151.0 to 0.152.0 in 
/sdks (#29596)
 add 70ef5072bf5 Update Java Healthcare Dependency (#29594)
 add 367e4ecb5e2 Replace usage of custom `gradle-command-action` with 
`gradle-build-action` (#29480)
 add c9c89fe7d5f Use UUIDs instead of object hashes to avoid collisions 
(#29542)
 add 6973255b3d0 Bump cloud.google.com/go/spanner from 1.53.0 to 1.53.1 in 
/sdks (#29610)
 add c53f0af09f9 Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks 
(#29574)
 add 17f3f0532c2 [#29568] Use gcr clone of images by default on Dataflow. 
(#29608)
 add 59930cd2584 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks (#29611)
 add 8b035d2a746 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in 
/sdks

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (070d05ee7cb)
\
 N -- N -- N   
refs/heads/dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.4
 (8b035d2a746)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .github/actions/gradle-command-action  |   1 -
 .../gradle-command-self-hosted-action/action.yml   |   6 +-
 .github/workflows/java_tests.yml   |  40 +++
 .gitmodules|   3 -
 CHANGES.md |   9 ++
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |   2 +-
 sdks/go.mod|  28 ++---
 sdks/go.sum|  60 +--
 sdks/go/pkg/beam/runners/dataflow/dataflow.go  |  13 ++-
 sdks/go/pkg/beam/runners/dataflow/dataflow_test.go |  10 ++
 .../transforms/elementwise/mltransform_test.py |   1 +
 sdks/python/apache_beam/ml/transforms/handlers.py  | 119 +++--
 .../apache_beam/ml/transforms/handlers_test.py |  46 
 13 files changed, 201 insertions(+), 137 deletions(-)
 delete mode 16 .github/actions/gradle-command-action



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new d6d37f50563 Updating config from bot
d6d37f50563 is described below

commit d6d37f505632c3e73197f378bc2fb3c3e702c24b
Author: github-actions 
AuthorDate: Tue Dec 5 18:35:07 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 1d6f851ca34..f75ae360c2d 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -2,6 +2,6 @@
   "label": "build",
   "dateOfLastReviewAssignment": {
 "damccorm": 1701754475028,
-"Abacn": 1701741340223
+"Abacn": 1701801303534
   }
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new bf5467d329c Updating config from bot
bf5467d329c is described below

commit bf5467d329cc3fb290e13f34ff6951f9a8b0b17b
Author: github-actions 
AuthorDate: Tue Dec 5 18:35:05 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29620.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29620.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29620.json
new file mode 100644
index 000..9c51466b9ee
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29620.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"build": "Abacn"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 7b90daaf040 Updating config from bot
7b90daaf040 is described below

commit 7b90daaf040e6519e3301b5dcd919a8cfa54afd7
Author: github-actions 
AuthorDate: Tue Dec 5 18:35:14 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29601.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29601.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29601.json
index 2638ed60591..2100edf9f6c 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29601.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29601.json
@@ -7,5 +7,5 @@
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
-  "committerAssigned": false
+  "committerAssigned": true
 }
\ No newline at end of file



(beam) branch master updated (59930cd2584 -> 5ebd5d823d8)

2023-12-05 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 59930cd2584 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks (#29611)
 add 4b4cc5d8088 Esacpe strings in integrationTestPipelineOptions in Java 
Tests
 new 5ebd5d823d8 Merge pull request #29620: Escape strings in 
integrationTestPipelineOptions in Java Tests

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .github/workflows/java_tests.yml | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)



(beam) 01/01: Merge pull request #29620: Escape strings in integrationTestPipelineOptions in Java Tests

2023-12-05 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 5ebd5d823d82ba7a03846f177a4981f7a3bfb7ce
Merge: 59930cd2584 4b4cc5d8088
Author: Kenneth Knowles 
AuthorDate: Tue Dec 5 13:39:39 2023 -0500

Merge pull request #29620: Escape strings in integrationTestPipelineOptions 
in Java Tests

 .github/workflows/java_tests.yml | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)



(beam) branch master updated: Initial RC Testing Guide Documentation (#29595)

2023-12-05 Thread damccorm
This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 169dce40670 Initial RC Testing Guide Documentation  (#29595)
169dce40670 is described below

commit 169dce40670fe22e3e257bb552084984f766ea70
Author: Svetak Sundhar 
AuthorDate: Tue Dec 5 14:09:07 2023 -0500

Initial RC Testing Guide Documentation  (#29595)

* Create HealthcareUtils file with shared resources

* revert

* Initial RC Testing Guide

* Updates to testing guide.

* update email

* update email

* Update contributor-docs/release-guide.md

Co-authored-by: Danny McCormick 

-

Co-authored-by: Danny McCormick 
---
 contributor-docs/rc-testing-guide.md | 60 
 contributor-docs/release-guide.md|  8 +++--
 2 files changed, 65 insertions(+), 3 deletions(-)

diff --git a/contributor-docs/rc-testing-guide.md 
b/contributor-docs/rc-testing-guide.md
new file mode 100644
index 000..0ac93271120
--- /dev/null
+++ b/contributor-docs/rc-testing-guide.md
@@ -0,0 +1,60 @@
+
+
+# Release Candidate (RC) Testing Guide
+
+This guide is meant for anybody who is interested in testing Beam Release 
Candidates against downstream projects. Note
+that one need not have any status on the Apache Beam project (eg. PMC Member, 
Committer) to vote; all are welcome.
+Please subscribe to the [dev 
list](https://lists.apache.org/list.html?d...@beam.apache.org), and vote on the 
RC Vote email thread.
+
+
+## RC Testing Objectives
+
+The RC testing process aims to:
+
+ - Test new release candidates against existing code bases utilizing Apache 
Beam, to ensure there are no unexpected behaviors downstream.
+ - Incorporate a breadth of perspectives (including validation on multiple 
SDKs and multiple runners), before releasing a new version.
+ - Allow Beam Contributors to dogfood their changes and verify that they work 
as intended.
+
+
+## Beam Release process overview
+- For a comprehensive overview on the Beam release process, please take a look 
at our [release 
guide](https://github.com/apache/beam/blob/master/contributor-docs/release-guide.md).
+- Note that release candidate votes will be open for 72 hours after the voting 
email is sent.
+
+
+## Ideas for Python SDK Validators
+
+_Note: Do the following in a dev-like environment._
+- If you are a Python SDK user that utilizes notebooks (eg. Jupyter Notebooks, 
or Colab Notebooks), change `pip install`
+to point to the new RC (e.g. `pip install apache_beam[gcp]==2.52.0rc1`). 
Re-execute the workflow to ensure everything
+works as intended.
+- If your workflow utilizes [Dataflow 
Templates](https://github.com/GoogleCloudPlatform/DataflowTemplates), or 
another way of launching your job, modify your `requirements.txt` file, 
`setup.py` file, or `DockerFile` to point to the new Beam RC.
+- _Tip_: Run your pipeline both against Direct Runner, and another runner of 
your choice by modifying your job's `PipelineOptions`.
+
+
+## Ideas for Java SDK Validators
+_Note: Do the following in a dev-like environment._
+- If you are a Java SDK user that utilizes Maven or Gradle in your workflow, 
in your `pom.xml` file, modify the `beam.version` to reflect the newest RC, and 
modify the `` tag under ``, to point to the repository given 
in the vote email. [Example 
Changes](https://github.com/GoogleCloudPlatform/DataflowTemplates/pull/1090/files).
+
+
+## Ideas for Go SDK Validators
+_Note: Do the following in a dev-like environment._
+- If you utilize the Go SDK, use `go-get` to use the desired RC, for example, 
`go get -d github.com/apache/beam/sdks/v...@v2.xx.0-RC1`
+- Utilize the `--environment_config`, to point to the new release, for 
example, `--environment_config=apache/beam_go_sdk:2.xx.0rc1`
+
+
+## After validation
+
+- Reply to [dev list](https://lists.apache.org/list.html?d...@beam.apache.org) 
vote thread with your [vote](https://www.apache.org/foundation/voting.html) and 
an explanation of the use case you tested.
+- [Optional]: If your use case can be well represented by a test, consider 
contributing a test to Beam! However, note that the of the value of validation 
is manual testing outside of the Beam CI workflow, so it is still recommended 
(and highly encouraged!) to validate these test cases in future releases.
\ No newline at end of file
diff --git a/contributor-docs/release-guide.md 
b/contributor-docs/release-guide.md
index faa8ad5927c..e00ecd69433 100644
--- a/contributor-docs/release-guide.md
+++ b/contributor-docs/release-guide.md
@@ -817,7 +817,7 @@ template; please adjust as you see fit.
 Reviewers are encouraged to test their own use cases with the release 
candidate, and vote +1 if
 no issues are found. Only PMC member votes will count towards the final 
vote, but votes fro

(beam) branch master updated: Dask runner: Use bag sqrt scaling (#29366)

2023-12-05 Thread damccorm
This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new eedbfe1fce4 Dask runner: Use bag sqrt scaling (#29366)
eedbfe1fce4 is described below

commit eedbfe1fce4ce4bb1a7fad41e53b4c91e5ff6dc0
Author: Jacob Tomlinson 
AuthorDate: Tue Dec 5 19:30:02 2023 +

Dask runner: Use bag sqrt scaling (#29366)

* Ensure Dask Runner scales beyond 199 workers

* Add copyright notice

* Fix linting

* Revert copyright change
---
 sdks/python/apache_beam/runners/dask/transform_evaluator.py | 6 +-
 1 file changed, 5 insertions(+), 1 deletion(-)

diff --git a/sdks/python/apache_beam/runners/dask/transform_evaluator.py 
b/sdks/python/apache_beam/runners/dask/transform_evaluator.py
index c4aac7f2111..d4d58879b7f 100644
--- a/sdks/python/apache_beam/runners/dask/transform_evaluator.py
+++ b/sdks/python/apache_beam/runners/dask/transform_evaluator.py
@@ -24,6 +24,7 @@ TODO(alxr): Translate ops from 
https://docs.dask.org/en/latest/bag-api.html.
 """
 import abc
 import dataclasses
+import math
 import typing as t
 
 import apache_beam
@@ -59,7 +60,10 @@ class Create(DaskBagOp):
 assert input_bag is None, 'Create expects no input!'
 original_transform = t.cast(_Create, self.transform)
 items = original_transform.values
-return db.from_sequence(items)
+return db.from_sequence(
+items,
+partition_size=max(
+1, math.ceil(math.sqrt(len(items)) / math.sqrt(100
 
 
 class ParDo(DaskBagOp):



(beam) branch dependabot/go_modules/sdks/go.mongodb.org/mongo-driver-1.13.0 deleted (was c24aa5ebf19)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/go.mongodb.org/mongo-driver-1.13.0
in repository https://gitbox.apache.org/repos/asf/beam.git


 was c24aa5ebf19 Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in 
/sdks

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch master updated: Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in /sdks (#29343)

2023-12-05 Thread riteshghorse
This is an automated email from the ASF dual-hosted git repository.

riteshghorse pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 68bd67fb084 Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in 
/sdks (#29343)
68bd67fb084 is described below

commit 68bd67fb084e7e3064a466277fb1362fab67cb3d
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
AuthorDate: Tue Dec 5 14:38:02 2023 -0500

Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in /sdks (#29343)

Bumps 
[go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 
1.12.1 to 1.13.0.
- [Release notes](https://github.com/mongodb/mongo-go-driver/releases)
- 
[Commits](https://github.com/mongodb/mongo-go-driver/compare/v1.12.1...v1.13.0)

---
updated-dependencies:
- dependency-name: go.mongodb.org/mongo-driver
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] 
Co-authored-by: dependabot[bot] 
<49699333+dependabot[bot]@users.noreply.github.com>
---
 sdks/go.mod | 2 +-
 sdks/go.sum | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)

diff --git a/sdks/go.mod b/sdks/go.mod
index b55c0bb474b..33e3e7507cb 100644
--- a/sdks/go.mod
+++ b/sdks/go.mod
@@ -53,7 +53,7 @@ require (
github.com/tetratelabs/wazero v1.5.0
github.com/xitongsys/parquet-go v1.6.2
github.com/xitongsys/parquet-go-source 
v0.0.0-20220315005136-aec0fe3e777c
-   go.mongodb.org/mongo-driver v1.12.1
+   go.mongodb.org/mongo-driver v1.13.0
golang.org/x/net v0.19.0
golang.org/x/oauth2 v0.14.0
golang.org/x/sync v0.5.0
diff --git a/sdks/go.sum b/sdks/go.sum
index ed4921bfacc..0f61b39482a 100644
--- a/sdks/go.sum
+++ b/sdks/go.sum
@@ -477,8 +477,8 @@ github.com/zeebo/assert v1.3.0 
h1:g7C04CbJuIDKNPFHmsk4hwZDO5O+kntRxzaUoNXj+IQ=
 github.com/zeebo/xxh3 v1.0.2 h1:xZmwmqxHZA8AI603jOQ0tMqmBr9lPeFwGg6d+xy9DC0=
 github.com/zeebo/xxh3 v1.0.2/go.mod 
h1:5NWz9Sef7zIDm2JHfFlcQvNekmcEl9ekUZQQKCYaDcA=
 go.etcd.io/bbolt v1.3.5/go.mod h1:G5EMThwa9y8QZGBClrRx5EY+Yw9kAhnjy3bSjsnlVTQ=
-go.mongodb.org/mongo-driver v1.12.1 
h1:nLkghSU8fQNaK7oUmDhQFsnrtcoNy7Z6LVFKsEecqgE=
-go.mongodb.org/mongo-driver v1.12.1/go.mod 
h1:/rGBTebI3XYboVmgz+Wv3Bcbl3aD0QF9zl6kDDw18rQ=
+go.mongodb.org/mongo-driver v1.13.0 
h1:67DgFFjYOCMWdtTEmKFpV3ffWlFnh+CYZ8ZS/tXWUfY=
+go.mongodb.org/mongo-driver v1.13.0/go.mod 
h1:/rGBTebI3XYboVmgz+Wv3Bcbl3aD0QF9zl6kDDw18rQ=
 go.opencensus.io v0.21.0/go.mod h1:mSImk1erAIZhrmZN+AvHh14ztQfjbGwt4TtuofqLduU=
 go.opencensus.io v0.22.0/go.mod h1:+kGneAE2xo2IficOXnaByMWTGM9T73dGwxeWcUqIpI8=
 go.opencensus.io v0.22.2/go.mod h1:yxeiOL68Rb0Xd1ddK5vPZ/oVn4vY4Ynel7k9FzqtOIw=



(beam) branch master updated: Add docs and warning about using SpannerIO.Read in streaming pipelines (#29601)

2023-12-05 Thread yhu
This is an automated email from the ASF dual-hosted git repository.

yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 70e41f4ebef Add docs and warning about using SpannerIO.Read in 
streaming pipelines (#29601)
70e41f4ebef is described below

commit 70e41f4ebef55667943616f322708be950e91ddf
Author: Niel Markwick 
AuthorDate: Tue Dec 5 20:59:40 2023 +0100

Add docs and warning about using SpannerIO.Read in streaming pipelines 
(#29601)

* Add docs and warning about using SpannerIO.Read in streaming.

Add more documentation around SpannerIO.Read and .ReadAll
explaining PartitionedRead API, batching, and how it should
not be used for unbounded reads in Streaming pipelines.

Add a warning if SpannerIO.ReadAll is applied to an unbounded input.
---
 .../apache/beam/sdk/io/gcp/spanner/SpannerIO.java  | 87 +++---
 1 file changed, 76 insertions(+), 11 deletions(-)

diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.java
index 786fa91f558..b6ec8097a5f 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.java
@@ -142,12 +142,15 @@ import org.slf4j.LoggerFactory;
  *
  * Reading from Cloud Spanner
  *
- * To read from Cloud Spanner, apply {@link Read} transformation. It will 
return a {@link
- * PCollection} of {@link Struct Structs}, where each element represents an 
individual row returned
- * from the read operation. Both Query and Read APIs are supported. See more 
information about Bulk reading of a single query or table
+ *
+ * To perform a single read from Cloud Spanner, construct a {@link Read} 
transform using {@link
+ * SpannerIO#read() SpannerIO.read()}. It will return a {@link PCollection} of 
{@link Struct
+ * Structs}, where each element represents an individual row returned from the 
read operation. Both
+ * Query and Read APIs are supported. See more information about https://cloud.google.com/spanner/docs/reads";>reading from Cloud 
Spanner
  *
- * To execute a query, specify a {@link 
Read#withQuery(Statement)} or {@link
+ * To execute a Query, specify a {@link 
Read#withQuery(Statement)} or {@link
  * Read#withQuery(String)} during the construction of the transform.
  *
  * {@code
@@ -158,8 +161,17 @@ import org.slf4j.LoggerFactory;
  * .withQuery("SELECT id, name, email FROM users"));
  * }
  *
- * To use the Read API, specify a {@link Read#withTable(String) table name} 
and a {@link
- * Read#withColumns(List) list of columns}.
+ * Reads by default use the https://cloud.google.com/spanner/docs/reads#read_data_in_parallel";>PartitionQuery
 API
+ * which enforces some limitations on the type of queries that can be used so 
that the data can be
+ * read in parallel. If the query is not supported by the PartitionQuery API, 
then you can specify a
+ * non-partitioned read by setting {@link Read#withBatching(boolean) 
withBatching(false)}. If the
+ * amount of data being read by a non-partitioned read is very large, it may 
be useful to add a
+ * {@link Reshuffle#viaRandomKey()} transform on the output so that the 
downstream transforms can
+ * run in parallel.
+ *
+ * To read an entire Table, use {@link 
Read#withTable(String)} and optionally
+ * specify a {@link Read#withColumns(List) list of columns}.
  *
  * {@code
  * PCollection rows = p.apply(
@@ -170,13 +182,26 @@ import org.slf4j.LoggerFactory;
  *.withColumns("id", "name", "email"));
  * }
  *
- * To optimally read using index, specify the index name using {@link 
Read#withIndex}.
+ * To read using an Index, specify the index name using 
{@link
+ * Read#withIndex(String)}.
+ *
+ * {@code
+ * PCollection rows = p.apply(
+ *SpannerIO.read()
+ *.withInstanceId(instanceId)
+ *.withDatabaseId(dbId)
+ *.withTable("users")
+ *.withIndex("users_by_name")
+ *.withColumns("id", "name", "email"));
+ * }
+ *
+ * Read consistency
  *
  * The transform is guaranteed to be executed on a consistent snapshot of 
data, utilizing the
  * power of read only transactions. Staleness of data can be controlled using 
{@link
  * Read#withTimestampBound} or {@link Read#withTimestamp(Timestamp)} methods. 
https://cloud.google.com/spanner/docs/transactions";>Read more 
about transactions in
- * Cloud Spanner.
+ * 
href="https://cloud.google.com/spanner/docs/transactions#read-only_transactions";>Read
 more
+ * about transactions in Cloud Spanner.
  *
  * It is possible to read several {@link PCollection PCollections} within a 
single transaction.
  * Apply {@link SpannerIO#createTransaction()} transform, that lazily creates 

(beam) branch master updated: [YAML] - PubSubLite Normalization (#29525)

2023-12-05 Thread austin
This is an automated email from the ASF dual-hosted git repository.

austin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 7d997348b55 [YAML] - PubSubLite Normalization (#29525)
7d997348b55 is described below

commit 7d997348b5525718ba3b3eb68d134bcc9dbb5140
Author: Ferran Fernández Garrido 
AuthorDate: Tue Dec 5 21:09:04 2023 +0100

[YAML] - PubSubLite Normalization (#29525)

* [YAML] - PubSubLite Normalization

* [YAML] - PubSubLite Normalization - spotlessApply

* [YAML] - PubSubLite Normalization - fix comment
---
 .../PubsubLiteReadSchemaTransformProvider.java | 311 +++--
 .../PubsubLiteWriteSchemaTransformProvider.java| 245 --
 .../gcp/pubsublite/internal/PubsubLiteDlqTest.java | 373 +++--
 .../internal/PubsubLiteWriteDlqTest.java   | 176 +-
 sdks/python/apache_beam/yaml/standard_io.yaml  |  30 ++
 5 files changed, 1048 insertions(+), 87 deletions(-)

diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsublite/PubsubLiteReadSchemaTransformProvider.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsublite/PubsubLiteReadSchemaTransformProvider.java
index f6acd081ab2..98c5f8a6b38 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsublite/PubsubLiteReadSchemaTransformProvider.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsublite/PubsubLiteReadSchemaTransformProvider.java
@@ -23,14 +23,22 @@ import com.google.cloud.pubsublite.CloudRegionOrZone;
 import com.google.cloud.pubsublite.ProjectId;
 import com.google.cloud.pubsublite.SubscriptionName;
 import com.google.cloud.pubsublite.SubscriptionPath;
+import com.google.cloud.pubsublite.proto.AttributeValues;
+import com.google.cloud.pubsublite.proto.PubSubMessage;
 import com.google.cloud.pubsublite.proto.SequencedMessage;
+import com.google.protobuf.ByteString;
+import java.util.ArrayList;
 import java.util.Arrays;
 import java.util.Collections;
+import java.util.HashMap;
 import java.util.List;
+import java.util.Map;
 import java.util.Objects;
 import java.util.Set;
+import java.util.function.Consumer;
 import org.apache.beam.sdk.extensions.avro.schemas.utils.AvroUtils;
 import org.apache.beam.sdk.extensions.gcp.options.GcpOptions;
+import org.apache.beam.sdk.io.gcp.pubsublite.internal.Uuid;
 import org.apache.beam.sdk.metrics.Counter;
 import org.apache.beam.sdk.metrics.Metrics;
 import org.apache.beam.sdk.schemas.AutoValueSchema;
@@ -40,12 +48,13 @@ import 
org.apache.beam.sdk.schemas.annotations.SchemaFieldDescription;
 import org.apache.beam.sdk.schemas.transforms.SchemaTransform;
 import org.apache.beam.sdk.schemas.transforms.SchemaTransformProvider;
 import org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider;
+import org.apache.beam.sdk.schemas.transforms.providers.ErrorHandling;
 import org.apache.beam.sdk.schemas.utils.JsonUtils;
 import org.apache.beam.sdk.transforms.DoFn;
-import org.apache.beam.sdk.transforms.DoFn.FinishBundle;
-import org.apache.beam.sdk.transforms.DoFn.ProcessElement;
 import org.apache.beam.sdk.transforms.ParDo;
 import org.apache.beam.sdk.transforms.SerializableFunction;
+import org.apache.beam.sdk.transforms.SimpleFunction;
+import org.apache.beam.sdk.values.PCollection;
 import org.apache.beam.sdk.values.PCollectionRowTuple;
 import org.apache.beam.sdk.values.PCollectionTuple;
 import org.apache.beam.sdk.values.Row;
@@ -68,14 +77,12 @@ public class PubsubLiteReadSchemaTransformProvider
   private static final Logger LOG =
   LoggerFactory.getLogger(PubsubLiteReadSchemaTransformProvider.class);
 
-  public static final String VALID_FORMATS_STR = "AVRO,JSON";
+  public static final String VALID_FORMATS_STR = "RAW,AVRO,JSON";
   public static final Set VALID_DATA_FORMATS =
   Sets.newHashSet(VALID_FORMATS_STR.split(","));
 
   public static final TupleTag OUTPUT_TAG = new TupleTag() {};
   public static final TupleTag ERROR_TAG = new TupleTag() {};
-  public static final Schema ERROR_SCHEMA =
-  
Schema.builder().addStringField("error").addNullableByteArrayField("row").build();
 
   @Override
   protected @UnknownKeyFor @NonNull @Initialized 
Class
@@ -84,30 +91,95 @@ public class PubsubLiteReadSchemaTransformProvider
   }
 
   public static class ErrorFn extends DoFn {
-private SerializableFunction valueMapper;
-private Counter errorCounter;
+private final SerializableFunction valueMapper;
+private final Counter errorCounter;
 private Long errorsInBundle = 0L;
+private final boolean handleErrors;
 
-public ErrorFn(String name, SerializableFunction valueMapper) 
{
+private final List attributes;
+
+private final String attributeMap;
+
+private final Schema errorSchema;
+
+priv

(beam) branch master updated: Feature/dead letter queue core (#29164)

2023-12-05 Thread johncasey
This is an automated email from the ASF dual-hosted git repository.

johncasey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 22ae2e35b98 Feature/dead letter queue core (#29164)
22ae2e35b98 is described below

commit 22ae2e35b98b57fc2f31dacd9a188dd7bcaf0cc7
Author: johnjcasey <95318300+johnjca...@users.noreply.github.com>
AuthorDate: Tue Dec 5 15:15:58 2023 -0500

Feature/dead letter queue core (#29164)

* Update 2.50 release notes to include new Kafka topicPattern feature

* Create groovy class for io performance tests
Create gradle task and github actions config for GCS using this.

* delete unnecessary class

* fix env call

* fix call to gradle

* run on hosted runner for testing

* add additional checkout

* add destination for triggered tests

* move env variables to correct location

* try uploading against separate dataset

* try without a user

* update branch checkout, try to view the failure log

* run on failure

* update to use correct BigQuery instance

* convert to matrix

* add result reporting

* add failure clause

* remove failure clause, update to run on self-hosted

* address comments, clean up build

* clarify branching

* Add error handling base implementation & test DLQ enabled class

* Add test cases

* apply spotless

* Fix Checkstyles

* Fix Checkstyles

* make DLH serializable

* rename dead letter to bad record

* make DLH serializable

* Change bad record router name, and use multioutputreceiver instead of 
process context

* Refactor BadRecord to be nested

* clean up checkstyle

* Update error handler test

* Add metrics for counting error records, and for measuring feature usage

* apply spotless

* fix checkstyle

* make metric reporting static

* spotless

* Rework annotations to be an explicit label on a PTransform, instead of 
using java annotations

* fix checkstyle

* Address comments

* Address comments

* Fix test cases, spotless

* remove flatting without error collections

* fix nullness

* spotless + encoding issues

* spotless

* throw error when error handler isn't used

* add concrete bad record error handler class

* spotless, fix test category

* fix checkstyle

* clean up comments

* fix test case

* remove "failing transform" field on bad record, add note to CHANGES.md

* fix failing test cases

* fix failing test cases

* apply spotless

* apply final comments

* apply final comments

* apply final comments
---
 CHANGES.md |   1 +
 .../core/construction/PTransformTranslation.java   |   7 +
 .../main/java/org/apache/beam/sdk/Pipeline.java|  24 +++
 .../org/apache/beam/sdk/transforms/PTransform.java |  14 ++
 .../sdk/transforms/errorhandling/BadRecord.java| 218 
 .../transforms/errorhandling/BadRecordRouter.java  |  85 
 .../sdk/transforms/errorhandling/ErrorHandler.java | 227 +
 .../sdk/transforms/errorhandling/package-info.java |  23 +++
 .../errorhandling/BRHEnabledPTransform.java|  90 
 .../errorhandling/BadRecordRouterTest.java | 180 
 .../transforms/errorhandling/ErrorHandlerTest.java | 136 
 11 files changed, 1005 insertions(+)

diff --git a/CHANGES.md b/CHANGES.md
index 847532e8556..4b977bf3790 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -74,6 +74,7 @@
 * Running multi-language pipelines locally no longer requires Docker.
   Instead, the same (generally auto-started) subprocess used to perform the
   expansion can also be used as the cross-language worker.
+* Framework for adding Error Handlers to composite transforms added in Java 
([#29164](https://github.com/apache/beam/pull/29164))
 
 ## Breaking Changes
 
diff --git 
a/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/PTransformTranslation.java
 
b/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/PTransformTranslation.java
index 8f415e718e9..6829e0d6b23 100644
--- 
a/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/PTransformTranslation.java
+++ 
b/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/PTransformTranslation.java
@@ -27,6 +27,7 @@ import java.util.Comparator;
 import java.util.HashMap;
 import java.util.List;
 import java.util.Map;
+import java.util.Map.Entry;
 import java.util.ServiceLoader;
 imp

(beam) 01/01: Add buildx install to postcommit_XVR_Go

2023-12-05 Thread damccorm
This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a commit to branch users/damccorm/buildx
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 64bc552579d26b3de998998795db1c7afeb25737
Author: Danny McCormick 
AuthorDate: Tue Dec 5 15:30:51 2023 -0500

Add buildx install to postcommit_XVR_Go
---
 .github/workflows/beam_PostCommit_XVR_GoUsingJava_Dataflow.yml | 7 ++-
 1 file changed, 6 insertions(+), 1 deletion(-)

diff --git a/.github/workflows/beam_PostCommit_XVR_GoUsingJava_Dataflow.yml 
b/.github/workflows/beam_PostCommit_XVR_GoUsingJava_Dataflow.yml
index f674412f195..b260eb99b15 100644
--- a/.github/workflows/beam_PostCommit_XVR_GoUsingJava_Dataflow.yml
+++ b/.github/workflows/beam_PostCommit_XVR_GoUsingJava_Dataflow.yml
@@ -74,6 +74,11 @@ jobs:
 uses: ./.github/actions/setup-environment-action
 with:
   python-version: 3.8
+  - name: Setup Buildx
+uses: docker/setup-buildx-action@v2
+with:
+  install: true
+  driver: 'docker'
   - name: run XVR GoUsingJava Dataflow script
 env:
   USER: github-actions
@@ -93,4 +98,4 @@ jobs:
 with:
   commit: '${{ env.prsha || env.GITHUB_SHA }}'
   comment_mode: ${{ github.event_name == 'issue_comment'  && 'always' 
|| 'off' }}
-  files: '**/build/test-results/**/*.xml'
\ No newline at end of file
+  files: '**/build/test-results/**/*.xml'



(beam) branch users/damccorm/buildx created (now 64bc552579d)

2023-12-05 Thread damccorm
This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a change to branch users/damccorm/buildx
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 64bc552579d Add buildx install to postcommit_XVR_Go

This branch includes the following new commits:

 new 64bc552579d Add buildx install to postcommit_XVR_Go

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.




(beam) branch users/damccorm/stableYaml created (now 8d47ec91ddb)

2023-12-05 Thread damccorm
This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a change to branch users/damccorm/stableYaml
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 8d47ec91ddb Remove experimental line from yaml readme

This branch includes the following new commits:

 new 8d47ec91ddb Remove experimental line from yaml readme

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.




(beam) 01/01: Remove experimental line from yaml readme

2023-12-05 Thread damccorm
This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a commit to branch users/damccorm/stableYaml
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 8d47ec91ddb431ee7c5b83cba8d21066f78c1c0e
Author: Danny McCormick 
AuthorDate: Tue Dec 5 15:33:35 2023 -0500

Remove experimental line from yaml readme
---
 sdks/python/apache_beam/yaml/README.md | 3 ---
 1 file changed, 3 deletions(-)

diff --git a/sdks/python/apache_beam/yaml/README.md 
b/sdks/python/apache_beam/yaml/README.md
index 247b42b6839..8ed7f333851 100644
--- a/sdks/python/apache_beam/yaml/README.md
+++ b/sdks/python/apache_beam/yaml/README.md
@@ -44,9 +44,6 @@ or consumption (e.g. a lineage analysis tool) and expect it 
to be more
 easily manipulated and semantically meaningful than the Beam protos
 themselves (which concern themselves more with execution).
 
-It should be noted that everything here is still EXPERIMENTAL and subject
-to change. Feedback is welcome at d...@apache.beam.org.
-
 ## Example pipelines
 
 Here is a simple pipeline that reads some data from csv files and



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 20ca75f3262 Updating config from bot
20ca75f3262 is described below

commit 20ca75f326231f6aa5be428f5112094f9e09997a
Author: github-actions 
AuthorDate: Tue Dec 5 20:34:55 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29490.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29490.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29490.json
index a7c19975bb1..27014f1d445 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29490.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29490.json
@@ -7,5 +7,5 @@
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
-  "committerAssigned": false
+  "committerAssigned": true
 }
\ No newline at end of file



(beam) branch users/damccorm/stableYaml deleted (was 8d47ec91ddb)

2023-12-05 Thread damccorm
This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a change to branch users/damccorm/stableYaml
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 8d47ec91ddb Remove experimental line from yaml readme

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch master updated (22ae2e35b98 -> 40685cdd0ee)

2023-12-05 Thread damondouglas
This is an automated email from the ASF dual-hosted git repository.

damondouglas pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 22ae2e35b98 Feature/dead letter queue core (#29164)
 add 40685cdd0ee [RRIO] [Call] Implement the Repeater (#29490)

No new revisions were added by this update.

Summary of changes:
 .../apache/beam/io/requestresponse/Repeater.java   | 140 +
 ...ion.java => UserCodeRemoteSystemException.java} |  15 +-
 .../beam/io/requestresponse/RepeaterTest.java  | 345 +
 3 files changed, 492 insertions(+), 8 deletions(-)
 create mode 100644 
sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/Repeater.java
 copy 
sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/{UserCodeQuotaException.java
 => UserCodeRemoteSystemException.java} (70%)
 create mode 100644 
sdks/java/io/rrio/src/test/java/org/apache/beam/io/requestresponse/RepeaterTest.java



(beam) 01/01: Merge pull request #29625 [yaml] Unmark as experimental

2023-12-05 Thread robertwb
This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 665ede8b0f6eb72bc1a03980fe3982c60c5c358b
Merge: 40685cdd0ee 50904522a5c
Author: Robert Bradshaw 
AuthorDate: Tue Dec 5 13:10:53 2023 -0800

Merge pull request #29625 [yaml] Unmark as experimental

 sdks/python/apache_beam/yaml/README.md | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)



(beam) branch master updated (40685cdd0ee -> 665ede8b0f6)

2023-12-05 Thread robertwb
This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 40685cdd0ee [RRIO] [Call] Implement the Repeater (#29490)
 add 50904522a5c [yaml] Unmark as experimental
 new 665ede8b0f6 Merge pull request #29625 [yaml] Unmark as experimental

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/python/apache_beam/yaml/README.md | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)



(beam) branch master updated: [YAML] Clean up some confusing error messages. (#29481)

2023-12-05 Thread robertwb
This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new e16d401987d [YAML] Clean up some confusing error messages. (#29481)
e16d401987d is described below

commit e16d401987d9656bf791afc0d4679b09b8f3fe04
Author: Robert Bradshaw 
AuthorDate: Tue Dec 5 13:15:33 2023 -0800

[YAML] Clean up some confusing error messages. (#29481)

* Provide sane defaults rather than NullPtrExceptions for optional BigQuery 
parameters.
* Better error when cross-language is used with (incompatible) local 
streaming Python runner.
* Add format and schema to readme PubSub examples.
---
 ...ueryStorageWriteApiSchemaTransformProvider.java | 11 +
 .../apache_beam/runners/direct/direct_runner.py| 11 +
 sdks/python/apache_beam/yaml/README.md | 28 +-
 sdks/python/apache_beam/yaml/readme_test.py|  4 ++--
 4 files changed, 47 insertions(+), 7 deletions(-)

diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
index 39e6fd7c809..98cc246ce0d 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
@@ -338,10 +338,13 @@ public class 
BigQueryStorageWriteApiSchemaTransformProvider
   if (inputRows.isBounded() == IsBounded.UNBOUNDED) {
 Long triggeringFrequency = 
configuration.getTriggeringFrequencySeconds();
 Boolean autoSharding = configuration.getAutoSharding();
-Integer numStreams = configuration.getNumStreams();
+int numStreams = configuration.getNumStreams() == null ? 0 : 
configuration.getNumStreams();
+boolean useAtLeastOnceSemantics =
+configuration.getUseAtLeastOnceSemantics() == null
+? false
+: configuration.getUseAtLeastOnceSemantics();
 // Triggering frequency is only applicable for exactly-once
-if (configuration.getUseAtLeastOnceSemantics() == null
-|| !configuration.getUseAtLeastOnceSemantics()) {
+if (!useAtLeastOnceSemantics) {
   write =
   write.withTriggeringFrequency(
   (triggeringFrequency == null || triggeringFrequency <= 0)
@@ -349,7 +352,7 @@ public class BigQueryStorageWriteApiSchemaTransformProvider
   : Duration.standardSeconds(triggeringFrequency));
 }
 // set num streams if specified, otherwise default to autoSharding
-if (numStreams != null && numStreams > 0) {
+if (numStreams > 0) {
   write = write.withNumStorageWriteApiStreams(numStreams);
 } else if (autoSharding == null || autoSharding) {
   write = write.withAutoSharding();
diff --git a/sdks/python/apache_beam/runners/direct/direct_runner.py 
b/sdks/python/apache_beam/runners/direct/direct_runner.py
index db53e4122bb..a470ba80d8e 100644
--- a/sdks/python/apache_beam/runners/direct/direct_runner.py
+++ b/sdks/python/apache_beam/runners/direct/direct_runner.py
@@ -507,6 +507,17 @@ class BundleBasedDirectRunner(PipelineRunner):
 from apache_beam.runners.direct.transform_evaluator import \
   TransformEvaluatorRegistry
 from apache_beam.testing.test_stream import TestStream
+from apache_beam.transforms.external import ExternalTransform
+
+class VerifyNoCrossLanguageTransforms(PipelineVisitor):
+  """Visitor determining whether a Pipeline uses a TestStream."""
+  def visit_transform(self, applied_ptransform):
+if isinstance(applied_ptransform.transform, ExternalTransform):
+  raise RuntimeError(
+  "Streaming Python direct runner "
+  "does not support cross-language pipelines.")
+
+pipeline.visit(VerifyNoCrossLanguageTransforms())
 
 # If the TestStream I/O is used, use a mock test clock.
 class TestStreamUsageVisitor(PipelineVisitor):
diff --git a/sdks/python/apache_beam/yaml/README.md 
b/sdks/python/apache_beam/yaml/README.md
index e1528a8e480..0b5c118ba8a 100644
--- a/sdks/python/apache_beam/yaml/README.md
+++ b/sdks/python/apache_beam/yaml/README.md
@@ -274,6 +274,13 @@ pipeline:
 - type: ReadFromPubSub
   config:
 topic: myPubSubTopic
+format: json
+schema:
+  type: object
+  properties:
+col1: {type: string}
+col2: {type: integer}
+col3: {type: number}
 - type: WindowInto
   

(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new e5640aaba7b Updating config from bot
e5640aaba7b is described below

commit e5640aaba7b557f87c0a73c1a758cf01c3a32034
Author: github-actions 
AuthorDate: Tue Dec 5 21:32:12 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29590.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29590.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29590.json
index 242a48d7d3b..37f7ab41238 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29590.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29590.json
@@ -2,7 +2,7 @@
   "commentedAboutFailingChecks": true,
   "reviewersAssignedForLabels": {},
   "nextAction": "Author",
-  "stopReviewerNotifications": false,
+  "stopReviewerNotifications": true,
   "remindAfterTestsPass": [],
   "committerAssigned": false
 }
\ No newline at end of file



(beam) branch users/damccorm/buildx updated (64bc552579d -> 5f7995429cd)

2023-12-05 Thread damccorm
This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a change to branch users/damccorm/buildx
in repository https://gitbox.apache.org/repos/asf/beam.git


from 64bc552579d Add buildx install to postcommit_XVR_Go
 add 5f7995429cd Mirror go postcommit

No new revisions were added by this update.

Summary of changes:
 .github/workflows/beam_PostCommit_XVR_GoUsingJava_Dataflow.yml | 10 +-
 1 file changed, 5 insertions(+), 5 deletions(-)



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 65b4d208a6e Updating config from bot
65b4d208a6e is described below

commit 65b4d208a6ee00f5966244f7d692aee4d29f2953
Author: github-actions 
AuthorDate: Tue Dec 5 23:34:45 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29546.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29546.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29546.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29546.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch asf-site updated: Publishing website 2023/12/05 23:40:52 at commit e16d401

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 95356c08875 Publishing website 2023/12/05 23:40:52 at commit e16d401
95356c08875 is described below

commit 95356c088756498b8d3c2b4f1f22a1ce0beade58
Author: runner 
AuthorDate: Tue Dec 5 23:40:52 2023 +

Publishing website 2023/12/05 23:40:52 at commit e16d401
---
 website/generated-content/sitemap.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/website/generated-content/sitemap.xml 
b/website/generated-content/sitemap.xml
index f0849b55536..32e1f51aea5 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.52.0/2023-12-05T07:23:41-08:00/categories/blog/2023-12-05T07:23:41-08:00/blog/2023-12-05T07:23:41-08:00/categories/2023-12-05T07:23:41-08:00/catego
 [...]
\ No newline at end of file
+http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.52.0/2023-12-05T13:15:33-08:00/categories/blog/2023-12-05T13:15:33-08:00/blog/2023-12-05T13:15:33-08:00/categories/2023-12-05T13:15:33-08:00/catego
 [...]
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new af6cfd31a37 Updating config from bot
af6cfd31a37 is described below

commit af6cfd31a37e62fe228f5b0d5da0485b0681cfeb
Author: github-actions 
AuthorDate: Wed Dec 6 00:20:11 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29626.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29626.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29626.json
new file mode 100644
index 000..8a92900947e
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29626.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"build": "damccorm"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 70489c31843 Updating config from bot
70489c31843 is described below

commit 70489c31843743283c1aeadade83d6d44a7e2226
Author: github-actions 
AuthorDate: Wed Dec 6 00:20:13 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index f75ae360c2d..8cc06a3961c 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -1,7 +1,7 @@
 {
   "label": "build",
   "dateOfLastReviewAssignment": {
-"damccorm": 1701754475028,
+"damccorm": 1701822009491,
 "Abacn": 1701801303534
   }
 }
\ No newline at end of file



(beam) branch nightly-refs/heads/master updated (c9c89fe7d5f -> e16d401987d)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


from c9c89fe7d5f Use UUIDs instead of object hashes to avoid collisions 
(#29542)
 add 6973255b3d0 Bump cloud.google.com/go/spanner from 1.53.0 to 1.53.1 in 
/sdks (#29610)
 add c53f0af09f9 Bump golang.org/x/net from 0.18.0 to 0.19.0 in /sdks 
(#29574)
 add 17f3f0532c2 [#29568] Use gcr clone of images by default on Dataflow. 
(#29608)
 add 59930cd2584 Bump github.com/aws/aws-sdk-go-v2 from 1.23.4 to 1.23.5 in 
/sdks (#29611)
 add 4b4cc5d8088 Esacpe strings in integrationTestPipelineOptions in Java 
Tests
 add 5ebd5d823d8 Merge pull request #29620: Escape strings in 
integrationTestPipelineOptions in Java Tests
 add 169dce40670 Initial RC Testing Guide Documentation  (#29595)
 add eedbfe1fce4 Dask runner: Use bag sqrt scaling (#29366)
 add 68bd67fb084 Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in 
/sdks (#29343)
 add 70e41f4ebef Add docs and warning about using SpannerIO.Read in 
streaming pipelines (#29601)
 add 7d997348b55 [YAML] - PubSubLite Normalization (#29525)
 add 22ae2e35b98 Feature/dead letter queue core (#29164)
 add 40685cdd0ee [RRIO] [Call] Implement the Repeater (#29490)
 add 50904522a5c [yaml] Unmark as experimental
 add 665ede8b0f6 Merge pull request #29625 [yaml] Unmark as experimental
 add e16d401987d [YAML] Clean up some confusing error messages. (#29481)

No new revisions were added by this update.

Summary of changes:
 .github/workflows/java_tests.yml   |   4 +-
 CHANGES.md |   1 +
 contributor-docs/rc-testing-guide.md   |  60 
 contributor-docs/release-guide.md  |   8 +-
 .../core/construction/PTransformTranslation.java   |   7 +
 sdks/go.mod|  12 +-
 sdks/go.sum|  24 +-
 sdks/go/pkg/beam/runners/dataflow/dataflow.go  |  13 +-
 sdks/go/pkg/beam/runners/dataflow/dataflow_test.go |  10 +
 .../main/java/org/apache/beam/sdk/Pipeline.java|  24 ++
 .../org/apache/beam/sdk/transforms/PTransform.java |  14 +
 .../sdk/transforms/errorhandling/BadRecord.java| 218 
 .../transforms/errorhandling/BadRecordRouter.java  |  85 +
 .../sdk/transforms/errorhandling/ErrorHandler.java | 227 +
 .../transforms/errorhandling}/package-info.java|   5 +-
 .../errorhandling/BRHEnabledPTransform.java|  90 +
 .../errorhandling/BadRecordRouterTest.java | 180 ++
 .../transforms/errorhandling/ErrorHandlerTest.java | 136 
 ...ueryStorageWriteApiSchemaTransformProvider.java |  11 +-
 .../PubsubLiteReadSchemaTransformProvider.java | 311 +++--
 .../PubsubLiteWriteSchemaTransformProvider.java| 245 --
 .../apache/beam/sdk/io/gcp/spanner/SpannerIO.java  |  87 -
 .../gcp/pubsublite/internal/PubsubLiteDlqTest.java | 373 +++--
 .../internal/PubsubLiteWriteDlqTest.java   | 176 +-
 .../apache/beam/io/requestresponse/Repeater.java   | 140 
 ...ion.java => UserCodeRemoteSystemException.java} |  15 +-
 .../beam/io/requestresponse/RepeaterTest.java  | 345 +++
 .../runners/dask/transform_evaluator.py|   6 +-
 .../apache_beam/runners/direct/direct_runner.py|  11 +
 sdks/python/apache_beam/yaml/README.md |  33 +-
 sdks/python/apache_beam/yaml/readme_test.py|   4 +-
 sdks/python/apache_beam/yaml/standard_io.yaml  |  30 ++
 32 files changed, 2762 insertions(+), 143 deletions(-)
 create mode 100644 contributor-docs/rc-testing-guide.md
 create mode 100644 
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/errorhandling/BadRecord.java
 create mode 100644 
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/errorhandling/BadRecordRouter.java
 create mode 100644 
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/errorhandling/ErrorHandler.java
 copy {runners/core-java/src/main/java/org/apache/beam/runners/core => 
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/errorhandling}/package-info.java
 (89%)
 create mode 100644 
sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/errorhandling/BRHEnabledPTransform.java
 create mode 100644 
sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/errorhandling/BadRecordRouterTest.java
 create mode 100644 
sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/errorhandling/ErrorHandlerTest.java
 create mode 100644 
sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/Repeater.java
 copy 
sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/{UserCodeQuotaException.java
 => UserCodeRemoteSystemException.java} (70%)
 create mode 100644 
sdks/java/io/rrio/src/test/java/org/apache

(beam) branch dependabot/go_modules/sdks/google.golang.org/api-0.153.0 created (now 341a60c995a)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/google.golang.org/api-0.153.0
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 341a60c995a Bump google.golang.org/api from 0.152.0 to 0.153.0 in /sdks

No new revisions were added by this update.



(beam) branch dependabot/go_modules/sdks/github.com/nats-io/nats-server/v2-2.10.6 created (now d38844f7ec0)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/nats-io/nats-server/v2-2.10.6
in repository https://gitbox.apache.org/repos/asf/beam.git


  at d38844f7ec0 Bump github.com/nats-io/nats-server/v2 from 2.10.5 to 
2.10.6 in /sdks

No new revisions were added by this update.



(beam) branch dependabot/go_modules/sdks/golang.org/x/oauth2-0.15.0 created (now a9f825eea7a)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/golang.org/x/oauth2-0.15.0
in repository https://gitbox.apache.org/repos/asf/beam.git


  at a9f825eea7a Bump golang.org/x/oauth2 from 0.14.0 to 0.15.0 in /sdks

No new revisions were added by this update.



(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/credentials-1.16.9 created (now 505f6e28cc8)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/credentials-1.16.9
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 505f6e28cc8 Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks

No new revisions were added by this update.



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 50ebdafd243 Updating config from bot
50ebdafd243 is described below

commit 50ebdafd24328343158355b0506313c24508a12a
Author: github-actions 
AuthorDate: Wed Dec 6 04:35:35 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29629.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29629.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29629.json
new file mode 100644
index 000..aa3638a74ec
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29629.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"go": "riteshghorse"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 4ab06f436de Updating config from bot
4ab06f436de is described below

commit 4ab06f436de2f41ae966a4d7a98a1827f691f9fb
Author: github-actions 
AuthorDate: Wed Dec 6 04:35:39 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29628.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29628.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29628.json
new file mode 100644
index 000..8ea94810368
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29628.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"go": "lostluck"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new ad2504b5be3 Updating config from bot
ad2504b5be3 is described below

commit ad2504b5be32e5ad5161fab84633a7ab29c47810
Author: github-actions 
AuthorDate: Wed Dec 6 04:35:36 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index 6aeebfad40e..3dfba6f69da 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -5,6 +5,6 @@
 "jrmccluskey": 1701754486123,
 "youngoli": 1657688896155,
 "damccorm": 1680501930289,
-"riteshghorse": 1701731171931
+"riteshghorse": 1701837333653
   }
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 7d099b166a5 Updating config from bot
7d099b166a5 is described below

commit 7d099b166a576c8d30126906618bafe9d0313af4
Author: github-actions 
AuthorDate: Wed Dec 6 04:35:40 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index 3dfba6f69da..23d3729c6a4 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -1,7 +1,7 @@
 {
   "label": "go",
   "dateOfLastReviewAssignment": {
-"lostluck": 1701754482334,
+"lostluck": 1701837337818,
 "jrmccluskey": 1701754486123,
 "youngoli": 1657688896155,
 "damccorm": 1680501930289,



(beam) branch dependabot/gradle/com.gradle.common-custom-user-data-gradle-plugin-1.12.1 created (now 501e6978eca)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/gradle/com.gradle.common-custom-user-data-gradle-plugin-1.12.1
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 501e6978eca Bump com.gradle.common-custom-user-data-gradle-plugin

No new revisions were added by this update.



(beam) branch dependabot/gradle/com.gradle.common-custom-user-data-gradle-plugin-1.12 deleted (was 8b2c4ba5a70)

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/gradle/com.gradle.common-custom-user-data-gradle-plugin-1.12
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 8b2c4ba5a70 Bump com.gradle.common-custom-user-data-gradle-plugin

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 5c1296747ce Updating config from bot
5c1296747ce is described below

commit 5c1296747ce4865c6be81392bffa3951ef31cae9
Author: github-actions 
AuthorDate: Wed Dec 6 05:05:52 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29631.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29631.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29631.json
new file mode 100644
index 000..1c2c2e31975
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29631.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"go": "jrmccluskey"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 35235613825 Updating config from bot
35235613825 is described below

commit 352356138250d29ce9db078d154d375d6f106db9
Author: github-actions 
AuthorDate: Wed Dec 6 05:05:54 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index 23d3729c6a4..c5d39094152 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -2,7 +2,7 @@
   "label": "go",
   "dateOfLastReviewAssignment": {
 "lostluck": 1701837337818,
-"jrmccluskey": 1701754486123,
+"jrmccluskey": 1701839150581,
 "youngoli": 1657688896155,
 "damccorm": 1680501930289,
 "riteshghorse": 1701837333653



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 1005fcb9a24 Updating config from bot
1005fcb9a24 is described below

commit 1005fcb9a24257fcbd661c24e7171123ab38586c
Author: github-actions 
AuthorDate: Wed Dec 6 05:05:57 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29630.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29630.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29630.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29630.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2023-12-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new eb41c1d13fc Updating config from bot
eb41c1d13fc is described below

commit eb41c1d13fc0fc7328341bdeec2742244843c03f
Author: github-actions 
AuthorDate: Wed Dec 6 05:34:39 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29632.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29632.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29632.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29632.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file