(beam) branch asf-site updated: Publishing website 2024/02/08 05:38:22 at commit 382c6dc

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 7767279c85f Publishing website 2024/02/08 05:38:22 at commit 382c6dc
7767279c85f is described below

commit 7767279c85f6864ab9784a2672d08f6dca0e291b
Author: runner 
AuthorDate: Thu Feb 8 05:38:22 2024 +

Publishing website 2024/02/08 05:38:22 at commit 382c6dc
---
 website/generated-content/sitemap.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/website/generated-content/sitemap.xml 
b/website/generated-content/sitemap.xml
index a8f76446c83..e2756639a6e 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/apache-beam-flink-and-kubernetes-part3/2024-02-07T14:43:56-08:00/categories/blog/2024-02-07T14:43:56-08:00/blog/2024-02-07T14:43:56-08:00/categories/2024-02-07T14:43:56-08:00http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/apache-beam-flink-and-kubernetes-part3/2024-02-07T19:54:43-05:00/categories/blog/2024-02-07T19:54:43-05:00/blog/2024-02-07T19:54:43-05:00/categories/2024-02-07T19:54:43-05:00

(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 1785aab0b62 Updating config from bot
1785aab0b62 is described below

commit 1785aab0b62d8a19cc0a5063734519be9a226d5c
Author: github-actions 
AuthorDate: Thu Feb 8 05:34:27 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30254.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30254.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30254.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30254.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch dependabot/go_modules/sdks/github.com/google/uuid-1.6.0 created (now 9a883cd3580)

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/google/uuid-1.6.0
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 9a883cd3580 Bump github.com/google/uuid from 1.5.0 to 1.6.0 in /sdks

No new revisions were added by this update.



(beam) branch nightly-refs/heads/master updated (7a46686577d -> 382c6dccfcc)

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 7a46686577d Fix a naming conflict of the TransformService test suite 
(#30243)
 add 4645a76ee2a gcsio: reduce number of get requests in function calls 
(#30205)
 add f250a843230 Adjust transform-service module names and deps with 
sdks/java/core
 add 13a70844abb Merge pull request #30237: Adjust transform-service module 
names and deps with sdks/java/core
 add 4f3963f7878 Bump google.golang.org/grpc from 1.60.1 to 1.61.0 in /sdks 
(#30249)
 add 2c5d153bf29 Add InferenceAPIEmbeddings to huggingface (#30138)
 add c72a9f83fed Fix Jms drop record (#30218)
 add a15dd7e7f84 [Go SDK] Use distroless:debian12 (no-ssl) as base image. 
(#30011)
 add 9b4b509e52c Fail later when duplicate transform translators are on the 
classpath
 add 382c6dccfcc Merge pull request #30252: Fail later when duplicate 
transform translators are on the classpath

No new revisions were added by this update.

Summary of changes:
 .../workflows/beam_PreCommit_Python_Coverage.yml   |   2 +
 CHANGES.md |   1 +
 .../core/construction/PTransformTranslation.java   |  90 ++-
 sdks/go.mod|   4 +-
 sdks/go.sum|   8 +-
 sdks/go/container/Dockerfile   |  15 +-
 .../sdk/expansion/service/ExpansionService.java| 650 ++---
 .../ExpansionServiceSchemaTransformProvider.java   |   1 -
 .../service/JavaClassLookupTransformProvider.java  |   1 -
 .../sdk/expansion/service/TransformProvider.java   | 167 ++
 .../expansion/service/ExpansionServiceTest.java|  11 +-
 .../beam/sdk/expansion/service/ExternalTest.java   |   2 +-
 .../apache/beam/sdk/io/jms/JmsCheckpointMark.java  | 201 ---
 .../java/org/apache/beam/sdk/io/jms/JmsIO.java |  84 ++-
 .../java/org/apache/beam/sdk/io/jms/JmsIOIT.java   |  45 +-
 .../java/org/apache/beam/sdk/io/jms/JmsIOTest.java | 109 ++--
 .../testing/expansion/TestExpansionService.java|  10 +-
 sdks/java/transform-service/app/build.gradle   |   2 +-
 sdks/java/transform-service/build.gradle   |   2 +-
 sdks/java/transform-service/launcher/build.gradle  |   7 +-
 sdks/python/apache_beam/io/gcp/gcsio.py|  51 +-
 sdks/python/apache_beam/io/gcp/gcsio_test.py   |  85 ++-
 .../ml/transforms/embeddings/huggingface.py| 126 +++-
 .../ml/transforms/embeddings/huggingface_test.py   |  51 ++
 sdks/python/test-suites/tox/common.gradle  |   4 +-
 sdks/python/tox.ini|   1 +
 26 files changed, 1118 insertions(+), 612 deletions(-)
 create mode 100644 
sdks/java/expansion-service/src/main/java/org/apache/beam/sdk/expansion/service/TransformProvider.java



(beam) branch master updated (a15dd7e7f84 -> 382c6dccfcc)

2024-02-07 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from a15dd7e7f84 [Go SDK] Use distroless:debian12 (no-ssl) as base image. 
(#30011)
 add 9b4b509e52c Fail later when duplicate transform translators are on the 
classpath
 new 382c6dccfcc Merge pull request #30252: Fail later when duplicate 
transform translators are on the classpath

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../core/construction/PTransformTranslation.java   |  90 ++-
 .../sdk/expansion/service/ExpansionService.java| 650 ++---
 .../ExpansionServiceSchemaTransformProvider.java   |   1 -
 .../service/JavaClassLookupTransformProvider.java  |   1 -
 .../sdk/expansion/service/TransformProvider.java   | 167 ++
 .../expansion/service/ExpansionServiceTest.java|  11 +-
 .../beam/sdk/expansion/service/ExternalTest.java   |   2 +-
 .../testing/expansion/TestExpansionService.java|  10 +-
 8 files changed, 541 insertions(+), 391 deletions(-)
 create mode 100644 
sdks/java/expansion-service/src/main/java/org/apache/beam/sdk/expansion/service/TransformProvider.java



(beam) 01/01: Merge pull request #30252: Fail later when duplicate transform translators are on the classpath

2024-02-07 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 382c6dccfccabfe4a7b20db9a2c24369e8fce981
Merge: a15dd7e7f84 9b4b509e52c
Author: Kenneth Knowles 
AuthorDate: Wed Feb 7 19:54:43 2024 -0500

Merge pull request #30252: Fail later when duplicate transform translators 
are on the classpath

 .../core/construction/PTransformTranslation.java   |  90 ++-
 .../sdk/expansion/service/ExpansionService.java| 650 ++---
 .../ExpansionServiceSchemaTransformProvider.java   |   1 -
 .../service/JavaClassLookupTransformProvider.java  |   1 -
 .../sdk/expansion/service/TransformProvider.java   | 167 ++
 .../expansion/service/ExpansionServiceTest.java|  11 +-
 .../beam/sdk/expansion/service/ExternalTest.java   |   2 +-
 .../testing/expansion/TestExpansionService.java|  10 +-
 8 files changed, 541 insertions(+), 391 deletions(-)



(beam) branch asf-site updated: Publishing website 2024/02/07 23:38:16 at commit a15dd7e

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 4b478e28026 Publishing website 2024/02/07 23:38:16 at commit a15dd7e
4b478e28026 is described below

commit 4b478e280264a931711837554f4016aa68e76cb0
Author: runner 
AuthorDate: Wed Feb 7 23:38:16 2024 +

Publishing website 2024/02/07 23:38:16 at commit a15dd7e
---
 website/generated-content/sitemap.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/website/generated-content/sitemap.xml 
b/website/generated-content/sitemap.xml
index 24b33c8c203..a8f76446c83 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/apache-beam-flink-and-kubernetes-part3/2024-02-07T12:33:47-05:00/categories/blog/2024-02-07T12:33:47-05:00/blog/2024-02-07T12:33:47-05:00/categories/2024-02-07T12:33:47-05:00http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/apache-beam-flink-and-kubernetes-part3/2024-02-07T14:43:56-08:00/categories/blog/2024-02-07T14:43:56-08:00/blog/2024-02-07T14:43:56-08:00/categories/2024-02-07T14:43:56-08:00

(beam) branch master updated: [Go SDK] Use distroless:debian12 (no-ssl) as base image. (#30011)

2024-02-07 Thread lostluck
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new a15dd7e7f84 [Go SDK] Use distroless:debian12 (no-ssl) as base image. 
(#30011)
a15dd7e7f84 is described below

commit a15dd7e7f848d2a99d74ba906c6b5cb5c8ffefa8
Author: Robert Burke 
AuthorDate: Wed Feb 7 14:43:56 2024 -0800

[Go SDK] Use distroless:debian12 (no-ssl) as base image. (#30011)

* [Go SDK] Use distroless:debian12 (no-ssl) as base image.

* ws lint

* Update changes

* add space

-

Co-authored-by: lostluck <13907733+lostl...@users.noreply.github.com>
---
 CHANGES.md   |  1 +
 sdks/go/container/Dockerfile | 15 +--
 2 files changed, 2 insertions(+), 14 deletions(-)

diff --git a/CHANGES.md b/CHANGES.md
index c63464a6e01..bb1dd5a117a 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -82,6 +82,7 @@
 
 ## Security Fixes
 * Fixed (CVE--)[https://www.cve.org/CVERecord?id=CVE--] 
(Java/Python/Go) ([#X](https://github.com/apache/beam/issues/X)).
+* Go SDK base container image moved to distroless/base-nossl-debian12, 
reducing vulnerable container surface to kernel and glibc 
([#30011](https://github.com/apache/beam/pull/30011)).
 
 ## Known Issues
 
diff --git a/sdks/go/container/Dockerfile b/sdks/go/container/Dockerfile
index 7f1884cfb71..b3b2fbbec3a 100644
--- a/sdks/go/container/Dockerfile
+++ b/sdks/go/container/Dockerfile
@@ -16,20 +16,12 @@
 # limitations under the License.
 ###
 
-FROM debian:bookworm
+FROM gcr.io/distroless/base-nossl-debian12:latest
 LABEL Author "Apache Beam "
 
 ARG TARGETOS
 ARG TARGETARCH
 
-ARG pull_licenses
-
-RUN apt-get update && \
-DEBIAN_FRONTEND=noninteractive apt-get install -y \
-ca-certificates \
-&& \
-rm -rf /var/lib/apt/lists/*
-
 ADD target/${TARGETOS}_${TARGETARCH}/boot /opt/apache/beam/
 
 COPY target/LICENSE /opt/apache/beam/
@@ -37,9 +29,4 @@ COPY target/NOTICE /opt/apache/beam/
 
 # Add Go licenses.
 COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
-RUN if [ "$pull_licenses" = "false" ] ; then \
-# Remove above golang license and dir if pull licenses false
-rm -rf /opt/apache/beam/third_party_licenses ; \
-   fi
-
 ENTRYPOINT ["/opt/apache/beam/boot"]



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new a99aafe7ca1 Updating config from bot
a99aafe7ca1 is described below

commit a99aafe7ca1c084455ec13ef96ba3e4f3324c4f1
Author: github-actions 
AuthorDate: Wed Feb 7 22:05:43 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30187.json | 9 ++---
 1 file changed, 6 insertions(+), 3 deletions(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30187.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30187.json
index 242a48d7d3b..95dd280087f 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30187.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30187.json
@@ -1,7 +1,10 @@
 {
-  "commentedAboutFailingChecks": true,
-  "reviewersAssignedForLabels": {},
-  "nextAction": "Author",
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "liferoad",
+"website": "liferoad"
+  },
+  "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
   "committerAssigned": false



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 9cf0820720d Updating config from bot
9cf0820720d is described below

commit 9cf0820720d65980fed69fd990a131f2a9ddbcec
Author: github-actions 
AuthorDate: Wed Feb 7 22:05:46 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-website.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-website.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-website.json
index d8992b47472..16487c84c72 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-website.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-website.json
@@ -4,7 +4,7 @@
 "rszper": 1707152752864,
 "melap": 1707210338935,
 "damccorm": 1707253545877,
-"liferoad": 1706735149793,
+"liferoad": 1707343542374,
 "kennknowles": 1706897164657
   }
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 493df56e0f6 Updating config from bot
493df56e0f6 is described below

commit 493df56e0f6f068600ef5c8ac4fa81c24259e62f
Author: github-actions 
AuthorDate: Wed Feb 7 22:05:44 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index 78ed21364dd..6ac533f2bee 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -11,6 +11,6 @@
 "damccorm": 1706876018447,
 "jrmccluskey": 1706915144832,
 "riteshghorse": 1707135221120,
-"liferoad": 1706812494692
+"liferoad": 1707343542374
   }
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new d719458148f Updating config from bot
d719458148f is described below

commit d719458148f432a69ad8a07a8d46792790cb2e5f
Author: github-actions 
AuthorDate: Wed Feb 7 22:05:36 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
index 52d02961275..413961da6b2 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
@@ -8,7 +8,7 @@
 "apilloud": 1678822446183,
 "Abacn": 1706703224505,
 "bvolpato": 1706738733802,
-"m-trieu": 1706573922958,
+"m-trieu": 1707343533957,
 "damondouglas": 1707308019524
   }
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 002eccaa370 Updating config from bot
002eccaa370 is described below

commit 002eccaa370dad6db0cd6678440ff8355511d47a
Author: github-actions 
AuthorDate: Wed Feb 7 22:05:38 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
index 5a9fd4161f6..cc8489f7609 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
@@ -5,7 +5,7 @@
 "johnjcasey": 1706997928741,
 "pabloem": 1691787951165,
 "Abacn": 1706812494692,
-"ahmedabu98": 1706703225114,
+"ahmedabu98": 1707343533957,
 "bvolpato": 1707233990808,
 "manavgarg": 1690826779210,
 "damondouglas": 170723738



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new c95792f97ff Updating config from bot
c95792f97ff is described below

commit c95792f97ff1b969de92556fd1e73ee30759e104
Author: github-actions 
AuthorDate: Wed Feb 7 22:05:35 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30253.json | 11 +++
 1 file changed, 11 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30253.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30253.json
new file mode 100644
index 000..62b89857e47
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30253.json
@@ -0,0 +1,11 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"java": "m-trieu",
+"io": "ahmedabu98"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch master updated: Fix Jms drop record (#30218)

2024-02-07 Thread yhu
This is an automated email from the ASF dual-hosted git repository.

yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new c72a9f83fed Fix Jms drop record (#30218)
c72a9f83fed is described below

commit c72a9f83fedb5d558a138ff01199a5fc16f605db
Author: Yi Hu 
AuthorDate: Wed Feb 7 16:32:21 2024 -0500

Fix Jms drop record (#30218)

* Fix JmsIO read drop message

* Close consumer before finalizing

* Close last consumer and session on finalizeCheckpoint

* Acknowlege single message in a session

* Remove unnecessary write lock in JmsCheckpointMakr (it's immutable)

* Add unit test

* Add message when test fail

* remove test leftover

* address comments

* enable integration test on amqp
---
 .../apache/beam/sdk/io/jms/JmsCheckpointMark.java  | 201 ++---
 .../java/org/apache/beam/sdk/io/jms/JmsIO.java |  84 ++---
 .../java/org/apache/beam/sdk/io/jms/JmsIOIT.java   |  45 -
 .../java/org/apache/beam/sdk/io/jms/JmsIOTest.java | 109 +++
 4 files changed, 301 insertions(+), 138 deletions(-)

diff --git 
a/sdks/java/io/jms/src/main/java/org/apache/beam/sdk/io/jms/JmsCheckpointMark.java
 
b/sdks/java/io/jms/src/main/java/org/apache/beam/sdk/io/jms/JmsCheckpointMark.java
index f9f382dc3cd..e213561917d 100644
--- 
a/sdks/java/io/jms/src/main/java/org/apache/beam/sdk/io/jms/JmsCheckpointMark.java
+++ 
b/sdks/java/io/jms/src/main/java/org/apache/beam/sdk/io/jms/JmsCheckpointMark.java
@@ -19,11 +19,12 @@ package org.apache.beam.sdk.io.jms;
 
 import java.io.IOException;
 import java.io.Serializable;
-import java.util.ArrayList;
-import java.util.List;
 import java.util.Objects;
 import java.util.concurrent.locks.ReentrantReadWriteLock;
+import javax.jms.JMSException;
 import javax.jms.Message;
+import javax.jms.MessageConsumer;
+import javax.jms.Session;
 import org.apache.beam.sdk.io.UnboundedSource;
 import 
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.annotations.VisibleForTesting;
 import org.checkerframework.checker.nullness.qual.Nullable;
@@ -39,78 +40,58 @@ class JmsCheckpointMark implements 
UnboundedSource.CheckpointMark, Serializable
 
   private static final Logger LOG = 
LoggerFactory.getLogger(JmsCheckpointMark.class);
 
-  private Instant oldestMessageTimestamp = Instant.now();
-  private transient List messages = new ArrayList<>();
+  private Instant oldestMessageTimestamp;
+  private transient @Nullable Message lastMessage;
+  private transient @Nullable MessageConsumer consumer;
+  private transient @Nullable Session session;
 
-  @VisibleForTesting transient boolean discarded = false;
-
-  @VisibleForTesting final ReentrantReadWriteLock lock = new 
ReentrantReadWriteLock();
-
-  JmsCheckpointMark() {}
+  private JmsCheckpointMark(
+  Instant oldestMessageTimestamp,
+  @Nullable Message lastMessage,
+  @Nullable MessageConsumer consumer,
+  @Nullable Session session) {
+this.oldestMessageTimestamp = oldestMessageTimestamp;
+this.lastMessage = lastMessage;
+this.consumer = consumer;
+this.session = session;
+  }
 
-  void add(Message message) throws Exception {
-lock.writeLock().lock();
+  /** Acknowledge all outstanding message. */
+  @Override
+  public void finalizeCheckpoint() {
 try {
-  if (discarded) {
-throw new IllegalStateException(
-String.format(
-"Attempting to add message %s to checkpoint that is 
discarded.", message));
-  }
-  Instant currentMessageTimestamp = new Instant(message.getJMSTimestamp());
-  if (currentMessageTimestamp.isBefore(oldestMessageTimestamp)) {
-oldestMessageTimestamp = currentMessageTimestamp;
+  // Jms spec will implicitly acknowledge _all_ messaged already received 
by the same
+  // session if one message in this session is being acknowledged.
+  if (lastMessage != null) {
+lastMessage.acknowledge();
   }
-  messages.add(message);
-} finally {
-  lock.writeLock().unlock();
+} catch (JMSException e) {
+  // The effect of this is message not get acknowledged and thus will be 
redelivered. It is
+  // not fatal, so we just raise error log. Similar below.
+  LOG.error(
+  "Failed to acknowledge the message. Will redeliver and might cause 
duplication.", e);
 }
-  }
 
-  Instant getOldestMessageTimestamp() {
-lock.readLock().lock();
-try {
-  return this.oldestMessageTimestamp;
-} finally {
-  lock.readLock().unlock();
+// session is closed after message acknowledged otherwise other consumer 
may receive duplicate
+// messages.
+if (consumer != null) {
+  try {
+consumer.close();
+consumer = null;
+  } catch (JMSException e) {
+LOG.info("Error closing JMS consumer. It may have already been 
clo

(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 0d1d90408a9 Updating config from bot
0d1d90408a9 is described below

commit 0d1d90408a9e2127d09f74b3fde5fae66dc7fb9f
Author: github-actions 
AuthorDate: Wed Feb 7 21:05:36 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30218.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30218.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30218.json
index 550d0543a2c..4d0ec74b26d 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30218.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30218.json
@@ -7,5 +7,5 @@
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
-  "committerAssigned": false
+  "committerAssigned": true
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 058dfacce56 Updating config from bot
058dfacce56 is described below

commit 058dfacce560ee98ba8b4838deebd8a5632600d5
Author: github-actions 
AuthorDate: Wed Feb 7 20:59:10 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30202.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30202.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30202.json
index 959c289c017..30d25f1f3dd 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30202.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30202.json
@@ -4,7 +4,7 @@
 "python": "jrmccluskey"
   },
   "nextAction": "Reviewers",
-  "stopReviewerNotifications": false,
+  "stopReviewerNotifications": true,
   "remindAfterTestsPass": [],
   "committerAssigned": false
 }
\ No newline at end of file



(beam) branch hf_inference_api_ deleted (was 94b5668f535)

2024-02-07 Thread anandinguva
This is an automated email from the ASF dual-hosted git repository.

anandinguva pushed a change to branch hf_inference_api_
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 94b5668f535 Fix pydocs

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch master updated (4f3963f7878 -> 2c5d153bf29)

2024-02-07 Thread anandinguva
This is an automated email from the ASF dual-hosted git repository.

anandinguva pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 4f3963f7878 Bump google.golang.org/grpc from 1.60.1 to 1.61.0 in /sdks 
(#30249)
 add 2c5d153bf29 Add InferenceAPIEmbeddings to huggingface (#30138)

No new revisions were added by this update.

Summary of changes:
 .../workflows/beam_PreCommit_Python_Coverage.yml   |   2 +
 .../ml/transforms/embeddings/huggingface.py| 126 -
 .../ml/transforms/embeddings/huggingface_test.py   |  51 +
 sdks/python/test-suites/tox/common.gradle  |   4 +-
 sdks/python/tox.ini|   1 +
 5 files changed, 178 insertions(+), 6 deletions(-)



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 28cf4401977 Updating config from bot
28cf4401977 is described below

commit 28cf4401977555ec1adddf6df1a604145031d289
Author: github-actions 
AuthorDate: Wed Feb 7 20:34:57 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30011.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30011.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30011.json
index aa3638a74ec..1e9dcd816d5 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30011.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30011.json
@@ -6,5 +6,5 @@
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
-  "committerAssigned": false
+  "committerAssigned": true
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 8568323212e Updating config from bot
8568323212e is described below

commit 8568323212e10a41476c3d5c7076283df31984da
Author: github-actions 
AuthorDate: Wed Feb 7 20:06:07 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30252.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30252.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30252.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30252.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 0404291c7ec Updating config from bot
0404291c7ec is described below

commit 0404291c7ec5bf6bd58b8a9d302296bd943c9e4e
Author: github-actions 
AuthorDate: Wed Feb 7 19:34:44 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30011.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30011.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30011.json
new file mode 100644
index 000..aa3638a74ec
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30011.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"go": "riteshghorse"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new bbbf82975c2 Updating config from bot
bbbf82975c2 is described below

commit bbbf82975c27fc9555aa7aed079b1a63c8eef9a8
Author: github-actions 
AuthorDate: Wed Feb 7 19:34:46 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index 1e7f77dc59a..275de8b85b0 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -5,6 +5,6 @@
 "jrmccluskey": 1707282348860,
 "youngoli": 1657688896155,
 "damccorm": 1680501930289,
-"riteshghorse": 1707282341774
+"riteshghorse": 1707334482938
   }
 }
\ No newline at end of file



svn commit: r67234 - /release/beam/KEYS

2024-02-07 Thread tvalentyn
Author: tvalentyn
Date: Wed Feb  7 19:19:09 2024
New Revision: 67234

Log:
Adds Samuel Whittle's public key

Modified:
release/beam/KEYS

Modified: release/beam/KEYS
==
--- release/beam/KEYS (original)
+++ release/beam/KEYS Wed Feb  7 19:19:09 2024
@@ -1264,7 +1264,7 @@ uid   [ultimate] Mark Liu (GPG k
 sub   rsa4096 2019-09-10 [E]
 
 -BEGIN PGP PUBLIC KEY BLOCK-
- 
+
 mQINBF14IZ0BEADTYB26xLbK8SVRX8ObawprHKUaT6Obo6HIRysM3CDqTUSlIHc7
 yx5hByDRKbpD2Y/4LHQAusPRERrg1bsPfRKiTj0QGo9Wllk5b5bT/DqgqtYFCjvb
 ZaOb8krtKunPedCZqk6Zfrl2VjZoQI/Rm0mYRM8q97JLclTT3EVbmz+AAAi+veLA
@@ -1465,9 +1465,9 @@ uid   [ultimate] Boyuan Zhang (r
 sig 399DF385DA877C596 2020-01-17  Boyuan Zhang (release) 

 sub   rsa4096 2020-01-17 [E]
 sig  99DF385DA877C596 2020-01-17  Boyuan Zhang (release) 

- 
+
 -BEGIN PGP PUBLIC KEY BLOCK-
- 
+
 mQINBF4hB7YBEADPd4S4IFFlBbWQUlLSwA8v//4q/XUXq0Z9LeAqnyyDVqP4uk5p
 W3sepB5VlT2/iZI4DGTXKUoQgZXAJM68G6E92acXEIKg1GEwuPvFLmnfeZ0VqqQ6
 kVNFWEiC7Z/iLD7mXSjTfVGbBDMqziHQLp/MF5VpmS59J4g/8UuuvDi4VxxESI8e
@@ -1807,9 +1807,9 @@ uid   [ultimate] Brian Hulette <
 sig 3449B6A3D558D20B0 2020-05-14  Brian Hulette 
 sub   rsa4096 2020-05-14 [E] [expires: 2022-05-14]
 sig  449B6A3D558D20B0 2020-05-14  Brian Hulette 
- 
+
 -BEGIN PGP PUBLIC KEY BLOCK-
- 
+
 mQINBF69powBEAC0nu+81iqp9UxxeGC4PfyGyhxyuAtp7OYVYPR+GkHj7IuFtMNV
 ztlzJqhOYZEs6GVlNHKNRrdCZG8EBNI9hmJMH+CA0R75JEhPp8qhNx9uQPjVLnGT
 80ZLpGeFYWv8AO73c+pOiAbEQrHoyADItQ+IHrCoQFfsQL5LsCvvESUoJ0HyLuqj
@@ -3652,3 +3652,62 @@ RrHIslA3VYLBsQHf8TOvTiaQvqdqUa6g2wFlL6iV
 dU847f1+6L6J9W2ZEHerGlJCSkeQFrhhmKRqGmHUcCxNkkKybjFLdixo
 =W5+j
 -END PGP PUBLIC KEY BLOCK-
+pub   rsa4096 2024-02-07 [SC]
+  9270827991C2F643A074C290FCFD152811BF1578
+uid   [ultimate] Samuel Carl Whittle (CODE SIGNING KEY) 

+sig 3FCFD152811BF1578 2024-02-07  Samuel Carl Whittle (CODE SIGNING 
KEY) 
+sub   rsa4096 2024-02-07 [E]
+sig  FCFD152811BF1578 2024-02-07  Samuel Carl Whittle (CODE SIGNING 
KEY) 
+
+-BEGIN PGP PUBLIC KEY BLOCK-
+
+mQINBGXDRpEBEADMrqBmoQpOldarLYbLANpnI/pekme6lKKkz0kjfXCsxnehQnlh
+zPCzmJDGf+jqXDFZHcoRKNjGPZ3ImzFo4xA3/FPudg3Fr20RFsb8XSgp4pSEamcG
+ghUI8ueQUmzXohs9Mb19XJPhNJSaRsADqDqETBbACovo+Xgz7Y931rc15y34bmoz
++vYULi0mm3gt3VKJ09p7XNEivbRGst3Rgp0GyATJVAb5nSc8VVMgKzujVSZWZf/T
++dPrXDerRniqUPe3GbCg/Oav2aqAL5+V/7bmskrNrgokm8Qiwd8yqWMX4TqRj/vo
+79Hmcsfe+w1rYBnoghOjNZUryv4Qaekb1RA9pfYLik0RfnPDhPwDvqo27hJSRFTN
+QfDi3GgUoxTyzUEK2s2guxdukZlKXCcAq21Wx2nsM03ziiEdt1BgGA48d/Dm8plh
+ddPUfekcSG5aTjqeLV0GyUcVQikmyrkTz2DHYEaIg+RnVFOrzsU82xTbgYb41abm
+ZyFS28aWMs+OJtrbbZw9pEGtULgH8hmHoRfDxPQqb+40Pz+rDRDNTp9GN5m2+/VI
+WubIBMjALiDe2cA8fhH55O2jru7ek3Orv57GkbFOdOsP3iLTWPCC62SRueA2UNPs
+Q5oOTlbXQN/O4oB0eE0LRC+8Cn7XXAoRtVB2q/V3GN+k15UjLUYaSccyCwARAQAB
+tD1TYW11ZWwgQ2FybCBXaGl0dGxlIChDT0RFIFNJR05JTkcgS0VZKSA8c2N3aGl0
+dGxlQGFwYWNoZS5vcmc+iQJOBBMBCgA4FiEEknCCeZHC9kOgdMKQ/P0VKBG/FXgF
+AmXDRpECGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQ/P0VKBG/FXh9TBAA
+mhmxNMUdK2csonydMVxFCYgvZvzB6/AMFDAClRFmwiCvA9YjqHLy84pYBnD87X3k
+PpaiOFr1QDTp6c2XD73+uhe07JNmFp6pZG082x41kCd935s5KvB4RvBwXlZBCuY+
+3X4+3cAv8cRZOOxr7mhA2MROcjk/poL7VcwZ0lIP9beoD8iJlK0TYXtlP1wtndQT
+WkfIS+GwNuCeR8We3nCcMtidr7rszXc9LqlsEeI3ynFbKqoJSJipIx1+qAISvfbe
+iWRDPK6sDrfapC6c+3qnGisNRpMrn7YJbtQayzzXAWhn3AKhTS0fktaJsf1NcbSw
+/iNqOaVsTFU7tJvbKwRto+kb6aO+E3mWG4Jnwz8Qq2AWsUmHTn47bluN/xJutKcj
+Rx2FB0oh7pMj4AbdBRnH85jtxP6pFvrffRmW+FskiueewScL1UQn4csaJJCFZpeP
+FL8RJUW9x5aKFMc7stLPDrJAWlQeCrQHB2iLUEzvxLpR8vqEa8yvesYGYUbS8Uxk
+M7GF8t7rKtw51Fg1aoqy6V59147WAxN7dqorjJl3PqSNfdJvvdStYjLSY2IWrZNs
+UdsgByhmKYzo9cMw9GvMxltbW4zA1Z4LDZr7uDe4tvTHOUfECMNxCP+mlwR6G/Ot
+IIqLTXP/PaYY+R11w2JO2O3y642ViPNGPa3pwDHskX+5Ag0EZcNGkQEQAKsrjcr/
+W+sCD/hI1nkqY5VoISBDrE6XF22PT+DCnAWYrfpdh1uS8+Jv6UKqDSqHjG8Ttnud
+YdPiwLcH+dRgDBkNWrWG2M+KZ9vnE+pgygXEMXvm3hvpDdPv9utxc26YRPB6brwQ
+I0lZZBO6km8CN/8jKdhE3jFiJxcgHLhfO3/1woKqQWlGK2Q2IWi6RxAIaxFOpvog
+NQ+64i5+xYHo/zziZ234WInNaxA4wA5chX/AX0ZAUX440ZEjACCwy5wJyN4T0tnr
+who4JdYbQP74oDxiIwCNZ4If6CnV6uAp9bbG4Y5elD7dycjlXwuaucMJsNyB4f2a
+zNeyy7gi1PRlEEL8MJpO6VoEV0qQKu8gUJOwSYIi3C6c7Ci80ugMDc5vsW0PnVRf
+T6PMaQcRtbVpJxeVlguiv8AMbbwVFuZ9SCKwYBfY5EosXVpgm2Mp7mrh6wX78ldb
+WlY2+hYz+6fSa99GzkE4ABy6sSnbEY24SxnfMqzpHY87Wkv7IPB8eJed7z5LfjJ7
+Oghuw9uew3cdtF752lJg7zA31HRNdu/7KKiUnGKYLOEZCsm+8jqIeBWIwOIJjm9n
+DTMArLsZMMJ5VjSq3WYPyap/NyeDsHB+sXhhunbKzeq0pLvLjIjNporIdIfNCaXe
+sePUjqJyJHDvsjx8qRJ04ra5WSNnAaafVlJRABEBAAGJAjYEGAEKACAWIQSScIJ5
+kcL2Q6B0wpD8/RUoEb8VeAUCZcNGkQIbDAAKCRD8/RUoEb8VeKVqD/0aDsRV/mB4
+UXr6h7ES5RUVK4uIduMSVP/yVCdHCyO0M7wj2UtIl1vdzSeh5Q1oIYO7lJ59yMo0
+x0MU9xpuZ1L3dZ5CMkaq627q1B1czEyvrdjWc9260oFg8XT4/Pwn0hqBV8JQZ+tU
+E6m4qdk3bB+2ji0bRxhZTNFnQG3KbAEfHrzq3sotRvQkAecP3vlnxSljoEalABVd
+E5QVXfI6kOhFW7YxXK/aqbFSGTOSMJXDSo3OZHML45ikxY28Asxcj4ZFTX/jyDP8
+/b9MDYeRa05tThWbUXp2tGenPVl6U2sw8Vs5HLhRMdeMG1lkKarjYB62hvcNQJRu
+6bKBipY31mmfSKeF/O+C82DsG7JoR4owngNTEeMe0OCWPhFuz+dSzuGEy4

(beam) branch ml_transform_criteo updated (e031888c818 -> 73e46997494)

2024-02-07 Thread anandinguva
This is an automated email from the ASF dual-hosted git repository.

anandinguva pushed a change to branch ml_transform_criteo
in repository https://gitbox.apache.org/repos/asf/beam.git


from e031888c818 Merge remote-tracking branch 'origin/master' into 
ml_transform_criteo
 add 73e46997494 Refactor code

No new revisions were added by this update.

Summary of changes:
 .../testing/benchmarks/mltransform/criteo.py   | 36 --
 1 file changed, 26 insertions(+), 10 deletions(-)



(beam) branch ml_transform_criteo updated (ea3faa479c5 -> e031888c818)

2024-02-07 Thread anandinguva
This is an automated email from the ASF dual-hosted git repository.

anandinguva pushed a change to branch ml_transform_criteo
in repository https://gitbox.apache.org/repos/asf/beam.git


from ea3faa479c5 Refactor pipeline
 add b2073c6c986 Fix typo in notebook (#29728)
 add c8deda71743 Upgrade go version to resolve vulnerabilities (#29743)
 add 5d42cb654c0 revert kafka host change (#29725)
 add 86720287c21 Deep-copy the process bundle descriptor when creating a 
new bundle processor. (#29742)
 add 06c3340e338 Add logs to confirm JvmInitializer completed running and 
Spanner successfully connected. (#29727)
 add 8f90fdd62d3 Upgrade Debian Bullseye to Bookworm (#29721)
 add 951b3b1a81b Per DoFn latency instrumentation (#29592)
 add fa47640888c Remove comment body from action (#29750)
 add ad2d8dc6e30 Update Bigtable python client version (#29753)
 add e37fa77c3b6 Pass getPort method through JDBC Resource Managers (#29732)
 add 8d41b62e828 Moving to 2.54.0-SNAPSHOT on master branch.
 add c49e9ec7dc7 test revert _beam_schema_proto (#29754)
 add db0bb446aa0 Add outputWindowedValue capability to Java SDK
 add ef0ee769e8f Merge pull request #29616: Add outputWindowedValue 
capability to Java SDK
 add 19858e990ad [#29760] Only respond to sampling request while data 
sampling is enabled (#29761)
 add a04a4ad4cd2 [yaml] Normalize drop on MapToFields
 add c124e473fa4 Merge pull request #29755 from Polber/jkinard/mapping-drop
 add a9f5ab14d06 Add support to use side inputs with 
Combine.PerKeyWithHotKeyFanout (#28867)
 add def026bfe11 Bump google.golang.org/api from 0.153.0 to 0.154.0 in 
/sdks (#29734)
 add 921e40a12f4 Dynamic SchemaTransform wrapper provider (#29561)
 add 4264c2c3e25 Fixes breakages of the upgrade feature (#29731)
 add 75746c6fe4a Bump cloud.google.com/go/storage from 1.35.1 to 1.36.0 in 
/sdks (#29767)
 add 00462b13cc1 Bump google.golang.org/grpc from 1.59.0 to 1.60.0 in /sdks 
(#29714)
 add 1ce707c3865 Add user-agent string for Beam in the GCS request header. 
(#29765)
 add bc42a637d56 [#28543][prism] Implement State API (#29712)
 add 9e8a310f0c0 Bump Precommit Java Examples Timeouts (#29771)
 add c4c9bb82723 Add 2.54.0 release section to CHANGES.md (#29757)
 add 543b013a548 Bump com.gradle.enterprise from 3.15.1 to 3.16 (#29740)
 add a81c9e8e38b Bump actions/setup-python from 4 to 5 (#29654)
 add 970a0bd9a92 Bump actions/stale from 8 to 9 (#29682)
 add d297cd531ee Bump org.javacc.javacc from 3.0.0 to 3.0.2 (#29739)
 add 1c7d178dd2b Bump github.com/google/uuid from 1.4.0 to 1.5.0 in /sdks 
(#29733)
 add 52f4fc0c378 [Go SDK] Decrease sampling frequency for streaming jobs to 
avoid oversampling (#29774)
 add 3bace64d16a Ignore 
testOnNewWorkerMetadata_correctlyRemovesStaleWindmillServers (#29744)
 add 5fb4db31994 Bump actions/upload-artifact from 3 to 4 (#29777)
 add 860bc30a110 Add SparkStructuredStreamingRunner to 
beam_PostCommit_Java_Tpcds_Spark workflow
 add e1ce548cea7 Merge pull request #29781: Add 
SparkStructuredStreamingRunner to beam_PostCommit_Java_Tpcds_Spark workflow
 add 539f04233c6 add alts to grpc vendored lib (#29763)
 add 1033b71aff6 pin dind image temoporarily due to issues 
https://github.com/actions/actions-runner-controller/issues/3159 (#29796)
 add fb8ae575eeb getProcessingTimesByStep returns a modifiable map (#29786)
 add 7db8c274dd5 make DataSample external (#29788)
 add f02bf88fd15 Upgrade download-artifact to v4 (#29801)
 add c3d130c8ebf Update python base image dependencies (#29800)
 add add34385719 Fix GenerateSequenceSchemaTransformProvider formatting 
(#29798)
 add 4cfe5498850 Fix nil pointer access in logRuntimeDependencies (#29804)
 add 2e38af69cf2 Adds Kafka upgrade module to the I/O precommit (#29773)
 add 87794aaef03 Update dataflow container tag (#29790)
 add 2baea8b65eb Bump golang.org/x/crypto from 0.14.0 to 0.17.0 in 
/.test-infra/mock-apis (#29809)
 add d6426c4fdfc Bump google.golang.org/grpc from 1.60.0 to 1.60.1 in /sdks 
(#29814)
 add 60f04081240 Update changes.md with known fixes. (#29817)
 add 54d2c2df5cf Bump golang.org/x/crypto from 0.16.0 to 0.17.0 in /sdks 
(#29810)
 add f841098c54d Support DatabaseID in Datastore beam connector (#29815)
 add 1a7174c68bd Build and publish multi-arch wheels separately from main 
wheels (#29821)
 add b9a62f0f793 [YAML] Properly deligate methods for renaming provider.
 add 56d177713ed Merge pull request #29827 [YAML] Properly deligate methods 
for renaming provider.
 add c5d53d61e78 Revert to non-schema-based Sql transform.
 add 0bbf2c3351b Merge pull request #29826 Revert to non-schema-based Sql 
transform.
 add 1986517d38a Enable User State tests for Prism (#29822)
 add 91aeba43273 Remove failing multimap key iteration tests.
 add fa11c0f29d1 Merge pull request #29836 Remove fa

(beam) branch hf_inference_api_ updated (1d1b9575d9d -> 94b5668f535)

2024-02-07 Thread anandinguva
This is an automated email from the ASF dual-hosted git repository.

anandinguva pushed a change to branch hf_inference_api_
in repository https://gitbox.apache.org/repos/asf/beam.git


from 1d1b9575d9d Remove space
 add 94b5668f535 Fix pydocs

No new revisions were added by this update.

Summary of changes:
 .../ml/transforms/embeddings/huggingface.py| 28 +-
 1 file changed, 17 insertions(+), 11 deletions(-)



(beam) branch fix-path updated (265c0556375 -> 13016581164)

2024-02-07 Thread anandinguva
This is an automated email from the ASF dual-hosted git repository.

anandinguva pushed a change to branch fix-path
in repository https://gitbox.apache.org/repos/asf/beam.git


from 265c0556375 Pass vocab filename param
 add 13016581164 Fix path

No new revisions were added by this update.

Summary of changes:
 sdks/python/apache_beam/examples/ml_transform/ml_transform_it_test.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)



(beam) branch dependabot/go_modules/sdks/google.golang.org/grpc-1.61.0 deleted (was 00e545f1549)

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/google.golang.org/grpc-1.61.0
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 00e545f1549 Bump google.golang.org/grpc from 1.60.1 to 1.61.0 in /sdks

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



(beam) branch master updated: Bump google.golang.org/grpc from 1.60.1 to 1.61.0 in /sdks (#30249)

2024-02-07 Thread riteshghorse
This is an automated email from the ASF dual-hosted git repository.

riteshghorse pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 4f3963f7878 Bump google.golang.org/grpc from 1.60.1 to 1.61.0 in /sdks 
(#30249)
4f3963f7878 is described below

commit 4f3963f7878534172b2ea094f069745f92f0b307
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
AuthorDate: Wed Feb 7 13:07:28 2024 -0500

Bump google.golang.org/grpc from 1.60.1 to 1.61.0 in /sdks (#30249)

Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.60.1 
to 1.61.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.60.1...v1.61.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] 
Co-authored-by: dependabot[bot] 
<49699333+dependabot[bot]@users.noreply.github.com>
---
 sdks/go.mod | 4 ++--
 sdks/go.sum | 8 
 2 files changed, 6 insertions(+), 6 deletions(-)

diff --git a/sdks/go.mod b/sdks/go.mod
index 71b3f5a3c99..8683c181a99 100644
--- a/sdks/go.mod
+++ b/sdks/go.mod
@@ -61,7 +61,7 @@ require (
golang.org/x/text v0.14.0
google.golang.org/api v0.157.0
google.golang.org/genproto v0.0.0-20240116215550-a9fa1716bcac
-   google.golang.org/grpc v1.60.1
+   google.golang.org/grpc v1.61.0
google.golang.org/protobuf v1.32.0
gopkg.in/retry.v1 v1.0.3
gopkg.in/yaml.v2 v2.4.0
@@ -138,7 +138,7 @@ require (
github.com/census-instrumentation/opencensus-proto v0.4.1 // indirect
github.com/cespare/xxhash/v2 v2.2.0 // indirect
github.com/cncf/udpa/go v0.0.0-20220112060539-c52dc94e7fbe // indirect
-   github.com/cncf/xds/go v0.0.0-20230607035331-e9ce68804cb4 // indirect
+   github.com/cncf/xds/go v0.0.0-20231109132714-523115ebc101 // indirect
github.com/containerd/containerd v1.7.11 // indirect
github.com/cpuguy83/dockercfg v0.3.1 // indirect
github.com/docker/distribution v2.8.2+incompatible // indirect
diff --git a/sdks/go.sum b/sdks/go.sum
index eefb376c6dd..acb53d86716 100644
--- a/sdks/go.sum
+++ b/sdks/go.sum
@@ -146,8 +146,8 @@ github.com/cncf/udpa/go 
v0.0.0-20191209042840-269d4d468f6f/go.mod h1:M8M6+tZqaGX
 github.com/cncf/udpa/go v0.0.0-20220112060539-c52dc94e7fbe 
h1:QQ3GSy+MqSHxm/d8nCtnAiZdYFd45cYZPs8vOOIYKfk=
 github.com/cncf/udpa/go v0.0.0-20220112060539-c52dc94e7fbe/go.mod 
h1:6pvJx4me5XPnfI9Z40ddWsdw2W/uZgQLFXToKeRcDiI=
 github.com/cncf/xds/go v0.0.0-20210922020428-25de7278fc84/go.mod 
h1:eXthEFrGJvWHgFFCl3hGmgk+/aYT6PnTQLykKQRLhEs=
-github.com/cncf/xds/go v0.0.0-20230607035331-e9ce68804cb4 
h1:/inchEIKaYC1Akx+H+gqO04wryn5h75LSazbRlnya1k=
-github.com/cncf/xds/go v0.0.0-20230607035331-e9ce68804cb4/go.mod 
h1:eXthEFrGJvWHgFFCl3hGmgk+/aYT6PnTQLykKQRLhEs=
+github.com/cncf/xds/go v0.0.0-20231109132714-523115ebc101 
h1:7To3pQ+pZo0i3dsWEbinPNFs5gPSBOsJtx3wTT94VBY=
+github.com/cncf/xds/go v0.0.0-20231109132714-523115ebc101/go.mod 
h1:eXthEFrGJvWHgFFCl3hGmgk+/aYT6PnTQLykKQRLhEs=
 github.com/colinmarc/hdfs/v2 v2.1.1/go.mod 
h1:M3x+k8UKKmxtFu++uAZ0OtDU8jR3jnaZIAc6yK4Ue0c=
 github.com/containerd/containerd v1.7.11 
h1:lfGKw3eU35sjV0aG2eYZTiwFEY1pCzxdzicHP3SZILw=
 github.com/containerd/containerd v1.7.11/go.mod 
h1:5UluHxHTX2rdvYuZ5OJTC5m/KJNs0Zs9wVoJm9zf5ZE=
@@ -725,8 +725,8 @@ google.golang.org/grpc v1.26.0/go.mod 
h1:qbnxyOmOxrQa7FizSgH+ReBfzJrCY1pSN7KXBS8
 google.golang.org/grpc v1.27.0/go.mod 
h1:qbnxyOmOxrQa7FizSgH+ReBfzJrCY1pSN7KXBS8abTk=
 google.golang.org/grpc v1.27.1/go.mod 
h1:qbnxyOmOxrQa7FizSgH+ReBfzJrCY1pSN7KXBS8abTk=
 google.golang.org/grpc v1.33.2/go.mod 
h1:JMHMWHQWaTccqQQlmk3MJZS+GWXOdAesneDmEnv2fbc=
-google.golang.org/grpc v1.60.1 h1:26+wFr+cNqSGFcOXcabYC0lUVJVRa2Sb2ortSK7VrEU=
-google.golang.org/grpc v1.60.1/go.mod 
h1:OlCHIeLYqSSsLi6i49B5QGdzaMZK9+M7LXN2FKz4eGM=
+google.golang.org/grpc v1.61.0 h1:TOvOcuXn30kRao+gfcvsebNEa5iZIiLkisYEkf7R7o0=
+google.golang.org/grpc v1.61.0/go.mod 
h1:VUbo7IFqmF1QtCAstipjG0GIoq49KvMe9+h1jFLBNJs=
 google.golang.org/protobuf v0.0.0-20200109180630-ec00e32a8dfd/go.mod 
h1:DFci5gLYBciE7Vtevhsrf46CRTquxDuWsQurQQe4oz8=
 google.golang.org/protobuf v0.0.0-20200221191635-4d8936d0db64/go.mod 
h1:kwYJMbMJ01Woi6D6+Kah6886xMZcty6N08ah7+eCXa0=
 google.golang.org/protobuf v0.0.0-20200228230310-ab0ca4ff8a60/go.mod 
h1:cfTl7dwQJ+fmap5saPgwCLgHXTUD7jkjRqWcaiX5VyM=



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new ae7a9dbed71 Updating config from bot
ae7a9dbed71 is described below

commit ae7a9dbed713628ab69ed63f7b413bcbd3e6042c
Author: github-actions 
AuthorDate: Wed Feb 7 18:06:11 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30138.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30138.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30138.json
index ebd43b0e7f7..01bc1ec7b6b 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30138.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30138.json
@@ -7,5 +7,5 @@
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
-  "committerAssigned": false
+  "committerAssigned": true
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 64afb3cb739 Updating config from bot
64afb3cb739 is described below

commit 64afb3cb739bd4974c47c68dec54b1eca24eca78
Author: github-actions 
AuthorDate: Wed Feb 7 17:57:06 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30251.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30251.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30251.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30251.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch lostluck-patch-2 created (now 8615fee8d42)

2024-02-07 Thread lostluck
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a change to branch lostluck-patch-2
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 8615fee8d42 [lint] Doc comment exported ErrCancelled.

This branch includes the following new commits:

 new 8615fee8d42 [lint] Doc comment exported ErrCancelled.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.




(beam) 01/01: [lint] Doc comment exported ErrCancelled.

2024-02-07 Thread lostluck
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a commit to branch lostluck-patch-2
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 8615fee8d427fdd237dcd657d23401cbd02c31e6
Author: Robert Burke 
AuthorDate: Wed Feb 7 09:53:49 2024 -0800

[lint] Doc comment exported ErrCancelled.
---
 sdks/go/pkg/beam/runners/prism/internal/jobservices/management.go | 1 +
 1 file changed, 1 insertion(+)

diff --git a/sdks/go/pkg/beam/runners/prism/internal/jobservices/management.go 
b/sdks/go/pkg/beam/runners/prism/internal/jobservices/management.go
index 0da37ef0bd7..1c7e280dcdd 100644
--- a/sdks/go/pkg/beam/runners/prism/internal/jobservices/management.go
+++ b/sdks/go/pkg/beam/runners/prism/internal/jobservices/management.go
@@ -32,6 +32,7 @@ import (
 )
 
 var (
+   // ErrCancel represents a pipeline cancellation by the user.
ErrCancel = errors.New("pipeline canceled")
 )
 



(beam) 01/01: Merge pull request #30237: Adjust transform-service module names and deps with sdks/java/core

2024-02-07 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 13a70844abb349d0ae5c6d84097e5cf4d0e9cc21
Merge: 4645a76ee2a f250a843230
Author: Kenneth Knowles 
AuthorDate: Wed Feb 7 12:33:47 2024 -0500

Merge pull request #30237: Adjust transform-service module names and deps 
with sdks/java/core

 sdks/java/transform-service/app/build.gradle  | 2 +-
 sdks/java/transform-service/build.gradle  | 2 +-
 sdks/java/transform-service/launcher/build.gradle | 7 ++-
 3 files changed, 4 insertions(+), 7 deletions(-)



(beam) branch master updated (4645a76ee2a -> 13a70844abb)

2024-02-07 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 4645a76ee2a gcsio: reduce number of get requests in function calls 
(#30205)
 add f250a843230 Adjust transform-service module names and deps with 
sdks/java/core
 new 13a70844abb Merge pull request #30237: Adjust transform-service module 
names and deps with sdks/java/core

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/java/transform-service/app/build.gradle  | 2 +-
 sdks/java/transform-service/build.gradle  | 2 +-
 sdks/java/transform-service/launcher/build.gradle | 7 ++-
 3 files changed, 4 insertions(+), 7 deletions(-)



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 89fd2ef23bc Updating config from bot
89fd2ef23bc is described below

commit 89fd2ef23bc8b86ff58ea1df6bebea5ba9047458
Author: github-actions 
AuthorDate: Wed Feb 7 17:29:50 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30246.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30246.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30246.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30246.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 394a18746a5 Updating config from bot
394a18746a5 is described below

commit 394a18746a50afc85cfd6fc0709a4385a89fc85c
Author: github-actions 
AuthorDate: Wed Feb 7 17:28:53 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30245.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30245.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30245.json
index 242a48d7d3b..37f7ab41238 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30245.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30245.json
@@ -2,7 +2,7 @@
   "commentedAboutFailingChecks": true,
   "reviewersAssignedForLabels": {},
   "nextAction": "Author",
-  "stopReviewerNotifications": false,
+  "stopReviewerNotifications": true,
   "remindAfterTestsPass": [],
   "committerAssigned": false
 }
\ No newline at end of file



(beam) branch fix-path updated (db09a185ed4 -> 265c0556375)

2024-02-07 Thread anandinguva
This is an automated email from the ASF dual-hosted git repository.

anandinguva pushed a change to branch fix-path
in repository https://gitbox.apache.org/repos/asf/beam.git


from db09a185ed4 Remove defaults
 add 265c0556375 Pass vocab filename param

No new revisions were added by this update.

Summary of changes:
 sdks/python/apache_beam/examples/ml_transform/ml_transform_it_test.py | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)



(beam) branch master updated: gcsio: reduce number of get requests in function calls (#30205)

2024-02-07 Thread yhu
This is an automated email from the ASF dual-hosted git repository.

yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 4645a76ee2a gcsio: reduce number of get requests in function calls 
(#30205)
4645a76ee2a is described below

commit 4645a76ee2a4b04f93ddb91b5f0a94d6713021fc
Author: Shunping Huang 
AuthorDate: Wed Feb 7 10:06:58 2024 -0500

gcsio: reduce number of get requests in function calls (#30205)

* Reduce the number of get requests in gcsio.

* Apply formatter.

* Replace get_bucket with bucket in _gcs_object
---
 sdks/python/apache_beam/io/gcp/gcsio.py  | 51 +++--
 sdks/python/apache_beam/io/gcp/gcsio_test.py | 85 +---
 2 files changed, 86 insertions(+), 50 deletions(-)

diff --git a/sdks/python/apache_beam/io/gcp/gcsio.py 
b/sdks/python/apache_beam/io/gcp/gcsio.py
index a6ba82a6e07..b5a29142876 100644
--- a/sdks/python/apache_beam/io/gcp/gcsio.py
+++ b/sdks/python/apache_beam/io/gcp/gcsio.py
@@ -175,17 +175,14 @@ class GcsIO(object):
   ValueError: Invalid open file mode.
 """
 bucket_name, blob_name = parse_gcs_path(filename)
-bucket = self.client.get_bucket(bucket_name)
+bucket = self.client.bucket(bucket_name)
 
 if mode == 'r' or mode == 'rb':
-  blob = bucket.get_blob(blob_name)
+  blob = bucket.blob(blob_name)
   return BeamBlobReader(blob, chunk_size=read_buffer_size)
 elif mode == 'w' or mode == 'wb':
-  blob = bucket.get_blob(blob_name)
-  if not blob:
-blob = storage.Blob(blob_name, bucket)
+  blob = bucket.blob(blob_name)
   return BeamBlobWriter(blob, mime_type)
-
 else:
   raise ValueError('Invalid file open mode: %s.' % mode)
 
@@ -199,7 +196,7 @@ class GcsIO(object):
 """
 bucket_name, blob_name = parse_gcs_path(path)
 try:
-  bucket = self.client.get_bucket(bucket_name)
+  bucket = self.client.bucket(bucket_name)
   bucket.delete_blob(blob_name)
 except NotFound:
   return
@@ -228,16 +225,15 @@ class GcsIO(object):
   with current_batch:
 for path in current_paths:
   bucket_name, blob_name = parse_gcs_path(path)
-  bucket = self.client.get_bucket(bucket_name)
+  bucket = self.client.bucket(bucket_name)
   bucket.delete_blob(blob_name)
 
   for i, path in enumerate(current_paths):
 error_code = None
-for j in range(2):
-  resp = current_batch._responses[2 * i + j]
-  if resp.status_code >= 400 and resp.status_code != 404:
-error_code = resp.status_code
-break
+resp = current_batch._responses[i]
+if resp.status_code >= 400 and resp.status_code != 404:
+  error_code = resp.status_code
+  break
 final_results.append((path, error_code))
 
   s += MAX_BATCH_OPERATION_SIZE
@@ -258,11 +254,9 @@ class GcsIO(object):
 """
 src_bucket_name, src_blob_name = parse_gcs_path(src)
 dest_bucket_name, dest_blob_name= parse_gcs_path(dest, 
object_optional=True)
-src_bucket = self.get_bucket(src_bucket_name)
-src_blob = src_bucket.get_blob(src_blob_name)
-if not src_blob:
-  raise NotFound("Source %s not found", src)
-dest_bucket = self.get_bucket(dest_bucket_name)
+src_bucket = self.client.bucket(src_bucket_name)
+src_blob = src_bucket.blob(src_blob_name)
+dest_bucket = self.client.bucket(dest_bucket_name)
 if not dest_blob_name:
   dest_blob_name = None
 src_bucket.copy_blob(src_blob, dest_bucket, new_name=dest_blob_name)
@@ -291,19 +285,18 @@ class GcsIO(object):
 for pair in current_pairs:
   src_bucket_name, src_blob_name = parse_gcs_path(pair[0])
   dest_bucket_name, dest_blob_name = parse_gcs_path(pair[1])
-  src_bucket = self.client.get_bucket(src_bucket_name)
-  src_blob = src_bucket.get_blob(src_blob_name)
-  dest_bucket = self.client.get_bucket(dest_bucket_name)
+  src_bucket = self.client.bucket(src_bucket_name)
+  src_blob = src_bucket.blob(src_blob_name)
+  dest_bucket = self.client.bucket(dest_bucket_name)
 
   src_bucket.copy_blob(src_blob, dest_bucket, dest_blob_name)
 
   for i, pair in enumerate(current_pairs):
 error_code = None
-for j in range(4):
-  resp = current_batch._responses[4 * i + j]
-  if resp.status_code >= 400:
-error_code = resp.status_code
-break
+resp = current_batch._responses[i]
+if resp.status_code >= 400:
+  error_code = resp.status_code
+  break
 final_results.append((pair[0], pair[1], error_code))
 
   s += MAX_BATCH_OPERATION_SIZE
@@ -417,12 +410,12 @@ class GcsIO(object):
 """Returns a gcs object for the given path
 
 This method does not perform glob expansion. Hence the gi

(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 4c6d6b8941d Updating config from bot
4c6d6b8941d is described below

commit 4c6d6b8941d4adbbfec45d55338b874f69673fcb
Author: github-actions 
AuthorDate: Wed Feb 7 12:13:41 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
index 391b5deb75b..52d02961275 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
@@ -9,6 +9,6 @@
 "Abacn": 1706703224505,
 "bvolpato": 1706738733802,
 "m-trieu": 1706573922958,
-"damondouglas": 1706703218116
+"damondouglas": 1707308019524
   }
 }
\ No newline at end of file



(beam) branch pr-bot-state updated: Updating config from bot

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 45472b0bb0b Updating config from bot
45472b0bb0b is described below

commit 45472b0bb0b0e84778d6127f7e6655cd14882759
Author: github-actions 
AuthorDate: Wed Feb 7 12:13:40 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30115.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30115.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30115.json
index 91e45be7869..01e4be28079 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30115.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30115.json
@@ -1,7 +1,7 @@
 {
   "commentedAboutFailingChecks": true,
   "reviewersAssignedForLabels": {
-"java": "robertwb"
+"java": "damondouglas"
   },
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,



svn commit: r67230 - /dev/beam/KEYS

2024-02-07 Thread scwhittle
Author: scwhittle
Date: Wed Feb  7 09:30:52 2024
New Revision: 67230

Log:
Add key for scwhit...@apache.org

Modified:
dev/beam/KEYS

Modified: dev/beam/KEYS
==
--- dev/beam/KEYS (original)
+++ dev/beam/KEYS Wed Feb  7 09:30:52 2024
@@ -3769,3 +3769,62 @@ RrHIslA3VYLBsQHf8TOvTiaQvqdqUa6g2wFlL6iV
 dU847f1+6L6J9W2ZEHerGlJCSkeQFrhhmKRqGmHUcCxNkkKybjFLdixo
 =W5+j
 -END PGP PUBLIC KEY BLOCK-
+pub   rsa4096 2024-02-07 [SC]
+  9270827991C2F643A074C290FCFD152811BF1578
+uid   [ultimate] Samuel Carl Whittle (CODE SIGNING KEY) 

+sig 3FCFD152811BF1578 2024-02-07  Samuel Carl Whittle (CODE SIGNING 
KEY) 
+sub   rsa4096 2024-02-07 [E]
+sig  FCFD152811BF1578 2024-02-07  Samuel Carl Whittle (CODE SIGNING 
KEY) 
+
+-BEGIN PGP PUBLIC KEY BLOCK-
+
+mQINBGXDRpEBEADMrqBmoQpOldarLYbLANpnI/pekme6lKKkz0kjfXCsxnehQnlh
+zPCzmJDGf+jqXDFZHcoRKNjGPZ3ImzFo4xA3/FPudg3Fr20RFsb8XSgp4pSEamcG
+ghUI8ueQUmzXohs9Mb19XJPhNJSaRsADqDqETBbACovo+Xgz7Y931rc15y34bmoz
++vYULi0mm3gt3VKJ09p7XNEivbRGst3Rgp0GyATJVAb5nSc8VVMgKzujVSZWZf/T
++dPrXDerRniqUPe3GbCg/Oav2aqAL5+V/7bmskrNrgokm8Qiwd8yqWMX4TqRj/vo
+79Hmcsfe+w1rYBnoghOjNZUryv4Qaekb1RA9pfYLik0RfnPDhPwDvqo27hJSRFTN
+QfDi3GgUoxTyzUEK2s2guxdukZlKXCcAq21Wx2nsM03ziiEdt1BgGA48d/Dm8plh
+ddPUfekcSG5aTjqeLV0GyUcVQikmyrkTz2DHYEaIg+RnVFOrzsU82xTbgYb41abm
+ZyFS28aWMs+OJtrbbZw9pEGtULgH8hmHoRfDxPQqb+40Pz+rDRDNTp9GN5m2+/VI
+WubIBMjALiDe2cA8fhH55O2jru7ek3Orv57GkbFOdOsP3iLTWPCC62SRueA2UNPs
+Q5oOTlbXQN/O4oB0eE0LRC+8Cn7XXAoRtVB2q/V3GN+k15UjLUYaSccyCwARAQAB
+tD1TYW11ZWwgQ2FybCBXaGl0dGxlIChDT0RFIFNJR05JTkcgS0VZKSA8c2N3aGl0
+dGxlQGFwYWNoZS5vcmc+iQJOBBMBCgA4FiEEknCCeZHC9kOgdMKQ/P0VKBG/FXgF
+AmXDRpECGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQ/P0VKBG/FXh9TBAA
+mhmxNMUdK2csonydMVxFCYgvZvzB6/AMFDAClRFmwiCvA9YjqHLy84pYBnD87X3k
+PpaiOFr1QDTp6c2XD73+uhe07JNmFp6pZG082x41kCd935s5KvB4RvBwXlZBCuY+
+3X4+3cAv8cRZOOxr7mhA2MROcjk/poL7VcwZ0lIP9beoD8iJlK0TYXtlP1wtndQT
+WkfIS+GwNuCeR8We3nCcMtidr7rszXc9LqlsEeI3ynFbKqoJSJipIx1+qAISvfbe
+iWRDPK6sDrfapC6c+3qnGisNRpMrn7YJbtQayzzXAWhn3AKhTS0fktaJsf1NcbSw
+/iNqOaVsTFU7tJvbKwRto+kb6aO+E3mWG4Jnwz8Qq2AWsUmHTn47bluN/xJutKcj
+Rx2FB0oh7pMj4AbdBRnH85jtxP6pFvrffRmW+FskiueewScL1UQn4csaJJCFZpeP
+FL8RJUW9x5aKFMc7stLPDrJAWlQeCrQHB2iLUEzvxLpR8vqEa8yvesYGYUbS8Uxk
+M7GF8t7rKtw51Fg1aoqy6V59147WAxN7dqorjJl3PqSNfdJvvdStYjLSY2IWrZNs
+UdsgByhmKYzo9cMw9GvMxltbW4zA1Z4LDZr7uDe4tvTHOUfECMNxCP+mlwR6G/Ot
+IIqLTXP/PaYY+R11w2JO2O3y642ViPNGPa3pwDHskX+5Ag0EZcNGkQEQAKsrjcr/
+W+sCD/hI1nkqY5VoISBDrE6XF22PT+DCnAWYrfpdh1uS8+Jv6UKqDSqHjG8Ttnud
+YdPiwLcH+dRgDBkNWrWG2M+KZ9vnE+pgygXEMXvm3hvpDdPv9utxc26YRPB6brwQ
+I0lZZBO6km8CN/8jKdhE3jFiJxcgHLhfO3/1woKqQWlGK2Q2IWi6RxAIaxFOpvog
+NQ+64i5+xYHo/zziZ234WInNaxA4wA5chX/AX0ZAUX440ZEjACCwy5wJyN4T0tnr
+who4JdYbQP74oDxiIwCNZ4If6CnV6uAp9bbG4Y5elD7dycjlXwuaucMJsNyB4f2a
+zNeyy7gi1PRlEEL8MJpO6VoEV0qQKu8gUJOwSYIi3C6c7Ci80ugMDc5vsW0PnVRf
+T6PMaQcRtbVpJxeVlguiv8AMbbwVFuZ9SCKwYBfY5EosXVpgm2Mp7mrh6wX78ldb
+WlY2+hYz+6fSa99GzkE4ABy6sSnbEY24SxnfMqzpHY87Wkv7IPB8eJed7z5LfjJ7
+Oghuw9uew3cdtF752lJg7zA31HRNdu/7KKiUnGKYLOEZCsm+8jqIeBWIwOIJjm9n
+DTMArLsZMMJ5VjSq3WYPyap/NyeDsHB+sXhhunbKzeq0pLvLjIjNporIdIfNCaXe
+sePUjqJyJHDvsjx8qRJ04ra5WSNnAaafVlJRABEBAAGJAjYEGAEKACAWIQSScIJ5
+kcL2Q6B0wpD8/RUoEb8VeAUCZcNGkQIbDAAKCRD8/RUoEb8VeKVqD/0aDsRV/mB4
+UXr6h7ES5RUVK4uIduMSVP/yVCdHCyO0M7wj2UtIl1vdzSeh5Q1oIYO7lJ59yMo0
+x0MU9xpuZ1L3dZ5CMkaq627q1B1czEyvrdjWc9260oFg8XT4/Pwn0hqBV8JQZ+tU
+E6m4qdk3bB+2ji0bRxhZTNFnQG3KbAEfHrzq3sotRvQkAecP3vlnxSljoEalABVd
+E5QVXfI6kOhFW7YxXK/aqbFSGTOSMJXDSo3OZHML45ikxY28Asxcj4ZFTX/jyDP8
+/b9MDYeRa05tThWbUXp2tGenPVl6U2sw8Vs5HLhRMdeMG1lkKarjYB62hvcNQJRu
+6bKBipY31mmfSKeF/O+C82DsG7JoR4owngNTEeMe0OCWPhFuz+dSzuGEy4xX+ntL
+Y+16cRkgy+zd84nKpA4JJGBw9Daf36ERIJWTB89mJF0vNc3DZ0Hu4IbNpoXcOSwy
+BXou/aTd4z2gIwgR5WYBwHMLyLDBZEmHRc+ERwfFiaXk8ZDe9MRa3KR+AZwJSVJJ
+AZ15BUZ803QfQ5Y3M0dBUXyHcbJF3g7ae+f1IKWPWQYEsHLGGUqR0s3eNPORKfOU
+TB507dlnLs4lIhIGbIb75r45yDHftifuIJdAL1TIZK2LKH8WuZVV1zYe++pCVGLw
+wq5TRnJP/RWY0SQtT68rQhkr++ybjW1Jww==
+=V4/Y
+-END PGP PUBLIC KEY BLOCK-