(beam) branch asf-site updated: Publishing website 2024/01/25 05:39:30 at commit 61a62e1

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 5c8b34dc7fb Publishing website 2024/01/25 05:39:30 at commit 61a62e1
5c8b34dc7fb is described below

commit 5c8b34dc7fbf771dfb547083f1f6383b93176303
Author: runner 
AuthorDate: Thu Jan 25 05:39:30 2024 +

Publishing website 2024/01/25 05:39:30 at commit 61a62e1
---
 website/generated-content/sitemap.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/website/generated-content/sitemap.xml 
b/website/generated-content/sitemap.xml
index 45e705ce8c7..d2b12d1cc2b 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.53.0/2024-01-24T14:38:45-08:00/categories/blog/2024-01-24T14:38:45-08:00/blog/2024-01-24T14:38:45-08:00/categories/2024-01-24T14:38:45-08:00/catego
 [...]
\ No newline at end of file
+http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.53.0/2024-01-24T20:34:04-05:00/categories/blog/2024-01-24T20:34:04-05:00/blog/2024-01-24T20:34:04-05:00/categories/2024-01-24T20:34:04-05:00/catego
 [...]
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new f365a8499cc Updating config from bot
f365a8499cc is described below

commit f365a8499cc35a981c36b40a9a6615c960760026
Author: github-actions 
AuthorDate: Thu Jan 25 05:05:54 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30105.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30105.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30105.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30105.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new c237ef647b6 Updating config from bot
c237ef647b6 is described below

commit c237ef647b6d66ff21cd48f0551ff7c9857db0f2
Author: github-actions 
AuthorDate: Thu Jan 25 05:05:51 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30106.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30106.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30106.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30106.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.48.0 deleted (was 423a10d8590)

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.48.0
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 423a10d8590 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.

(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.48.1 created (now 609258d3188)

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.48.1
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 609258d3188 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks

No new revisions were added by this update.

(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.15 created (now 6d868facb2c)

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.15
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 6d868facb2c Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in 
/sdks

No new revisions were added by this update.

(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.14 deleted (was 7d6492cab03)

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.14
in repository https://gitbox.apache.org/repos/asf/beam.git


 was 7d6492cab03 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in 
/sdks

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.

(beam) branch nightly-refs/heads/master updated (7ff25d89625 -> 61a62e19c4a)

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 7ff25d89625 [YAML] Allow windowing to be done in Java or Python. 
(#30055)
 add b22fe9287b0 [YAML] LogForTesting improvements. (#30005)
 add 0eefb797765 [YAML] Expose flatten implementation from Java. (#30057)
 add 8f3887bb512 [YAML] Require numStreams for unbounded 
BigQueryStorageWriteApiSchemaTransform xlang transform
 add 11646ca7da2 Merge pull request #30059 [YAML] Require numStreams for 
unbounded BigQueryStorageWrite
 add 582d5c03569 fix for #30078 (#30079)
 add 98a86b11cc7 [MLTransform]Throw an error when specifiend columns are 
not present in the input data (#30085)
 add f7da756ac6d Update container build version to Go 1.21.6 (#30090)
 add e85d070a32b Ignore DicomMetadataRead tests (#30096)
 add 27214149d34 Support dynamic destinations with Python Storage API 
(#30045)
 add 674fe77df47 [Python] Add an option to retain timestamp returned from 
the BigTable row (#30088)
 add e3f45249620 Moving to 2.55.0-SNAPSHOT on master branch.
 add d759f970139 Add StreamingStepMetricsContainer::extractPerWorkerMetrics 
method. (#30089)
 add d62ae0144cc Add section for 2.55.0, cleanup 2.54.0 due to cut. (#30101)
 add 61a62e19c4a rename ExternalSchemaTransform to ExternalTransform 
(#30102)

No new revisions were added by this update.

Summary of changes:
 .asf.yaml  |   1 +
 .../beam_PostCommit_Python_Xlang_Gcp_Dataflow.json |   0
 .../beam_PostCommit_Python_Xlang_Gcp_Direct.json   |   1 +
 CHANGES.md |  45 +++-
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |   3 +-
 gradle.properties  |   4 +-
 .../worker/StreamingStepMetricsContainer.java  | 128 -
 .../worker/StreamingStepMetricsContainerTest.java  | 159 +++
 sdks/go/pkg/beam/core/core.go  |   2 +-
 .../providers/FlattenTransformProvider.java}   |  69 ++---
 ...Provider.java => LoggingTransformProvider.java} | 145 +-
 ...ueryStorageWriteApiSchemaTransformProvider.java |  67 -
 .../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java|   2 +
 ...StorageWriteApiSchemaTransformProviderTest.java |  54 +++-
 .../beam/sdk/io/gcp/healthcare/DicomIOReadIT.java  |   3 +
 .../io/external/xlang_bigqueryio_it_test.py|  77 +-
 sdks/python/apache_beam/io/gcp/bigquery.py | 293 -
 sdks/python/apache_beam/ml/transforms/base.py  |  13 +
 sdks/python/apache_beam/ml/transforms/base_test.py |  47 +++-
 .../transforms/enrichment_handlers/bigtable.py |  24 +-
 .../enrichment_handlers/bigtable_it_test.py|  63 -
 ..._provider.py => external_transform_provider.py} |  34 +--
 ...test.py => external_transform_provider_test.py} |  18 +-
 sdks/python/apache_beam/version.py |   2 +-
 sdks/python/apache_beam/yaml/standard_io.yaml  |   2 +
 .../apache_beam/yaml/standard_providers.yaml   |  27 ++
 sdks/python/apache_beam/yaml/yaml_provider.py  |  36 ++-
 .../apache_beam/yaml/yaml_transform_unit_test.py   |   4 +
 sdks/typescript/package.json   |   2 +-
 29 files changed, 994 insertions(+), 331 deletions(-)
 copy 
learning/tour-of-beam/learning-content/io/text-io/text-io-local-write/go-example/myfile.txt
 => .github/trigger_files/beam_PostCommit_Python_Xlang_Gcp_Dataflow.json (100%)
 create mode 100644 
.github/trigger_files/beam_PostCommit_Python_Xlang_Gcp_Direct.json
 copy 
sdks/java/{expansion-service/src/main/java/org/apache/beam/sdk/expansion/service/WindowIntoTransformProvider.java
 => 
core/src/main/java/org/apache/beam/sdk/schemas/transforms/providers/FlattenTransformProvider.java}
 (57%)
 copy 
sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/transforms/providers/{JavaFilterTransformProvider.java
 => LoggingTransformProvider.java} (50%)
 rename 
sdks/python/apache_beam/transforms/{external_schematransform_provider.py => 
external_transform_provider.py} (90%)
 rename 
sdks/python/apache_beam/transforms/{external_schematransform_provider_test.py 
=> external_transform_provider_test.py} (87%)

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 0ed98f77b12 Updating config from bot
0ed98f77b12 is described below

commit 0ed98f77b129010b339bf77cdc35f9a11fb31717
Author: github-actions 
AuthorDate: Thu Jan 25 02:18:18 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index af2014db98e..c114afb2283 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -9,7 +9,7 @@
 "pabloem": 1681281324703,
 "y1chi": 1667002607045,
 "damccorm": 1706042084330,
-"jrmccluskey": 1705969245233,
+"jrmccluskey": 1706149095380,
 "riteshghorse": 1705979157521,
 "liferoad": 1706042080203
   }

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new e44ac9eae5d Updating config from bot
e44ac9eae5d is described below

commit e44ac9eae5d6f17e5e380456e2fc276a0eacf433
Author: github-actions 
AuthorDate: Thu Jan 25 02:18:21 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
index 0fbd0af0c0f..421d342224e 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
@@ -1,7 +1,7 @@
 {
   "label": "io",
   "dateOfLastReviewAssignment": {
-"chamikaramj": 1705666435182,
+"chamikaramj": 1706149095380,
 "johnjcasey": 1706007946503,
 "pabloem": 1691787951165,
 "Abacn": 1705973463134,

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new a4105f19d12 Updating config from bot
a4105f19d12 is described below

commit a4105f19d128092e380c2a9369e8449790240be3
Author: github-actions 
AuthorDate: Thu Jan 25 02:18:20 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index bdb49ee4090..eb207a8a9c9 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -2,6 +2,6 @@
   "label": "build",
   "dateOfLastReviewAssignment": {
 "damccorm": 1705629469494,
-"Abacn": 1705554349105
+"Abacn": 1706149095380
   }
 }
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 6811d45cbe5 Updating config from bot
6811d45cbe5 is described below

commit 6811d45cbe5cc77b3fbe0afe3969caf4af681802
Author: github-actions 
AuthorDate: Thu Jan 25 02:18:16 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30099.json | 10 +++---
 1 file changed, 7 insertions(+), 3 deletions(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30099.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30099.json
index 242a48d7d3b..a7c9b79aa16 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30099.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30099.json
@@ -1,7 +1,11 @@
 {
-  "commentedAboutFailingChecks": true,
-  "reviewersAssignedForLabels": {},
-  "nextAction": "Author",
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "jrmccluskey",
+"build": "Abacn",
+"io": "chamikaramj"
+  },
+  "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
   "committerAssigned": false

(beam) branch master updated (d62ae0144cc -> 61a62e19c4a)

2024-01-24 Thread ahmedabualsaud 
This is an automated email from the ASF dual-hosted git repository.

ahmedabualsaud pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from d62ae0144cc Add section for 2.55.0, cleanup 2.54.0 due to cut. (#30101)
 add 61a62e19c4a rename ExternalSchemaTransform to ExternalTransform 
(#30102)

No new revisions were added by this update.

Summary of changes:
 ..._provider.py => external_transform_provider.py} | 34 +++---
 ...test.py => external_transform_provider_test.py} | 18 ++--
 2 files changed, 26 insertions(+), 26 deletions(-)
 rename 
sdks/python/apache_beam/transforms/{external_schematransform_provider.py => 
external_transform_provider.py} (90%)
 rename 
sdks/python/apache_beam/transforms/{external_schematransform_provider_test.py 
=> external_transform_provider_test.py} (87%)

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 325714cb087 Updating config from bot
325714cb087 is described below

commit 325714cb087ab764811717dc0f741d28ccee5b4a
Author: github-actions 
AuthorDate: Thu Jan 25 00:44:33 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30103.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30103.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30103.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30103.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new e2a43ec8c52 Updating config from bot
e2a43ec8c52 is described below

commit e2a43ec8c521ce2a33e09acb958a81a6be82a3c5
Author: github-actions 
AuthorDate: Thu Jan 25 00:21:37 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30099.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30099.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30099.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30099.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 5e5c51caad0 Updating config from bot
5e5c51caad0 is described below

commit 5e5c51caad0f2b04ccaac696ba299eb37c635cae
Author: github-actions 
AuthorDate: Thu Jan 25 00:21:34 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index d3ef276a930..af2014db98e 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -1,7 +1,7 @@
 {
   "label": "python",
   "dateOfLastReviewAssignment": {
-"AnandInguva": 1705631963601,
+"AnandInguva": 1706142090877,
 "yeandy": 1665802753763,
 "TheNeuralBit": 1667896849319,
 "ryanthompson591": 1670002443548,

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 2d0692fab6f Updating config from bot
2d0692fab6f is described below

commit 2d0692fab6f6b19df173010d6c7100486b2af1c3
Author: github-actions 
AuthorDate: Thu Jan 25 00:21:32 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30102.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30102.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30102.json
new file mode 100644
index 000..6272b4e797d
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30102.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "AnandInguva"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new bad081f7044 Updating config from bot
bad081f7044 is described below

commit bad081f7044e6caa0eb59705756d5ddad7e29093
Author: github-actions 
AuthorDate: Thu Jan 25 00:21:29 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30104.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30104.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30104.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30104.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch lostluck-patch-2 deleted (was d4c25467f39)

2024-01-24 Thread lostluck 
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a change to branch lostluck-patch-2
in repository https://gitbox.apache.org/repos/asf/beam.git


 was d4c25467f39 Add section for 2.55.0, cleanup 2.54.0 due to cut.

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.

(beam) branch master updated (d759f970139 -> d62ae0144cc)

2024-01-24 Thread lostluck 
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from d759f970139 Add StreamingStepMetricsContainer::extractPerWorkerMetrics 
method. (#30089)
 add d62ae0144cc Add section for 2.55.0, cleanup 2.54.0 due to cut. (#30101)

No new revisions were added by this update.

Summary of changes:
 CHANGES.md | 44 ++--
 1 file changed, 38 insertions(+), 6 deletions(-)

(beam) branch asf-site updated: Publishing website 2024/01/24 23:40:01 at commit d759f97

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 940ab2d5575 Publishing website 2024/01/24 23:40:01 at commit d759f97
940ab2d5575 is described below

commit 940ab2d5575415055c2867689493a96a9299e748
Author: runner 
AuthorDate: Wed Jan 24 23:40:01 2024 +

Publishing website 2024/01/24 23:40:01 at commit d759f97
---
 website/generated-content/sitemap.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/website/generated-content/sitemap.xml 
b/website/generated-content/sitemap.xml
index e282ac34a8b..45e705ce8c7 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.53.0/2024-01-24T16:41:20+00:00/categories/blog/2024-01-24T16:41:20+00:00/blog/2024-01-24T16:41:20+00:00/categories/2024-01-24T16:41:20+00:00/catego
 [...]
\ No newline at end of file
+http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.53.0/2024-01-24T14:38:45-08:00/categories/blog/2024-01-24T14:38:45-08:00/blog/2024-01-24T14:38:45-08:00/categories/2024-01-24T14:38:45-08:00/catego
 [...]
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 556bc8655e8 Updating config from bot
556bc8655e8 is described below

commit 556bc8655e88f87b40b2487b38b4f3f41fd414fd
Author: github-actions 
AuthorDate: Wed Jan 24 23:05:59 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json
index f5bb8e19376..66fa59b490c 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json
@@ -11,7 +11,7 @@
 "lostluck": 1705635383761,
 "riteshghorse": 1705435557774,
 "robertwb": 1705698339778,
-"tvalentyn": 1704836068541,
+"tvalentyn": 1706137556940,
 "damondouglas": 1705649933326
   }
 }
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new b046f825642 Updating config from bot
b046f825642 is described below

commit b046f825642d52b9d9029afe8243c49ab40a7a76
Author: github-actions 
AuthorDate: Wed Jan 24 23:05:58 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30101.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30101.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30101.json
new file mode 100644
index 000..c9972b0d659
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30101.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"no-matching-label": "tvalentyn"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch lostluck-patch-2 created (now d4c25467f39)

2024-01-24 Thread lostluck 
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a change to branch lostluck-patch-2
in repository https://gitbox.apache.org/repos/asf/beam.git


  at d4c25467f39 Add section for 2.55.0, cleanup 2.54.0 due to cut.

This branch includes the following new commits:

 new d4c25467f39 Add section for 2.55.0, cleanup 2.54.0 due to cut.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.

(beam) 01/01: Add section for 2.55.0, cleanup 2.54.0 due to cut.

2024-01-24 Thread lostluck 
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a commit to branch lostluck-patch-2
in repository https://gitbox.apache.org/repos/asf/beam.git

commit d4c25467f398d8a9cfcf5ad7a96626ecd8745aff
Author: Robert Burke 
AuthorDate: Wed Jan 24 14:42:08 2024 -0800

Add section for 2.55.0, cleanup 2.54.0 due to cut.
---
 CHANGES.md | 44 ++--
 1 file changed, 38 insertions(+), 6 deletions(-)

diff --git a/CHANGES.md b/CHANGES.md
index d4b9b7d77e0..2d9c249bf6b 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -52,8 +52,7 @@
 
 * ([#X](https://github.com/apache/beam/issues/X)).
 -->
-
-# [2.54.0] - Unreleased
+# [2.55.0] - Unreleased
 
 ## Highlights
 
@@ -63,6 +62,39 @@
 ## I/Os
 
 * Support for X source added (Java/Python) 
([#X](https://github.com/apache/beam/issues/X)).
+
+## New Features / Improvements
+
+* X feature added (Java/Python) 
([#X](https://github.com/apache/beam/issues/X)).
+
+## Breaking Changes
+
+* X behavior was changed ([#X](https://github.com/apache/beam/issues/X)).
+
+## Deprecations
+
+* X behavior is deprecated and will be removed in X versions 
([#X](https://github.com/apache/beam/issues/X)).
+
+## Bugfixes
+
+* Fixed X (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
+
+## Security Fixes
+* Fixed (CVE--)[https://www.cve.org/CVERecord?id=CVE--] 
(Java/Python/Go) ([#X](https://github.com/apache/beam/issues/X)).
+
+## Known Issues
+
+* ([#X](https://github.com/apache/beam/issues/X)).
+
+# [2.54.0] - Cut,Unreleased
+
+## Highlights
+
+* New highly anticipated feature X added to Python SDK 
([#X](https://github.com/apache/beam/issues/X)).
+* New highly anticipated feature Y added to Java SDK 
([#Y](https://github.com/apache/beam/issues/Y)).
+
+## I/Os
+
 * Added support for writing to BigQuery dynamic destinations with Python's 
Storage Write API ([#30045](https://github.com/apache/beam/pull/30045))
 * Adding support for Tuples DataType in ClickHouse (Java) 
([#29715](https://github.com/apache/beam/pull/29715)).
 * Added support for handling bad records to FileIO, TextIO, AvroIO 
([#29670](https://github.com/apache/beam/pull/29670)).
@@ -74,18 +106,18 @@
 
 ## Breaking Changes
 
-* X behavior was changed ([#X](https://github.com/apache/beam/issues/X)).
+* N/A
 
 ## Deprecations
 
-* X behavior is deprecated and will be removed in X versions 
([#X](https://github.com/apache/beam/issues/X)).
+* N/A
 
 ## Bugfixes
 
-* Fixed X (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
+* N/A
 
 ## Security Fixes
-* Fixed (CVE--)[https://www.cve.org/CVERecord?id=CVE--] 
(Java/Python/Go) ([#X](https://github.com/apache/beam/issues/X)).
+* N/A
 
 ## Known Issues

(beam) branch master updated (e3f45249620 -> d759f970139)

2024-01-24 Thread yhu 
This is an automated email from the ASF dual-hosted git repository.

yhu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from e3f45249620 Moving to 2.55.0-SNAPSHOT on master branch.
 add d759f970139 Add StreamingStepMetricsContainer::extractPerWorkerMetrics 
method. (#30089)

No new revisions were added by this update.

Summary of changes:
 .../worker/StreamingStepMetricsContainer.java  | 128 -
 .../worker/StreamingStepMetricsContainerTest.java  | 159 +
 2 files changed, 284 insertions(+), 3 deletions(-)

(beam) branch master updated: Moving to 2.55.0-SNAPSHOT on master branch.

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new e3f45249620 Moving to 2.55.0-SNAPSHOT on master branch.
e3f45249620 is described below

commit e3f452496202b989a2f0203dc12eb029e73984e2
Author: lostluck 
AuthorDate: Wed Jan 24 22:36:31 2024 +

Moving to 2.55.0-SNAPSHOT on master branch.
---
 .asf.yaml  | 1 +
 gradle.properties  | 4 ++--
 sdks/go/pkg/beam/core/core.go  | 2 +-
 sdks/python/apache_beam/version.py | 2 +-
 sdks/typescript/package.json   | 2 +-
 5 files changed, 6 insertions(+), 5 deletions(-)

diff --git a/.asf.yaml b/.asf.yaml
index d126c562838..63e05f72052 100644
--- a/.asf.yaml
+++ b/.asf.yaml
@@ -49,6 +49,7 @@ github:
 
   protected_branches:
 master: {}
+release-2.54.0: {}
 release-2.53.0: {}
 release-2.52.0: {}
 release-2.51.0: {}
diff --git a/gradle.properties b/gradle.properties
index 8f8736a100f..b76e071981a 100644
--- a/gradle.properties
+++ b/gradle.properties
@@ -30,8 +30,8 @@ signing.gnupg.useLegacyGpg=true
 # buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy.
 # To build a custom Beam version make sure you change it in both places, see
 # https://github.com/apache/beam/issues/21302.
-version=2.54.0-SNAPSHOT
-sdk_version=2.54.0.dev
+version=2.55.0-SNAPSHOT
+sdk_version=2.55.0.dev
 
 javaVersion=1.8
 
diff --git a/sdks/go/pkg/beam/core/core.go b/sdks/go/pkg/beam/core/core.go
index 862b6eee94b..176c98b0f07 100644
--- a/sdks/go/pkg/beam/core/core.go
+++ b/sdks/go/pkg/beam/core/core.go
@@ -27,7 +27,7 @@ const (
// SdkName is the human readable name of the SDK for UserAgents.
SdkName = "Apache Beam SDK for Go"
// SdkVersion is the current version of the SDK.
-   SdkVersion = "2.54.0.dev"
+   SdkVersion = "2.55.0.dev"
 
// DefaultDockerImage represents the associated image for this release.
DefaultDockerImage = "apache/beam_go_sdk:" + SdkVersion
diff --git a/sdks/python/apache_beam/version.py 
b/sdks/python/apache_beam/version.py
index f0df92e31e5..73b908e0ef7 100644
--- a/sdks/python/apache_beam/version.py
+++ b/sdks/python/apache_beam/version.py
@@ -17,4 +17,4 @@
 
 """Apache Beam SDK version information and utilities."""
 
-__version__ = '2.54.0.dev'
+__version__ = '2.55.0.dev'
diff --git a/sdks/typescript/package.json b/sdks/typescript/package.json
index 8fc999bc9c9..023d3d10131 100644
--- a/sdks/typescript/package.json
+++ b/sdks/typescript/package.json
@@ -1,6 +1,6 @@
 {
   "name": "apache-beam",
-  "version": "2.54.0-SNAPSHOT",
+  "version": "2.55.0-SNAPSHOT",
   "devDependencies": {
 "@google-cloud/bigquery": "^5.12.0",
 "@types/mocha": "^9.0.0",

(beam) 01/01: Set Dataflow container to release version.

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch release-2.54.0
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 22f847d1bd681b50da8744a22ad39bf963cd3c2e
Author: lostluck 
AuthorDate: Wed Jan 24 22:36:08 2024 +

Set Dataflow container to release version.
---
 runners/google-cloud-dataflow-java/build.gradle | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/runners/google-cloud-dataflow-java/build.gradle 
b/runners/google-cloud-dataflow-java/build.gradle
index f34db247a0f..9e2a2da5f05 100644
--- a/runners/google-cloud-dataflow-java/build.gradle
+++ b/runners/google-cloud-dataflow-java/build.gradle
@@ -51,8 +51,8 @@ evaluationDependsOn(":sdks:java:container:java11")
 
 ext.dataflowLegacyEnvironmentMajorVersion = '8'
 ext.dataflowFnapiEnvironmentMajorVersion = '8'
-ext.dataflowLegacyContainerVersion = 'beam-master-20231212'
-ext.dataflowFnapiContainerVersion = 'beam-master-20240109'
+ext.dataflowLegacyContainerVersion = '2.54.0'
+ext.dataflowFnapiContainerVersion = '2.54.0'
 ext.dataflowContainerBaseRepository = 'gcr.io/cloud-dataflow/v1beta3'
 
 processResources {

(beam) branch release-2.54.0 created (now 22f847d1bd6)

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch release-2.54.0
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 22f847d1bd6 Set Dataflow container to release version.

This branch includes the following new commits:

 new 22f847d1bd6 Set Dataflow container to release version.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.

(beam) branch master updated (27214149d34 -> 674fe77df47)

2024-01-24 Thread riteshghorse 
This is an automated email from the ASF dual-hosted git repository.

riteshghorse pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 27214149d34 Support dynamic destinations with Python Storage API 
(#30045)
 add 674fe77df47 [Python] Add an option to retain timestamp returned from 
the BigTable row (#30088)

No new revisions were added by this update.

Summary of changes:
 .../transforms/enrichment_handlers/bigtable.py | 24 ++---
 .../enrichment_handlers/bigtable_it_test.py| 63 ++
 2 files changed, 70 insertions(+), 17 deletions(-)

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 63c7968b423 Updating config from bot
63c7968b423 is described below

commit 63c7968b4236b9368e741809d6d8d141633dee06
Author: github-actions 
AuthorDate: Wed Jan 24 19:34:44 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index 5ccaabb882a..d3ef276a930 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -5,7 +5,7 @@
 "yeandy": 1665802753763,
 "TheNeuralBit": 1667896849319,
 "ryanthompson591": 1670002443548,
-"tvalentyn": 1705964763751,
+"tvalentyn": 1706124882265,
 "pabloem": 1681281324703,
 "y1chi": 1667002607045,
 "damccorm": 1706042084330,

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 378a277cc50 Updating config from bot
378a277cc50 is described below

commit 378a277cc50bebc2c68fdc34ce544e2f8e2e794c
Author: github-actions 
AuthorDate: Wed Jan 24 19:34:43 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-29978.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29978.json 
b/scripts/ci/pr-bot/state/pr-state/pr-29978.json
new file mode 100644
index 000..321b31c0f05
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29978.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "tvalentyn"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch master updated (e85d070a32b -> 27214149d34)

2024-01-24 Thread ahmedabualsaud 
This is an automated email from the ASF dual-hosted git repository.

ahmedabualsaud pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from e85d070a32b Ignore DicomMetadataRead tests (#30096)
 add 27214149d34 Support dynamic destinations with Python Storage API 
(#30045)

No new revisions were added by this update.

Summary of changes:
 .../beam_PostCommit_Python_Xlang_Gcp_Dataflow.json |   0
 .../beam_PostCommit_Python_Xlang_Gcp_Direct.json   |   1 +
 CHANGES.md |   1 +
 ...ueryStorageWriteApiSchemaTransformProvider.java |  59 -
 ...StorageWriteApiSchemaTransformProviderTest.java |  54 +++-
 .../io/external/xlang_bigqueryio_it_test.py|  77 +-
 sdks/python/apache_beam/io/gcp/bigquery.py | 293 -
 7 files changed, 334 insertions(+), 151 deletions(-)
 copy 
learning/tour-of-beam/learning-content/io/text-io/text-io-local-write/go-example/myfile.txt
 => .github/trigger_files/beam_PostCommit_Python_Xlang_Gcp_Dataflow.json (100%)
 create mode 100644 
.github/trigger_files/beam_PostCommit_Python_Xlang_Gcp_Direct.json

(beam) branch master updated: Ignore DicomMetadataRead tests (#30096)

2024-01-24 Thread yhu 
This is an automated email from the ASF dual-hosted git repository.

yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new e85d070a32b Ignore DicomMetadataRead tests (#30096)
e85d070a32b is described below

commit e85d070a32b0d16706b56bf7a9c2eba596e2bab2
Author: Yi Hu 
AuthorDate: Wed Jan 24 13:21:50 2024 -0500

Ignore DicomMetadataRead tests (#30096)
---
 .../test/java/org/apache/beam/sdk/io/gcp/healthcare/DicomIOReadIT.java | 3 +++
 1 file changed, 3 insertions(+)

diff --git 
a/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/DicomIOReadIT.java
 
b/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/DicomIOReadIT.java
index 570844011f3..f6f8e8b8fcc 100644
--- 
a/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/DicomIOReadIT.java
+++ 
b/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/healthcare/DicomIOReadIT.java
@@ -27,6 +27,7 @@ import org.apache.beam.sdk.transforms.Create;
 import org.junit.After;
 import org.junit.Assert;
 import org.junit.Before;
+import org.junit.Ignore;
 import org.junit.Rule;
 import org.junit.Test;
 
@@ -61,6 +62,7 @@ public class DicomIOReadIT {
 client.deleteDicomStore(healthcareDataset + "/dicomStores/" + storeName);
   }
 
+  @Ignore("https://github.com/apache/beam/issues/28099";)
   @Test
   public void testDicomMetadataRead() {
 String webPath =
@@ -88,6 +90,7 @@ public class DicomIOReadIT {
 pipeline.run();
   }
 
+  @Ignore("https://github.com/apache/beam/issues/28099";)
   @Test
   public void testDicomFailedMetadataRead() {
 String badWebPath = "foo";

(beam) branch master updated (98a86b11cc7 -> f7da756ac6d)

2024-01-24 Thread jrmccluskey 
This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 98a86b11cc7 [MLTransform]Throw an error when specifiend columns are 
not present in the input data (#30085)
 add f7da756ac6d Update container build version to Go 1.21.6 (#30090)

No new revisions were added by this update.

Summary of changes:
 .../src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new b743f0077b2 Updating config from bot
b743f0077b2 is described below

commit b743f0077b2126c2c8ebdaef2f26cba393ac7dc8
Author: github-actions 
AuthorDate: Wed Jan 24 16:48:30 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30096.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30096.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30096.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30096.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

(beam) branch master updated: [MLTransform]Throw an error when specifiend columns are not present in the input data (#30085)

2024-01-24 Thread anandinguva 
This is an automated email from the ASF dual-hosted git repository.

anandinguva pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 98a86b11cc7 [MLTransform]Throw an error when specifiend columns are 
not present in the input data (#30085)
98a86b11cc7 is described below

commit 98a86b11cc767774dcbc7a92e03bd19a9656d7b7
Author: Anand Inguva <34158215+ananding...@users.noreply.github.com>
AuthorDate: Wed Jan 24 16:41:20 2024 +

[MLTransform]Throw an error when specifiend columns are not present in the 
input data (#30085)

* throw a warning when columns are not present in the input data

* Add a check to see if the input dict have same keys
---
 sdks/python/apache_beam/ml/transforms/base.py  | 13 ++
 sdks/python/apache_beam/ml/transforms/base_test.py | 47 --
 2 files changed, 57 insertions(+), 3 deletions(-)

diff --git a/sdks/python/apache_beam/ml/transforms/base.py 
b/sdks/python/apache_beam/ml/transforms/base.py
index 64ad0286e53..a297f62f5bc 100644
--- a/sdks/python/apache_beam/ml/transforms/base.py
+++ b/sdks/python/apache_beam/ml/transforms/base.py
@@ -69,7 +69,14 @@ OperationOutputT = TypeVar('OperationOutputT')
 def _convert_list_of_dicts_to_dict_of_lists(
 list_of_dicts: Sequence[Dict[str, Any]]) -> Dict[str, List[Any]]:
   keys_to_element_list = collections.defaultdict(list)
+  input_keys = list_of_dicts[0].keys()
   for d in list_of_dicts:
+if set(d.keys()) != set(input_keys):
+  extra_keys = set(d.keys()) - set(input_keys) if len(
+  d.keys()) > len(input_keys) else set(input_keys) - set(d.keys())
+  raise RuntimeError(
+  f'All the dicts in the input data should have the same keys. '
+  f'Got: {extra_keys} instead.')
 for key, value in d.items():
   keys_to_element_list[key].append(value)
   return keys_to_element_list
@@ -629,6 +636,12 @@ class _TextEmbeddingHandler(ModelHandler):
   model: ModelT,
   inference_args: Optional[Dict[str, Any]]) -> Dict[str, List[Any]]:
 result: Dict[str, List[Any]] = collections.defaultdict(list)
+input_keys = dict_batch.keys()
+missing_columns_in_data = set(self.columns) - set(input_keys)
+if missing_columns_in_data:
+  raise RuntimeError(
+  f'Data does not contain the following columns '
+  f': {missing_columns_in_data}.')
 for key, batch in dict_batch.items():
   if key in self.columns:
 self._validate_column_data(batch)
diff --git a/sdks/python/apache_beam/ml/transforms/base_test.py 
b/sdks/python/apache_beam/ml/transforms/base_test.py
index 44820c23cc2..3a83a115e42 100644
--- a/sdks/python/apache_beam/ml/transforms/base_test.py
+++ b/sdks/python/apache_beam/ml/transforms/base_test.py
@@ -334,8 +334,8 @@ class FakeModelHandler(ModelHandler):
 
 
 class FakeEmbeddingsManager(base.EmbeddingsManager):
-  def __init__(self, columns):
-super().__init__(columns=columns)
+  def __init__(self, columns, **kwargs):
+super().__init__(columns=columns, **kwargs)
 
   def get_model_handler(self) -> ModelHandler:
 FakeModelHandler.__repr__ = lambda x: 'FakeEmbeddingsManager'  # type: 
ignore[assignment]
@@ -416,7 +416,6 @@ class TextEmbeddingHandlerTest(unittest.TestCase):
   )
 
   def test_handler_on_multiple_columns(self):
-self.embedding_conig.columns = ['x', 'y']
 data = [
 {
 'x': "Hello world", 'y': "Apache Beam", 'z': 'unchanged'
@@ -443,6 +442,26 @@ class TextEmbeddingHandlerTest(unittest.TestCase):
   equal_to(expected_data),
   )
 
+  def test_handler_on_columns_not_exist_in_input_data(self):
+data = [
+{
+'x': "Hello world", 'y': "Apache Beam"
+},
+{
+'x': "Apache Beam", 'y': "Hello world"
+},
+]
+self.embedding_conig.columns = ['x', 'y', 'a']
+
+with self.assertRaises(RuntimeError):
+  with beam.Pipeline() as p:
+_ = (
+p
+| beam.Create(data)
+| base.MLTransform(
+write_artifact_location=self.artifact_location).with_transform(
+self.embedding_conig))
+
   def test_handler_with_list_data(self):
 data = [{
 'x': ['Hello world', 'Apache Beam'],
@@ -458,6 +477,28 @@ class TextEmbeddingHandlerTest(unittest.TestCase):
 write_artifact_location=self.artifact_location).with_transform(
 self.embedding_conig))
 
+  def test_handler_with_inconsistent_keys(self):
+data = [
+{
+'x': 'foo', 'y': 'bar', 'z': 'baz'
+},
+{
+'x': 'foo2', 'y': 'bar2'
+},
+{
+'x': 'foo3', 'y': 'bar3', 'z': 'baz3'
+},
+]
+self.embedding_conig.min_batch_size = 2
+with self.assertRaises(RuntimeError):
+  with beam.Pipeline() as p:
+_ = (
+p
+

(beam) branch master updated: fix for #30078 (#30079)

2024-01-24 Thread yhu 
This is an automated email from the ASF dual-hosted git repository.

yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 582d5c03569 fix for #30078 (#30079)
582d5c03569 is described below

commit 582d5c03569186fbff5b48fc890cd6ed7c1fb283
Author: Neeraj Bansal <51872638+nrj...@users.noreply.github.com>
AuthorDate: Wed Jan 24 20:52:08 2024 +0530

fix for #30078 (#30079)

Co-authored-by: neeraj 
---
 .../src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java   | 2 ++
 1 file changed, 2 insertions(+)

diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java
index e281e559a54..1080999271d 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java
@@ -566,6 +566,8 @@ public class PubsubIO {
   public static Read 
readMessagesWithAttributesAndMessageIdAndOrderingKey() {
 return Read.newBuilder()
 
.setCoder(PubsubMessageWithAttributesAndMessageIdAndOrderingKeyCoder.of())
+.setNeedsAttributes(true)
+.setNeedsMessageId(true)
 .setNeedsOrderingKey(true)
 .build();
   }

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 838b72e7e55 Updating config from bot
838b72e7e55 is described below

commit 838b72e7e55b181638cbd011af35abbebad6456c
Author: github-actions 
AuthorDate: Wed Jan 24 14:39:56 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30088.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30088.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30088.json
index 242a48d7d3b..37f7ab41238 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30088.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30088.json
@@ -2,7 +2,7 @@
   "commentedAboutFailingChecks": true,
   "reviewersAssignedForLabels": {},
   "nextAction": "Author",
-  "stopReviewerNotifications": false,
+  "stopReviewerNotifications": true,
   "remindAfterTestsPass": [],
   "committerAssigned": false
 }
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 17ebf13da88 Updating config from bot
17ebf13da88 is described below

commit 17ebf13da88e51fc25c58faf1990f9a990935c06
Author: github-actions 
AuthorDate: Wed Jan 24 12:13:56 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
index 464b8fd11d6..1184b50bb48 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
@@ -9,6 +9,6 @@
 "Abacn": 1705666427704,
 "bvolpato": 1706034929353,
 "m-trieu": 1706007946503,
-"damondouglas": 1705631963601
+"damondouglas": 1706098433426
   }
 }
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new f4e24a0af5f Updating config from bot
f4e24a0af5f is described below

commit f4e24a0af5fbe6f48eeb90512f342dbf498344b3
Author: github-actions 
AuthorDate: Wed Jan 24 12:13:57 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
index 0576f9b1202..0fbd0af0c0f 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
@@ -8,6 +8,6 @@
 "ahmedabu98": 1705666428333,
 "bvolpato": 1706034929353,
 "manavgarg": 1690826779210,
-"damondouglas": 1705631963602
+"damondouglas": 1706098433426
   }
 }
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 1c110d14273 Updating config from bot
1c110d14273 is described below

commit 1c110d14273d455700d29448ca46a1525f06cda1
Author: github-actions 
AuthorDate: Wed Jan 24 12:13:54 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30094.json | 7 +--
 1 file changed, 5 insertions(+), 2 deletions(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30094.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30094.json
index 242a48d7d3b..e41b428b191 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30094.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30094.json
@@ -1,7 +1,10 @@
 {
   "commentedAboutFailingChecks": true,
-  "reviewersAssignedForLabels": {},
-  "nextAction": "Author",
+  "reviewersAssignedForLabels": {
+"java": "damondouglas",
+"io": "damondouglas"
+  },
+  "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
   "committerAssigned": false

(beam) branch asf-site updated: Publishing website 2024/01/24 11:39:04 at commit 11646ca

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 92b744097db Publishing website 2024/01/24 11:39:04 at commit 11646ca
92b744097db is described below

commit 92b744097db8cb2f46928dab048222177e7eb2d6
Author: runner 
AuthorDate: Wed Jan 24 11:39:04 2024 +

Publishing website 2024/01/24 11:39:04 at commit 11646ca
---
 website/generated-content/sitemap.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/website/generated-content/sitemap.xml 
b/website/generated-content/sitemap.xml
index e85867cda30..846460b23da 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.53.0/2024-01-23T15:46:17-08:00/categories/blog/2024-01-23T15:46:17-08:00/blog/2024-01-23T15:46:17-08:00/categories/2024-01-23T15:46:17-08:00/catego
 [...]
\ No newline at end of file
+http://www.sitemaps.org/schemas/sitemap/0.9"; 
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.53.0/2024-01-23T23:19:10-08:00/categories/blog/2024-01-23T23:19:10-08:00/blog/2024-01-23T23:19:10-08:00/categories/2024-01-23T23:19:10-08:00/catego
 [...]
\ No newline at end of file

(beam) branch pr-bot-state updated: Updating config from bot

2024-01-24 Thread github-bot 
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 3b3c580e47b Updating config from bot
3b3c580e47b is described below

commit 3b3c580e47bb5aa8f53bfbe68de4111b8b2a7352
Author: github-actions 
AuthorDate: Wed Jan 24 10:06:08 2024 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-30094.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30094.json 
b/scripts/ci/pr-bot/state/pr-state/pr-30094.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30094.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": true,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file