(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 73c386b9f42 Updating config from bot
73c386b9f42 is described below
commit 73c386b9f4205704dfe77d323df73f02ca3e814b
Author: github-actions
AuthorDate: Wed Feb 14 09:05:56 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30312.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30312.json
b/scripts/ci/pr-bot/state/pr-state/pr-30312.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30312.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new b5eecc5be68 Updating config from bot
b5eecc5be68 is described below
commit b5eecc5be68fd137d204ee6de73015108068fcd9
Author: github-actions
AuthorDate: Wed Feb 14 15:34:00 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30306.json | 7 +--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30306.json
b/scripts/ci/pr-bot/state/pr-state/pr-30306.json
index 242a48d7d3b..d7b83ed1c47 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30306.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30306.json
@@ -1,7 +1,10 @@
{
"commentedAboutFailingChecks": true,
- "reviewersAssignedForLabels": {},
- "nextAction": "Author",
+ "reviewersAssignedForLabels": {
+"java": "m-trieu",
+"io": "johnjcasey"
+ },
+ "nextAction": "Reviewers",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
"committerAssigned": false
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new ce4d7ff316e Updating config from bot ce4d7ff316e is described below commit ce4d7ff316e0026058b1636da078f439a4606b35 Author: github-actions AuthorDate: Wed Feb 14 15:34:01 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json b/scripts/ci/pr-bot/state/reviewers-for-label-java.json index d13e8cf1f21..3d94e10626c 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json @@ -8,7 +8,7 @@ "apilloud": 1678822446183, "Abacn": 1707425392750, "bvolpato": 1707503950521, -"m-trieu": 1707343533957, +"m-trieu": 1707924839184, "damondouglas": 1707845670465 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 0119cb07ce6 Updating config from bot
0119cb07ce6 is described below
commit 0119cb07ce67d999e1f58530064952ff7a0ce4c8
Author: github-actions
AuthorDate: Wed Feb 14 15:34:03 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json
b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
index 8ebccc3c734..c35305c5fa3 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
@@ -2,7 +2,7 @@
"label": "io",
"dateOfLastReviewAssignment": {
"chamikaramj": 1707867277708,
-"johnjcasey": 1707761180436,
+"johnjcasey": 1707924839184,
"pabloem": 1691787951165,
"Abacn": 1707503950521,
"ahmedabu98": 1707845670465,
(beam) annotated tag sdks/v2.54.0 updated (f660f49b6cf -> 7126cdb6952)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to annotated tag sdks/v2.54.0 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag sdks/v2.54.0 was modified! *** from f660f49b6cf (commit) to 7126cdb6952 (tag) tagging 9052a0b1f0b18c180a6f6c1260e4fce8968e45f4 (tag) length 167 bytes by lostluck on Wed Feb 14 17:43:05 2024 + - Log - Tagging release -BEGIN PGP SIGNATURE- iQJMBAABCgA2FiEEkTwzkqdwx4HtxN2r0gMW9xIhNCIFAmXM+6kYHHByaXZhdGVA YmVhbS5hcGFjaGUub3JnAAoJENIDFvcSITQiNocQAJLu6msc+DQc3RcvIHnaEBcD r5ypD99J3ehduX68YVMhUcRwphu7Rrq/sDwHTOdx46EGWchP1/3P0AjF/qO7BYBd UqO3DdSyTVIkW9z43IAFfaSKVXe9m7Oac85nUi9ood9AcREoe1byOUev99MxMglG Pc/f/zTZmid5R3ojtp1QB7em2JwL29o1cQkZLTDAI/0IPkBJ8jEuCuQCQhWp9Ddd 2EKumXLZP5Wpfs1MTMeS2rfLqqBnc/a+HCaH5DpGOvoCGnJbN6QuSLc7rRyh8/ym k5nzo+uDrUvEJEem2U4Cb4rJNIRwvr6kRGyWZHOuzNgeoSvm5VYZDGjRJC+U5WyH v+3YgI9gr367LFL8m7Jf37VxGzOCcvevu1lXjs0GKVfiJg+5bpnQJ4QrYAfa5Otf DwguP2xuDy3P9WiSSFfd75fEDkwrOrYiutBwz5UZtu75P+e1VJ4txPZ7JSu+giLm NtzwMFS31N/Z9KgTsiK+4KTEx3UC7rfwYHlDJvy59LIEhh+47hW79L8DA6YbKSSM JdT/FICCOBzhK76+Vl1ZtzpMLeUR8/eveomk8JyfOR1vYIRlOrqo6bvxmIhX+diE uYsJpySIpQteeTuw4IU54Hk2cfkaYDtfY4FGmvqwSikBJfFJODOux632md29BG32 t79W0Xz7JojeS5rwf5/b =SyB/ -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(beam) annotated tag v2.54.0 updated (f660f49b6cf -> 2bbb5752b43)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to annotated tag v2.54.0 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag v2.54.0 was modified! *** from f660f49b6cf (commit) to 2bbb5752b43 (tag) tagging 9052a0b1f0b18c180a6f6c1260e4fce8968e45f4 (tag) length 167 bytes by lostluck on Wed Feb 14 17:43:06 2024 + - Log - Tagging release -BEGIN PGP SIGNATURE- iQJMBAABCgA2FiEEkTwzkqdwx4HtxN2r0gMW9xIhNCIFAmXM+6oYHHByaXZhdGVA YmVhbS5hcGFjaGUub3JnAAoJENIDFvcSITQi+UEQAITYvTiWiZ7FO/zNzPStmtR4 aXaXbXuLPCM9ax7/2G319Hwv8RUpfmYctPInm11PAAfVUK5Cau6AVKdAeFFyyHAP svrLzSgapuN5QvLmCcqlp4GJ+tz11ABDVSAK+Nc2KbTacEBkbsWvxOEZg1E7EYbv uU7phMUoOOD22Gd4XIXOP6CDMv+z/OpVE0dnY06Ro9bzPKKoGl+GrX42bNmbOO1p 8bxcHmtFpxvEbmt46azV27/0I+NvfQx9kpWzXBqrPT/TOoRa3rfeIPM+YobyDfbM L6elurScpCrG4n88ccC/bRmo7EQbCAnRUnUNpjeS2fZz+VE3e44dShRYOBlgCZtQ 1C/7tX5DBA335ijJbRqtFhrFi/gTnrVTG7X1vvPV2CwPppTrJXeVjD0isnD6B/q2 NdQRyFlekfyZrnTLoznNlwxKiimVuG/NCKfsuFrEIu7hWrXsVMIp9PO0tnXDdFAs 3RTV6XC9IyN556Xwds6LpcjAj/UPR11rTPfQ08dFuxQcPW9bja3xtvOi5DcZW6hG pZABtqkVWE+Dm/QrOuuvh0lnCVoMKl4o/GaW34xEmIolSXsxYGL+D1XD/bVEOPbB 5KtfMH8WcSE2/uyZMOMFQuq5cs6s5ncSWXV9MRYZTVA7cbdQjmE53EhGhzsLDQIw TBRUfrTNbFrmy/DGNpTC =pb7P -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 8365b2a6fe5 Updating config from bot 8365b2a6fe5 is described below commit 8365b2a6fe54cbd4ac524a05e0e8f98511833181 Author: github-actions AuthorDate: Wed Feb 14 17:58:08 2024 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-30306.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30306.json b/scripts/ci/pr-bot/state/pr-state/pr-30306.json index d7b83ed1c47..dcbe857b392 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-30306.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-30306.json @@ -5,7 +5,7 @@ "io": "johnjcasey" }, "nextAction": "Reviewers", - "stopReviewerNotifications": false, + "stopReviewerNotifications": true, "remindAfterTestsPass": [], "committerAssigned": false } \ No newline at end of file
(beam-site) branch updates_release_2.54.0 deleted (was a1c817c6c8)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a change to branch updates_release_2.54.0 in repository https://gitbox.apache.org/repos/asf/beam-site.git was a1c817c6c8 Update beam-site for release 2.54.0. The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
svn commit: r67350 - in /release/beam: 2.53.0/ 2.54.0/ 2.54.0/python/
Author: lostluck Date: Wed Feb 14 18:07:49 2024 New Revision: 67350 Log: Adding artifacts for the 2.54.0 release and removing old artifacts Added: release/beam/2.54.0/ release/beam/2.54.0/apache-beam-2.54.0-source-release.zip (with props) release/beam/2.54.0/apache-beam-2.54.0-source-release.zip.asc release/beam/2.54.0/apache-beam-2.54.0-source-release.zip.sha512 release/beam/2.54.0/python/ release/beam/2.54.0/python/apache-beam-2.54.0.tar.gz (with props) release/beam/2.54.0/python/apache-beam-2.54.0.tar.gz.asc release/beam/2.54.0/python/apache-beam-2.54.0.tar.gz.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-macosx_10_9_x86_64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-macosx_10_9_x86_64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-macosx_10_9_x86_64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-win32.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-win32.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-win32.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-win_amd64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-win_amd64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp310-cp310-win_amd64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-macosx_10_9_x86_64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-macosx_10_9_x86_64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-macosx_10_9_x86_64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-win32.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-win32.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-win32.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-win_amd64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-win_amd64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp311-cp311-win_amd64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp38-cp38-macosx_10_9_x86_64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp38-cp38-macosx_10_9_x86_64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp38-cp38-macosx_10_9_x86_64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (with props) release/beam/2.54.0/python/apache_beam-2.54.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.asc release/beam/2.54.0/python/apache_beam-2.54.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.sha512 release/beam/2.54.0/python/apache_beam-2.54.0
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 81381181161 Updating config from bot
81381181161 is described below
commit 8138118116127404c7c9e0d04b49c088785e750b
Author: github-actions
AuthorDate: Wed Feb 14 18:35:07 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30314.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30314.json
b/scripts/ci/pr-bot/state/pr-state/pr-30314.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30314.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 36f17dc7400 Updating config from bot
36f17dc7400 is described below
commit 36f17dc7400654d0dda01788459ce59894e19bc2
Author: github-actions
AuthorDate: Wed Feb 14 18:53:26 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30315.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30315.json
b/scripts/ci/pr-bot/state/pr-state/pr-30315.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30315.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated: Add an automatic GCP-BOM dependency upgrader (#30262)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new bfa26a4d907 Add an automatic GCP-BOM dependency upgrader (#30262)
bfa26a4d907 is described below
commit bfa26a4d907d844aed4b938f88142ed0fc82c90f
Author: Yi Hu
AuthorDate: Wed Feb 14 14:00:56 2024 -0500
Add an automatic GCP-BOM dependency upgrader (#30262)
* Add an automatic GCP-BOM dependency upgrader
* Standardize comment tag
---
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 22 +-
scripts/tools/bomupgrader.py | 233 +
2 files changed, 245 insertions(+), 10 deletions(-)
diff --git
a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
index 9705557a162..abaaa7fb1df 100644
--- a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
+++ b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
@@ -590,6 +590,9 @@ class BeamModulePlugin implements Plugin {
// These versions are defined here because they represent
// a dependency version which should match across multiple
// Maven artifacts.
+//
+// There are a few versions are determined by the BOMs by running
scripts/tools/bomupgrader.py
+// marked as [bomupgrader]. See the documentation of that script for
detail.
def activemq_version = "5.14.5"
def autovalue_version = "1.9"
def autoservice_version = "1.0.1"
@@ -601,17 +604,17 @@ class BeamModulePlugin implements Plugin {
def classgraph_version = "4.8.162"
def dbcp2_version = "2.9.0"
def errorprone_version = "2.10.0"
-// Try to keep gax_version consistent with gax-grpc version in
google_cloud_platform_libraries_bom
+// [bomupgrader] determined by: com.google.api:gax, consistent with:
google_cloud_platform_libraries_bom
def gax_version = "2.41.0"
def google_ads_version = "26.0.0"
def google_clients_version = "2.0.0"
def google_cloud_bigdataoss_version = "2.2.16"
-// Try to keep google_cloud_spanner_version consistent with
google_cloud_spanner_bom in google_cloud_platform_libraries_bom
+// [bomupgrader] determined by: com.google.cloud:google-cloud-spanner,
consistent with: google_cloud_platform_libraries_bom
def google_cloud_spanner_version = "6.57.0"
def google_code_gson_version = "2.10.1"
def google_oauth_clients_version = "1.34.1"
-// Try to keep grpc_version consistent with gRPC version in
google_cloud_platform_libraries_bom
-def grpc_version = "1.60.0"
+// [bomupgrader] determined by: io.grpc:grpc-netty, consistent with:
google_cloud_platform_libraries_bom
+def grpc_version = "1.61.0"
def guava_version = "32.1.2-jre"
def hadoop_version = "2.10.2"
def hamcrest_version = "2.1"
@@ -625,11 +628,11 @@ class BeamModulePlugin implements Plugin {
def kafka_version = "2.4.1"
def log4j2_version = "2.20.0"
def nemo_version = "0.1"
-// Try to keep netty_version consistent with the netty version in grpc_bom
(includes grpc_netty) in google_cloud_platform_libraries_bom
+// [bomupgrader] determined by: io.grpc:grpc-netty, consistent with:
google_cloud_platform_libraries_bom
def netty_version = "4.1.100.Final"
def postgres_version = "42.2.16"
def powermock_version = "2.0.9"
-// Try to keep protobuf_version consistent with the protobuf version in
google_cloud_platform_libraries_bom
+// [bomupgrader] determined by: com.google.protobuf:protobuf-java,
consistent with: google_cloud_platform_libraries_bom
def protobuf_version = "3.25.2"
def qpid_jms_client_version = "0.61.0"
def quickcheck_version = "1.0"
@@ -640,7 +643,7 @@ class BeamModulePlugin implements Plugin {
def spark3_version = "3.2.2"
def spotbugs_version = "4.0.6"
def testcontainers_version = "1.17.3"
-// Try to keep arrow_version consistent with the arrow version in
google_cloud_bigquery, managed by google_cloud_platform_libraries_bom
+// [bomupgrader] determined by: org.apache.arrow:arrow-memory-core,
consistent with: google_cloud_platform_libraries_bom
def arrow_version = "15.0.0"
def jmh_version = "1.34"
def jupiter_version = "5.7.0"
@@ -756,9 +759,8 @@ class BeamModulePlugin implements Plugin {
google_cloud_firestore :
"com.google.cloud:google-cloud-firestore", //
google_cloud_platform_libraries_bom sets version
google_cloud_pubsub :
"com.google.cloud:google-cloud-pubsub", // google_cloud_platform_libraries_bom
sets version
google_cloud_pubsublite :
"com.google.cloud:google-cloud-pubsublite", //
google_cloud_platform_libraries_bom sets version
-// The release notes
(beam) branch master updated: Beam 2.54.0 release blog. (#30201)
This is an automated email from the ASF dual-hosted git repository.
lostluck pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 7cfbfa5f3e5 Beam 2.54.0 release blog. (#30201)
7cfbfa5f3e5 is described below
commit 7cfbfa5f3e5b67a5e40b3be653b8f0a019fd8986
Author: Robert Burke
AuthorDate: Wed Feb 14 11:22:43 2024 -0800
Beam 2.54.0 release blog. (#30201)
* Beam 2.54.0 release blog.
* Fix delimiter
* Update to archive.
* Update release date to 02-12.
* Add note about Dataflow Runner v2 default for Java Batch.
* Update blog with note about RunnerV2 becoming the default.
* Update release date due to delay.
* runnerv2 again
* Update time.
* fix archive links
* fix publish time.
* Time and time again.
* yesterday
* slow to update.
-
Co-authored-by: lostluck <13907733+lostl...@users.noreply.github.com>
Co-authored-by: Robert Bradshaw
---
CHANGES.md | 12 +-
website/www/site/config.toml | 2 +-
website/www/site/content/en/blog/beam-2.54.0.md| 175 +
.../www/site/content/en/get-started/downloads.md | 32 ++--
4 files changed, 203 insertions(+), 18 deletions(-)
diff --git a/CHANGES.md b/CHANGES.md
index 607f1a1185f..ce46b7087f8 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -92,12 +92,13 @@
* ([#X](https://github.com/apache/beam/issues/X)).
-# [2.54.0] - Cut,Unreleased
+# [2.54.0] - 2024-02-14
## Highlights
-* New highly anticipated feature X added to Python SDK
([#X](https://github.com/apache/beam/issues/X)).
-* New highly anticipated feature Y added to Java SDK
([#Y](https://github.com/apache/beam/issues/Y)).
+* [Enrichment Transform](https://s.apache.org/enrichment-transform) along with
GCP BigTable handler added to Python SDK
([#30001](https://github.com/apache/beam/pull/30001)).
+* Beam Java Batch pipelines run on Google Cloud Dataflow will default to the
Portable (Runner V2)[https://cloud.google.com/dataflow/docs/runner-v2] starting
with this version. (All other languages are already on Runner V2.)
+* This change is still rolling out to the Dataflow service, see (Runner V2
documentation)[https://cloud.google.com/dataflow/docs/runner-v2] for how to
enable or disable it intentionally.
## I/Os
@@ -120,14 +121,15 @@
## Bugfixes
-* N/A
+* Fixed a memory leak affecting some Go SDK since 2.46.0.
([#28142](https://github.com/apache/beam/pull/28142))
## Security Fixes
+
* N/A
## Known Issues
-* ([#X](https://github.com/apache/beam/issues/X)).
+* N/A
# [2.53.0] - 2024-01-04
diff --git a/website/www/site/config.toml b/website/www/site/config.toml
index df90aa61763..bbd8193915c 100644
--- a/website/www/site/config.toml
+++ b/website/www/site/config.toml
@@ -104,7 +104,7 @@ github_project_repo = "https://github.com/apache/beam";
[params]
description = "Apache Beam is an open source, unified model and set of
language-specific SDKs for defining and executing data processing workflows,
and also data ingestion and integration flows, supporting Enterprise
Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow
pipelines simplify the mechanics of large-scale batch and streaming data
processing and can run on a number of runtimes like Apache Flink, Apache Spark,
and Google Cloud Dataflow (a cloud service). Be [...]
-release_latest = "2.53.0"
+release_latest = "2.54.0"
# The repository and branch where the files live in Github or Colab. This is
used
# to serve and stage from your local branch, but publish to the master branch.
# e.g. https://github.com/{{< param branch_repo >}}/path/to/notebook.ipynb
diff --git a/website/www/site/content/en/blog/beam-2.54.0.md
b/website/www/site/content/en/blog/beam-2.54.0.md
new file mode 100644
index 000..2c7b0f0d410
--- /dev/null
+++ b/website/www/site/content/en/blog/beam-2.54.0.md
@@ -0,0 +1,175 @@
+---
+title: "Apache Beam 2.54.0"
+date: 2024-02-14 09:00:00 -0400
+categories:
+ - blog
+ - release
+authors:
+ - lostluck
+---
+
+
+We are happy to present the new 2.54.0 release of Beam.
+This release includes both improvements and new functionality.
+See the [download page](/get-started/downloads/) for this release.
+
+
+
+For more information on changes in 2.54.0, check out the [detailed release
notes](https://github.com/apache/beam/milestone/18).
+
+## Highlights
+
+* [Enrichment Transform](https://s.apache.org/enrichment-transform) along with
GCP BigTable handler added to Python SDK
([#30001](https://github.com/apache/beam/pull/30001)).
+* Beam Java Batch pipelines run on Google Cloud Dataflow will default to the
Portable (Runner V2)[https://cloud.google.com/dataflow/docs/runner-v2] starting
with this version. (All other la
(beam) branch master updated (7cfbfa5f3e5 -> 1ac5e8bdfb9)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 7cfbfa5f3e5 Beam 2.54.0 release blog. (#30201) add 1ac5e8bdfb9 Update beam-2.54.0.md - fix link. No new revisions were added by this update. Summary of changes: website/www/site/content/en/blog/beam-2.54.0.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new e4deffd8f33 Updating config from bot
e4deffd8f33 is described below
commit e4deffd8f33a5602bb3cb30dec75707aecf3f35c
Author: github-actions
AuthorDate: Wed Feb 14 20:34:47 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30314.json | 8 +---
1 file changed, 5 insertions(+), 3 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30314.json
b/scripts/ci/pr-bot/state/pr-state/pr-30314.json
index 242a48d7d3b..1c736ae3495 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30314.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30314.json
@@ -1,7 +1,9 @@
{
- "commentedAboutFailingChecks": true,
- "reviewersAssignedForLabels": {},
- "nextAction": "Author",
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"java": "Abacn"
+ },
+ "nextAction": "Reviewers",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
"committerAssigned": false
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 0031d9c63d9 Updating config from bot 0031d9c63d9 is described below commit 0031d9c63d91ba825fe2d4b661c8d908f3a10cc8 Author: github-actions AuthorDate: Wed Feb 14 20:34:48 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json b/scripts/ci/pr-bot/state/reviewers-for-label-java.json index 3d94e10626c..859a046eb67 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json @@ -6,7 +6,7 @@ "robertwb": 1707764084416, "kileys": 1674428678843, "apilloud": 1678822446183, -"Abacn": 1707425392750, +"Abacn": 1707942885810, "bvolpato": 1707503950521, "m-trieu": 1707924839184, "damondouglas": 1707845670465
(beam) branch master updated: Extract ThrottleTimeCounter for PerWorkerMetrics (#30245)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new f64501427bf Extract ThrottleTimeCounter for PerWorkerMetrics (#30245)
f64501427bf is described below
commit f64501427bf2e0e5482859e66a3d8e1f7d6e6c94
Author: JayajP
AuthorDate: Wed Feb 14 12:46:21 2024 -0800
Extract ThrottleTimeCounter for PerWorkerMetrics (#30245)
* Extract ThrottleTimeCounter for PerWorkerMetrics
* spotless
* Update unit tests
---
.../dataflow/worker/streaming/StageInfo.java | 20 +++
.../dataflow/worker/streaming/StageInfoTest.java | 70 ++
.../sdk/io/gcp/bigquery/BigQuerySinkMetrics.java | 4 +-
3 files changed, 92 insertions(+), 2 deletions(-)
diff --git
a/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/streaming/StageInfo.java
b/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/streaming/StageInfo.java
index cb6cbec7d4b..8f14ea26a46 100644
---
a/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/streaming/StageInfo.java
+++
b/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/streaming/StageInfo.java
@@ -21,6 +21,7 @@ import static
org.apache.beam.runners.dataflow.worker.DataflowSystemMetrics.THRO
import com.google.api.services.dataflow.model.CounterStructuredName;
import com.google.api.services.dataflow.model.CounterUpdate;
+import com.google.api.services.dataflow.model.MetricValue;
import com.google.api.services.dataflow.model.PerStepNamespaceMetrics;
import com.google.auto.value.AutoValue;
import java.util.ArrayList;
@@ -34,6 +35,7 @@ import
org.apache.beam.runners.dataflow.worker.counters.Counter;
import org.apache.beam.runners.dataflow.worker.counters.CounterSet;
import
org.apache.beam.runners.dataflow.worker.counters.DataflowCounterUpdateExtractor;
import org.apache.beam.runners.dataflow.worker.counters.NameContext;
+import org.apache.beam.sdk.io.gcp.bigquery.BigQuerySinkMetrics;
import
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.Iterables;
/** Contains a few of the stage specific fields. E.g. metrics container
registry, counters etc. */
@@ -117,6 +119,24 @@ public abstract class StageInfo {
Iterables.addAll(
metrics,
StreamingStepMetricsContainer.extractPerWorkerMetricUpdates(metricsContainerRegistry()));
+translateKnownPerWorkerCounters(metrics);
return metrics;
}
+
+ private void translateKnownPerWorkerCounters(List
metrics) {
+for (PerStepNamespaceMetrics perStepnamespaceMetrics : metrics) {
+ if (!BigQuerySinkMetrics.METRICS_NAMESPACE.equals(
+ perStepnamespaceMetrics.getMetricsNamespace())) {
+continue;
+ }
+ for (MetricValue metric : perStepnamespaceMetrics.getMetricValues()) {
+if (BigQuerySinkMetrics.THROTTLED_TIME.equals(metric.getMetric())) {
+ Long msecs = metric.getValueInt64();
+ if (msecs != null && msecs > 0) {
+throttledMsecs().addValue(msecs);
+ }
+}
+ }
+}
+ }
}
diff --git
a/runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/streaming/StageInfoTest.java
b/runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/streaming/StageInfoTest.java
new file mode 100644
index 000..9b46466c5bf
--- /dev/null
+++
b/runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/streaming/StageInfoTest.java
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.beam.runners.dataflow.worker.streaming;
+
+import static org.hamcrest.MatcherAssert.assertThat;
+import static org.hamcrest.Matchers.equalTo;
+
+import org.apache.beam.runners.dataflow.worker.StreamingStepMetricsContainer;
+import org.apache.beam.sdk.io.gcp.bigquery.BigQuerySinkMetrics;
+import org.apache.beam.sdk.metrics.Metri
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new e86cb74aba6 Updating config from bot
e86cb74aba6 is described below
commit e86cb74aba6a46c01d3f7c11c5cf691f158ec531
Author: github-actions
AuthorDate: Wed Feb 14 20:53:28 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30318.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30318.json
b/scripts/ci/pr-bot/state/pr-state/pr-30318.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30318.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated (f64501427bf -> e4d90981899)
This is an automated email from the ASF dual-hosted git repository. svetak pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from f64501427bf Extract ThrottleTimeCounter for PerWorkerMetrics (#30245) add 8ae7215d748 Create HealthcareUtils file with shared resources add ef2786e9151 revert add 93223a24e44 Merge branch 'apache:master' into master add 0ffdbf1dbc7 Merge branch 'master' of github.com:svetakvsundhar/beam add e67379b0531 Merge branch 'apache:master' into master add 721dc4f73d3 Merge branch 'apache:master' into master add aa1f4811886 Merge branch 'apache:master' into master add bef38724679 Merge branch 'apache:master' into master add cc0a48e7ba8 Merge remote-tracking branch 'origin/master' add 5ef9809b4fb Merge remote-tracking branch 'origin/master' add 3688fee6830 Merge remote-tracking branch 'origin/master' add 40869f65139 Merge remote-tracking branch 'origin/master' add facd13593a7 add to documentation. new e4d90981899 Merge pull request #30318 from svetakvsundhar/pipeline_design_documentation The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../www/site/content/en/documentation/pipelines/design-your-pipeline.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) 01/01: Merge pull request #30318 from svetakvsundhar/pipeline_design_documentation
This is an automated email from the ASF dual-hosted git repository. svetak pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit e4d909818998ffb3053c4c3f8f141a01df093a89 Merge: f64501427bf facd13593a7 Author: Svetak Sundhar AuthorDate: Wed Feb 14 21:29:07 2024 + Merge pull request #30318 from svetakvsundhar/pipeline_design_documentation Pipeline design documentation update .../www/site/content/en/documentation/pipelines/design-your-pipeline.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch master updated (bfe6168505c -> 914cf145cba)
This is an automated email from the ASF dual-hosted git repository. riteshghorse pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from bfe6168505c fixed the display issue for impersonateServiceAccount with Java (#30283) add 914cf145cba [Docs] Add transform catalog page for enrichment transform (#30187) No new revisions were added by this update. Summary of changes: .../snippets/transforms/elementwise/enrichment.py | 51 + .../transforms/elementwise/enrichment_test.py | 53 + .../site/content/en/documentation/ml/overview.md | 3 +- .../transforms/python/elementwise/enrichment.md| 66 ++ .../python/elementwise/runinference-pytorch.md | 2 +- .../en/documentation/transforms/python/overview.md | 1 + .../partials/section-menu/en/documentation.html| 1 + 7 files changed, 175 insertions(+), 2 deletions(-) create mode 100644 sdks/python/apache_beam/examples/snippets/transforms/elementwise/enrichment.py create mode 100644 sdks/python/apache_beam/examples/snippets/transforms/elementwise/enrichment_test.py create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/enrichment.md
(beam) branch master updated (e4d90981899 -> bfe6168505c)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from e4d90981899 Merge pull request #30318 from svetakvsundhar/pipeline_design_documentation add bfe6168505c fixed the display issue for impersonateServiceAccount with Java (#30283) No new revisions were added by this update. Summary of changes: .../dataflow/worker/StreamingDataflowWorker.java | 1 + .../worker/WorkerPipelineOptionsFactory.java | 10 .../sdk/extensions/gcp/options/GcpOptions.java | 1 - sdks/java/harness/build.gradle | 1 + .../java/org/apache/beam/fn/harness/FnHarness.java | 30 ++ 5 files changed, 42 insertions(+), 1 deletion(-)
(beam) branch master updated: [Docs] Add example notebook for enrichment transform with bigtable (#30315)
This is an automated email from the ASF dual-hosted git repository.
riteshghorse pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 6377cbe20cc [Docs] Add example notebook for enrichment transform with
bigtable (#30315)
6377cbe20cc is described below
commit 6377cbe20cc387d7986709014efc4cedfb2099f3
Author: Ritesh Ghorse
AuthorDate: Wed Feb 14 18:50:47 2024 -0500
[Docs] Add example notebook for enrichment transform with bigtable (#30315)
* bigtable enrichment notebook
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* Update examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
* changes from the review
* Apply suggestions from code review
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
-
Co-authored-by: Rebecca Szper <98840847+rsz...@users.noreply.github.com>
---
.../beam-ml/bigtable_enrichment_transform.ipynb| 854 +
1 file changed, 854 insertions(+)
diff --git a/examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
b/examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
new file mode 100644
index 000..455b5cccd5d
--- /dev/null
+++ b/examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb
@@ -0,0 +1,854 @@
+{
+ "cells": [
+{
+ "cell_type": "code",
+ "execution_count": null,
+ "metadata": {
+"id": "fFjof1NgAJwu",
+"cellView": "form"
+ },
+ "outputs": [],
+ "source": [
+"# @title ## Licensed to the Apache Software Foundation (ASF),
Version 2.0 (the \"License\")\n",
+"\n",
+"# Licensed to the Apache Software Foundation (ASF) under one\n",
+"# or more contributor license agreements. See the NOTICE file\n",
+"# distributed with this work for additional information\n",
+"# regarding copyright ownership. The ASF licenses this file\n",
+"# to you under the Apache License, Version 2.0 (the\n",
+"# \"License\"); you may not use this file except in compliance\n",
+"# with the License. You may obtain a copy of the License at\n",
+"#\n",
+"# http://www.apache.org/licenses/LICENSE-2.0\n";,
+"#\n",
+"# Unless required by applicable law or agreed to in writing,\n",
+"# software distributed under the License is distributed on an\n",
+"# \"AS IS\" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY\n",
+"# KIND, either express or implied. See the License for the\n",
+"# specific language governing permissions and limitations\n",
+"# under the License"
+ ]
+},
+{
+ "cell_type": "markdown",
+ "metadata": {
+"id": "A8xNRyZMW1yK"
+ },
+ "source": [
+"# Use Apache Beam and Bigtable to enrich data\n",
+"\n",
+"\n",
+" \n",
+"https://colab.research.google.com/github/apache/beam/blob/master/examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb\";>https://raw.githubusercontent.com/google/or-tools/main/tools/colab_32px.png\";
/>Run in Google Colab\n",
+" \n",
+" \n",
+"https://github.com/apache/beam/blob/master/examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb\";>https://raw.githubusercontent.com/google/or-tools/main/tools/github_32px.png\";
/>View source on GitHub\n",
+" \n",
+"\n"
+ ]
+},
+{
+ "cell_type": "markdown",
+ "metadata": {
+"id": "HrCtxslBGK8
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new c342345994b Updating config from bot
c342345994b is described below
commit c342345994bc43d4bded9d53b727e6705be61b91
Author: github-actions
AuthorDate: Thu Feb 15 01:12:21 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30312.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30312.json
b/scripts/ci/pr-bot/state/pr-state/pr-30312.json
index 242a48d7d3b..37f7ab41238 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30312.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30312.json
@@ -2,7 +2,7 @@
"commentedAboutFailingChecks": true,
"reviewersAssignedForLabels": {},
"nextAction": "Author",
- "stopReviewerNotifications": false,
+ "stopReviewerNotifications": true,
"remindAfterTestsPass": [],
"committerAssigned": false
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 63b0854ee7c Updating config from bot 63b0854ee7c is described below commit 63b0854ee7c2795981ffde98d850dc80617e5fd7 Author: github-actions AuthorDate: Thu Feb 15 01:26:09 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json index 421423720b1..799c819951f 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json @@ -4,7 +4,7 @@ "Abacn": 1707614957467, "AnandInguva": 1707824067215, "chamikaramj": 1707876645084, -"damccorm": 1706746787532, +"damccorm": 1707960366200, "johnjcasey": 1706756770922, "jrmccluskey": 1707010152976, "kennknowles": 1706906090429,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 3a4c24828bf Updating config from bot
3a4c24828bf is described below
commit 3a4c24828bff6f3a7611a806fde5fc7e8428ee80
Author: github-actions
AuthorDate: Thu Feb 15 01:26:08 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30322.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30322.json
b/scripts/ci/pr-bot/state/pr-state/pr-30322.json
new file mode 100644
index 000..f6cbd919240
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30322.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"no-matching-label": "damccorm"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 4fc6c532215 Updating config from bot
4fc6c532215 is described below
commit 4fc6c5322156b79902da5f98433c3831c0bd9ec4
Author: github-actions
AuthorDate: Thu Feb 15 02:19:24 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30323.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30323.json
b/scripts/ci/pr-bot/state/pr-state/pr-30323.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30323.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch nightly-refs/heads/master updated (9a4e1144532 -> 6377cbe20cc)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git from 9a4e1144532 Add instructions for Go custom container builds, link from 2.55.0 release notes. (#30290) add bfa26a4d907 Add an automatic GCP-BOM dependency upgrader (#30262) add 7cfbfa5f3e5 Beam 2.54.0 release blog. (#30201) add 1ac5e8bdfb9 Update beam-2.54.0.md - fix link. add f64501427bf Extract ThrottleTimeCounter for PerWorkerMetrics (#30245) add 8ae7215d748 Create HealthcareUtils file with shared resources add ef2786e9151 revert add 93223a24e44 Merge branch 'apache:master' into master add 0ffdbf1dbc7 Merge branch 'master' of github.com:svetakvsundhar/beam add e67379b0531 Merge branch 'apache:master' into master add 721dc4f73d3 Merge branch 'apache:master' into master add aa1f4811886 Merge branch 'apache:master' into master add bef38724679 Merge branch 'apache:master' into master add cc0a48e7ba8 Merge remote-tracking branch 'origin/master' add 5ef9809b4fb Merge remote-tracking branch 'origin/master' add 3688fee6830 Merge remote-tracking branch 'origin/master' add 40869f65139 Merge remote-tracking branch 'origin/master' add facd13593a7 add to documentation. add e4d90981899 Merge pull request #30318 from svetakvsundhar/pipeline_design_documentation add bfe6168505c fixed the display issue for impersonateServiceAccount with Java (#30283) add 914cf145cba [Docs] Add transform catalog page for enrichment transform (#30187) add 6377cbe20cc [Docs] Add example notebook for enrichment transform with bigtable (#30315) No new revisions were added by this update. Summary of changes: CHANGES.md | 12 +- .../org/apache/beam/gradle/BeamModulePlugin.groovy | 22 +- .../beam-ml/bigtable_enrichment_transform.ipynb| 854 + .../dataflow/worker/StreamingDataflowWorker.java | 1 + .../worker/WorkerPipelineOptionsFactory.java | 10 + .../dataflow/worker/streaming/StageInfo.java | 20 + .../dataflow/worker/streaming/StageInfoTest.java | 70 ++ scripts/tools/bomupgrader.py | 233 ++ .../sdk/extensions/gcp/options/GcpOptions.java | 1 - sdks/java/harness/build.gradle | 1 + .../java/org/apache/beam/fn/harness/FnHarness.java | 30 + .../sdk/io/gcp/bigquery/BigQuerySinkMetrics.java | 4 +- .../snippets/transforms/elementwise/enrichment.py | 51 ++ .../transforms/elementwise/enrichment_test.py | 53 ++ website/www/site/config.toml | 2 +- website/www/site/content/en/blog/beam-2.54.0.md| 175 + .../site/content/en/documentation/ml/overview.md | 3 +- .../pipelines/design-your-pipeline.md | 2 +- .../transforms/python/elementwise/enrichment.md| 66 ++ .../python/elementwise/runinference-pytorch.md | 2 +- .../en/documentation/transforms/python/overview.md | 1 + .../www/site/content/en/get-started/downloads.md | 32 +- .../partials/section-menu/en/documentation.html| 1 + 23 files changed, 1612 insertions(+), 34 deletions(-) create mode 100644 examples/notebooks/beam-ml/bigtable_enrichment_transform.ipynb create mode 100644 runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/streaming/StageInfoTest.java create mode 100644 scripts/tools/bomupgrader.py create mode 100644 sdks/python/apache_beam/examples/snippets/transforms/elementwise/enrichment.py create mode 100644 sdks/python/apache_beam/examples/snippets/transforms/elementwise/enrichment_test.py create mode 100644 website/www/site/content/en/blog/beam-2.54.0.md create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/enrichment.md
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new f53532bed95 Updating config from bot
f53532bed95 is described below
commit f53532bed958ef8a3d33fa1bb986f5221f0b157a
Author: github-actions
AuthorDate: Thu Feb 15 05:34:47 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30324.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30324.json
b/scripts/ci/pr-bot/state/pr-state/pr-30324.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30324.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch asf-site updated: Publishing website 2024/02/15 05:37:45 at commit 6377cbe
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 1ea50c5a8cc Publishing website 2024/02/15 05:37:45 at commit 6377cbe 1ea50c5a8cc is described below commit 1ea50c5a8cc63fc92d233ba4befd67153fa823ab Author: runner AuthorDate: Thu Feb 15 05:37:45 2024 + Publishing website 2024/02/15 05:37:45 at commit 6377cbe --- website/generated-content/sitemap.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml index 83d70b2fa91..7f758bce551 100644 --- a/website/generated-content/sitemap.xml +++ b/website/generated-content/sitemap.xml @@ -1 +1 @@ -http://www.sitemaps.org/schemas/sitemap/0.9"; xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.54.0/2024-02-14T18:01:36-05:00/categories/blog/2024-02-14T18:01:36-05:00/blog/2024-02-14T18:01:36-05:00/categories/2024-02-14T18:01:36-05:00/catego [...] \ No newline at end of file +http://www.sitemaps.org/schemas/sitemap/0.9"; xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.54.0/2024-02-14T18:50:47-05:00/categories/blog/2024-02-14T18:50:47-05:00/blog/2024-02-14T18:50:47-05:00/categories/2024-02-14T18:50:47-05:00/catego [...] \ No newline at end of file
