(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 893e6560bc0 Updating config from bot
893e6560bc0 is described below
commit 893e6560bc0ca7154bc5da37c317880bb0077499
Author: github-actions
AuthorDate: Fri Dec 15 05:34:30 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29780.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29780.json
b/scripts/ci/pr-bot/state/pr-state/pr-29780.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29780.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 77beee8fed5 Updating config from bot
77beee8fed5 is described below
commit 77beee8fed5e4f031b533555b4940d5e8c9332e4
Author: github-actions
AuthorDate: Fri Dec 15 05:05:51 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index dec2fcf94aa..8a2883e23a3 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -2,6 +2,6 @@
"label": "build",
"dateOfLastReviewAssignment": {
"damccorm": 1702616745080,
-"Abacn": 1702588007815
+"Abacn": 1702616748592
}
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new b06e52f4772 Updating config from bot
b06e52f4772 is described below
commit b06e52f4772736fbe9216f6cd69763657616f83b
Author: github-actions
AuthorDate: Fri Dec 15 05:05:49 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29776.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29776.json
b/scripts/ci/pr-bot/state/pr-state/pr-29776.json
new file mode 100644
index 000..9c51466b9ee
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29776.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "Abacn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 1e75200b24d Updating config from bot
1e75200b24d is described below
commit 1e75200b24d700dd4fe622b8a05cd90323c1965e
Author: github-actions
AuthorDate: Fri Dec 15 05:05:46 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29777.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29777.json
b/scripts/ci/pr-bot/state/pr-state/pr-29777.json
new file mode 100644
index 000..8a92900947e
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29777.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "damccorm"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new dc11c257abf Updating config from bot
dc11c257abf is described below
commit dc11c257abf7e1f69020cab8af7de02668ec9aef
Author: github-actions
AuthorDate: Fri Dec 15 05:05:44 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29778.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29778.json
b/scripts/ci/pr-bot/state/pr-state/pr-29778.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29778.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 6c775f4a38c Updating config from bot
6c775f4a38c is described below
commit 6c775f4a38cabfd924f02afd125d6242814a6cb0
Author: github-actions
AuthorDate: Fri Dec 15 05:05:47 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 508685bf5b4..dec2fcf94aa 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -1,7 +1,7 @@
{
"label": "build",
"dateOfLastReviewAssignment": {
-"damccorm": 1702586302878,
+"damccorm": 1702616745080,
"Abacn": 1702588007815
}
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 1ebadbd9243 Updating config from bot
1ebadbd9243 is described below
commit 1ebadbd9243cc646e038feb24e35205edab528ec
Author: github-actions
AuthorDate: Fri Dec 15 05:05:41 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29779.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29779.json
b/scripts/ci/pr-bot/state/pr-state/pr-29779.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29779.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch dependabot/go_modules/sdks/cloud.google.com/go/spanner-1.54.0 created (now 26b51c5e117)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/cloud.google.com/go/spanner-1.54.0 in repository https://gitbox.apache.org/repos/asf/beam.git at 26b51c5e117 Bump cloud.google.com/go/spanner from 1.53.1 to 1.54.0 in /sdks No new revisions were added by this update.
(beam) branch dependabot/gradle/com.gradle.enterprise-3.16.1 created (now 028e9c47fd3)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.gradle.enterprise-3.16.1 in repository https://gitbox.apache.org/repos/asf/beam.git at 028e9c47fd3 Bump com.gradle.enterprise from 3.16 to 3.16.1 No new revisions were added by this update.
(beam) branch dependabot/gradle/com.github.spotbugs.snom-spotbugs-gradle-plugin-6.0.3 created (now b6daa65f36e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.github.spotbugs.snom-spotbugs-gradle-plugin-6.0.3 in repository https://gitbox.apache.org/repos/asf/beam.git at b6daa65f36e Bump com.github.spotbugs.snom:spotbugs-gradle-plugin No new revisions were added by this update.
(beam) branch dependabot/github_actions/actions/upload-artifact-4 created (now fde4e6d3f5d)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/github_actions/actions/upload-artifact-4 in repository https://gitbox.apache.org/repos/asf/beam.git at fde4e6d3f5d Bump actions/upload-artifact from 3 to 4 No new revisions were added by this update.
(beam) branch dependabot/github_actions/actions/download-artifact-4 created (now a32d34d2c58)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/github_actions/actions/download-artifact-4 in repository https://gitbox.apache.org/repos/asf/beam.git at a32d34d2c58 Bump actions/download-artifact from 3 to 4 No new revisions were added by this update.
(beam) branch nightly-refs/heads/master updated (def026bfe11 -> 52f4fc0c378)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git from def026bfe11 Bump google.golang.org/api from 0.153.0 to 0.154.0 in /sdks (#29734) add 921e40a12f4 Dynamic SchemaTransform wrapper provider (#29561) add 4264c2c3e25 Fixes breakages of the upgrade feature (#29731) add 75746c6fe4a Bump cloud.google.com/go/storage from 1.35.1 to 1.36.0 in /sdks (#29767) add 00462b13cc1 Bump google.golang.org/grpc from 1.59.0 to 1.60.0 in /sdks (#29714) add 1ce707c3865 Add user-agent string for Beam in the GCS request header. (#29765) add bc42a637d56 [#28543][prism] Implement State API (#29712) add 9e8a310f0c0 Bump Precommit Java Examples Timeouts (#29771) add c4c9bb82723 Add 2.54.0 release section to CHANGES.md (#29757) add 543b013a548 Bump com.gradle.enterprise from 3.15.1 to 3.16 (#29740) add a81c9e8e38b Bump actions/setup-python from 4 to 5 (#29654) add 970a0bd9a92 Bump actions/stale from 8 to 9 (#29682) add d297cd531ee Bump org.javacc.javacc from 3.0.0 to 3.0.2 (#29739) add 1c7d178dd2b Bump github.com/google/uuid from 1.4.0 to 1.5.0 in /sdks (#29733) add 52f4fc0c378 [Go SDK] Decrease sampling frequency for streaming jobs to avoid oversampling (#29774) No new revisions were added by this update. Summary of changes: .../beam_PreCommit_Java_Examples_Dataflow.yml | 2 +- ...eam_PreCommit_Java_Examples_Dataflow_Java21.yml | 2 +- .github/workflows/build_release_candidate.yml | 4 +- .github/workflows/build_wheels.yml | 4 +- .github/workflows/dask_runner_tests.yml| 4 +- .github/workflows/local_env_tests.yml | 4 +- .github/workflows/python_dependency_tests.yml | 2 +- .github/workflows/python_tests.yml | 8 +- .github/workflows/run_perf_alert_tool.yml | 2 +- .github/workflows/run_rc_validation.yml| 14 +- .github/workflows/stale.yml| 2 +- .github/workflows/typescript_tests.yml | 4 +- CHANGES.md | 34 + .../core/construction/TransformUpgrader.java | 13 +- sdks/go.mod| 8 +- sdks/go.sum| 17 +- sdks/go/pkg/beam/core/runtime/exec/datasink.go | 4 +- sdks/go/pkg/beam/core/runtime/exec/pcollection.go | 14 +- .../pkg/beam/runners/prism/internal/engine/data.go | 176 + .../prism/internal/engine/elementmanager.go| 226 ++- .../runners/prism/internal/engine/engine_test.go | 159 + sdks/go/pkg/beam/runners/prism/internal/execute.go | 22 + .../beam/runners/prism/internal/execute_test.go| 8 +- .../pkg/beam/runners/prism/internal/handlepardo.go | 9 +- .../beam/runners/prism/internal/jobservices/job.go | 3 +- .../prism/internal/jobservices/management.go | 20 +- .../pkg/beam/runners/prism/internal/preprocess.go | 14 +- sdks/go/pkg/beam/runners/prism/internal/stage.go | 22 +- .../runners/prism/internal/unimplemented_test.go | 48 +- .../pkg/beam/runners/prism/internal/urns/urns.go | 5 + .../beam/runners/prism/internal/worker/bundle.go | 6 +- .../beam/runners/prism/internal/worker/worker.go | 89 ++- sdks/go/test/integration/primitives/state.go | 53 +- .../GenerateSequenceSchemaTransformProvider.java | 201 ++ .../apache/beam/sdk/providers}/package-info.java | 5 +- ...enerateSequenceSchemaTransformProviderTest.java | 61 ++ .../sdk/io/gcp/bigquery/BigQueryIOTranslation.java | 705 +++-- sdks/java/io/kafka/upgrade/build.gradle| 2 - .../sdk/io/kafka/upgrade/KafkaIOTranslation.java | 414 ++-- .../io/kafka/upgrade/KafkaIOTranslationTest.java | 11 + .../io/external/xlang_kafkaio_it_test.py | 4 +- sdks/python/apache_beam/io/gcp/gcsio.py| 7 +- .../runners/dataflow/internal/apiclient.py | 6 +- .../apache_beam/runners/interactive/utils.py | 8 +- .../runners/portability/sdk_container_builder.py | 6 +- sdks/python/apache_beam/transforms/external.py | 1 + .../external_schematransform_provider.py | 277 .../external_schematransform_provider_test.py | 140 sdks/python/apache_beam/typehints/schemas.py | 3 + sdks/python/pytest.ini | 2 +- sdks/python/setup.py | 2 +- sdks/python/test-suites/dataflow/build.gradle | 4 +- sdks/python/test-suites/direct/build.gradle| 8 +- sdks/python/test-suites/gradle.properties | 4 +- sdks/python/test-suites/xlang/build.gradle | 9 +- settings.gradle.kts| 4 +- 56 files changed, 2205 insertions(+), 681 deletions(-) create mode 100644 sdks/go/pkg/bea
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new b448b4b4ef4 Updating config from bot b448b4b4ef4 is described below commit b448b4b4ef4d54c11a30d0d77624801ffba7f067 Author: github-actions AuthorDate: Fri Dec 15 03:06:00 2023 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json index 00a0ff7cea8..7fabaeafcc2 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json @@ -10,7 +10,7 @@ "kennknowles": 1701320765721, "lostluck": 1702290994451, "riteshghorse": 1702076738591, -"robertwb": 1700228072719, +"robertwb": 1702609556851, "tvalentyn": 1700246106570, "damondouglas": 1702430984870 }
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 2e56fc84952 Updating config from bot
2e56fc84952 is described below
commit 2e56fc84952ecb18fed42edc50b2a387f92c3b47
Author: github-actions
AuthorDate: Fri Dec 15 03:05:58 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29775.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29775.json
b/scripts/ci/pr-bot/state/pr-state/pr-29775.json
new file mode 100644
index 000..25dfed5a0d2
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29775.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"no-matching-label": "robertwb"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) 01/01: Fix tour of beam co-group-by-key python example
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch users/damccorm/tob-cgbk
in repository https://gitbox.apache.org/repos/asf/beam.git
commit e5382ce0641444546ab2e6401cb7a4336d799fc1
Author: Danny McCormick
AuthorDate: Thu Dec 14 21:30:34 2023 -0500
Fix tour of beam co-group-by-key python example
---
.../map/co-group-by-key/description.md | 48 --
1 file changed, 17 insertions(+), 31 deletions(-)
diff --git
a/learning/tour-of-beam/learning-content/core-transforms/map/co-group-by-key/description.md
b/learning/tour-of-beam/learning-content/core-transforms/map/co-group-by-key/description.md
index c0e7f9f3e44..543b216 100644
---
a/learning/tour-of-beam/learning-content/core-transforms/map/co-group-by-key/description.md
+++
b/learning/tour-of-beam/learning-content/core-transforms/map/co-group-by-key/description.md
@@ -284,42 +284,28 @@ static PCollection
applyTransform(PCollection fruits, PCollectio
{{end}}
{{if (eq .Sdk "python")}}
```
-weight := beam.ParDo(s, func(_ []byte, emit func(string, int)){
- emit("brazil", 1000)
- emit("australia", 150)
- emit("canada", 340)
-}, beam.Impulse(s))
-
-fruits := beam.ParDo(s, func(_ []byte, emit func(string, string)){
- emit("australia", "cherry")
- emit("brazil", "apple")
- emit("canada", "banan")
-}, beam.Impulse(s))
+fruits = p | 'Fruits' >> beam.Create([('australia', 'cherry'), ('brazil',
'apple'), ('canada', 'banana')])
+weights = p | 'Countries' >> beam.Create([('australia', 1000), ('brazil',
150), ('canada', 340)])
```
-Change `Alphabet` to `ProductWeight`:
+Change `alphabet` to `product_weight`:
```
-type WordsAlphabet struct {
- Country string
- Fruit string
- ProductWeight int
-}
+class ProductWeight:
+def __init__(self, product_weight, fruit, country):
+self.product_weight = product_weight
+self.fruit = fruit
+self.country = country
```
The union takes place through the keys:
```
-func applyTransform(s beam.Scope, fruits beam.PCollection, countries
beam.PCollection) beam.PCollection {
- grouped := beam.CoGroupByKey(s, fruits, countries)
- return beam.ParDo(s, func(key string, weightIter func(*int) bool,
fruitIter func(*string) bool, emit func(string)) {
-
- wa := &WordsAlphabet{
- Country: key,
- }
- weightIter(&wa.ProductWeight)
- fruitIter(&wa.Fruit)
-emit(wa.String())
-
- }, grouped)
-}
+def apply_transforms(fruits, weights):
+def cogbk_result_to_product_weight(cgbk_result):
+(country, values) = cgbk_result
+return WordsAlphabet(values['weights'][0], values['fruits'][0],
country)
+
+return ({'fruits': fruits, 'weights': weights}
+| beam.CoGroupByKey()
+| beam.Map(cogbk_result_to_product_weight))
```
-{{end}}
\ No newline at end of file
+{{end}}
(beam) branch users/damccorm/tob-cgbk created (now e5382ce0641)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/tob-cgbk in repository https://gitbox.apache.org/repos/asf/beam.git at e5382ce0641 Fix tour of beam co-group-by-key python example This branch includes the following new commits: new e5382ce0641 Fix tour of beam co-group-by-key python example The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) branch asf-site updated: Publishing website 2023/12/14 23:39:56 at commit 52f4fc0
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new af6be1e7b1b Publishing website 2023/12/14 23:39:56 at commit 52f4fc0 af6be1e7b1b is described below commit af6be1e7b1beb4826c355543755efebe380a0085 Author: runner AuthorDate: Thu Dec 14 23:39:56 2023 + Publishing website 2023/12/14 23:39:56 at commit 52f4fc0 --- website/generated-content/sitemap.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml index f3df159e2ce..e12457fb4d6 100644 --- a/website/generated-content/sitemap.xml +++ b/website/generated-content/sitemap.xml @@ -1 +1 @@ -http://www.sitemaps.org/schemas/sitemap/0.9"; xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.52.0/2023-12-14T10:13:29-05:00/categories/blog/2023-12-14T10:13:29-05:00/blog/2023-12-14T10:13:29-05:00/categories/2023-12-14T10:13:29-05:00/catego [...] \ No newline at end of file +http://www.sitemaps.org/schemas/sitemap/0.9"; xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.52.0/2023-12-14T14:53:00-08:00/categories/blog/2023-12-14T14:53:00-08:00/blog/2023-12-14T14:53:00-08:00/categories/2023-12-14T14:53:00-08:00/catego [...] \ No newline at end of file
(beam) branch master updated: [Go SDK] Decrease sampling frequency for streaming jobs to avoid oversampling (#29774)
This is an automated email from the ASF dual-hosted git repository.
lostluck pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 52f4fc0c378 [Go SDK] Decrease sampling frequency for streaming jobs to
avoid oversampling (#29774)
52f4fc0c378 is described below
commit 52f4fc0c378650ada532ebfcf16e665646d9593e
Author: Zechen Jiang
AuthorDate: Thu Dec 14 14:53:00 2023 -0800
[Go SDK] Decrease sampling frequency for streaming jobs to avoid
oversampling (#29774)
---
sdks/go/pkg/beam/core/runtime/exec/datasink.go| 4 ++--
sdks/go/pkg/beam/core/runtime/exec/pcollection.go | 14 --
2 files changed, 10 insertions(+), 8 deletions(-)
diff --git a/sdks/go/pkg/beam/core/runtime/exec/datasink.go
b/sdks/go/pkg/beam/core/runtime/exec/datasink.go
index 6b39a2bb44f..a58c93083f5 100644
--- a/sdks/go/pkg/beam/core/runtime/exec/datasink.go
+++ b/sdks/go/pkg/beam/core/runtime/exec/datasink.go
@@ -60,7 +60,7 @@ func (n *DataSink) StartBundle(ctx context.Context, id
string, data DataContext)
// TODO[BEAM-6374): Properly handle the multiplex and flatten cases.
// Right now we just stop datasink collection.
if n.PCol != nil {
- atomic.StoreInt64(&n.PCol.elementCount, 0)
+ atomic.StoreInt64(&n.PCol.bundleElementCount, 0)
n.PCol.resetSize()
}
return nil
@@ -86,7 +86,7 @@ func (n *DataSink) ProcessElement(ctx context.Context, value
*FullValue, values
// TODO[BEAM-6374): Properly handle the multiplex and flatten cases.
// Right now we just stop datasink collection.
if n.PCol != nil {
- atomic.AddInt64(&n.PCol.elementCount, 1)
+ atomic.AddInt64(&n.PCol.bundleElementCount, 1)
n.PCol.addSize(int64(byteCount))
}
return nil
diff --git a/sdks/go/pkg/beam/core/runtime/exec/pcollection.go
b/sdks/go/pkg/beam/core/runtime/exec/pcollection.go
index ed13c65a6f5..6df2bd84653 100644
--- a/sdks/go/pkg/beam/core/runtime/exec/pcollection.go
+++ b/sdks/go/pkg/beam/core/runtime/exec/pcollection.go
@@ -46,7 +46,8 @@ type PCollection struct {
elementCoder ElementEncoder
windowCoder WindowEncoder
- elementCount int64 // must use atomic
operations.
+ bundleElementCount int64 // must use atomic
operations.
+ pCollectionElementCount int64 // track the total number of
elements this instance has processed. Local use only, no concurrent read/write.
sizeMu sync.Mutex
sizeCount, sizeSum, sizeMin, sizeMax int64
dataSampler *DataSampler
@@ -68,7 +69,7 @@ func (p *PCollection) Up(ctx context.Context) error {
// StartBundle resets collected metrics for this PCollection, and propagates
bundle start.
func (p *PCollection) StartBundle(ctx context.Context, id string, data
DataContext) error {
- atomic.StoreInt64(&p.elementCount, 0)
+ atomic.StoreInt64(&p.bundleElementCount, 0)
p.nextSampleIdx = 1
p.resetSize()
return MultiStartBundle(ctx, id, data, p.Out)
@@ -85,8 +86,8 @@ func (w *byteCounter) Write(p []byte) (n int, err error) {
// ProcessElement increments the element count and sometimes takes size
samples of the elements.
func (p *PCollection) ProcessElement(ctx context.Context, elm *FullValue,
values ...ReStream) error {
- cur := atomic.AddInt64(&p.elementCount, 1)
- if cur == p.nextSampleIdx {
+ cur := atomic.AddInt64(&p.bundleElementCount, 1)
+ if cur+p.pCollectionElementCount == p.nextSampleIdx {
// Always encode the first 3 elements. Otherwise...
// We pick the next sampling index based on how large this
pcollection already is.
// We don't want to necessarily wait until the pcollection has
doubled, so we reduce the range.
@@ -97,7 +98,7 @@ func (p *PCollection) ProcessElement(ctx context.Context, elm
*FullValue, values
if p.nextSampleIdx < 4 {
p.nextSampleIdx++
} else {
- p.nextSampleIdx = cur + p.r.Int63n(cur/10+2) + 1
+ p.nextSampleIdx = cur +
p.r.Int63n((cur+p.pCollectionElementCount)/10+2) + 1
}
if p.dataSampler == nil {
@@ -140,6 +141,7 @@ func (p *PCollection) resetSize() {
// FinishBundle propagates bundle termination.
func (p *PCollection) FinishBundle(ctx context.Context) error {
+ p.pCollectionElementCount += atomic.LoadInt64(&p.bundleElementCount)
return MultiFinishBundle(ctx, p.Out)
}
@@ -165,7 +167,7 @@ func (p *PCollection) snapshot() PCollectionSnapshot {
defer p.sizeMu.Unlock()
return PCollectionSnapshot{
ID: p.PColID,
- ElementCount:
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new a5a3a8ef04b Updating config from bot
a5a3a8ef04b is described below
commit a5a3a8ef04b8d65ab2a8f8812080fb45f91c81ec
Author: github-actions
AuthorDate: Thu Dec 14 21:52:02 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29774.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29774.json
b/scripts/ci/pr-bot/state/pr-state/pr-29774.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29774.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch dependabot/go_modules/sdks/github.com/google/uuid-1.5.0 deleted (was d6642b0b853)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/google/uuid-1.5.0 in repository https://gitbox.apache.org/repos/asf/beam.git was d6642b0b853 Bump github.com/google/uuid from 1.4.0 to 1.5.0 in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: Bump github.com/google/uuid from 1.4.0 to 1.5.0 in /sdks (#29733)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 1c7d178dd2b Bump github.com/google/uuid from 1.4.0 to 1.5.0 in /sdks (#29733) 1c7d178dd2b is described below commit 1c7d178dd2b7053b1f03463593985aee6474254c Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Thu Dec 14 16:18:22 2023 -0500 Bump github.com/google/uuid from 1.4.0 to 1.5.0 in /sdks (#29733) Bumps [github.com/google/uuid](https://github.com/google/uuid) from 1.4.0 to 1.5.0. - [Release notes](https://github.com/google/uuid/releases) - [Changelog](https://github.com/google/uuid/blob/master/CHANGELOG.md) - [Commits](https://github.com/google/uuid/compare/v1.4.0...v1.5.0) --- updated-dependencies: - dependency-name: github.com/google/uuid dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- sdks/go.mod | 2 +- sdks/go.sum | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/sdks/go.mod b/sdks/go.mod index 87c61f67597..2e3d61bea03 100644 --- a/sdks/go.mod +++ b/sdks/go.mod @@ -41,7 +41,7 @@ require ( github.com/go-sql-driver/mysql v1.7.1 github.com/golang/protobuf v1.5.3 // TODO(danoliveira): Fully replace this with google.golang.org/protobuf github.com/google/go-cmp v0.6.0 - github.com/google/uuid v1.4.0 + github.com/google/uuid v1.5.0 github.com/johannesboyne/gofakes3 v0.0.0-20221110173912-32fb85c5aed6 github.com/lib/pq v1.10.9 github.com/linkedin/goavro/v2 v2.12.0 diff --git a/sdks/go.sum b/sdks/go.sum index fe76820fc05..5ed3a4e198f 100644 --- a/sdks/go.sum +++ b/sdks/go.sum @@ -285,8 +285,8 @@ github.com/google/s2a-go v0.1.7 h1:60BLSyTrOV4/haCDW4zb1guZItoSq8foHCXrAnjBo/o= github.com/google/s2a-go v0.1.7/go.mod h1:50CgR4k1jNlWBu4UfS4AcfhVe1r6pdZPygJ3R8F0Qdw= github.com/google/uuid v1.1.2/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo= github.com/google/uuid v1.2.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo= -github.com/google/uuid v1.4.0 h1:MtMxsa51/r9yyhkyLsVeVt0B+BGQZzpQiTQ4eHZ8bc4= -github.com/google/uuid v1.4.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo= +github.com/google/uuid v1.5.0 h1:1p67kYwdtXjb0gL0BPiP1Av9wiZPo5A8z2cWkTZ+eyU= +github.com/google/uuid v1.5.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo= github.com/googleapis/enterprise-certificate-proxy v0.3.2 h1:Vie5ybvEvT75RniqhfFxPRy3Bf7vr3h0cechB90XaQs= github.com/googleapis/enterprise-certificate-proxy v0.3.2/go.mod h1:VLSiSSBs/ksPL8kq3OBOQ6WRI2QnaFynd1DCjZ62+V0= github.com/googleapis/gax-go/v2 v2.0.4/go.mod h1:0Wqv26UfaUD9n4G6kQubkQ+KchISgw+vpHVxEJEs9eg=
(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.47.5 deleted (was 19072d7db2f)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.47.5 in repository https://gitbox.apache.org/repos/asf/beam.git was 19072d7db2f Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.7 deleted (was 535f23a055e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.7 in repository https://gitbox.apache.org/repos/asf/beam.git was 535f23a055e Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/gradle/org.javacc.javacc-3.0.2 deleted (was 42990e51026)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/org.javacc.javacc-3.0.2 in repository https://gitbox.apache.org/repos/asf/beam.git was 42990e51026 Bump org.javacc.javacc from 3.0.0 to 3.0.2 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: Bump org.javacc.javacc from 3.0.0 to 3.0.2 (#29739)
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new d297cd531ee Bump org.javacc.javacc from 3.0.0 to 3.0.2 (#29739)
d297cd531ee is described below
commit d297cd531eeb7f705f91c3a893eeafae2a9537ec
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
AuthorDate: Thu Dec 14 16:10:18 2023 -0500
Bump org.javacc.javacc from 3.0.0 to 3.0.2 (#29739)
Bumps org.javacc.javacc from 3.0.0 to 3.0.2.
---
updated-dependencies:
- dependency-name: org.javacc.javacc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot]
Co-authored-by: dependabot[bot]
<49699333+dependabot[bot]@users.noreply.github.com>
---
settings.gradle.kts | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/settings.gradle.kts b/settings.gradle.kts
index 5a1136c4fa1..8a60d377f41 100644
--- a/settings.gradle.kts
+++ b/settings.gradle.kts
@@ -19,7 +19,7 @@ import
com.gradle.enterprise.gradleplugin.internal.extension.BuildScanExtensionW
pluginManagement {
plugins {
- id("org.javacc.javacc") version "3.0.0" // enable the JavaCC parser
generator
+ id("org.javacc.javacc") version "3.0.2" // enable the JavaCC parser
generator
}
}
(beam) branch dependabot/github_actions/actions/stale-9 deleted (was e84700ecc71)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/github_actions/actions/stale-9 in repository https://gitbox.apache.org/repos/asf/beam.git was e84700ecc71 Bump actions/stale from 8 to 9 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated (a81c9e8e38b -> 970a0bd9a92)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from a81c9e8e38b Bump actions/setup-python from 4 to 5 (#29654) add 970a0bd9a92 Bump actions/stale from 8 to 9 (#29682) No new revisions were added by this update. Summary of changes: .github/workflows/stale.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch dependabot/github_actions/actions/setup-python-5 deleted (was b0bcf313614)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/github_actions/actions/setup-python-5 in repository https://gitbox.apache.org/repos/asf/beam.git was b0bcf313614 Bump actions/setup-python from 4 to 5 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated (543b013a548 -> a81c9e8e38b)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 543b013a548 Bump com.gradle.enterprise from 3.15.1 to 3.16 (#29740) add a81c9e8e38b Bump actions/setup-python from 4 to 5 (#29654) No new revisions were added by this update. Summary of changes: .github/workflows/build_release_candidate.yml | 4 ++-- .github/workflows/build_wheels.yml| 4 ++-- .github/workflows/dask_runner_tests.yml | 4 ++-- .github/workflows/local_env_tests.yml | 4 ++-- .github/workflows/python_dependency_tests.yml | 2 +- .github/workflows/python_tests.yml| 8 .github/workflows/run_perf_alert_tool.yml | 2 +- .github/workflows/run_rc_validation.yml | 14 +++--- .github/workflows/typescript_tests.yml| 4 ++-- 9 files changed, 23 insertions(+), 23 deletions(-)
(beam) branch dependabot/gradle/com.gradle.enterprise-3.16 deleted (was e4ec43252db)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.gradle.enterprise-3.16 in repository https://gitbox.apache.org/repos/asf/beam.git was e4ec43252db Bump com.gradle.enterprise from 3.15.1 to 3.16 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/gradle/com.diffplug.spotless-6.23.3 deleted (was 92ce5225f3b)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.diffplug.spotless-6.23.3 in repository https://gitbox.apache.org/repos/asf/beam.git was 92ce5225f3b Bump com.diffplug.spotless from 5.6.1 to 6.23.3 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/gradle/org.ajoberstar.grgit-grgit-gradle-5.2.1 deleted (was 65237c830da)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/org.ajoberstar.grgit-grgit-gradle-5.2.1 in repository https://gitbox.apache.org/repos/asf/beam.git was 65237c830da Bump org.ajoberstar.grgit:grgit-gradle from 4.1.1 to 5.2.1 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 183b3e4abd9 Updating config from bot
183b3e4abd9 is described below
commit 183b3e4abd93ee099a5137a8fbcc7dd141d5c9d7
Author: github-actions
AuthorDate: Thu Dec 14 21:06:50 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 529e4ecf0dc..508685bf5b4 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -2,6 +2,6 @@
"label": "build",
"dateOfLastReviewAssignment": {
"damccorm": 1702586302878,
-"Abacn": 1702404385813
+"Abacn": 1702588007815
}
}
\ No newline at end of file
(beam) branch master updated (c4c9bb82723 -> 543b013a548)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from c4c9bb82723 Add 2.54.0 release section to CHANGES.md (#29757) add 543b013a548 Bump com.gradle.enterprise from 3.15.1 to 3.16 (#29740) No new revisions were added by this update. Summary of changes: settings.gradle.kts | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 7f1acdccbc0 Updating config from bot
7f1acdccbc0 is described below
commit 7f1acdccbc0137c91c44cb0bfddd6bae84ac8358
Author: github-actions
AuthorDate: Thu Dec 14 21:06:49 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29773.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29773.json
b/scripts/ci/pr-bot/state/pr-state/pr-29773.json
new file mode 100644
index 000..9c51466b9ee
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29773.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "Abacn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated: Add 2.54.0 release section to CHANGES.md (#29757)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new c4c9bb82723 Add 2.54.0 release section to CHANGES.md (#29757) c4c9bb82723 is described below commit c4c9bb82723deab622d3a49fca2b871f219fbe6e Author: Jack McCluskey <34928439+jrmcclus...@users.noreply.github.com> AuthorDate: Thu Dec 14 16:05:41 2023 -0500 Add 2.54.0 release section to CHANGES.md (#29757) --- CHANGES.md | 34 ++ 1 file changed, 34 insertions(+) diff --git a/CHANGES.md b/CHANGES.md index cf7ef0d4db0..b791dd806d4 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -53,6 +53,40 @@ * ([#X](https://github.com/apache/beam/issues/X)). --> +# [2.54.0] - Unreleased + +## Highlights + +* New highly anticipated feature X added to Python SDK ([#X](https://github.com/apache/beam/issues/X)). +* New highly anticipated feature Y added to Java SDK ([#Y](https://github.com/apache/beam/issues/Y)). + +## I/Os + +* Support for X source added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)). + +## New Features / Improvements + +* X feature added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)). + +## Breaking Changes + +* X behavior was changed ([#X](https://github.com/apache/beam/issues/X)). + +## Deprecations + +* X behavior is deprecated and will be removed in X versions ([#X](https://github.com/apache/beam/issues/X)). + +## Bugfixes + +* Fixed X (Java/Python) ([#X](https://github.com/apache/beam/issues/X)). + +## Security Fixes +* Fixed (CVE--)[https://www.cve.org/CVERecord?id=CVE--] (Java/Python/Go) ([#X](https://github.com/apache/beam/issues/X)). + +## Known Issues + +* ([#X](https://github.com/apache/beam/issues/X)). + # [2.53.0] - Unreleased ## Highlights
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 38d36eee5df Updating config from bot 38d36eee5df is described below commit 38d36eee5df4ea7eae12efced561285b25088773 Author: github-actions AuthorDate: Thu Dec 14 21:01:18 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29763.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29763.json b/scripts/ci/pr-bot/state/pr-state/pr-29763.json index 774e36bd490..7de3ca02373 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29763.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29763.json @@ -4,7 +4,7 @@ "build": "damccorm" }, "nextAction": "Reviewers", - "stopReviewerNotifications": false, + "stopReviewerNotifications": true, "remindAfterTestsPass": [], "committerAssigned": false } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 4aad376b172 Updating config from bot
4aad376b172 is described below
commit 4aad376b172282930f1478e7996c98708cf75df7
Author: github-actions
AuthorDate: Thu Dec 14 20:38:25 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 92058c3e4ee..529e4ecf0dc 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -1,7 +1,7 @@
{
"label": "build",
"dateOfLastReviewAssignment": {
-"damccorm": 1702383230637,
+"damccorm": 1702586302878,
"Abacn": 1702404385813
}
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new cba74c3c1a9 Updating config from bot
cba74c3c1a9 is described below
commit cba74c3c1a9567666ee7fcb18662853889d2922f
Author: github-actions
AuthorDate: Thu Dec 14 20:38:24 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29763.json | 6 --
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29763.json
b/scripts/ci/pr-bot/state/pr-state/pr-29763.json
index 242a48d7d3b..774e36bd490 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29763.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29763.json
@@ -1,7 +1,9 @@
{
"commentedAboutFailingChecks": true,
- "reviewersAssignedForLabels": {},
- "nextAction": "Author",
+ "reviewersAssignedForLabels": {
+"build": "damccorm"
+ },
+ "nextAction": "Reviewers",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
"committerAssigned": false
(beam) branch master updated: Bump Precommit Java Examples Timeouts (#29771)
This is an automated email from the ASF dual-hosted git repository.
jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 9e8a310f0c0 Bump Precommit Java Examples Timeouts (#29771)
9e8a310f0c0 is described below
commit 9e8a310f0c0faddfba28176df5893d8ad8fd10a0
Author: Jack McCluskey <34928439+jrmcclus...@users.noreply.github.com>
AuthorDate: Thu Dec 14 15:12:00 2023 -0500
Bump Precommit Java Examples Timeouts (#29771)
---
.github/workflows/beam_PreCommit_Java_Examples_Dataflow.yml| 2 +-
.github/workflows/beam_PreCommit_Java_Examples_Dataflow_Java21.yml | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/.github/workflows/beam_PreCommit_Java_Examples_Dataflow.yml
b/.github/workflows/beam_PreCommit_Java_Examples_Dataflow.yml
index ee372e84d74..88e2a77b18a 100644
--- a/.github/workflows/beam_PreCommit_Java_Examples_Dataflow.yml
+++ b/.github/workflows/beam_PreCommit_Java_Examples_Dataflow.yml
@@ -74,7 +74,7 @@ permissions:
jobs:
beam_PreCommit_Java_Examples_Dataflow:
name: ${{ matrix.job_name }} (${{ matrix.job_phrase }})
-timeout-minutes: 60
+timeout-minutes: 75
runs-on: [self-hosted, ubuntu-20.04, main]
strategy:
matrix:
diff --git a/.github/workflows/beam_PreCommit_Java_Examples_Dataflow_Java21.yml
b/.github/workflows/beam_PreCommit_Java_Examples_Dataflow_Java21.yml
index c411594c5c3..61a27004edd 100644
--- a/.github/workflows/beam_PreCommit_Java_Examples_Dataflow_Java21.yml
+++ b/.github/workflows/beam_PreCommit_Java_Examples_Dataflow_Java21.yml
@@ -77,7 +77,7 @@ jobs:
matrix:
job_name: ["beam_PreCommit_Java_Examples_Dataflow_Java21"]
job_phrase: ["Run Java_Examples_Dataflow_Java21 PreCommit"]
-timeout-minutes: 60
+timeout-minutes: 75
if: |
github.event_name == 'push' ||
github.event_name == 'pull_request_target' ||
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new f5e120f7270 Updating config from bot
f5e120f7270 is described below
commit f5e120f72706680737097110c517808e69ce1885
Author: github-actions
AuthorDate: Thu Dec 14 19:44:33 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29771.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29771.json
b/scripts/ci/pr-bot/state/pr-state/pr-29771.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29771.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated: [#28543][prism] Implement State API (#29712)
This is an automated email from the ASF dual-hosted git repository.
lostluck pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new bc42a637d56 [#28543][prism] Implement State API (#29712)
bc42a637d56 is described below
commit bc42a637d566b1dbc042632114afb539555ff353
Author: Robert Burke
AuthorDate: Thu Dec 14 10:45:17 2023 -0800
[#28543][prism] Implement State API (#29712)
---
.../pkg/beam/runners/prism/internal/engine/data.go | 176
.../prism/internal/engine/elementmanager.go| 226 -
.../runners/prism/internal/engine/engine_test.go | 159 +++
sdks/go/pkg/beam/runners/prism/internal/execute.go | 22 ++
.../beam/runners/prism/internal/execute_test.go| 8 +-
.../pkg/beam/runners/prism/internal/handlepardo.go | 9 +-
.../beam/runners/prism/internal/jobservices/job.go | 3 +-
.../prism/internal/jobservices/management.go | 20 +-
.../pkg/beam/runners/prism/internal/preprocess.go | 14 +-
sdks/go/pkg/beam/runners/prism/internal/stage.go | 22 +-
.../runners/prism/internal/unimplemented_test.go | 48 +++--
.../pkg/beam/runners/prism/internal/urns/urns.go | 5 +
.../beam/runners/prism/internal/worker/bundle.go | 6 +-
.../beam/runners/prism/internal/worker/worker.go | 89 ++--
sdks/go/test/integration/primitives/state.go | 53 +++--
15 files changed, 769 insertions(+), 91 deletions(-)
diff --git a/sdks/go/pkg/beam/runners/prism/internal/engine/data.go
b/sdks/go/pkg/beam/runners/prism/internal/engine/data.go
index 6fc192ac83b..6679f484aa2 100644
--- a/sdks/go/pkg/beam/runners/prism/internal/engine/data.go
+++ b/sdks/go/pkg/beam/runners/prism/internal/engine/data.go
@@ -15,10 +15,30 @@
package engine
+import (
+ "bytes"
+ "fmt"
+
+ "github.com/apache/beam/sdks/v2/go/pkg/beam/core/graph/coder"
+ "github.com/apache/beam/sdks/v2/go/pkg/beam/core/graph/window"
+ "github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec"
+ "github.com/apache/beam/sdks/v2/go/pkg/beam/core/typex"
+ "golang.org/x/exp/slog"
+)
+
+// StateData is a "union" between Bag state and MultiMap state to increase
common code.
+type StateData struct {
+ Bag [][]byte
+ Multimap map[string][][]byte
+}
+
// TentativeData is where data for in progress bundles is put
// until the bundle executes successfully.
type TentativeData struct {
Raw map[string][][]byte
+
+ // state is a map from transformID + UserStateID, to window, to
userKey, to datavalues.
+ state map[LinkID]map[typex.Window]map[string]StateData
}
// WriteData adds data to a given global collectionID.
@@ -28,3 +48,159 @@ func (d *TentativeData) WriteData(colID string, data
[]byte) {
}
d.Raw[colID] = append(d.Raw[colID], data)
}
+
+func (d *TentativeData) toWindow(wKey []byte) typex.Window {
+ if len(wKey) == 0 {
+ return window.GlobalWindow{}
+ }
+ // TODO: Custom Window handling.
+ w, err :=
exec.MakeWindowDecoder(coder.NewIntervalWindow()).DecodeSingle(bytes.NewBuffer(wKey))
+ if err != nil {
+ panic(fmt.Sprintf("error decoding append bag user state window
key %v: %v", wKey, err))
+ }
+ return w
+}
+
+// GetBagState retrieves available state from the tentative bundle data.
+// The stateID has the Transform and Local fields populated, for the Transform
and UserStateID respectively.
+func (d *TentativeData) GetBagState(stateID LinkID, wKey, uKey []byte)
[][]byte {
+ winMap := d.state[stateID]
+ w := d.toWindow(wKey)
+ data := winMap[w][string(uKey)]
+ slog.Debug("State() Bag.Get", slog.Any("StateID", stateID),
slog.Any("UserKey", uKey), slog.Any("Window", w), slog.Any("Data", data))
+ return data.Bag
+}
+
+func (d *TentativeData) appendState(stateID LinkID, wKey []byte)
map[string]StateData {
+ if d.state == nil {
+ d.state = map[LinkID]map[typex.Window]map[string]StateData{}
+ }
+ winMap, ok := d.state[stateID]
+ if !ok {
+ winMap = map[typex.Window]map[string]StateData{}
+ d.state[stateID] = winMap
+ }
+ w := d.toWindow(wKey)
+ kmap, ok := winMap[w]
+ if !ok {
+ kmap = map[string]StateData{}
+ winMap[w] = kmap
+ }
+ return kmap
+}
+
+// AppendBagState appends the incoming data to the existing tentative data
bundle.
+//
+// The stateID has the Transform and Local fields populated, for the Transform
and UserStateID respectively.
+func (d *TentativeData) AppendBagState(stateID LinkID, wKey, uKey, data
[]byte) {
+ kmap := d.appendState(stateID, wKey)
+ kmap[string(uKey)] = StateData{Bag: append(kmap[string(uKey)].Bag,
data)}
+ slog.Debug("State() Bag.Append", slog.Any("StateID", stateID),
slog.Any("
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new fcd3ae815db Updating config from bot
fcd3ae815db is described below
commit fcd3ae815db356e2c20b52b73a3d16440ef46de5
Author: github-actions
AuthorDate: Thu Dec 14 17:34:29 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29768.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29768.json
b/scripts/ci/pr-bot/state/pr-state/pr-29768.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29768.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch release-2.53.0 updated: test revert _beam_schema_proto (#29754) (#29759)
This is an automated email from the ASF dual-hosted git repository. jrmccluskey pushed a commit to branch release-2.53.0 in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/release-2.53.0 by this push: new 03e90360272 test revert _beam_schema_proto (#29754) (#29759) 03e90360272 is described below commit 03e90360272ba35ffd15a6e2a10a70d984dc3be1 Author: Ritesh Ghorse AuthorDate: Thu Dec 14 11:09:54 2023 -0500 test revert _beam_schema_proto (#29754) (#29759) --- sdks/python/apache_beam/typehints/schemas.py | 1 - 1 file changed, 1 deletion(-) diff --git a/sdks/python/apache_beam/typehints/schemas.py b/sdks/python/apache_beam/typehints/schemas.py index 6a6544aaa07..b8176dccb8e 100644 --- a/sdks/python/apache_beam/typehints/schemas.py +++ b/sdks/python/apache_beam/typehints/schemas.py @@ -561,7 +561,6 @@ class SchemaTranslation(object): '__reduce__', _named_tuple_reduce_method(schema.SerializeToString())) setattr(user_type, row_type._BEAM_SCHEMA_ID, schema.id) -user_type._beam_schema_proto = _Ephemeral(schema) self.schema_registry.add(user_type, schema) coders.registry.register_coder(user_type, coders.RowCoder)
(beam) branch master updated: Add user-agent string for Beam in the GCS request header. (#29765)
This is an automated email from the ASF dual-hosted git repository.
jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 1ce707c3865 Add user-agent string for Beam in the GCS request header.
(#29765)
1ce707c3865 is described below
commit 1ce707c38650a7f9c5120061adfeed37889cc634
Author: Shunping Huang
AuthorDate: Thu Dec 14 10:13:29 2023 -0500
Add user-agent string for Beam in the GCS request header. (#29765)
---
sdks/python/apache_beam/io/gcp/gcsio.py | 7 ++-
sdks/python/apache_beam/runners/dataflow/internal/apiclient.py| 6 +-
sdks/python/apache_beam/runners/interactive/utils.py | 8 +++-
.../apache_beam/runners/portability/sdk_container_builder.py | 6 +-
sdks/python/setup.py | 2 +-
5 files changed, 24 insertions(+), 5 deletions(-)
diff --git a/sdks/python/apache_beam/io/gcp/gcsio.py
b/sdks/python/apache_beam/io/gcp/gcsio.py
index 838c956b6cf..087d32a9e05 100644
--- a/sdks/python/apache_beam/io/gcp/gcsio.py
+++ b/sdks/python/apache_beam/io/gcp/gcsio.py
@@ -40,6 +40,7 @@ from google.cloud.exceptions import NotFound
from google.cloud.storage.fileio import BlobReader
from google.cloud.storage.fileio import BlobWriter
+from apache_beam import version as beam_version
from apache_beam.internal.gcp import auth
from apache_beam.options.pipeline_options import GoogleCloudOptions
from apache_beam.options.pipeline_options import PipelineOptions
@@ -111,7 +112,11 @@ class GcsIO(object):
if credentials:
storage_client = storage.Client(
credentials=credentials.get_google_auth_credentials(),
-project=pipeline_options.view_as(GoogleCloudOptions).project)
+project=pipeline_options.view_as(GoogleCloudOptions).project,
+extra_headers={
+"User-Agent": "apache-beam/%s (GPN:Beam)" %
+beam_version.__version__
+})
else:
storage_client = storage.Client.create_anonymous_client()
self.client = storage_client
diff --git a/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py
b/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py
index c313268cafc..2ef50b3c2ed 100644
--- a/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py
+++ b/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py
@@ -514,7 +514,11 @@ class DataflowApplicationClient(object):
# client in terms of which GCP project to use.
self._storage_client = storage.Client(
credentials=storage_credentials,
- project=self.google_cloud_options.project)
+ project=self.google_cloud_options.project,
+ extra_headers={
+ "User-Agent": "apache-beam/%s (GPN:Beam)" %
+ beam_version.__version__
+ })
else:
self._storage_client = storage.Client.create_anonymous_client()
self._sdk_image_overrides = self._get_sdk_image_overrides(options)
diff --git a/sdks/python/apache_beam/runners/interactive/utils.py
b/sdks/python/apache_beam/runners/interactive/utils.py
index 78fc26b95e6..524e532c2e3 100644
--- a/sdks/python/apache_beam/runners/interactive/utils.py
+++ b/sdks/python/apache_beam/runners/interactive/utils.py
@@ -30,6 +30,7 @@ from typing import Tuple
import pandas as pd
import apache_beam as beam
+from apache_beam import version as beam_version
from apache_beam.dataframe.convert import to_pcollection
from apache_beam.dataframe.frame_base import DeferredBase
from apache_beam.internal.gcp import auth
@@ -457,7 +458,12 @@ def assert_bucket_exists(bucket_name):
# We set project to None, so it will not try to use project id from
# the environment (ADC).
storage_client = storage.Client(
- credentials=credentials.get_google_auth_credentials(), project=None)
+ credentials=credentials.get_google_auth_credentials(),
+ project=None,
+ extra_headers={
+ "User-Agent": "apache-beam/%s (GPN:Beam)" %
+ beam_version.__version__
+ })
else:
storage_client = storage.Client.create_anonymous_client()
storage_client.get_bucket(bucket_name)
diff --git
a/sdks/python/apache_beam/runners/portability/sdk_container_builder.py
b/sdks/python/apache_beam/runners/portability/sdk_container_builder.py
index ea86eafcc34..d5d1bca981d 100644
--- a/sdks/python/apache_beam/runners/portability/sdk_container_builder.py
+++ b/sdks/python/apache_beam/runners/portability/sdk_container_builder.py
@@ -213,7 +213,11 @@ class
_SdkContainerImageCloudBuilder(SdkContainerImageBuilder):
if credentials:
self._storage_client = storage.Client(
credentials=credentials.get_google_auth_credentials(),
- project=self._google_cloud_options.project)
+ project=self._googl
(beam) branch release-2.53.0 updated: [#29760] Only respond to sampling request while data sampling is enabled (#29764)
This is an automated email from the ASF dual-hosted git repository.
jrmccluskey pushed a commit to branch release-2.53.0
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/release-2.53.0 by this push:
new f773123d430 [#29760] Only respond to sampling request while data
sampling is enabled (#29764)
f773123d430 is described below
commit f773123d430e0c2420d4cca80db59f301fbeb953
Author: Robert Burke
AuthorDate: Thu Dec 14 07:11:10 2023 -0800
[#29760] Only respond to sampling request while data sampling is enabled
(#29764)
* Only respond to sampling request while data sampling is enabled
* do not fail runner when data sampling is not enabled
-
Co-authored-by: Zechen Jiang
---
sdks/go/pkg/beam/core/runtime/harness/harness.go | 22 --
1 file changed, 12 insertions(+), 10 deletions(-)
diff --git a/sdks/go/pkg/beam/core/runtime/harness/harness.go
b/sdks/go/pkg/beam/core/runtime/harness/harness.go
index 6a66c81a0a6..2888b39853e 100644
--- a/sdks/go/pkg/beam/core/runtime/harness/harness.go
+++ b/sdks/go/pkg/beam/core/runtime/harness/harness.go
@@ -665,19 +665,21 @@ func (c *control) handleInstruction(ctx context.Context,
req *fnpb.InstructionRe
case req.GetSampleData() != nil:
msg := req.GetSampleData()
var samples =
make(map[string]*fnpb.SampleDataResponse_ElementList)
- var elementsMap =
c.dataSampler.GetSamples(msg.GetPcollectionIds())
-
- for pid, elements := range elementsMap {
- var elementList fnpb.SampleDataResponse_ElementList
- for i := range elements {
- var sampledElement = &fnpb.SampledElement{
- Element: elements[i].Element,
- SampleTimestamp:
timestamppb.New(elements[i].Timestamp),
+ if c.dataSampler != nil {
+ var elementsMap =
c.dataSampler.GetSamples(msg.GetPcollectionIds())
+ for pid, elements := range elementsMap {
+ var elementList
fnpb.SampleDataResponse_ElementList
+ for i := range elements {
+ var sampledElement =
&fnpb.SampledElement{
+ Element:
elements[i].Element,
+ SampleTimestamp:
timestamppb.New(elements[i].Timestamp),
+ }
+ elementList.Elements =
append(elementList.Elements, sampledElement)
}
- elementList.Elements =
append(elementList.Elements, sampledElement)
+ samples[pid] = &elementList
}
- samples[pid] = &elementList
}
+
return &fnpb.InstructionResponse{
InstructionId: string(instID),
Response: &fnpb.InstructionResponse_SampleData{
(beam) branch dependabot/go_modules/sdks/google.golang.org/grpc-1.60.0 deleted (was 933e0b01972)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/google.golang.org/grpc-1.60.0 in repository https://gitbox.apache.org/repos/asf/beam.git was 933e0b01972 Bump google.golang.org/grpc from 1.59.0 to 1.60.0 in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated (75746c6fe4a -> 00462b13cc1)
This is an automated email from the ASF dual-hosted git repository. jrmccluskey pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 75746c6fe4a Bump cloud.google.com/go/storage from 1.35.1 to 1.36.0 in /sdks (#29767) add 00462b13cc1 Bump google.golang.org/grpc from 1.59.0 to 1.60.0 in /sdks (#29714) No new revisions were added by this update. Summary of changes: sdks/go.mod | 4 ++-- sdks/go.sum | 9 + 2 files changed, 7 insertions(+), 6 deletions(-)
(beam) branch dependabot/go_modules/sdks/cloud.google.com/go/storage-1.36.0 deleted (was 186e5b61e1d)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/cloud.google.com/go/storage-1.36.0 in repository https://gitbox.apache.org/repos/asf/beam.git was 186e5b61e1d Bump cloud.google.com/go/storage from 1.35.1 to 1.36.0 in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: Bump cloud.google.com/go/storage from 1.35.1 to 1.36.0 in /sdks (#29767)
This is an automated email from the ASF dual-hosted git repository. riteshghorse pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 75746c6fe4a Bump cloud.google.com/go/storage from 1.35.1 to 1.36.0 in /sdks (#29767) 75746c6fe4a is described below commit 75746c6fe4a5489b6ec584569a7dc8eba14f537b Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Thu Dec 14 09:24:41 2023 -0500 Bump cloud.google.com/go/storage from 1.35.1 to 1.36.0 in /sdks (#29767) Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.35.1 to 1.36.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](https://github.com/googleapis/google-cloud-go/compare/storage/v1.35.1...spanner/v1.36.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/storage dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- sdks/go.mod | 2 +- sdks/go.sum | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/sdks/go.mod b/sdks/go.mod index b186a42930e..075df0812ca 100644 --- a/sdks/go.mod +++ b/sdks/go.mod @@ -29,7 +29,7 @@ require ( cloud.google.com/go/profiler v0.4.0 cloud.google.com/go/pubsub v1.33.0 cloud.google.com/go/spanner v1.53.1 - cloud.google.com/go/storage v1.35.1 + cloud.google.com/go/storage v1.36.0 github.com/aws/aws-sdk-go-v2 v1.24.0 github.com/aws/aws-sdk-go-v2/config v1.26.1 github.com/aws/aws-sdk-go-v2/credentials v1.16.12 diff --git a/sdks/go.sum b/sdks/go.sum index 763f2708075..284879e23c6 100644 --- a/sdks/go.sum +++ b/sdks/go.sum @@ -43,8 +43,8 @@ cloud.google.com/go/spanner v1.53.1/go.mod h1:liG4iCeLqm5L3fFLU5whFITqP0e0orsAW1 cloud.google.com/go/storage v1.0.0/go.mod h1:IhtSnM/ZTZV8YYJWCY8RULGVqBDmpoyjwiyrjsg+URw= cloud.google.com/go/storage v1.5.0/go.mod h1:tpKbwo567HUNpVclU5sGELwQWBDZ8gh0ZeosJ0Rtdos= cloud.google.com/go/storage v1.6.0/go.mod h1:N7U0C8pVQ/+NIKOBQyamJIeKQKkZ+mxpohlUTyfDhBk= -cloud.google.com/go/storage v1.35.1 h1:B59ahL//eDfx2IIKFBeT5Atm9wnNmj3+8xG/W4WB//w= -cloud.google.com/go/storage v1.35.1/go.mod h1:M6M/3V/D3KpzMTJyPOR/HU6n2Si5QdaXYEsng2xgOs8= +cloud.google.com/go/storage v1.36.0 h1:P0mOkAcaJxhCTvAkMhxMfrTKiNcub4YmmPBtlhAyTr8= +cloud.google.com/go/storage v1.36.0/go.mod h1:M6M/3V/D3KpzMTJyPOR/HU6n2Si5QdaXYEsng2xgOs8= dario.cat/mergo v1.0.0 h1:AGCNq9Evsj31mOgNPcLyXc+4PNABt905YmuqPYYpBWk= dario.cat/mergo v1.0.0/go.mod h1:uNxQE+84aUszobStD9th8a29P2fMDhsBdgRYvZOxGmk= dmitri.shuralyov.com/gpu/mtl v0.0.0-20190408044501-666a987793e9/go.mod h1:H6x//7gZCb22OMCxBHrMx7a5I7Hp++hsVxbQ4BYO7hU=
