(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 7530f0d3f40 Updating config from bot
7530f0d3f40 is described below
commit 7530f0d3f406e5c084d9f6cc505a93fbb9d0d991
Author: github-actions
AuthorDate: Thu Apr 18 05:06:22 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31032.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31032.json
b/scripts/ci/pr-bot/state/pr-state/pr-31032.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31032.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 30679507c57 Updating config from bot
30679507c57 is described below
commit 30679507c57e2fa55230635fd3e2c5bb21f0ea28
Author: github-actions
AuthorDate: Thu Apr 18 05:06:20 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31033.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31033.json
b/scripts/ci/pr-bot/state/pr-state/pr-31033.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31033.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch dependabot/gradle/com.gradle.common-custom-user-data-gradle-plugin-2.0.1 created (now d6690fae8ff)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.gradle.common-custom-user-data-gradle-plugin-2.0.1 in repository https://gitbox.apache.org/repos/asf/beam.git at d6690fae8ff Bump com.gradle.common-custom-user-data-gradle-plugin No new revisions were added by this update.
(beam) branch dependabot/gradle/commons-cli-commons-cli-1.7.0 created (now 5ef29b15910)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/commons-cli-commons-cli-1.7.0 in repository https://gitbox.apache.org/repos/asf/beam.git at 5ef29b15910 Bump commons-cli:commons-cli from 1.6.0 to 1.7.0 No new revisions were added by this update.
(beam) branch dependabot/gradle/com.gradle.enterprise-3.17.1 deleted (was 7c449fc4415)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.gradle.enterprise-3.17.1 in repository https://gitbox.apache.org/repos/asf/beam.git was 7c449fc4415 Bump com.gradle.enterprise from 3.15.1 to 3.17.1 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/gradle/com.gradle.common-custom-user-data-gradle-plugin-2.0 deleted (was 183a221077c)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.gradle.common-custom-user-data-gradle-plugin-2.0 in repository https://gitbox.apache.org/repos/asf/beam.git was 183a221077c Bump com.gradle.common-custom-user-data-gradle-plugin from 1.12.1 to 2.0 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/gradle/com.gradle.enterprise-3.17.2 created (now 22535521e7b)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.gradle.enterprise-3.17.2 in repository https://gitbox.apache.org/repos/asf/beam.git at 22535521e7b Bump com.gradle.enterprise from 3.15.1 to 3.17.2 No new revisions were added by this update.
(beam) branch nightly-refs/heads/master updated (6366bd4c890 -> 4f964bf05d5)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 6366bd4c890 Disable profiling in cythonized code by default. (#30938)
add 8092932a2e1 [#30941]fix upgrade test due to missed config
ConsumerPollingTimeout (#30998)
add 9947260deba fix naming changes caused by setuptools (#31012)
add a26c5055ccc Downgrade google-api-core to mitigate #30927 (#31004)
add 27643432ea9 [yaml] backtick generated aliases on sql mappings (#30895)
add 6624d952bbd Cache parsed metrics in StreamingStepMetricsContainer
(#31005)
add e48a9351d2f add Yaml_Xlang_Direct PreCommit to README (#31009)
add deee0e9cc8c [flink] add support for Flink 1.17 (#29939)
add d70c25328ee Merge pull request #30197: Flink 1.17
add 38a8b5f7047 Create YAML Join Transform (#30734)
add a207e4e8bbe Revert "Docker - Remove Deprecated Types (#30826)" (#31010)
add 05b7146656a Add /job/cancel endpoint to prism web server. (#30825)
add 1e8a16d9eae Use base 2 exponential histograms in BigQuerySinkMetrics
(#31000)
add 7159beac55f Minor updates to StreamingInsertsMetrics (#31003)
add 5c6bc39a44d Moving to 2.57.0-SNAPSHOT on master branch.
add e4baee698d8 [runners-flink] remove 1.12 and 1.13 runners
add 3cfc160b512 Merge pull request #30988: Remove flink 1.12 1.13
add b134e72a068 [changes] Update CHANGES.md (#29939) (#31017)
add 3822f551dfc remove CLOUDSDK (#31016)
add d6eb576d037 Allow IFrames to youtube. (#31021)
add e3077b7460c add new user info to metrics Readme (#30989)
add 4f964bf05d5 Fix workflow param value for Grafana link (#31011)
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 1 +
...am_PostCommit_Python_ValidatesRunner_Flink.json | 0
.github/workflows/README.md| 2 +
.../beam_PostCommit_Java_ValidatesRunner_Flink.yml | 4 +-
...eam_PostCommit_XVR_JavaUsingPython_Dataflow.yml | 2 -
.../workflows/beam_PreCommit_Yaml_Xlang_Direct.yml | 4 +-
.github/workflows/dask_runner_tests.yml| 2 +-
.github/workflows/python_tests.yml | 2 +-
.test-infra/metrics/README.md | 7 +
.../github/github_runs_prefetcher/code/main.py | 34 ++-
.test-infra/tools/flaky_test_detection.py | 2 +-
CHANGES.md | 3 +-
gradle.properties | 6 +-
release/build.gradle.kts | 2 +-
runners/flink/1.12/build.gradle| 33 ---
.../streaming/AbstractStreamOperatorCompat.java| 94 ---
.../io/source/compat/FlinkSourceCompat.java| 31 ---
.../io/source/compat/SplitEnumeratorCompat.java| 27 --
.../beam/runners/flink/RemoteMiniClusterImpl.java | 68 -
.../runners/flink/metrics/MetricGroupWrapper.java | 31 ---
.../runners/flink/streaming/StreamSources.java | 72 --
.../streaming/io/source/SourceTestCompat.java | 75 --
runners/flink/1.13/build.gradle| 33 ---
runners/flink/1.13/job-server/build.gradle | 31 ---
runners/flink/1.14/build.gradle| 13 +-
.../translation/types/CoderTypeSerializer.java | 10 +-
.../streaming/ProcessingTimeCallbackCompat.java| 0
.../io/source/compat/SplitEnumeratorCompat.java| 0
.../streaming/io/source/compat/package-info.java | 0
.../beam/runners/flink/MiniClusterCompat.java | 0
.../translation/types/CoderTypeSerializerTest.java | 2 +-
runners/flink/1.15/build.gradle| 13 +-
runners/flink/1.16/build.gradle| 13 +-
.../job-server-container => 1.17}/build.gradle | 7 +-
.../job-server-container/build.gradle | 0
.../flink/{1.12 => 1.17}/job-server/build.gradle | 2 +-
.../translation/types/CoderTypeSerializer.java | 31 +--
runners/flink/flink_runner.gradle | 35 ++-
.../types/UnversionedTypeSerializerSnapshot.java | 86 +++
.../streaming/io/source/FlinkSourceReaderBase.java | 2 -
.../UnversionedTypeSerializerSnapshotTest.java | 52
.../MetricsToPerStepNamespaceMetricsConverter.java | 37 ++-
.../worker/StreamingStepMetricsContainer.java | 25 +-
...ricsToPerStepNamespaceMetricsConverterTest.java | 60 -
.../worker/StreamingStepMetricsContainerTest.java | 35 ++-
sdks/go/examples/stringsplit/stringsplit.go| 2 +-
sdks/go/pkg/beam/core/core.go | 2 +-
.../beam/runners/prism/internal/environments.go| 4 +-
sdks/go/pkg/beam/runners/prism/internal/web/web.go | 57 +
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 12 +-
.../sdk/io/gcp/bigquery/BigQuerySinkMetrics.java | 7 +-
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 06cd9039c8d Updating config from bot 06cd9039c8d is described below commit 06cd9039c8d696ea0a18a9d8a9c339db2336c571 Author: github-actions AuthorDate: Thu Apr 18 00:49:11 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json b/scripts/ci/pr-bot/state/reviewers-for-label-python.json index e89d281c2b3..08c5a68710c 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json @@ -9,7 +9,7 @@ "pabloem": 1681281324703, "y1chi": 1667002607045, "damccorm": 1713318705495, -"jrmccluskey": 1713228570806, +"jrmccluskey": 1713401349432, "riteshghorse": 1713274474831, "liferoad": 1713297957925, "shunping": 1713384363515
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 5d5c7e58378 Updating config from bot
5d5c7e58378 is described below
commit 5d5c7e58378d1b062d22c75c0efe417067e66cb0
Author: github-actions
AuthorDate: Thu Apr 18 00:49:10 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31029.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31029.json
b/scripts/ci/pr-bot/state/pr-state/pr-31029.json
new file mode 100644
index 000..959c289c017
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31029.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"python": "jrmccluskey"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new aa5bdef3620 Updating config from bot aa5bdef3620 is described below commit aa5bdef362020193f4f0c396e11229aeff9691a0 Author: github-actions AuthorDate: Thu Apr 18 00:19:43 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json index 35bc7db0df5..910930edcf0 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json @@ -5,7 +5,7 @@ "AnandInguva": 1710144575340, "chamikaramj": 1713058448533, "damccorm": 1713357664828, -"johnjcasey": 1712322355017, +"johnjcasey": 1713399580129, "jrmccluskey": 1712595975431, "kennknowles": 1712453421772, "lostluck": 1712853284277,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 126de1e5459 Updating config from bot
126de1e5459 is described below
commit 126de1e5459422ee3d3dd91975a74dfe452aec40
Author: github-actions
AuthorDate: Thu Apr 18 00:19:41 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30999.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30999.json
b/scripts/ci/pr-bot/state/pr-state/pr-30999.json
new file mode 100644
index 000..b29414341ff
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30999.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"no-matching-label": "johnjcasey"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch asf-site updated: Publishing website 2024/04/17 23:37:54 at commit 4f964bf
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new a51f6a2e24d Publishing website 2024/04/17 23:37:54 at commit 4f964bf a51f6a2e24d is described below commit a51f6a2e24d445377f86ea460168b07385f0f4cc Author: runner AuthorDate: Wed Apr 17 23:37:54 2024 + Publishing website 2024/04/17 23:37:54 at commit 4f964bf --- website/generated-content/.htaccess | 2 +- website/generated-content/documentation/dsls/sql/shell/index.html | 6 +++--- website/generated-content/documentation/runners/flink/index.html | 2 +- website/generated-content/sitemap.xml | 2 +- 4 files changed, 6 insertions(+), 6 deletions(-) diff --git a/website/generated-content/.htaccess b/website/generated-content/.htaccess index d8251734dde..a93e707fdb3 100644 --- a/website/generated-content/.htaccess +++ b/website/generated-content/.htaccess @@ -27,4 +27,4 @@ RedirectMatch "/contribute/release-guide" "https://github.com/apache/beam/blob/m RedirectMatch "/contribute/committer-guide" "https://github.com/apache/beam/blob/master/contributor-docs/committer-guide.md; -Header set Content-Security-Policy "frame-src 'self' https://play.beam.apache.org/ ;" +Header set Content-Security-Policy "frame-src 'self' https://play.beam.apache.org/ https://youtube.com/ ;" diff --git a/website/generated-content/documentation/dsls/sql/shell/index.html b/website/generated-content/documentation/dsls/sql/shell/index.html index 396a2f116ca..d220381b555 100644 --- a/website/generated-content/documentation/dsls/sql/shell/index.html +++ b/website/generated-content/documentation/dsls/sql/shell/index.html @@ -35,7 +35,7 @@ https://beam.apache.org/documentation/ml/overview/>
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new d266eda4319 Updating config from bot
d266eda4319 is described below
commit d266eda4319779ca3c9f7e681d50e006640b3491
Author: github-actions
AuthorDate: Wed Apr 17 23:10:34 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31019.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31019.json
b/scripts/ci/pr-bot/state/pr-state/pr-31019.json
index a00c58524cd..4cb682bcaa0 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-31019.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31019.json
@@ -3,7 +3,7 @@
"reviewersAssignedForLabels": {
"website": "kennknowles"
},
- "nextAction": "Reviewers",
+ "nextAction": "Author",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
"committerAssigned": false
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 87eb392fdf5 Updating config from bot
87eb392fdf5 is described below
commit 87eb392fdf52739abf761ca247465777a1e4ef47
Author: github-actions
AuthorDate: Wed Apr 17 23:05:57 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31028.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31028.json
b/scripts/ci/pr-bot/state/pr-state/pr-31028.json
new file mode 100644
index 000..1c2c2e31975
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31028.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"go": "jrmccluskey"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 23cb12894fc Updating config from bot
23cb12894fc is described below
commit 23cb12894fc9cad92a0c59460eb386e60d8bea49
Author: github-actions
AuthorDate: Wed Apr 17 23:05:58 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index 43f66cf3eaa..4caef3f3c4d 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -2,7 +2,7 @@
"label": "go",
"dateOfLastReviewAssignment": {
"lostluck": 1713355761561,
-"jrmccluskey": 1712552757469,
+"jrmccluskey": 1713395156069,
"youngoli": 1657688896155,
"damccorm": 1680501930289,
"riteshghorse": 1713269616781
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 20c27ccca6d Updating config from bot
20c27ccca6d is described below
commit 20c27ccca6d7491e2451e4a3962a1b21e1ae44ea
Author: github-actions
AuthorDate: Wed Apr 17 21:35:13 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31027.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31027.json
b/scripts/ci/pr-bot/state/pr-state/pr-31027.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31027.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new ec4c8d60c57 Updating config from bot
ec4c8d60c57 is described below
commit ec4c8d60c5773d545dc5276fee703e510aba0714
Author: github-actions
AuthorDate: Wed Apr 17 21:35:15 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31026.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31026.json
b/scripts/ci/pr-bot/state/pr-state/pr-31026.json
new file mode 100644
index 000..321b31c0f05
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31026.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"python": "tvalentyn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 54fe0c99d18 Updating config from bot 54fe0c99d18 is described below commit 54fe0c99d184594baf9381a916289efa042bebb4 Author: github-actions AuthorDate: Wed Apr 17 21:35:16 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json b/scripts/ci/pr-bot/state/reviewers-for-label-python.json index 4e53298608d..e89d281c2b3 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json @@ -5,7 +5,7 @@ "yeandy": 1665802753763, "TheNeuralBit": 1667896849319, "ryanthompson591": 1670002443548, -"tvalentyn": 1713226756133, +"tvalentyn": 1713389714559, "pabloem": 1681281324703, "y1chi": 1667002607045, "damccorm": 1713318705495,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 3135ffd8441 Updating config from bot
3135ffd8441 is described below
commit 3135ffd844113411aa250f7eb2307776a6f26a79
Author: github-actions
AuthorDate: Wed Apr 17 21:06:26 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31025.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31025.json
b/scripts/ci/pr-bot/state/pr-state/pr-31025.json
new file mode 100644
index 000..1c736ae3495
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31025.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"java": "Abacn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new e3332664f86 Updating config from bot e3332664f86 is described below commit e3332664f8642132a49221858bdf6c0c71fbc809 Author: github-actions AuthorDate: Wed Apr 17 21:06:28 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json b/scripts/ci/pr-bot/state/reviewers-for-label-java.json index 3e62ecaa319..e84c17c3e07 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json @@ -6,7 +6,7 @@ "robertwb": 1713297957925, "kileys": 1674428678843, "apilloud": 1678822446183, -"Abacn": 1712730964541, +"Abacn": 1713387985633, "bvolpato": 1712595969392, "m-trieu": 1713290776308, "damondouglas": 1713356027654
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 0398dc5e40e Updating config from bot 0398dc5e40e is described below commit 0398dc5e40e311994e569bf68051335fadf2848d Author: github-actions AuthorDate: Wed Apr 17 20:06:07 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json b/scripts/ci/pr-bot/state/reviewers-for-label-python.json index 65b3762eba3..4e53298608d 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json @@ -12,6 +12,6 @@ "jrmccluskey": 1713228570806, "riteshghorse": 1713274474831, "liferoad": 1713297957925, -"shunping": 1713226749138 +"shunping": 1713384363515 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 933461c68a2 Updating config from bot
933461c68a2 is described below
commit 933461c68a25c581448f550665d417f5dd85
Author: github-actions
AuthorDate: Wed Apr 17 20:06:05 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31023.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31023.json
b/scripts/ci/pr-bot/state/pr-state/pr-31023.json
new file mode 100644
index 000..28c0f36dc93
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31023.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"python": "shunping"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated (e3077b7460c -> 4f964bf05d5)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from e3077b7460c add new user info to metrics Readme (#30989) add 4f964bf05d5 Fix workflow param value for Grafana link (#31011) No new revisions were added by this update. Summary of changes: .test-infra/tools/flaky_test_detection.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch master updated (d6eb576d037 -> e3077b7460c)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from d6eb576d037 Allow IFrames to youtube. (#31021) add e3077b7460c add new user info to metrics Readme (#30989) No new revisions were added by this update. Summary of changes: .test-infra/metrics/README.md | 7 + .../github/github_runs_prefetcher/code/main.py | 34 +- 2 files changed, 33 insertions(+), 8 deletions(-)
(beam) branch damccorm-patch-1 created (now 19d837d1bf2)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch damccorm-patch-1 in repository https://gitbox.apache.org/repos/asf/beam.git at 19d837d1bf2 Re-enable schedule trigger for PostCommit Java IO Performance Tests This branch includes the following new commits: new 19d837d1bf2 Re-enable schedule trigger for PostCommit Java IO Performance Tests The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) 01/01: Re-enable schedule trigger for PostCommit Java IO Performance Tests
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch damccorm-patch-1
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 19d837d1bf2e4d1abf27ad569e4d81f4a527e7af
Author: Danny McCormick
AuthorDate: Wed Apr 17 15:58:21 2024 -0400
Re-enable schedule trigger for PostCommit Java IO Performance Tests
---
.github/workflows/beam_PostCommit_Java_IO_Performance_Tests.yml | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/.github/workflows/beam_PostCommit_Java_IO_Performance_Tests.yml
b/.github/workflows/beam_PostCommit_Java_IO_Performance_Tests.yml
index 63319789cb0..6a9565bdbd1 100644
--- a/.github/workflows/beam_PostCommit_Java_IO_Performance_Tests.yml
+++ b/.github/workflows/beam_PostCommit_Java_IO_Performance_Tests.yml
@@ -18,8 +18,8 @@ name: PostCommit Java IO Performance Tests
on:
issue_comment:
types: [created]
-# schedule:
-# - cron: '0 4/6 * * *'
+ schedule:
+ - cron: '0 4/6 * * *'
pull_request_target:
paths: ['release/trigger_all_tests.json',
'.github/trigger_files/beam_PostCommit_Java_IO_Performance_Tests.json']
workflow_dispatch:
@@ -127,4 +127,4 @@ jobs:
with:
commit: '${{ env.prsha || env.GITHUB_SHA }}'
comment_mode: ${{ github.event_name == 'issue_comment' && 'always' ||
'off' }}
-files: '**/build/test-results/**/*.xml'
\ No newline at end of file
+files: '**/build/test-results/**/*.xml'
(beam) branch master updated (3822f551dfc -> d6eb576d037)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 3822f551dfc remove CLOUDSDK (#31016) add d6eb576d037 Allow IFrames to youtube. (#31021) No new revisions were added by this update. Summary of changes: website/www/site/static/.htaccess | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch release-2.56.0 updated: [runners-flink] remove 1.12 and 1.13 runners (#31020)
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch release-2.56.0
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/release-2.56.0 by this push:
new 50b73de3336 [runners-flink] remove 1.12 and 1.13 runners (#31020)
50b73de3336 is described below
commit 50b73de333614888db174140f72371db4cdbdbe5
Author: Jan Lukavský
AuthorDate: Wed Apr 17 21:56:06 2024 +0200
[runners-flink] remove 1.12 and 1.13 runners (#31020)
---
gradle.properties | 2 +-
release/build.gradle.kts | 2 +-
runners/flink/1.12/build.gradle| 25 --
.../flink/1.12/job-server-container/build.gradle | 26 --
runners/flink/1.12/job-server/build.gradle | 31 ---
.../streaming/AbstractStreamOperatorCompat.java| 94 --
.../io/source/compat/FlinkSourceCompat.java| 31 ---
.../io/source/compat/SplitEnumeratorCompat.java| 27 ---
.../beam/runners/flink/RemoteMiniClusterImpl.java | 68
.../runners/flink/metrics/MetricGroupWrapper.java | 31 ---
.../runners/flink/streaming/StreamSources.java | 72 -
.../streaming/io/source/SourceTestCompat.java | 75 -
runners/flink/1.13/build.gradle| 25 --
.../flink/1.13/job-server-container/build.gradle | 26 --
runners/flink/1.13/job-server/build.gradle | 31 ---
.../translation/types/CoderTypeSerializer.java | 0
.../streaming/ProcessingTimeCallbackCompat.java| 0
.../io/source/compat/SplitEnumeratorCompat.java| 0
.../streaming/io/source/compat/package-info.java | 0
.../beam/runners/flink/MiniClusterCompat.java | 0
.../translation/types/CoderTypeSerializerTest.java | 0
runners/flink/flink_runner.gradle | 17 ++--
.../streaming/io/source/FlinkSourceReaderBase.java | 2 -
sdks/go/examples/stringsplit/stringsplit.go| 2 +-
sdks/java/testing/nexmark/build.gradle | 2 +-
sdks/java/testing/tpcds/build.gradle | 2 +-
settings.gradle.kts| 8 --
.../content/en/documentation/dsls/sql/shell.md | 6 +-
.../shortcodes/flink_java_pipeline_options.html| 8 +-
.../shortcodes/flink_python_pipeline_options.html | 8 +-
30 files changed, 22 insertions(+), 599 deletions(-)
diff --git a/gradle.properties b/gradle.properties
index 5b07dd6c2b4..8fd8e9b4742 100644
--- a/gradle.properties
+++ b/gradle.properties
@@ -39,6 +39,6 @@ docker_image_default_repo_root=apache
docker_image_default_repo_prefix=beam_
# supported flink versions
-flink_versions=1.12,1.13,1.14,1.15,1.16,1.17
+flink_versions=1.14,1.15,1.16,1.17
# supported python versions
python_versions=3.8,3.9,3.10,3.11
diff --git a/release/build.gradle.kts b/release/build.gradle.kts
index abb34d8605a..4e4586f666f 100644
--- a/release/build.gradle.kts
+++ b/release/build.gradle.kts
@@ -39,7 +39,7 @@ task("runJavaExamplesValidationTask") {
dependsOn(":runners:direct-java:runQuickstartJavaDirect")
dependsOn(":runners:google-cloud-dataflow-java:runQuickstartJavaDataflow")
dependsOn(":runners:spark:3:runQuickstartJavaSpark")
- dependsOn(":runners:flink:1.13:runQuickstartJavaFlinkLocal")
+ dependsOn(":runners:flink:1.17:runQuickstartJavaFlinkLocal")
dependsOn(":runners:direct-java:runMobileGamingJavaDirect")
dependsOn(":runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow")
dependsOn(":runners:twister2:runQuickstartJavaTwister2")
diff --git a/runners/flink/1.12/build.gradle b/runners/flink/1.12/build.gradle
deleted file mode 100644
index 2acee16c6e8..000
--- a/runners/flink/1.12/build.gradle
+++ /dev/null
@@ -1,25 +0,0 @@
-/*
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements. See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership. The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * License); you may not use this file except in compliance
- * with the License. You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an AS IS BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-project.ext {
- flink_major = '1.12'
- flink_version = '1.12.7'
-}
-
-// Load the main build script which contains all build logic.
-apply from: "../flink_runner.gradle"
diff --git a/runners/flink/1.12/job-server-container/build.gradle
b/runners/flink/1.12/job-server-container/build.gradle
deleted file mode 100644
index
(beam) branch master updated (b134e72a068 -> 3822f551dfc)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from b134e72a068 [changes] Update CHANGES.md (#29939) (#31017) add 3822f551dfc remove CLOUDSDK (#31016) No new revisions were added by this update. Summary of changes: .github/workflows/beam_PostCommit_XVR_JavaUsingPython_Dataflow.yml | 2 -- 1 file changed, 2 deletions(-)
(beam) branch release-2.56.0 updated: [changes] Update CHANGES.md (#29939) (#31017) (#31022)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a commit to branch release-2.56.0 in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/release-2.56.0 by this push: new 5b8761d8862 [changes] Update CHANGES.md (#29939) (#31017) (#31022) 5b8761d8862 is described below commit 5b8761d886226a6bcc1b955a705910a4d0211ee0 Author: Jan Lukavský AuthorDate: Wed Apr 17 21:33:43 2024 +0200 [changes] Update CHANGES.md (#29939) (#31017) (#31022) --- CHANGES.md | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index 6963d9507cd..5fc2509ade8 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -57,8 +57,7 @@ ## Highlights -* New highly anticipated feature X added to Python SDK ([#X](https://github.com/apache/beam/issues/X)). -* New highly anticipated feature Y added to Java SDK ([#Y](https://github.com/apache/beam/issues/Y)). +* Added FlinkRunner for Flink 1.17, removed support for Flink 1.12 and 1.13. Previous version of Pipeline running on Flink 1.16 and below can be upgraded to 1.17, if the Pipeline is first updated to Beam 2.56.0 with the same Flink version. After Pipeline runs with Beam 2.56.0, it should be possible to upgrade to FlinkRunner with Flink 1.17. ([#29939](https://github.com/apache/beam/issues/29939)) ## I/Os
Error while running notifications feature from .asf.yaml in beam!
An error occurred while running notifications feature in .asf.yaml!: Expecting value: line 1 column 1 (char 0)
(beam) branch master updated (3cfc160b512 -> b134e72a068)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 3cfc160b512 Merge pull request #30988: Remove flink 1.12 1.13 add b134e72a068 [changes] Update CHANGES.md (#29939) (#31017) No new revisions were added by this update. Summary of changes: CHANGES.md | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new fa46ab327b0 Updating config from bot
fa46ab327b0 is described below
commit fa46ab327b0d6c4dddc55d8fdf82e16c73651eaf
Author: github-actions
AuthorDate: Wed Apr 17 19:02:51 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31013.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31013.json
b/scripts/ci/pr-bot/state/pr-state/pr-31013.json
index 242a48d7d3b..37f7ab41238 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-31013.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31013.json
@@ -2,7 +2,7 @@
"commentedAboutFailingChecks": true,
"reviewersAssignedForLabels": {},
"nextAction": "Author",
- "stopReviewerNotifications": false,
+ "stopReviewerNotifications": true,
"remindAfterTestsPass": [],
"committerAssigned": false
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 15216999212 Updating config from bot 15216999212 is described below commit 15216999212f8abcffbd26b77bcab42249e26fcd Author: github-actions AuthorDate: Wed Apr 17 19:05:27 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-website.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-website.json b/scripts/ci/pr-bot/state/reviewers-for-label-website.json index 66e117ed22c..10139026bec 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-website.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-website.json @@ -5,6 +5,6 @@ "melap": 1712181944250, "damccorm": 1712687712177, "liferoad": 1712623767447, -"kennknowles": 1712162170007 +"kennknowles": 1713380725141 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 27981e91796 Updating config from bot
27981e91796 is described below
commit 27981e91796254a01b9b9419268e92de1251b14a
Author: github-actions
AuthorDate: Wed Apr 17 19:05:26 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31019.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31019.json
b/scripts/ci/pr-bot/state/pr-state/pr-31019.json
new file mode 100644
index 000..a00c58524cd
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31019.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"website": "kennknowles"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new c3237f85825 Updating config from bot
c3237f85825 is described below
commit c3237f85825cb7f1cc9c07d31f13b5b107fc95fa
Author: github-actions
AuthorDate: Wed Apr 17 18:24:55 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31021.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31021.json
b/scripts/ci/pr-bot/state/pr-state/pr-31021.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31021.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new c4a773d59d5 Updating config from bot
c4a773d59d5 is described below
commit c4a773d59d5216da983b7314f2a9542b00a7db1c
Author: github-actions
AuthorDate: Wed Apr 17 18:17:19 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31020.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31020.json
b/scripts/ci/pr-bot/state/pr-state/pr-31020.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31020.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
Error while running notifications feature from .asf.yaml in beam!
An error occurred while running notifications feature in .asf.yaml!: Expecting value: line 1 column 1 (char 0)
(beam) branch master updated (5c6bc39a44d -> 3cfc160b512)
This is an automated email from the ASF dual-hosted git repository.
janl pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 5c6bc39a44d Moving to 2.57.0-SNAPSHOT on master branch.
add e4baee698d8 [runners-flink] remove 1.12 and 1.13 runners
new 3cfc160b512 Merge pull request #30988: Remove flink 1.12 1.13
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
gradle.properties | 2 +-
release/build.gradle.kts | 2 +-
runners/flink/1.12/build.gradle| 25 --
.../flink/1.12/job-server-container/build.gradle | 26 --
runners/flink/1.12/job-server/build.gradle | 31 ---
.../streaming/AbstractStreamOperatorCompat.java| 94 --
.../io/source/compat/FlinkSourceCompat.java| 31 ---
.../io/source/compat/SplitEnumeratorCompat.java| 27 ---
.../beam/runners/flink/RemoteMiniClusterImpl.java | 68
.../runners/flink/metrics/MetricGroupWrapper.java | 31 ---
.../runners/flink/streaming/StreamSources.java | 72 -
.../streaming/io/source/SourceTestCompat.java | 75 -
runners/flink/1.13/build.gradle| 25 --
.../flink/1.13/job-server-container/build.gradle | 26 --
runners/flink/1.13/job-server/build.gradle | 31 ---
.../translation/types/CoderTypeSerializer.java | 0
.../streaming/ProcessingTimeCallbackCompat.java| 0
.../io/source/compat/SplitEnumeratorCompat.java| 0
.../streaming/io/source/compat/package-info.java | 0
.../beam/runners/flink/MiniClusterCompat.java | 0
.../translation/types/CoderTypeSerializerTest.java | 0
runners/flink/flink_runner.gradle | 17 ++--
.../streaming/io/source/FlinkSourceReaderBase.java | 2 -
sdks/go/examples/stringsplit/stringsplit.go| 2 +-
sdks/java/testing/nexmark/build.gradle | 2 +-
sdks/java/testing/tpcds/build.gradle | 2 +-
settings.gradle.kts| 8 --
.../content/en/documentation/dsls/sql/shell.md | 6 +-
.../shortcodes/flink_java_pipeline_options.html| 8 +-
.../shortcodes/flink_python_pipeline_options.html | 8 +-
30 files changed, 22 insertions(+), 599 deletions(-)
delete mode 100644 runners/flink/1.12/build.gradle
delete mode 100644 runners/flink/1.12/job-server-container/build.gradle
delete mode 100644 runners/flink/1.12/job-server/build.gradle
delete mode 100644
runners/flink/1.12/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/AbstractStreamOperatorCompat.java
delete mode 100644
runners/flink/1.12/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/compat/FlinkSourceCompat.java
delete mode 100644
runners/flink/1.12/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/compat/SplitEnumeratorCompat.java
delete mode 100644
runners/flink/1.12/src/test/java/org/apache/beam/runners/flink/RemoteMiniClusterImpl.java
delete mode 100644
runners/flink/1.12/src/test/java/org/apache/beam/runners/flink/metrics/MetricGroupWrapper.java
delete mode 100644
runners/flink/1.12/src/test/java/org/apache/beam/runners/flink/streaming/StreamSources.java
delete mode 100644
runners/flink/1.12/src/test/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/SourceTestCompat.java
delete mode 100644 runners/flink/1.13/build.gradle
delete mode 100644 runners/flink/1.13/job-server-container/build.gradle
delete mode 100644 runners/flink/1.13/job-server/build.gradle
rename runners/flink/{1.12 =>
1.14}/src/main/java/org/apache/beam/runners/flink/translation/types/CoderTypeSerializer.java
(100%)
rename runners/flink/{1.12 =>
1.14}/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/ProcessingTimeCallbackCompat.java
(100%)
rename runners/flink/{1.13 =>
1.14}/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/compat/SplitEnumeratorCompat.java
(100%)
rename runners/flink/{1.12 =>
1.14}/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/compat/package-info.java
(100%)
rename runners/flink/{1.12 =>
1.14}/src/test/java/org/apache/beam/runners/flink/MiniClusterCompat.java (100%)
rename runners/flink/{1.12 =>
1.14}/src/test/java/org/apache/beam/runners/flink/translation/types/CoderTypeSerializerTest.java
(100%)
(beam) 01/01: Merge pull request #30988: Remove flink 1.12 1.13
This is an automated email from the ASF dual-hosted git repository. janl pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 3cfc160b51234a5cd8d3c0c34b0b229b3e543baa Merge: 5c6bc39a44d e4baee698d8 Author: Jan Lukavský AuthorDate: Wed Apr 17 20:12:45 2024 +0200 Merge pull request #30988: Remove flink 1.12 1.13 gradle.properties | 2 +- release/build.gradle.kts | 2 +- runners/flink/1.12/build.gradle| 25 -- .../flink/1.12/job-server-container/build.gradle | 26 -- runners/flink/1.12/job-server/build.gradle | 31 --- .../streaming/AbstractStreamOperatorCompat.java| 94 -- .../io/source/compat/FlinkSourceCompat.java| 31 --- .../io/source/compat/SplitEnumeratorCompat.java| 27 --- .../beam/runners/flink/RemoteMiniClusterImpl.java | 68 .../runners/flink/metrics/MetricGroupWrapper.java | 31 --- .../runners/flink/streaming/StreamSources.java | 72 - .../streaming/io/source/SourceTestCompat.java | 75 - runners/flink/1.13/build.gradle| 25 -- .../flink/1.13/job-server-container/build.gradle | 26 -- runners/flink/1.13/job-server/build.gradle | 31 --- .../translation/types/CoderTypeSerializer.java | 0 .../streaming/ProcessingTimeCallbackCompat.java| 0 .../io/source/compat/SplitEnumeratorCompat.java| 0 .../streaming/io/source/compat/package-info.java | 0 .../beam/runners/flink/MiniClusterCompat.java | 0 .../translation/types/CoderTypeSerializerTest.java | 0 runners/flink/flink_runner.gradle | 17 ++-- .../streaming/io/source/FlinkSourceReaderBase.java | 2 - sdks/go/examples/stringsplit/stringsplit.go| 2 +- sdks/java/testing/nexmark/build.gradle | 2 +- sdks/java/testing/tpcds/build.gradle | 2 +- settings.gradle.kts| 8 -- .../content/en/documentation/dsls/sql/shell.md | 6 +- .../shortcodes/flink_java_pipeline_options.html| 8 +- .../shortcodes/flink_python_pipeline_options.html | 8 +- 30 files changed, 22 insertions(+), 599 deletions(-)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new e7d2416bf79 Updating config from bot
e7d2416bf79 is described below
commit e7d2416bf799460e5e9d5b39acd624f5c37377bb
Author: github-actions
AuthorDate: Wed Apr 17 17:35:05 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31017.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31017.json
b/scripts/ci/pr-bot/state/pr-state/pr-31017.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31017.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 6e7b580f97b Updating config from bot
6e7b580f97b is described below
commit 6e7b580f97bfc875e743a307ba404d983daf90b0
Author: github-actions
AuthorDate: Wed Apr 17 17:05:54 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31015.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31015.json
b/scripts/ci/pr-bot/state/pr-state/pr-31015.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31015.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated (7159beac55f -> 5c6bc39a44d)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 7159beac55f Minor updates to StreamingInsertsMetrics (#31003) add 5c6bc39a44d Moving to 2.57.0-SNAPSHOT on master branch. No new revisions were added by this update. Summary of changes: .asf.yaml | 1 + gradle.properties | 4 ++-- sdks/go/pkg/beam/core/core.go | 2 +- sdks/python/apache_beam/version.py | 2 +- sdks/typescript/package.json | 2 +- 5 files changed, 6 insertions(+), 5 deletions(-)
(beam) branch release-2.56.0 created (now fb111738c27)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch release-2.56.0 in repository https://gitbox.apache.org/repos/asf/beam.git at fb111738c27 Set Dataflow container to release version. This branch includes the following new commits: new fb111738c27 Set Dataflow container to release version. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) 01/01: Set Dataflow container to release version.
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch release-2.56.0
in repository https://gitbox.apache.org/repos/asf/beam.git
commit fb111738c272165722ef8e58b409deee6d4aa085
Author: damccorm
AuthorDate: Wed Apr 17 16:55:53 2024 +
Set Dataflow container to release version.
---
runners/google-cloud-dataflow-java/build.gradle | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/runners/google-cloud-dataflow-java/build.gradle
b/runners/google-cloud-dataflow-java/build.gradle
index 09ab59b3f4b..45d2c5f3597 100644
--- a/runners/google-cloud-dataflow-java/build.gradle
+++ b/runners/google-cloud-dataflow-java/build.gradle
@@ -51,8 +51,8 @@ evaluationDependsOn(":sdks:java:container:java11")
ext.dataflowLegacyEnvironmentMajorVersion = '8'
ext.dataflowFnapiEnvironmentMajorVersion = '8'
-ext.dataflowLegacyContainerVersion = 'beam-master-20240306'
-ext.dataflowFnapiContainerVersion = 'beam-master-20240306'
+ext.dataflowLegacyContainerVersion = '2.56.0'
+ext.dataflowFnapiContainerVersion = '2.56.0'
ext.dataflowContainerBaseRepository = 'gcr.io/cloud-dataflow/v1beta3'
processResources {
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 922e82ddd08 Updating config from bot
922e82ddd08 is described below
commit 922e82ddd082f9ef4cb8ada8e0993770ef8ea253
Author: github-actions
AuthorDate: Wed Apr 17 16:36:36 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 9c05b564d72..10322b972ae 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -2,6 +2,6 @@
"label": "build",
"dateOfLastReviewAssignment": {
"damccorm": 1713357661356,
-"Abacn": 1713355765827
+"Abacn": 1713371791885
}
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 04d2bcb2ea2 Updating config from bot
04d2bcb2ea2 is described below
commit 04d2bcb2ea2645885ba0f16894b5a40b1cee1dab
Author: github-actions
AuthorDate: Wed Apr 17 16:36:33 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31016.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31016.json
b/scripts/ci/pr-bot/state/pr-state/pr-31016.json
new file mode 100644
index 000..9c51466b9ee
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31016.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "Abacn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated: Minor updates to StreamingInsertsMetrics (#31003)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 7159beac55f Minor updates to StreamingInsertsMetrics (#31003)
7159beac55f is described below
commit 7159beac55f6b3492bdf84df956cffe4df27fca9
Author: JayajP
AuthorDate: Wed Apr 17 09:28:53 2024 -0700
Minor updates to StreamingInsertsMetrics (#31003)
---
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 12 +++--
.../io/gcp/bigquery/StreamingInsertsMetrics.java | 63 ++
.../gcp/bigquery/StreamingInsertsMetricsTest.java | 13 +++--
3 files changed, 30 insertions(+), 58 deletions(-)
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java
index 2dbc02131f5..fa680004a7c 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java
@@ -1079,6 +1079,7 @@ public class BigQueryServicesImpl implements
BigQueryServices {
}
StreamingInsertsMetrics streamingInsertsResults =
BigQuerySinkMetrics.streamingInsertsMetrics();
+ int numFailedRows = 0;
final Set failedIndices = new HashSet<>();
long retTotalDataSize = 0;
List allErrors = new
ArrayList<>();
@@ -1135,7 +1136,7 @@ public class BigQueryServicesImpl implements
BigQueryServices {
+ " pipeline, and the row will be output as a failed
insert.",
nextRowSize));
} else {
- streamingInsertsResults.incrementFailedRows();
+ numFailedRows += 1;
errorContainer.add(failedInserts, error, ref,
rowsToPublish.get(rowIndex));
failedIndices.add(rowIndex);
rowIndex++;
@@ -1223,7 +1224,7 @@ public class BigQueryServicesImpl implements
BigQueryServices {
retryIds.add(idsToPublish.get(errorIndex));
}
} else {
-streamingInsertsResults.incrementFailedRows();
+numFailedRows += 1;
errorContainer.add(failedInserts, error, ref,
rowsToPublish.get(errorIndex));
}
}
@@ -1234,7 +1235,8 @@ public class BigQueryServicesImpl implements
BigQueryServices {
Thread.currentThread().interrupt();
throw new IOException("Interrupted while inserting " +
rowsToPublish);
} catch (ExecutionException e) {
- streamingInsertsResults.updateStreamingInsertsMetrics(ref);
+ streamingInsertsResults.updateStreamingInsertsMetrics(
+ ref, rowList.size(), rowList.size());
throw new RuntimeException(e.getCause());
}
@@ -1276,8 +1278,8 @@ public class BigQueryServicesImpl implements
BigQueryServices {
}
}
}
- streamingInsertsResults.updateSuccessfulAndFailedRows(rowList.size(),
allErrors.size());
- streamingInsertsResults.updateStreamingInsertsMetrics(ref);
+ numFailedRows += allErrors.size();
+ streamingInsertsResults.updateStreamingInsertsMetrics(ref,
rowList.size(), numFailedRows);
if (!allErrors.isEmpty()) {
throw new IOException("Insert failed: " + allErrors);
} else {
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StreamingInsertsMetrics.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StreamingInsertsMetrics.java
index c451856f06a..2ada2e94dc1 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StreamingInsertsMetrics.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StreamingInsertsMetrics.java
@@ -40,11 +40,8 @@ public interface StreamingInsertsMetrics {
void updateSuccessfulRpcMetrics(Instant start, Instant end);
- void incrementFailedRows();
-
- void updateSuccessfulAndFailedRows(int totalRows, int failedRows);
-
- void updateStreamingInsertsMetrics(@Nullable TableReference tableRef);
+ void updateStreamingInsertsMetrics(
+ @Nullable TableReference tableRef, int totalRows, int failedRows);
/** No-op implementation of {@code StreamingInsertsResults}. */
class NoOpStreamingInsertsMetrics implements StreamingInsertsMetrics {
@@ -60,13 +57,8 @@ public interface StreamingInsertsMetrics {
public void updateSuccessfulRpcMetrics(Instant start, Instant end) {}
@Override
-public void incrementFailedRows() {}
-
-@Override
-public void updateSuccessfulAndFailedRows(int totalRows, int
(beam) branch master updated: Use base 2 exponential histograms in BigQuerySinkMetrics (#31000)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 1e8a16d9eae Use base 2 exponential histograms in BigQuerySinkMetrics
(#31000)
1e8a16d9eae is described below
commit 1e8a16d9eae3bfd8c42ea102c0ed2d7de5cbe060
Author: JayajP
AuthorDate: Wed Apr 17 09:26:20 2024 -0700
Use base 2 exponential histograms in BigQuerySinkMetrics (#31000)
* Use base 2 exponential histograms in BigQuerySinkMetrics
---
.../sdk/io/gcp/bigquery/BigQuerySinkMetrics.java | 7 +-
.../io/gcp/bigquery/BigQuerySinkMetricsTest.java | 76 +-
.../gcp/bigquery/StreamingInsertsMetricsTest.java | 2 +-
3 files changed, 24 insertions(+), 61 deletions(-)
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySinkMetrics.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySinkMetrics.java
index b80438aceeb..ecdf8eee4bf 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySinkMetrics.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySinkMetrics.java
@@ -106,7 +106,7 @@ public class BigQuerySinkMetrics {
* 'RpcLatency-Method:{method};'
*
* @param method StorageWriteAPI method associated with this metric.
- * @return Histogram with exponential buckets with a sqrt(2) growth factor.
+ * @return Histogram with exponential buckets with a size 2 growth factor.
*/
static Histogram createRPCLatencyHistogram(RpcMethod method) {
LabeledMetricNameUtils.MetricNameBuilder nameBuilder =
@@ -114,7 +114,10 @@ public class BigQuerySinkMetrics {
nameBuilder.addLabel(RPC_METHOD, method.toString());
MetricName metricName = nameBuilder.build(METRICS_NAMESPACE);
-HistogramData.BucketType buckets = HistogramData.ExponentialBuckets.of(1,
34);
+// Create Exponential histogram buckets wtih the following parameters:
+// 0 scale, resulting in bucket widths with a size 2 growth factor.
+// 17 buckets, so the max latency of that can be stored is (2^17 millis ~=
130 seconds).
+HistogramData.BucketType buckets = HistogramData.ExponentialBuckets.of(0,
17);
return new DelegatingHistogram(metricName, buckets, false, true);
}
diff --git
a/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySinkMetricsTest.java
b/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySinkMetricsTest.java
index 37472c4db3d..5254ab514db 100644
---
a/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySinkMetricsTest.java
+++
b/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySinkMetricsTest.java
@@ -128,10 +128,7 @@ public class BigQuerySinkMetricsTest {
MetricName deletesDisabledCounterName =
MetricName.named(
"BigQuerySink",
"RowsAppendedCount*row_status:SUCCESSFUL;rpc_status:rpcStatus;");
-assertThat(testContainer.perWorkerCounters,
IsMapContaining.hasKey(deletesDisabledCounterName));
-assertThat(
-
testContainer.perWorkerCounters.get(deletesDisabledCounterName).getCumulative(),
-equalTo(1L));
+testContainer.assertPerWorkerCounterValue(deletesDisabledCounterName, 1L);
BigQuerySinkMetrics.setSupportMetricsDeletion(true);
testContainer.reset();
@@ -143,10 +140,7 @@ public class BigQuerySinkMetricsTest {
MetricName.named(
"BigQuerySink",
"RowsAppendedCount*row_status:SUCCESSFUL;rpc_status:rpcStatus;table_id:tableId;");
-assertThat(testContainer.perWorkerCounters,
IsMapContaining.hasKey(deletesEnabledCounterName));
-assertThat(
-
testContainer.perWorkerCounters.get(deletesEnabledCounterName).getCumulative(),
-equalTo(1L));
+testContainer.assertPerWorkerCounterValue(deletesEnabledCounterName, 1L);
}
@Test
@@ -179,8 +173,7 @@ public class BigQuerySinkMetricsTest {
MetricName counterName =
MetricName.named("BigQuerySink",
"ThrottledTime*rpc_method:APPEND_ROWS;");
-assertThat(testContainer.perWorkerCounters,
IsMapContaining.hasKey(counterName));
-
assertThat(testContainer.perWorkerCounters.get(counterName).getCumulative(),
equalTo(1L));
+testContainer.assertPerWorkerCounterValue(counterName, 1L);
}
@Test
@@ -201,14 +194,9 @@ public class BigQuerySinkMetricsTest {
MetricName.named("BigQuerySink",
"RpcRequestsCount*rpc_method:APPEND_ROWS;rpc_status:OK;");
MetricName histogramName =
MetricName.named("BigQuerySink", "RpcLatency*rpc_method:APPEND_ROWS;");
-HistogramData.BucketType bucketType =
(beam) branch master updated (a207e4e8bbe -> 05b7146656a)
This is an automated email from the ASF dual-hosted git repository. damondouglas pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from a207e4e8bbe Revert "Docker - Remove Deprecated Types (#30826)" (#31010) add 05b7146656a Add /job/cancel endpoint to prism web server. (#30825) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/runners/prism/internal/web/web.go | 57 ++ 1 file changed, 57 insertions(+)
(beam) branch master updated (38a8b5f7047 -> a207e4e8bbe)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 38a8b5f7047 Create YAML Join Transform (#30734) add a207e4e8bbe Revert "Docker - Remove Deprecated Types (#30826)" (#31010) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/runners/prism/internal/environments.go | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
(beam) branch master updated: Create YAML Join Transform (#30734)
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 38a8b5f7047 Create YAML Join Transform (#30734)
38a8b5f7047 is described below
commit 38a8b5f70477c17ea3499bd352977689cc6a1065
Author: Timothy Itodo
AuthorDate: Wed Apr 17 10:30:05 2024 -0500
Create YAML Join Transform (#30734)
* basic SQLbacked transform
* add Join-calcite to providers
* translate join conditions to sql
* parse output fields
* validate join yaml entries
* reformat code
* fix pythonformatter issues
* add unit tests
* support equalities with more than 2 inputs
* fix lint formatting & remove networkx dependency
* fix lint
* fix format
* handle disconnect equalities
* correct disconnected inputs error message
* remove test.yaml
* add unit test annotation
* add fields validation
* Minor join fixes.
* Some simple join tests.
-
Co-authored-by: Robert Bradshaw
---
sdks/python/apache_beam/yaml/integration_tests.py | 19 +-
sdks/python/apache_beam/yaml/tests/join.yaml | 186 ++
sdks/python/apache_beam/yaml/yaml_join.py | 281 ++
sdks/python/apache_beam/yaml/yaml_join_test.py| 216 +
sdks/python/apache_beam/yaml/yaml_provider.py | 2 +
5 files changed, 698 insertions(+), 6 deletions(-)
diff --git a/sdks/python/apache_beam/yaml/integration_tests.py
b/sdks/python/apache_beam/yaml/integration_tests.py
index aef0a3be4ad..2b862e014bb 100644
--- a/sdks/python/apache_beam/yaml/integration_tests.py
+++ b/sdks/python/apache_beam/yaml/integration_tests.py
@@ -92,12 +92,19 @@ def provider_sets(spec, require_available=False):
"""For transforms that are vended by multiple providers, yields all possible
combinations of providers to use.
"""
- all_transform_types = set.union(
- *(
- set(
- transform_types(
- yaml_transform.preprocess(copy.deepcopy(p['pipeline']
- for p in spec['pipelines']))
+ try:
+for p in spec['pipelines']:
+ _ = yaml_transform.preprocess(copy.deepcopy(p['pipeline']))
+ except Exception as exn:
+print(exn)
+all_transform_types = []
+ else:
+all_transform_types = set.union(
+*(
+set(
+transform_types(
+yaml_transform.preprocess(copy.deepcopy(p['pipeline']
+for p in spec['pipelines']))
def filter_to_available(t, providers):
if require_available:
diff --git a/sdks/python/apache_beam/yaml/tests/join.yaml
b/sdks/python/apache_beam/yaml/tests/join.yaml
new file mode 100644
index 000..67013efe229
--- /dev/null
+++ b/sdks/python/apache_beam/yaml/tests/join.yaml
@@ -0,0 +1,186 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the# Row(word='License'); you may not use this file except in compliance
with
+# the License. You may obtain a copy of the License at
+#
+#http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an# Row(word='AS IS' BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#
+
+pipelines:
+
+ - pipeline:
+ transforms:
+- type: Create
+ name: A
+ config:
+elements:
+ - {common: "x", a: 1}
+ - {common: "y", a: 2}
+ - {common: "z", a: 3}
+
+- type: Create
+ name: B
+ config:
+elements:
+ - {common: "x", b: 10, other: "t"}
+ - {common: "y", b: 20, other: "u"}
+ - {common: "z", b: 30, other: "v"}
+
+- type: Create
+ name: C
+ config:
+elements:
+ - {other: "t", c: 100}
+ - {other: "u", c: 200}
+
+- type: Join
+ input:
+A: A
+B: B
+C: C
+ config:
+type: inner
+equalities:
+ - B: other
+C: other
+ - A: common
+B: common
+fields:
+ A: [a]
+ B: [b]
+ C: [c]
+
+- type: AssertEqual
+ input: Join
+ config:
+elements:
+ - {a: 1, b: 10, c: 100}
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new fa7d3b30c2e Updating config from bot
fa7d3b30c2e is described below
commit fa7d3b30c2e2e35560c0accf7970d7141f90c826
Author: github-actions
AuthorDate: Wed Apr 17 15:06:06 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31013.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31013.json
b/scripts/ci/pr-bot/state/pr-state/pr-31013.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31013.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated (e48a9351d2f -> d70c25328ee)
This is an automated email from the ASF dual-hosted git repository.
janl pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from e48a9351d2f add Yaml_Xlang_Direct PreCommit to README (#31009)
add deee0e9cc8c [flink] add support for Flink 1.17 (#29939)
new d70c25328ee Merge pull request #30197: Flink 1.17
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
...am_PostCommit_Python_ValidatesRunner_Flink.json | 0
.../beam_PostCommit_Java_ValidatesRunner_Flink.yml | 4 +-
gradle.properties | 2 +-
runners/flink/1.12/build.gradle| 12 +--
.../translation/types/CoderTypeSerializer.java | 10 ++-
.../translation/types/CoderTypeSerializerTest.java | 2 +-
runners/flink/1.13/build.gradle| 12 +--
runners/flink/1.14/build.gradle| 13 +---
runners/flink/1.15/build.gradle| 13 +---
runners/flink/1.16/build.gradle| 13 +---
.../java8 => runners/flink/1.17}/build.gradle | 5 +-
.../job-server-container/build.gradle | 0
.../flink/{1.12 => 1.17}/job-server/build.gradle | 2 +-
.../translation/types/CoderTypeSerializer.java | 31 +---
runners/flink/flink_runner.gradle | 20 -
.../types/UnversionedTypeSerializerSnapshot.java | 86 ++
.../UnversionedTypeSerializerSnapshotTest.java | 52 +
settings.gradle.kts| 4 +
.../shortcodes/flink_java_pipeline_options.html| 15
.../shortcodes/flink_python_pipeline_options.html | 15
20 files changed, 220 insertions(+), 91 deletions(-)
copy
learning/tour-of-beam/learning-content/io/text-io/text-io-local-write/go-example/myfile.txt
=> .github/trigger_files/beam_PostCommit_Python_ValidatesRunner_Flink.json
(100%)
copy runners/flink/{ =>
1.12}/src/main/java/org/apache/beam/runners/flink/translation/types/CoderTypeSerializer.java
(94%)
rename runners/flink/{ =>
1.12}/src/test/java/org/apache/beam/runners/flink/translation/types/CoderTypeSerializerTest.java
(97%)
copy {sdks/java/container/java8 => runners/flink/1.17}/build.gradle (91%)
copy runners/flink/{1.12 => 1.17}/job-server-container/build.gradle (100%)
copy runners/flink/{1.12 => 1.17}/job-server/build.gradle (95%)
rename runners/flink/{ =>
1.17}/src/main/java/org/apache/beam/runners/flink/translation/types/CoderTypeSerializer.java
(82%)
create mode 100644
runners/flink/src/main/java/org/apache/beam/runners/flink/translation/types/UnversionedTypeSerializerSnapshot.java
create mode 100644
runners/flink/src/test/java/org/apache/beam/runners/flink/translation/types/UnversionedTypeSerializerSnapshotTest.java
(beam) 01/01: Merge pull request #30197: Flink 1.17
This is an automated email from the ASF dual-hosted git repository.
janl pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit d70c25328eec42be281401a958ff9829659174ea
Merge: e48a9351d2f deee0e9cc8c
Author: Jan Lukavský
AuthorDate: Wed Apr 17 16:52:38 2024 +0200
Merge pull request #30197: Flink 1.17
...am_PostCommit_Python_ValidatesRunner_Flink.json | 0
.../beam_PostCommit_Java_ValidatesRunner_Flink.yml | 4 +-
gradle.properties | 2 +-
runners/flink/1.12/build.gradle| 12 +--
.../translation/types/CoderTypeSerializer.java | 10 ++-
.../translation/types/CoderTypeSerializerTest.java | 2 +-
runners/flink/1.13/build.gradle| 12 +--
runners/flink/1.14/build.gradle| 13 +---
runners/flink/1.15/build.gradle| 13 +---
runners/flink/1.16/build.gradle| 13 +---
runners/flink/{1.12 => 1.17}/build.gradle | 14 +---
.../job-server-container}/build.gradle | 15 +---
.../flink/{1.12 => 1.17/job-server}/build.gradle | 20 +++--
.../translation/types/CoderTypeSerializer.java | 31 +---
runners/flink/flink_runner.gradle | 20 -
.../types/UnversionedTypeSerializerSnapshot.java | 86 ++
.../UnversionedTypeSerializerSnapshotTest.java | 52 +
settings.gradle.kts| 4 +
.../shortcodes/flink_java_pipeline_options.html| 15
.../shortcodes/flink_python_pipeline_options.html | 15
20 files changed, 232 insertions(+), 121 deletions(-)
(beam) branch master updated (27643432ea9 -> 6624d952bbd)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 27643432ea9 [yaml] backtick generated aliases on sql mappings (#30895) add 6624d952bbd Cache parsed metrics in StreamingStepMetricsContainer (#31005) No new revisions were added by this update. Summary of changes: .../MetricsToPerStepNamespaceMetricsConverter.java | 37 ++--- .../worker/StreamingStepMetricsContainer.java | 25 +++-- ...ricsToPerStepNamespaceMetricsConverterTest.java | 60 -- .../worker/StreamingStepMetricsContainerTest.java | 35 - 4 files changed, 141 insertions(+), 16 deletions(-)
(beam) branch master updated (6624d952bbd -> e48a9351d2f)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 6624d952bbd Cache parsed metrics in StreamingStepMetricsContainer (#31005) add e48a9351d2f add Yaml_Xlang_Direct PreCommit to README (#31009) No new revisions were added by this update. Summary of changes: .github/workflows/README.md| 2 ++ .github/workflows/beam_PreCommit_Yaml_Xlang_Direct.yml | 4 ++-- 2 files changed, 4 insertions(+), 2 deletions(-)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 8d825b1e87a Updating config from bot 8d825b1e87a is described below commit 8d825b1e87a1bed64eb2544efbd36194ae09585c Author: github-actions AuthorDate: Wed Apr 17 14:34:40 2024 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-30825.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30825.json b/scripts/ci/pr-bot/state/pr-state/pr-30825.json index aa3638a74ec..1e9dcd816d5 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-30825.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-30825.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch master updated: [yaml] backtick generated aliases on sql mappings (#30895)
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 27643432ea9 [yaml] backtick generated aliases on sql mappings (#30895)
27643432ea9 is described below
commit 27643432ea9654a03e574badf87bb6cd4f7dca82
Author: Jeff Kinard
AuthorDate: Wed Apr 17 09:08:10 2024 -0400
[yaml] backtick generated aliases on sql mappings (#30895)
* [yaml] backtick generated aliases on sql mappings
Signed-off-by: Jeffrey Kinard
* add some it's
Signed-off-by: Jeffrey Kinard
* migrate it's to ut's
Signed-off-by: Jeffrey Kinard
* add more detailed docs for mapping functions
Signed-off-by: Jeffrey Kinard
* rebuild docs and ad readme tests
Signed-off-by: Jeffrey Kinard
* rebase and add fix typo
Signed-off-by: Jeffrey Kinard
* Spacing
-
Signed-off-by: Jeffrey Kinard
Co-authored-by: Danny McCormick
---
sdks/python/apache_beam/yaml/integration_tests.py | 2 +-
sdks/python/apache_beam/yaml/readme_test.py| 28 +++-
sdks/python/apache_beam/yaml/yaml_mapping.py | 6 +-
sdks/python/apache_beam/yaml/yaml_udf_test.py | 79 +-
.../site/content/en/documentation/sdks/yaml-udf.md | 173 -
5 files changed, 269 insertions(+), 19 deletions(-)
diff --git a/sdks/python/apache_beam/yaml/integration_tests.py
b/sdks/python/apache_beam/yaml/integration_tests.py
index 49ae491def7..aef0a3be4ad 100644
--- a/sdks/python/apache_beam/yaml/integration_tests.py
+++ b/sdks/python/apache_beam/yaml/integration_tests.py
@@ -115,7 +115,7 @@ def provider_sets(spec, require_available=False):
if len(filter_to_available(t, standard_providers[t])) > 1
}
if not multiple_providers:
-yield ('only', standard_providers)
+yield 'only', standard_providers
else:
names, provider_lists = zip(*sorted(multiple_providers.items()))
for ix, c in enumerate(itertools.product(*provider_lists)):
diff --git a/sdks/python/apache_beam/yaml/readme_test.py
b/sdks/python/apache_beam/yaml/readme_test.py
index 592ef03ce33..efce92490a3 100644
--- a/sdks/python/apache_beam/yaml/readme_test.py
+++ b/sdks/python/apache_beam/yaml/readme_test.py
@@ -54,7 +54,7 @@ class FakeSql(beam.PTransform):
raise ValueError(self.query)
def guess_name_and_type(expr):
- expr = expr.strip()
+ expr = expr.strip().replace('`', '')
parts = expr.split()
if len(parts) >= 2 and parts[-2].lower() == 'as':
name = parts[-1]
@@ -181,6 +181,13 @@ class TestEnvironment:
return os.path.join(
self.tempdir.name, str(random.randint(0, 1000)) + '.out')
+ def udf_file(self, name):
+if name == 'my_mapping':
+ lines = '\n'.join(['def my_mapping(row):', '\treturn "good"'])
+else:
+ lines = '\n'.join(['def my_filter(row):', '\treturn True'])
+return self.input_file('udf.py', lines)
+
def __exit__(self, *args):
self.tempdir.cleanup()
@@ -213,6 +220,13 @@ def create_test_method(test_type, test_name, test_yaml):
with TestEnvironment() as env:
nonlocal test_yaml
test_yaml = test_yaml.replace('/path/to/*.tsv', env.input_tsv())
+ if 'MapToFields' in test_yaml or 'Filter' in test_yaml:
+if 'my_mapping' in test_yaml:
+ test_yaml = test_yaml.replace(
+ '/path/to/some/udf.py', env.udf_file('my_mapping'))
+elif 'my_filter' in test_yaml:
+ test_yaml = test_yaml.replace(
+ '/path/to/some/udf.py', env.udf_file('my_filter'))
spec = yaml.load(test_yaml, Loader=SafeLoader)
if test_type == 'PARSE':
return
@@ -237,9 +251,15 @@ def create_test_method(test_type, test_name, test_yaml):
with mock.patch(
'apache_beam.yaml.yaml_provider.SqlBackedProvider.sql_provider',
lambda self: test_provider):
-p = beam.Pipeline(options=PipelineOptions(**options))
-yaml_transform.expand_pipeline(
-p, modified_yaml, yaml_provider.merge_providers([test_provider]))
+# TODO(polber) - remove once there is support for ExternalTransforms
+# in precommits
+with mock.patch(
+'apache_beam.yaml.yaml_provider.ExternalProvider.create_transform',
+lambda *args,
+**kwargs: _Fakes.SomeTransform(*args, **kwargs)):
+ p = beam.Pipeline(options=PipelineOptions(**options))
+ yaml_transform.expand_pipeline(
+ p, modified_yaml, yaml_provider.merge_providers([test_provider]))
if test_type == 'BUILD':
return
p.run().wait_until_finish()
diff --git a/sdks/python/apache_beam/yaml/yaml_mapping.py
b/sdks/python/apache_beam/yaml/yaml_mapping.py
index 32095fe39f2..8d4bcd488bc 100644
---
(beam) branch master updated: Downgrade google-api-core to mitigate #30927 (#31004)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new a26c5055ccc Downgrade google-api-core to mitigate #30927 (#31004) a26c5055ccc is described below commit a26c5055cccfde5780913586439c6f0df949e256 Author: tvalentyn AuthorDate: Wed Apr 17 06:06:30 2024 -0700 Downgrade google-api-core to mitigate #30927 (#31004) * Exclude currently available GAPIC versions affected by a GRPC regression * Regenerate dependencies for Python containers. --- sdks/python/container/py310/base_image_requirements.txt | 8 sdks/python/container/py311/base_image_requirements.txt | 8 sdks/python/container/py38/base_image_requirements.txt | 8 sdks/python/container/py39/base_image_requirements.txt | 8 sdks/python/setup.py| 4 +++- 5 files changed, 19 insertions(+), 17 deletions(-) diff --git a/sdks/python/container/py310/base_image_requirements.txt b/sdks/python/container/py310/base_image_requirements.txt index 8635c937ca0..32bdfa95bc8 100644 --- a/sdks/python/container/py310/base_image_requirements.txt +++ b/sdks/python/container/py310/base_image_requirements.txt @@ -50,8 +50,8 @@ fastavro==1.9.4 fasteners==0.19 freezegun==1.4.0 future==1.0.0 -google-api-core==2.18.0 -google-api-python-client==2.125.0 +google-api-core==2.16.2 +google-api-python-client==2.126.0 google-apitools==0.5.31 google-auth==2.29.0 google-auth-httplib2==0.2.0 @@ -98,7 +98,7 @@ nose==1.3.7 numpy==1.26.4 oauth2client==4.1.3 objsize==0.7.0 -orjson==3.10.0 +orjson==3.10.1 overrides==7.7.0 packaging==24.0 pandas==2.0.3 @@ -130,7 +130,7 @@ pytz==2024.1 PyYAML==6.0.1 redis==5.0.3 referencing==0.34.0 -regex==2023.12.25 +regex==2024.4.16 requests==2.31.0 requests-mock==1.12.1 rpds-py==0.18.0 diff --git a/sdks/python/container/py311/base_image_requirements.txt b/sdks/python/container/py311/base_image_requirements.txt index 300580f0fbf..6db63f234ef 100644 --- a/sdks/python/container/py311/base_image_requirements.txt +++ b/sdks/python/container/py311/base_image_requirements.txt @@ -48,8 +48,8 @@ fastavro==1.9.4 fasteners==0.19 freezegun==1.4.0 future==1.0.0 -google-api-core==2.18.0 -google-api-python-client==2.125.0 +google-api-core==2.16.2 +google-api-python-client==2.126.0 google-apitools==0.5.31 google-auth==2.29.0 google-auth-httplib2==0.2.0 @@ -96,7 +96,7 @@ nose==1.3.7 numpy==1.26.4 oauth2client==4.1.3 objsize==0.7.0 -orjson==3.10.0 +orjson==3.10.1 overrides==7.7.0 packaging==24.0 pandas==2.0.3 @@ -128,7 +128,7 @@ pytz==2024.1 PyYAML==6.0.1 redis==5.0.3 referencing==0.34.0 -regex==2023.12.25 +regex==2024.4.16 requests==2.31.0 requests-mock==1.12.1 rpds-py==0.18.0 diff --git a/sdks/python/container/py38/base_image_requirements.txt b/sdks/python/container/py38/base_image_requirements.txt index ec585687bd6..f59c4004078 100644 --- a/sdks/python/container/py38/base_image_requirements.txt +++ b/sdks/python/container/py38/base_image_requirements.txt @@ -51,8 +51,8 @@ fastavro==1.9.4 fasteners==0.19 freezegun==1.4.0 future==1.0.0 -google-api-core==2.18.0 -google-api-python-client==2.125.0 +google-api-core==2.16.2 +google-api-python-client==2.126.0 google-apitools==0.5.31 google-auth==2.29.0 google-auth-httplib2==0.2.0 @@ -101,7 +101,7 @@ nose==1.3.7 numpy==1.24.4 oauth2client==4.1.3 objsize==0.7.0 -orjson==3.10.0 +orjson==3.10.1 overrides==7.7.0 packaging==24.0 pandas==2.0.3 @@ -134,7 +134,7 @@ pytz==2024.1 PyYAML==6.0.1 redis==5.0.3 referencing==0.34.0 -regex==2023.12.25 +regex==2024.4.16 requests==2.31.0 requests-mock==1.12.1 rpds-py==0.18.0 diff --git a/sdks/python/container/py39/base_image_requirements.txt b/sdks/python/container/py39/base_image_requirements.txt index b169b730c71..0b4a933e788 100644 --- a/sdks/python/container/py39/base_image_requirements.txt +++ b/sdks/python/container/py39/base_image_requirements.txt @@ -50,8 +50,8 @@ fastavro==1.9.4 fasteners==0.19 freezegun==1.4.0 future==1.0.0 -google-api-core==2.18.0 -google-api-python-client==2.125.0 +google-api-core==2.16.2 +google-api-python-client==2.126.0 google-apitools==0.5.31 google-auth==2.29.0 google-auth-httplib2==0.2.0 @@ -99,7 +99,7 @@ nose==1.3.7 numpy==1.26.4 oauth2client==4.1.3 objsize==0.7.0 -orjson==3.10.0 +orjson==3.10.1 overrides==7.7.0 packaging==24.0 pandas==2.0.3 @@ -131,7 +131,7 @@ pytz==2024.1 PyYAML==6.0.1 redis==5.0.3 referencing==0.34.0 -regex==2023.12.25 +regex==2024.4.16 requests==2.31.0 requests-mock==1.12.1 rpds-py==0.18.0 diff --git a/sdks/python/setup.py b/sdks/python/setup.py index da8a674bc96..ad8923fcc8d 100644 --- a/sdks/python/setup.py +++ b/sdks/python/setup.py @@ -436,7 +436,9 @@ if __name__ == '__main__': ], 'gcp': [ 'cachetools>=3.1.0,<6', -
(beam) branch master updated: [#30941]fix upgrade test due to missed config ConsumerPollingTimeout (#30998)
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 8092932a2e1 [#30941]fix upgrade test due to missed config
ConsumerPollingTimeout (#30998)
8092932a2e1 is described below
commit 8092932a2e121a6ddec19efa7b8ec3e25075a950
Author: xianhualiu <122747878+xianhua...@users.noreply.github.com>
AuthorDate: Wed Apr 17 08:53:39 2024 -0400
[#30941]fix upgrade test due to missed config ConsumerPollingTimeout
(#30998)
* [#30941]fix upgrade test deu to missed config ConsumerPollingTimeout in
KafkaIOTranslation
* [#30941]fix upgrade test due to missed config ConsumerPollingTimeout in
KafkaIOTranslation
* [#30941]fix upgrade test due to missed config ConsumerPollingTimeout in
KafkaIOTranslation
* [#30941]fix upgrade test due to missed config ConsumerPollingTimeout in
KafkaIOTranslation
* [#30941]fix upgrade test due to missed config ConsumerPollingTimeout in
KafkaIOTranslation
* fixed upgrade test and changed consumer timeout to long
* fixed spotless issues
* fixed test
---
.../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 38 ++
.../KafkaIOReadImplementationCompatibility.java| 7 +++-
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 21 +---
.../org/apache/beam/sdk/io/kafka/KafkaIOTest.java | 6 ++--
.../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java | 7 ++--
.../sdk/io/kafka/upgrade/KafkaIOTranslation.java | 21 +++-
sdks/python/apache_beam/io/kafka.py| 2 +-
7 files changed, 59 insertions(+), 43 deletions(-)
diff --git
a/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java
b/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java
index 6a0df589706..e897ed439cd 100644
--- a/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java
+++ b/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java
@@ -587,7 +587,7 @@ public class KafkaIO {
.setCommitOffsetsInFinalizeEnabled(false)
.setDynamicRead(false)
.setTimestampPolicyFactory(TimestampPolicyFactory.withProcessingTime())
-.setConsumerPollingTimeout(Duration.standardSeconds(2L))
+.setConsumerPollingTimeout(2L)
.build();
}
@@ -708,7 +708,7 @@ public class KafkaIO {
public abstract @Nullable ErrorHandler
getBadRecordErrorHandler();
@Pure
-public abstract @Nullable Duration getConsumerPollingTimeout();
+public abstract long getConsumerPollingTimeout();
abstract Builder toBuilder();
@@ -766,7 +766,7 @@ public class KafkaIO {
return
setCheckStopReadingFn(CheckStopReadingFnWrapper.of(checkStopReadingFn));
}
- abstract Builder setConsumerPollingTimeout(Duration
consumerPollingTimeout);
+ abstract Builder setConsumerPollingTimeout(long
consumerPollingTimeout);
abstract Read build();
@@ -836,10 +836,9 @@ public class KafkaIO {
if (config.consumerPollingTimeout <= 0) {
throw new IllegalArgumentException("consumerPollingTimeout should
be > 0.");
}
- builder.setConsumerPollingTimeout(
- Duration.standardSeconds(config.consumerPollingTimeout));
+ builder.setConsumerPollingTimeout(config.consumerPollingTimeout);
} else {
- builder.setConsumerPollingTimeout(Duration.standardSeconds(2L));
+ builder.setConsumerPollingTimeout(2L);
}
}
@@ -1356,14 +1355,12 @@ public class KafkaIO {
}
/**
- * Sets the timeout time for Kafka consumer polling request in the {@link
ReadFromKafkaDoFn}. A
- * lower timeout optimizes for latency. Increase the timeout if the
consumer is not fetching
- * enough (or any) records. The default is 2 seconds.
+ * Sets the timeout time in seconds for Kafka consumer polling request in
the {@link
+ * ReadFromKafkaDoFn}. A lower timeout optimizes for latency. Increase the
timeout if the
+ * consumer is not fetching any records. The default is 2 seconds.
*/
-public Read withConsumerPollingTimeout(Duration duration) {
- checkState(
- duration == null || duration.compareTo(Duration.ZERO) > 0,
- "Consumer polling timeout must be greater than 0.");
+public Read withConsumerPollingTimeout(long duration) {
+ checkState(duration > 0, "Consumer polling timeout must be greater than
0.");
return toBuilder().setConsumerPollingTimeout(duration).build();
}
@@ -2071,7 +2068,7 @@ public class KafkaIO {
abstract ErrorHandler getBadRecordErrorHandler();
@Pure
-abstract @Nullable Duration getConsumerPollingTimeout();
+abstract long getConsumerPollingTimeout();
abstract boolean isBounded();
@@
(beam) branch master updated: fix naming changes caused by setuptools (#31012)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 9947260deba fix naming changes caused by setuptools (#31012) 9947260deba is described below commit 9947260debab86688d8be9b70c9cd5ba47379ec8 Author: liferoad AuthorDate: Wed Apr 17 08:55:30 2024 -0400 fix naming changes caused by setuptools (#31012) --- .github/workflows/dask_runner_tests.yml | 2 +- .github/workflows/python_tests.yml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/.github/workflows/dask_runner_tests.yml b/.github/workflows/dask_runner_tests.yml index 628cf2c3446..5f39852c228 100644 --- a/.github/workflows/dask_runner_tests.yml +++ b/.github/workflows/dask_runner_tests.yml @@ -49,7 +49,7 @@ jobs: run: pip install -U build && python -m build --sdist - name: Rename source file working-directory: ./sdks/python/dist -run: mv $(ls | grep "apache-beam.*tar\.gz") apache-beam-source.tar.gz +run: mv $(ls | grep "apache-beam.*tar\.gz\|apache_beam.*tar\.gz") apache-beam-source.tar.gz - name: Upload compressed sources as artifacts uses: actions/upload-artifact@v4 with: diff --git a/.github/workflows/python_tests.yml b/.github/workflows/python_tests.yml index a179939e4df..15d6539e983 100644 --- a/.github/workflows/python_tests.yml +++ b/.github/workflows/python_tests.yml @@ -83,7 +83,7 @@ jobs: run: pip install -U build && python -m build --sdist - name: Rename source file working-directory: ./sdks/python/dist -run: mv $(ls | grep "apache-beam.*tar\.gz") apache-beam-source.tar.gz +run: mv $(ls | grep "apache-beam.*tar\.gz\|apache_beam.*tar\.gz") apache-beam-source.tar.gz - name: Upload compressed sources as artifacts uses: actions/upload-artifact@v4 with:
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 4b07cdff9d3 Updating config from bot
4b07cdff9d3 is described below
commit 4b07cdff9d35acef3a0124fc89df6ce084422293
Author: github-actions
AuthorDate: Wed Apr 17 12:41:05 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31011.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31011.json
b/scripts/ci/pr-bot/state/pr-state/pr-31011.json
new file mode 100644
index 000..f6cbd919240
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31011.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"no-matching-label": "damccorm"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 9d212b4faed Updating config from bot
9d212b4faed is described below
commit 9d212b4faed18f232c7dbea447cf17ce4da0df63
Author: github-actions
AuthorDate: Wed Apr 17 12:41:03 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index b5e0e14162c..9c05b564d72 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -1,7 +1,7 @@
{
"label": "build",
"dateOfLastReviewAssignment": {
-"damccorm": 1713288892885,
+"damccorm": 1713357661356,
"Abacn": 1713355765827
}
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 3222f2a1453 Updating config from bot 3222f2a1453 is described below commit 3222f2a1453234a7a451a13354ea003cfd342c65 Author: github-actions AuthorDate: Wed Apr 17 12:41:07 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json index fcdb4b6e74b..35bc7db0df5 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json @@ -4,7 +4,7 @@ "Abacn": 1713188081309, "AnandInguva": 1710144575340, "chamikaramj": 1713058448533, -"damccorm": 1712307954194, +"damccorm": 1713357664828, "johnjcasey": 1712322355017, "jrmccluskey": 1712595975431, "kennknowles": 1712453421772,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 42479509080 Updating config from bot
42479509080 is described below
commit 42479509080164a0f76b9b36cf8688eb6468c164
Author: github-actions
AuthorDate: Wed Apr 17 12:41:02 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31012.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31012.json
b/scripts/ci/pr-bot/state/pr-state/pr-31012.json
new file mode 100644
index 000..8a92900947e
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31012.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "damccorm"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 37d3c68d7ff Updating config from bot
37d3c68d7ff is described below
commit 37d3c68d7ff09f1326b9c6e0a68f46a65d79c897
Author: github-actions
AuthorDate: Wed Apr 17 12:09:24 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index 47f8cc48ae3..43f66cf3eaa 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -1,7 +1,7 @@
{
"label": "go",
"dateOfLastReviewAssignment": {
-"lostluck": 1712095576120,
+"lostluck": 1713355761561,
"jrmccluskey": 1712552757469,
"youngoli": 1657688896155,
"damccorm": 1680501930289,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 823d355c513 Updating config from bot 823d355c513 is described below commit 823d355c5136f078c8092a20a6d71b7fdd422e74 Author: github-actions AuthorDate: Wed Apr 17 12:13:50 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json b/scripts/ci/pr-bot/state/reviewers-for-label-java.json index 7c4e6e5c20d..3e62ecaa319 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json @@ -9,6 +9,6 @@ "Abacn": 1712730964541, "bvolpato": 1712595969392, "m-trieu": 1713290776308, -"damondouglas": 1712747012989 +"damondouglas": 1713356027654 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 658bcc2f1c8 Updating config from bot 658bcc2f1c8 is described below commit 658bcc2f1c8f5713361c5f92f27b78bb77266536 Author: github-actions AuthorDate: Wed Apr 17 12:13:51 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json b/scripts/ci/pr-bot/state/reviewers-for-label-io.json index 1b7879d4fc1..798b6551f7a 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json @@ -5,7 +5,7 @@ "johnjcasey": 1712730964541, "pabloem": 1691787951165, "Abacn": 1713318705496, -"ahmedabu98": 1712725549321, +"ahmedabu98": 1713356028189, "bvolpato": 1712595969392, "manavgarg": 1690826779210, "damondouglas": 1712747012989,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new c567f8a4a14 Updating config from bot
c567f8a4a14 is described below
commit c567f8a4a1443f18b409497962a56bfbb400302b
Author: github-actions
AuthorDate: Wed Apr 17 12:13:49 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-28763.json | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-28763.json
b/scripts/ci/pr-bot/state/pr-state/pr-28763.json
index 4d841dcb81c..5e473c8c7ef 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-28763.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-28763.json
@@ -1,8 +1,8 @@
{
"commentedAboutFailingChecks": false,
"reviewersAssignedForLabels": {
-"java": "Abacn",
-"io": "johnjcasey"
+"java": "damondouglas",
+"io": "ahmedabu98"
},
"nextAction": "Reviewers",
"stopReviewerNotifications": false,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 15c3ee2426d Updating config from bot
15c3ee2426d is described below
commit 15c3ee2426df2477d883250b37ff3cba61ec5d98
Author: github-actions
AuthorDate: Wed Apr 17 12:09:28 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 5c53b2b5813..b5e0e14162c 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -2,6 +2,6 @@
"label": "build",
"dateOfLastReviewAssignment": {
"damccorm": 1713288892885,
-"Abacn": 1713198547707
+"Abacn": 1713355765827
}
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 7924428f2da Updating config from bot
7924428f2da is described below
commit 7924428f2da75412311864824386928fb4d2dcc3
Author: github-actions
AuthorDate: Wed Apr 17 12:09:27 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31009.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31009.json
b/scripts/ci/pr-bot/state/pr-state/pr-31009.json
new file mode 100644
index 000..9c51466b9ee
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31009.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "Abacn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 77222df3331 Updating config from bot
77222df3331 is described below
commit 77222df3331055b5e8c446d4d8ad552defb7eba1
Author: github-actions
AuthorDate: Wed Apr 17 12:09:22 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31010.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31010.json
b/scripts/ci/pr-bot/state/pr-state/pr-31010.json
new file mode 100644
index 000..8ea94810368
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31010.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"go": "lostluck"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
