[beam] branch nightly-refs/heads/master updated (43d7ec0a147 -> fcd69f02ba1)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 43d7ec0a147 Fix Go Code Coverage. (#26885)
add f9a82f7b920 Initial terraform code for ARC based runners (#26845)
add d8f0e1786f1 update_grpc_router (#26843)
add 2d82b5fdc6e [BQ Storage] Allow using optional minutes in timestamp
offset (#26879)
add 0963cf0bd0a Fix failing BQ tests on XVR GoUsingJava tests (#26880)
add 2b13a03acc4 [release] Add signing key flag and env variable to release
documentation (#26895)
add 35ceb278373 Validate that a URN is set on all non-composite transforms.
add ee18c7b6035 Add stub URNs to make validation pass.
add c576fe9f359 spotless
add 31c3390bbb4 Merge pull request #26675 Validate that a URN is set on
all non-composite transforms.
add 1007b508cf7 Exclude sickbay test suite in mass comment (#26894)
add 675d509967b Gate pushing release branch on input (default true)
(#26793)
add 3d85be031ea [Tour of beam][Playground] Use source directory as working
directory (#26842)
add cc8a1ec4a6a Fixed SingleStore row in the Built-in I/O Connectors
table. (#25574)
add fc5f2f51350 Structured logging support - Java SDK (#26848)
add 480e8a7ca3b fix: get google apt key with gpg commmand (#26859)
add 170b597b5ea [Website] change banner (#26898)
add 0b430748cdd Fix java dockerPrepare timing (#26901)
add 4aebbc0391c [Playground] Log cancellation messages as warnings (#26790)
add 6865eefac56 [Playground] Refuse RunCode requests if NUM_PARALLEL_JOBS
is exceeded (#26737)
add 676382c842e Provide Python container path in xlang postcommit (#26908)
add b2ca23c04e4 fix ClassCastException in toBeamValue with
List<{Primitive}> types (#26873)
add 06a0c871141 Add AutoService annotation to
SpannerChangestreamsReadSchemaTransformProvider (#26899)
add 0c7f4ddc892 Upgrade spring-expression due to CVE-2023-20861 and
CVE-2023-20863 (#26813)
add 6dfe06adbbf Always install dev wheel if passed to sdk_version (#26913)
add fcd69f02ba1 Switch Flink load test with lcg synthetic data (#26893)
No new revisions were added by this update.
Summary of changes:
.../gh-actions-self-hosted-runners/arc/README.md | 63 +++
.../arc/config/arc_autoscaler.tpl | 42 ++
.../arc/config/arc_certificate.tpl | 25 +
.../arc/config/arc_deployment.tpl | 39 ++
.github/gh-actions-self-hosted-runners/arc/gke.tf | 52 ++
.github/gh-actions-self-hosted-runners/arc/helm.tf | 54 ++
.github/gh-actions-self-hosted-runners/arc/iam.tf | 29 ++
.../arc/kubernetes.tf | 33 ++
.../gh-actions-self-hosted-runners/arc/locals.tf | 39 ++
.../gh-actions-self-hosted-runners/arc/network.tf | 32 ++
.../gh-actions-self-hosted-runners/arc/outputs.tf | 28 +
.../gh-actions-self-hosted-runners/arc/provider.tf | 69 +++
.../gh-actions-self-hosted-runners/arc/secrets.tf | 30 ++
.../arc/variables.tf | 91
.../gh-actions-self-hosted-runners/arc/webhook.tf | 31 ++
.github/workflows/cut_release_branch.yml | 84 +--
.test-infra/jenkins/README.md | 2 +-
.../job_LoadTests_Combine_Flink_Python.groovy | 9 +-
.../jenkins/job_LoadTests_GBK_Flink_Python.groovy | 4 +-
.../job_LoadTests_GBK_Python_reiterate.groovy | 6 +-
.../job_LoadTests_ParDo_Flink_Python.groovy| 27 +-
.../jenkins/job_LoadTests_coGBK_Python.groovy | 24 +-
...stCommit_Python_CrossLanguage_Gcp_Direct.groovy | 1 -
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 11 +-
learning/tour-of-beam/frontend/lib/locator.dart| 1 -
.../frontend/lib/pages/tour/state.dart | 2 +-
playground/backend/cmd/server/controller.go| 10 +-
playground/backend/configs/SDK_JAVA.json | 2 +-
playground/backend/containers/java/Dockerfile | 2 +-
.../internal/code_processing/code_processing.go| 63 ++-
.../code_processing/code_processing_test.go| 2 +-
playground/backend/internal/errors/grpc_errors.go | 6 +
.../backend/internal/errors/lifecycle_error.go | 32 ++
.../internal/setup_tools/builder/setup_builder.go | 2 +-
.../setup_tools/builder/setup_builder_test.go | 4 +-
playground/backend/internal/utils/system_utils.go | 6 +-
.../backend/internal/utils/system_utils_test.go| 12 +-
playground/frontend/lib/controllers/factories.dart | 2 +-
playground/frontend/lib/locator.dart | 3 -
.../widgets/embedded_appbar_title.dart | 4 +-
.../lib/playground_components.dart | 1 -
.../lib/src/controllers/code_runner.dart | 333 ++--
.../lib/src/controllers/playground_controller.dart | 6 +-
.../repositories/code_client/grpc_code_client.dart |
[beam] branch asf-site updated: Publishing website 2023/05/27 04:17:11 at commit fcd69f0
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 05bf70940c0 Publishing website 2023/05/27 04:17:11 at commit fcd69f0 05bf70940c0 is described below commit 05bf70940c077f6bd185cf27de69967f36f44a5e Author: jenkins AuthorDate: Sat May 27 04:17:12 2023 + Publishing website 2023/05/27 04:17:11 at commit fcd69f0 --- website/generated-content/sitemap.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml index 246b4e5644c..6ad5622d16f 100644 --- a/website/generated-content/sitemap.xml +++ b/website/generated-content/sitemap.xml @@ -1 +1 @@ -http://www.sitemaps.org/schemas/sitemap/0.9; xmlns:xhtml="http://www.w3.org/1999/xhtml;>/blog/beam-2.47.0/2023-05-26T18:00:17-04:00/categories/blog/2023-05-26T18:00:17-04:00/blog/2023-05-26T18:00:17-04:00/categories/2023-05-26T18:00:17-04:00/catego [...] \ No newline at end of file +http://www.sitemaps.org/schemas/sitemap/0.9; xmlns:xhtml="http://www.w3.org/1999/xhtml;>/blog/beam-2.47.0/2023-05-26T22:06:45-04:00/categories/blog/2023-05-26T22:06:45-04:00/blog/2023-05-26T22:06:45-04:00/categories/2023-05-26T22:06:45-04:00/catego [...] \ No newline at end of file
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new e441e371c5e Updating config from bot e441e371c5e is described below commit e441e371c5ee919fd3f23d8b72a5a1da7ec04b32 Author: github-actions AuthorDate: Sat May 27 02:18:49 2023 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json b/scripts/ci/pr-bot/state/reviewers-for-label-python.json index e53dce1bfb1..ad3ff18d277 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json @@ -9,7 +9,7 @@ "pabloem": 1681281324703, "y1chi": 1667002607045, "damccorm": 1684798489768, -"jrmccluskey": 1684402503798, +"jrmccluskey": 1685153925715, "riteshghorse": 1684500117481, "liferoad": 1684537555366 }
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 4b38ee16767 Updating config from bot
4b38ee16767 is described below
commit 4b38ee16767d3440f6dc325de8cf7037a7802ad9
Author: github-actions
AuthorDate: Sat May 27 02:18:47 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-26920.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26920.json
b/scripts/ci/pr-bot/state/pr-state/pr-26920.json
new file mode 100644
index 000..959c289c017
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-26920.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"python": "jrmccluskey"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
[beam] branch master updated (6dfe06adbbf -> fcd69f02ba1)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 6dfe06adbbf Always install dev wheel if passed to sdk_version (#26913) add fcd69f02ba1 Switch Flink load test with lcg synthetic data (#26893) No new revisions were added by this update. Summary of changes: .../job_LoadTests_Combine_Flink_Python.groovy | 9 +--- .../jenkins/job_LoadTests_GBK_Flink_Python.groovy | 4 ++-- .../job_LoadTests_GBK_Python_reiterate.groovy | 6 +++-- .../job_LoadTests_ParDo_Flink_Python.groovy| 27 ++ .../jenkins/job_LoadTests_coGBK_Python.groovy | 24 --- 5 files changed, 46 insertions(+), 24 deletions(-)
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 4e7300845c9 Updating config from bot
4e7300845c9 is described below
commit 4e7300845c98385269538d774e561d307cd7296a
Author: github-actions
AuthorDate: Fri May 26 23:06:09 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-26919.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26919.json
b/scripts/ci/pr-bot/state/pr-state/pr-26919.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-26919.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
[beam] branch master updated: Always install dev wheel if passed to sdk_version (#26913)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 6dfe06adbbf Always install dev wheel if passed to sdk_version (#26913)
6dfe06adbbf is described below
commit 6dfe06adbbfa60f2e90804e4400911c127da48cc
Author: Yi Hu
AuthorDate: Fri May 26 18:44:33 2023 -0400
Always install dev wheel if passed to sdk_version (#26913)
---
sdks/python/container/piputil.go | 5 -
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git a/sdks/python/container/piputil.go b/sdks/python/container/piputil.go
index a931f45a672..03ac8325d6d 100644
--- a/sdks/python/container/piputil.go
+++ b/sdks/python/container/piputil.go
@@ -148,8 +148,11 @@ func findBeamSdkWhl(files []string, acceptableWhlSpecs
[]string) string {
// SDK from source tarball provided in sdkSrcFile.
func installSdk(files []string, workDir string, sdkSrcFile string,
acceptableWhlSpecs []string, required bool) error {
sdkWhlFile := findBeamSdkWhl(files, acceptableWhlSpecs)
+
if sdkWhlFile != "" {
- err := pipInstallPackage(files, workDir, sdkWhlFile, false,
false, []string{"gcp"})
+ // by default, pip rejects to install wheel if same version
already installed
+ isDev := strings.Contains(sdkWhlFile, ".dev")
+ err := pipInstallPackage(files, workDir, sdkWhlFile, isDev,
false, []string{"gcp"})
if err == nil {
return nil
}
[beam] branch asf-site updated: Publishing website 2023/05/26 22:17:30 at commit 0c7f4dd
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 26991e80507 Publishing website 2023/05/26 22:17:30 at commit 0c7f4dd 26991e80507 is described below commit 26991e805079b981e2689a19aa03e9a959033ff0 Author: jenkins AuthorDate: Fri May 26 22:17:30 2023 + Publishing website 2023/05/26 22:17:30 at commit 0c7f4dd --- website/generated-content/sitemap.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml index 54b9fffba46..246b4e5644c 100644 --- a/website/generated-content/sitemap.xml +++ b/website/generated-content/sitemap.xml @@ -1 +1 @@ -http://www.sitemaps.org/schemas/sitemap/0.9; xmlns:xhtml="http://www.w3.org/1999/xhtml;>/blog/beam-2.47.0/2023-05-26T10:26:22-04:00/categories/blog/2023-05-26T10:26:22-04:00/blog/2023-05-26T10:26:22-04:00/categories/2023-05-26T10:26:22-04:00/catego [...] \ No newline at end of file +http://www.sitemaps.org/schemas/sitemap/0.9; xmlns:xhtml="http://www.w3.org/1999/xhtml;>/blog/beam-2.47.0/2023-05-26T18:00:17-04:00/categories/blog/2023-05-26T18:00:17-04:00/blog/2023-05-26T18:00:17-04:00/categories/2023-05-26T18:00:17-04:00/catego [...] \ No newline at end of file
[beam] branch master updated (06a0c871141 -> 0c7f4ddc892)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 06a0c871141 Add AutoService annotation to SpannerChangestreamsReadSchemaTransformProvider (#26899) add 0c7f4ddc892 Upgrade spring-expression due to CVE-2023-20861 and CVE-2023-20863 (#26813) No new revisions were added by this update. Summary of changes: playground/backend/containers/java/Dockerfile | 2 +- sdks/java/io/kafka/build.gradle | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
[beam] branch master updated (b2ca23c04e4 -> 06a0c871141)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from b2ca23c04e4 fix ClassCastException in toBeamValue with
List<{Primitive}> types (#26873)
add 06a0c871141 Add AutoService annotation to
SpannerChangestreamsReadSchemaTransformProvider (#26899)
No new revisions were added by this update.
Summary of changes:
.../changestreams/SpannerChangestreamsReadSchemaTransformProvider.java | 3 +++
1 file changed, 3 insertions(+)
[beam] branch master updated (676382c842e -> b2ca23c04e4)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 676382c842e Provide Python container path in xlang postcommit (#26908)
add b2ca23c04e4 fix ClassCastException in toBeamValue with
List<{Primitive}> types (#26873)
No new revisions were added by this update.
Summary of changes:
.../apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 17 -
.../beam/sdk/io/gcp/bigquery/BigQueryUtilsTest.java | 12
2 files changed, 28 insertions(+), 1 deletion(-)
[beam] branch master updated (6865eefac56 -> 676382c842e)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 6865eefac56 [Playground] Refuse RunCode requests if NUM_PARALLEL_JOBS is exceeded (#26737) add 676382c842e Provide Python container path in xlang postcommit (#26908) No new revisions were added by this update. Summary of changes: .test-infra/jenkins/README.md | 2 +- .../job_PostCommit_Python_CrossLanguage_Gcp_Direct.groovy | 1 - .../groovy/org/apache/beam/gradle/BeamModulePlugin.groovy | 11 +-- sdks/python/test-suites/dataflow/common.gradle| 1 + 4 files changed, 7 insertions(+), 8 deletions(-)
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new f413faa8bc5 Updating config from bot
f413faa8bc5 is described below
commit f413faa8bc58616bac106b3d25128c508f422615
Author: github-actions
AuthorDate: Fri May 26 19:31:12 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-26913.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26913.json
b/scripts/ci/pr-bot/state/pr-state/pr-26913.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-26913.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new bdf9a438421 Updating config from bot bdf9a438421 is described below commit bdf9a438421d376952ec6f78663521e394219780 Author: github-actions AuthorDate: Fri May 26 19:05:31 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-26910.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26910.json b/scripts/ci/pr-bot/state/pr-state/pr-26910.json index 9c51466b9ee..ebb27d68fb5 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-26910.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-26910.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 3bede1bf544 Updating config from bot
3bede1bf544 is described below
commit 3bede1bf544f071d5c326619ca8c4ce31209a204
Author: github-actions
AuthorDate: Fri May 26 18:34:48 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 6a63b8b445e..ae6b52f4d3a 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -2,6 +2,6 @@
"label": "build",
"dateOfLastReviewAssignment": {
"damccorm": 1685081166600,
-"Abacn": 1684859789493
+"Abacn": 1685126084619
}
}
\ No newline at end of file
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new f936adee7f9 Updating config from bot
f936adee7f9 is described below
commit f936adee7f95fa28e1e203c2df334227004c9aaa
Author: github-actions
AuthorDate: Fri May 26 18:34:46 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-26910.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26910.json
b/scripts/ci/pr-bot/state/pr-state/pr-26910.json
new file mode 100644
index 000..9c51466b9ee
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-26910.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "Abacn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
[beam] branch master updated: [Playground] Refuse RunCode requests if NUM_PARALLEL_JOBS is exceeded (#26737)
This is an automated email from the ASF dual-hosted git repository.
pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 6865eefac56 [Playground] Refuse RunCode requests if NUM_PARALLEL_JOBS
is exceeded (#26737)
6865eefac56 is described below
commit 6865eefac5633198c71fd1ec75b514e8a390d002
Author: Timur Sultanov
AuthorDate: Fri May 26 21:05:07 2023 +0400
[Playground] Refuse RunCode requests if NUM_PARALLEL_JOBS is exceeded
(#26737)
* Refuse RunCode requests if NUM_PARALLEL_JOBS is exceeded
* Retry running if backend was overloaded
* Fix the embedded_run frontend integration test
* Ignore copy button when a snippet has not loaded yet
* Change run attempts and interval
-
Co-authored-by: Alexey Inkin
Co-authored-by: Alexey Inkin
---
learning/tour-of-beam/frontend/lib/locator.dart| 1 -
.../frontend/lib/pages/tour/state.dart | 2 +-
playground/backend/cmd/server/controller.go| 6 +
playground/backend/internal/errors/grpc_errors.go | 6 +
playground/backend/internal/utils/system_utils.go | 6 +-
.../backend/internal/utils/system_utils_test.go| 12 +-
playground/frontend/lib/controllers/factories.dart | 2 +-
playground/frontend/lib/locator.dart | 3 -
.../widgets/embedded_appbar_title.dart | 4 +-
.../lib/playground_components.dart | 1 -
.../lib/src/controllers/code_runner.dart | 333 ++--
.../lib/src/controllers/playground_controller.dart | 6 +-
.../repositories/code_client/grpc_code_client.dart | 20 +-
.../lib/src/repositories/code_repository.dart | 241 -
.../src/repositories/models/run_code_error.dart| 6 +
.../src/repositories/models/run_code_result.dart | 26 +-
.../lib/src/widgets/run_or_cancel_button.dart | 11 +-
.../test/src/controllers/code_runner_test.dart | 258 ++
.../src/controllers/code_runner_test.mocks.dart| 564 +
.../src/repositories/code_repository_test.dart | 389 --
.../repositories/code_repository_test.mocks.dart | 249 -
.../lib/src/widget_tester.dart | 6 +-
22 files changed, 1186 insertions(+), 966 deletions(-)
diff --git a/learning/tour-of-beam/frontend/lib/locator.dart
b/learning/tour-of-beam/frontend/lib/locator.dart
index 46095e92948..fedfa528c05 100644
--- a/learning/tour-of-beam/frontend/lib/locator.dart
+++ b/learning/tour-of-beam/frontend/lib/locator.dart
@@ -57,7 +57,6 @@ Future _initializeRepositories() async {
final exampleClient = GrpcExampleClient(url: routerUrl);
GetIt.instance.registerSingleton(codeClient);
- GetIt.instance.registerSingleton(CodeRepository(client: codeClient));
GetIt.instance.registerSingleton(exampleClient);
GetIt.instance.registerSingleton(ExampleRepository(client: exampleClient));
}
diff --git a/learning/tour-of-beam/frontend/lib/pages/tour/state.dart
b/learning/tour-of-beam/frontend/lib/pages/tour/state.dart
index a228d3a0621..00d2f2fcddc 100644
--- a/learning/tour-of-beam/frontend/lib/pages/tour/state.dart
+++ b/learning/tour-of-beam/frontend/lib/pages/tour/state.dart
@@ -351,7 +351,7 @@ class TourNotifier extends ChangeNotifier with
PageStateMixin {
static PlaygroundController _createPlaygroundController(String initialSdkId)
{
final playgroundController = PlaygroundController(
- codeRepository: GetIt.instance.get(),
+ codeClient: GetIt.instance.get(),
exampleCache: ExampleCache(
exampleRepository: GetIt.instance.get(),
),
diff --git a/playground/backend/cmd/server/controller.go
b/playground/backend/cmd/server/controller.go
index 606e5fd4dcf..f788f2e613f 100644
--- a/playground/backend/cmd/server/controller.go
+++ b/playground/backend/cmd/server/controller.go
@@ -69,11 +69,17 @@ type playgroundController struct {
// RunCode is running code from requests using a particular SDK
// - In case of incorrect sdk returns codes.InvalidArgument
+// - In case of exceeded number of parallel jobs returns
codes.ResourceExhausted
// - In case of error during preparing files/folders returns codes.Internal
// - In case of no errors saves playground.Status_STATUS_EXECUTING as
cache.Status into cache and sets expiration time
// for all cache values which will be saved into cache during processing
received code.
// Returns id of code processing (pipelineId)
func (controller *playgroundController) RunCode(ctx context.Context, info
*pb.RunCodeRequest) (*pb.RunCodeResponse, error) {
+ // check if we can take a new RunCode request
+ if
!utils.CheckNumOfTheParallelJobs(controller.env.ApplicationEnvs.WorkingDir(),
controller.env.BeamSdkEnvs.NumOfParallelJobs()) {
+ logger.Warnf("RunCode(): number of parallel jobs is
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 2fd57dc8f68 Updating config from bot
2fd57dc8f68 is described below
commit 2fd57dc8f68bb5640afef004227b32ff900027c8
Author: github-actions
AuthorDate: Fri May 26 16:46:22 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-26908.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26908.json
b/scripts/ci/pr-bot/state/pr-state/pr-26908.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-26908.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
[beam] branch master updated: [Playground] Log cancellation messages as warnings (#26790)
This is an automated email from the ASF dual-hosted git repository.
pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 4aebbc0391c [Playground] Log cancellation messages as warnings (#26790)
4aebbc0391c is described below
commit 4aebbc0391c9e03e7bfdfd58f80986314c33ed18
Author: Timur Sultanov
AuthorDate: Fri May 26 20:44:04 2023 +0400
[Playground] Log cancellation messages as warnings (#26790)
* Log cancellation messages as warnings
* Log compilation errors as warnings
---
playground/backend/cmd/server/controller.go| 4 +-
.../internal/code_processing/code_processing.go| 63 +++---
.../backend/internal/errors/lifecycle_error.go | 32 +++
3 files changed, 78 insertions(+), 21 deletions(-)
diff --git a/playground/backend/cmd/server/controller.go
b/playground/backend/cmd/server/controller.go
index 4e379be2595..606e5fd4dcf 100644
--- a/playground/backend/cmd/server/controller.go
+++ b/playground/backend/cmd/server/controller.go
@@ -570,7 +570,7 @@ func (controller *playgroundController) GetSnippet(ctx
context.Context, info *pb
func (controller *playgroundController) GetMetadata(_ context.Context, _
*pb.GetMetadataRequest) (*pb.GetMetadataResponse, error) {
commitTimestampInteger, err := strconv.ParseInt(BuildCommitTimestamp,
10, 64)
if err != nil {
- logger.Errorf("GetMetadata(): failed to parse
BuildCommitTimestamp (\"%s\"): %s", BuildCommitTimestamp, err.Error())
+ logger.Warnf("GetMetadata(): failed to parse
BuildCommitTimestamp (\"%s\"): %s", BuildCommitTimestamp, err.Error())
commitTimestampInteger = 0
}
@@ -587,7 +587,7 @@ func (controller *playgroundController) GetMetadata(_
context.Context, _ *pb.Get
// verifyRouter verifies that controller is configured to work in router mode
func (controller *playgroundController) verifyRouter() error {
if controller.env.BeamSdkEnvs.ApacheBeamSdk != pb.Sdk_SDK_UNSPECIFIED {
- return errors.New("runner mode")
+ return errors.New("server is in runner mode")
}
if controller.db == nil {
return errors.New("no database service")
diff --git a/playground/backend/internal/code_processing/code_processing.go
b/playground/backend/internal/code_processing/code_processing.go
index d371860430e..06bc8335701 100644
--- a/playground/backend/internal/code_processing/code_processing.go
+++ b/playground/backend/internal/code_processing/code_processing.go
@@ -18,6 +18,7 @@ package code_processing
import (
"bytes"
"context"
+ "errors"
"fmt"
"io"
"os"
@@ -31,7 +32,7 @@ import (
pb "beam.apache.org/playground/backend/internal/api/v1"
"beam.apache.org/playground/backend/internal/cache"
"beam.apache.org/playground/backend/internal/environment"
- "beam.apache.org/playground/backend/internal/errors"
+ perrors "beam.apache.org/playground/backend/internal/errors"
"beam.apache.org/playground/backend/internal/executors"
"beam.apache.org/playground/backend/internal/fs_tool"
"beam.apache.org/playground/backend/internal/logger"
@@ -68,13 +69,23 @@ func Process(ctx context.Context, cacheService cache.Cache,
lc *fs_tool.LifeCycl
err := validateStep(pipelineLifeCycleCtx, cacheService, ,
pipelineId, sdkEnv, )
if err != nil {
- logger.Errorf("%s: error during validation step: %s",
pipelineId, err.Error())
+ var pipelineCanceledError perrors.PipelineCanceledError
+ if errors.As(err, ) {
+ logger.Warnf("%s: pipeline execution has been canceled:
%s", pipelineId, pipelineCanceledError.Error())
+ } else {
+ logger.Errorf("%s: error during validation step: %s",
pipelineId, err.Error())
+ }
return
}
err = prepareStep(pipelineLifeCycleCtx, cacheService, ,
pipelineId, sdkEnv, , lc.GetPreparerParameters())
if err != nil {
- logger.Errorf("%s: error during preparation step: %s",
pipelineId, err.Error())
+ var pipelineCanceledError perrors.PipelineCanceledError
+ if errors.As(err, ) {
+ logger.Warnf("%s: pipeline execution has been canceled:
%s", pipelineId, pipelineCanceledError.Error())
+ } else {
+ logger.Errorf("%s: error during preparation step: %s",
pipelineId, err.Error())
+ }
return
}
@@ -84,14 +95,28 @@ func Process(ctx context.Context, cacheService cache.Cache,
lc *fs_tool.LifeCycl
err = compileStep(pipelineLifeCycleCtx, cacheService, ,
pipelineId, sdkEnv, isUnitTest)
if err != nil {
- logger.Errorf("%s: error
[beam] branch master updated: Fix java dockerPrepare timing (#26901)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 0b430748cdd Fix java dockerPrepare timing (#26901)
0b430748cdd is described below
commit 0b430748cdd2e25edc553747ce018195e9cce888
Author: Yi Hu
AuthorDate: Fri May 26 10:26:22 2023 -0400
Fix java dockerPrepare timing (#26901)
---
sdks/java/container/common.gradle | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/sdks/java/container/common.gradle
b/sdks/java/container/common.gradle
index 084b7eefefa..5b2130f2781 100644
--- a/sdks/java/container/common.gradle
+++ b/sdks/java/container/common.gradle
@@ -62,6 +62,8 @@ task copyDockerfileDependencies(type: Copy) {
}
task copySdkHarnessLauncher(type: Copy) {
+dependsOn ":sdks:java:container:downloadCloudProfilerAgent"
+
from configurations.sdkHarnessLauncher
into "build/target"
}
@@ -134,6 +136,5 @@ if
(project.rootProject.hasProperty(["docker-pull-licenses"]) ||
}
dockerPrepare.dependsOn copySdkHarnessLauncher
dockerPrepare.dependsOn copyDockerfileDependencies
-dockerPrepare.dependsOn ":sdks:java:container:downloadCloudProfilerAgent"
dockerPrepare.dependsOn copyJdkOptions
dockerPrepare.dependsOn validateJavaHome
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new a5aa5e28b48 Updating config from bot a5aa5e28b48 is described below commit a5aa5e28b48dee84cb1f5fe227ac761c90080e51 Author: github-actions AuthorDate: Fri May 26 14:01:21 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-26901.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26901.json b/scripts/ci/pr-bot/state/pr-state/pr-26901.json index fa3809f24dd..6ad08dcf573 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-26901.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-26901.json @@ -4,7 +4,7 @@ "java": "kennknowles" }, "nextAction": "Reviewers", - "stopReviewerNotifications": false, + "stopReviewerNotifications": true, "remindAfterTestsPass": [], "committerAssigned": false } \ No newline at end of file
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new f9e6bdeaef1 Updating config from bot f9e6bdeaef1 is described below commit f9e6bdeaef1f3e21ccb938e1d443ff17d1a3dd48 Author: github-actions AuthorDate: Fri May 26 14:00:50 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-26893.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26893.json b/scripts/ci/pr-bot/state/pr-state/pr-26893.json index 26e4be5dc8a..24ff5131212 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-26893.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-26893.json @@ -4,7 +4,7 @@ "no-matching-label": "chamikaramj" }, "nextAction": "Reviewers", - "stopReviewerNotifications": false, + "stopReviewerNotifications": true, "remindAfterTestsPass": [], "committerAssigned": false } \ No newline at end of file
[beam] branch master updated (480e8a7ca3b -> 170b597b5ea)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 480e8a7ca3b fix: get google apt key with gpg commmand (#26859) add 170b597b5ea [Website] change banner (#26898) No new revisions were added by this update. Summary of changes: website/www/site/assets/scss/_banner.sass | 6 +- website/www/site/layouts/partials/header.html | 6 +++--- website/www/site/static/images/banner_desktop.png | Bin 0 -> 79738 bytes website/www/site/static/images/banner_mobile.png | Bin 0 -> 64923 bytes 4 files changed, 4 insertions(+), 8 deletions(-) create mode 100644 website/www/site/static/images/banner_desktop.png create mode 100644 website/www/site/static/images/banner_mobile.png
[beam] branch master updated (fc5f2f51350 -> 480e8a7ca3b)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from fc5f2f51350 Structured logging support - Java SDK (#26848) add 480e8a7ca3b fix: get google apt key with gpg commmand (#26859) No new revisions were added by this update. Summary of changes: .../cloudbuild/cloudbuild_playground_deploy.sh | 2 +- .../cloudbuild/cloudbuild_playground_infra.sh | 29 -- 2 files changed, 23 insertions(+), 8 deletions(-)
[beam] branch dependabot/gradle/com.gradle.enterprise-3.13.3 deleted (was dacca0c1822)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.gradle.enterprise-3.13.3 in repository https://gitbox.apache.org/repos/asf/beam.git was dacca0c1822 Bump com.gradle.enterprise from 3.13.2 to 3.13.3 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new c0ad802acc6 Updating config from bot c0ad802acc6 is described below commit c0ad802acc66b4dc2608959b2ecb46db109601c0 Author: github-actions AuthorDate: Fri May 26 11:34:43 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-26903.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26903.json b/scripts/ci/pr-bot/state/pr-state/pr-26903.json index f6cbd919240..bd084d1c483 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-26903.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-26903.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new a6a793eef7f Updating config from bot
a6a793eef7f is described below
commit a6a793eef7fc43401f0d71ecf53813bb7e95893d
Author: github-actions
AuthorDate: Fri May 26 06:06:11 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 37bf3ac37d8..6a63b8b445e 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -1,7 +1,7 @@
{
"label": "build",
"dateOfLastReviewAssignment": {
-"damccorm": 1684812879690,
+"damccorm": 1685081166600,
"Abacn": 1684859789493
}
}
\ No newline at end of file
[beam] branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new d694291f1a2 Updating config from bot
d694291f1a2 is described below
commit d694291f1a250fef94b55ae1221fb6a965d92dd6
Author: github-actions
AuthorDate: Fri May 26 06:06:08 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-26905.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-26905.json
b/scripts/ci/pr-bot/state/pr-state/pr-26905.json
new file mode 100644
index 000..8a92900947e
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-26905.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "damccorm"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
