(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 2bffee622a8 Updating config from bot
2bffee622a8 is described below
commit 2bffee622a87557d5e6d270bffb44fca82ff834b
Author: github-actions
AuthorDate: Mon Nov 6 10:35:54 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29313.json | 12
1 file changed, 12 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29313.json
b/scripts/ci/pr-bot/state/pr-state/pr-29313.json
new file mode 100644
index 000..ba7809d0477
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29313.json
@@ -0,0 +1,12 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"java": "bvolpato",
+"io": "chamikaramj",
+"spanner": "nielm"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new ee1a92f264d Updating config from bot
ee1a92f264d is described below
commit ee1a92f264d6858058bbb18cef0a57e8dd4556a2
Author: github-actions
AuthorDate: Mon Nov 6 10:35:58 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-spanner.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-spanner.json
b/scripts/ci/pr-bot/state/reviewers-for-label-spanner.json
index 210695be669..590e67ab537 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-spanner.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-spanner.json
@@ -1,6 +1,6 @@
{
"label": "spanner",
"dateOfLastReviewAssignment": {
-"nielm": 1693977347401
+"nielm": 1699266953098
}
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 926999f8183 Updating config from bot 926999f8183 is described below commit 926999f8183e7b277401c790f656ae2c110783e3 Author: github-actions AuthorDate: Mon Nov 6 10:35:56 2023 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json b/scripts/ci/pr-bot/state/reviewers-for-label-java.json index e5698194267..80274e5ed30 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json @@ -7,7 +7,7 @@ "kileys": 1674428678843, "apilloud": 1678822446183, "Abacn": 1699021514543, -"bvolpato": 1698694484788, +"bvolpato": 1699266953098, "m-trieu": 1699230866798 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new d16dbc4d505 Updating config from bot
d16dbc4d505 is described below
commit d16dbc4d5050753554dff14e2c996902439ae5e6
Author: github-actions
AuthorDate: Mon Nov 6 10:35:57 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json
b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
index ead08272200..2265c6b1263 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json
@@ -1,7 +1,7 @@
{
"label": "io",
"dateOfLastReviewAssignment": {
-"chamikaramj": 1698694484788,
+"chamikaramj": 1699266953098,
"johnjcasey": 1699021514543,
"pabloem": 1691787951165,
"Abacn": 1699054471140,
(beam) branch dependabot/go_modules/sdks/github.com/spf13/cobra-1.8.0 deleted (was 3f3a1e87c5d)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/spf13/cobra-1.8.0 in repository https://gitbox.apache.org/repos/asf/beam.git was 3f3a1e87c5d Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 in /sdks (#29308)
This is an automated email from the ASF dual-hosted git repository. riteshghorse pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 34b93c0d10d Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 in /sdks (#29308) 34b93c0d10d is described below commit 34b93c0d10ddd67d081b401a59a2f77be0ad5a89 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Mon Nov 6 09:19:34 2023 -0500 Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 in /sdks (#29308) Bumps [github.com/spf13/cobra](https://github.com/spf13/cobra) from 1.7.0 to 1.8.0. - [Release notes](https://github.com/spf13/cobra/releases) - [Commits](https://github.com/spf13/cobra/compare/v1.7.0...v1.8.0) --- updated-dependencies: - dependency-name: github.com/spf13/cobra dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- sdks/go.mod | 2 +- sdks/go.sum | 6 +++--- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/sdks/go.mod b/sdks/go.mod index 5618da7ec14..0ee2c233dab 100644 --- a/sdks/go.mod +++ b/sdks/go.mod @@ -46,7 +46,7 @@ require ( github.com/lib/pq v1.10.9 github.com/linkedin/goavro/v2 v2.12.0 github.com/proullon/ramsql v0.1.3 - github.com/spf13/cobra v1.7.0 + github.com/spf13/cobra v1.8.0 github.com/testcontainers/testcontainers-go v0.25.0 github.com/tetratelabs/wazero v1.5.0 github.com/xitongsys/parquet-go v1.6.2 diff --git a/sdks/go.sum b/sdks/go.sum index dd53a66dfa6..6343b568926 100644 --- a/sdks/go.sum +++ b/sdks/go.sum @@ -158,7 +158,7 @@ github.com/coreos/go-systemd/v22 v22.3.2/go.mod h1:Y58oyj3AT4RCenI/lSvhwexgC+NSV github.com/cpuguy83/dockercfg v0.3.1 h1:/FpZ+JaygUR/lZP2NlFI2DVfrOEMAIKP5wWEJdoYe9E= github.com/cpuguy83/dockercfg v0.3.1/go.mod h1:sugsbF4//dDlL/i+S+rtpIWp+5h0BHJHfjj5/jFyUJc= github.com/cpuguy83/go-md2man/v2 v2.0.0-20190314233015-f79a8a8ca69d/go.mod h1:maD7wRr/U5Z6m/iR4s+kqSMx2CaBsrgA7czyZG/E6dU= -github.com/cpuguy83/go-md2man/v2 v2.0.2/go.mod h1:tgQtvFlXSQOSOSIRvRPT7W67SCa46tRHOmNcaadrF8o= +github.com/cpuguy83/go-md2man/v2 v2.0.3/go.mod h1:tgQtvFlXSQOSOSIRvRPT7W67SCa46tRHOmNcaadrF8o= github.com/creack/pty v1.1.9/go.mod h1:oKZEueFk5CKHvIhNR5MUki03XCEU+Q6VDXinZuGJ33E= github.com/creack/pty v1.1.18 h1:n56/Zwd5o6whRC5PMGretI4IdRLlmBXYNjScPaBgsbY= github.com/cyphar/filepath-securejoin v0.2.3/go.mod h1:aPGpWjXOXUn2NCNjFvBE6aRxGGx79pTxQpKOJNYHHl4= @@ -408,8 +408,8 @@ github.com/sirupsen/logrus v1.9.3 h1:dueUQJ1C2q9oE3F7wvmSGAaVtTmUizReu6fjN8uqzbQ github.com/sirupsen/logrus v1.9.3/go.mod h1:naHLuLoDiP4jHNo9R0sCBMtWGeIprob74mVsIT4qYEQ= github.com/spf13/afero v1.2.1/go.mod h1:9ZxEEn6pIJ8Rxe320qSDBk6AsU0r9pR7Q4OcevTdifk= github.com/spf13/afero v1.2.2/go.mod h1:9ZxEEn6pIJ8Rxe320qSDBk6AsU0r9pR7Q4OcevTdifk= -github.com/spf13/cobra v1.7.0 h1:hyqWnYt1ZQShIddO5kBpj3vu05/++x6tJ6dg8EC572I= -github.com/spf13/cobra v1.7.0/go.mod h1:uLxZILRyS/50WlhOIKD7W6V5bgeIt+4sICxh6uRMrb0= +github.com/spf13/cobra v1.8.0 h1:7aJaZx1B85qltLMc546zn58BxxfZdR/W22ej9CFoEf0= +github.com/spf13/cobra v1.8.0/go.mod h1:WXLWApfZ71AjXPya3WOlMsY9yMs7YeiHhFVlvLyhcho= github.com/spf13/pflag v1.0.5 h1:iy+VFUOCP1a+8yFto/drg2CJ5u0yRoB7fZw3DKv/JXA= github.com/spf13/pflag v1.0.5/go.mod h1:McXfInJRrz4CZXVZOBLb0bTZqETkiAhM9Iw0y3An2Bg= github.com/stretchr/objx v0.1.0/go.mod h1:HFkY916IF+rwdDfMAkV7OtwuqBVzrE8GR6GFx+wExME=
(beam) branch dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.26.0 updated (e04579d7ec5 -> ea950566d0c)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.26.0 in repository https://gitbox.apache.org/repos/asf/beam.git discard e04579d7ec5 Bump github.com/testcontainers/testcontainers-go in /sdks add e98e37f15b8 [YAML] Kafka Read Provider (#28865) add 88fcfd5ac65 First pass at sorting gha dashboard (#29151) add 97b14a16f36 Added conditions to publish email (#29138) add db664d8125b Bump github.com/google/uuid from 1.3.1 to 1.4.0 in /sdks (#29159) add 7479aececf7 Bump actions/setup-node from 3 to 4 (#29115) add dd853ce0d10 Bump github.com/aws/aws-sdk-go-v2/config from 1.19.0 to 1.19.1 in /sdks (#29132) add 919441e64c0 Bump google.golang.org/grpc in /.test-infra/mock-apis (#29142) add 71a74b9e9be [Java][Dataflow Runner] Add precondition to make sure userAgent name and version are not empty (#29157) add aeea5c80e18 Revert grafana data source (#29161) add 73f91238b81 Bump com.gradle.enterprise from 3.13.2 to 3.15.1 (#28913) add 7b38f743f78 Add extra typehinting tests (#29148) add 6bb3ef2ec4d Bump Python Postcommit to high memory runner (#29176) add e8c455eacc2 change extension of beam sdist from .zip to .tar.gz (#29108) add 388fc394bbf Checkout repo for post step in website publish (#29166) add a2560800355 Infrastructure-as-Code deploys API & dependencies (#29155) add 717295e25f3 Bump github.com/fsouza/fake-gcs-server from 1.47.5 to 1.47.6 in /sdks (#29104) add aab3c64566f [Go] BigTableIO support on Website (#29152) add 1f7e882e22e [Flink Runner] Add UseDataStreamForBatch option to Flink runner to enable batch execution on DataStream API (#28614) add 0d5469e76f0 [YAML] add GCS support for external transform jars add ab2ab2ff72a Merge pull request #29173 [YAML] add GCS support for external transform jars add c2816c8d977 remove anon functions from minimal wordcount (#29179) add b5794fc27b8 Bump github.com/docker/docker in /sdks (#29193) add a93fa513181 minor prism fixes (#29183) add 472ed9f8d86 [Go Docs] Remove outdated examples of anonymous functions from pardo, partition, and filter. (#29181) add 84e6ceb2f0c increase received message size to max for Job Management. (#29178) add 2f8eebb7fa7 Remove anonymous function from fileio.ReadMatches example (#29186) add 8a28100c47b Bump commons-cli:commons-cli from 1.5.0 to 1.6.0 (#29192) add 28f6e3398bf Don't assume env vars are set in model handler (#29200) add 41369a71df9 Report Outstanding Bundles and Bytes (#29041) add d5fc02479c2 [YAML] Add a basic aggregating transform to Beam Yaml. (#29167) add 8648e583c84 Merge pull request #29114: Support default values in storage-api sink add 9a836203055 Rename --host to --fireStoreHost (#29201) add 714badb821b Better naming and logging to investigate leaking bigtable resources (#29203) add ba714221d5e organize and refactor GrpcWindmillServer. (#29156) add 524a7bfef40 [runners-spark] Do not set accTimestamp to null in SparkCombineFn (#28256) add 6a66b722f46 Merge pull request #29162: [runners-spark] Do not set accTimestamp to null in SparkCombineFn (#28256) add 181296dec2a Support DatabaseID in Datastore beam connector (#27987) add 7d81f0a4f35 Add empty outputs to AMR notebook (#29205) add c7dc5bd3d0d Add in missing space between dependency and comment add 9a97ec841c1 Fix notebook installs (#29211) add 9fcd0c91844 Add Cloud Bigtable Change Stream integration tests (#29127) add 3f434f07053 Add Dataflow Example Java21 PreCommit (#29170) add e8849a424e7 Inventory - Update temp files retention to 24h, run more frequently (#29216) add e2a7ea66fa2 [Security] Bump org.json version due to CVE-2023-5072 (#29207) add a036a181170 Delete on exit beam-artifact temp file (#29219) add e4bd6183b70 [YAML] Add JDBC branding transforms (#29171) add f2f88c5f3a1 Fix launcher artifact gradle configuration name conflict (#29224) add aed3457d9a2 Add apache_beam[yaml] options. add 8fcdf6a2975 Update readme to refere to new options. add 99e16d3f65f Also include gcp for ease of use. add 16fee7505e3 Merge pull request #29225 Add apache_beam[yaml] options. add d329a7e9b85 [Python]Enable state cache to 100 MB (#28781) add 96d6f2d07e8 prevent performance cdap on forks (#29194) add b5134202a0c [YAML] Implement basic java mapping operations. (#28657) add f5c0d16c680 Update `it` module. (#29232) add 33a527b1d4f Declare undeclared libraries to work around BEAM-11761. add 04b55c76dd6 Merge pull request #29234 Declare undeclared libraries to work around BEAM-11761. add ca21948d64d [YAML] - Kafka write and RAW format add 400ef71e719 [YAML] - Exactly one field + fix typo add 9e65a1035e4 Merge pull request #29160 [YAML] - Kafk
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 09939ef1e88 Updating config from bot 09939ef1e88 is described below commit 09939ef1e88d901d1b0684c917fc008f201c2c82 Author: github-actions AuthorDate: Mon Nov 6 14:35:20 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29294.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29294.json b/scripts/ci/pr-bot/state/pr-state/pr-29294.json index 793582a229a..46651877fb2 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29294.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29294.json @@ -8,5 +8,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch users/damccorm/update_docs created (now 96d2ae47070)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/update_docs in repository https://gitbox.apache.org/repos/asf/beam.git at 96d2ae47070 Updates from release to guide This branch includes the following new commits: new 96d2ae47070 Updates from release to guide The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) 01/01: Updates from release to guide
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch users/damccorm/update_docs
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 96d2ae4707038fc1046f7ec992d411fb4f71d219
Author: Danny McCormick
AuthorDate: Mon Nov 6 09:42:19 2023 -0500
Updates from release to guide
---
contributor-docs/release-guide.md | 16 +++-
1 file changed, 7 insertions(+), 9 deletions(-)
diff --git a/contributor-docs/release-guide.md
b/contributor-docs/release-guide.md
index 712e77a25b1..f4b4543e797 100644
--- a/contributor-docs/release-guide.md
+++ b/contributor-docs/release-guide.md
@@ -555,19 +555,16 @@ The following should be confirmed:
### Run build_release_candidate GitHub Action to create a release candidate
-Note: This step is partially automated (in progress), so part of the RC
-creation is done by GitHub Actions and the rest is done by a script. You don't
-need to wait for the action to complete to start running the script.
-
**Action**
[build_release_candidate](https://github.com/apache/beam/actions/workflows/build_release_candidate.yml)
(click `run workflow`)
**The action will:**
1. Clone the repo at the selected RC tag.
2. Run gradle publish to push java artifacts into Maven staging repo.
-3. Stage SDK docker images to [docker hub Apache
+3. Build and push java and python source distribution into
[dist.apache.org](https://dist.apache.org/repos/dist/dev/beam).
+4. Stage SDK docker images to [docker hub Apache
organization](https://hub.docker.com/search?q=apache%2Fbeam&type=image).
-4. Build javadoc, pydoc, typedocs for a PR to update beam-site.
+5. Build javadoc, pydoc, typedocs for a PR to update beam-site.
- **NOTE**: Do not merge this PR until after an RC has been approved (see
"Finalize the Release").
@@ -585,22 +582,23 @@ with tags: `${RELEASE_VERSION}_rc{RC_NUM}`
Verify that third party licenses are included in Docker. You can do this with
a simple script:
+RC_TAG=${RELEASE_VERSION}_rc{RC_NUM}
for pyver in 3.8 3.9 3.10 3.11; do
docker run --rm --entrypoint sh \
- apache/beam_python${pyver}_sdk:2.51.0rc1 \
+ apache/beam_python${pyver}_sdk:${RC_TAG} \
-c 'ls -al /opt/apache/beam/third_party_licenses/ | wc -l'
done
for javaver in 8 11 17; do
docker run --rm --entrypoint sh \
- apache/beam_java${pyver}_sdk:2.51.0rc1 \
+ apache/beam_java${pyver}_sdk:${RC_TAG} \
-c 'ls -al /opt/apache/beam/third_party_licenses/ | wc -l'
done
And you may choose to log in to the containers and inspect:
docker run --rm -it --entrypoint=/bin/bash \
-apache/beam_java${ver}_sdk:${RELEASE_VERSION}rc${RC_NUM}
+apache/beam_java${ver}_sdk:${RC_TAG}
ls -al /opt/apache/beam/third_party_licenses/
### Publish Java staging artifacts (manual)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new d39b1dfe528 Updating config from bot
d39b1dfe528 is described below
commit d39b1dfe528afcacfd1e168aba5ab65c0e364f76
Author: github-actions
AuthorDate: Mon Nov 6 15:06:43 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29158.json | 8 +---
1 file changed, 5 insertions(+), 3 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29158.json
b/scripts/ci/pr-bot/state/pr-state/pr-29158.json
index 242a48d7d3b..8ea94810368 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29158.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29158.json
@@ -1,7 +1,9 @@
{
- "commentedAboutFailingChecks": true,
- "reviewersAssignedForLabels": {},
- "nextAction": "Author",
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"go": "lostluck"
+ },
+ "nextAction": "Reviewers",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
"committerAssigned": false
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new acce462bcea Updating config from bot
acce462bcea is described below
commit acce462bcea461d23b542ca005d1842d1794937d
Author: github-actions
AuthorDate: Mon Nov 6 15:06:45 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index a4fac96f5a0..b4aa57f5906 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -1,7 +1,7 @@
{
"label": "go",
"dateOfLastReviewAssignment": {
-"lostluck": 1699248889267,
+"lostluck": 1699283201373,
"jrmccluskey": 1699248894290,
"youngoli": 1657688896155,
"damccorm": 1680501930289,
(beam) branch users/damccorm/pypi_publish created (now 167893630b2)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/pypi_publish in repository https://gitbox.apache.org/repos/asf/beam.git at 167893630b2 Add action to publish RC to PyPi This branch includes the following new commits: new 167893630b2 Add action to publish RC to PyPi The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) 01/01: Add action to publish RC to PyPi
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch users/damccorm/pypi_publish
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 167893630b2184c4786600d9fb6d806ff90f9f6f
Author: Danny McCormick
AuthorDate: Mon Nov 6 10:07:43 2023 -0500
Add action to publish RC to PyPi
---
.../workflows/deploy_release_candidate_pypi.yaml | 89 ++
1 file changed, 89 insertions(+)
diff --git a/.github/workflows/deploy_release_candidate_pypi.yaml
b/.github/workflows/deploy_release_candidate_pypi.yaml
new file mode 100644
index 000..7f873dbdc2a
--- /dev/null
+++ b/.github/workflows/deploy_release_candidate_pypi.yaml
@@ -0,0 +1,89 @@
+name: deploy_release_candidate_pypi
+
+# Workflow added after
https://github.com/apache/beam/commit/4183e747becebd18becee5fff547af365910fc9c
+# If help is needed debugging issues, you can view the release guide at that
commit for guidance on how to do this manually.
+#
(https://github.com/apache/beam/blob/4183e747becebd18becee5fff547af365910fc9c/website/www/site/content/en/contribute/release-guide.md)
+on:
+ workflow_dispatch:
+inputs:
+ RELEASE:
+description: Beam version of current release (e.g. 2.XX.0)
+required: true
+default: '2.XX.0'
+ RC:
+description: Integer RC version for the release (e.g. 3 for RC3)
+required: true
+ PYPI_USER:
+description: PyPi username to perform the upload with
+required: true
+ PYPI_PASSWORD:
+description: PyPi password to perform the upload with
+required: true
+
+env:
+ GRADLE_ENTERPRISE_ACCESS_KEY: ${{ secrets.GE_ACCESS_TOKEN }}
+ GRADLE_ENTERPRISE_CACHE_USERNAME: ${{ secrets.GE_CACHE_USERNAME }}
+ GRADLE_ENTERPRISE_CACHE_PASSWORD: ${{ secrets.GE_CACHE_PASSWORD }}
+
+jobs:
+ deploy_release_candidate_pypi:
+runs-on: [self-hosted, ubuntu-20.04, main]
+steps:
+- name: Mask PyPi id/password
+ run: |
+echo "::add-mask::${{ github.event.inputs.PYPI_USER }}"
+echo "::add-mask::${{ github.event.inputs.PYPI_PASSWORD }}"
+- name: Checkout
+ uses: actions/checkout@v4
+ with:
+ref: "v${{ github.event.inputs.RELEASE }}-RC${{ github.event.inputs.RC
}}"
+repository: apache/beam
+- name: Setup environment
+ uses: ./.github/actions/setup-environment-action
+ with:
+python-version: 3.11
+- name: Install dependencies
+ run: |
+pip install python-dateutil
+pip install requests
+pip install twine
+- name: Deploy to Pypi
+ env:
+RC_TAG: "v${{ github.event.inputs.RELEASE }}-RC${{
github.event.inputs.RC }}"
+GIT_REPO_BASE_URL: https://github.com/apache/beam
+RELEASE_DIR: "beam/${{ github.event.inputs.RELEASE }}"
+RELEASE: "${{ github.event.inputs.RELEASE }}"
+SCRIPT_DIR: release/src/main/scripts
+GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
+SVN_ARTIFACTS_DIR: "beam/${{ github.event.inputs.RELEASE }}/python"
+ run: |
+git fetch --all --tags --prune
+RELEASE_COMMIT=$(git rev-list -n 1 $RC_TAG)
+
+PYTHON_ARTIFACTS_DIR="./python"
+python "release/src/main/scripts/download_github_actions_artifacts.py"
\
+ --github-token-var GITHUB_TOKEN \
+ --repo-url "apache/beam" \
+ --rc-tag "${RC_TAG}" \
+ --release-commit "${RELEASE_COMMIT}" \
+ --artifacts_dir "${PYTHON_ARTIFACTS_DIR}" \
+ --rc_number "${{ github.event.inputs.RC }}" \
+ --yes True
+
+echo "--Checking Hash Value for
apache-beam-${RELEASE}rc${RC_NUMBER}.tar.gz-"
+sha512sum -c "apache-beam-${RELEASE}rc${RC_NUMBER}.tar.gz.sha512"
+
+for artifact in *.whl; do
+ echo "--Checking Hash Value for ${artifact} wheel---"
+ sha512sum -c "${artifact}.sha512"
+done
+
+echo "===Removing sha512 files==="
+rm $(ls | grep -i ".*.sha512$")
+
+echo "Upload rc to pypi"
+mkdir dist && mv $(ls | grep apache) dist && cd dist
+echo "Will upload the following files to PyPI:"
+ls
+
+twine upload * -u ${{ github.event.inputs.PYPI_USER }} -p ${{
github.event.inputs.PYPI_PASSWORD }}
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 6192dc3dc32 Updating config from bot
6192dc3dc32 is described below
commit 6192dc3dc324a267110738c847b49693e0541437
Author: github-actions
AuthorDate: Mon Nov 6 15:10:14 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29316.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29316.json
b/scripts/ci/pr-bot/state/pr-state/pr-29316.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29316.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated: [BigQueryIO] Upserts work with CREATE_IF_NEEDED -- doc only PR (#29276)
This is an automated email from the ASF dual-hosted git repository.
johncasey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 7fe906497db [BigQueryIO] Upserts work with CREATE_IF_NEEDED -- doc
only PR (#29276)
7fe906497db is described below
commit 7fe906497db776dd87eb3f8b1af87767a365d893
Author: Israel Herraiz
AuthorDate: Mon Nov 6 16:21:07 2023 +0100
[BigQueryIO] Upserts work with CREATE_IF_NEEDED -- doc only PR (#29276)
* Upserts work with CREATE_IF_NEEDED
* Switch order of points
---
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 25 +-
1 file changed, 15 insertions(+), 10 deletions(-)
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
index cf62ffed3b9..2ea5d1c2920 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
@@ -486,8 +486,11 @@ import org.slf4j.LoggerFactory;
* Upserts and deletes
*
* The connector also supports streaming row updates to BigQuery, with the
following qualifications:
- * - The CREATE_IF_NEEDED CreateDisposition is not supported. Tables must be
precreated with primary
- * keys. - Only the STORAGE_WRITE_API_AT_LEAST_ONCE method is supported.
+ *
+ * - Only the STORAGE_WRITE_API_AT_LEAST_ONCE method is supported.
+ *
+ * - If the table is not previously created and CREATE_IF_NEEDED is used, a
primary key must be
+ * specified using {@link Write#withPrimaryKey}.
*
* Two types of updates are supported. UPSERT replaces the row with the
matching primary key or
* inserts the row if non exists. DELETE removes the row with the matching
primary key. Row inserts
@@ -535,8 +538,8 @@ import org.slf4j.LoggerFactory;
* }
*
* Note that in order to use inserts or deletes, the table must bet set up
with a primary key. If
- * the table is not previously created and CREATE_IF_NEEDED is used, a primary
key must be
- * specified.
+ * the table is not previously created and CREATE_IF_NEEDED is used, a primary
key must be specified
+ * using {@link Write#withPrimaryKey}.
*/
@SuppressWarnings({
"nullness" // TODO(https://github.com/apache/beam/issues/20506)
@@ -2167,9 +2170,10 @@ public class BigQueryIO {
* apply row updates; directly calling {@link
Write#withRowMutationInformationFn} is preferred
* when writing non TableRows types (e.g. {@link #writeGenericRecords} or a
custom user type).
*
- * This is only supported when using the {@link
Write.Method#STORAGE_API_AT_LEAST_ONCE} insert
- * method and {@link Write.CreateDisposition#CREATE_NEVER}. The tables must
be precreated with a
- * primary key.
+ * This is supported when using the {@link
Write.Method#STORAGE_API_AT_LEAST_ONCE} insert
+ * method, and with either {@link Write.CreateDisposition#CREATE_NEVER} or
{@link
+ * Write.CreateDisposition#CREATE_IF_NEEDED}. For CREATE_IF_NEEDED, a
primary key must be
+ * specified using {@link Write#withPrimaryKey}.
*/
public static Write applyRowMutations() {
return BigQueryIO.write()
@@ -2826,9 +2830,10 @@ public class BigQueryIO {
* function that determines how a row is applied to BigQuery (upsert, or
delete) along with a
* sequence number for ordering operations.
*
- * This is only supported when using the {@link
Write.Method#STORAGE_API_AT_LEAST_ONCE}
- * insert method and {@link Write.CreateDisposition#CREATE_NEVER}. The
tables must be precreated
- * with a primary key.
+ * This is supported when using the {@link
Write.Method#STORAGE_API_AT_LEAST_ONCE} insert
+ * method, and with either {@link Write.CreateDisposition#CREATE_NEVER} or
{@link
+ * Write.CreateDisposition#CREATE_IF_NEEDED}. For CREATE_IF_NEEDED, a
primary key must be
+ * specified using {@link Write#withPrimaryKey}.
*/
public Write withRowMutationInformationFn(
SerializableFunction updateFn) {
(beam) branch master updated: Update dev container tags. (#29311)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new cbd756770d2 Update dev container tags. (#29311) cbd756770d2 is described below commit cbd756770d2f9b96a562c0f47a6d13b1f05c44ed Author: tvalentyn AuthorDate: Mon Nov 6 07:37:31 2023 -0800 Update dev container tags. (#29311) --- sdks/python/apache_beam/runners/dataflow/internal/names.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sdks/python/apache_beam/runners/dataflow/internal/names.py b/sdks/python/apache_beam/runners/dataflow/internal/names.py index b39c4a2b757..9a96baeb2a3 100644 --- a/sdks/python/apache_beam/runners/dataflow/internal/names.py +++ b/sdks/python/apache_beam/runners/dataflow/internal/names.py @@ -34,6 +34,6 @@ SERIALIZED_SOURCE_KEY = 'serialized_source' # Unreleased sdks use container image tag specified below. # Update this tag whenever there is a change that # requires changes to SDK harness container or SDK harness launcher. -BEAM_DEV_SDK_CONTAINER_TAG = 'beam-master-20231023' +BEAM_DEV_SDK_CONTAINER_TAG = 'beam-master-20231102' DATAFLOW_CONTAINER_IMAGE_REPOSITORY = 'gcr.io/cloud-dataflow/v1beta3'
(beam) branch tvalentyn-patch-2 deleted (was 745842d7dac)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch tvalentyn-patch-2 in repository https://gitbox.apache.org/repos/asf/beam.git was 745842d7dac Update dev container tags. The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 82aae2a4009 Updating config from bot 82aae2a4009 is described below commit 82aae2a40090e262209e6450aec16afd0dab579f Author: github-actions AuthorDate: Mon Nov 6 17:34:49 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29313.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29313.json b/scripts/ci/pr-bot/state/pr-state/pr-29313.json index ba7809d0477..f0f0f37a73a 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29313.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29313.json @@ -8,5 +8,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch users/damccorm/revert-ds created (now 76d6aaaf791)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/revert-ds in repository https://gitbox.apache.org/repos/asf/beam.git at 76d6aaaf791 Revert "Support DatabaseID in Datastore beam connector (#27987)" This branch includes the following new commits: new 76d6aaaf791 Revert "Support DatabaseID in Datastore beam connector (#27987)" The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) 01/01: Revert "Support DatabaseID in Datastore beam connector (#27987)"
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch users/damccorm/revert-ds
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 76d6aaaf791e9c722948aabe0c293c0fc608a59f
Author: Danny McCormick
AuthorDate: Mon Nov 6 12:54:08 2023 -0500
Revert "Support DatabaseID in Datastore beam connector (#27987)"
This reverts commit 181296dec2a6d6973e7aaa17f2cb0286c9308457.
---
.../beam/sdk/io/gcp/datastore/DatastoreV1.java | 349 +++--
.../beam/sdk/io/gcp/datastore/DatastoreV1Test.java | 94 +-
.../beam/sdk/io/gcp/datastore/SplitQueryFnIT.java | 17 +-
.../apache/beam/sdk/io/gcp/datastore/V1ReadIT.java | 26 +-
.../beam/sdk/io/gcp/datastore/V1TestUtil.java | 59 +---
.../beam/sdk/io/gcp/datastore/V1WriteIT.java | 11 +-
6 files changed, 98 insertions(+), 458 deletions(-)
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
index b94186b9893..cdd003abae2 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
@@ -126,9 +126,8 @@ import org.slf4j.LoggerFactory;
* To read a {@link PCollection} from a query to Cloud Datastore, use
{@link DatastoreV1#read}
* and its methods {@link DatastoreV1.Read#withProjectId} and {@link
DatastoreV1.Read#withQuery} to
* specify the project to query and the query to read from. You can optionally
provide a namespace
- * to query within using {@link DatastoreV1.Read#withDatabase} or {@link
- * DatastoreV1.Read#withNamespace}. You could also optionally specify how many
splits you want for
- * the query using {@link DatastoreV1.Read#withNumQuerySplits}.
+ * to query within using {@link DatastoreV1.Read#withNamespace}. You could
also optionally specify
+ * how many splits you want for the query using {@link
DatastoreV1.Read#withNumQuerySplits}.
*
* For example:
*
@@ -136,14 +135,12 @@ import org.slf4j.LoggerFactory;
* // Read a query from Datastore
* PipelineOptions options = PipelineOptionsFactory.fromArgs(args).create();
* Query query = ...;
- * String databaseId = "...";
* String projectId = "...";
*
* Pipeline p = Pipeline.create(options);
* PCollection entities = p.apply(
* DatastoreIO.v1().read()
* .withProjectId(projectId)
- * .withDatabaseId(databaseId)
* .withQuery(query));
* }
*
@@ -159,7 +156,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().write().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().write().withProjectId(projectId));
* p.run();
* }
*
@@ -168,7 +165,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().deleteEntity().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().deleteEntity().withProjectId(projectId));
* p.run();
* }
*
@@ -177,7 +174,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().deleteKey().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().deleteKey().withProjectId(projectId));
* p.run();
* }
*
@@ -278,9 +275,6 @@ public class DatastoreV1 {
Code.PERMISSION_DENIED,
Code.UNAUTHENTICATED);
- /** Database ID for the default database. */
- private static final String DEFAULT_DATABASE = "";
-
/**
* Returns an empty {@link DatastoreV1.Read} builder. Configure the source
{@code projectId},
* {@code query}, and optionally {@code namespace} and {@code
numQuerySplits} using {@link
@@ -319,8 +313,6 @@ public class DatastoreV1 {
public abstract @Nullable ValueProvider getProjectId();
-public abstract @Nullable ValueProvider getDatabaseId();
-
public abstract @Nullable Query getQuery();
public abstract @Nullable ValueProvider getLiteralGqlQuery();
@@ -342,8 +334,6 @@ public class DatastoreV1 {
abstract static class Builder {
abstract Builder setProjectId(ValueProvider projectId);
- abstract Builder setDatabaseId(ValueProvider databaseId);
-
abstract Builder setQuery(Query query);
abstract Builder setLiteralGqlQuery(ValueProvider
literalGqlQuery);
@@ -364,16 +354,10 @@ public class DatastoreV1 {
* size from Cloud Datastore.
*/
static int getEstimatedNumSplits(
-Datastore datastore,
-String projectId,
-String databaseId,
-Query query,
-@Nullable String namespace,
-@Nullable Instant readTime) {
+Datastore datastore, Query query, @Nullable S
(beam) branch users/damccorm/revert-ds-cp created (now 33532a44e4c)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/revert-ds-cp in repository https://gitbox.apache.org/repos/asf/beam.git at 33532a44e4c Revert "Support DatabaseID in Datastore beam connector (#27987)" This branch includes the following new commits: new 33532a44e4c Revert "Support DatabaseID in Datastore beam connector (#27987)" The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) 01/01: Revert "Support DatabaseID in Datastore beam connector (#27987)"
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch users/damccorm/revert-ds-cp
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 33532a44e4ca002e42d8f79f674df31480fc3b91
Author: Danny McCormick
AuthorDate: Mon Nov 6 12:54:08 2023 -0500
Revert "Support DatabaseID in Datastore beam connector (#27987)"
This reverts commit 181296dec2a6d6973e7aaa17f2cb0286c9308457.
---
.../beam/sdk/io/gcp/datastore/DatastoreV1.java | 349 +++--
.../beam/sdk/io/gcp/datastore/DatastoreV1Test.java | 94 +-
.../beam/sdk/io/gcp/datastore/SplitQueryFnIT.java | 17 +-
.../apache/beam/sdk/io/gcp/datastore/V1ReadIT.java | 26 +-
.../beam/sdk/io/gcp/datastore/V1TestUtil.java | 59 +---
.../beam/sdk/io/gcp/datastore/V1WriteIT.java | 11 +-
6 files changed, 98 insertions(+), 458 deletions(-)
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
index b94186b9893..cdd003abae2 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
@@ -126,9 +126,8 @@ import org.slf4j.LoggerFactory;
* To read a {@link PCollection} from a query to Cloud Datastore, use
{@link DatastoreV1#read}
* and its methods {@link DatastoreV1.Read#withProjectId} and {@link
DatastoreV1.Read#withQuery} to
* specify the project to query and the query to read from. You can optionally
provide a namespace
- * to query within using {@link DatastoreV1.Read#withDatabase} or {@link
- * DatastoreV1.Read#withNamespace}. You could also optionally specify how many
splits you want for
- * the query using {@link DatastoreV1.Read#withNumQuerySplits}.
+ * to query within using {@link DatastoreV1.Read#withNamespace}. You could
also optionally specify
+ * how many splits you want for the query using {@link
DatastoreV1.Read#withNumQuerySplits}.
*
* For example:
*
@@ -136,14 +135,12 @@ import org.slf4j.LoggerFactory;
* // Read a query from Datastore
* PipelineOptions options = PipelineOptionsFactory.fromArgs(args).create();
* Query query = ...;
- * String databaseId = "...";
* String projectId = "...";
*
* Pipeline p = Pipeline.create(options);
* PCollection entities = p.apply(
* DatastoreIO.v1().read()
* .withProjectId(projectId)
- * .withDatabaseId(databaseId)
* .withQuery(query));
* }
*
@@ -159,7 +156,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().write().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().write().withProjectId(projectId));
* p.run();
* }
*
@@ -168,7 +165,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().deleteEntity().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().deleteEntity().withProjectId(projectId));
* p.run();
* }
*
@@ -177,7 +174,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().deleteKey().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().deleteKey().withProjectId(projectId));
* p.run();
* }
*
@@ -278,9 +275,6 @@ public class DatastoreV1 {
Code.PERMISSION_DENIED,
Code.UNAUTHENTICATED);
- /** Database ID for the default database. */
- private static final String DEFAULT_DATABASE = "";
-
/**
* Returns an empty {@link DatastoreV1.Read} builder. Configure the source
{@code projectId},
* {@code query}, and optionally {@code namespace} and {@code
numQuerySplits} using {@link
@@ -319,8 +313,6 @@ public class DatastoreV1 {
public abstract @Nullable ValueProvider getProjectId();
-public abstract @Nullable ValueProvider getDatabaseId();
-
public abstract @Nullable Query getQuery();
public abstract @Nullable ValueProvider getLiteralGqlQuery();
@@ -342,8 +334,6 @@ public class DatastoreV1 {
abstract static class Builder {
abstract Builder setProjectId(ValueProvider projectId);
- abstract Builder setDatabaseId(ValueProvider databaseId);
-
abstract Builder setQuery(Query query);
abstract Builder setLiteralGqlQuery(ValueProvider
literalGqlQuery);
@@ -364,16 +354,10 @@ public class DatastoreV1 {
* size from Cloud Datastore.
*/
static int getEstimatedNumSplits(
-Datastore datastore,
-String projectId,
-String databaseId,
-Query query,
-@Nullable String namespace,
-@Nullable Instant readTime) {
+Datastore datastore, Query query, @Nullabl
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 3e8e9102141 Updating config from bot
3e8e9102141 is described below
commit 3e8e9102141a075174037a4f45ad630bba74b96c
Author: github-actions
AuthorDate: Mon Nov 6 17:58:10 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29317.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29317.json
b/scripts/ci/pr-bot/state/pr-state/pr-29317.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29317.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated: [RRIO] [Call] Implement PTransform without adaptive throttling (#29144)
This is an automated email from the ASF dual-hosted git repository.
damondouglas pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new aa890ea5621 [RRIO] [Call] Implement PTransform without adaptive
throttling (#29144)
aa890ea5621 is described below
commit aa890ea562103c8a6040ce8dd238355666724a02
Author: Damon
AuthorDate: Mon Nov 6 10:50:49 2023 -0800
[RRIO] [Call] Implement PTransform without adaptive throttling (#29144)
* Implement Call PTransform
* Replace use of Coder with JSON
* Remove public modifiers from ApiIOError Builder
* Reference #29248
---
sdks/java/io/rrio/build.gradle | 2 +
.../apache/beam/io/requestresponse/ApiIOError.java | 36 +-
.../org/apache/beam/io/requestresponse/Call.java | 337 +-
.../apache/beam/io/requestresponse/CallTest.java | 493 +
4 files changed, 845 insertions(+), 23 deletions(-)
diff --git a/sdks/java/io/rrio/build.gradle b/sdks/java/io/rrio/build.gradle
index 6963fcb23dd..52119c91b47 100644
--- a/sdks/java/io/rrio/build.gradle
+++ b/sdks/java/io/rrio/build.gradle
@@ -30,6 +30,8 @@ dependencies {
implementation project(path: ":sdks:java:core", configuration: "shadow")
implementation library.java.joda_time
implementation library.java.vendored_guava_32_1_2_jre
+implementation library.java.jackson_core
+implementation library.java.jackson_databind
implementation "redis.clients:jedis:$jedisVersion"
testImplementation project(path: ":sdks:java:core", configuration:
"shadowTest")
diff --git
a/sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/ApiIOError.java
b/sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/ApiIOError.java
index 5936c5dd84b..cfff3bd8941 100644
---
a/sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/ApiIOError.java
+++
b/sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/ApiIOError.java
@@ -17,11 +17,16 @@
*/
package org.apache.beam.io.requestresponse;
+import com.fasterxml.jackson.core.JsonProcessingException;
+import com.fasterxml.jackson.databind.ObjectMapper;
import com.google.auto.value.AutoValue;
+import java.util.Optional;
import org.apache.beam.sdk.schemas.AutoValueSchema;
import org.apache.beam.sdk.schemas.annotations.DefaultSchema;
import org.apache.beam.sdk.schemas.annotations.SchemaCaseFormat;
import
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.base.CaseFormat;
+import
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.base.Throwables;
+import org.checkerframework.checker.nullness.qual.NonNull;
import org.joda.time.Instant;
/** {@link ApiIOError} is a data class for storing details about an error. */
@@ -30,12 +35,31 @@ import org.joda.time.Instant;
@AutoValue
public abstract class ApiIOError {
+ private static final ObjectMapper OBJECT_MAPPER = new ObjectMapper();
+
+ /**
+ * Instantiate an {@link ApiIOError} from an {@link ErrorT} {@link T}
element. The {@link T}
+ * element is converted to a JSON string.
+ */
+ static ApiIOError of(@NonNull ErrorT e,
@NonNull T element)
+ throws JsonProcessingException {
+
+String json = OBJECT_MAPPER.writeValueAsString(element);
+
+return ApiIOError.builder()
+.setRequestAsJsonString(json)
+.setMessage(Optional.ofNullable(e.getMessage()).orElse(""))
+.setObservedTimestamp(Instant.now())
+.setStackTrace(Throwables.getStackTraceAsString(e))
+.build();
+ }
+
static Builder builder() {
return new AutoValue_ApiIOError.Builder();
}
- /** The encoded UTF-8 string representation of the related processed
element. */
- public abstract String getEncodedElementAsUtfString();
+ /** The JSON string representation of the request associated with the error.
*/
+ public abstract String getRequestAsJsonString();
/** The observed timestamp of the error. */
public abstract Instant getObservedTimestamp();
@@ -49,13 +73,13 @@ public abstract class ApiIOError {
@AutoValue.Builder
abstract static class Builder {
-public abstract Builder setEncodedElementAsUtfString(String value);
+abstract Builder setRequestAsJsonString(String value);
-public abstract Builder setObservedTimestamp(Instant value);
+abstract Builder setObservedTimestamp(Instant value);
-public abstract Builder setMessage(String value);
+abstract Builder setMessage(String value);
-public abstract Builder setStackTrace(String value);
+abstract Builder setStackTrace(String value);
abstract ApiIOError build();
}
diff --git
a/sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/Call.java
b/sdks/java/io/rrio/src/main/java/org/apache/beam/io/requestresponse/Call.java
index 4f854ea69c7..52181af534e 100644
---
a/sdks/java/io/rrio/src/main/java/org/a
(beam) branch release-2.52.0 updated: Revert "Support DatabaseID in Datastore beam connector (#27987)" (#29318)
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch release-2.52.0
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/release-2.52.0 by this push:
new 0fdf4048736 Revert "Support DatabaseID in Datastore beam connector
(#27987)" (#29318)
0fdf4048736 is described below
commit 0fdf404873636d24be50ae8360a08e4dddfae679
Author: Danny McCormick
AuthorDate: Mon Nov 6 14:00:26 2023 -0500
Revert "Support DatabaseID in Datastore beam connector (#27987)" (#29318)
This reverts commit 181296dec2a6d6973e7aaa17f2cb0286c9308457.
---
.../beam/sdk/io/gcp/datastore/DatastoreV1.java | 349 +++--
.../beam/sdk/io/gcp/datastore/DatastoreV1Test.java | 94 +-
.../beam/sdk/io/gcp/datastore/SplitQueryFnIT.java | 17 +-
.../apache/beam/sdk/io/gcp/datastore/V1ReadIT.java | 26 +-
.../beam/sdk/io/gcp/datastore/V1TestUtil.java | 59 +---
.../beam/sdk/io/gcp/datastore/V1WriteIT.java | 11 +-
6 files changed, 98 insertions(+), 458 deletions(-)
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
index b94186b9893..cdd003abae2 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java
@@ -126,9 +126,8 @@ import org.slf4j.LoggerFactory;
* To read a {@link PCollection} from a query to Cloud Datastore, use
{@link DatastoreV1#read}
* and its methods {@link DatastoreV1.Read#withProjectId} and {@link
DatastoreV1.Read#withQuery} to
* specify the project to query and the query to read from. You can optionally
provide a namespace
- * to query within using {@link DatastoreV1.Read#withDatabase} or {@link
- * DatastoreV1.Read#withNamespace}. You could also optionally specify how many
splits you want for
- * the query using {@link DatastoreV1.Read#withNumQuerySplits}.
+ * to query within using {@link DatastoreV1.Read#withNamespace}. You could
also optionally specify
+ * how many splits you want for the query using {@link
DatastoreV1.Read#withNumQuerySplits}.
*
* For example:
*
@@ -136,14 +135,12 @@ import org.slf4j.LoggerFactory;
* // Read a query from Datastore
* PipelineOptions options = PipelineOptionsFactory.fromArgs(args).create();
* Query query = ...;
- * String databaseId = "...";
* String projectId = "...";
*
* Pipeline p = Pipeline.create(options);
* PCollection entities = p.apply(
* DatastoreIO.v1().read()
* .withProjectId(projectId)
- * .withDatabaseId(databaseId)
* .withQuery(query));
* }
*
@@ -159,7 +156,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().write().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().write().withProjectId(projectId));
* p.run();
* }
*
@@ -168,7 +165,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().deleteEntity().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().deleteEntity().withProjectId(projectId));
* p.run();
* }
*
@@ -177,7 +174,7 @@ import org.slf4j.LoggerFactory;
*
* {@code
* PCollection entities = ...;
- *
entities.apply(DatastoreIO.v1().deleteKey().withProjectId(projectId).withDatabaseId(databaseId));
+ * entities.apply(DatastoreIO.v1().deleteKey().withProjectId(projectId));
* p.run();
* }
*
@@ -278,9 +275,6 @@ public class DatastoreV1 {
Code.PERMISSION_DENIED,
Code.UNAUTHENTICATED);
- /** Database ID for the default database. */
- private static final String DEFAULT_DATABASE = "";
-
/**
* Returns an empty {@link DatastoreV1.Read} builder. Configure the source
{@code projectId},
* {@code query}, and optionally {@code namespace} and {@code
numQuerySplits} using {@link
@@ -319,8 +313,6 @@ public class DatastoreV1 {
public abstract @Nullable ValueProvider getProjectId();
-public abstract @Nullable ValueProvider getDatabaseId();
-
public abstract @Nullable Query getQuery();
public abstract @Nullable ValueProvider getLiteralGqlQuery();
@@ -342,8 +334,6 @@ public class DatastoreV1 {
abstract static class Builder {
abstract Builder setProjectId(ValueProvider projectId);
- abstract Builder setDatabaseId(ValueProvider databaseId);
-
abstract Builder setQuery(Query query);
abstract Builder setLiteralGqlQuery(ValueProvider
literalGqlQuery);
@@ -364,16 +354,10 @@ public class DatastoreV1 {
* size from Cloud Datastore.
*/
static int getEstimatedNumSplits(
-Datastore datastore,
-
(beam) branch master updated (aa890ea5621 -> 827afb9f3b7)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from aa890ea5621 [RRIO] [Call] Implement PTransform without adaptive throttling (#29144) add 827afb9f3b7 Revert "Support DatabaseID in Datastore beam connector (#27987)" (#29317) No new revisions were added by this update. Summary of changes: .../beam/sdk/io/gcp/datastore/DatastoreV1.java | 349 +++-- .../beam/sdk/io/gcp/datastore/DatastoreV1Test.java | 94 +- .../beam/sdk/io/gcp/datastore/SplitQueryFnIT.java | 17 +- .../apache/beam/sdk/io/gcp/datastore/V1ReadIT.java | 26 +- .../beam/sdk/io/gcp/datastore/V1TestUtil.java | 59 +--- .../beam/sdk/io/gcp/datastore/V1WriteIT.java | 11 +- 6 files changed, 98 insertions(+), 458 deletions(-)
(beam) branch users/damccorm/revert-ds deleted (was 76d6aaaf791)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/revert-ds in repository https://gitbox.apache.org/repos/asf/beam.git was 76d6aaaf791 Revert "Support DatabaseID in Datastore beam connector (#27987)" The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch users/damccorm/revert-ds-cp deleted (was 33532a44e4c)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/revert-ds-cp in repository https://gitbox.apache.org/repos/asf/beam.git was 33532a44e4c Revert "Support DatabaseID in Datastore beam connector (#27987)" The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 0ed59833964 Updating config from bot
0ed59833964 is described below
commit 0ed598339649fb7fc52f750c6b32d4c3e501ed41
Author: github-actions
AuthorDate: Mon Nov 6 19:05:44 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29277.json | 9 ++---
1 file changed, 6 insertions(+), 3 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29277.json
b/scripts/ci/pr-bot/state/pr-state/pr-29277.json
index 242a48d7d3b..f8e5c76e01a 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29277.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29277.json
@@ -1,7 +1,10 @@
{
- "commentedAboutFailingChecks": true,
- "reviewersAssignedForLabels": {},
- "nextAction": "Author",
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"java": "kennknowles",
+"io": "bvolpato"
+ },
+ "nextAction": "Reviewers",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
"committerAssigned": false
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new e7930d35ea4 Updating config from bot e7930d35ea4 is described below commit e7930d35ea4622017a6af437e40740e751975d0b Author: github-actions AuthorDate: Mon Nov 6 19:05:47 2023 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json b/scripts/ci/pr-bot/state/reviewers-for-label-io.json index 2265c6b1263..643dfe47b5c 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json @@ -6,7 +6,7 @@ "pabloem": 1691787951165, "Abacn": 1699054471140, "ahmedabu98": 1699230866798, -"bvolpato": 1698960777652, +"bvolpato": 1699297542461, "manavgarg": 1690826779210 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 59ca560767b Updating config from bot
59ca560767b is described below
commit 59ca560767b0aca4f0d3006d8ae80f687e54d776
Author: github-actions
AuthorDate: Mon Nov 6 19:05:45 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json
b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
index 80274e5ed30..0f3337da2ce 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
@@ -2,7 +2,7 @@
"label": "java",
"dateOfLastReviewAssignment": {
"lukecwik": 1680701852535,
-"kennknowles": 1698960777652,
+"kennknowles": 1699297542461,
"robertwb": 1699054471140,
"kileys": 1674428678843,
"apilloud": 1678822446183,
(beam) annotated tag sdks/v2.52.0-RC2 updated (4cceacd0755 -> c10ebc08d3b)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to annotated tag sdks/v2.52.0-RC2 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag sdks/v2.52.0-RC2 was modified! *** from 4cceacd0755 (commit) to c10ebc08d3b (tag) tagging 4cceacd0755d0f116ec7089909ba422e7795f767 (commit) replaces jupyterlab-sidepanel-v3.0.0 by Danny McCormick on Mon Nov 6 14:58:57 2023 -0500 - Log - Go SDK v2.52.0-RC2 --- No new revisions were added by this update. Summary of changes:
(beam) annotated tag v2.52.0-RC2 updated (4cceacd0755 -> 9778fdd0950)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to annotated tag v2.52.0-RC2 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag v2.52.0-RC2 was modified! *** from 4cceacd0755 (commit) to 9778fdd0950 (tag) tagging 4cceacd0755d0f116ec7089909ba422e7795f767 (commit) replaces jupyterlab-sidepanel-v3.0.0 by Danny McCormick on Mon Nov 6 14:58:57 2023 -0500 - Log - v2.52.0-RC2 --- No new revisions were added by this update. Summary of changes:
svn commit: r65068 - in /dev/beam/2.52.0: apache-beam-2.52.0-source-release.zip apache-beam-2.52.0-source-release.zip.asc apache-beam-2.52.0-source-release.zip.sha512
Author: damccorm Date: Mon Nov 6 20:01:15 2023 New Revision: 65068 Log: Staging Java artifacts for Apache Beam 2.52.0 RC1 Added: dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip (with props) Modified: dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip.asc dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip.sha512 Added: dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip == Binary file - no diff available. Propchange: dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip -- svn:mime-type = application/octet-stream Modified: dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip.asc == --- dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip.asc (original) +++ dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip.asc Mon Nov 6 20:01:15 2023 @@ -1,17 +1,17 @@ -BEGIN PGP SIGNATURE- -iQJMBAABCgA2FiEEkTwzkqdwx4HtxN2r0gMW9xIhNCIFAmVGIxYYHHByaXZhdGVA -YmVhbS5hcGFjaGUub3JnAAoJENIDFvcSITQiMK0P/jo5pQXc/S1OFf1TFqedzFjg -R1G8fBrcIY332BSkolPsktsmOEsRA1XwYsC6WaQKcfBBws+C4zU0L+HqJ5vlpX/h -VNV6cJzbe89RQOh7gPDhW7gLSIUHi+MI4LRRZZrs9roEPieYrjkLtk/a9R/1YcCH -27vx/rcj3l3kq5AjKa6g54ZLoOs6Kd1Fk7J78OMSpJGK9gyVOgmG/E7rFg6XL5M0 -qdJ9v6ruMj33E0AHICkDaiL9tw4J0N46wJTOHz2bNQD78Nivco3OkmWjvB9Wy/V7 -UxFJJ7jCYH3JHnWygXBFyQX2VwLmzKKhM9pTLMogKKCOhpl8LZUYbz4211t2kBnc -nzMXV5VlEfQNbaw0FppS5bXwraG9xm4a5yccrTON9oDlVs/sK2wcfP5LfQ04xNTX -gn6z6HYYLxO4tC6OSYrj2LWbcbTOm3nXp5cU//cHJbztVV2lXm2hpg5682c9lG7v -Q1lQy3u5iIZshYFGz0HzvbdOo93dn7R2yI43UUE41Wdx4Ou9uwbgGWptsJJ8Q1sR -4zShF2yofiJCizt1IImE1IFixl3JVpdDZ2QJUPX2ZfnYlAqt1L3vYgHuXFDkyEHJ -pC+AxeAmGL6wMCfa45XrbR7HYMfB7SvW9YdHNwoxAcjlugUFSqAgLIT8wKC+ubOB -1czFUWQgiatPMHf3tdJN -=vL9K +iQJMBAABCgA2FiEEkTwzkqdwx4HtxN2r0gMW9xIhNCIFAmVJRggYHHByaXZhdGVA +YmVhbS5hcGFjaGUub3JnAAoJENIDFvcSITQifWYQAIoLen3Vwd86ymrsiWsnHkqK +hyod1oHKX7dfWvGNbQjanMYpYpPVAQAoERsxWoO87aWZA3yFDvQWu4iklEoLD972 +owl+ThwsFHgV9ubCEapyrhHIjdH/pDPGez+gaZrcJTswSC5O0oEs/tqhik+RmmX4 ++CNNPR9LOFjTRcom4cfN+8Yz9Xvd59GQHRTOmp2pT7TumkMvKFi/+ReUV5URwtOX +BYPmkXF6BKt07639avUq+He6V/nrDVhvr/5Js7G2xDM5Pkr1QRq6LaQGqFf5bKrr +neayWILt1MJj71Kahy2SgD4qbCpi3oGuarHSIzxNdmYJUEqR4OWZ0QialxgSg2ox +aOm9TnsuicBPfMDQp0R0z3YH+L0nYOhJWfz16/3IZBLwgG0Uw0GZK6k0N3rMMelh +XOgdYQohB7lkrlOavZmIhi26s0WF9HU7IDqWs77AfQXxkewRxk4LgkyelQjspBF7 +sK6NVXj5LZh9YruioMWJQ5ME5HnLRXZ8O7FKF1z/sEM3NBNs0upnpuXhT+JUNVMg +pmoYi+vhNanbQZls0n8CBokxdlqRF9K/I/bTh/YacNi6xmH/1LIUUKkFqxUvA0YK +OwyE/kfncxtLsRbJf4PZQMdsW7poXbn/Gc9VDJRKCQXRfYT7BZ0Z9icSyZnu2JjV +mj9csG1y6hDeP5q7ivYR +=dtUf -END PGP SIGNATURE- Modified: dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip.sha512 == --- dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip.sha512 (original) +++ dev/beam/2.52.0/apache-beam-2.52.0-source-release.zip.sha512 Mon Nov 6 20:01:15 2023 @@ -1 +1 @@ -96528d460927579aa9e5992fba3a2e5db3b3f9506fe868b7065030dd0e10f0947ac782476dc805dd5cc62ddfffee9dd357ca34dabecd183d9717df3f3f2c63f0 apache-beam-2.52.0-source-release.zip +e2f8e43d91d9df27d7ca949c401f582b33d5d93fc7a1647d7f8f9f172518b26fd3cc6e1b5ae03efdcf853126fe605eac260d1268cec28a60d85096a7eb700403 apache-beam-2.52.0-source-release.zip
svn commit: r65069 - /dev/beam/2.52.0/python/
Author: damccorm Date: Mon Nov 6 20:03:02 2023 New Revision: 65069 Log: Staging Python artifacts for Apache Beam 2.52.0 RC Modified: dev/beam/2.52.0/python/apache-beam-2.52.0.tar.gz.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-macosx_10_9_x86_64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-win32.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-win_amd64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp311-cp311-macosx_10_9_x86_64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp311-cp311-win32.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp311-cp311-win_amd64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp38-cp38-macosx_10_9_x86_64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp38-cp38-win32.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp38-cp38-win_amd64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp39-cp39-macosx_10_9_x86_64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp39-cp39-win32.whl.asc dev/beam/2.52.0/python/apache_beam-2.52.0-cp39-cp39-win_amd64.whl.asc Modified: dev/beam/2.52.0/python/apache-beam-2.52.0.tar.gz.asc == --- dev/beam/2.52.0/python/apache-beam-2.52.0.tar.gz.asc (original) +++ dev/beam/2.52.0/python/apache-beam-2.52.0.tar.gz.asc Mon Nov 6 20:03:02 2023 @@ -1,17 +1,17 @@ -BEGIN PGP SIGNATURE- -iQJMBAABCgA2FiEEkTwzkqdwx4HtxN2r0gMW9xIhNCIFAmVGI2UYHHByaXZhdGVA -YmVhbS5hcGFjaGUub3JnAAoJENIDFvcSITQiL9QP/2lnoSxXEZozT9f26FwwHpiT -utKpQdh0bza8eIWg39iC05x1KEz65e25xLkUb/mFTjLAmkqYmkQMNbiulEnr1lY/ -xRC4jDvz9SIRkiM/6LAMglXbVMu22O1/1dFKc3ZwpN+DwWd1utX5d6g5MxaCPmTN -nOQXkHpIUMMJnYhzQU4lYKxHw7JGhKO54mLWYEqtMGHl2ZekSAdntSskG7JDMkSI -0JMXZ3b4oDXBYWZkue9RrWiBdBpuRHyrxMAfJ0GlI3P44B3pdeh/iG+jQ4y4jEwl -yIat6SF9cd8rkNTuf4X2i70Skyzr8CxM/O5c2z3FI+9ZeDGDo84SbvrR97+xoXoi -XteotJm3rQMPE8Ud6HdXeCqGYl7ZOo11J7y7KCkuJUO4anurkyWqEGHzgMunc79N -W451Cr9EXaNqgYEqaw8vPXAzKenDDpnB2LbmP2sVbneJtgM+hkhnHl8v/I8VcjPd -XhqebBRwLr9fVs0rnna4iMO9SsZgOzLtR9xv2Igu0m3bOn4H2ELf/fR22tCwlHXx -pJAj/sJFKYJoKXm4lq8QO6hWKd3ZA0fpNjyW7yZLwFqaSEei+muWDcSOmjm30sDJ -ATWKEXjR9zBoWkz9661MzG0Fjb82fJFaXSjQ5ZgSHam8xhsnWsCKquBS3wROYdm9 -CebtzfUY2sHX72EdeSB2 -=b2Nf +iQJMBAABCgA2FiEEkTwzkqdwx4HtxN2r0gMW9xIhNCIFAmVJRnIYHHByaXZhdGVA +YmVhbS5hcGFjaGUub3JnAAoJENIDFvcSITQi08cP/iKoPdyN67buaXv2grTrLPYR +jTCYjvKtqUoyICgryuOTf5qi5CIaHldxx4ROZUq0S2OAqVzxDU1JJitM9zQ5LZnz +sYQZEDNmLyP4gTR6jnRzodE0v6CwBpRwy9etdnGoTLxSuDRlvk9/1Ytm1T12dS1Y +tp5rMFe8EluxzMtRIHUCYO7MMByjxDMhu4tD7OmCzsoyio6I9LG5Yon308saOVc1 +vdnyPUxf2WctRyFQOcZYLI72pnCt0hA0QRDvhEXda6cGOGi1+JPqFLOxgfppNlV7 +m/3mY2yi/hK95j/caoy/INmwQisntnLIFi83cTeuI/4KRQEM4EE6p2QWJfFrPXbf +h+549y2SRdzGlKTdKV2MVNG1GarlGQz3tDwN7klyZju7hPkf3OGFZ0I2sUplAd3l +THzVLU/7GThBPDAsI9NPBQVSyLjW1Mq0qDZRti0S9+sATMCJs6SngzBOG6KErNij +7jJ3N29Wjnu4qLWUFCdvMIZL7VDjxcWZsXywqlSjK2GMvjHEfesfkZFxvgh+Rh9X +1jrDKbypGcAjQl+IOs14U+wuHfb46NLhgqIf98TBVKOvcJe+6MGAvzfBtWhPnJIk +Pu4KeDccjZ2bwyo7hcZALHg4rMj64ZsTqWPfQbV4QvBY2hHJsLKZkq3sAH6xs86p +tLPIjojGZRyxAGO9A6gP +=jVfV -END PGP SIGNATURE- Modified: dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-macosx_10_9_x86_64.whl.asc == --- dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-macosx_10_9_x86_64.whl.asc (original) +++ dev/beam/2.52.0/python/apache_beam-2.52.0-cp310-cp310-macosx_10_9_x86_64.whl.asc Mon Nov 6 20:03:02 2023 @@ -1,17 +1,17 @@ -BEGIN PGP SIGNATURE- -iQJMBAABCgA2FiEEkTwzkqdwx4HtxN2r0gMW9xIhNCIFAmVGI2YYHHByaXZhdGVA -YmVhbS5hcGFjaGUub3JnAAoJENIDFvcSITQim6EQALczTnMlI7UwwgImvW/t3i3M -
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 35410ed5444 Updating config from bot 35410ed5444 is described below commit 35410ed5f23ad0fd7dcd6fd8d982affd9007 Author: github-actions AuthorDate: Mon Nov 6 20:06:07 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29306.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29306.json b/scripts/ci/pr-bot/state/pr-state/pr-29306.json index aa3638a74ec..1e9dcd816d5 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29306.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29306.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch prismFusion updated (95e3f1164fa -> 39939ce5d12)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a change to branch prismFusion in repository https://gitbox.apache.org/repos/asf/beam.git from 95e3f1164fa fmt fix add 39939ce5d12 Update sdks/go/pkg/beam/runners/prism/internal/preprocess.go No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/runners/prism/internal/preprocess.go | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch master updated: [prism] Add fusion. (#29306)
This is an automated email from the ASF dual-hosted git repository.
lostluck pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 9acf947780e [prism] Add fusion. (#29306)
9acf947780e is described below
commit 9acf947780e3438e76245b572dcb068dead857ed
Author: Robert Burke
AuthorDate: Mon Nov 6 12:08:49 2023 -0800
[prism] Add fusion. (#29306)
---
sdks/go/pkg/beam/runners/direct/direct_test.go | 98
sdks/go/pkg/beam/runners/prism/README.md | 3 +-
sdks/go/pkg/beam/runners/prism/internal/execute.go | 6 -
.../beam/runners/prism/internal/execute_test.go| 105 +++-
.../beam/runners/prism/internal/handlecombine.go | 17 +-
.../pkg/beam/runners/prism/internal/handlepardo.go | 37 +-
.../beam/runners/prism/internal/handlerunner.go| 61 ++-
.../pkg/beam/runners/prism/internal/preprocess.go | 526 ++---
.../beam/runners/prism/internal/preprocess_test.go | 78 +--
.../beam/runners/prism/internal/separate_test.go | 3 +-
sdks/go/pkg/beam/runners/prism/internal/stage.go | 44 +-
.../runners/prism/internal/unimplemented_test.go | 1 -
12 files changed, 731 insertions(+), 248 deletions(-)
diff --git a/sdks/go/pkg/beam/runners/direct/direct_test.go
b/sdks/go/pkg/beam/runners/direct/direct_test.go
index a8108580aa2..bcfce612da3 100644
--- a/sdks/go/pkg/beam/runners/direct/direct_test.go
+++ b/sdks/go/pkg/beam/runners/direct/direct_test.go
@@ -29,6 +29,7 @@ import (
"github.com/apache/beam/sdks/v2/go/pkg/beam/core/graph/mtime"
"github.com/apache/beam/sdks/v2/go/pkg/beam/core/graph/window"
"github.com/apache/beam/sdks/v2/go/pkg/beam/core/metrics"
+ "github.com/apache/beam/sdks/v2/go/pkg/beam/register"
"github.com/apache/beam/sdks/v2/go/pkg/beam/transforms/filter"
"github.com/google/go-cmp/cmp"
)
@@ -542,3 +543,100 @@ func TestMain(m *testing.M) {
beam.Init()
os.Exit(m.Run())
}
+
+func init() {
+ // Basic Registration
+ // beam.RegisterFunction(identity)
+ // beam.RegisterType(reflect.TypeOf((*source)(nil)))
+ // beam.RegisterType(reflect.TypeOf((*discard)(nil)))
+
+ // Generic registration
+ register.Function2x0(identity)
+ register.DoFn2x0[[]byte, func(int)]((*source)(nil))
+ register.DoFn1x0[int]((*discard)(nil))
+ register.Emitter1[int]()
+}
+
+type source struct {
+ Count int
+}
+
+func (fn *source) ProcessElement(_ []byte, emit func(int)) {
+ for i := 0; i < fn.Count; i++ {
+ emit(i)
+ }
+}
+
+func identity(v int, emit func(int)) {
+ emit(v)
+}
+
+type discard struct {
+ processed int
+}
+
+func (fn *discard) ProcessElement(int) {
+ fn.processed++
+}
+
+// BenchmarkPipe checks basic throughput and exec overhead with everything
registered.
+//
+// Just registered: ~700-900ns per call, 330B per DoFn, across 5 allocs per
DoFn
+//
+// goos: linux
+// goarch: amd64
+// pkg: github.com/apache/beam/sdks/v2/go/pkg/beam/runners/direct
+// cpu: 12th Gen Intel(R) Core(TM) i7-1260P
+// BenchmarkPipe/dofns=0-16 1657698 763.0 ns/op
10.49 MB/s 763.0 ns/elm 320 B/op 6 allocs/op
+// BenchmarkPipe/dofns=1-16 832784 1294 ns/op
12.37 MB/s 1294 ns/elm656 B/op 11 allocs/op
+// BenchmarkPipe/dofns=2-16 633345 1798 ns/op
13.35 MB/s 899.0 ns/elm 992 B/op 16 allocs/op
+// BenchmarkPipe/dofns=3-16 471106 2446 ns/op
13.08 MB/s 815.4 ns/elm 1329 B/op 21 allocs/op
+// BenchmarkPipe/dofns=5-16 340099 3634 ns/op
13.21 MB/s 726.8 ns/elm 2001 B/op 31 allocs/op
+// BenchmarkPipe/dofns=10-16 183429 6957 ns/op
12.65 MB/s 695.7 ns/elm 3683 B/op 56 allocs/op
+// BenchmarkPipe/dofns=100-16 17956 65986 ns/op
12.25 MB/s 659.9 ns/elm33975 B/op506 allocs/op
+//
+// Optimized w/ Generic reg: ~200-300ns per call, 150B per DoFn, across 2
allocs per DoFn
+//
+// goos: linux
+// goarch: amd64
+// pkg: github.com/apache/beam/sdks/v2/go/pkg/beam/runners/direct
+// cpu: 12th Gen Intel(R) Core(TM) i7-1260P
+// BenchmarkPipe/dofns=0-16 9319206 131.5 ns/op
60.85 MB/s 131.5 ns/elm 152 B/op 2 allocs/op
+// BenchmarkPipe/dofns=1-16 4465477 268.3 ns/op
59.63 MB/s 268.3 ns/elm 304 B/op 3 allocs/op
+// BenchmarkPipe/dofns=2-16 2876710 431.9 ns/op
55.56 MB/s 216.0 ns/elm 456 B/op 5 allocs/op
+// Be
(beam-site) branch updates_release_2.52.0 updated (b7368e2189 -> 7230101bd6)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch updates_release_2.52.0 in repository https://gitbox.apache.org/repos/asf/beam-site.git omit b7368e2189 Update beam-site for release 2.52.0. add 7230101bd6 Update beam-site for release 2.52.0. This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (b7368e2189) \ N -- N -- N refs/heads/updates_release_2.52.0 (7230101bd6) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: pydoc/2.52.0/apache_beam.dataframe.frames.html | 296 ++--- pydoc/2.52.0/apache_beam.dataframe.io.html | 14 +- pydoc/2.52.0/apache_beam.dataframe.transforms.html | 12 +- pydoc/2.52.0/apache_beam.io.fileio.html| 2 +- pydoc/2.52.0/apache_beam.io.textio.html| 4 +- ...he_beam.ml.inference.huggingface_inference.html | 16 +- .../apache_beam.ml.inference.onnx_inference.html | 6 +- ...apache_beam.ml.inference.pytorch_inference.html | 16 +- ...che_beam.ml.inference.tensorflow_inference.html | 14 +- ...pache_beam.ml.inference.tensorrt_inference.html | 6 +- .../2.52.0/apache_beam.ml.transforms.handlers.html | 8 +- pydoc/2.52.0/apache_beam.ml.transforms.tft.html| 18 +- .../apache_beam.transforms.periodicsequence.html | 2 +- pydoc/2.52.0/apache_beam.typehints.schemas.html| 4 +- pydoc/2.52.0/doctest/output.txt| 22 +- .../2.52.0/doctrees/apache_beam.io.fileio.doctree | Bin 83256 -> 83256 bytes ...beam.ml.inference.huggingface_inference.doctree | Bin 119216 -> 119216 bytes ...apache_beam.ml.inference.onnx_inference.doctree | Bin 25022 -> 25022 bytes ...che_beam.ml.inference.pytorch_inference.doctree | Bin 84883 -> 84883 bytes ..._beam.ml.inference.tensorflow_inference.doctree | Bin 69144 -> 69144 bytes ...he_beam.ml.inference.tensorrt_inference.doctree | Bin 39786 -> 39786 bytes .../apache_beam.ml.transforms.handlers.doctree | Bin 27641 -> 27641 bytes .../doctrees/apache_beam.ml.transforms.tft.doctree | Bin 92488 -> 92488 bytes ...apache_beam.transforms.periodicsequence.doctree | Bin 37699 -> 37699 bytes .../doctrees/apache_beam.typehints.schemas.doctree | Bin 222136 -> 222136 bytes pydoc/2.52.0/doctrees/environment.pickle | Bin 12734652 -> 12734652 bytes pydoc/2.52.0/searchindex.js| 2 +- 27 files changed, 221 insertions(+), 221 deletions(-)
(beam-site) branch updates_release_2.52.0 deleted (was 7230101bd6)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch updates_release_2.52.0 in repository https://gitbox.apache.org/repos/asf/beam-site.git was 7230101bd6 Update beam-site for release 2.52.0. The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: Add action to publish RC to PyPi (#29316)
This is an automated email from the ASF dual-hosted git repository.
jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new f619affcf70 Add action to publish RC to PyPi (#29316)
f619affcf70 is described below
commit f619affcf704258ec11f5328a39010ba12cc2584
Author: Danny McCormick
AuthorDate: Mon Nov 6 15:31:49 2023 -0500
Add action to publish RC to PyPi (#29316)
---
.../workflows/deploy_release_candidate_pypi.yaml | 89 ++
1 file changed, 89 insertions(+)
diff --git a/.github/workflows/deploy_release_candidate_pypi.yaml
b/.github/workflows/deploy_release_candidate_pypi.yaml
new file mode 100644
index 000..7f873dbdc2a
--- /dev/null
+++ b/.github/workflows/deploy_release_candidate_pypi.yaml
@@ -0,0 +1,89 @@
+name: deploy_release_candidate_pypi
+
+# Workflow added after
https://github.com/apache/beam/commit/4183e747becebd18becee5fff547af365910fc9c
+# If help is needed debugging issues, you can view the release guide at that
commit for guidance on how to do this manually.
+#
(https://github.com/apache/beam/blob/4183e747becebd18becee5fff547af365910fc9c/website/www/site/content/en/contribute/release-guide.md)
+on:
+ workflow_dispatch:
+inputs:
+ RELEASE:
+description: Beam version of current release (e.g. 2.XX.0)
+required: true
+default: '2.XX.0'
+ RC:
+description: Integer RC version for the release (e.g. 3 for RC3)
+required: true
+ PYPI_USER:
+description: PyPi username to perform the upload with
+required: true
+ PYPI_PASSWORD:
+description: PyPi password to perform the upload with
+required: true
+
+env:
+ GRADLE_ENTERPRISE_ACCESS_KEY: ${{ secrets.GE_ACCESS_TOKEN }}
+ GRADLE_ENTERPRISE_CACHE_USERNAME: ${{ secrets.GE_CACHE_USERNAME }}
+ GRADLE_ENTERPRISE_CACHE_PASSWORD: ${{ secrets.GE_CACHE_PASSWORD }}
+
+jobs:
+ deploy_release_candidate_pypi:
+runs-on: [self-hosted, ubuntu-20.04, main]
+steps:
+- name: Mask PyPi id/password
+ run: |
+echo "::add-mask::${{ github.event.inputs.PYPI_USER }}"
+echo "::add-mask::${{ github.event.inputs.PYPI_PASSWORD }}"
+- name: Checkout
+ uses: actions/checkout@v4
+ with:
+ref: "v${{ github.event.inputs.RELEASE }}-RC${{ github.event.inputs.RC
}}"
+repository: apache/beam
+- name: Setup environment
+ uses: ./.github/actions/setup-environment-action
+ with:
+python-version: 3.11
+- name: Install dependencies
+ run: |
+pip install python-dateutil
+pip install requests
+pip install twine
+- name: Deploy to Pypi
+ env:
+RC_TAG: "v${{ github.event.inputs.RELEASE }}-RC${{
github.event.inputs.RC }}"
+GIT_REPO_BASE_URL: https://github.com/apache/beam
+RELEASE_DIR: "beam/${{ github.event.inputs.RELEASE }}"
+RELEASE: "${{ github.event.inputs.RELEASE }}"
+SCRIPT_DIR: release/src/main/scripts
+GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
+SVN_ARTIFACTS_DIR: "beam/${{ github.event.inputs.RELEASE }}/python"
+ run: |
+git fetch --all --tags --prune
+RELEASE_COMMIT=$(git rev-list -n 1 $RC_TAG)
+
+PYTHON_ARTIFACTS_DIR="./python"
+python "release/src/main/scripts/download_github_actions_artifacts.py"
\
+ --github-token-var GITHUB_TOKEN \
+ --repo-url "apache/beam" \
+ --rc-tag "${RC_TAG}" \
+ --release-commit "${RELEASE_COMMIT}" \
+ --artifacts_dir "${PYTHON_ARTIFACTS_DIR}" \
+ --rc_number "${{ github.event.inputs.RC }}" \
+ --yes True
+
+echo "--Checking Hash Value for
apache-beam-${RELEASE}rc${RC_NUMBER}.tar.gz-"
+sha512sum -c "apache-beam-${RELEASE}rc${RC_NUMBER}.tar.gz.sha512"
+
+for artifact in *.whl; do
+ echo "--Checking Hash Value for ${artifact} wheel---"
+ sha512sum -c "${artifact}.sha512"
+done
+
+echo "===Removing sha512 files==="
+rm $(ls | grep -i ".*.sha512$")
+
+echo "Upload rc to pypi"
+mkdir dist && mv $(ls | grep apache) dist && cd dist
+echo "Will upload the following files to PyPI:"
+ls
+
+twine upload * -u ${{ github.event.inputs.PYPI_USER }} -p ${{
github.event.inputs.PYPI_PASSWORD }}
(beam) branch master updated: Bump golang.org/x/sys from 0.13.0 to 0.14.0 in /sdks (#29309)
This is an automated email from the ASF dual-hosted git repository. jrmccluskey pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 3e790032b7d Bump golang.org/x/sys from 0.13.0 to 0.14.0 in /sdks (#29309) 3e790032b7d is described below commit 3e790032b7d5253010cc8172efe3f4466dfb2c3c Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Mon Nov 6 15:32:42 2023 -0500 Bump golang.org/x/sys from 0.13.0 to 0.14.0 in /sdks (#29309) Bumps [golang.org/x/sys](https://github.com/golang/sys) from 0.13.0 to 0.14.0. - [Commits](https://github.com/golang/sys/compare/v0.13.0...v0.14.0) --- updated-dependencies: - dependency-name: golang.org/x/sys dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- sdks/go.mod | 2 +- sdks/go.sum | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/sdks/go.mod b/sdks/go.mod index 0ee2c233dab..5ba1ac0109b 100644 --- a/sdks/go.mod +++ b/sdks/go.mod @@ -55,7 +55,7 @@ require ( golang.org/x/net v0.17.0 golang.org/x/oauth2 v0.13.0 golang.org/x/sync v0.4.0 - golang.org/x/sys v0.13.0 + golang.org/x/sys v0.14.0 golang.org/x/text v0.13.0 google.golang.org/api v0.149.0 google.golang.org/genproto v0.0.0-20231016165738-49dd2c1f3d0b diff --git a/sdks/go.sum b/sdks/go.sum index 6343b568926..540bc6a8713 100644 --- a/sdks/go.sum +++ b/sdks/go.sum @@ -600,8 +600,8 @@ golang.org/x/sys v0.0.0-20220722155257-8c9f86f7a55f/go.mod h1:oPkhp1MJrh7nUepCBc golang.org/x/sys v0.5.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg= golang.org/x/sys v0.8.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg= golang.org/x/sys v0.11.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg= -golang.org/x/sys v0.13.0 h1:Af8nKPmuFypiUBjVoU9V20FiaFXOcuZI21p0ycVYYGE= -golang.org/x/sys v0.13.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg= +golang.org/x/sys v0.14.0 h1:Vz7Qs629MkJkGyHxUlRHizWJRG2j8fbQKjELVSNhy7Q= +golang.org/x/sys v0.14.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA= golang.org/x/term v0.0.0-20201126162022-7de9c90e9dd1/go.mod h1:bj7SfCRtBDWHUb9snDiAeCFNEtKQo2Wmx5Cou7ajbmo= golang.org/x/term v0.0.0-20210927222741-03fcf44c2211/go.mod h1:jbD1KX2456YbFQfuXm/mYQcufACuNUgVhRMnK/tPxf8= golang.org/x/text v0.0.0-20170915032832-14c0d48ead0c/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
(beam) branch dependabot/go_modules/sdks/golang.org/x/sys-0.14.0 deleted (was ed3ceba93f8)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/golang.org/x/sys-0.14.0 in repository https://gitbox.apache.org/repos/asf/beam.git was ed3ceba93f8 Bump golang.org/x/sys from 0.13.0 to 0.14.0 in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.26.0 updated (ea950566d0c -> 27567414827)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.26.0 in repository https://gitbox.apache.org/repos/asf/beam.git omit ea950566d0c Bump github.com/testcontainers/testcontainers-go in /sdks add 7fe906497db [BigQueryIO] Upserts work with CREATE_IF_NEEDED -- doc only PR (#29276) add cbd756770d2 Update dev container tags. (#29311) add aa890ea5621 [RRIO] [Call] Implement PTransform without adaptive throttling (#29144) add 827afb9f3b7 Revert "Support DatabaseID in Datastore beam connector (#27987)" (#29317) add 9acf947780e [prism] Add fusion. (#29306) add f619affcf70 Add action to publish RC to PyPi (#29316) add 3e790032b7d Bump golang.org/x/sys from 0.13.0 to 0.14.0 in /sdks (#29309) add 27567414827 Bump github.com/testcontainers/testcontainers-go in /sdks This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (ea950566d0c) \ N -- N -- N refs/heads/dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.26.0 (27567414827) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .../workflows/deploy_release_candidate_pypi.yaml | 89 sdks/go.mod| 2 +- sdks/go.sum| 4 +- sdks/go/pkg/beam/runners/direct/direct_test.go | 98 sdks/go/pkg/beam/runners/prism/README.md | 3 +- sdks/go/pkg/beam/runners/prism/internal/execute.go | 6 - .../beam/runners/prism/internal/execute_test.go| 105 +++- .../beam/runners/prism/internal/handlecombine.go | 17 +- .../pkg/beam/runners/prism/internal/handlepardo.go | 37 +- .../beam/runners/prism/internal/handlerunner.go| 61 ++- .../pkg/beam/runners/prism/internal/preprocess.go | 526 ++--- .../beam/runners/prism/internal/preprocess_test.go | 78 +-- .../beam/runners/prism/internal/separate_test.go | 3 +- sdks/go/pkg/beam/runners/prism/internal/stage.go | 44 +- .../runners/prism/internal/unimplemented_test.go | 1 - .../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 25 +- .../beam/sdk/io/gcp/datastore/DatastoreV1.java | 349 ++ .../beam/sdk/io/gcp/datastore/DatastoreV1Test.java | 94 +--- .../beam/sdk/io/gcp/datastore/SplitQueryFnIT.java | 17 +- .../apache/beam/sdk/io/gcp/datastore/V1ReadIT.java | 26 +- .../beam/sdk/io/gcp/datastore/V1TestUtil.java | 59 +-- .../beam/sdk/io/gcp/datastore/V1WriteIT.java | 11 +- sdks/java/io/rrio/build.gradle | 2 + .../apache/beam/io/requestresponse/ApiIOError.java | 36 +- .../org/apache/beam/io/requestresponse/Call.java | 337 - .../apache/beam/io/requestresponse/CallTest.java | 493 +++ .../apache_beam/runners/dataflow/internal/names.py | 2 +- 27 files changed, 1782 insertions(+), 743 deletions(-) create mode 100644 .github/workflows/deploy_release_candidate_pypi.yaml create mode 100644 sdks/java/io/rrio/src/test/java/org/apache/beam/io/requestresponse/CallTest.java
(beam) branch dependabot/go_modules/sdks/golang.org/x/sync-0.5.0 updated (ade39e072db -> 6929e63c9b2)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/golang.org/x/sync-0.5.0 in repository https://gitbox.apache.org/repos/asf/beam.git discard ade39e072db Bump golang.org/x/sync from 0.4.0 to 0.5.0 in /sdks add 34b93c0d10d Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 in /sdks (#29308) add 7fe906497db [BigQueryIO] Upserts work with CREATE_IF_NEEDED -- doc only PR (#29276) add cbd756770d2 Update dev container tags. (#29311) add aa890ea5621 [RRIO] [Call] Implement PTransform without adaptive throttling (#29144) add 827afb9f3b7 Revert "Support DatabaseID in Datastore beam connector (#27987)" (#29317) add 9acf947780e [prism] Add fusion. (#29306) add f619affcf70 Add action to publish RC to PyPi (#29316) add 3e790032b7d Bump golang.org/x/sys from 0.13.0 to 0.14.0 in /sdks (#29309) add 6929e63c9b2 Bump golang.org/x/sync from 0.4.0 to 0.5.0 in /sdks This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (ade39e072db) \ N -- N -- N refs/heads/dependabot/go_modules/sdks/golang.org/x/sync-0.5.0 (6929e63c9b2) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .../workflows/deploy_release_candidate_pypi.yaml | 89 sdks/go.mod| 4 +- sdks/go.sum| 10 +- sdks/go/pkg/beam/runners/direct/direct_test.go | 98 sdks/go/pkg/beam/runners/prism/README.md | 3 +- sdks/go/pkg/beam/runners/prism/internal/execute.go | 6 - .../beam/runners/prism/internal/execute_test.go| 105 +++- .../beam/runners/prism/internal/handlecombine.go | 17 +- .../pkg/beam/runners/prism/internal/handlepardo.go | 37 +- .../beam/runners/prism/internal/handlerunner.go| 61 ++- .../pkg/beam/runners/prism/internal/preprocess.go | 526 ++--- .../beam/runners/prism/internal/preprocess_test.go | 78 +-- .../beam/runners/prism/internal/separate_test.go | 3 +- sdks/go/pkg/beam/runners/prism/internal/stage.go | 44 +- .../runners/prism/internal/unimplemented_test.go | 1 - .../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 25 +- .../beam/sdk/io/gcp/datastore/DatastoreV1.java | 349 ++ .../beam/sdk/io/gcp/datastore/DatastoreV1Test.java | 94 +--- .../beam/sdk/io/gcp/datastore/SplitQueryFnIT.java | 17 +- .../apache/beam/sdk/io/gcp/datastore/V1ReadIT.java | 26 +- .../beam/sdk/io/gcp/datastore/V1TestUtil.java | 59 +-- .../beam/sdk/io/gcp/datastore/V1WriteIT.java | 11 +- sdks/java/io/rrio/build.gradle | 2 + .../apache/beam/io/requestresponse/ApiIOError.java | 36 +- .../org/apache/beam/io/requestresponse/Call.java | 337 - .../apache/beam/io/requestresponse/CallTest.java | 493 +++ .../apache_beam/runners/dataflow/internal/names.py | 2 +- 27 files changed, 1786 insertions(+), 747 deletions(-) create mode 100644 .github/workflows/deploy_release_candidate_pypi.yaml create mode 100644 sdks/java/io/rrio/src/test/java/org/apache/beam/io/requestresponse/CallTest.java
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 9b62db9c09d Updating config from bot
9b62db9c09d is described below
commit 9b62db9c09d74debc89434d496aa19dedc44bc5a
Author: github-actions
AuthorDate: Mon Nov 6 21:34:38 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29319.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29319.json
b/scripts/ci/pr-bot/state/pr-state/pr-29319.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29319.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch users/damccorm/pypi_publish deleted (was 167893630b2)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/pypi_publish in repository https://gitbox.apache.org/repos/asf/beam.git was 167893630b2 Add action to publish RC to PyPi The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#29288)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new c8e7bde45d9 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#29288) c8e7bde45d9 is described below commit c8e7bde45d9ddb976498506e29e0891830a37c35 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Mon Nov 6 14:12:53 2023 -0800 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#29288) Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.13.0 to 1.13.1. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/config/v1.13.1/CHANGELOG.md) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.13.0...config/v1.13.1) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- sdks/go.mod | 2 +- sdks/go.sum | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/sdks/go.mod b/sdks/go.mod index 5ba1ac0109b..c3c1c4593f8 100644 --- a/sdks/go.mod +++ b/sdks/go.mod @@ -33,7 +33,7 @@ require ( github.com/aws/aws-sdk-go-v2 v1.22.1 github.com/aws/aws-sdk-go-v2/config v1.22.0 github.com/aws/aws-sdk-go-v2/credentials v1.15.1 - github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.13.0 + github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.13.1 github.com/aws/aws-sdk-go-v2/service/s3 v1.42.0 github.com/aws/smithy-go v1.16.0 github.com/docker/go-connections v0.4.0 diff --git a/sdks/go.sum b/sdks/go.sum index 540bc6a8713..875ba55d859 100644 --- a/sdks/go.sum +++ b/sdks/go.sum @@ -95,8 +95,8 @@ github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.3.0/go.mod h1:2LAuqPx1I6jNfaGDu github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.14.2 h1:gIeH4+o1MN/caGBWjoGQTUTIu94xD6fI5B2+TcwBf70= github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.14.2/go.mod h1:wLyMIo/zPOhQhPXTddpfdkSleyigtFi8iMnC+2m/SK4= github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.3.2/go.mod h1:qaqQiHSrOUVOfKe6fhgQ6UzhxjwqVW8aHNegd6Ws4w4= -github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.13.0 h1:LPTcGCwO6bup9pTuOmYFXlcocpMX8PPO+TIB7CtSVnI= -github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.13.0/go.mod h1:QJXFEiHtNvgiOuBx9cyK6hC28xTB7mQ/iya6Xr1Fu7Y= +github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.13.1 h1:ULswbgGNVrW8zEhkCNwrwXrs1mUvy2JTqWaCRsD2ZZw= +github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.13.1/go.mod h1:pAXgsDPk1rRwwfkz8/9ISO75vXEHqTGIgbLhGqqQ1GY= github.com/aws/aws-sdk-go-v2/internal/configsources v1.2.1 h1:fi1ga6WysOyYb5PAf3Exd6B5GiSNpnZim4h1rhlBqx0= github.com/aws/aws-sdk-go-v2/internal/configsources v1.2.1/go.mod h1:V5CY8wNurvPUibTi9mwqUqpiFZ5LnioKWIFUDtIzdI8= github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.5.1 h1:ZpaV/j48RlPc4AmOZuPv22pJliXjXq8/reL63YzyFnw=
(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.13.1 deleted (was 63f4ea713fd)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.13.1 in repository https://gitbox.apache.org/repos/asf/beam.git was 63f4ea713fd Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: [#29210] Fix SDF progress fraction to not return NaN (#29307)
This is an automated email from the ASF dual-hosted git repository.
lostluck pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new ad287193c1e [#29210] Fix SDF progress fraction to not return NaN
(#29307)
ad287193c1e is described below
commit ad287193c1ee3b47ea17a586a68381ad5065e8ce
Author: Johanna Öjeling <51084516+johannaojel...@users.noreply.github.com>
AuthorDate: Mon Nov 6 23:15:23 2023 +0100
[#29210] Fix SDF progress fraction to not return NaN (#29307)
---
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 11 ++-
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 117 ++---
2 files changed, 96 insertions(+), 32 deletions(-)
diff --git a/sdks/go/pkg/beam/core/runtime/exec/sdf.go
b/sdks/go/pkg/beam/core/runtime/exec/sdf.go
index b21b47b20ae..3977d31dda7 100644
--- a/sdks/go/pkg/beam/core/runtime/exec/sdf.go
+++ b/sdks/go/pkg/beam/core/runtime/exec/sdf.go
@@ -781,7 +781,7 @@ func (n *ProcessSizedElementsAndRestrictions)
singleWindowSplit(ctx context.Cont
func (n *ProcessSizedElementsAndRestrictions) multiWindowSplit(ctx
context.Context, f float64, pWeState any, rWeState any) ([]*FullValue,
[]*FullValue, error) {
// Get the split point in window range, to see what window it falls in.
done, rem := n.rt.GetProgress()
- cwp := done / (done + rem) // Progress in current
window.
+ cwp := progressFraction(done, rem) // Progress in current
window.
p := (float64(n.currW) + cwp) / float64(n.numW) // Progress of whole
element.
sp := p + (f * (1.0 - p)) // Split point in range
of entire element [0, 1].
wsp := sp * float64(n.numW) // Split point in
window range [0, numW].
@@ -923,7 +923,7 @@ func (n *ProcessSizedElementsAndRestrictions)
newSplitResult(ctx context.Context
// DoFns, so 1.0 is only returned once all windows have been processed.
func (n *ProcessSizedElementsAndRestrictions) GetProgress() float64 {
d, r := n.rt.GetProgress()
- frac := d / (d + r)
+ frac := progressFraction(d, r)
if n.numW == 1 {
return frac
@@ -959,6 +959,13 @@ func (n *ProcessSizedElementsAndRestrictions)
GetOutputWatermark() map[string]*t
return nil
}
+func progressFraction(done float64, remaining float64) float64 {
+ if done == 0 {
+ return 0
+ }
+ return done / (done + remaining)
+}
+
// SdfFallback is an executor used when an SDF isn't expanded into steps by the
// runner, indicating that the runner doesn't support splitting. It executes
all
// the SDF steps together in one unit.
diff --git a/sdks/go/pkg/beam/core/runtime/exec/sdf_test.go
b/sdks/go/pkg/beam/core/runtime/exec/sdf_test.go
index a0380796e86..460a7111b11 100644
--- a/sdks/go/pkg/beam/core/runtime/exec/sdf_test.go
+++ b/sdks/go/pkg/beam/core/runtime/exec/sdf_test.go
@@ -715,6 +715,14 @@ func TestAsSplittableUnit(t *testing.T) {
currWindow:0,
wantProgress: 0.5,
},
+ {
+ name: "SingleWindowZeroWork",
+ windows: testWindows,
+ doneWork: 0.0,
+ remainingWork: 0.0,
+ currWindow:0,
+ wantProgress: 0.0,
+ },
{
name: "MultipleWindows",
windows: multiWindows,
@@ -724,6 +732,14 @@ func TestAsSplittableUnit(t *testing.T) {
// Progress should be halfway through second
window.
wantProgress: 1.5 / 4.0,
},
+ {
+ name: "MultipleWindowsZeroWork",
+ windows: multiWindows,
+ doneWork: 0.0,
+ remainingWork: 0.0,
+ currWindow:1,
+ wantProgress: 1.0 / 4.0,
+ },
}
for _, test := range tests {
test := test
@@ -776,15 +792,19 @@ func TestAsSplittableUnit(t *testing.T) {
name string
fn*graph.DoFn
frac float64
- doneRtbool // Result that RTracker will return
for IsDone.
+ done float64
+ remaining float64
+ isDoneRt bool // Result that RTracker will return
for IsDone.
(beam) branch users/damccorm/pypi created (now aa8c7ae1bf1)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/pypi in repository https://gitbox.apache.org/repos/asf/beam.git at aa8c7ae1bf1 Update deploy_release_candidate_pypi.yaml to checkout master This branch includes the following new commits: new aa8c7ae1bf1 Update deploy_release_candidate_pypi.yaml to checkout master The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) 01/01: Update deploy_release_candidate_pypi.yaml to checkout master
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch users/damccorm/pypi
in repository https://gitbox.apache.org/repos/asf/beam.git
commit aa8c7ae1bf18811a7931447d3615f12b9dd78fef
Author: Danny McCormick
AuthorDate: Mon Nov 6 17:31:19 2023 -0500
Update deploy_release_candidate_pypi.yaml to checkout master
---
.github/workflows/deploy_release_candidate_pypi.yaml | 3 ---
1 file changed, 3 deletions(-)
diff --git a/.github/workflows/deploy_release_candidate_pypi.yaml
b/.github/workflows/deploy_release_candidate_pypi.yaml
index 7f873dbdc2a..2e1185b5684 100644
--- a/.github/workflows/deploy_release_candidate_pypi.yaml
+++ b/.github/workflows/deploy_release_candidate_pypi.yaml
@@ -35,9 +35,6 @@ jobs:
echo "::add-mask::${{ github.event.inputs.PYPI_PASSWORD }}"
- name: Checkout
uses: actions/checkout@v4
- with:
-ref: "v${{ github.event.inputs.RELEASE }}-RC${{ github.event.inputs.RC
}}"
-repository: apache/beam
- name: Setup environment
uses: ./.github/actions/setup-environment-action
with:
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 23a04ec8d60 Updating config from bot 23a04ec8d60 is described below commit 23a04ec8d6086b618b7d9020817bc5ed3b4650ad Author: github-actions AuthorDate: Mon Nov 6 22:34:25 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29310.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29310.json b/scripts/ci/pr-bot/state/pr-state/pr-29310.json index 8ea94810368..db1f0cb985a 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29310.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29310.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch prismFusion deleted (was 39939ce5d12)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a change to branch prismFusion in repository https://gitbox.apache.org/repos/asf/beam.git was 39939ce5d12 Update sdks/go/pkg/beam/runners/prism/internal/preprocess.go The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: [Go SDK]: Create natsio.Write transform for writing to NATS (#29184)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new cf560ca2f70 [Go SDK]: Create natsio.Write transform for writing to NATS (#29184) cf560ca2f70 is described below commit cf560ca2f70c53d6c9c625e8a4c6fb13c192e640 Author: Johanna Öjeling <51084516+johannaojel...@users.noreply.github.com> AuthorDate: Tue Nov 7 00:02:13 2023 +0100 [Go SDK]: Create natsio.Write transform for writing to NATS (#29184) * Create natsio.Write transform for writing to NATS * Emit representation of acknowledged message from writeFn * Use type map[string][]string for ProduceMessage headers --- sdks/go.mod| 9 +- sdks/go.sum| 18 ++- sdks/go/pkg/beam/io/natsio/common.go | 58 +++ sdks/go/pkg/beam/io/natsio/example_test.go | 55 +++ sdks/go/pkg/beam/io/natsio/helper_test.go | 130 +++ sdks/go/pkg/beam/io/natsio/write.go| 114 + sdks/go/pkg/beam/io/natsio/write_option.go | 31 sdks/go/pkg/beam/io/natsio/write_test.go | 252 + 8 files changed, 664 insertions(+), 3 deletions(-) diff --git a/sdks/go.mod b/sdks/go.mod index c3c1c4593f8..6f64472eb8a 100644 --- a/sdks/go.mod +++ b/sdks/go.mod @@ -45,6 +45,8 @@ require ( github.com/johannesboyne/gofakes3 v0.0.0-20221110173912-32fb85c5aed6 github.com/lib/pq v1.10.9 github.com/linkedin/goavro/v2 v2.12.0 + github.com/nats-io/nats-server/v2 v2.10.4 + github.com/nats-io/nats.go v1.31.0 github.com/proullon/ramsql v0.1.3 github.com/spf13/cobra v1.8.0 github.com/testcontainers/testcontainers-go v0.25.0 @@ -76,12 +78,17 @@ require ( github.com/Microsoft/hcsshim v0.11.0 // indirect github.com/go-ole/go-ole v1.2.6 // indirect github.com/lufia/plan9stats v0.0.0-20211012122336-39d0f177ccd0 // indirect + github.com/minio/highwayhash v1.0.2 // indirect + github.com/nats-io/jwt/v2 v2.5.2 // indirect + github.com/nats-io/nkeys v0.4.6 // indirect + github.com/nats-io/nuid v1.0.1 // indirect github.com/power-devops/perfstat v0.0.0-20210106213030-5aafc221ea8c // indirect github.com/shirou/gopsutil/v3 v3.23.8 // indirect github.com/shoenig/go-m1cpu v0.1.6 // indirect github.com/tklauser/go-sysconf v0.3.12 // indirect github.com/tklauser/numcpus v0.6.1 // indirect github.com/yusufpapurcu/wmi v1.2.3 // indirect + golang.org/x/time v0.3.0 // indirect ) require ( @@ -138,7 +145,7 @@ require ( github.com/inconshreveable/mousetrap v1.1.0 // indirect github.com/jmespath/go-jmespath v0.4.0 // indirect github.com/klauspost/asmfmt v1.3.2 // indirect - github.com/klauspost/compress v1.16.7 // indirect + github.com/klauspost/compress v1.17.2 // indirect github.com/klauspost/cpuid/v2 v2.2.5 // indirect github.com/kr/text v0.2.0 // indirect github.com/magiconair/properties v1.8.7 // indirect diff --git a/sdks/go.sum b/sdks/go.sum index 875ba55d859..efffec5951a 100644 --- a/sdks/go.sum +++ b/sdks/go.sum @@ -319,8 +319,8 @@ github.com/klauspost/asmfmt v1.3.2/go.mod h1:AG8TuvYojzulgDAMCnYn50l/5QV3Bs/tp6j github.com/klauspost/compress v1.9.7/go.mod h1:RyIbtBH6LamlWaDj8nUwkbUhJ87Yi3uG0guNDohfE1A= github.com/klauspost/compress v1.13.1/go.mod h1:8dP1Hq4DHOhN9w426knH3Rhby4rFm6D8eO+e+Dq5Gzg= github.com/klauspost/compress v1.13.6/go.mod h1:/3/Vjq9QcHkK5uEr5lBEmyoZ1iFhe47etQ6QUkpK6sk= -github.com/klauspost/compress v1.16.7 h1:2mk3MPGNzKyxErAw8YaohYh69+pa4sIQSC0fPGCFR9I= -github.com/klauspost/compress v1.16.7/go.mod h1:ntbaceVETuRiXiv4DpjP66DpAtAGkEQskQzEyD//IeE= +github.com/klauspost/compress v1.17.2 h1:RlWWUY/Dr4fL8qk9YG7DTZ7PDgME2V4csBXA8L/ixi4= +github.com/klauspost/compress v1.17.2/go.mod h1:ntbaceVETuRiXiv4DpjP66DpAtAGkEQskQzEyD//IeE= github.com/klauspost/cpuid/v2 v2.2.5 h1:0E5MSMDEoAulmXNFquVs//DdoomxaoTY1kUhbc/qbZg= github.com/klauspost/cpuid/v2 v2.2.5/go.mod h1:Lcz8mBdAVJIBVzewtcLocK12l3Y+JytZYpaMropDUws= github.com/kr/pretty v0.1.0/go.mod h1:dAy3ld7l9f0ibDNOQOHHMYYIIbhfbHSm3C4ZsoJORNo= @@ -343,6 +343,8 @@ github.com/minio/asm2plan9s v0.0.0-20200509001527-cdd76441f9d8 h1:AMFGa4R4MiIpsp github.com/minio/asm2plan9s v0.0.0-20200509001527-cdd76441f9d8/go.mod h1:mC1jAcsrzbxHt8iiaC+zU4b1ylILSosueou12R++wfY= github.com/minio/c2goasm v0.0.0-20190812172519-36a3d3bbc4f3 h1:+n/aFZefKZp7spd8DFdX7uMikMLXX4oubIzJF4kv/wI= github.com/minio/c2goasm v0.0.0-20190812172519-36a3d3bbc4f3/go.mod h1:RagcQ7I8IeTMnF8JTXieKnO4Z6JCsikNEzj0DwauVzE= +github.com/minio/highwayhash v1.0.2 h1:Aak5U0nElisjDCfPSG79Tgzkn2gl66NxOMspRrKnA/g= +github.com/minio/highwayhash v1.0.2/go.mod h1:BQskDq+xkJ12lmlUUi7U0M5Swg3EWR+dLTk+kldvVxY= github.co
(beam) branch dependabot/go_modules/sdks/golang.org/x/sync-0.5.0 updated (6929e63c9b2 -> b8af1387d22)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/go_modules/sdks/golang.org/x/sync-0.5.0
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 6929e63c9b2 Bump golang.org/x/sync from 0.4.0 to 0.5.0 in /sdks
add c8e7bde45d9 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#29288)
add ad287193c1e [#29210] Fix SDF progress fraction to not return NaN
(#29307)
add cf560ca2f70 [Go SDK]: Create natsio.Write transform for writing to
NATS (#29184)
add b8af1387d22 Bump golang.org/x/sync from 0.4.0 to 0.5.0 in /sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6929e63c9b2)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/golang.org/x/sync-0.5.0 (b8af1387d22)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
sdks/go.mod| 11 +-
sdks/go.sum| 22 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 11 +-
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 117 +++---
.../provision.go => pkg/beam/io/natsio/common.go} | 56 ++---
.../go/pkg/beam/io/natsio/example_test.go | 40 ++--
sdks/go/pkg/beam/io/natsio/helper_test.go | 130 +++
sdks/go/pkg/beam/io/natsio/write.go| 114 ++
.../go/pkg/beam/io/natsio/write_option.go | 26 +--
sdks/go/pkg/beam/io/natsio/write_test.go | 252 +
10 files changed, 683 insertions(+), 96 deletions(-)
copy sdks/go/{cmd/beamctl/cmd/provision.go => pkg/beam/io/natsio/common.go}
(55%)
copy learning/katas/go/common_transforms/aggregation/max/cmd/main.go =>
sdks/go/pkg/beam/io/natsio/example_test.go (59%)
create mode 100644 sdks/go/pkg/beam/io/natsio/helper_test.go
create mode 100644 sdks/go/pkg/beam/io/natsio/write.go
copy playground/backend/playground_functions/func_enviornment.go =>
sdks/go/pkg/beam/io/natsio/write_option.go (66%)
create mode 100644 sdks/go/pkg/beam/io/natsio/write_test.go
(beam) branch dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.26.0 updated (27567414827 -> 1712d84a7da)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.26.0
in repository https://gitbox.apache.org/repos/asf/beam.git
omit 27567414827 Bump github.com/testcontainers/testcontainers-go in /sdks
add c8e7bde45d9 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#29288)
add ad287193c1e [#29210] Fix SDF progress fraction to not return NaN
(#29307)
add cf560ca2f70 [Go SDK]: Create natsio.Write transform for writing to
NATS (#29184)
add 1712d84a7da Bump github.com/testcontainers/testcontainers-go in /sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (27567414827)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.26.0
(1712d84a7da)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
sdks/go.mod| 11 +-
sdks/go.sum| 22 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 11 +-
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 117 +++---
.../provision.go => pkg/beam/io/natsio/common.go} | 56 ++---
.../go/pkg/beam/io/natsio/example_test.go | 40 ++--
sdks/go/pkg/beam/io/natsio/helper_test.go | 130 +++
sdks/go/pkg/beam/io/natsio/write.go| 114 ++
.../go/pkg/beam/io/natsio/write_option.go | 26 +--
sdks/go/pkg/beam/io/natsio/write_test.go | 252 +
10 files changed, 683 insertions(+), 96 deletions(-)
copy sdks/go/{cmd/beamctl/cmd/provision.go => pkg/beam/io/natsio/common.go}
(55%)
copy learning/katas/go/common_transforms/aggregation/max/cmd/main.go =>
sdks/go/pkg/beam/io/natsio/example_test.go (59%)
create mode 100644 sdks/go/pkg/beam/io/natsio/helper_test.go
create mode 100644 sdks/go/pkg/beam/io/natsio/write.go
copy playground/backend/playground_functions/func_enviornment.go =>
sdks/go/pkg/beam/io/natsio/write_option.go (66%)
create mode 100644 sdks/go/pkg/beam/io/natsio/write_test.go
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new de86af40ba5 Updating config from bot
de86af40ba5 is described below
commit de86af40ba5dc6b41ed3e5176e7ffdaa7a604334
Author: github-actions
AuthorDate: Mon Nov 6 23:05:35 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29320.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29320.json
b/scripts/ci/pr-bot/state/pr-state/pr-29320.json
new file mode 100644
index 000..8a92900947e
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29320.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "damccorm"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 63313ca1ecc Updating config from bot
63313ca1ecc is described below
commit 63313ca1ecc38d69aa5d1042d658f9fafa8f20d5
Author: github-actions
AuthorDate: Mon Nov 6 23:05:36 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index 04e2c0f5b74..e53be56d93e 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -1,7 +1,7 @@
{
"label": "build",
"dateOfLastReviewAssignment": {
-"damccorm": 1698960777652,
+"damccorm": 1699311933210,
"Abacn": 1699101618503
}
}
\ No newline at end of file
(beam) branch users/damccorm/pypi updated (aa8c7ae1bf1 -> bc05a2e5dd1)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/pypi in repository https://gitbox.apache.org/repos/asf/beam.git from aa8c7ae1bf1 Update deploy_release_candidate_pypi.yaml to checkout master add bc05a2e5dd1 get to right location for artifacts No new revisions were added by this update. Summary of changes: .github/workflows/deploy_release_candidate_pypi.yaml | 2 ++ 1 file changed, 2 insertions(+)
(beam) branch users/damccorm/pypi updated (bc05a2e5dd1 -> fd782cd6962)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/pypi in repository https://gitbox.apache.org/repos/asf/beam.git from bc05a2e5dd1 get to right location for artifacts add fd782cd6962 Debug info No new revisions were added by this update. Summary of changes: .github/workflows/deploy_release_candidate_pypi.yaml | 1 + 1 file changed, 1 insertion(+)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 139ef0b77fa Updating config from bot 139ef0b77fa is described below commit 139ef0b77fa7acafbc791c5ed39e0a7284cc6053 Author: github-actions AuthorDate: Mon Nov 6 23:27:14 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29320.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29320.json b/scripts/ci/pr-bot/state/pr-state/pr-29320.json index 8a92900947e..4aa691bf72d 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29320.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29320.json @@ -4,7 +4,7 @@ "build": "damccorm" }, "nextAction": "Reviewers", - "stopReviewerNotifications": false, + "stopReviewerNotifications": true, "remindAfterTestsPass": [], "committerAssigned": false } \ No newline at end of file
(beam) branch users/damccorm/pypi updated (fd782cd6962 -> 67f770935fd)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/pypi in repository https://gitbox.apache.org/repos/asf/beam.git from fd782cd6962 Debug info add 67f770935fd Use RC number from inputs No new revisions were added by this update. Summary of changes: .github/workflows/deploy_release_candidate_pypi.yaml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
(beam) branch users/damccorm/update_docs updated (96d2ae47070 -> 1e4781cce12)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/update_docs in repository https://gitbox.apache.org/repos/asf/beam.git from 96d2ae47070 Updates from release to guide add 1e4781cce12 More changes No new revisions were added by this update. Summary of changes: contributor-docs/release-guide.md | 22 -- 1 file changed, 4 insertions(+), 18 deletions(-)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 1d16d2716f9 Updating config from bot
1d16d2716f9 is described below
commit 1d16d2716f9e4a957f1001777a292410221a5414
Author: github-actions
AuthorDate: Tue Nov 7 00:19:21 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-build.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
index e53be56d93e..4ca697bbba1 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-build.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-build.json
@@ -2,6 +2,6 @@
"label": "build",
"dateOfLastReviewAssignment": {
"damccorm": 1699311933210,
-"Abacn": 1699101618503
+"Abacn": 1699316357911
}
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 0aee0b39321 Updating config from bot
0aee0b39321 is described below
commit 0aee0b39321a8fd41fb8d426345c175234968efa
Author: github-actions
AuthorDate: Tue Nov 7 00:19:19 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29321.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29321.json
b/scripts/ci/pr-bot/state/pr-state/pr-29321.json
new file mode 100644
index 000..9c51466b9ee
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29321.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"build": "Abacn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 75c4a35f08a Updating config from bot 75c4a35f08a is described below commit 75c4a35f08aa5f29ec9cc17f7dcfd2501327206c Author: github-actions AuthorDate: Tue Nov 7 00:49:37 2023 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29321.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29321.json b/scripts/ci/pr-bot/state/pr-state/pr-29321.json index 9c51466b9ee..ebb27d68fb5 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29321.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29321.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 5ec5590f52e Updating config from bot 5ec5590f52e is described below commit 5ec5590f52e8e77308274534b3b9646ae9bfd63d Author: github-actions AuthorDate: Tue Nov 7 00:59:21 2023 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json index 3473d7cc433..f7527af457e 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json @@ -9,7 +9,7 @@ "jrmccluskey": 1699034786644, "kennknowles": 1698946661560, "lostluck": 1698419387586, -"riteshghorse": 1698413041538, +"riteshghorse": 1699318758450, "robertwb": 1698444361546, "tvalentyn": 1698635168131 }
(beam) branch master updated: [RRIO] [testing] Downgrade mock-apis grpcio-tools dependencies to remove Beam SDK version conflict (#29320)
This is an automated email from the ASF dual-hosted git repository.
riteshghorse pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 29c0b41afec [RRIO] [testing] Downgrade mock-apis grpcio-tools
dependencies to remove Beam SDK version conflict (#29320)
29c0b41afec is described below
commit 29c0b41afeca1cb0fb97362a40d869d46735593a
Author: Damon
AuthorDate: Mon Nov 6 16:58:16 2023 -0800
[RRIO] [testing] Downgrade mock-apis grpcio-tools dependencies to remove
Beam SDK version conflict (#29320)
* Constrain grpc* versons to >=1.53.0
* Downgrade grpcio dependencies
* Bump project version
* Make version constraint >=
* Add poetry.lock to rat
---
.test-infra/mock-apis/poetry.lock| 19 +--
.test-infra/mock-apis/pyproject.toml | 6 +++---
build.gradle.kts | 3 +++
3 files changed, 7 insertions(+), 21 deletions(-)
diff --git a/.test-infra/mock-apis/poetry.lock
b/.test-infra/mock-apis/poetry.lock
index e9bcdbb4750..b36baff7a74 100644
--- a/.test-infra/mock-apis/poetry.lock
+++ b/.test-infra/mock-apis/poetry.lock
@@ -1,20 +1,3 @@
-#
-# Licensed to the Apache Software Foundation (ASF) under one or more
-# contributor license agreements. See the NOTICE file distributed with
-# this work for additional information regarding copyright ownership.
-# The ASF licenses this file to You under the Apache License, Version 2.0
-# (the "License"); you may not use this file except in compliance with
-# the License. You may obtain a copy of the License at
-#
-#http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
-#
-
# This file is automatically @generated by Poetry 1.7.0 and should not be
changed by hand.
[[package]]
@@ -233,4 +216,4 @@ files = [
[metadata]
lock-version = "2.0"
python-versions = "^3.8"
-content-hash =
"1f2dadd2821a62cdfb7562f211be17c8bd12b762551bdb923954f9e7404087ec"
+content-hash =
"35ed5a98dd3f951bbfc44b949ad9148634159976cb54ac6f257d119c12d9d924"
diff --git a/.test-infra/mock-apis/pyproject.toml
b/.test-infra/mock-apis/pyproject.toml
index ed3f035cbf4..680bf489ba1 100644
--- a/.test-infra/mock-apis/pyproject.toml
+++ b/.test-infra/mock-apis/pyproject.toml
@@ -17,7 +17,7 @@
[tool.poetry]
name = "mock-apis"
-version = "0.1.0"
+version = "0.1.1"
authors = ["Ritesh Ghorse , Damon Douglas <>"]
license = "Apache-2.0"
description = ""
@@ -29,8 +29,8 @@ packages = [
[tool.poetry.dependencies]
python = "^3.8"
google = "^3.0.0"
-grpcio = "^1.59.2"
-grpcio-tools = "^1.59.2"
+grpcio = "^1.53.0"
+grpcio-tools = "^1.53.0"
[build-system]
diff --git a/build.gradle.kts b/build.gradle.kts
index b330bd07861..59161809f37 100644
--- a/build.gradle.kts
+++ b/build.gradle.kts
@@ -202,6 +202,9 @@ tasks.rat {
// Ignore buf autogenerated files.
"**/buf.lock",
+
+// Ignore poetry autogenerated files.
+"**/poetry.lock",
)
// Add .gitignore excludes to the Apache Rat exclusion list. We re-create
the behavior
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 84038e83917 Updating config from bot
84038e83917 is described below
commit 84038e8391721bf3e5246ae6e6823c41f129bb41
Author: github-actions
AuthorDate: Tue Nov 7 00:59:20 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29305.json | 6 --
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29305.json
b/scripts/ci/pr-bot/state/pr-state/pr-29305.json
index 242a48d7d3b..0eee1168789 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29305.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29305.json
@@ -1,7 +1,9 @@
{
"commentedAboutFailingChecks": true,
- "reviewersAssignedForLabels": {},
- "nextAction": "Author",
+ "reviewersAssignedForLabels": {
+"no-matching-label": "riteshghorse"
+ },
+ "nextAction": "Reviewers",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
"committerAssigned": false
(beam) branch master updated: A couple small fixes to the pypi deploy action (#29321)
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new f3636f32b3f A couple small fixes to the pypi deploy action (#29321)
f3636f32b3f is described below
commit f3636f32b3f5a97bdd5c8421bf3b1f702ad0980f
Author: Danny McCormick
AuthorDate: Mon Nov 6 19:59:46 2023 -0500
A couple small fixes to the pypi deploy action (#29321)
* Update deploy_release_candidate_pypi.yaml to checkout master
* get to right location for artifacts
* Debug info
* Use RC number from inputs
---
.github/workflows/deploy_release_candidate_pypi.yaml | 10 +-
1 file changed, 5 insertions(+), 5 deletions(-)
diff --git a/.github/workflows/deploy_release_candidate_pypi.yaml
b/.github/workflows/deploy_release_candidate_pypi.yaml
index 7f873dbdc2a..fd3994f658e 100644
--- a/.github/workflows/deploy_release_candidate_pypi.yaml
+++ b/.github/workflows/deploy_release_candidate_pypi.yaml
@@ -35,9 +35,6 @@ jobs:
echo "::add-mask::${{ github.event.inputs.PYPI_PASSWORD }}"
- name: Checkout
uses: actions/checkout@v4
- with:
-ref: "v${{ github.event.inputs.RELEASE }}-RC${{ github.event.inputs.RC
}}"
-repository: apache/beam
- name: Setup environment
uses: ./.github/actions/setup-environment-action
with:
@@ -70,8 +67,11 @@ jobs:
--rc_number "${{ github.event.inputs.RC }}" \
--yes True
-echo "--Checking Hash Value for
apache-beam-${RELEASE}rc${RC_NUMBER}.tar.gz-"
-sha512sum -c "apache-beam-${RELEASE}rc${RC_NUMBER}.tar.gz.sha512"
+cd "${PYTHON_ARTIFACTS_DIR}"
+ls
+
+echo "--Checking Hash Value for apache-beam-${RELEASE}rc${{
github.event.inputs.RC }}.tar.gz-"
+sha512sum -c "apache-beam-${RELEASE}rc${{ github.event.inputs.RC
}}.tar.gz.sha512"
for artifact in *.whl; do
echo "--Checking Hash Value for ${artifact} wheel---"
(beam) branch users/damccorm/pypi deleted (was 67f770935fd)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/pypi in repository https://gitbox.apache.org/repos/asf/beam.git was 67f770935fd Use RC number from inputs The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam-site) branch updates_release_2.52.0 created (now 0139644c68)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch updates_release_2.52.0 in repository https://gitbox.apache.org/repos/asf/beam-site.git at 0139644c68 Update beam-site for release 2.52.0. No new revisions were added by this update.
(beam) branch nightly-refs/heads/master updated (e6120602171 -> f3636f32b3f)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from e6120602171 Fix staging java source/python source (#29299)
add 34b93c0d10d Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 in /sdks
(#29308)
add 7fe906497db [BigQueryIO] Upserts work with CREATE_IF_NEEDED -- doc
only PR (#29276)
add cbd756770d2 Update dev container tags. (#29311)
add aa890ea5621 [RRIO] [Call] Implement PTransform without adaptive
throttling (#29144)
add 827afb9f3b7 Revert "Support DatabaseID in Datastore beam connector
(#27987)" (#29317)
add 9acf947780e [prism] Add fusion. (#29306)
add f619affcf70 Add action to publish RC to PyPi (#29316)
add 3e790032b7d Bump golang.org/x/sys from 0.13.0 to 0.14.0 in /sdks
(#29309)
add c8e7bde45d9 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#29288)
add ad287193c1e [#29210] Fix SDF progress fraction to not return NaN
(#29307)
add cf560ca2f70 [Go SDK]: Create natsio.Write transform for writing to
NATS (#29184)
add 29c0b41afec [RRIO] [testing] Downgrade mock-apis grpcio-tools
dependencies to remove Beam SDK version conflict (#29320)
add f3636f32b3f A couple small fixes to the pypi deploy action (#29321)
No new revisions were added by this update.
Summary of changes:
.../workflows/deploy_release_candidate_pypi.yaml | 89
.test-infra/mock-apis/poetry.lock | 19 +-
.test-infra/mock-apis/pyproject.toml | 6 +-
build.gradle.kts | 3 +
sdks/go.mod| 15 +-
sdks/go.sum| 32 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 11 +-
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 117 +++--
.../provision.go => pkg/beam/io/natsio/common.go} | 56 +--
.../go/pkg/beam/io/natsio/example_test.go | 40 +-
sdks/go/pkg/beam/io/natsio/helper_test.go | 130 +
sdks/go/pkg/beam/io/natsio/write.go| 114 +
.../go/pkg/beam/io/natsio/write_option.go | 26 +-
sdks/go/pkg/beam/io/natsio/write_test.go | 252 ++
sdks/go/pkg/beam/runners/direct/direct_test.go | 98
sdks/go/pkg/beam/runners/prism/README.md | 3 +-
sdks/go/pkg/beam/runners/prism/internal/execute.go | 6 -
.../beam/runners/prism/internal/execute_test.go| 105 +++-
.../beam/runners/prism/internal/handlecombine.go | 17 +-
.../pkg/beam/runners/prism/internal/handlepardo.go | 37 +-
.../beam/runners/prism/internal/handlerunner.go| 61 ++-
.../pkg/beam/runners/prism/internal/preprocess.go | 526 ++---
.../beam/runners/prism/internal/preprocess_test.go | 78 +--
.../beam/runners/prism/internal/separate_test.go | 3 +-
sdks/go/pkg/beam/runners/prism/internal/stage.go | 44 +-
.../runners/prism/internal/unimplemented_test.go | 1 -
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 25 +-
.../beam/sdk/io/gcp/datastore/DatastoreV1.java | 349 ++
.../beam/sdk/io/gcp/datastore/DatastoreV1Test.java | 94 +---
.../beam/sdk/io/gcp/datastore/SplitQueryFnIT.java | 17 +-
.../apache/beam/sdk/io/gcp/datastore/V1ReadIT.java | 26 +-
.../beam/sdk/io/gcp/datastore/V1TestUtil.java | 59 +--
.../beam/sdk/io/gcp/datastore/V1WriteIT.java | 11 +-
sdks/java/io/rrio/build.gradle | 2 +
.../apache/beam/io/requestresponse/ApiIOError.java | 36 +-
.../org/apache/beam/io/requestresponse/Call.java | 337 -
.../apache/beam/io/requestresponse/CallTest.java | 493 +++
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
38 files changed, 2476 insertions(+), 864 deletions(-)
create mode 100644 .github/workflows/deploy_release_candidate_pypi.yaml
copy sdks/go/{cmd/beamctl/cmd/provision.go => pkg/beam/io/natsio/common.go}
(55%)
copy learning/katas/go/common_transforms/aggregation/max/cmd/main.go =>
sdks/go/pkg/beam/io/natsio/example_test.go (59%)
create mode 100644 sdks/go/pkg/beam/io/natsio/helper_test.go
create mode 100644 sdks/go/pkg/beam/io/natsio/write.go
copy playground/backend/playground_functions/func_enviornment.go =>
sdks/go/pkg/beam/io/natsio/write_option.go (66%)
create mode 100644 sdks/go/pkg/beam/io/natsio/write_test.go
create mode 100644
sdks/java/io/rrio/src/test/java/org/apache/beam/io/requestresponse/CallTest.java
(beam) branch dependabot/gradle/com.github.spotbugs.snom-spotbugs-gradle-plugin-5.2.1 deleted (was c3efbf2a1dc)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.github.spotbugs.snom-spotbugs-gradle-plugin-5.2.1 in repository https://gitbox.apache.org/repos/asf/beam.git was c3efbf2a1dc Bump com.github.spotbugs.snom:spotbugs-gradle-plugin The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/gradle/com.github.spotbugs.snom-spotbugs-gradle-plugin-5.2.3 created (now 99bb3a11e96)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/gradle/com.github.spotbugs.snom-spotbugs-gradle-plugin-5.2.3 in repository https://gitbox.apache.org/repos/asf/beam.git at 99bb3a11e96 Bump com.github.spotbugs.snom:spotbugs-gradle-plugin No new revisions were added by this update.
(beam) branch dependabot/go_modules/sdks/golang.org/x/text-0.14.0 created (now bf616a198f1)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/golang.org/x/text-0.14.0 in repository https://gitbox.apache.org/repos/asf/beam.git at bf616a198f1 Bump golang.org/x/text from 0.13.0 to 0.14.0 in /sdks No new revisions were added by this update.
(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/config-1.22.1 created (now 5c802bbb85d)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/config-1.22.1 in repository https://gitbox.apache.org/repos/asf/beam.git at 5c802bbb85d Bump github.com/aws/aws-sdk-go-v2/config from 1.22.0 to 1.22.1 in /sdks No new revisions were added by this update.
(beam) branch dependabot/go_modules/sdks/google.golang.org/api-0.150.0 created (now 5950ba466cd)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/google.golang.org/api-0.150.0 in repository https://gitbox.apache.org/repos/asf/beam.git at 5950ba466cd Bump google.golang.org/api from 0.149.0 to 0.150.0 in /sdks No new revisions were added by this update.
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 742173d67d0 Updating config from bot
742173d67d0 is described below
commit 742173d67d0685a0704369aa17db9670af3c7eea
Author: github-actions
AuthorDate: Tue Nov 7 05:34:43 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29323.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29323.json
b/scripts/ci/pr-bot/state/pr-state/pr-29323.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29323.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new c5323a7c318 Updating config from bot
c5323a7c318 is described below
commit c5323a7c318569331df001272e9d4a00dbff4e36
Author: github-actions
AuthorDate: Tue Nov 7 07:05:58 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29326.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29326.json
b/scripts/ci/pr-bot/state/pr-state/pr-29326.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29326.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new a053ad71f2c Updating config from bot
a053ad71f2c is described below
commit a053ad71f2c7fdca3862212324d2c33859dd43f6
Author: github-actions
AuthorDate: Tue Nov 7 07:06:01 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29325.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29325.json
b/scripts/ci/pr-bot/state/pr-state/pr-29325.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29325.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 250fa145845 Updating config from bot
250fa145845 is described below
commit 250fa1458454465bdada496fb7901f57803f3b0f
Author: github-actions
AuthorDate: Tue Nov 7 07:06:09 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29322.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29322.json
b/scripts/ci/pr-bot/state/pr-state/pr-29322.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29322.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 426fd2f6407 Updating config from bot
426fd2f6407 is described below
commit 426fd2f64075f77b497b1e87067ad3541752c5b0
Author: github-actions
AuthorDate: Tue Nov 7 07:06:04 2023 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29324.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29324.json
b/scripts/ci/pr-bot/state/pr-state/pr-29324.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29324.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
