Re: [PR] add interfaces for direct path, and StreamingEngineClient [beam]

2023-11-07 Thread via GitHub
m-trieu commented on code in PR #28835: URL: https://github.com/apache/beam/pull/28835#discussion_r1386146766 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/work/budget/EvenGetWorkBudgetDistributor.java: ## @@ -0,0 +1,

Re: [PR] add interfaces for direct path, and StreamingEngineClient [beam]

2023-11-07 Thread via GitHub
m-trieu commented on code in PR #28835: URL: https://github.com/apache/beam/pull/28835#discussion_r1386146041 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/work/budget/EvenGetWorkBudgetDistributor.java: ## @@ -0,0 +1,

Re: [PR] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager from 1.13.1 to 1.13.3 in /sdks [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29342: URL: https://github.com/apache/beam/pull/29342#issuecomment-1801240888 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in /sdks [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29343: URL: https://github.com/apache/beam/pull/29343#issuecomment-1801240844 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Bump github.com/aws/aws-sdk-go-v2/config from 1.22.0 to 1.22.2 in /sdks [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29344: URL: https://github.com/apache/beam/pull/29344#issuecomment-1801240803 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [I] Add Apache Iceberg IO connector [beam]

2023-11-07 Thread via GitHub
gabrywu commented on issue #20327: URL: https://github.com/apache/beam/issues/20327#issuecomment-1801163220 we use iceberg low-level API adding data files directly -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[PR] Bump github.com/aws/aws-sdk-go-v2/config from 1.22.0 to 1.22.2 in /sdks [beam]

2023-11-07 Thread via GitHub
dependabot[bot] opened a new pull request, #29344: URL: https://github.com/apache/beam/pull/29344 Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.22.0 to 1.22.2. Commits https://github.com/aws/aws-sdk-go-v2/commit/3674c3886336f797ad40b1

Re: [PR] Bump github.com/aws/aws-sdk-go-v2/config from 1.22.0 to 1.22.1 in /sdks [beam]

2023-11-07 Thread via GitHub
dependabot[bot] closed pull request #29325: Bump github.com/aws/aws-sdk-go-v2/config from 1.22.0 to 1.22.1 in /sdks URL: https://github.com/apache/beam/pull/29325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] Bump github.com/aws/aws-sdk-go-v2/config from 1.22.0 to 1.22.1 in /sdks [beam]

2023-11-07 Thread via GitHub
dependabot[bot] commented on PR #29325: URL: https://github.com/apache/beam/pull/29325#issuecomment-1801095594 Superseded by #29344. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[PR] Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.0 in /sdks [beam]

2023-11-07 Thread via GitHub
dependabot[bot] opened a new pull request, #29343: URL: https://github.com/apache/beam/pull/29343 Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 1.12.1 to 1.13.0. Commits https://github.com/mongodb/mongo-go-driver/commit/01cc2a267a0e5916c3

[PR] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager from 1.13.1 to 1.13.3 in /sdks [beam]

2023-11-07 Thread via GitHub
dependabot[bot] opened a new pull request, #29342: URL: https://github.com/apache/beam/pull/29342 Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.13.1 to 1.13.3. Commits https://github.com/aws/aws-sdk-go-v2/commit/3d809f443e

Re: [PR] Use distroless to build the python container [beam]

2023-11-07 Thread via GitHub
tvalentyn commented on PR #29001: URL: https://github.com/apache/beam/pull/29001#issuecomment-1800949152 Run Python PostCommit Arm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] Use distroless to build the python container [beam]

2023-11-07 Thread via GitHub
tvalentyn commented on PR #29001: URL: https://github.com/apache/beam/pull/29001#issuecomment-1800949121 Regular postcommits wouldn't pick up these changes. ARM postcommits should -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] Use distroless to build the python container [beam]

2023-11-07 Thread via GitHub
tvalentyn commented on PR #29001: URL: https://github.com/apache/beam/pull/29001#issuecomment-1800947121 I am not sure why ARM suite is not showing up, it's on github actions, I thought only Jenkins had issues -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Use distroless to build the python container [beam]

2023-11-07 Thread via GitHub
tvalentyn commented on PR #29001: URL: https://github.com/apache/beam/pull/29001#issuecomment-1800947385 Run Python ValidatesContainer Dataflow ARM 3.8 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] Use distroless to build the python container [beam]

2023-11-07 Thread via GitHub
tvalentyn commented on PR #29001: URL: https://github.com/apache/beam/pull/29001#issuecomment-1800947767 Run Python 3.8 Postcommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] Use distroless to build the python container [beam]

2023-11-07 Thread via GitHub
tvalentyn commented on PR #29001: URL: https://github.com/apache/beam/pull/29001#issuecomment-1800947432 Run Python ValidatesContainer Dataflow ARM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Use distroless to build the python container [beam]

2023-11-07 Thread via GitHub
tvalentyn commented on PR #29001: URL: https://github.com/apache/beam/pull/29001#issuecomment-1800946876 I can find test results - could you paste a link for container test suites please after we iron out any remaining issues with test infra? -- This is an automated message from the Apach

Re: [PR] Use distroless to build the python container [beam]

2023-11-07 Thread via GitHub
tvalentyn commented on code in PR #29001: URL: https://github.com/apache/beam/pull/29001#discussion_r1385911064 ## sdks/python/container/Dockerfile: ## @@ -82,6 +78,32 @@ RUN \ # Remove pip cache. rm -rf /root/.cache/pip +FROM gcr.io/distroless/cc-debian12 as beam +

Re: [PR] Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes [beam]

2023-11-07 Thread via GitHub
talatuyarer commented on code in PR #29305: URL: https://github.com/apache/beam/pull/29305#discussion_r1385886517 ## website/www/site/content/en/blog/apache-beam-flink-and-kubernetes.md: ## @@ -0,0 +1,355 @@ +--- +title: "How to Build a Scalable Self-Managed Streaming Infrastru

Re: [PR] Fix small typo on get_table_schema_from_string [beam]

2023-11-07 Thread via GitHub
Abacn merged PR #29340: URL: https://github.com/apache/beam/pull/29340 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] Fix small typo on get_table_schema_from_string [beam]

2023-11-07 Thread via GitHub
Abacn commented on PR #29340: URL: https://github.com/apache/beam/pull/29340#issuecomment-1800844939 PreCommit Python Docker currently permared not related to this PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] [Bug]: Multiarch sdk container creation time at epoch causing cleaner agressively delete them [beam]

2023-11-07 Thread via GitHub
Abacn commented on issue #29341: URL: https://github.com/apache/beam/issues/29341#issuecomment-1800822991 Also, go container is always build in multiarch, which is not necessary. This can cause both non-arm and arm test failing. -- This is an automated message from the Apache Git Service.

Re: [I] [Bug]: Multiarch sdk container creation time at epoch causing cleaner agressively delete them [beam]

2023-11-07 Thread via GitHub
hours ago | Not supported |   |   fa0191e6b4fb |   | 213.6 MB | 2 hours ago | 2 hours ago | 26 |   |   89124f3fe410 |   | 208 MB | 2 hours ago | 2 hours ago | 26 |   |   b1f9dc6e8656 | 20231107-211804995803113 | — | Dec 31, 1969 | 3 hours ago | — |   |   06e7bb78989b |   | 1.2 KB | Dec

[I] [Bug]: Multiarch sdk container creation time at epoch causing cleaner agressively delete them [beam]

2023-11-07 Thread via GitHub
Abacn opened a new issue, #29341: URL: https://github.com/apache/beam/issues/29341 ### What happened? and causing ongoing postcommits failure every day around 5 PM (PDT). From the log of https://github.com/apache/beam/actions/runs/6778016000 one can see ``` Digests: -

Re: [I] [Bug]: TextIO read record twice for large delimited files [beam]

2023-11-07 Thread via GitHub
vatanrathi commented on issue #29146: URL: https://github.com/apache/beam/issues/29146#issuecomment-1800684328 I cant share file as it has company sensitive data. I feel this is related to aws2 sdk.. -- This is an automated message from the Apache Git Service. To respond to the message

Re: [I] [Bug][prism]: Support receiving Java's CoGBKList Result [beam]

2023-11-07 Thread via GitHub
lostluck commented on issue #28544: URL: https://github.com/apache/beam/issues/28544#issuecomment-1800442389 cc: @robertwb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] revert network name [beam]

2023-11-07 Thread via GitHub
damccorm merged PR #29337: URL: https://github.com/apache/beam/pull/29337 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Fix small typo on get_table_schema_from_string [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29340: URL: https://github.com/apache/beam/pull/29340#issuecomment-1800343118 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] revert network name [beam]

2023-11-07 Thread via GitHub
Abacn commented on PR #29337: URL: https://github.com/apache/beam/pull/29337#issuecomment-1800272734 Python Docker PreCommit is currently permared due to a regression from a go dependency (dl). Not related for this PR ``` go: downloading golang.org/dl v0.0.0-20231107201224-8165dcd9

Re: [PR] Remove push trigger for non-precommit workflows [beam]

2023-11-07 Thread via GitHub
Abacn merged PR #29339: URL: https://github.com/apache/beam/pull/29339 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] Test sink name [beam]

2023-11-07 Thread via GitHub
y1chi commented on code in PR #29230: URL: https://github.com/apache/beam/pull/29230#discussion_r1385612930 ## runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/DataflowPipelineTranslatorTest.java: ## @@ -229,6 +237,115 @@ private static DataflowP

Re: [PR] Test sink name [beam]

2023-11-07 Thread via GitHub
Naireen commented on code in PR #29230: URL: https://github.com/apache/beam/pull/29230#discussion_r1385604813 ## runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/DataflowPipelineTranslatorTest.java: ## @@ -229,6 +238,126 @@ private static Dataflo

Re: [PR] Test sink name [beam]

2023-11-07 Thread via GitHub
Naireen commented on code in PR #29230: URL: https://github.com/apache/beam/pull/29230#discussion_r1385604087 ## runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/DataflowPipelineTranslatorTest.java: ## @@ -229,6 +238,126 @@ private static Dataflo

Re: [PR] Test sink name [beam]

2023-11-07 Thread via GitHub
Naireen commented on code in PR #29230: URL: https://github.com/apache/beam/pull/29230#discussion_r1385603743 ## runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/DataflowPipelineTranslatorTest.java: ## @@ -229,6 +238,126 @@ private static Dataflo

Re: [PR] Test sink name [beam]

2023-11-07 Thread via GitHub
Naireen commented on code in PR #29230: URL: https://github.com/apache/beam/pull/29230#discussion_r1385605168 ## runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/DataflowPipelineTranslatorTest.java: ## @@ -229,6 +238,126 @@ private static Dataflo

Re: [PR] [RRIO] [Test] Create test Caller and SetupTeardown [beam]

2023-11-07 Thread via GitHub
damondouglas merged PR #29262: URL: https://github.com/apache/beam/pull/29262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.ap

Re: [I] [Task]: [RRIO] [Test] Create test Caller and SetupTeardown interface implementations [beam]

2023-11-07 Thread via GitHub
damondouglas closed issue #28710: [Task]: [RRIO] [Test] Create test Caller and SetupTeardown interface implementations URL: https://github.com/apache/beam/issues/28710 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[PR] Fix small typo on get_table_schema_from_string [beam]

2023-11-07 Thread via GitHub
lazarillo opened a new pull request, #29340: URL: https://github.com/apache/beam/pull/29340 Just fixing a tiny typo in the docstring on the get_table_schema_from_string method Thank you for your contribution! Follow this checklist to help us incorporate yo

Re: [PR] Remove push trigger for non-precommit workflows [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29339: URL: https://github.com/apache/beam/pull/29339#issuecomment-1800095454 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] Remove push trigger for non-precommit workflows [beam]

2023-11-07 Thread via GitHub
Abacn commented on PR #29339: URL: https://github.com/apache/beam/pull/29339#issuecomment-1800090955 R: @damccorm @volatilemolotov -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[PR] Remove push trigger for non-precommit workflows [beam]

2023-11-07 Thread via GitHub
Abacn opened a new pull request, #29339: URL: https://github.com/apache/beam/pull/29339 Part of the effort of reducing the concurrent Dataflow jobs in precommit stage to reasonable level Found that several postcommit jobs have "Push" trigger, while most does not. This PR then removes

Re: [PR] Install cbt cli for cleanup gcp resource [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29335: URL: https://github.com/apache/beam/pull/29335#issuecomment-1800040949 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] Install cbt cli for cleanup gcp resource [beam]

2023-11-07 Thread via GitHub
Abacn commented on PR #29335: URL: https://github.com/apache/beam/pull/29335#issuecomment-1800036778 R: @ahmedabu98 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] Install cbt cli for cleanup gcp resource [beam]

2023-11-07 Thread via GitHub
Abacn commented on PR #29335: URL: https://github.com/apache/beam/pull/29335#issuecomment-1800035309 example run: https://github.com/apache/beam/actions/runs/6789866882/job/18458117003 task :beam-test-tools:removeStaleK8sWorkload now runs normally -- This is an automated message fr

Re: [PR] revert network name [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29337: URL: https://github.com/apache/beam/pull/29337#issuecomment-1799913608 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes [beam]

2023-11-07 Thread via GitHub
talatuyarer commented on code in PR #29305: URL: https://github.com/apache/beam/pull/29305#discussion_r1385508822 ## website/www/site/content/en/blog/apache-beam-flink-and-kubernetes.md: ## @@ -0,0 +1,355 @@ +--- +title: "How to Build a Scalable Self-Managed Streaming Infrastru

Re: [I] [Bug]: BigQuery IO Batch load using File_load causing the same job id ignoring inserts as the job_id is already completed [beam]

2023-11-07 Thread via GitHub
yeshvantbhavnasi commented on issue #28219: URL: https://github.com/apache/beam/issues/28219#issuecomment-1799811902 Hey @kennknowles can we point to reshuffle implementation codebase ? if we can try rollout our own version of beam after the fix and see if it works on GCP dataflow with batc

Re: [I] [Task]: Upgrade mongodb-java-driver up to 4.7 [beam]

2023-11-07 Thread via GitHub
edgarRSV4 closed issue #29328: [Task]: Upgrade mongodb-java-driver up to 4.7 URL: https://github.com/apache/beam/issues/29328 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] revert network name [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29337: URL: https://github.com/apache/beam/pull/29337#issuecomment-1799801046 Will wait for checks to pass to merge (GHA should be picked up eventually...) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] revert network name [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29337: URL: https://github.com/apache/beam/pull/29337#issuecomment-1799801307 Will wait for checks to pass to merge (GHA should be picked up eventually...) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] revert network name [beam]

2023-11-07 Thread via GitHub
volatilemolotov commented on PR #29337: URL: https://github.com/apache/beam/pull/29337#issuecomment-1799796312 R: @damccorm small commit just to fix a mistake that i had in https://github.com/apache/beam/pull/29334 -- This is an automated message from the Apache Git Service. To respond to

[PR] revert network name [beam]

2023-11-07 Thread via GitHub
volatilemolotov opened a new pull request, #29337: URL: https://github.com/apache/beam/pull/29337 Just change network name in docker-compose to be consistent with the intetion Thank you for your contribution! Follow this checklist to help us incorporate

Re: [PR] Bump @babel/traverse from 7.10.5 to 7.23.2 in /sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel [beam]

2023-11-07 Thread via GitHub
dependabot[bot] commented on PR #29018: URL: https://github.com/apache/beam/pull/29018#issuecomment-1799788904 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Bump @babel/traverse from 7.10.5 to 7.23.2 in /sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel [beam]

2023-11-07 Thread via GitHub
damccorm closed pull request #29018: Bump @babel/traverse from 7.10.5 to 7.23.2 in /sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel URL: https://github.com/apache/beam/pull/29018 -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes [beam]

2023-11-07 Thread via GitHub
damondouglas commented on code in PR #29305: URL: https://github.com/apache/beam/pull/29305#discussion_r1385469043 ## website/www/site/content/en/blog/apache-beam-flink-and-kubernetes.md: ## @@ -0,0 +1,355 @@ +--- +title: "How to Build a Scalable Self-Managed Streaming Infrastr

Re: [I] [Failing Test]: PythonPostCommit is Perma-Red [beam]

2023-11-07 Thread via GitHub
damccorm commented on issue #29214: URL: https://github.com/apache/beam/issues/29214#issuecomment-1799763423 No worries, its actually a GitHub feature - https://docs.github.com/en/issues/tracking-your-work-with-issues/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-usin

Re: [I] [Failing Test]: PythonPostCommit is Perma-Red [beam]

2023-11-07 Thread via GitHub
volatilemolotov commented on issue #29214: URL: https://github.com/apache/beam/issues/29214#issuecomment-1799760456 I did not meant to autoclose its only a part. Sorry im not aware of mechanisms, worked on a lot of different systems :) -- This is an automated message from the Apache Git S

Re: [I] [Failing Test]: PythonPostCommit is Perma-Red [beam]

2023-11-07 Thread via GitHub
damccorm commented on issue #29214: URL: https://github.com/apache/beam/issues/29214#issuecomment-1799746254 @volatilemolotov I don't think you meant to auto-close this with the PR, is that right? If yes, we can reclose after a green signal anyways I guess -- This is an automated message

Re: [I] [Failing Test]: PythonPostCommit is Perma-Red [beam]

2023-11-07 Thread via GitHub
damccorm closed issue #29214: [Failing Test]: PythonPostCommit is Perma-Red URL: https://github.com/apache/beam/issues/29214 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] add mtu to docker comose files in python test suite [beam]

2023-11-07 Thread via GitHub
damccorm merged PR #29334: URL: https://github.com/apache/beam/pull/29334 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Delete Java11/17 Examples Dataflow PreCommit [beam]

2023-11-07 Thread via GitHub
Abacn merged PR #29336: URL: https://github.com/apache/beam/pull/29336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] Delete Java11/17 Examples Dataflow PreCommit [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29336: URL: https://github.com/apache/beam/pull/29336#issuecomment-1799653897 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] Bump google.golang.org/api from 0.149.0 to 0.150.0 in /sdks [beam]

2023-11-07 Thread via GitHub
jrmccluskey merged PR #29326: URL: https://github.com/apache/beam/pull/29326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] Bump golang.org/x/text from 0.13.0 to 0.14.0 in /sdks [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29324: URL: https://github.com/apache/beam/pull/29324#issuecomment-1799593601 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @riteshghorse for label go. Available commands: - `stop

Re: [PR] Bump google.golang.org/api from 0.149.0 to 0.150.0 in /sdks [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29326: URL: https://github.com/apache/beam/pull/29326#issuecomment-1799593150 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @jrmccluskey for label go. Available commands: - `stop r

Re: [PR] Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes [beam]

2023-11-07 Thread via GitHub
talatuyarer commented on PR #29305: URL: https://github.com/apache/beam/pull/29305#issuecomment-1799539013 > Consider my question non-blocking of the PR. Is the intent for the reader to follow this article to replicate in their own environment? Thank you reviewing @damccorm Our goal

Re: [PR] Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes [beam]

2023-11-07 Thread via GitHub
talatuyarer commented on code in PR #29305: URL: https://github.com/apache/beam/pull/29305#discussion_r1385402875 ## website/www/site/content/en/blog/apache-beam-flink-and-kubernetes.md: ## @@ -0,0 +1,355 @@ +--- +title: "How to Build a Scalable Self-Managed Streaming Infrastru

Re: [PR] Creating a Fully Managed Beam Streaming System with Flink Runner on Kubernetes [beam]

2023-11-07 Thread via GitHub
talatuyarer commented on code in PR #29305: URL: https://github.com/apache/beam/pull/29305#discussion_r1385402531 ## website/www/site/content/en/blog/apache-beam-flink-and-kubernetes.md: ## @@ -0,0 +1,355 @@ +--- +title: "How to Build a Scalable Self-Managed Streaming Infrastru

Re: [PR] Bump golang.org/x/sync from 0.4.0 to 0.5.0 in /sdks [beam]

2023-11-07 Thread via GitHub
lostluck merged PR #29310: URL: https://github.com/apache/beam/pull/29310 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [I] [Bug][prism]: Support receiving Java's CoGBKList Result [beam]

2023-11-07 Thread via GitHub
lostluck commented on issue #28544: URL: https://github.com/apache/beam/issues/28544#issuecomment-1799530207 Fusion was added in #29306 which is currently enabled by default. It's most likely that fusion will be enabled by default for xlang based pipelines anyway (if not for non-go pipeline

Re: [PR] add mtu to docker comose files in python test suite [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29334: URL: https://github.com/apache/beam/pull/29334#issuecomment-1799516667 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] Delete Java11/17 Examples Dataflow PreCommit [beam]

2023-11-07 Thread via GitHub
github-actions[bot] commented on PR #29336: URL: https://github.com/apache/beam/pull/29336#issuecomment-1799479142 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @chamikaramj added as fallback since no labels match configuration

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799387302 Run XVR_PythonUsingJavaSQL_Dataflow PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799386037 Run XVR_JavaUsingPython_Dataflow PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799385243 Run XVR_GoUsingJava_Dataflow PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799384320 Run XVR_Flink PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799383643 Run XVR_Direct PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799382751 Run ULR Loopback ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799381792 Run Twister2 ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799381101 Run TransformService_Direct PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799380081 Run Spark ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799379366 Run Spark ValidatesRunner Java 11 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799376931 Run Spark Runner Nexmark Tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799378590 Run Spark StructuredStreaming ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799377851 Run Spark Runner Tpcds Tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799375214 Run SQL PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799375930 Run Samza ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799374475 Run Python_Xlang_IO_Dataflow PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799373730 Run Python_Xlang_Gcp_Direct PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799372986 Run Python_Xlang_Gcp_Dataflow PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799372104 Run Python_Transforms PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799371236 Run Python_Runners PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799370139 Run Python_PVR_Flink PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799369178 Run Python_Integration PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799362134 Run Python_Coverage PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799366519 Run Python_Dataframes PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799368149 Run Python_Examples PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799359558 Run PythonDocker PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2023-11-07 Thread via GitHub
damccorm commented on PR #29319: URL: https://github.com/apache/beam/pull/29319#issuecomment-1799358726 Run Python Spark ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

  1   2   3   4   >