Re: [PR] Add ID to steps using gradlew command [beam]

2023-10-19 Thread via GitHub
magicgoody closed pull request #29073: Add ID to steps using gradlew command URL: https://github.com/apache/beam/pull/29073 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] Bump google.golang.org/api from 0.147.0 to 0.148.0 in /sdks [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29086: URL: https://github.com/apache/beam/pull/29086#issuecomment-1772088270 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @riteshghorse for label go. Available commands: - `stop

[PR] Bump google.golang.org/api from 0.147.0 to 0.148.0 in /sdks [beam]

2023-10-19 Thread via GitHub
dependabot[bot] opened a new pull request, #29086: URL: https://github.com/apache/beam/pull/29086 Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.147.0 to 0.148.0. Release notes Sourced from https://github.com/googleapis/google-api-go-clien

Re: [I] [Feature Request]: How checkStopReadingFn release resources gracefully [beam]

2023-10-19 Thread via GitHub
gabrywu commented on issue #29072: URL: https://github.com/apache/beam/issues/29072#issuecomment-1772001841 Hi, @Abacn can you help to give suggestions about this case? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Remove warning in dataframes io. [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29084: URL: https://github.com/apache/beam/pull/29084#issuecomment-1771965774 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @riteshghorse for label python. Available commands: - `s

Re: [PR] check for clientId representing a retry before activating and completing work [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29082: URL: https://github.com/apache/beam/pull/29082#issuecomment-1771932898 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn added as fallback since no labels match configuration

[I] [Bug]: Fix typos in HistogramData.java and HistogramDataTest.java [beam]

2023-10-19 Thread via GitHub
shunping-google opened a new issue, #29085: URL: https://github.com/apache/beam/issues/29085 ### What happened? The recent commit of HistogramData (https://github.com/apache/beam/commit/9aaf9c213e) has introduced a few typos to the code. (1) wiht -> with https://github.com/ap

Re: [PR] Remove warning in dataframes io. [beam]

2023-10-19 Thread via GitHub
codecov[bot] commented on PR #29084: URL: https://github.com/apache/beam/pull/29084#issuecomment-1771930833 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/29084?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

Re: [PR] [YAML] Improved pipeline schema definition. [beam]

2023-10-19 Thread via GitHub
codecov[bot] commented on PR #29083: URL: https://github.com/apache/beam/pull/29083#issuecomment-1771919441 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/29083?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

[PR] Remove warning in dataframes io. [beam]

2023-10-19 Thread via GitHub
robertwb opened a new pull request, #29084: URL: https://github.com/apache/beam/pull/29084 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in yo

Re: [PR] [YAML] Improved pipeline schema definition. [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29083: URL: https://github.com/apache/beam/pull/29083#issuecomment-1771903974 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] [YAML] Improved pipeline schema definition. [beam]

2023-10-19 Thread via GitHub
robertwb commented on PR #29083: URL: https://github.com/apache/beam/pull/29083#issuecomment-1771903038 R: @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[PR] [YAML] Improved pipeline schema definition. [beam]

2023-10-19 Thread via GitHub
robertwb opened a new pull request, #29083: URL: https://github.com/apache/beam/pull/29083 Slightly stricter definitions for catching more errors, as well as avoding the use of anyOf which often makes it difficult to deduce what the true error is. This does mean a pipeline must have

[PR] check for clientId representing a retry before activating and completing work [beam]

2023-10-19 Thread via GitHub
m-trieu opened a new pull request, #29082: URL: https://github.com/apache/beam/pull/29082 Instead of just checking a `Work`/`WorkItem`'s `workToken` to detect duplicates, also check the `cacheToken`. Change behavior of `ActiveWorkState#activateWork` to only return `ActivateWorkResult

Re: [I] [Failing Test]: GHA performance tests not publishing metrics [beam]

2023-10-19 Thread via GitHub
Abacn closed issue #28830: [Failing Test]: GHA performance tests not publishing metrics URL: https://github.com/apache/beam/issues/28830 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Add InfluxDB credentials [beam]

2023-10-19 Thread via GitHub
Abacn commented on PR #29071: URL: https://github.com/apache/beam/pull/29071#issuecomment-1771878466 addresses #28830 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[PR] [RRIO] create RedisClient utility [beam]

2023-10-19 Thread via GitHub
damondouglas opened a new pull request, #29081: URL: https://github.com/apache/beam/pull/29081 This PR addresses #28932, addresses #28924, addresses #28922 by creating a RedisClient utility. The value of this class over using the direct java Redis client is that it is Serializable and handl

Re: [PR] TImeout StreamingDataflowWorkerTest when test stuck [beam]

2023-10-19 Thread via GitHub
Abacn merged PR #29065: URL: https://github.com/apache/beam/pull/29065 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] TImeout StreamingDataflowWorkerTest when test stuck [beam]

2023-10-19 Thread via GitHub
edman124 commented on PR #29065: URL: https://github.com/apache/beam/pull/29065#issuecomment-1771781396 The notify could be called before we enter the synchronized block causing wait to wait indefinitely, this test should be fixed in https://github.com/apache/beam/pull/29041 LGTM as a te

Re: [PR] Report Outstanding Bundles and Bytes [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29041: URL: https://github.com/apache/beam/pull/29041#issuecomment-1771780826 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @AnandInguva added as fallback since no labels match configuration

Re: [PR] Report Outstanding Bundles and Bytes [beam]

2023-10-19 Thread via GitHub
edman124 commented on PR #29041: URL: https://github.com/apache/beam/pull/29041#issuecomment-1771779422 assign set of reviewers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] Report Outstanding Bundles and Bytes [beam]

2023-10-19 Thread via GitHub
edman124 commented on code in PR #29041: URL: https://github.com/apache/beam/pull/29041#discussion_r1366192536 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/StreamingDataflowWorker.java: ## @@ -1715,6 +1731,14 @@ private void

Re: [PR] Report Outstanding Bundles and Bytes [beam]

2023-10-19 Thread via GitHub
edman124 commented on PR #29041: URL: https://github.com/apache/beam/pull/29041#issuecomment-1771778253 ptal: @bvolpato -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Change level of initialization exception to error, make errors obvious [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29078: URL: https://github.com/apache/beam/pull/29078#issuecomment-1771769741 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Validate incoming JSON data from pubsub. [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29080: URL: https://github.com/apache/beam/pull/29080#issuecomment-1771769660 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @AnandInguva for label python. Available commands: - `st

Re: [PR] Make BeamKafkaTable.createKafkaRead to be protected [beam]

2023-10-19 Thread via GitHub
Abacn merged PR #29051: URL: https://github.com/apache/beam/pull/29051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] Report total active threads [beam]

2023-10-19 Thread via GitHub
Abacn commented on code in PR #28513: URL: https://github.com/apache/beam/pull/28513#discussion_r1366178028 ## runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/StreamingDataflowWorkerTest.java: ## @@ -2793,6 +2793,79 @@ public void

Re: [PR] Setup Java 21 container [beam]

2023-10-19 Thread via GitHub
Abacn commented on code in PR #28918: URL: https://github.com/apache/beam/pull/28918#discussion_r1366175999 ## sdks/java/testing/jpms-tests/build.gradle: ## @@ -120,7 +121,7 @@ plugins.withType(JavaPlugin).configureEach{ // JPMS requires JDK > 8 project.tasks.each { it.only

Re: [PR] Setup Java 21 container [beam]

2023-10-19 Thread via GitHub
Abacn commented on code in PR #28918: URL: https://github.com/apache/beam/pull/28918#discussion_r1366157216 ## sdks/java/testing/test-utils/src/test/java/org/apache/beam/sdk/testutils/jvmverification/JvmVerification.java: ## @@ -39,6 +40,7 @@ public class JvmVerification {

Re: [I] [Failing Test]: Python ARM PostCommit failing after #28385 [beam]

2023-10-19 Thread via GitHub
Abacn commented on issue #29076: URL: https://github.com/apache/beam/issues/29076#issuecomment-1771744155 @AnandInguva thanks, taking a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] [Task]: Update roadmap for Spark runner [beam]

2023-10-19 Thread via GitHub
rszper commented on issue #23801: URL: https://github.com/apache/beam/issues/23801#issuecomment-1771729420 I think this refers to this page: https://beam.apache.org/roadmap/spark-runner/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Validate incoming JSON data from pubsub. [beam]

2023-10-19 Thread via GitHub
codecov[bot] commented on PR #29080: URL: https://github.com/apache/beam/pull/29080#issuecomment-1771709041 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/29080?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

Re: [I] Remove command prompts from quickstart commands [beam]

2023-10-19 Thread via GitHub
damccorm closed issue #20948: Remove command prompts from quickstart commands URL: https://github.com/apache/beam/issues/20948 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] Remove command prompts from Go quickstart commands [beam]

2023-10-19 Thread via GitHub
damccorm merged PR #29079: URL: https://github.com/apache/beam/pull/29079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[PR] Validate incoming JSON data from pubsub. [beam]

2023-10-19 Thread via GitHub
robertwb opened a new pull request, #29080: URL: https://github.com/apache/beam/pull/29080 As well as good practice, not doing so may result in much more obscure errors (e.g. during encoding) downstream. Thank you for your contribution! Follow this chec

Re: [PR] Windowing Support for the DaskRunner [beam]

2023-10-19 Thread via GitHub
cisaacstern commented on PR #27618: URL: https://github.com/apache/beam/pull/27618#issuecomment-1771607417 In working on testing, I stumbled across the somewhat alarming fact that something in this PR is resulting in `assert_that` _**always passing**_, including when asked to evaluate plain

Re: [I] [Failing Test]: Python ARM PostCommit failing after #28385 [beam]

2023-10-19 Thread via GitHub
AnandInguva commented on issue #29076: URL: https://github.com/apache/beam/issues/29076#issuecomment-1771603694 cc: @Abacn @ahmedabu98 This is the failing test FAILED apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts - google.api_core.exceptions.

Re: [I] [Failing Test]: Python ARM PostCommit failing after #28385 [beam]

2023-10-19 Thread via GitHub
AnandInguva commented on issue #29076: URL: https://github.com/apache/beam/issues/29076#issuecomment-1771598363 https://github.com/apache/beam/actions/runs/6576849694 - that solves the permissions/IAM errors for bigquery tests but there are still some errors which needs investigation. --

Re: [I] [Website] Remove "They tried it out" block [beam]

2023-10-19 Thread via GitHub
rszper commented on issue #21078: URL: https://github.com/apache/beam/issues/21078#issuecomment-1771582909 This content doesn't seem to exist on the Beam homepage: https://beam.apache.org/ Maybe it's been removed? -- This is an automated message from the Apache Git Service. To resp

Re: [PR] Remove command prompts from Go quickstart commands [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29079: URL: https://github.com/apache/beam/pull/29079#issuecomment-1771579502 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] Remove command prompts from Go quickstart commands [beam]

2023-10-19 Thread via GitHub
rszper commented on PR #29079: URL: https://github.com/apache/beam/pull/29079#issuecomment-1771567061 R: @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] Remove command prompts from Go quickstart commands [beam]

2023-10-19 Thread via GitHub
rszper commented on PR #29079: URL: https://github.com/apache/beam/pull/29079#issuecomment-1771568195 .take-issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[PR] Remove command prompts from Go quickstart commands [beam]

2023-10-19 Thread via GitHub
rszper opened a new pull request, #29079: URL: https://github.com/apache/beam/pull/29079 Remove command prompts from Go quickstart commands Fixes #20948 Thank you for your contribution! Follow this checklist to help us incorporate your contribut

[PR] Change level of initialization exception to error, make errors obvious [beam]

2023-10-19 Thread via GitHub
bvolpato opened a new pull request, #29078: URL: https://github.com/apache/beam/pull/29078 Exceptions in JvmInitializers were being printed in the STDOUT by the FnHarness, so handled/displayed on Dataflow as an info log: https://github.com/apache/beam/assets/3207647/ae9f2490-9d4b-483c

Re: [PR] Report total active threads [beam]

2023-10-19 Thread via GitHub
edman124 commented on code in PR #28513: URL: https://github.com/apache/beam/pull/28513#discussion_r1365957340 ## runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/StreamingDataflowWorkerTest.java: ## @@ -2793,6 +2793,79 @@ public vo

Re: [PR] Report total active threads [beam]

2023-10-19 Thread via GitHub
edman124 commented on code in PR #28513: URL: https://github.com/apache/beam/pull/28513#discussion_r1365957340 ## runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/StreamingDataflowWorkerTest.java: ## @@ -2793,6 +2793,79 @@ public vo

Re: [PR] Fix Reshuffle implementation in Java SDK [beam]

2023-10-19 Thread via GitHub
kennknowles commented on PR #28853: URL: https://github.com/apache/beam/pull/28853#issuecomment-1771507310 run java precommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Fix Reshuffle implementation in Java SDK [beam]

2023-10-19 Thread via GitHub
kennknowles commented on PR #28853: URL: https://github.com/apache/beam/pull/28853#issuecomment-1771507155 https://ge.apache.org/s/s6jldnngfhe32/tests/overview?outcome=FAILED#:runners:java-fn-execution:test-5-org.apache.beam.runners.fnexecution.control.remoteexecutiontest-11-testbundleproces

Re: [PR] Refactor StateFetcher [beam]

2023-10-19 Thread via GitHub
m-trieu commented on code in PR #28755: URL: https://github.com/apache/beam/pull/28755#discussion_r1365885297 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/streaming/sideinput/SideInput.java: ## @@ -0,0 +1,43 @@ +/* + * Licens

Re: [PR] Refactor StateFetcher [beam]

2023-10-19 Thread via GitHub
m-trieu commented on code in PR #28755: URL: https://github.com/apache/beam/pull/28755#discussion_r1365884640 ## runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/streaming/sideinput/SideInputStateFetcherTest.java: ## @@ -312,9 +349,

Re: [PR] Refactor StateFetcher [beam]

2023-10-19 Thread via GitHub
m-trieu commented on PR #28755: URL: https://github.com/apache/beam/pull/28755#issuecomment-1771412570 > looks like you need to rebase as well, merge conflict done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] Setup Java 21 container [beam]

2023-10-19 Thread via GitHub
damccorm commented on code in PR #28918: URL: https://github.com/apache/beam/pull/28918#discussion_r1365879939 ## sdks/java/testing/test-utils/src/test/java/org/apache/beam/sdk/testutils/jvmverification/JvmVerification.java: ## @@ -39,6 +40,7 @@ public class JvmVerification {

Re: [PR] Refactor StateFetcher [beam]

2023-10-19 Thread via GitHub
scwhittle commented on code in PR #28755: URL: https://github.com/apache/beam/pull/28755#discussion_r1365860715 ## runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/streaming/sideinput/SideInputStateFetcherTest.java: ## @@ -312,9 +34

Re: [PR] [YAML] Add optional output type parameter to mappings. [beam]

2023-10-19 Thread via GitHub
codecov[bot] commented on PR #29077: URL: https://github.com/apache/beam/pull/29077#issuecomment-1771377899 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/29077?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

Re: [PR] [YAML] Add optional output type parameter to mappings. [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #29077: URL: https://github.com/apache/beam/pull/29077#issuecomment-1771348075 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] [YAML] Add optional output type parameter to mappings. [beam]

2023-10-19 Thread via GitHub
robertwb commented on PR #29077: URL: https://github.com/apache/beam/pull/29077#issuecomment-1771345992 R: @Polber -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[PR] [YAML] Add optional output type parameter to mappings. [beam]

2023-10-19 Thread via GitHub
robertwb opened a new pull request, #29077: URL: https://github.com/apache/beam/pull/29077 This can be useful when inference is insufficient for Python/Javascript. Thank you for your contribution! Follow this checklist to help us incorporate your contr

Re: [PR] Report total active threads [beam]

2023-10-19 Thread via GitHub
Abacn commented on code in PR #28513: URL: https://github.com/apache/beam/pull/28513#discussion_r1365793238 ## runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/StreamingDataflowWorkerTest.java: ## @@ -2793,6 +2793,79 @@ public void

Re: [PR] TImeout StreamingDataflowWorkerTest when test stuck [beam]

2023-10-19 Thread via GitHub
Abacn commented on PR #29065: URL: https://github.com/apache/beam/pull/29065#issuecomment-1771289164 R: @edman124 @bvolpato this test was recently added in #28513 . Besides adding a timeout, any chance to know why it could stuck indefinitely? -- This is an automated message from t

Re: [PR] Bump apache-beam from 2.46.0 to 2.51.0 [beam-starter-python]

2023-10-19 Thread via GitHub
dependabot[bot] closed pull request #24: Bump apache-beam from 2.46.0 to 2.51.0 URL: https://github.com/apache/beam-starter-python/pull/24 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Bump apache-beam from 2.46.0 to 2.51.0 [beam-starter-python]

2023-10-19 Thread via GitHub
dependabot[bot] commented on PR #24: URL: https://github.com/apache/beam-starter-python/pull/24#issuecomment-1771281138 Looks like apache-beam is up-to-date now, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] Bump beam to 2.51.0 [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm commented on PR #21: URL: https://github.com/apache/beam-starter-python/pull/21#issuecomment-1771279523 Ended up bundling this into https://github.com/apache/beam-starter-python/pull/23 so we can close here -- This is an automated message from the Apache Git Service. To respond

Re: [PR] Bump beam to 2.51.0 [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm closed pull request #21: Bump beam to 2.51.0 URL: https://github.com/apache/beam-starter-python/pull/21 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Update python versions to current supported versions [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm merged PR #23: URL: https://github.com/apache/beam-starter-python/pull/23 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@be

Re: [PR] Bump actions/checkout from 3 to 4 [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm merged PR #25: URL: https://github.com/apache/beam-starter-python/pull/25 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@be

Re: [PR] Move Java Google BOM to best effort post-release task [beam]

2023-10-19 Thread via GitHub
damccorm merged PR #29062: URL: https://github.com/apache/beam/pull/29062 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[PR] Bump apache-beam from 2.46.0 to 2.51.0 [beam-starter-python]

2023-10-19 Thread via GitHub
dependabot[bot] opened a new pull request, #24: URL: https://github.com/apache/beam-starter-python/pull/24 Bumps [apache-beam](https://github.com/apache/beam) from 2.46.0 to 2.51.0. Release notes Sourced from https://github.com/apache/beam/releases";>apache-beam's releases.

Re: [PR] Update reviewers to match beam python reviewers [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm merged PR #22: URL: https://github.com/apache/beam-starter-python/pull/22 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@be

[PR] Bump actions/checkout from 3 to 4 [beam-starter-python]

2023-10-19 Thread via GitHub
dependabot[bot] opened a new pull request, #25: URL: https://github.com/apache/beam-starter-python/pull/25 Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4. Release notes Sourced from https://github.com/actions/checkout/releases";>actions/checkout's release

Re: [PR] Bump apache-beam from 2.46.0 to 2.49.0 [beam-starter-python]

2023-10-19 Thread via GitHub
dependabot[bot] commented on PR #20: URL: https://github.com/apache/beam-starter-python/pull/20#issuecomment-1771267951 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor ver

Re: [PR] Bump apache-beam from 2.46.0 to 2.49.0 [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm closed pull request #20: Bump apache-beam from 2.46.0 to 2.49.0 URL: https://github.com/apache/beam-starter-python/pull/20 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] Update python versions to current supported versions [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm commented on PR #23: URL: https://github.com/apache/beam-starter-python/pull/23#issuecomment-1771264219 > Is 3.11 not yet supported in 2.46.0 ? Yeah, I'm kinda inclined to merge anyways since that will be fixed by https://github.com/apache/beam-starter-python/pull/21 -- T

Re: [PR] Update python versions to current supported versions [beam-starter-python]

2023-10-19 Thread via GitHub
kennknowles commented on PR #23: URL: https://github.com/apache/beam-starter-python/pull/23#issuecomment-1771261454 Is 3.11 not yet supported in 2.46.0 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] Bump beam to 2.51.0 [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm commented on PR #21: URL: https://github.com/apache/beam-starter-python/pull/21#issuecomment-1771253838 CI breakages caused fixed https://github.com/apache/beam-starter-python/pull/23 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] Update reviewers to match beam python reviewers [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm commented on PR #22: URL: https://github.com/apache/beam-starter-python/pull/22#issuecomment-1771261137 R: @kennknowles @AnandInguva @jrmccluskey @riteshghorse @tvalentyn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] Fix Reshuffle implementation in Java SDK [beam]

2023-10-19 Thread via GitHub
kennknowles commented on PR #28853: URL: https://github.com/apache/beam/pull/28853#issuecomment-1771253497 run java precommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] Update python versions to current supported versions [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm opened a new pull request, #23: URL: https://github.com/apache/beam-starter-python/pull/23 3.7 is no longer supported Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: -

Re: [PR] Fix Reshuffle implementation in Java SDK [beam]

2023-10-19 Thread via GitHub
kennknowles commented on PR #28853: URL: https://github.com/apache/beam/pull/28853#issuecomment-1771256439 I get the impression this somehow actually slows things down. Everything looks like a timeout. Or perhaps it just invalidates too much of the Gradle cache? -- This is an automated m

[PR] Remove ryan from reviewers [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm opened a new pull request, #22: URL: https://github.com/apache/beam-starter-python/pull/22 Reviewers have to be committers according to https://github.com/apache/beam-starter-python/pull/20#issuecomment-1638057249 Thank you for your contributio

Re: [PR] Remove Avro-related code from Java SDK "core" module [beam]

2023-10-19 Thread via GitHub
kennknowles commented on PR #27851: URL: https://github.com/apache/beam/pull/27851#issuecomment-1771242359 🎉 🎉 🎉 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] Bump apache-beam from 2.46.0 to 2.49.0 [beam-starter-python]

2023-10-19 Thread via GitHub
damccorm commented on PR #20: URL: https://github.com/apache/beam-starter-python/pull/20#issuecomment-1771242441 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] Bump apache-beam from 2.46.0 to 2.49.0 [beam-starter-python]

2023-10-19 Thread via GitHub
dependabot[bot] commented on PR #20: URL: https://github.com/apache/beam-starter-python/pull/20#issuecomment-1771242528 Looks like this PR is already up-to-date with main! If you'd still like to recreate it from scratch, overwriting any edits, you can request `@dependabot recreate`. --

Re: [I] [Failing Test]: Python ARM PostCommit failing after #28385 [beam]

2023-10-19 Thread via GitHub
AnandInguva commented on issue #29076: URL: https://github.com/apache/beam/issues/29076#issuecomment-1771215586 https://github.com/apache/beam/issues/29022 - tests are failing during staging where the stager downloads the packages that are mentioned in `requirements.txt. This is happening b

[PR] Bump beam to 2.51.0 [beam-starter-python]

2023-10-19 Thread via GitHub
kennknowles opened a new pull request, #21: URL: https://github.com/apache/beam-starter-python/pull/21 Dependabot is paused on the repository. I did not debug why. Thank you for your contribution! Follow this checklist to help us incorporate your contri

Re: [PR] Bump beam to 2.51.0 [beam-starter-python]

2023-10-19 Thread via GitHub
kennknowles commented on PR #21: URL: https://github.com/apache/beam-starter-python/pull/21#issuecomment-1771196106 R: @lostluck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[PR] Bump Beam version to 2.51.0 [beam-starter-java]

2023-10-19 Thread via GitHub
kennknowles opened a new pull request, #93: URL: https://github.com/apache/beam-starter-java/pull/93 Updated all the build systems. Dependabot can't do it because it opens separate PRs for each dependency and they are coupled. Thank you for your contrib

Re: [PR] Fix various issues in SplunkIO [beam]

2023-10-19 Thread via GitHub
Abacn commented on PR #28825: URL: https://github.com/apache/beam/pull/28825#issuecomment-1771187282 there are spotless and chexkstyle violations, see https://github.com/apache/beam/actions/runs/6535063663/job/17743650936?pr=28825 -- This is an automated message from the Apache Git Servic

Re: [PR] Bump Beam version to 2.51.0 [beam-starter-java]

2023-10-19 Thread via GitHub
kennknowles commented on PR #93: URL: https://github.com/apache/beam-starter-java/pull/93#issuecomment-1771188773 R: @lostluck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] Bump cloud.google.com/go/profiler from 0.3.1 to 0.4.0 in /sdks [beam]

2023-10-19 Thread via GitHub
jrmccluskey merged PR #29070: URL: https://github.com/apache/beam/pull/29070 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

[I] [Failing Test]: Python ARM PostCommit failing after #28385 [beam]

2023-10-19 Thread via GitHub
Abacn opened a new issue, #29076: URL: https://github.com/apache/beam/issues/29076 ### What happened? From https://github.com/apache/beam/pull/28385#issuecomment-179029 Python ARM postcommit were failing after this change: Last passed run https://github.com/apache/bea

Re: [PR] Handle response exception from Elasticsearch client [beam]

2023-10-19 Thread via GitHub
kennknowles commented on PR #26424: URL: https://github.com/apache/beam/pull/26424#issuecomment-1771146769 R: @egalpin -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] Align Neo4jIO with GCP Dataflow Neo4j Flex Template [beam]

2023-10-19 Thread via GitHub
github-actions[bot] commented on PR #27598: URL: https://github.com/apache/beam/pull/27598#issuecomment-1771145959 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

Re: [PR] beam_performance_singlestoreio [beam]

2023-10-19 Thread via GitHub
Abacn commented on code in PR #28986: URL: https://github.com/apache/beam/pull/28986#discussion_r1365676632 ## .github/workflows/beam_PerformanceTests_SingleStoreIO.yml: ## @@ -0,0 +1,119 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor lic

Re: [PR] beam_performance_singlestoreio [beam]

2023-10-19 Thread via GitHub
Abacn commented on code in PR #28986: URL: https://github.com/apache/beam/pull/28986#discussion_r1365674392 ## .github/workflows/beam_PerformanceTests_SingleStoreIO.yml: ## @@ -0,0 +1,119 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor lic

Re: [PR] Align Neo4jIO with GCP Dataflow Neo4j Flex Template [beam]

2023-10-19 Thread via GitHub
kennknowles commented on PR #27598: URL: https://github.com/apache/beam/pull/27598#issuecomment-1771143300 R: @Abacn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] Add 'release/trigger_all_tests.json' to trigger path of mass comment PR [beam]

2023-10-19 Thread via GitHub
Abacn merged PR #29064: URL: https://github.com/apache/beam/pull/29064 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] [JdbcIO] Add fetchSize to the schema provider for partitioned reads [beam]

2023-10-19 Thread via GitHub
Abacn merged PR #29015: URL: https://github.com/apache/beam/pull/29015 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] Fix and stabilize some GitHub Actions workflows [beam]

2023-10-19 Thread via GitHub
Abacn merged PR #29009: URL: https://github.com/apache/beam/pull/29009 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [I] [Task]: publish test results for GHA Python tests [beam]

2023-10-19 Thread via GitHub
Abacn commented on issue #29075: URL: https://github.com/apache/beam/issues/29075#issuecomment-1771118626 blocks python part of #28426 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Add InfluxDB credentials [beam]

2023-10-19 Thread via GitHub
Abacn merged PR #29071: URL: https://github.com/apache/beam/pull/29071 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

  1   2   >