Re: [PR] Revert setuptools upperbound since buggy releases are yanked. [beam]

2024-04-12 Thread via GitHub
tvalentyn merged PR #30958: URL: https://github.com/apache/beam/pull/30958 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Automatically execute unbounded pipelines in streaming mode. [beam]

2024-04-12 Thread via GitHub
damccorm commented on code in PR #30959: URL: https://github.com/apache/beam/pull/30959#discussion_r1563640076 ## CHANGES.md: ## @@ -119,6 +119,7 @@ * Merged sdks/java/fn-execution and runners/core-construction-java into the main SDK. These artifacts were never meant for

Re: [PR] Automatically execute unbounded pipelines in streaming mode. [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30959: URL: https://github.com/apache/beam/pull/30959#issuecomment-2052900909 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git

Re: [PR] Automatically execute unbounded pipelines in streaming mode. [beam]

2024-04-12 Thread via GitHub
robertwb commented on PR #30959: URL: https://github.com/apache/beam/pull/30959#issuecomment-2052897653 R: @damccorm or @kennknowles -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] Automatically execute unbounded pipelines in streaming mode. [beam]

2024-04-12 Thread via GitHub
robertwb opened a new pull request, #30959: URL: https://github.com/apache/beam/pull/30959 This version is guarded by an experiment in case the old behavior is needed. Thank you for your contribution! Follow this checklist to help us incorporate your

Re: [PR] Revert setuptools upperbound since buggy releases are yanked. [beam]

2024-04-12 Thread via GitHub
Abacn commented on PR #30958: URL: https://github.com/apache/beam/pull/30958#issuecomment-2052842519 Now it apppears PyDoc PreCommit is a different breakage -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] [Failing Test]: BigtableIOWriteTest::test_bigtable_write is about 50% flaky [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on issue #30927: URL: https://github.com/apache/beam/issues/30927#issuecomment-2052729627 gdb backtrace of the stuck that thread holds up GIL: https://github.com/grpc/grpc/issues/36256#issuecomment-2052729097 -- This is an automated message from the Apache Git

Re: [PR] Revert setuptools upperbound since buggy releases are yanked. [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30958: URL: https://github.com/apache/beam/pull/30958#issuecomment-2052686382 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git

Re: [PR] Revert setuptools upperbound since buggy releases are yanked. [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on PR #30958: URL: https://github.com/apache/beam/pull/30958#issuecomment-2052685823 R: @Abacn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Add code change guide contributor-doc [beam]

2024-04-12 Thread via GitHub
Abacn commented on code in PR #30879: URL: https://github.com/apache/beam/pull/30879#discussion_r1563292058 ## contributor-docs/code-change-guide.md: ## @@ -0,0 +1,518 @@ + + +This guide is for Beam users and developers changing and testing Beam code. +Specifically, this guide

Re: [PR] Add code change guide contributor-doc [beam]

2024-04-12 Thread via GitHub
Abacn commented on code in PR #30879: URL: https://github.com/apache/beam/pull/30879#discussion_r1563291081 ## contributor-docs/code-change-guide.md: ## @@ -0,0 +1,518 @@ + + +This guide is for Beam users and developers changing and testing Beam code. +Specifically, this guide

Re: [PR] Move logic to build a Labeled Metric Name to a util file. [beam]

2024-04-12 Thread via GitHub
JayajP commented on PR #30796: URL: https://github.com/apache/beam/pull/30796#issuecomment-2052638999 Java IO precommit failing due to #30941 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Move dependency updates to right after branch cut [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on PR #30939: URL: https://github.com/apache/beam/pull/30939#issuecomment-2052630389 Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Move dependency updates to right after branch cut [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on code in PR #30939: URL: https://github.com/apache/beam/pull/30939#discussion_r1563277851 ## .github/workflows/update_python_dependencies.yml: ## @@ -80,6 +78,11 @@ jobs: env: GH_TOKEN: ${{ secrets.GITHUB_TOKEN }} run: | +

Re: [PR] Move dependency updates to right after branch cut [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on code in PR #30939: URL: https://github.com/apache/beam/pull/30939#discussion_r1563277851 ## .github/workflows/update_python_dependencies.yml: ## @@ -80,6 +78,11 @@ jobs: env: GH_TOKEN: ${{ secrets.GITHUB_TOKEN }} run: | +

Re: [PR] Document how to trigger test suites. [beam]

2024-04-12 Thread via GitHub
tvalentyn merged PR #30953: URL: https://github.com/apache/beam/pull/30953 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Revert "Revert #30533: Automatically execute unbounded pipelines in streaming mode." [beam]

2024-04-12 Thread via GitHub
damccorm commented on PR #30894: URL: https://github.com/apache/beam/pull/30894#issuecomment-2052510228 We're taking a different (runner driven) approach here -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Revert "Revert #30533: Automatically execute unbounded pipelines in streaming mode." [beam]

2024-04-12 Thread via GitHub
damccorm closed pull request #30894: Revert "Revert #30533: Automatically execute unbounded pipelines in streaming mode." URL: https://github.com/apache/beam/pull/30894 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [yaml] backtick generated aliases on sql mappings [beam]

2024-04-12 Thread via GitHub
damccorm commented on code in PR #30895: URL: https://github.com/apache/beam/pull/30895#discussion_r1563185528 ## website/www/site/content/en/documentation/sdks/yaml-udf.md: ## @@ -133,11 +184,26 @@ expressions are supported as well another_col: "col2 + col3" ```

Re: [PR] [yaml] backtick generated aliases on sql mappings [beam]

2024-04-12 Thread via GitHub
damccorm commented on code in PR #30895: URL: https://github.com/apache/beam/pull/30895#discussion_r1563185014 ## website/www/site/content/en/documentation/sdks/yaml-udf.md: ## @@ -133,11 +184,26 @@ expressions are supported as well another_col: "col2 + col3" ```

Re: [PR] Revert "Tune maximum thread count for streaming dataflow worker executor dynamically. [beam]

2024-04-12 Thread via GitHub
MelodyShen commented on PR #30952: URL: https://github.com/apache/beam/pull/30952#issuecomment-2052472089 > do you need the revert to be _merged_ in order to test performance change? We plan to create an import cl and let the performance tests run against head during the weekends.

Re: [PR] Fix sdist [beam]

2024-04-12 Thread via GitHub
Abacn merged PR #30956: URL: https://github.com/apache/beam/pull/30956 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Fix sdist [beam]

2024-04-12 Thread via GitHub
Abacn commented on PR #30956: URL: https://github.com/apache/beam/pull/30956#issuecomment-2052468005 merge for now to make most Python PostCommit back green -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Disable profiling in cythonized code by default. [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on PR #30938: URL: https://github.com/apache/beam/pull/30938#issuecomment-2052437277 > I think we should call this out in CHANGES.md, otherwise LGTM Done, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log

[PR] [Python] Add feast feature store handler for enrichment transform [beam]

2024-04-12 Thread via GitHub
riteshghorse opened a new pull request, #30957: URL: https://github.com/apache/beam/pull/30957 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution

Re: [PR] Revert "Tune maximum thread count for streaming dataflow worker executor dynamically. [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on PR #30952: URL: https://github.com/apache/beam/pull/30952#issuecomment-2052413019 do you need the revert to be *merged* in order to test performance change? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] Fix sdist [beam]

2024-04-12 Thread via GitHub
Abacn commented on PR #30956: URL: https://github.com/apache/beam/pull/30956#issuecomment-2052406061 Python Doc PreCommit seems still failing, and the attempt fix (second commit) didn't work. I'm going to revert the second commit and merge the reviewed and tested first one -- This is an

Re: [I] [Failing Test]: setuptools 69.3.0 breaks sdist [beam]

2024-04-12 Thread via GitHub
Abacn commented on issue #30955: URL: https://github.com/apache/beam/issues/30955#issuecomment-2052374308 > They also changed the handling of dashes: apache-beam becomes apache_beam Yeah, this is https://github.com/pypa/setuptools/issues/4300 -- This is an automated message from

Re: [I] [Failing Test]: setuptools 69.3.0 breaks sdist [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on issue #30955: URL: https://github.com/apache/beam/issues/30955#issuecomment-2052366329 They also changed the handling of dashes: apache-beam becomes apache_beam -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[PR] Fix sdist [beam]

2024-04-12 Thread via GitHub
Abacn opened a new pull request, #30956: URL: https://github.com/apache/beam/pull/30956 Mitigate #30955 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate

Re: [PR] Re-add iceberg bounded source; test splitting [beam]

2024-04-12 Thread via GitHub
kennknowles merged PR #30805: URL: https://github.com/apache/beam/pull/30805 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[I] [Bug]: gradlew clean involves external transform generation and fails [beam]

2024-04-12 Thread via GitHub
tvalentyn opened a new issue, #30954: URL: https://github.com/apache/beam/issues/30954 ### What happened? Repro: ``` gradlew :sdks:python:cleanPython To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to

Re: [PR] Revert "Tune maximum thread count for streaming dataflow worker executor dynamically. [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30952: URL: https://github.com/apache/beam/pull/30952#issuecomment-2052231920 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @tvalentyn added as fallback since no labels match configuration

Re: [PR] Bump transformers from 4.30.0 to 4.38.0 in /sdks/python/apache_beam/examples/inference/online_clustering/clustering_pipeline [beam]

2024-04-12 Thread via GitHub
jrmccluskey merged PR #30922: URL: https://github.com/apache/beam/pull/30922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Document how to trigger test suites. [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30953: URL: https://github.com/apache/beam/pull/30953#issuecomment-2052209410 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git

Re: [PR] Document how to trigger test suites. [beam]

2024-04-12 Thread via GitHub
tvalentyn commented on PR #30953: URL: https://github.com/apache/beam/pull/30953#issuecomment-2052207810 R: @andreydevyatkin or @Abacn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] Document how to trigger test suites. [beam]

2024-04-12 Thread via GitHub
tvalentyn opened a new pull request, #30953: URL: https://github.com/apache/beam/pull/30953 Document workarounds for #28909 in the beginning of the doc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Revert "Tune maximum thread count for streaming dataflow worker executor dynamically. [beam]

2024-04-12 Thread via GitHub
MelodyShen commented on PR #30952: URL: https://github.com/apache/beam/pull/30952#issuecomment-2052178600 Hi @damccorm @tudorm here is the pr to revert the https://github.com/apache/beam/pull/30439 that caused performance regression. Would you mind taking a look? Thanks! -- This is an

[PR] Revert "Tune maximum thread count for streaming dataflow worker executor dynamically. [beam]

2024-04-12 Thread via GitHub
MelodyShen opened a new pull request, #30952: URL: https://github.com/apache/beam/pull/30952 This reverts commit d4990744cda3afe052422f5ae19ba17e0145218f. Performance regression was detected. The potential reason might be that we added additional lock on the metrics.

Re: [PR] Add code change guide contributor-doc [beam]

2024-04-12 Thread via GitHub
rszper commented on code in PR #30879: URL: https://github.com/apache/beam/pull/30879#discussion_r1562791368 ## contributor-docs/code-change-guide.md: ## @@ -0,0 +1,516 @@ + + +This guide is for Beam users and developers changing and testing Beam codes. +Specifically, + +1.

Re: [PR] Increase the timeout value for LeaderBoard example on DataflowRunner [beam]

2024-04-12 Thread via GitHub
damccorm merged PR #30949: URL: https://github.com/apache/beam/pull/30949 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Update java-dependency-guide contributor-doc reflecting gcpbomupgrader script [beam]

2024-04-12 Thread via GitHub
Abacn commented on PR #30942: URL: https://github.com/apache/beam/pull/30942#issuecomment-2052018774 fixed the cross link to the script, merging for now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Update java-dependency-guide contributor-doc reflecting gcpbomupgrader script [beam]

2024-04-12 Thread via GitHub
Abacn merged PR #30942: URL: https://github.com/apache/beam/pull/30942 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [#30870]: support consumer polling timeout in KafkaIO expansion service [beam]

2024-04-12 Thread via GitHub
damccorm commented on PR #30915: URL: https://github.com/apache/beam/pull/30915#issuecomment-2052002208 @xianhualiu any update here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] [Failing Test]: beam_PreCommit_Yaml_Xlang_Direct fails with with external bigquery write [beam]

2024-04-12 Thread via GitHub
robertwb commented on issue #30950: URL: https://github.com/apache/beam/issues/30950#issuecomment-2051996241 Underlying test was skipped, not resolved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] [Failing Test]: beam_PreCommit_Yaml_Xlang_Direct fails with with external bigquery write [beam]

2024-04-12 Thread via GitHub
robertwb closed issue #30950: [Failing Test]: beam_PreCommit_Yaml_Xlang_Direct fails with with external bigquery write URL: https://github.com/apache/beam/issues/30950 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [BEAM-30950] Disable failing test for now. [beam]

2024-04-12 Thread via GitHub
robertwb merged PR #30951: URL: https://github.com/apache/beam/pull/30951 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Increase the timeout value for LeaderBoard example on DataflowRunner [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30949: URL: https://github.com/apache/beam/pull/30949#issuecomment-2051992626 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damccorm for label build. Available commands: - `stop

Re: [PR] [YAML] Adds several tests exercising the cross-language capabilities. [beam]

2024-04-12 Thread via GitHub
robertwb merged PR #30880: URL: https://github.com/apache/beam/pull/30880 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [BEAM-30950] Disable failing test for now. [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30951: URL: https://github.com/apache/beam/pull/30951#issuecomment-2051986808 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git

Re: [PR] [BEAM-30950] Disable failing test for now. [beam]

2024-04-12 Thread via GitHub
robertwb commented on PR #30951: URL: https://github.com/apache/beam/pull/30951#issuecomment-2051984865 R: @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [BEAM-30950] Disable failing test for now. [beam]

2024-04-12 Thread via GitHub
robertwb opened a new pull request, #30951: URL: https://github.com/apache/beam/pull/30951 This should resolve https://github.com/apache/beam/issues/30950 from breaking presubmits until we figure out what the issue is. Thank you for your contribution!

Re: [PR] Add important category [beam]

2024-04-12 Thread via GitHub
damccorm merged PR #30920: URL: https://github.com/apache/beam/pull/30920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Re-add iceberg bounded source; test splitting [beam]

2024-04-12 Thread via GitHub
kennknowles commented on code in PR #30805: URL: https://github.com/apache/beam/pull/30805#discussion_r1562599790 ## sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/ScanSource.java: ## @@ -0,0 +1,136 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] Add code change guide contributor-doc [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30879: URL: https://github.com/apache/beam/pull/30879#issuecomment-2051963313 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git

Re: [PR] Add code change guide contributor-doc [beam]

2024-04-12 Thread via GitHub
Abacn commented on PR #30879: URL: https://github.com/apache/beam/pull/30879#issuecomment-2051961119 R: @rszper -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Iceberg Write SchemaTransform [beam]

2024-04-12 Thread via GitHub
robertwb commented on code in PR #30910: URL: https://github.com/apache/beam/pull/30910#discussion_r1562688850 ## sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/IcebergWriteSchemaTransformProvider.java: ## @@ -0,0 +1,216 @@ +/* + * Licensed to the Apache Software

Re: [PR] Add code change guide contributor-doc [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30879: URL: https://github.com/apache/beam/pull/30879#issuecomment-2051944271 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @robertwb added as fallback since no labels match configuration

Re: [PR] [YAML] Increase re-use of providers with implicitly overlapping transforms. [beam]

2024-04-12 Thread via GitHub
robertwb commented on PR #30793: URL: https://github.com/apache/beam/pull/30793#issuecomment-2051924037 > Took a bit for me to wrap my head around the logic, but this makes sense to me. > > So now with this logic, if we were to package all turnkey external transforms in a common

[PR] Increase the timeout value for LeaderBoard example on DataflowRunner [beam]

2024-04-12 Thread via GitHub
liferoad opened a new pull request, #30949: URL: https://github.com/apache/beam/pull/30949 Address #30505. The current time out value is 20 minutes. I checked few successful runs, which usually took less than 20 minutes. However, given sleeping 1 min

Re: [PR] Update java-dependency-guide contributor-doc reflecting gcpbomupgrader script [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30942: URL: https://github.com/apache/beam/pull/30942#issuecomment-2051916495 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git

Re: [PR] Update java-dependency-guide contributor-doc reflecting gcpbomupgrader script [beam]

2024-04-12 Thread via GitHub
Abacn commented on PR #30942: URL: https://github.com/apache/beam/pull/30942#issuecomment-2051914215 R: @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] [Task]: Python Jdbc xlang test uses deprecated API for sqlalchemy [beam]

2024-04-12 Thread via GitHub
AnandInguva closed issue #26333: [Task]: Python Jdbc xlang test uses deprecated API for sqlalchemy URL: https://github.com/apache/beam/issues/26333 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] [Task]: Python Jdbc xlang test uses deprecated API for sqlalchemy [beam]

2024-04-12 Thread via GitHub
Dippatel98 commented on issue #26333: URL: https://github.com/apache/beam/issues/26333#issuecomment-2051886983 This issue has been fixed by #30919 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Update sqlalchemy requirement from >=1.3,<2.0 to >=1.3,<3.0 in /sdks/python [beam]

2024-04-12 Thread via GitHub
Dippatel98 commented on PR #30919: URL: https://github.com/apache/beam/pull/30919#issuecomment-2051886183 Fixes #26333 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Update java-dependency-guide contributor-doc reflecting gcpbomupgrader script [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30942: URL: https://github.com/apache/beam/pull/30942#issuecomment-2051881147 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damondouglas added as fallback since no labels match

Re: [PR] Support FLOAT32 type in Spanner [beam]

2024-04-12 Thread via GitHub
Abacn merged PR #30893: URL: https://github.com/apache/beam/pull/30893 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Fix broken lint and improve lint rules. [beam]

2024-04-12 Thread via GitHub
Abacn merged PR #30940: URL: https://github.com/apache/beam/pull/30940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Fix broken lint and improve lint rules. [beam]

2024-04-12 Thread via GitHub
Abacn commented on PR #30940: URL: https://github.com/apache/beam/pull/30940#issuecomment-2051796175 local environment test fail should be irrelevant, merging for now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Args to set the max shard size in WriteToParquet [beam]

2024-04-12 Thread via GitHub
lhoestq commented on PR #23808: URL: https://github.com/apache/beam/pull/23808#issuecomment-2051778305 Feel free to re-open a PR with these changes (and possibly the missing test), I don't think I'll continue this PR -- This is an automated message from the Apache Git Service. To respond

Re: [PR] Args to set the max shard size in WriteToParquet [beam]

2024-04-12 Thread via GitHub
lpolisi commented on PR #23808: URL: https://github.com/apache/beam/pull/23808#issuecomment-2051730843 No plans to merge this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Fix broken lint and improve lint rules. [beam]

2024-04-12 Thread via GitHub
scwhittle commented on PR #30940: URL: https://github.com/apache/beam/pull/30940#issuecomment-2051688760 Closed and reopened to retrigger tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Fix broken lint and improve lint rules. [beam]

2024-04-12 Thread via GitHub
scwhittle closed pull request #30940: Fix broken lint and improve lint rules. URL: https://github.com/apache/beam/pull/30940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] [Bug]: RunInference with automatic refresh using a global window side inputs takes too long to update sometimes [beam]

2024-04-12 Thread via GitHub
scwhittle commented on issue #28776: URL: https://github.com/apache/beam/issues/28776#issuecomment-2051652566 I believe this is a long-standing bug within the python sdk. Side inputs within the global window are cached in

Re: [PR] Implementing lull reporting at bundle level processing [beam]

2024-04-12 Thread via GitHub
codecov-commenter commented on PR #30693: URL: https://github.com/apache/beam/pull/30693#issuecomment-2051644673 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/30693?dropdown=coverage=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=apache) Report

Re: [PR] Implementing lull reporting at bundle level processing [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30693: URL: https://github.com/apache/beam/pull/30693#issuecomment-2051644369 Reminder, please take a look at this pr: @johnjcasey -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] #30903: Do not reemit data from impulse [beam]

2024-04-12 Thread via GitHub
je-ik commented on code in PR #30905: URL: https://github.com/apache/beam/pull/30905#discussion_r1562135025 ## runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/bounded/FlinkBoundedSourceReader.java: ## @@ -61,8 +55,6 @@ */

Re: [PR] Fix broken lint and improve lint rules. [beam]

2024-04-12 Thread via GitHub
andreydevyatkin commented on PR #30940: URL: https://github.com/apache/beam/pull/30940#issuecomment-2051467203 @tvalentyn @liferoad Seems one of the checks has failed. Shall we merge it as it is or re-run it manually? Notice that there is no way to re-run it by leaving a comment -- This

Re: [PR] [DO NOT MERGE] Flink 1.17 [beam]

2024-04-12 Thread via GitHub
je-ik commented on PR #30197: URL: https://github.com/apache/beam/pull/30197#issuecomment-2051253260 I verified the current implementation works and can read savepoint created by 1.16 (at least with the same beam version), but I need more tests regarding upgrade from current stable

Re: [PR] #30903: Do not reemit data from impulse [beam]

2024-04-12 Thread via GitHub
JozoVilcek commented on code in PR #30905: URL: https://github.com/apache/beam/pull/30905#discussion_r1562178562 ## runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/bounded/FlinkBoundedSourceReader.java: ## @@ -61,8 +55,6 @@

Re: [PR] #30903: Do not reemit data from impulse [beam]

2024-04-12 Thread via GitHub
je-ik commented on code in PR #30905: URL: https://github.com/apache/beam/pull/30905#discussion_r1562135025 ## runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/bounded/FlinkBoundedSourceReader.java: ## @@ -61,8 +55,6 @@ */

Re: [PR] #30903: Do not reemit data from impulse [beam]

2024-04-12 Thread via GitHub
JozoVilcek commented on code in PR #30905: URL: https://github.com/apache/beam/pull/30905#discussion_r1562080961 ## runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/source/bounded/FlinkBoundedSourceReader.java: ## @@ -61,8 +55,6 @@

Re: [PR] Bump github.com/docker/docker from 25.0.5+incompatible to 26.0.1+incompatible in /sdks [beam]

2024-04-12 Thread via GitHub
github-actions[bot] commented on PR #30948: URL: https://github.com/apache/beam/pull/30948#issuecomment-2051044866 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated