Re: [PR] Bump google.golang.org/api from 0.192.0 to 0.194.0 in /sdks [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32296: URL: https://github.com/apache/beam/pull/32296#issuecomment-2306326009 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Bump google.golang.org/api from 0.192.0 to 0.193.0 in /sdks [beam]

2024-08-22 Thread via GitHub
dependabot[bot] closed pull request #32277: Bump google.golang.org/api from 0.192.0 to 0.193.0 in /sdks URL: https://github.com/apache/beam/pull/32277 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Bump google.golang.org/api from 0.192.0 to 0.193.0 in /sdks [beam]

2024-08-22 Thread via GitHub
dependabot[bot] commented on PR #32277: URL: https://github.com/apache/beam/pull/32277#issuecomment-2306286155 Superseded by #32296. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[PR] Bump google.golang.org/api from 0.192.0 to 0.194.0 in /sdks [beam]

2024-08-22 Thread via GitHub
dependabot[bot] opened a new pull request, #32296: URL: https://github.com/apache/beam/pull/32296 Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.192.0 to 0.194.0. Release notes Sourced from https://github.com/googleapis/google-api-go-clien

[PR] Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.60.0 to 1.60.1 in /sdks [beam]

2024-08-22 Thread via GitHub
dependabot[bot] opened a new pull request, #32295: URL: https://github.com/apache/beam/pull/32295 Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.60.0 to 1.60.1. Commits https://github.com/aws/aws-sdk-go-v2/commit/d1d210dd11afc2ef0e

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32284: URL: https://github.com/apache/beam/pull/32284#issuecomment-2306062511 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Rag opensearch usecase with Beam's MLTransform [beam]

2024-08-22 Thread via GitHub
itsayushpandey commented on PR #32018: URL: https://github.com/apache/beam/pull/32018#issuecomment-2306009968 > Code looks good, probably time to focus on cleaning up the notebook > > Same note on rebasing the branch, see https://stackoverflow.com/questions/7929369/how-to-rebase-local

Re: [PR] Implement Java TestPrismRunner and PrismRunner [beam]

2024-08-22 Thread via GitHub
lostluck commented on code in PR #32294: URL: https://github.com/apache/beam/pull/32294#discussion_r1728068353 ## runners/prism/java/src/main/java/org/apache/beam/runners/prism/PrismRunner.java: ## @@ -34,34 +40,38 @@ * submit to an already running Prism service, use the {@lin

Re: [PR] Implement Java TestPrismRunner and PrismRunner [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32294: URL: https://github.com/apache/beam/pull/32294#issuecomment-2305943039 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Implement Java TestPrismRunner and PrismRunner [beam]

2024-08-22 Thread via GitHub
damondouglas commented on PR #32294: URL: https://github.com/apache/beam/pull/32294#issuecomment-2305941997 R: @lostluck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] Implement Java TestPrismRunner and PrismRunner [beam]

2024-08-22 Thread via GitHub
damondouglas opened a new pull request, #32294: URL: https://github.com/apache/beam/pull/32294 This PR closes https://github.com/apache/beam/issues/31967, closes https://github.com/apache/beam/issues/31935, and closes https://github.com/apache/beam/issues/31935 with a Java Prism Runner.

Re: [PR] Make autosharding test more robust [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32293: URL: https://github.com/apache/beam/pull/32293#issuecomment-2305935640 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Make autosharding test more robust [beam]

2024-08-22 Thread via GitHub
damccorm commented on PR #32293: URL: https://github.com/apache/beam/pull/32293#issuecomment-2305934768 R: @tvalentyn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] Improve BatchElements documentation [beam]

2024-08-22 Thread via GitHub
tvalentyn commented on code in PR #32082: URL: https://github.com/apache/beam/pull/32082#discussion_r1728047494 ## sdks/python/apache_beam/transforms/util.py: ## @@ -802,6 +802,20 @@ class BatchElements(PTransform): corresponding to its contents. Each batch is emitted with a

Re: [PR] Improve BatchElements documentation [beam]

2024-08-22 Thread via GitHub
tvalentyn commented on code in PR #32082: URL: https://github.com/apache/beam/pull/32082#discussion_r1728047494 ## sdks/python/apache_beam/transforms/util.py: ## @@ -802,6 +802,20 @@ class BatchElements(PTransform): corresponding to its contents. Each batch is emitted with a

Re: [PR] Improve BatchElements documentation [beam]

2024-08-22 Thread via GitHub
tvalentyn commented on code in PR #32082: URL: https://github.com/apache/beam/pull/32082#discussion_r1728047698 ## sdks/python/apache_beam/transforms/util.py: ## @@ -802,6 +802,20 @@ class BatchElements(PTransform): corresponding to its contents. Each batch is emitted with a

[PR] Make autosharding test more robust [beam]

2024-08-22 Thread via GitHub
damccorm opened a new pull request, #32293: URL: https://github.com/apache/beam/pull/32293 Fixes #32069 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropr

Re: [I] [Failing Test]: apache_beam.io.gcp.bigquery_test.PipelineBasedStreamingInsertTest is flaky [beam]

2024-08-22 Thread via GitHub
damccorm commented on issue #32069: URL: https://github.com/apache/beam/issues/32069#issuecomment-2305904148 Looks like this is likely just a bad test. The actual assertion here is based on an assumption that data will be processed in order, but that's not guaranteed. I'll clean the test up

Re: [PR] [CHANGES.md] Add 2.60.0 section. [beam]

2024-08-22 Thread via GitHub
lostluck merged PR #32287: URL: https://github.com/apache/beam/pull/32287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] [CHANGES.md] Add 2.60.0 section. [beam]

2024-08-22 Thread via GitHub
lostluck commented on PR #32287: URL: https://github.com/apache/beam/pull/32287#issuecomment-2305851382 Thank you kindly! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] [Task][Prism]: Create a PrismRunner [beam]

2024-08-22 Thread via GitHub
lostluck commented on issue #31793: URL: https://github.com/apache/beam/issues/31793#issuecomment-2305844600 With various discussions, this is moved to the 2.60.0 release scheduled to be cut on October 2nd. -- This is an automated message from the Apache Git Service. To respond to the mes

[PR] Build rc wheels in parallel to main wheels [beam]

2024-08-22 Thread via GitHub
damccorm opened a new pull request, #32291: URL: https://github.com/apache/beam/pull/32291 This will greatly speed up our time to release (now docker artifacts will be the bottleneck, though we could do something similar for them if needed Thank you for

Re: [PR] [WIP] Remove Python 3.8 Support [beam]

2024-08-22 Thread via GitHub
codecov[bot] commented on PR #32279: URL: https://github.com/apache/beam/pull/32279#issuecomment-2305654391 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/32279?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term

Re: [PR] [yaml] Add use cases for Enrichment transform in YAML [beam]

2024-08-22 Thread via GitHub
Polber commented on code in PR #32289: URL: https://github.com/apache/beam/pull/32289#discussion_r1727793074 ## sdks/python/apache_beam/yaml/examples/bigtable_enrichment.yaml: ## @@ -0,0 +1,35 @@ +pipeline: + type: chain + transforms: + + # Step 1: Creating a collection of el

Re: [PR] [yaml] Add enrichment transform to Beam YAML [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32286: URL: https://github.com/apache/beam/pull/32286#issuecomment-2305583264 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] [CHANGES.md] Add 2.60.0 section. [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32287: URL: https://github.com/apache/beam/pull/32287#issuecomment-2305583161 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn for label build. Available commands: - `stop revi

Re: [PR] [yaml] Add use cases for Enrichment transform in YAML [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32289: URL: https://github.com/apache/beam/pull/32289#issuecomment-2305582966 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damccorm for label python. R: @ahmedabu98 for label io.

Re: [PR] [yaml] Add examples for Spanner IO in YAML [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32288: URL: https://github.com/apache/beam/pull/32288#issuecomment-2305540299 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] [yaml] Add examples for Spanner IO in YAML [beam]

2024-08-22 Thread via GitHub
Polber commented on code in PR #32288: URL: https://github.com/apache/beam/pull/32288#discussion_r1727723306 ## sdks/python/apache_beam/yaml/examples/spanner_read.yaml: ## @@ -0,0 +1,63 @@ +pipeline: + transforms: + + # Reading data from a Spanner database. The table used here

Re: [PR] Cherry pick: Check experiment for hotkey logging (#32285) [beam]

2024-08-22 Thread via GitHub
damccorm merged PR #32290: URL: https://github.com/apache/beam/pull/32290 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[PR] Cherry pick: Check experiment for hotkey logging (#32285) [beam]

2024-08-22 Thread via GitHub
damccorm opened a new pull request, #32290: URL: https://github.com/apache/beam/pull/32290 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue i

Re: [PR] [CHANGES.md] Add 2.60.0 section. [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32287: URL: https://github.com/apache/beam/pull/32287#issuecomment-2305446883 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Download BQMS catalog jar at build time [beam]

2024-08-22 Thread via GitHub
ahmedabu98 merged PR #32282: URL: https://github.com/apache/beam/pull/32282 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apac

Re: [PR] Check experiment for hotkey logging [beam]

2024-08-22 Thread via GitHub
damccorm merged PR #32285: URL: https://github.com/apache/beam/pull/32285 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] [WIP] Remove Python 3.8 targets from Actions [beam]

2024-08-22 Thread via GitHub
jrmccluskey commented on PR #32283: URL: https://github.com/apache/beam/pull/32283#issuecomment-2305436577 The coverage failure is because the runner isn't picking up the change to the action but it is picking up the configuration change to make python 3.9 the default. As a result, the work

[PR] Add use-cases for Enrichment transform in YAML [beam]

2024-08-22 Thread via GitHub
reeba212 opened a new pull request, #32289: URL: https://github.com/apache/beam/pull/32289 1. Added a simple bigtable enrichment example 2. Added an end to end use case that demonstrates how spanner IO and enrichment transform coupled with other YAML transforms can be used in a real worl

Re: [I] [Task]: Update the minor version of protobuf library in the upper bound prior to Beam release. [beam]

2024-08-22 Thread via GitHub
damccorm commented on issue #25590: URL: https://github.com/apache/beam/issues/25590#issuecomment-2305364830 It is fine to push to 2.60 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32284: URL: https://github.com/apache/beam/pull/32284#issuecomment-2305346016 ## Test Results 15 tests   15 :white_check_mark:  1h 37m 40s :stopwatch: 12 suites   0 :zzz: 12 files     0 :x: Results for commit 85ed0d97. [test-results

[PR] Add examples for Spanner IO in YAML [beam]

2024-08-22 Thread via GitHub
reeba212 opened a new pull request, #32288: URL: https://github.com/apache/beam/pull/32288 Added examples with explanatory comments for reading from and writing to a spanner table Thank you for your contribution! Follow this checklist to help us incorp

Re: [PR] Check experiment for hotkey logging [beam]

2024-08-22 Thread via GitHub
damccorm commented on PR #32285: URL: https://github.com/apache/beam/pull/32285#issuecomment-2305319812 > One could argue that this should be DRY'd into the `isHotKeyLoggingEnabled()` method instead of at each callsite, but given how much options code is generated, I'm not sure if it would

Re: [PR] Check experiment for hotkey logging [beam]

2024-08-22 Thread via GitHub
lostluck commented on PR #32285: URL: https://github.com/apache/beam/pull/32285#issuecomment-2305318221 One could argue that this should be DRY'd into the `isHotKeyLoggingEnabled()` method instead of at each callsite, but given how much options code is generated, I'm not sure if it would be

Re: [PR] Check experiment for hotkey logging [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32285: URL: https://github.com/apache/beam/pull/32285#issuecomment-2305313785 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [I] [Task]: Migrate to build with Java11 [beam]

2024-08-22 Thread via GitHub
Abacn commented on issue #31677: URL: https://github.com/apache/beam/issues/31677#issuecomment-2305313599 Realize build candidate script still explicitly "install java8" so keep this open until next release (2.60.0) where that part should also be updated -- This is an automated message fr

Re: [PR] Check experiment for hotkey logging [beam]

2024-08-22 Thread via GitHub
damccorm commented on PR #32285: URL: https://github.com/apache/beam/pull/32285#issuecomment-2305311849 R: @Abacn @lostluck (trying to get this in the release to address an issue folks are running into using Dataflow templates (which can plumb through the experiment, not the service option)

[PR] [CHANGES.md] Add 2.60.0 section. [beam]

2024-08-22 Thread via GitHub
lostluck opened a new pull request, #32287: URL: https://github.com/apache/beam/pull/32287 New release cut, need to add section for next release. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly

[PR] Add enrichment transform to Beam YAML [beam]

2024-08-22 Thread via GitHub
reeba212 opened a new pull request, #32286: URL: https://github.com/apache/beam/pull/32286 1. Added enrichment transform 2. Registered it in standard_providers.yaml 3. Added integration and unit tests for enrichment transform Thank you for your co

Re: [PR] Move RunInference GC to finalize_bundle [beam]

2024-08-22 Thread via GitHub
damccorm merged PR #32281: URL: https://github.com/apache/beam/pull/32281 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [I] [Feature Request]: Add timeout to RunInference operations [beam]

2024-08-22 Thread via GitHub
damccorm closed issue #32137: [Feature Request]: Add timeout to RunInference operations URL: https://github.com/apache/beam/issues/32137 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] Check experiment for hotkey logging [beam]

2024-08-22 Thread via GitHub
damccorm opened a new pull request, #32285: URL: https://github.com/apache/beam/pull/32285 The `enable_hot_key_logging` experiment is a valid way to turn on hotkey logging, but we don't respect it today. This respects both the service option and the experiment. --

Re: [I] [Task]: Update the minor version of protobuf library in the upper bound prior to Beam release. [beam]

2024-08-22 Thread via GitHub
lostluck commented on issue #25590: URL: https://github.com/apache/beam/issues/25590#issuecomment-2305271302 Do we need to do anything further for the 2.59.0 release for this, or should I push it to 2.60.0 ? -- This is an automated message from the Apache Git Service. To respond to the me

[PR] [DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch [beam]

2024-08-22 Thread via GitHub
lostluck opened a new pull request, #32284: URL: https://github.com/apache/beam/pull/32284 Tests run on GHA should be queued shortly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Download BQMS catalog jar at build time [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32282: URL: https://github.com/apache/beam/pull/32282#issuecomment-2305248659 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Cherrypick #32276 to 2.59.0 release branch. [beam]

2024-08-22 Thread via GitHub
lostluck merged PR #32280: URL: https://github.com/apache/beam/pull/32280 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Download BQMS catalog jar at build time [beam]

2024-08-22 Thread via GitHub
ahmedabu98 commented on PR #32282: URL: https://github.com/apache/beam/pull/32282#issuecomment-2305246460 R: @shunping CC: @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] Move RunInference GC to finalize_bundle [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32281: URL: https://github.com/apache/beam/pull/32281#issuecomment-2305237128 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Move RunInference GC to finalize_bundle [beam]

2024-08-22 Thread via GitHub
damccorm commented on PR #32281: URL: https://github.com/apache/beam/pull/32281#issuecomment-2305234645 R: @jrmccluskey -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [WIP] Remove Python 3.8 targets from Actions [beam]

2024-08-22 Thread via GitHub
jrmccluskey opened a new pull request, #32283: URL: https://github.com/apache/beam/pull/32283 Python 3.8 is scheduled to reach EOL in October of 2024. This PR removes actions targets for 3.8 ahead of the removal of Beam support for 3.8. DO NOT MERGE

Re: [I] MQTT IO connector for Python [beam]

2024-08-22 Thread via GitHub
chamikaramj commented on issue #21060: URL: https://github.com/apache/beam/issues/21060#issuecomment-2305210642 @ahmedabu98 @damccorm do we have plans to include MQTT as a Python auto-generated x-lang wrapper ? -- This is an automated message from the Apache Git Service. To respond to the

[PR] Move RunInference GC to finalize_bundle [beam]

2024-08-22 Thread via GitHub
damccorm opened a new pull request, #32281: URL: https://github.com/apache/beam/pull/32281 This makes way more sense since it will save a bunch of cross process calls on large bundles Thank you for your contribution! Follow this checklist to help us in

Re: [PR] Cherrypick #32276 to 2.59.0 release branch. [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32280: URL: https://github.com/apache/beam/pull/32280#issuecomment-2304995335 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Cherrypick #32276 to 2.59.0 release branch. [beam]

2024-08-22 Thread via GitHub
lostluck commented on PR #32280: URL: https://github.com/apache/beam/pull/32280#issuecomment-2304989656 R: @jrmccluskey And for the cherry pick please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[PR] Cherrypick #32276 to 2.59.0 release branch. [beam]

2024-08-22 Thread via GitHub
lostluck opened a new pull request, #32280: URL: https://github.com/apache/beam/pull/32280 Cherry pick of #32276 to the release branch. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[PR] [WIP] Remove Python 3.8 Support [beam]

2024-08-22 Thread via GitHub
jrmccluskey opened a new pull request, #32279: URL: https://github.com/apache/beam/pull/32279 Python 3.8 is scheduled to reach EOL in October of 2024. This PR removes support for Python 3.8 ahead of the Beam 2.60.0 release, following versioning changes in #27194 and #30828. DO NOT ME

Re: [PR] Loose BigQuery GCP project ID regex restrictions [beam]

2024-08-22 Thread via GitHub
Abacn commented on code in PR #32178: URL: https://github.com/apache/beam/pull/32178#discussion_r1727185714 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java: ## @@ -574,11 +574,12 @@ public class BigQueryIO { static final

Re: [PR] Loose BigQuery GCP project ID regex restrictions [beam]

2024-08-22 Thread via GitHub
Abacn commented on code in PR #32178: URL: https://github.com/apache/beam/pull/32178#discussion_r1727185714 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java: ## @@ -574,11 +574,12 @@ public class BigQueryIO { static final

Re: [PR] [prism] Add an idle shutdown timout to prism binary. [beam]

2024-08-22 Thread via GitHub
lostluck merged PR #32276: URL: https://github.com/apache/beam/pull/32276 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [I] [Bug]: ReadAllFiles does not fully read gzipped files from GCS [beam]

2024-08-22 Thread via GitHub
kennknowles commented on issue #31040: URL: https://github.com/apache/beam/issues/31040#issuecomment-2304824351 Based on this getting pushed from release to release, it is clearly not a true release-blocker. -- This is an automated message from the Apache Git Service. To respond to the me

Re: [I] Sorry, only users with push access can use that command. [beam]

2024-08-22 Thread via GitHub
Abacn closed issue #32268: Sorry, only users with push access can use that command. URL: https://github.com/apache/beam/issues/32268 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [I] [Feature Request]: Support `SetState` in SparkRunner [beam]

2024-08-22 Thread via GitHub
Abacn closed issue #32225: [Feature Request]: Support `SetState` in SparkRunner URL: https://github.com/apache/beam/issues/32225 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Add SetState support for SparkRunner [beam]

2024-08-22 Thread via GitHub
Abacn merged PR #32226: URL: https://github.com/apache/beam/pull/32226 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] [prism] Add an idle shutdown timout to prism binary. [beam]

2024-08-22 Thread via GitHub
lostluck commented on PR #32276: URL: https://github.com/apache/beam/pull/32276#issuecomment-2304772573 Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [prism] Add an idle shutdown timout to prism binary. [beam]

2024-08-22 Thread via GitHub
jrmccluskey commented on code in PR #32276: URL: https://github.com/apache/beam/pull/32276#discussion_r1727126763 ## sdks/go/cmd/prism/prism.go: ## @@ -30,27 +30,34 @@ import ( ) var ( - jobPort= flag.Int("job_port", 8073, "specify the job management servi

Re: [PR] [WIP] Fix TextSource checking of custom delimiters [beam]

2024-08-22 Thread via GitHub
jrmccluskey commented on PR #32257: URL: https://github.com/apache/beam/pull/32257#issuecomment-2304767400 Picked up by someone else -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [WIP] Fix TextSource checking of custom delimiters [beam]

2024-08-22 Thread via GitHub
jrmccluskey closed pull request #32257: [WIP] Fix TextSource checking of custom delimiters URL: https://github.com/apache/beam/pull/32257 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] The PostCommit Java Nexmark Dataflow job is flaky [beam]

2024-08-22 Thread via GitHub
shahine44 commented on issue #30606: URL: https://github.com/apache/beam/issues/30606#issuecomment-2304732708 نمی دانم چرا این برنامه گیت هاب را خوب درک نمی کنم فعلا یک مدت وارد نمی شوم و در یوتیوب ویدیو های آن را نگاه می کنم تا بتوانم بهتر متوجه شوید در تاریخ پنجشنبه ۲۲ اوت ۲۰۲۴،‏

Re: [I] The PostCommit Java Nexmark Dataflow job is flaky [beam]

2024-08-22 Thread via GitHub
shahine44 commented on issue #30606: URL: https://github.com/apache/beam/issues/30606#issuecomment-2304729662 نمی دانم چرا این برنامه گیت هاب را خوب درک نمی کنم فعلا یک مدت وارد نمی شوم و در یوتیوب ویدیو های آن را نگاه می کنم تا بتوانم بهتر متوجه شوید در تاریخ پنجشنبه ۲۲ اوت ۲۰۲۴،‏ ۱۶:۱

Re: [I] The PostCommit Java Nexmark Dataflow job is flaky [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on issue #30606: URL: https://github.com/apache/beam/issues/30606#issuecomment-2304578680 Reopening since the workflow is still flaky -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[I] The PostCommit Java Nexmark Dataflow job is flaky [beam]

2024-08-22 Thread via GitHub
github-actions[bot] opened a new issue, #30606: URL: https://github.com/apache/beam/issues/30606 The PostCommit Java Nexmark Dataflow is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Nexmark_Dataflow.yml?query=is%3Afailure

Re: [PR] Add throttling counters in gcsio. [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #31584: URL: https://github.com/apache/beam/pull/31584#issuecomment-2304578109 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. -- This is

Re: [PR] Add throttling counters in gcsio. [beam]

2024-08-22 Thread via GitHub
github-actions[bot] closed pull request #31584: Add throttling counters in gcsio. URL: https://github.com/apache/beam/pull/31584 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Bump commons-cli:commons-cli from 1.8.0 to 1.9.0 [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32191: URL: https://github.com/apache/beam/pull/32191#issuecomment-2304520471 Reminder, please take a look at this pr: @Abacn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] added methods for support ValueProvider in `MqttIO` [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #32181: URL: https://github.com/apache/beam/pull/32181#issuecomment-2304520498 Reminder, please take a look at this pr: @robertwb @johnjcasey -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [yaml] Add tests for provider schema validation [beam]

2024-08-22 Thread via GitHub
github-actions[bot] commented on PR #31975: URL: https://github.com/apache/beam/pull/31975#issuecomment-2304520571 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @jrmccluske

Re: [I] [Bug]: TextIO.read() with non-default delimiter doesn't split at the right position [beam]

2024-08-22 Thread via GitHub
Amar3tto commented on issue #32251: URL: https://github.com/apache/beam/issues/32251#issuecomment-2303927729 .take-issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To