Re: [PR] [Dataflow Streaming] Reuse proto builders on hot path to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
gemini-code-assist[bot] commented on code in PR #36164: URL: https://github.com/apache/beam/pull/36164#discussion_r2350308956 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/GetWorkResponseChunkAssembler.java: #

Re: [PR] [Dataflow Streaming] Reuse ByteStringOutputStream buffers to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp commented on PR #36165: URL: https://github.com/apache/beam/pull/36165#issuecomment-3294277796 R: @scwhittle -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[PR] [Dataflow Streaming] Reuse proto builders on hot path to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp opened a new pull request, #36164: URL: https://github.com/apache/beam/pull/36164 #33578 Noticed it while debugging long GC on a high cardinality job. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] [KafkaIO] Only update size metrics once per batch [beam]

2025-09-15 Thread via GitHub
kennknowles commented on PR #36077: URL: https://github.com/apache/beam/pull/36077#issuecomment-3271369409 I see we have a dedicated precommit. I am happy to merge and we can watch for any integration test failures. -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] [Dataflow Streaming] Reuse ByteStringOutputStream buffers to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36165: URL: https://github.com/apache/beam/pull/36165#issuecomment-3294279725 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

[PR] [Prism] Fix potential side-effect in TriggerAfterEach.onFire. [beam]

2025-09-15 Thread via GitHub
shunping opened a new pull request, #36166: URL: https://github.com/apache/beam/pull/36166 The current implementation of the `onFire` method for the `TriggerAfterEach` trigger in `strategy.go` has a side-effect that can cause multiple sub-triggers to be marked as finished within a single in

Re: [PR] [YAML] - update readme to correct pipeline calls [beam]

2025-09-15 Thread via GitHub
derrickaw commented on PR #36076: URL: https://github.com/apache/beam/pull/36076#issuecomment-3275090005 R: @shunping -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] Make dill optional [beam]

2025-09-15 Thread via GitHub
tvalentyn commented on code in PR #36093: URL: https://github.com/apache/beam/pull/36093#discussion_r2350167317 ## sdks/python/apache_beam/options/pipeline_options.py: ## @@ -1619,7 +1619,7 @@ def _add_argparse_args(cls, parser): help=( 'Chooses which pickl

Re: [PR] [Prism] Defer unlocking to avoid deadlock [beam]

2025-09-15 Thread via GitHub
shunping merged PR #36163: URL: https://github.com/apache/beam/pull/36163 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] [Prism] Defer unlocking to avoid deadlock [beam]

2025-09-15 Thread via GitHub
shunping commented on code in PR #36163: URL: https://github.com/apache/beam/pull/36163#discussion_r2350424599 ## sdks/go/pkg/beam/runners/prism/internal/engine/elementmanager.go: ## @@ -892,70 +892,75 @@ func (em *ElementManager) PersistBundle(rb RunBundle, col2Coders map[stri

Re: [I] [Feature Request]: Make Pulsar IO connector publish messages asynchronously [beam]

2025-09-15 Thread via GitHub
Abacn closed issue #22025: [Feature Request]: Make Pulsar IO connector publish messages asynchronously URL: https://github.com/apache/beam/issues/22025 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] Integrate lambda name pickling with Cloudpickle [beam]

2025-09-15 Thread via GitHub
claudevdm commented on code in PR #35904: URL: https://github.com/apache/beam/pull/35904#discussion_r2350284775 ## sdks/python/apache_beam/internal/cloudpickle/cloudpickle.py: ## @@ -78,6 +78,9 @@ import warnings import weakref +from apache_beam.internal.code_object_pickler

Re: [PR] [Dataflow Streaming] Reuse proto builders on hot path to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp commented on code in PR #36164: URL: https://github.com/apache/beam/pull/36164#discussion_r2350337177 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/GetWorkResponseChunkAssembler.java: ## @@ -9

Re: [PR] [Dataflow Streaming] Reuse ByteStringOutputStream buffers to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
gemini-code-assist[bot] commented on code in PR #36165: URL: https://github.com/apache/beam/pull/36165#discussion_r2350328610 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/state/WindmillStateUtil.java: ## @@ -26,22 +2

Re: [PR] [Dataflow Streaming] Reuse ByteStringOutputStream buffers to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp commented on PR #36165: URL: https://github.com/apache/beam/pull/36165#issuecomment-3294287956 /gemini review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] [Dataflow Streaming] Reuse proto builders on hot path to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
gemini-code-assist[bot] commented on code in PR #36164: URL: https://github.com/apache/beam/pull/36164#discussion_r2350324027 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/GetWorkResponseChunkAssembler.java: #

Re: [PR] [Dataflow Streaming] Reuse proto builders on hot path to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp commented on PR #36164: URL: https://github.com/apache/beam/pull/36164#issuecomment-3294323218 /gemini review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] [Dataflow Streaming] Reuse ByteStringOutputStream buffers to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp commented on PR #36165: URL: https://github.com/apache/beam/pull/36165#issuecomment-3294316587 /gemini review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] [Dataflow Streaming] Reuse proto builders on hot path to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp commented on PR #36164: URL: https://github.com/apache/beam/pull/36164#issuecomment-3294288672 /gemini review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[PR] [Dataflow Streaming] Reuse ByteStringOutputStream buffers to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp opened a new pull request, #36165: URL: https://github.com/apache/beam/pull/36165 #33578 Also removed an unconditional `stream.toByteString()` in checkState. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] Bump transformers from 4.30.0 to 4.53.0 in /sdks/python/apache_beam/ml/inference [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36162: URL: https://github.com/apache/beam/pull/36162#issuecomment-3293858887 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] [Dataflow Streaming] Reuse proto builders on hot path to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36164: URL: https://github.com/apache/beam/pull/36164#issuecomment-3294121576 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] [Dataflow Streaming] Reuse proto builders on hot path to reduce GC overhead [beam]

2025-09-15 Thread via GitHub
arunpandianp commented on PR #36164: URL: https://github.com/apache/beam/pull/36164#issuecomment-3294119212 R: @scwhittle -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] Bump actions/download-artifact from 4 to 5 [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36155: URL: https://github.com/apache/beam/pull/36155#issuecomment-3292803654 Assigning reviewers: R: @Abacn for label build. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available commands

Re: [PR] [Prism] Defer unlocking to avoid deadlock [beam]

2025-09-15 Thread via GitHub
shunping commented on code in PR #36163: URL: https://github.com/apache/beam/pull/36163#discussion_r2350112675 ## sdks/go/pkg/beam/runners/prism/internal/engine/elementmanager.go: ## @@ -892,70 +892,75 @@ func (em *ElementManager) PersistBundle(rb RunBundle, col2Coders map[stri

Re: [PR] [Python] Fix: Propagate resource hints through with_exception_handling [beam]

2025-09-15 Thread via GitHub
ian-Liaozy commented on code in PR #36090: URL: https://github.com/apache/beam/pull/36090#discussion_r2350096577 ## sdks/python/apache_beam/transforms/core.py: ## @@ -1664,7 +1664,7 @@ def with_exception_handling( subject to change. """ args, kwargs = self.r

Re: [PR] Fix PostCommit Python ValidatesRunner Dataflow job [beam]

2025-09-15 Thread via GitHub
Amar3tto commented on code in PR #36149: URL: https://github.com/apache/beam/pull/36149#discussion_r2350088691 ## sdks/python/apache_beam/transforms/ptransform_test.py: ## @@ -728,7 +728,10 @@ def test_flatten_one_single_pcollection(self): param(compat_version="2.66.0"),

Re: [PR] [Prism] Defer unlocking to avoid deadlock [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36163: URL: https://github.com/apache/beam/pull/36163#issuecomment-3293858526 Assigning reviewers: R: @lostluck for label go. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available commands

Re: [PR] Allow dependabot to update all actions [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36151: URL: https://github.com/apache/beam/pull/36151#issuecomment-3292238593 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Add blog post for Google Summer of Code 25 on improving Apache Beam's infrastructure [beam]

2025-09-15 Thread via GitHub
damccorm commented on PR #36161: URL: https://github.com/apache/beam/pull/36161#issuecomment-3293713575 R: @pabloem -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [PR] [Prism] Defer unlocking to avoid deadlock [beam]

2025-09-15 Thread via GitHub
lostluck commented on code in PR #36163: URL: https://github.com/apache/beam/pull/36163#discussion_r2349965073 ## sdks/go/pkg/beam/runners/prism/internal/engine/elementmanager.go: ## @@ -892,70 +892,75 @@ func (em *ElementManager) PersistBundle(rb RunBundle, col2Coders map[stri

Re: [PR] [Prism] Defer unlocking to avoid deadlock [beam]

2025-09-15 Thread via GitHub
shunping commented on code in PR #36163: URL: https://github.com/apache/beam/pull/36163#discussion_r2349948482 ## sdks/go/pkg/beam/runners/prism/internal/engine/elementmanager.go: ## @@ -1032,11 +1037,16 @@ func (em *ElementManager) triageTimers(d TentativeData, inputInfo PColI

Re: [PR] [Prism] Defer unlocking to avoid deadlock [beam]

2025-09-15 Thread via GitHub
shunping commented on code in PR #36163: URL: https://github.com/apache/beam/pull/36163#discussion_r2349948086 ## sdks/go/pkg/beam/runners/prism/internal/engine/elementmanager.go: ## @@ -892,70 +892,75 @@ func (em *ElementManager) PersistBundle(rb RunBundle, col2Coders map[stri

[PR] Defer unlocking to avoid deadlock [beam]

2025-09-15 Thread via GitHub
shunping opened a new pull request, #36163: URL: https://github.com/apache/beam/pull/36163 In rare cases, a runner bug can cause the `em.pendingElements` waitgroup counter to drop below zero, triggering a panic. The current code has two locations where this can occur. A mutex is locke

Re: [PR] Add blog post for Google Summer of Code 25 on improving Apache Beam's infrastructure [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36161: URL: https://github.com/apache/beam/pull/36161#issuecomment-3293649941 Assigning reviewers: R: @damccorm for label website. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available com

Re: [PR] Fix PulsarIO [beam]

2025-09-15 Thread via GitHub
Abacn commented on PR #36141: URL: https://github.com/apache/beam/pull/36141#issuecomment-3292499384 > Shall we update CHANGES.md since the updates are quite significant? Updated to bugfix section. In terms of breaking change I think it's fine because current PulsarIO is unusable (rea

Re: [PR] Set selected library to default before checks [beam]

2025-09-15 Thread via GitHub
shunping merged PR #36156: URL: https://github.com/apache/beam/pull/36156 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[PR] Bump transformers from 4.30.0 to 4.53.0 in /sdks/python/apache_beam/ml/inference [beam]

2025-09-15 Thread via GitHub
dependabot[bot] opened a new pull request, #36162: URL: https://github.com/apache/beam/pull/36162 Bumps [transformers](https://github.com/huggingface/transformers) from 4.30.0 to 4.53.0. Release notes Sourced from https://github.com/huggingface/transformers/releases";>transformers'

Re: [PR] Bump transformers from 4.30.0 to 4.48.0 in /sdks/python/apache_beam/ml/inference [beam]

2025-09-15 Thread via GitHub
dependabot[bot] commented on PR #34385: URL: https://github.com/apache/beam/pull/34385#issuecomment-3293512633 Superseded by #36162. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] Use distroless container built from HEAD in Dataflow V2 integration tests [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36160: URL: https://github.com/apache/beam/pull/36160#issuecomment-3293470185 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Use distroless container built from HEAD in Dataflow V2 integration tests [beam]

2025-09-15 Thread via GitHub
kennknowles commented on PR #36160: URL: https://github.com/apache/beam/pull/36160#issuecomment-3293466989 CC @sjvanrossum -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Use distroless container built from HEAD in Dataflow V2 integration tests [beam]

2025-09-15 Thread via GitHub
kennknowles commented on PR #36160: URL: https://github.com/apache/beam/pull/36160#issuecomment-3293466447 R: @Abacn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] Bump docker/build-push-action from 4 to 6 [beam]

2025-09-15 Thread via GitHub
damccorm merged PR #36159: URL: https://github.com/apache/beam/pull/36159 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] [Go SDK] Add Write transform to cross-language Bigtable package - fixes #35873 [beam]

2025-09-15 Thread via GitHub
Aashish-Jha-11 commented on PR #35876: URL: https://github.com/apache/beam/pull/35876#issuecomment-3293410407 Thank you for the clarification, Sir @shunping. You're absolutely right - I should run the integration tests against an actual Bigtable instance. I attempted to run the full integ

Re: [I] [Bug]: download page problems [beam]

2025-09-15 Thread via GitHub
liferoad commented on issue #34504: URL: https://github.com/apache/beam/issues/34504#issuecomment-3292496291 To be clear, do you mean we should update all URLs to something like https://www.apache.org/dyn/closer.lua/beam/2.67.0/apache-beam-2.67.0-source-release.zip? -- This is an automate

Re: [I] [Feature Request]: Set option for acknowledge the messages in PulsarIO reader [beam]

2025-09-15 Thread via GitHub
Abacn commented on issue #22054: URL: https://github.com/apache/beam/issues/22054#issuecomment-3293353859 This is essentially a feature request of implementing consumer based read (instead of the reader based read currently PulsarIO.read uses) -- This is an automated message from the Apac

Re: [PR] Use distroless container built from HEAD in Dataflow V2 integration tests [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36160: URL: https://github.com/apache/beam/pull/36160#issuecomment-3293363407 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [I] [Feature Request]: Make Pulsar IO connector publish messages asynchronously [beam]

2025-09-15 Thread via GitHub
Abacn commented on issue #22025: URL: https://github.com/apache/beam/issues/22025#issuecomment-3293350901 this issue was raised because previously PulsarIO.read's reader readNext did not provide a timeout, causing it hang indefinitely if no new messages. This has been fixed in #36141 and cl

Re: [PR] Fix PostCommit Python ValidatesRunner Dataflow job [beam]

2025-09-15 Thread via GitHub
claudevdm commented on code in PR #36149: URL: https://github.com/apache/beam/pull/36149#discussion_r2349407615 ## sdks/python/apache_beam/transforms/ptransform_test.py: ## @@ -728,7 +728,10 @@ def test_flatten_one_single_pcollection(self): param(compat_version="2.66.0"),

Re: [PR] Fix bug when execute DataframeTransform a dictionary of Pcoll [beam]

2025-09-15 Thread via GitHub
damccorm commented on code in PR #35893: URL: https://github.com/apache/beam/pull/35893#discussion_r2349737091 ## CHANGES.md: ## @@ -142,6 +142,7 @@ ## Bugfixes * (Python) Fixed Java YAML provider fails on Windows ([#35617](https://github.com/apache/beam/issues/35617)). +*

Re: [PR] Add dill dep where tensorflow-transform is used. [beam]

2025-09-15 Thread via GitHub
liferoad merged PR #36158: URL: https://github.com/apache/beam/pull/36158 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[PR] Add blog post for Google Summer of Code 25 on improving Apache Beam's infrastructure [beam]

2025-09-15 Thread via GitHub
ksobrenat32 opened a new pull request, #36161: URL: https://github.com/apache/beam/pull/36161 This pull request adds a new blog post to the Apache Beam website, sharing a Google Summer of Code 2025 participant's experience improving Beam's infrastructure :) -- This is an automated messag

Re: [PR] fix the end_stamp issue for the initial partition [beam]

2025-09-15 Thread via GitHub
github-actions[bot] closed pull request #35542: fix the end_stamp issue for the initial partition URL: https://github.com/apache/beam/pull/35542 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] Fix PulsarIO [beam]

2025-09-15 Thread via GitHub
liferoad commented on PR #36141: URL: https://github.com/apache/beam/pull/36141#issuecomment-3292260042 Shall we update CHANGES.md since the updates are quite significant? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] JsonToRowTest: fix race condition [beam]

2025-09-15 Thread via GitHub
ahmedabu98 merged PR #36073: URL: https://github.com/apache/beam/pull/36073 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apac

Re: [PR] [Go SDK] Add Write transform to cross-language Bigtable package - fixes #35873 [beam]

2025-09-15 Thread via GitHub
shunping commented on PR #35876: URL: https://github.com/apache/beam/pull/35876#issuecomment-3293191328 > Ran the integration tests under bigtable using go test, confirming they compile and skip gracefully when infrastructure is missing. That's exactly what I think is missing here. We

[PR] Bump google-github-actions/auth from 2 to 3 [beam]

2025-09-15 Thread via GitHub
dependabot[bot] opened a new pull request, #36154: URL: https://github.com/apache/beam/pull/36154 Bumps [google-github-actions/auth](https://github.com/google-github-actions/auth) from 2 to 3. Release notes Sourced from https://github.com/google-github-actions/auth/releases";>goog

Re: [PR] [Go SDK] Add Write transform to cross-language Bigtable package - fixes #35873 [beam]

2025-09-15 Thread via GitHub
Aashish-Jha-11 commented on PR #35876: URL: https://github.com/apache/beam/pull/35876#issuecomment-3293125986 Sir To verify my implementation, I ran the following checks locally: - Built the Go SDK and ensured all packages compiled successfully. - Ran the integration tests under bigtabl

Re: [I] The PostCommit Python Arm job is flaky [beam]

2025-09-15 Thread via GitHub
liferoad commented on issue #30760: URL: https://github.com/apache/beam/issues/30760#issuecomment-3292541870 https://github.com/apache/beam/pull/36140 should fix this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [I] [Bug]: Prism early window pane is not processed immediately downstream [beam]

2025-09-15 Thread via GitHub
shunping closed issue #36128: [Bug]: Prism early window pane is not processed immediately downstream URL: https://github.com/apache/beam/issues/36128 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [Prism] Disable combiner lifting for TriggerAlways [beam]

2025-09-15 Thread via GitHub
shunping commented on PR #36146: URL: https://github.com/apache/beam/pull/36146#issuecomment-3293103111 > TriggerAlways can be viewed as Repeated(ElementCount=1) Brilliant! That's a good explanation of why it also failed. -- This is an automated message from the Apache Git Service.

Re: [PR] Bump docker/build-push-action from 4 to 6 [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36159: URL: https://github.com/apache/beam/pull/36159#issuecomment-3293041857 Assigning reviewers: R: @damccorm for label build. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available comma

[PR] Use distroless container built from HEAD in Dataflow V2 integration tests [beam]

2025-09-15 Thread via GitHub
kennknowles opened a new pull request, #36160: URL: https://github.com/apache/beam/pull/36160 Previously, the Dataflow V2 tests rebuilt the distroless container using an overridden base image that was the `:latest` tag from the live docker repo. Now it should use the version that was built

Re: [PR] Adding CMEK support for temp_dataset for Python Bigquery [beam]

2025-09-15 Thread via GitHub
damccorm merged PR #36118: URL: https://github.com/apache/beam/pull/36118 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Bump actions/github-script from 7 to 8 [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36157: URL: https://github.com/apache/beam/pull/36157#issuecomment-3293042059 Assigning reviewers: R: @Abacn for label build. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available commands

Re: [PR] Fix PulsarIO [beam]

2025-09-15 Thread via GitHub
Abacn merged PR #36141: URL: https://github.com/apache/beam/pull/36141 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [I] [Bug]: download page problems [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on issue #34504: URL: https://github.com/apache/beam/issues/34504#issuecomment-3292006635 This issue has been marked as stale due to 150 days of inactivity. It will be closed in 30 days if no further activity occurs. If you think that’s incorrect or this issue

Re: [I] [Bug]: Unauthenticated error when running tests on Dataproc using Flink and Docker with private repos [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on issue #34339: URL: https://github.com/apache/beam/issues/34339#issuecomment-3292007010 This issue has been closed due to lack of activity. If you think that is incorrect, you can reopen the issue at any time. -- This is an automated message from the Apache

Re: [I] [Feature Request]: Support returning back BoundedTrie in metric result [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on issue #34633: URL: https://github.com/apache/beam/issues/34633#issuecomment-3292006423 This issue has been marked as stale due to 150 days of inactivity. It will be closed in 30 days if no further activity occurs. If you think that’s incorrect or this issue

Re: [PR] Cleanly separate v1 worker and v2 sdk harness container image handling in DataflowRunner [beam]

2025-09-15 Thread via GitHub
kennknowles commented on code in PR #36138: URL: https://github.com/apache/beam/pull/36138#discussion_r2349514937 ## runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowRunner.java: ## @@ -1290,15 +1277,18 @@ public DataflowPipelineJob run(P

Re: [I] [Bug]: PulsarIO write() complains of missing ClientUrl even when provided with withClientUrl [beam]

2025-09-15 Thread via GitHub
Abacn closed issue #30152: [Bug]: PulsarIO write() complains of missing ClientUrl even when provided with withClientUrl URL: https://github.com/apache/beam/issues/30152 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] org.apache.beam.sdk.io.pulsar.PulsarIOTest.testReadFromSimpleTopic flaky [beam]

2025-09-15 Thread via GitHub
Abacn closed issue #21560: org.apache.beam.sdk.io.pulsar.PulsarIOTest.testReadFromSimpleTopic flaky URL: https://github.com/apache/beam/issues/21560 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [I] PulsarIOTest.testReadFromSimpleTopic is very flaky [beam]

2025-09-15 Thread via GitHub
Abacn closed issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky URL: https://github.com/apache/beam/issues/21714 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] [Bug]: PulsarIO.read() is failing with java.lang.RuntimeException: Could not find a way to create AutoValue class class com.idfy.beam.pulsar.PulsarSourceDescriptor [beam]

2025-09-15 Thread via GitHub
Abacn closed issue #30688: [Bug]: PulsarIO.read() is failing with java.lang.RuntimeException: Could not find a way to create AutoValue class class com.idfy.beam.pulsar.PulsarSourceDescriptor URL: https://github.com/apache/beam/issues/30688 -- This is an automated message from the Apache Git

Re: [I] The PostCommit Python Arm job is flaky [beam]

2025-09-15 Thread via GitHub
Amar3tto commented on issue #30760: URL: https://github.com/apache/beam/issues/30760#issuecomment-3292270064 Culprit: https://github.com/apache/beam/pull/36027 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] Add dill dep where tensorflow-transform is used. [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36158: URL: https://github.com/apache/beam/pull/36158#issuecomment-3292929348 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Add dill dep where tensorflow-transform is used. [beam]

2025-09-15 Thread via GitHub
claudevdm commented on PR #36158: URL: https://github.com/apache/beam/pull/36158#issuecomment-3292925174 R: @liferoad -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[PR] Add dill dep where tensorflow-transform is used. [beam]

2025-09-15 Thread via GitHub
claudevdm opened a new pull request, #36158: URL: https://github.com/apache/beam/pull/36158 tensorflow-transform has a hard dependency on dill but does not specify it in setup.py. It used to be included transitively by depending on apache-beam, but apache-beam no longer has a hard dependenc

[PR] Bump docker/build-push-action from 4 to 6 [beam]

2025-09-15 Thread via GitHub
dependabot[bot] opened a new pull request, #36159: URL: https://github.com/apache/beam/pull/36159 Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 4 to 6. Release notes Sourced from https://github.com/docker/build-push-action/releases";>docker/bui

[PR] Bump actions/github-script from 7 to 8 [beam]

2025-09-15 Thread via GitHub
dependabot[bot] opened a new pull request, #36157: URL: https://github.com/apache/beam/pull/36157 Bumps [actions/github-script](https://github.com/actions/github-script) from 7 to 8. Release notes Sourced from https://github.com/actions/github-script/releases";>actions/github-scrip

Re: [PR] [Java]Fix NPE in UnboundedSolaceReader.getWatermark during disconnection (fixes #32660) [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #35919: URL: https://github.com/apache/beam/pull/35919#issuecomment-3291869597 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @ahmedabu98

Re: [I] [Bug]: download page problems [beam]

2025-09-15 Thread via GitHub
sebbASF commented on issue #34504: URL: https://github.com/apache/beam/issues/34504#issuecomment-3292863767 For current artifacts, yes. Hashes, sigs and KEYS for current artifacts must point directly to the files under https://downloads.apache.org/beam/ Older artifacts (and thei

Re: [PR] Bump google-github-actions/auth from 2 to 3 [beam]

2025-09-15 Thread via GitHub
damccorm merged PR #36154: URL: https://github.com/apache/beam/pull/36154 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] [IcebergIO] pin ORC 1.9.6 [beam]

2025-09-15 Thread via GitHub
ahmedabu98 merged PR #36132: URL: https://github.com/apache/beam/pull/36132 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apac

Re: [PR] Bump actions/stale from 9 to 10 [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36153: URL: https://github.com/apache/beam/pull/36153#issuecomment-3292804065 Assigning reviewers: R: @Abacn for label build. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available commands

Re: [PR] Cleanly separate v1 worker and v2 sdk harness container image handling in DataflowRunner [beam]

2025-09-15 Thread via GitHub
Abacn commented on code in PR #36138: URL: https://github.com/apache/beam/pull/36138#discussion_r2349389859 ## runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowRunner.java: ## @@ -1290,15 +1277,18 @@ public DataflowPipelineJob run(Pipelin

Re: [PR] Fix PostCommit Python ValidatesRunner Dataflow job [beam]

2025-09-15 Thread via GitHub
Abacn commented on PR #36149: URL: https://github.com/apache/beam/pull/36149#issuecomment-3292770076 cc: @claudevdm to confirm this is intended -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Bump actions/checkout from 4 to 5 [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36152: URL: https://github.com/apache/beam/pull/36152#issuecomment-3292679136 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Set selected library to default before checks [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on PR #36156: URL: https://github.com/apache/beam/pull/36156#issuecomment-3292678697 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] [Go SDK] Add Write transform to cross-language Bigtable package - fixes #35873 [beam]

2025-09-15 Thread via GitHub
Aashish-Jha-11 commented on PR #35876: URL: https://github.com/apache/beam/pull/35876#issuecomment-3292639605 Thank you for the follow-up Sir, @shunping. I want to clarify that the code was written and verified by me directly, not auto-generated. Unfortunately, the schema changes that

[PR] Bump actions/download-artifact from 4 to 5 [beam]

2025-09-15 Thread via GitHub
dependabot[bot] opened a new pull request, #36155: URL: https://github.com/apache/beam/pull/36155 Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 4 to 5. Release notes Sourced from https://github.com/actions/download-artifact/releases";>actions

[PR] Bump actions/stale from 9 to 10 [beam]

2025-09-15 Thread via GitHub
dependabot[bot] opened a new pull request, #36153: URL: https://github.com/apache/beam/pull/36153 Bumps [actions/stale](https://github.com/actions/stale) from 9 to 10. Release notes Sourced from https://github.com/actions/stale/releases";>actions/stale's releases. v10.0.0

Re: [I] [Bug]: Prism early window pane is not processed immediately downstream [beam]

2025-09-15 Thread via GitHub
shunping commented on issue #36128: URL: https://github.com/apache/beam/issues/36128#issuecomment-3292538685 Fixed in [36137](https://github.com/apache/beam/pull/36137) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] [Go SDK] Add Write transform to cross-language Bigtable package - fixes #35873 [beam]

2025-09-15 Thread via GitHub
shunping commented on PR #35876: URL: https://github.com/apache/beam/pull/35876#issuecomment-3292494212 While I see that the latest commit reverts the field names to fix the schema incompatibility, this doesn't fully address the concerns I raised in my previous comment: https://github.com/

[PR] Bump actions/checkout from 4 to 5 [beam]

2025-09-15 Thread via GitHub
dependabot[bot] opened a new pull request, #36152: URL: https://github.com/apache/beam/pull/36152 Bumps [actions/checkout](https://github.com/actions/checkout) from 4 to 5. Release notes Sourced from https://github.com/actions/checkout/releases";>actions/checkout's releases.

Re: [I] [Bug]: download page problems [beam]

2025-09-15 Thread via GitHub
sebbASF commented on issue #34504: URL: https://github.com/apache/beam/issues/34504#issuecomment-3292387558 Is anyone going to review this? The download page at https://beam.apache.org/get-started/downloads has lots of problems. It must not use the archive server for current rel

Re: [I] The PerformanceTests PubsubIOIT Python Streaming job is flaky [beam]

2025-09-15 Thread via GitHub
liferoad commented on issue #36150: URL: https://github.com/apache/beam/issues/36150#issuecomment-3292266465 https://github.com/apache/beam/pull/36140 should fix this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] Allow dependabot to update all actions [beam]

2025-09-15 Thread via GitHub
damccorm merged PR #36151: URL: https://github.com/apache/beam/pull/36151 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [I] [Feature Request]: Add support for tracking lineage with BoundedTrie [beam]

2025-09-15 Thread via GitHub
github-actions[bot] commented on issue #34342: URL: https://github.com/apache/beam/issues/34342#issuecomment-3292006922 This issue has been closed due to lack of activity. If you think that is incorrect, you can reopen the issue at any time. -- This is an automated message from the Apache

Re: [PR] Allow dependabot to update all actions [beam]

2025-09-15 Thread via GitHub
damccorm commented on PR #36151: URL: https://github.com/apache/beam/pull/36151#issuecomment-3292233420 R: @jrmccluskey -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

  1   2   >