Re: [I] The PostCommit Python job is flaky [beam]

2025-02-18 Thread via GitHub
Amar3tto commented on issue #30513: URL: https://github.com/apache/beam/issues/30513#issuecomment-2667831441 Possible cause: https://github.com/apache/beam/pull/33943. I'm testing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] The finalize_release job is flaky [beam]

2025-02-18 Thread via GitHub
Amar3tto commented on issue #33698: URL: https://github.com/apache/beam/issues/33698#issuecomment-2667689080 The last run was successful, closing for now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] The finalize_release job is flaky [beam]

2025-02-18 Thread via GitHub
Amar3tto closed issue #33698: The finalize_release job is flaky URL: https://github.com/apache/beam/issues/33698 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Add histogram parsing in runner v2 [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #34017: URL: https://github.com/apache/beam/pull/34017#issuecomment-2667633566 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn for label java. Available commands: - `stop revie

Re: [PR] Add histogram parsing in runner v2 [beam]

2025-02-18 Thread via GitHub
Naireen commented on PR #34017: URL: https://github.com/apache/beam/pull/34017#issuecomment-2667559063 Run Java_Pulsar_IO_Direct PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] Add histogram parsing in runner v2 [beam]

2025-02-18 Thread via GitHub
Naireen commented on PR #34017: URL: https://github.com/apache/beam/pull/34017#issuecomment-2667558627 Run Java PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Add histogram parsing in runner v2 [beam]

2025-02-18 Thread via GitHub
Naireen commented on PR #34017: URL: https://github.com/apache/beam/pull/34017#issuecomment-2667529486 Run Java_Pulsar_IO_Direct PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] Add histogram parsing in runner v2 [beam]

2025-02-18 Thread via GitHub
Naireen commented on PR #34017: URL: https://github.com/apache/beam/pull/34017#issuecomment-2667529015 Run Java_IOs_Direct PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] Add histogram parsing in runner v2 [beam]

2025-02-18 Thread via GitHub
Naireen commented on PR #34017: URL: https://github.com/apache/beam/pull/34017#issuecomment-2667529963 Run Python_Runners PreCommit 3.12 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] Add histogram parsing in runner v2 [beam]

2025-02-18 Thread via GitHub
Naireen commented on PR #34017: URL: https://github.com/apache/beam/pull/34017#issuecomment-2667529165 Run Java PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [AnomalyDetection] Add threshold and aggregation functions. [beam]

2025-02-18 Thread via GitHub
shunping opened a new pull request, #34018: URL: https://github.com/apache/beam/pull/34018 Also include the following changes: * change prediction to predictions (iterable) in AnomalyResult per reviews. * fix some tests that contaminate _KNONW_SPECIFIABLE This is a follow-up PR o

Re: [PR] Change UnboundedSourceAsSdfWrapperFn to share the cache across instances. [beam]

2025-02-18 Thread via GitHub
kennknowles commented on code in PR #33901: URL: https://github.com/apache/beam/pull/33901#discussion_r1960771308 ## sdks/java/core/src/main/java/org/apache/beam/sdk/util/MemoizingPerInstantiationSerializableSupplier.java: ## @@ -0,0 +1,60 @@ +/* + * Licensed to the Apache Softw

[PR] Add histogram parsing in runner v2 [beam]

2025-02-18 Thread via GitHub
Naireen opened a new pull request, #34017: URL: https://github.com/apache/beam/pull/34017 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickl

Re: [PR] Bump github.com/spf13/cobra from 1.8.1 to 1.9.1 in /sdks [beam]

2025-02-18 Thread via GitHub
lostluck merged PR #34005: URL: https://github.com/apache/beam/pull/34005 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Bump serialize-javascript and mocha in /sdks/typescript [beam]

2025-02-18 Thread via GitHub
lostluck commented on PR #34012: URL: https://github.com/apache/beam/pull/34012#issuecomment-2666971671 assign to next reviewer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] [Bug]: Race condition in FileSystems initialisation [beam]

2025-02-18 Thread via GitHub
liferoad closed issue #33965: [Bug]: Race condition in FileSystems initialisation URL: https://github.com/apache/beam/issues/33965 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] [Bug]: Race condition in FileSystems initialisation [beam]

2025-02-18 Thread via GitHub
liferoad commented on issue #33965: URL: https://github.com/apache/beam/issues/33965#issuecomment-2666969506 https://github.com/apache/beam/pull/34007#issuecomment-2666854778 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Use lock in FileSystems to allow only one thread to update options [beam]

2025-02-18 Thread via GitHub
liferoad commented on PR #34007: URL: https://github.com/apache/beam/pull/34007#issuecomment-2666968963 > There is already a fix in #32723. For usage outside worker, one should call FileSystems.registerFileSystemsOnce which is already a synchronized method. Close my PR then. -- Thi

Re: [PR] Use lock in FileSystems to allow only one thread to update options [beam]

2025-02-18 Thread via GitHub
liferoad closed pull request #34007: Use lock in FileSystems to allow only one thread to update options URL: https://github.com/apache/beam/pull/34007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Change UnboundedSourceAsSdfWrapperFn to share the cache across instances. [beam]

2025-02-18 Thread via GitHub
scwhittle closed pull request #33901: Change UnboundedSourceAsSdfWrapperFn to share the cache across instances. URL: https://github.com/apache/beam/pull/33901 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [AnomalyDetection] Add univariate trackers [beam]

2025-02-18 Thread via GitHub
damccorm merged PR #33994: URL: https://github.com/apache/beam/pull/33994 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [I] [Task]: Support non-ascii BigQuery field name for BigQueryIO STORAGE_WRITE_API [beam]

2025-02-18 Thread via GitHub
Abacn commented on issue #33991: URL: https://github.com/apache/beam/issues/33991#issuecomment-2666858726 I see, thanks for investigation, yeah this sounds non-trivial and I do not have immediate solution either without dive deep into it -- This is an automated message from the Apache Git

Re: [PR] Use lock in FileSystems to allow only one thread to update options [beam]

2025-02-18 Thread via GitHub
Abacn commented on PR #34007: URL: https://github.com/apache/beam/pull/34007#issuecomment-2666854778 There is already a fix in #32723. For usage outside worker, one should call FileSystems.registerFileSystemsOnce which is already a synchronized method. -- This is an automated message from

Re: [I] [Bug]: Race condition in FileSystems initialisation [beam]

2025-02-18 Thread via GitHub
Abacn commented on issue #33965: URL: https://github.com/apache/beam/issues/33965#issuecomment-2666852198 FileSystems.setDefaultPipelineOptions() should be called once on worker startup. It is an internal method and is not supposed to be used by worker. Would you mind sharing stacktrace so

Re: [PR] [AnomalyDetection] Add univariate trackers [beam]

2025-02-18 Thread via GitHub
damccorm commented on code in PR #33994: URL: https://github.com/apache/beam/pull/33994#discussion_r1960470739 ## sdks/python/apache_beam/ml/anomaly/univariate/mean.py: ## @@ -0,0 +1,141 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor l

Re: [PR] [AnomalyDetection] Add univariate trackers [beam]

2025-02-18 Thread via GitHub
shunping commented on code in PR #33994: URL: https://github.com/apache/beam/pull/33994#discussion_r1960416493 ## sdks/python/apache_beam/ml/anomaly/univariate/quantile.py: ## @@ -0,0 +1,171 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contribut

Re: [PR] [AnomalyDetection] Add univariate trackers [beam]

2025-02-18 Thread via GitHub
shunping commented on code in PR #33994: URL: https://github.com/apache/beam/pull/33994#discussion_r1960249091 ## sdks/python/apache_beam/ml/anomaly/univariate/mean.py: ## @@ -0,0 +1,141 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor l

Re: [I] The PostCommit Java ValidatesRunner Dataflow V2 job is flaky [beam]

2025-02-18 Thread via GitHub
Amar3tto commented on issue #33720: URL: https://github.com/apache/beam/issues/33720#issuecomment-2666496280 > I looked at the failures. It is WAI. Now in our backend we did a change where if the job has not specified --enable_lineage we don't store its stringset metric in spanner and hence

Re: [PR] [AnomalyDetection] Add univariate trackers [beam]

2025-02-18 Thread via GitHub
shunping commented on code in PR #33994: URL: https://github.com/apache/beam/pull/33994#discussion_r1960249091 ## sdks/python/apache_beam/ml/anomaly/univariate/mean.py: ## @@ -0,0 +1,141 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor l

Re: [PR] [AnomalyDetection] Add univariate trackers [beam]

2025-02-18 Thread via GitHub
shunping commented on code in PR #33994: URL: https://github.com/apache/beam/pull/33994#discussion_r1960191745 ## sdks/python/apache_beam/ml/anomaly/univariate/base.py: ## @@ -0,0 +1,88 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor li

Re: [PR] [AnomalyDetection] Add univariate trackers [beam]

2025-02-18 Thread via GitHub
damccorm commented on code in PR #33994: URL: https://github.com/apache/beam/pull/33994#discussion_r1960051738 ## sdks/python/apache_beam/ml/anomaly/univariate/quantile.py: ## @@ -0,0 +1,171 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contribut

Re: [PR] Add support for collections.abc.Mapping [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #34001: URL: https://github.com/apache/beam/pull/34001#issuecomment-2666306066 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @liferoad for label python. Available commands: - `stop

Re: [I] The Python ValidatesContainer Dataflow ARM job is flaky [beam]

2025-02-18 Thread via GitHub
damccorm closed issue #33065: The Python ValidatesContainer Dataflow ARM job is flaky URL: https://github.com/apache/beam/issues/33065 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Fix Python ValidatesContainer Dataflow ARM workflow [beam]

2025-02-18 Thread via GitHub
damccorm merged PR #34008: URL: https://github.com/apache/beam/pull/34008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Add support for collections.abc.Mapping [beam]

2025-02-18 Thread via GitHub
msuozzo commented on PR #34001: URL: https://github.com/apache/beam/pull/34001#issuecomment-2666300407 assign set of reviewers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] Add support for collections.abc.Mapping [beam]

2025-02-18 Thread via GitHub
msuozzo commented on PR #34001: URL: https://github.com/apache/beam/pull/34001#issuecomment-2666298206 assign to next reviewer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.76.1 to 1.77.0 in /sdks [beam]

2025-02-18 Thread via GitHub
dependabot[bot] closed pull request #34003: Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.76.1 to 1.77.0 in /sdks URL: https://github.com/apache/beam/pull/34003 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.76.1 to 1.77.0 in /sdks [beam]

2025-02-18 Thread via GitHub
dependabot[bot] commented on PR #34003: URL: https://github.com/apache/beam/pull/34003#issuecomment-2666274552 Looks like github.com/aws/aws-sdk-go-v2/service/s3 is up-to-date now, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Bump github.com/nats-io/nats.go from 1.38.0 to 1.39.0 in /sdks [beam]

2025-02-18 Thread via GitHub
jrmccluskey merged PR #33914: URL: https://github.com/apache/beam/pull/33914 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] Bump google.golang.org/api from 0.220.0 to 0.221.0 in /sdks [beam]

2025-02-18 Thread via GitHub
jrmccluskey merged PR #33976: URL: https://github.com/apache/beam/pull/33976 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager from 1.17.61 to 1.17.62 in /sdks [beam]

2025-02-18 Thread via GitHub
jrmccluskey merged PR #34004: URL: https://github.com/apache/beam/pull/34004 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] Fix commit message in finalize workflow [beam]

2025-02-18 Thread via GitHub
jrmccluskey merged PR #34014: URL: https://github.com/apache/beam/pull/34014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] [Release] Add 2.63.0 to Beam Website [beam]

2025-02-18 Thread via GitHub
jrmccluskey merged PR #33905: URL: https://github.com/apache/beam/pull/33905 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] Fix race in FanOutStreamingEngineWorkerHarnessTest [beam]

2025-02-18 Thread via GitHub
damccorm merged PR #34011: URL: https://github.com/apache/beam/pull/34011 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [I] [Bug]: Periodic Impulse with Fixed Window Stalls When Used as a Side Input in a Session Window Pipeline [beam]

2025-02-18 Thread via GitHub
liferoad commented on issue #34010: URL: https://github.com/apache/beam/issues/34010#issuecomment-2666234731 https://beam.apache.org/documentation/patterns/side-inputs/ has the Python example to show how to use side input. I suggest you to check it as well. I will recommend [Enrichment tra

Re: [PR] Fix GrpcDirectGetDataStreamTest waiting for 2 responses instead of the 3 present. [beam]

2025-02-18 Thread via GitHub
damccorm merged PR #34013: URL: https://github.com/apache/beam/pull/34013 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Add support for collections.abc.Mapping [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #34001: URL: https://github.com/apache/beam/pull/34001#issuecomment-2666171030 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Add support for collections.abc.Mapping [beam]

2025-02-18 Thread via GitHub
msuozzo commented on PR #34001: URL: https://github.com/apache/beam/pull/34001#issuecomment-2666167657 R: @jrmccluskey -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [I] [Bug]: Periodic Impulse with Fixed Window Stalls When Used as a Side Input in a Session Window Pipeline [beam]

2025-02-18 Thread via GitHub
SanjayPanda commented on issue #34010: URL: https://github.com/apache/beam/issues/34010#issuecomment-2666142216 Hi @liferoad Thanks for reply :) I tried processing the data without windowing, but it still gets stalled at Enrich ParDo. Using triggers with a custom window seems

Re: [PR] [Release] Add 2.63.0 to Beam Website [beam]

2025-02-18 Thread via GitHub
jrmccluskey commented on code in PR #33905: URL: https://github.com/apache/beam/pull/33905#discussion_r1960012768 ## website/www/site/content/en/get-started/downloads.md: ## @@ -96,11 +96,20 @@ versions denoted `0.x.y`. ## Releases +### 2.63.0 (2025-02-11) + +Official [sour

Re: [PR] [Release] Add 2.63.0 to Beam Website [beam]

2025-02-18 Thread via GitHub
damccorm commented on code in PR #33905: URL: https://github.com/apache/beam/pull/33905#discussion_r1960008176 ## website/www/site/content/en/get-started/downloads.md: ## @@ -96,11 +96,20 @@ versions denoted `0.x.y`. ## Releases +### 2.63.0 (2025-02-11) + +Official [source

Re: [PR] [Release] Add 2.63.0 to Beam Website [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #33905: URL: https://github.com/apache/beam/pull/33905#issuecomment-2666067488 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Fix commit message in finalize workflow [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #34014: URL: https://github.com/apache/beam/pull/34014#issuecomment-2666062825 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] [Release] Add 2.63.0 to Beam Website [beam]

2025-02-18 Thread via GitHub
jrmccluskey commented on PR #33905: URL: https://github.com/apache/beam/pull/33905#issuecomment-2666063881 R: @damccorm @liferoad -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[PR] Fix commit message in finalize workflow [beam]

2025-02-18 Thread via GitHub
damccorm opened a new pull request, #34014: URL: https://github.com/apache/beam/pull/34014 The message currently doesn't match the commit - https://github.com/apache/beam/commit/bc7c0d520faf4e45bcf9bbc4b8fbaa8280b50590 Thank you for your contribution! F

Re: [PR] Fix commit message in finalize workflow [beam]

2025-02-18 Thread via GitHub
damccorm commented on PR #34014: URL: https://github.com/apache/beam/pull/34014#issuecomment-2666058673 R: @jrmccluskey -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Use lock in FileSystems to allow only one thread to update options [beam]

2025-02-18 Thread via GitHub
scwhittle commented on PR #34007: URL: https://github.com/apache/beam/pull/34007#issuecomment-2666005577 https://github.com/apache/beam/pull/34011 to fix test failure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Preempt issubclass error for generic types [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #33995: URL: https://github.com/apache/beam/pull/33995#issuecomment-2666032872 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Preempt issubclass error for generic types [beam]

2025-02-18 Thread via GitHub
damccorm commented on PR #33995: URL: https://github.com/apache/beam/pull/33995#issuecomment-2666028589 R: @jrmccluskey -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Add histogram to metrics container [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #33043: URL: https://github.com/apache/beam/pull/33043#issuecomment-2666006928 Stopping reviewer notifications for this pull request: requested by reviewer. If you'd like to restart, comment `assign set of reviewers` -- This is an automated message from

Re: [PR] Add histogram to metrics container [beam]

2025-02-18 Thread via GitHub
damccorm commented on PR #33043: URL: https://github.com/apache/beam/pull/33043#issuecomment-2666002565 (stopping the bot since this got converted to a draft) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] Add histogram to metrics container [beam]

2025-02-18 Thread via GitHub
damccorm commented on PR #33043: URL: https://github.com/apache/beam/pull/33043#issuecomment-2666001919 stop reviewer notifications -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[PR] Fix GrpcDirectGetDataStreamTest waiting for 2 responses instead of the 3 present. [beam]

2025-02-18 Thread via GitHub
scwhittle opened a new pull request, #34013: URL: https://github.com/apache/beam/pull/34013 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in y

Re: [PR] Fix race in FanOutStreamingEngineWorkerHarnessTest [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #34011: URL: https://github.com/apache/beam/pull/34011#issuecomment-2665960290 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @jrmccluskey added as fallback since no labels match configuration

Re: [PR] Fix race in FanOutStreamingEngineWorkerHarnessTest [beam]

2025-02-18 Thread via GitHub
scwhittle commented on PR #34011: URL: https://github.com/apache/beam/pull/34011#issuecomment-2665956583 assign set of reviewers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [I] [Bug]: Periodic Impulse with Fixed Window Stalls When Used as a Side Input in a Session Window Pipeline [beam]

2025-02-18 Thread via GitHub
liferoad commented on issue #34010: URL: https://github.com/apache/beam/issues/34010#issuecomment-2665950579 Have you tried https://cloud.google.com/dataflow/docs/guides/enrichment? For your case, you might need to use `with_redis_cache` with TTL: https://beam.apache.org/documentation/tran

Re: [PR] Fix Python ValidatesContainer Dataflow ARM workflow [beam]

2025-02-18 Thread via GitHub
damccorm commented on code in PR #34008: URL: https://github.com/apache/beam/pull/34008#discussion_r1959911904 ## .github/workflows/beam_Python_ValidatesContainer_Dataflow_ARM.yml: ## @@ -61,7 +61,7 @@ jobs: github.event_name == 'workflow_dispatch' || startsWith(gi

Re: [PR] Fix Python ValidatesContainer Dataflow ARM workflow [beam]

2025-02-18 Thread via GitHub
damccorm commented on code in PR #34008: URL: https://github.com/apache/beam/pull/34008#discussion_r1959913440 ## .github/workflows/beam_Python_ValidatesContainer_Dataflow_ARM.yml: ## @@ -61,7 +61,7 @@ jobs: github.event_name == 'workflow_dispatch' || startsWith(gi

Re: [PR] Bump serialize-javascript and mocha in /sdks/typescript [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #34012: URL: https://github.com/apache/beam/pull/34012#issuecomment-2665901546 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @lostluck added as fallback since no labels match configuration

[PR] Bump serialize-javascript and mocha in /sdks/typescript [beam]

2025-02-18 Thread via GitHub
dependabot[bot] opened a new pull request, #34012: URL: https://github.com/apache/beam/pull/34012 Bumps [serialize-javascript](https://github.com/yahoo/serialize-javascript) to 6.0.2 and updates ancestor dependency [mocha](https://github.com/mochajs/mocha). These dependencies need to be up

Re: [PR] Use lock in FileSystems to allow only one thread to update options [beam]

2025-02-18 Thread via GitHub
liferoad commented on code in PR #34007: URL: https://github.com/apache/beam/pull/34007#discussion_r1959795218 ## sdks/java/core/src/main/java/org/apache/beam/sdk/io/FileSystems.java: ## @@ -586,15 +588,17 @@ public static void setDefaultPipelineOptions(PipelineOptions options)

Re: [PR] Fix race in FanOutStreamingEngineWorkerHarnessTest [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #34011: URL: https://github.com/apache/beam/pull/34011#issuecomment-2665781476 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Fix race in FanOutStreamingEngineWorkerHarnessTest [beam]

2025-02-18 Thread via GitHub
scwhittle commented on PR #34011: URL: https://github.com/apache/beam/pull/34011#issuecomment-2665778261 R: @Abacn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] Change UnboundedSourceAsSdfWrapperFn to share the cache across instances. [beam]

2025-02-18 Thread via GitHub
scwhittle commented on PR #33901: URL: https://github.com/apache/beam/pull/33901#issuecomment-2665754160 Run Java_Pulsar_IO_Direct PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] Change UnboundedSourceAsSdfWrapperFn to share the cache across instances. [beam]

2025-02-18 Thread via GitHub
scwhittle commented on PR #33901: URL: https://github.com/apache/beam/pull/33901#issuecomment-2665753579 Run Java_IOs_Direct PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Change UnboundedSourceAsSdfWrapperFn to share the cache across instances. [beam]

2025-02-18 Thread via GitHub
scwhittle commented on PR #33901: URL: https://github.com/apache/beam/pull/33901#issuecomment-2665753112 Run Java PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] Fix race in FanOutStreamingEngineWorkerHarnessTest [beam]

2025-02-18 Thread via GitHub
scwhittle opened a new pull request, #34011: URL: https://github.com/apache/beam/pull/34011 Multiple assignments can be racily collapsed causing the verification to block. Thank you for your contribution! Follow this checklist to help us incorporate yo

Re: [PR] Use lock in FileSystems to allow only one thread to update options [beam]

2025-02-18 Thread via GitHub
scwhittle commented on code in PR #34007: URL: https://github.com/apache/beam/pull/34007#discussion_r1959762610 ## sdks/java/core/src/main/java/org/apache/beam/sdk/io/FileSystems.java: ## @@ -586,15 +588,17 @@ public static void setDefaultPipelineOptions(PipelineOptions options

Re: [PR] log the docker cmd to help debug [beam]

2025-02-18 Thread via GitHub
liferoad merged PR #34002: URL: https://github.com/apache/beam/pull/34002 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[I] [Bug]: Periodic Impulse with fixed window getting stuck after sometime when used side input to a session window main pipeline [beam]

2025-02-18 Thread via GitHub
SanjayPanda opened a new issue, #34010: URL: https://github.com/apache/beam/issues/34010 ### What happened? Team I tried to email with the email Id shown it didn't work, hence thought creating this issue. I am using the Apache Beam Python SDK with the Dataflow runner. Our pipe

Re: [PR] Include window coder to repr of WindowedValueCoder [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #33900: URL: https://github.com/apache/beam/pull/33900#issuecomment-2665532136 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @jrmccluske

Re: [PR] Bump github.com/nats-io/nats.go from 1.38.0 to 1.39.0 in /sdks [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #33914: URL: https://github.com/apache/beam/pull/33914#issuecomment-2665531816 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @jrmccluske

Re: [PR] Create examples/java/webapis/README.md [beam]

2025-02-18 Thread via GitHub
github-actions[bot] commented on PR #33931: URL: https://github.com/apache/beam/pull/33931#issuecomment-2665531681 Reminder, please take a look at this pr: @robertwb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the