Re: [PR] Updated User Defined Function Document for SQL [beam]

2025-07-11 Thread via GitHub
talatuyarer commented on PR #35571: URL: https://github.com/apache/beam/pull/35571#issuecomment-3064757584 @kennknowles Could you review this ? @Abacn would oyu like to give a try šŸ˜„ cc @ahmedabu98 -- This is an automated message from the Apache Git Service. To respond to t

[PR] Updated User Defined Function Document for SQL [beam]

2025-07-11 Thread via GitHub
talatuyarer opened a new pull request, #35571: URL: https://github.com/apache/beam/pull/35571 UDFProvider is a feature looks like it is un documented. I just updated user define function page to help users to use UDFProvider more confidently Thank you

Re: [PR] Add a flag in PeriodicImpulse to rebase timestamp. [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #35569: URL: https://github.com/apache/beam/pull/35569#issuecomment-3064739375 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

[PR] Fix metrics url [beam]

2025-07-11 Thread via GitHub
Amar3tto opened a new pull request, #35570: URL: https://github.com/apache/beam/pull/35570 https://metrics.beam.apache.org/ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]

[PR] Add a flag in PeriodicImpulse to rebase timestamp. [beam]

2025-07-11 Thread via GitHub
shunping opened a new pull request, #35569: URL: https://github.com/apache/beam/pull/35569 When we call `PeriodicImpulse`, either using the default `start_timestamp`, or specifying it to be `Timestamp.now()`. The timestamp that gets passed in is the timestamp when the pipeline is constructe

[PR] [YAML] A Streaming Inference Pipeline - Taxi Fare Estimation [beam]

2025-07-11 Thread via GitHub
charlespnh opened a new pull request, #35568: URL: https://github.com/apache/beam/pull/35568 **Please** add a meaningful description for your change here Part of a larger effort https://github.com/apache/beam/issues/35069 and https://github.com/apache/beam/issues/35068 to add more exa

Re: [I] The go_modules in /sdks - Update #941920271 job is flaky [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on issue #33475: URL: https://github.com/apache/beam/issues/33475#issuecomment-3064440448 Reopening since the workflow is still flaky -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] Add BigQuery Storage Read API Enrichment Handler [beam]

2025-07-11 Thread via GitHub
pandasanjay commented on code in PR #35197: URL: https://github.com/apache/beam/pull/35197#discussion_r2201948536 ## sdks/python/apache_beam/transforms/enrichment_handlers/bigquery_storage_read.py: ## @@ -0,0 +1,763 @@ +# -*- coding: utf-8 -*- +# Copyright 2024 Google LLC & Apac

Re: [PR] Add BigQuery Storage Read API Enrichment Handler [beam]

2025-07-11 Thread via GitHub
pandasanjay commented on PR #35197: URL: https://github.com/apache/beam/pull/35197#issuecomment-3063969842 Hi @tvalentyn Sorry for the late reply. We recently deployed this version of the code in production, but it didn’t work well due to conflicts between the thread pool used for p

Re: [PR] [BQ]: Update error message for too big of a BQ tablerow [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #35567: URL: https://github.com/apache/beam/pull/35567#issuecomment-3063921758 Assigning reviewers: R: @chamikaramj for label java. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available com

Re: [PR] [KafkaIO] Report unknown backlog size when latest offset lags behind next offset [beam]

2025-07-11 Thread via GitHub
liferoad merged PR #35086: URL: https://github.com/apache/beam/pull/35086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] [KafkaIO] Report unknown backlog size when latest offset lags behind next offset [beam]

2025-07-11 Thread via GitHub
sjvanrossum commented on PR #35086: URL: https://github.com/apache/beam/pull/35086#issuecomment-3063602806 @liferoad yes, this is good to merge. šŸ‘ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [BQ]: Update error message for too big of a BQ tablerow [beam]

2025-07-11 Thread via GitHub
derrickaw commented on PR #35567: URL: https://github.com/apache/beam/pull/35567#issuecomment-3063404704 Checks don't seem related to this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] [Bug]: Building wheels failing on self hosted actions, working on github's runners [beam]

2025-07-11 Thread via GitHub
damccorm commented on issue #33506: URL: https://github.com/apache/beam/issues/33506#issuecomment-3063331277 It would be great to figure this one out eventually, commenting to keep it from being stale -- This is an automated message from the Apache Git Service. To respond to the message,

[PR] [BQ]: Update error message for too big of a BQ tablerow [beam]

2025-07-11 Thread via GitHub
derrickaw opened a new pull request, #35567: URL: https://github.com/apache/beam/pull/35567 #35566 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Mention the appropriate

[I] [Bug]: BQ log message covering up real reason for failure [beam]

2025-07-11 Thread via GitHub
derrickaw opened a new issue, #35566: URL: https://github.com/apache/beam/issues/35566 ### What happened? We have a job that failed supposedly due to too big of a table row trying to be inserted into BQ, but the underlying reason was due to schema issues. The log message should be i

Re: [PR] Mysql embeddings [beam]

2025-07-11 Thread via GitHub
claudevdm commented on PR #35393: URL: https://github.com/apache/beam/pull/35393#issuecomment-3062982598 > https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Xlang_Gcp_Dataflow.yml?query=event%3Aschedule @Abacn where can I see the list of tests that actually run?

Re: [PR] Mysql embeddings [beam]

2025-07-11 Thread via GitHub
claudevdm commented on PR #35393: URL: https://github.com/apache/beam/pull/35393#issuecomment-3062985362 Actually looking back at the test history, it was timing out a lot before this change too. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [I] The PostCommit Python ValidatesContainer Dataflow With RC job is flaky [beam]

2025-07-11 Thread via GitHub
Amar3tto closed issue #30525: The PostCommit Python ValidatesContainer Dataflow With RC job is flaky URL: https://github.com/apache/beam/issues/30525 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Fix PostCommit Python ValidatesContainer Dataflow With RC job [beam]

2025-07-11 Thread via GitHub
Amar3tto merged PR #35556: URL: https://github.com/apache/beam/pull/35556 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Fix PostCommit Python ValidatesContainer Dataflow With RC job [beam]

2025-07-11 Thread via GitHub
Amar3tto commented on PR #35556: URL: https://github.com/apache/beam/pull/35556#issuecomment-3062579923 > Thanks! > > Just curious about how this get triaged as the log shows no clue I found a clue about Postgres in logs, also 3 / 4 jobs were cancelling due to short timeout -

Re: [PR] Update Beam Protobuf Schema (Java) [beam]

2025-07-11 Thread via GitHub
liferoad commented on PR #35150: URL: https://github.com/apache/beam/pull/35150#issuecomment-3062559763 @ahmedabu98 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [I] The PerformanceTests SQLBigQueryIO Batch Java job is flaky [beam]

2025-07-11 Thread via GitHub
Amar3tto commented on issue #35522: URL: https://github.com/apache/beam/issues/35522#issuecomment-3062556659 I tried to revert #35480, also tried to use highmem runner, didn't help. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] Bump github.com/nats-io/nats-server/v2 from 2.11.5 to 2.11.6 in /sdks [beam]

2025-07-11 Thread via GitHub
liferoad merged PR #35509: URL: https://github.com/apache/beam/pull/35509 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] [KafkaIO] Report unknown backlog size when latest offset lags behind next offset [beam]

2025-07-11 Thread via GitHub
liferoad commented on PR #35086: URL: https://github.com/apache/beam/pull/35086#issuecomment-3062551282 > I actually wonder if this could have weird issues? I guess the presumption of the prior code is that we are "caught up" if the next offset has caught up to the latest offset. This could

Re: [PR] [Dataflow Streaming] Fix grpc commit stream test [beam]

2025-07-11 Thread via GitHub
liferoad merged PR #35552: URL: https://github.com/apache/beam/pull/35552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [I] [Bug]: Building wheels failing on self hosted actions, working on github's runners [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on issue #33506: URL: https://github.com/apache/beam/issues/33506#issuecomment-3062206874 This issue has been marked as stale due to 150 days of inactivity. It will be closed in 30 days if no further activity occurs. If you think that’s incorrect or this issue

Re: [PR] Fix flink runner test [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #34913: URL: https://github.com/apache/beam/pull/34913#issuecomment-3062206141 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull r

Re: [I] [Bug]: beam-starter-typescript: npm run build: TypeError: Cannot set property constructor of [object Object] which has only a getter [beam]

2025-07-11 Thread via GitHub
github-actions[bot] closed issue #33527: [Bug]: beam-starter-typescript: npm run build: TypeError: Cannot set property constructor of [object Object] which has only a getter URL: https://github.com/apache/beam/issues/33527 -- This is an automated message from the Apache Git Service. To respo

Re: [I] [Bug]: beam-starter-typescript: npm run build: TypeError: Cannot set property constructor of [object Object] which has only a getter [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on issue #33527: URL: https://github.com/apache/beam/issues/33527#issuecomment-3062206822 This issue has been closed due to lack of activity. If you think that is incorrect, you can reopen the issue at any time. -- This is an automated message from the Apache

Re: [PR] Move remaining workflow to Java11 [beam]

2025-07-11 Thread via GitHub
damccorm commented on code in PR #35559: URL: https://github.com/apache/beam/pull/35559#discussion_r2200635397 ## sdks/python/tox.ini: ## @@ -307,6 +307,7 @@ commands = bash {toxinidir}/scripts/pytest_validates_runner.sh {envname} {toxinidir}/apache_beam/runners/portability/

Re: [PR] updates Hazelcast website link in the documentation [beam]

2025-07-11 Thread via GitHub
damccorm merged PR #35565: URL: https://github.com/apache/beam/pull/35565 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] fixed the large row errors fof BigQuery IO storage write [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #35478: URL: https://github.com/apache/beam/pull/35478#issuecomment-3062078892 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @robertwb f

Re: [PR] [BEAM-6394] Add support to write protobuf data using ProtoParquetReader [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #34063: URL: https://github.com/apache/beam/pull/34063#issuecomment-3062080185 Reminder, please take a look at this pr: @chamikaramj @Abacn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] Iobase streaming support in FileBasedSink, exposed in TextIO [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #35253: URL: https://github.com/apache/beam/pull/35253#issuecomment-3062079958 Reminder, please take a look at this pr: @shunping -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Adding GCP Spanner Change Stream support for Python [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #35453: URL: https://github.com/apache/beam/pull/35453#issuecomment-3062079717 Reminder, please take a look at this pr: @damccorm @m-trieu @nielm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] added the job id for spanner IO [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #35479: URL: https://github.com/apache/beam/pull/35479#issuecomment-3062077786 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn for

Re: [PR] [GrowableOffsetRangeTracker] Use UnsignedLong instead of BigDecimal to calculate progress [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #35561: URL: https://github.com/apache/beam/pull/35561#issuecomment-3061713148 Assigning reviewers: R: @kennknowles for label java. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available com

Re: [PR] [GrowableOffsetRangeTracker] Use UnsignedLong instead of BigDecimal to calculate progress [beam]

2025-07-11 Thread via GitHub
sjvanrossum commented on PR #35561: URL: https://github.com/apache/beam/pull/35561#issuecomment-3061709988 assign set of reviewers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] adds pre-commit hook to standardize whitespaces, adds EditorConfig to set the indents [beam]

2025-07-11 Thread via GitHub
nyoungstudios commented on PR #35564: URL: https://github.com/apache/beam/pull/35564#issuecomment-3060891847 I don't think the GitHub action failures are related to my code changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] adds pre-commit hook to standardize whitespaces, adds EditorConfig to set the indents [beam]

2025-07-11 Thread via GitHub
github-actions[bot] commented on PR #35564: URL: https://github.com/apache/beam/pull/35564#issuecomment-3060894705 Assigning reviewers: R: @jrmccluskey for label python. R: @m-trieu for label java. R: @shunping for label go. R: @Abacn for label build. R: @kennknowles for la

Re: [PR] adds pre-commit hook to standardize whitespaces, adds EditorConfig to set the indents [beam]

2025-07-11 Thread via GitHub
nyoungstudios commented on PR #35564: URL: https://github.com/apache/beam/pull/35564#issuecomment-3060892111 assign set of reviewers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c