Re: [I] [Bug]: `max_retries` not being passed in WriteToBigQuery Python SDK [beam]

2025-05-21 Thread via GitHub
TanuSharma2511 commented on issue #35019: URL: https://github.com/apache/beam/issues/35019#issuecomment-2899801963 .take-issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [I] Globbing asterisk cannot be escaped in file reads. [beam]

2025-05-21 Thread via GitHub
Bhargavkonidena commented on issue #21140: URL: https://github.com/apache/beam/issues/21140#issuecomment-2899735457 Can you please assign this issue to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] sdks/python: enrich data with CloudSQL [beam]

2025-05-21 Thread via GitHub
mohamedawnallah commented on PR #34398: URL: https://github.com/apache/beam/pull/34398#issuecomment-2899616190 Run Python_ML PreCommit 3.10 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] The PreCommit Java GCP IO Direct job is flaky [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on issue #33909: URL: https://github.com/apache/beam/issues/33909#issuecomment-2899599144 Reopening since the workflow is still flaky -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[I] The PreCommit Java GCP IO Direct job is flaky [beam]

2025-05-21 Thread via GitHub
github-actions[bot] opened a new issue, #33909: URL: https://github.com/apache/beam/issues/33909 The PreCommit Java GCP IO Direct is failing over 50% of the time. Please visit https://github.com/apache/beam/actions/workflows/beam_PreCommit_Java_GCP_IO_Direct.yml?query=is%3Afailure+branch%

Re: [PR] Yaml IT - Phase 3b [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #35022: URL: https://github.com/apache/beam/pull/35022#issuecomment-2899364857 Assigning reviewers: R: @jrmccluskey for label python. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available c

Re: [PR] Correcting the pipeline object definition [beam]

2025-05-21 Thread via GitHub
liferoad merged PR #34899: URL: https://github.com/apache/beam/pull/34899 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[PR] Fix vllm logging [beam]

2025-05-21 Thread via GitHub
damccorm opened a new pull request, #35023: URL: https://github.com/apache/beam/pull/35023 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution quick

[PR] [IcebergIO] load tests [beam]

2025-05-21 Thread via GitHub
ahmedabu98 opened a new pull request, #33728: URL: https://github.com/apache/beam/pull/33728 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [PR] Yaml IT - Phase 3a [beam]

2025-05-21 Thread via GitHub
derrickaw commented on code in PR #34782: URL: https://github.com/apache/beam/pull/34782#discussion_r2100999388 ## sdks/java/extensions/schemaio-expansion-service/build.gradle: ## @@ -58,6 +58,7 @@ dependencies { permitUnusedDeclared 'com.google.cloud:alloydb-jdbc-connector

Re: [PR] Yaml IT - Phase 3a [beam]

2025-05-21 Thread via GitHub
derrickaw commented on code in PR #34782: URL: https://github.com/apache/beam/pull/34782#discussion_r2100999388 ## sdks/java/extensions/schemaio-expansion-service/build.gradle: ## @@ -58,6 +58,7 @@ dependencies { permitUnusedDeclared 'com.google.cloud:alloydb-jdbc-connector

[PR] Yaml IT - Phase 3b [beam]

2025-05-21 Thread via GitHub
derrickaw opened a new pull request, #35022: URL: https://github.com/apache/beam/pull/35022 Phase 3 of this document - https://s.apache.org/beam-yaml-it https://github.com/apache/beam/issues/34611 Thank you for your contribution! Follow this checklist

Re: [PR] Add informal Python 3.13 support [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #35018: URL: https://github.com/apache/beam/pull/35018#issuecomment-2898738082 Assigning reviewers: R: @liferoad for label python. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available comm

Re: [PR] Fix nullability in ByteBuddyDoFnInvokerFactory and DoFnOutputReceivers [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #35020: URL: https://github.com/apache/beam/pull/35020#issuecomment-2898654984 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Add informal Python 3.13 support [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #35018: URL: https://github.com/apache/beam/pull/35018#issuecomment-2898593085 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Adding project and database support in write transform for firestoreIO [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #35017: URL: https://github.com/apache/beam/pull/35017#issuecomment-2898593206 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] [Gradle] Clean up DataflowRunner's Java distroless container image build tasks [beam]

2025-05-21 Thread via GitHub
sjvanrossum commented on PR #34999: URL: https://github.com/apache/beam/pull/34999#issuecomment-2898554422 Run Java PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] Refactor: separate SplittableTruncateSizedRestrictions [beam]

2025-05-21 Thread via GitHub
kennknowles opened a new pull request, #35021: URL: https://github.com/apache/beam/pull/35021 This follows #34919, splis out calls to `@TruncateRestriction`. This is the first Fn API transform that deals with responding to splits so it is a bit more complex than the prior refactors that onl

Re: [PR] Update GRPC dependencies for Python 3.13 [beam]

2025-05-21 Thread via GitHub
tvalentyn commented on code in PR #35003: URL: https://github.com/apache/beam/pull/35003#discussion_r2100705776 ## sdks/python/setup.py: ## @@ -354,7 +354,8 @@ def get_portability_package_data(): 'fastavro>=0.23.6,<2', 'fasteners>=0.3,<1.0', # TO

[PR] Fix nullability in ByteBuddyDoFnInvokerFactory and DoFnOutputReceivers [beam]

2025-05-21 Thread via GitHub
kennknowles opened a new pull request, #35020: URL: https://github.com/apache/beam/pull/35020 Fixing up warnings/errors in a couple files I was looking at today. Thank you for your contribution! Follow this checklist to help us incorporate your contribu

[I] [Bug]: `max_retries` not being passed in WriteToBigQuery [beam]

2025-05-21 Thread via GitHub
unography opened a new issue, #35019: URL: https://github.com/apache/beam/issues/35019 ### What happened? `max_retries` is not used in `WriteToBigQuery` even though, for example, [_StreamToBigQuery](https://github.com/apache/beam/blob/f4a0f2b42db9418f35a19bf44cbf9457b3010ae5/sdks/pyth

Re: [PR] [WIP] Update Debezium in DebeziumIO to 3.1.1 [beam]

2025-05-21 Thread via GitHub
tkaymak commented on code in PR #34763: URL: https://github.com/apache/beam/pull/34763#discussion_r2100611322 ## sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/DebeziumTransformRegistrar.java: ## @@ -34,7 +34,7 @@ "nullness" // TODO(https://github.com/apache/

[PR] Add informal Python 3.13 support [beam]

2025-05-21 Thread via GitHub
jrmccluskey opened a new pull request, #35018: URL: https://github.com/apache/beam/pull/35018 Introduces the changes to the package itself, gradle, and tox definitions to include Python 3.13 support. Does not automatically create or publish python 3.13 containers, nor does it add Python 3.1

Re: [PR] Bump @babel/helpers from 7.10.4 to 7.27.1 in /sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34926: URL: https://github.com/apache/beam/pull/34926#issuecomment-2898303974 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Bump @babel/helpers from 7.10.4 to 7.27.1 in /sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel [beam]

2025-05-21 Thread via GitHub
liferoad commented on PR #34926: URL: https://github.com/apache/beam/pull/34926#issuecomment-2898299185 R: @Chenzo1001 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] Update GRPC dependencies for Python 3.13 [beam]

2025-05-21 Thread via GitHub
jrmccluskey merged PR #35003: URL: https://github.com/apache/beam/pull/35003 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

[PR] Adding project and database support in write transform for firestoreIO [beam]

2025-05-21 Thread via GitHub
TanuSharma2511 opened a new pull request, #35017: URL: https://github.com/apache/beam/pull/35017 Resolves a part of #31858 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]

Re: [PR] [Java] Add parsedData to Hl7v2Message and Update HL7v2IO Docs [beam]

2025-05-21 Thread via GitHub
Suvrat1629 commented on PR #34213: URL: https://github.com/apache/beam/pull/34213#issuecomment-2898188477 @svetakvsundhar please take a look at this [comment](https://github.com/apache/beam/pull/34213#issuecomment-2726254794) again. Thank you -- This is an automated message from the A

Re: [PR] Refactor: separate SplitAndSizeRestriction from FnApiDoFnRunner [beam]

2025-05-21 Thread via GitHub
kennknowles merged PR #34919: URL: https://github.com/apache/beam/pull/34919 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] Rethrowing Exception from CassandraIO's ReadFn [beam]

2025-05-21 Thread via GitHub
kennknowles merged PR #34191: URL: https://github.com/apache/beam/pull/34191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] [Java] Add Gauge Metric Extraction to DataflowMetrics [beam]

2025-05-21 Thread via GitHub
Suvrat1629 commented on code in PR #34307: URL: https://github.com/apache/beam/pull/34307#discussion_r2100459166 ## runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowMetrics.java: ## @@ -225,6 +230,40 @@ private DistributionResult getDist

Re: [PR] [WIP] Update Debezium in DebeziumIO to 3.1.1 [beam]

2025-05-21 Thread via GitHub
Abacn commented on code in PR #34763: URL: https://github.com/apache/beam/pull/34763#discussion_r2100445984 ## sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/DebeziumTransformRegistrar.java: ## @@ -34,7 +34,7 @@ "nullness" // TODO(https://github.com/apache/be

Re: [I] The PostCommit Java Examples Dataflow V2 job is flaky [beam]

2025-05-21 Thread via GitHub
Abacn closed issue #33646: The PostCommit Java Examples Dataflow V2 job is flaky URL: https://github.com/apache/beam/issues/33646 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Fix PostCommit Java Examples Dataflow V2 workflow [beam]

2025-05-21 Thread via GitHub
Abacn merged PR #35015: URL: https://github.com/apache/beam/pull/35015 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] Fix PostCommit Java Examples Dataflow V2 workflow [beam]

2025-05-21 Thread via GitHub
Abacn commented on PR #35015: URL: https://github.com/apache/beam/pull/35015#issuecomment-2898165466 Thanks @sjvanrossum ! Let me merge this at the moment to bring back test green. Take your time on #34999. -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] Bump @babel/helpers from 7.10.4 to 7.27.1 in /sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel [beam]

2025-05-21 Thread via GitHub
claudevdm commented on PR #34926: URL: https://github.com/apache/beam/pull/34926#issuecomment-2898159068 @liferoad should this be merged? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] Update GRPC dependencies for Python 3.13 [beam]

2025-05-21 Thread via GitHub
jrmccluskey commented on code in PR #35003: URL: https://github.com/apache/beam/pull/35003#discussion_r2100342839 ## sdks/python/setup.py: ## @@ -354,7 +354,8 @@ def get_portability_package_data(): 'fastavro>=0.23.6,<2', 'fasteners>=0.3,<1.0', #

Re: [PR] Update GRPC dependencies for Python 3.13 [beam]

2025-05-21 Thread via GitHub
jrmccluskey commented on code in PR #35003: URL: https://github.com/apache/beam/pull/35003#discussion_r2100329037 ## sdks/python/setup.py: ## @@ -354,7 +354,8 @@ def get_portability_package_data(): 'fastavro>=0.23.6,<2', 'fasteners>=0.3,<1.0', #

Re: [PR] Bump transformers from 4.30.0 to 4.48.0 in /sdks/python/apache_beam/ml/inference [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34385: URL: https://github.com/apache/beam/pull/34385#issuecomment-2897843420 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull r

Re: [PR] Update docstring to clarify numShards=0 doesn't neccessarily enable autosharding [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34280: URL: https://github.com/apache/beam/pull/34280#issuecomment-2897843540 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. -- This is

Re: [PR] Update docstring to clarify numShards=0 doesn't neccessarily enable autosharding [beam]

2025-05-21 Thread via GitHub
github-actions[bot] closed pull request #34280: Update docstring to clarify numShards=0 doesn't neccessarily enable autosharding URL: https://github.com/apache/beam/pull/34280 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] Switch to use registerFileSystemsOnce for SerializablePipelineOptions constructor [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34028: URL: https://github.com/apache/beam/pull/34028#issuecomment-2897737145 Reminder, please take a look at this pr: @robertwb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Fix Docker build error by adding fallback for python3.12-distutils [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34144: URL: https://github.com/apache/beam/pull/34144#issuecomment-2897737088 Reminder, please take a look at this pr: @Abacn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [Java] Add parsedData to Hl7v2Message and Update HL7v2IO Docs [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34213: URL: https://github.com/apache/beam/pull/34213#issuecomment-2897736865 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn for

Re: [PR] Bump @octokit/plugin-paginate-rest and @octokit/rest in /scripts/ci/issue-report [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34167: URL: https://github.com/apache/beam/pull/34167#issuecomment-2897737047 Reminder, please take a look at this pr: @johnjcasey -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] Update google-bigquery.md to direct to Storage Write API as the inges… [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34909: URL: https://github.com/apache/beam/pull/34909#issuecomment-2897736398 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @melap for

Re: [PR] Bump cloud.google.com/go/bigquery from 1.67.0 to 1.68.0 in /sdks [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34939: URL: https://github.com/apache/beam/pull/34939#issuecomment-2897736263 Reminder, please take a look at this pr: @lostluck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Concat protos in BQStorageWriteAPI - solve edge cases during mering of nested repeated fields [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34436: URL: https://github.com/apache/beam/pull/34436#issuecomment-2897736649 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @robertwb f

Re: [PR] Bump @babel/helpers from 7.10.4 to 7.27.1 in /sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel [beam]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #34926: URL: https://github.com/apache/beam/pull/34926#issuecomment-2897736313 Reminder, please take a look at this pr: @claudevdm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [I] [Bug]: RuntimeError: No dataflow job was found when running the python file. [beam]

2025-05-21 Thread via GitHub
Ox0400 commented on issue #35013: URL: https://github.com/apache/beam/issues/35013#issuecomment-2896874107 You're absolutely right—it's impossible to set the log level in DataflowPythonJobOp. The only workaround is to configure it in data_clean.py, which is what I did by adding: log