[GitHub] [beam] johnjcasey commented on issue #23893: [Feature Request][Go]: Support Resource Hints

2023-01-20 Thread GitBox
johnjcasey commented on issue #23893: URL: https://github.com/apache/beam/issues/23893#issuecomment-1398748618 @lostluck is this ready for 2.45, or should we bump it to 2.46? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] rszper commented on a diff in pull request #25083: Multi language/runinference example

2023-01-20 Thread GitBox
rszper commented on code in PR #25083: URL: https://github.com/apache/beam/pull/25083#discussion_r1082856121 ## website/www/site/content/en/documentation/ml/multi-language-inference.md: ## @@ -0,0 +1,161 @@ +--- +title: "Cross Language RunInference " +--- + + +# Cross Language

[GitHub] [beam] damondouglas commented on a diff in pull request #24874: [Playground] Implement Java & Go multifile examples execution

2023-01-20 Thread GitBox
damondouglas commented on code in PR #24874: URL: https://github.com/apache/beam/pull/24874#discussion_r1082831517 ## playground/backend/internal/setup_tools/builder/setup_builder.go: ## @@ -185,7 +196,7 @@ func replaceLogPlaceholder(paths *fs_tool.LifeCyclePaths, executorConfi

[GitHub] [beam] Abacn commented on pull request #25101: Fix truncate copy job when WRITE_TRUNCATE in BigQuery batch load

2023-01-20 Thread GitBox
Abacn commented on PR #25101: URL: https://github.com/apache/beam/pull/25101#issuecomment-1398684069 Run Python_Examples PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [beam] Abacn commented on pull request #25101: Fix truncate copy job when WRITE_TRUNCATE in BigQuery batch load

2023-01-20 Thread GitBox
Abacn commented on PR #25101: URL: https://github.com/apache/beam/pull/25101#issuecomment-1398672510 @johnjcasey it impacts 2.44.0, and also seen in previous releases. Will try to track since when it is introduced. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] Abacn closed issue #25061: [Failing Test]: Python PostCommit xlang jdbc tests failing due to breaking change introduced in #24851

2023-01-20 Thread GitBox
Abacn closed issue #25061: [Failing Test]: Python PostCommit xlang jdbc tests failing due to breaking change introduced in #24851 URL: https://github.com/apache/beam/issues/25061 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [beam] Abacn commented on issue #25061: [Failing Test]: Python PostCommit xlang jdbc tests failing due to breaking change introduced in #24851

2023-01-20 Thread GitBox
Abacn commented on issue #25061: URL: https://github.com/apache/beam/issues/25061#issuecomment-1398670785 Yes it should be closed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [beam] xinyuiscool merged pull request #25031: Allow to set timeout for finishing a remote bundle in Samza portable runner

2023-01-20 Thread GitBox
xinyuiscool merged PR #25031: URL: https://github.com/apache/beam/pull/25031 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

[GitHub] [beam] johnjcasey commented on issue #25061: [Failing Test]: Python PostCommit xlang jdbc tests failing due to breaking change introduced in #24851

2023-01-20 Thread GitBox
johnjcasey commented on issue #25061: URL: https://github.com/apache/beam/issues/25061#issuecomment-1398667025 @Abacn is this issue closed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [beam] nbali commented on pull request #24168: #24167 Document<->Row conversion for FirestoreIO

2023-01-20 Thread GitBox
nbali commented on PR #24168: URL: https://github.com/apache/beam/pull/24168#issuecomment-1398652827 @vishinde Quite frankly it's not up to me at this point. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [beam] riteshghorse commented on issue #23382: [Feature Request]: RunInference Wrapper for Go SDK

2023-01-20 Thread GitBox
riteshghorse commented on issue #23382: URL: https://github.com/apache/beam/issues/23382#issuecomment-1398633128 Sklearn Inference Unkeyed ModelHandler is in for 2.45.0 along with the generic internal details required to wrap any other inference from Python SDK. Rest of the wrappers are no

[GitHub] [beam] codecov[bot] commented on pull request #25101: Fix truncate copy job when WRITE_TRUNCATE in BigQuery batch load

2023-01-20 Thread GitBox
codecov[bot] commented on PR #25101: URL: https://github.com/apache/beam/pull/25101#issuecomment-1398629515 # [Codecov](https://codecov.io/gh/apache/beam/pull/25101?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Fo

[GitHub] [beam] johnjcasey commented on pull request #25101: Fix truncate copy job when WRITE_TRUNCATE in BigQuery batch load

2023-01-20 Thread GitBox
johnjcasey commented on PR #25101: URL: https://github.com/apache/beam/pull/25101#issuecomment-1398627089 We may need to update the comment, as this did not impact the 2.44 release -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [beam] github-actions[bot] commented on pull request #25101: Fix truncate copy job when WRITE_TRUNCATE in BigQuery batch load

2023-01-20 Thread GitBox
github-actions[bot] commented on PR #25101: URL: https://github.com/apache/beam/pull/25101#issuecomment-1398604394 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

[GitHub] [beam] Abacn commented on pull request #25101: Fix truncate copy job when WRITE_TRUNCATE in BigQuery batch load

2023-01-20 Thread GitBox
Abacn commented on PR #25101: URL: https://github.com/apache/beam/pull/25101#issuecomment-1398595541 R: @robertwb R: @johnjcasey We may need another cherry-pick because the original fix, marked as 2.45.0 milestone, did not take effect. -- This is an automated message from the A

[GitHub] [beam] Abacn opened a new pull request, #25101: Fix truncate copy job when WRITE_TRUNCATE in BigQuery batch load

2023-01-20 Thread GitBox
Abacn opened a new pull request, #25101: URL: https://github.com/apache/beam/pull/25101 Fixes #24535 Due to a typo the original fix did not take effect. Fixed and added a test. **Please** add a meaningful description for your change here Th

[GitHub] [beam] damccorm commented on pull request #25083: Multi language/runinference example

2023-01-20 Thread GitBox
damccorm commented on PR #25083: URL: https://github.com/apache/beam/pull/25083#issuecomment-1398580169 Oh, could you please add a short snippet to the overview examples as well? https://github.com/apache/beam/blob/master/website/www/site/content/en/documentation/ml/overview.md#examples --

[GitHub] [beam] MOscity commented on issue #21432: `beam.CombineValues` on DataFlow runner causes ambiguous failure with python SDK

2023-01-20 Thread GitBox
MOscity commented on issue #21432: URL: https://github.com/apache/beam/issues/21432#issuecomment-1398541772 Hey, I'm facing the same issue here, whole pipeline works with DirectRunner (all steps), but DataflowRunner fails after 1-3secs and emits no logs. It works fine without the the CountC

[GitHub] [beam] damccorm commented on pull request #25083: Multi language/runinference example

2023-01-20 Thread GitBox
damccorm commented on PR #25083: URL: https://github.com/apache/beam/pull/25083#issuecomment-1398513181 Also, for context for anyone coming across this PR, this is a continuation of https://github.com/apache/beam/pull/24656 The website changes are rendered here - http://apache-beam-w

[GitHub] [beam] damccorm commented on a diff in pull request #25083: Multi language/runinference example

2023-01-20 Thread GitBox
damccorm commented on code in PR #25083: URL: https://github.com/apache/beam/pull/25083#discussion_r1082651068 ## sdks/python/apache_beam/examples/inference/multi_language_inference/last_word_prediction/src/main/java/org/MultiLangRunInference.java: ## @@ -0,0 +1,89 @@ +package o

[GitHub] [beam] johnjcasey merged pull request #25066: [Release-2.45.0] Cherry pick: Set maxConnections optional in incoming schema

2023-01-20 Thread GitBox
johnjcasey merged PR #25066: URL: https://github.com/apache/beam/pull/25066 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apac

[GitHub] [beam] andoni-guzman opened a new pull request, #23149: GA Migration Python PreCommit Portable Commit - Validates Runner Flink

2023-01-20 Thread GitBox
andoni-guzman opened a new pull request, #23149: URL: https://github.com/apache/beam/pull/23149 This PR is part of the migration from jenkins to github actions. This PR contains this tests Python Portable Commit Python PreCommit Validates Runner Flink 2 Files were add

[GitHub] [beam] damccorm merged pull request #25095: Bump cloud.google.com/go/storage from 1.28.1 to 1.29.0 in /sdks

2023-01-20 Thread GitBox
damccorm merged PR #25095: URL: https://github.com/apache/beam/pull/25095 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[GitHub] [beam] dannymartinm opened a new pull request, #23137: [GitHub Actions] - Updates in Cancel to runs-on Self-hosted runners

2023-01-20 Thread GitBox
dannymartinm opened a new pull request, #23137: URL: https://github.com/apache/beam/pull/23137 `DO NOT MERGE until the infrastructure is in place. Please talk to @dannymartinm @elink21 before merging` As part of the issue [21106](https://github.com/apache/beam/issues/21106), @elink21

[GitHub] [beam] ruslan-ikhsan commented on pull request #25100: Playground ci webhook

2023-01-20 Thread GitBox
ruslan-ikhsan commented on PR #25100: URL: https://github.com/apache/beam/pull/25100#issuecomment-1398482428 Opened by mistake -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [beam] ruslan-ikhsan closed pull request #25100: Playground ci webhook

2023-01-20 Thread GitBox
ruslan-ikhsan closed pull request #25100: Playground ci webhook URL: https://github.com/apache/beam/pull/25100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

[GitHub] [beam] ruslan-ikhsan opened a new pull request, #25100: Playground ci webhook

2023-01-20 Thread GitBox
ruslan-ikhsan opened a new pull request, #25100: URL: https://github.com/apache/beam/pull/25100 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution

[GitHub] [beam] damccorm commented on a diff in pull request #25099: Add more info in documentation

2023-01-20 Thread GitBox
damccorm commented on code in PR #25099: URL: https://github.com/apache/beam/pull/25099#discussion_r1082617853 ## website/www/site/content/en/documentation/ml/large-language-modeling.md: ## @@ -25,11 +25,12 @@ RunInference works well on arbitrarily large models as long as they

[GitHub] [beam] MarcoRob opened a new pull request, #23363: GA Migration Python PreCommit Sharding Runners Portability Samza

2023-01-20 Thread GitBox
MarcoRob opened a new pull request, #23363: URL: https://github.com/apache/beam/pull/23363 As part of the migration of Precommit and Postcommit Jobs from Jenkins to GA in self-hosted runners, this PR contains: - Migrated workflow [job-precommit-python-runners-portability-samza.yml](h

[GitHub] [beam] aromanenko-dev commented on pull request #24992: [WIP][Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules

2023-01-20 Thread GitBox
aromanenko-dev commented on PR #24992: URL: https://github.com/apache/beam/pull/24992#issuecomment-1398460707 Run Flink ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [beam] aromanenko-dev commented on pull request #24992: [WIP][Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules

2023-01-20 Thread GitBox
aromanenko-dev commented on PR #24992: URL: https://github.com/apache/beam/pull/24992#issuecomment-1398460435 Run Dataflow ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [beam] aromanenko-dev commented on pull request #24992: [WIP][Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules

2023-01-20 Thread GitBox
aromanenko-dev commented on PR #24992: URL: https://github.com/apache/beam/pull/24992#issuecomment-1398460256 Run Direct ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [beam] aromanenko-dev commented on pull request #24992: [WIP][Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules

2023-01-20 Thread GitBox
aromanenko-dev commented on PR #24992: URL: https://github.com/apache/beam/pull/24992#issuecomment-1398459769 Run Spark ValidatesRunner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [beam] shub-kris commented on pull request #25099: Add more info in documentation

2023-01-20 Thread GitBox
shub-kris commented on PR #25099: URL: https://github.com/apache/beam/pull/25099#issuecomment-1398334631 Hi, @damccorm please find the updated documentation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [beam] shub-kris opened a new pull request, #25099: Add more info in documentation

2023-01-20 Thread GitBox
shub-kris opened a new pull request, #25099: URL: https://github.com/apache/beam/pull/25099 This PR aims to add more information on the arguments required to pass for running the large language model runinference pipeline. Thank you for your contribut

[GitHub] [beam] github-actions[bot] commented on pull request #22619: [Website] update hero section

2023-01-20 Thread GitBox
github-actions[bot] commented on PR #22619: URL: https://github.com/apache/beam/pull/22619#issuecomment-1398331366 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. -- This is

[GitHub] [beam] github-actions[bot] closed pull request #22619: [Website] update hero section

2023-01-20 Thread GitBox
github-actions[bot] closed pull request #22619: [Website] update hero section URL: https://github.com/apache/beam/pull/22619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [beam] github-actions[bot] closed pull request #23137: [GitHub Actions] - Updates in Cancel to runs-on Self-hosted runners

2023-01-20 Thread GitBox
github-actions[bot] closed pull request #23137: [GitHub Actions] - Updates in Cancel to runs-on Self-hosted runners URL: https://github.com/apache/beam/pull/23137 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [beam] github-actions[bot] commented on pull request #23363: GA Migration Python PreCommit Sharding Runners Portability Samza

2023-01-20 Thread GitBox
github-actions[bot] commented on PR #23363: URL: https://github.com/apache/beam/pull/23363#issuecomment-1398331157 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. -- This is

[GitHub] [beam] github-actions[bot] commented on pull request #23137: [GitHub Actions] - Updates in Cancel to runs-on Self-hosted runners

2023-01-20 Thread GitBox
github-actions[bot] commented on PR #23137: URL: https://github.com/apache/beam/pull/23137#issuecomment-1398331264 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. -- This is

[GitHub] [beam] github-actions[bot] commented on pull request #23149: GA Migration Python PreCommit Portable Commit - Validates Runner Flink

2023-01-20 Thread GitBox
github-actions[bot] commented on PR #23149: URL: https://github.com/apache/beam/pull/23149#issuecomment-1398331209 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. -- This is

[GitHub] [beam] github-actions[bot] closed pull request #23149: GA Migration Python PreCommit Portable Commit - Validates Runner Flink

2023-01-20 Thread GitBox
github-actions[bot] closed pull request #23149: GA Migration Python PreCommit Portable Commit - Validates Runner Flink URL: https://github.com/apache/beam/pull/23149 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [beam] github-actions[bot] commented on pull request #23888: Support non-getter (POJO) AutoValues

2023-01-20 Thread GitBox
github-actions[bot] commented on PR #23888: URL: https://github.com/apache/beam/pull/23888#issuecomment-1398331087 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull r

[GitHub] [beam] github-actions[bot] closed pull request #23363: GA Migration Python PreCommit Sharding Runners Portability Samza

2023-01-20 Thread GitBox
github-actions[bot] closed pull request #23363: GA Migration Python PreCommit Sharding Runners Portability Samza URL: https://github.com/apache/beam/pull/23363 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [beam] sirenbyte opened a new pull request, #25098: Tob - IO Connectors

2023-01-20 Thread GitBox
sirenbyte opened a new pull request, #25098: URL: https://github.com/apache/beam/pull/25098 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution quic

[GitHub] [beam] github-actions[bot] commented on pull request #24630: [24469] Implement CsvIO.Write and supporting classes

2023-01-20 Thread GitBox
github-actions[bot] commented on PR #24630: URL: https://github.com/apache/beam/pull/24630#issuecomment-1398298973 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @robertwb f

[GitHub] [beam] github-actions[bot] commented on pull request #24933: fix(sec): upgrade torch to 1.13.1

2023-01-20 Thread GitBox
github-actions[bot] commented on PR #24933: URL: https://github.com/apache/beam/pull/24933#issuecomment-1398298660 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @tvalentyn

[GitHub] [beam] damccorm commented on pull request #25095: Bump cloud.google.com/go/storage from 1.28.1 to 1.29.0 in /sdks

2023-01-20 Thread GitBox
damccorm commented on PR #25095: URL: https://github.com/apache/beam/pull/25095#issuecomment-1398264036 Run Go PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [beam] aromanenko-dev commented on pull request #24992: [WIP][Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules

2023-01-20 Thread GitBox
aromanenko-dev commented on PR #24992: URL: https://github.com/apache/beam/pull/24992#issuecomment-1398181872 Run Java PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [beam] TSultanov commented on a diff in pull request #24946: [Playground] Resolve issue with SCIO examples failing on start due to a timeout

2023-01-20 Thread GitBox
TSultanov commented on code in PR #24946: URL: https://github.com/apache/beam/pull/24946#discussion_r1082318716 ## playground/backend/containers/scio/Dockerfile: ## @@ -84,4 +83,18 @@ RUN chown -R appuser:appgroup /opt/playground/backend/executable_files/ \ # Switch to appuser

[GitHub] [beam] olehborysevych opened a new issue, #25097: [Tour of Beam] [Task] Process template hints for examples and challenges

2023-01-20 Thread GitBox
olehborysevych opened a new issue, #25097: URL: https://github.com/apache/beam/issues/25097 ### What needs to happen? Hints for ToB challenges need to support templates for different SDKs ### Issue Priority Priority: 3 ### Component tour-of-beam -- This is an automat

[GitHub] [beam] sirenbyte commented on issue #25087: [Tour of Beam] [Task] Extend Introduction Module with Runner information for Go SDK

2023-01-20 Thread GitBox
sirenbyte commented on issue #25087: URL: https://github.com/apache/beam/issues/25087#issuecomment-1398087489 .take-issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [beam] reuvenlax merged pull request #24145: Handle updates to table schema when using Storage API writes.

2023-01-19 Thread GitBox
reuvenlax merged PR #24145: URL: https://github.com/apache/beam/pull/24145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apach

[GitHub] [beam] prodriguezdefino commented on a diff in pull request #25094: Externalizing the StreamWriter parameters for StorageWrites

2023-01-19 Thread GitBox
prodriguezdefino commented on code in PR #25094: URL: https://github.com/apache/beam/pull/25094#discussion_r1082184017 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryOptions.java: ## @@ -109,6 +109,20 @@ void setNumStorageWri

[GitHub] [beam] andres-vv commented on pull request #24656: Cross Language RunInference

2023-01-19 Thread GitBox
andres-vv commented on PR #24656: URL: https://github.com/apache/beam/pull/24656#issuecomment-1398017714 No definitely not, something went wrong when I rebased and this PR got closed. I made a new one with all the requested changes https://github.com/apache/beam/pull/25083 -- This

[GitHub] [beam] reuvenlax commented on a diff in pull request #25094: Externalizing the StreamWriter parameters for StorageWrites

2023-01-19 Thread GitBox
reuvenlax commented on code in PR #25094: URL: https://github.com/apache/beam/pull/25094#discussion_r1082144502 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryOptions.java: ## @@ -109,6 +109,20 @@ void setNumStorageWriteApiSt

[GitHub] [beam] jvnuw commented on issue #25096: [Feature Request]: Parameterized Query support in Go BigQuery IO connector

2023-01-19 Thread GitBox
jvnuw commented on issue #25096: URL: https://github.com/apache/beam/issues/25096#issuecomment-1397934887 .take-issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [beam] jvnuw opened a new issue, #25096: [Feature Request]: Parameterized Query support in Go BigQuery IO connector

2023-01-19 Thread GitBox
jvnuw opened a new issue, #25096: URL: https://github.com/apache/beam/issues/25096 ### What would you like to happen? The standard BigQuery library for Go supports [parameterized queries](https://cloud.google.com/bigquery/docs/parameterized-queries#go), and the BigQuery IO connector

[GitHub] [beam] github-actions[bot] commented on pull request #25095: Bump cloud.google.com/go/storage from 1.28.1 to 1.29.0 in /sdks

2023-01-19 Thread GitBox
github-actions[bot] commented on PR #25095: URL: https://github.com/apache/beam/pull/25095#issuecomment-1397913438 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damccorm for label go. Available commands: - `stop revi

[GitHub] [beam] codecov[bot] commented on pull request #25095: Bump cloud.google.com/go/storage from 1.28.1 to 1.29.0 in /sdks

2023-01-19 Thread GitBox
codecov[bot] commented on PR #25095: URL: https://github.com/apache/beam/pull/25095#issuecomment-1397908772 # [Codecov](https://codecov.io/gh/apache/beam/pull/25095?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Fo

[GitHub] [beam] dependabot[bot] opened a new pull request, #25095: Bump cloud.google.com/go/storage from 1.28.1 to 1.29.0 in /sdks

2023-01-19 Thread GitBox
dependabot[bot] opened a new pull request, #25095: URL: https://github.com/apache/beam/pull/25095 Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.28.1 to 1.29.0. Release notes Sourced from https://github.com/googleapis/google-cloud-go/rele

[GitHub] [beam] github-actions[bot] commented on pull request #25094: Externalizing the StreamWriter parameters for StorageWrites

2023-01-19 Thread GitBox
github-actions[bot] commented on PR #25094: URL: https://github.com/apache/beam/pull/25094#issuecomment-1397894081 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

[GitHub] [beam] prodriguezdefino commented on pull request #25094: Externalizing the StreamWriter parameters for StorageWrites

2023-01-19 Thread GitBox
prodriguezdefino commented on PR #25094: URL: https://github.com/apache/beam/pull/25094#issuecomment-1397893401 R: @reuvenlax -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [beam] prodriguezdefino opened a new pull request, #25094: Externalizing the StreamWriter parameters for StorageWrites

2023-01-19 Thread GitBox
prodriguezdefino opened a new pull request, #25094: URL: https://github.com/apache/beam/pull/25094 This change adds the possibility of configuring the amount of inflight messages or bytes the underlying StreamWriter holds at the connection level before start channeling the new request to a

[GitHub] [beam] Abacn commented on issue #24535: [Bug]: Bigquery Load jobs with WRITE_TRUNCATE disposition may truncate valid records.

2023-01-19 Thread GitBox
Abacn commented on issue #24535: URL: https://github.com/apache/beam/issues/24535#issuecomment-1397889109 The bug can still occur when the number of files are greater than 10,000 then bigquery load jobs will be conducted in multiple partitions: https://github.com/apache/beam/blob/428ec97e30

[GitHub] [beam] robertwb opened a new issue, #24535: [Bug]: Bigquery Load jobs with WRITE_TRUNCATE disposition may truncate valid records.

2023-01-19 Thread GitBox
robertwb opened a new issue, #24535: URL: https://github.com/apache/beam/issues/24535 ### What happened? `TriggerCopyJobs` was written to assume all jobs belonging to the same table are processed by the same bundle, but this precondition appears to have been invalidated with future c

[GitHub] [beam] Abacn commented on issue #18267: beam.io.BigQuerySink Python SDK does not support WRITE_TRUNCATE write disposition when specifying table with partition decorator

2023-01-19 Thread GitBox
Abacn commented on issue #18267: URL: https://github.com/apache/beam/issues/18267#issuecomment-1397876866 BigQuerySink is deprecated since Beam v2.11.0. This task my ends with won't do. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [beam] tvalentyn commented on pull request #24725: Update upper bound for numpy.

2023-01-19 Thread GitBox
tvalentyn commented on PR #24725: URL: https://github.com/apache/beam/pull/24725#issuecomment-1397873408 Dataframes (ParquetIO) test requires numpy<1.20.0, this is a preexisting issue: https://github.com/apache/beam/blob/428ec97e30cc6587c2ae0f81d3ba44a8a9b34f93/sdks/python/tox.ini#L286 , a

[GitHub] [beam] Abacn commented on issue #25014: TypeError: Cannot convert GlobalWindow to apache_beam.utils.windowed_value._IntervalWindowBase

2023-01-19 Thread GitBox
Abacn commented on issue #25014: URL: https://github.com/apache/beam/issues/25014#issuecomment-1397838767 thanks for reporting. Sounds like this is intermittent which makes it hard to investigate. Will try to investigate. -- This is an automated message from the Apache Git Service. To res

[GitHub] [beam] tvalentyn commented on pull request #24725: Update upper bound for numpy.

2023-01-19 Thread GitBox
tvalentyn commented on PR #24725: URL: https://github.com/apache/beam/pull/24725#issuecomment-1397824135 Run Python 3.8 PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [beam] rohdesamuel opened a new pull request, #25093: [DRAFT] Task #25064: Python SDK Data sampling implementation

2023-01-19 Thread GitBox
rohdesamuel opened a new pull request, #25093: URL: https://github.com/apache/beam/pull/25093 This adds the capability for the Python SDK to sample in-flight elements. The implementation modifies the ProcessBundleDescriptor when received by the BundleProcessor to create additional DataSampl

[GitHub] [beam] tvalentyn commented on pull request #24725: Update upper bound for numpy.

2023-01-19 Thread GitBox
tvalentyn commented on PR #24725: URL: https://github.com/apache/beam/pull/24725#issuecomment-1397814614 Interactive runner tests need a fix in facets-overview: https://github.com/PAIR-code/facets/pull/250 -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [beam] tvalentyn commented on pull request #24725: Update upper bound for numpy.

2023-01-19 Thread GitBox
tvalentyn commented on PR #24725: URL: https://github.com/apache/beam/pull/24725#issuecomment-1397813354 cc: @jli -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [beam] nathancCG commented on issue #25014: TypeError: Cannot convert GlobalWindow to apache_beam.utils.windowed_value._IntervalWindowBase

2023-01-19 Thread GitBox
nathancCG commented on issue #25014: URL: https://github.com/apache/beam/issues/25014#issuecomment-1397798710 @Abacn Yes. Beam version: python sdk 2.43.0. Succeeded job and failed job both running on 2.43.0. After we restarted a new job with same code this error is not been seen yet. --

[GitHub] [beam] tvalentyn merged pull request #24834: improve error message for mismatched pipelines

2023-01-19 Thread GitBox
tvalentyn merged PR #24834: URL: https://github.com/apache/beam/pull/24834 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apach

[GitHub] [beam] chamikaramj commented on a diff in pull request #24667: Initial start of a yaml-based declarative way of building pipelines.

2023-01-19 Thread GitBox
chamikaramj commented on code in PR #24667: URL: https://github.com/apache/beam/pull/24667#discussion_r1080651152 ## sdks/python/apache_beam/yaml/main.py: ## @@ -0,0 +1,56 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreemen

[GitHub] [beam] github-actions[bot] commented on pull request #25083: Multi language/runinference example

2023-01-19 Thread GitBox
github-actions[bot] commented on PR #25083: URL: https://github.com/apache/beam/pull/25083#issuecomment-1397760357 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

[GitHub] [beam] tvalentyn commented on pull request #24834: improve error message for mismatched pipelines

2023-01-19 Thread GitBox
tvalentyn commented on PR #24834: URL: https://github.com/apache/beam/pull/24834#issuecomment-1397756876 Linter errors should be fixed, we can merge once tests run. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [beam] tvalentyn commented on a diff in pull request #24834: improve error message for mismatched pipelines

2023-01-19 Thread GitBox
tvalentyn commented on code in PR #24834: URL: https://github.com/apache/beam/pull/24834#discussion_r1081983122 ## sdks/python/apache_beam/transforms/util.py: ## @@ -234,7 +234,8 @@ def expand(self, pcolls): for pcoll in pcolls.values(): self._check_pcollection(pcoll

[GitHub] [beam] kileys closed pull request #23834: [DO NOT MERGE] Testing dep versions

2023-01-19 Thread GitBox
kileys closed pull request #23834: [DO NOT MERGE] Testing dep versions URL: https://github.com/apache/beam/pull/23834 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[GitHub] [beam] kileys closed pull request #24323: [DO NOT MERGE] Verify dependency version patches

2023-01-19 Thread GitBox
kileys closed pull request #24323: [DO NOT MERGE] Verify dependency version patches URL: https://github.com/apache/beam/pull/24323 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [beam] kileys closed pull request #23912: [DO NOT MERGE] Test failures

2023-01-19 Thread GitBox
kileys closed pull request #23912: [DO NOT MERGE] Test failures URL: https://github.com/apache/beam/pull/23912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

[GitHub] [beam] tvalentyn commented on a diff in pull request #24834: improve error message for mismatched pipelines

2023-01-19 Thread GitBox
tvalentyn commented on code in PR #24834: URL: https://github.com/apache/beam/pull/24834#discussion_r1081979119 ## sdks/python/apache_beam/transforms/util.py: ## @@ -234,7 +234,8 @@ def expand(self, pcolls): for pcoll in pcolls.values(): self._check_pcollection(pcoll

[GitHub] [beam] tvalentyn commented on pull request #24834: improve error message for mismatched pipelines

2023-01-19 Thread GitBox
tvalentyn commented on PR #24834: URL: https://github.com/apache/beam/pull/24834#issuecomment-1397746924 see also: s.apache.org/beam-python-dev-wiki which talks about how to run linter locally during development. -- This is an automated message from the Apache Git Service. To respond to t

[GitHub] [beam] tvalentyn commented on pull request #24834: improve error message for mismatched pipelines

2023-01-19 Thread GitBox
tvalentyn commented on PR #24834: URL: https://github.com/apache/beam/pull/24834#issuecomment-1397746658 Apologies for the long response, I was OOO for a bit. Thanks for the fix! Precommit errors are most likely a flake, we can re-run the suite. Lint errors is visible if you follow t

[GitHub] [beam] alnzng commented on a diff in pull request #25031: Allow to set timeout for finishing a remote bundle in Samza portable runner

2023-01-19 Thread GitBox
alnzng commented on code in PR #25031: URL: https://github.com/apache/beam/pull/25031#discussion_r1081971707 ## runners/samza/src/main/java/org/apache/beam/runners/samza/util/RunWithTimeout.java: ## @@ -0,0 +1,42 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [beam] tvalentyn closed issue #19929: Relax version of httplib2

2023-01-19 Thread GitBox
tvalentyn closed issue #19929: Relax version of httplib2 URL: https://github.com/apache/beam/issues/19929 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[GitHub] [beam] tvalentyn merged pull request #24573: Bump httplib2 upper bound to 0.22.0.

2023-01-19 Thread GitBox
tvalentyn merged PR #24573: URL: https://github.com/apache/beam/pull/24573 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apach

[GitHub] [beam] tvalentyn commented on pull request #24573: Bump httplib2 upper bound to 0.22.0.

2023-01-19 Thread GitBox
tvalentyn commented on PR #24573: URL: https://github.com/apache/beam/pull/24573#issuecomment-1397738682 Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [beam] tvalentyn commented on pull request #24573: Bump httplib2 upper bound to 0.22.0.

2023-01-19 Thread GitBox
tvalentyn commented on PR #24573: URL: https://github.com/apache/beam/pull/24573#issuecomment-1397738425 The remaining flake has been addressed in a different PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [beam] lukecwik commented on a diff in pull request #25048: Don't validate trailing whitespace for *.md files.

2023-01-19 Thread GitBox
lukecwik commented on code in PR #25048: URL: https://github.com/apache/beam/pull/25048#discussion_r1081958868 ## sdks/python/test-suites/tox/py38/build.gradle: ## @@ -120,7 +120,6 @@ task archiveFilesToLint(type: Zip) { destinationDirectory = file("$buildDir/dist") from

[GitHub] [beam] Abacn closed issue #23487: [Task]: Eliminate google-python-cloud-debugger dependency in base_image_requirements

2023-01-19 Thread GitBox
Abacn closed issue #23487: [Task]: Eliminate google-python-cloud-debugger dependency in base_image_requirements URL: https://github.com/apache/beam/issues/23487 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [beam] Abacn merged pull request #25088: Eliminate google-python-cloud-debugger dependency in base_image_requirements

2023-01-19 Thread GitBox
Abacn merged PR #25088: URL: https://github.com/apache/beam/pull/25088 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

[GitHub] [beam] Abacn commented on pull request #25088: Eliminate google-python-cloud-debugger dependency in base_image_requirements

2023-01-19 Thread GitBox
Abacn commented on PR #25088: URL: https://github.com/apache/beam/pull/25088#issuecomment-1397703203 yeah thanks for reminding. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [beam] kennknowles commented on pull request #25055: Remove trailing whitespace from blog to fix precommit

2023-01-19 Thread GitBox
kennknowles commented on PR #25055: URL: https://github.com/apache/beam/pull/25055#issuecomment-1397698255 This alters `` to `` does it not? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [beam] kennknowles commented on a diff in pull request #25048: Don't validate trailing whitespace for *.md files.

2023-01-19 Thread GitBox
kennknowles commented on code in PR #25048: URL: https://github.com/apache/beam/pull/25048#discussion_r1081938409 ## sdks/python/test-suites/tox/py38/build.gradle: ## @@ -120,7 +120,6 @@ task archiveFilesToLint(type: Zip) { destinationDirectory = file("$buildDir/dist") f

[GitHub] [beam] tvalentyn commented on pull request #25083: Multi language/runinference example

2023-01-19 Thread GitBox
tvalentyn commented on PR #25083: URL: https://github.com/apache/beam/pull/25083#issuecomment-1397696321 R: @chamikaramj @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [beam] tvalentyn commented on pull request #24656: Cross Language RunInference

2023-01-19 Thread GitBox
tvalentyn commented on PR #24656: URL: https://github.com/apache/beam/pull/24656#issuecomment-1397696137 I am seeing a new PR https://github.com/apache/beam/pull/25083 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [beam] tvalentyn commented on pull request #25088: Eliminate google-python-cloud-debugger dependency in base_image_requirements

2023-01-19 Thread GitBox
tvalentyn commented on PR #25088: URL: https://github.com/apache/beam/pull/25088#issuecomment-1397691857 noting that this CL doesn't regenerate the dependencies, but this happens regularly, and done at least before a release. -- This is an automated message from the Apache Git Service. To

[GitHub] [beam] pabloem merged pull request #25023: [Website] update content of community case study page

2023-01-19 Thread GitBox
pabloem merged PR #25023: URL: https://github.com/apache/beam/pull/25023 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.

  1   2   3   4   5   6   7   8   9   10   >