[GitHub] [beam] github-actions[bot] commented on pull request #28432: Github Workflow Replacement for Jenkins Jobs, beam_PostCommit_XVR_*

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28432: URL: https://github.com/apache/beam/pull/28432#issuecomment-1718816166 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damccorm for label build. Available commands: - `stop r

[GitHub] [beam] magicgoody opened a new pull request, #28445: Add Publish JUnit Test Results Action

2023-09-13 Thread via GitHub
magicgoody opened a new pull request, #28445: URL: https://github.com/apache/beam/pull/28445 This PR was created to add an action that visualize the results of JUnit tests and adds them to the workflow summary page and the PR page (if the PR exists). Related merged PR, implemented on

[GitHub] [beam] lostluck commented on pull request #28444: Prism docker env

2023-09-13 Thread via GitHub
lostluck commented on PR #28444: URL: https://github.com/apache/beam/pull/28444#issuecomment-1718719159 Ah dang it. This is not yet ready. Please disregard. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [beam] lostluck merged pull request #28441: use go 1.21.1 for build

2023-09-13 Thread via GitHub
lostluck merged PR #28441: URL: https://github.com/apache/beam/pull/28441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[GitHub] [beam] reuvenlax commented on issue #27892: [Bug]: ignoreUnknownValues not working when using CreateDisposition.CREATE_IF_NEEDED

2023-09-13 Thread via GitHub
reuvenlax commented on issue #27892: URL: https://github.com/apache/beam/issues/27892#issuecomment-1718714198 The storage write API requires us to pass in a schema when we open a connection to it, and that schema must match the actual table schema. This is the schema you pass into withSchem

[GitHub] [beam] meowcakes commented on issue #23439: [Bug]: Spark "uber jar" job server fails on cluster with NoSuchFileException

2023-09-13 Thread via GitHub
meowcakes commented on issue #23439: URL: https://github.com/apache/beam/issues/23439#issuecomment-1718693206 Any updates on this? It still seems like an issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [beam] github-actions[bot] commented on pull request #28444: Prism docker env

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28444: URL: https://github.com/apache/beam/pull/28444#issuecomment-1718544231 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @jrmccluskey for label go. Available commands: - `stop r

[GitHub] [beam] arunpandianp commented on a diff in pull request #28442: Sets recommended max Xmx 32G when set_recommended_max_xmx experiment is enabled

2023-09-13 Thread via GitHub
arunpandianp commented on code in PR #28442: URL: https://github.com/apache/beam/pull/28442#discussion_r1325227187 ## sdks/java/container/boot.go: ## @@ -266,9 +267,12 @@ func makePipelineOptionsFile(options string) error { // it returns 70% of the physical memory on the machin

[GitHub] [beam] arunpandianp commented on a diff in pull request #28442: Sets recommended max Xmx 32G when set_recommended_max_xmx experiment is enabled

2023-09-13 Thread via GitHub
arunpandianp commented on code in PR #28442: URL: https://github.com/apache/beam/pull/28442#discussion_r1325227187 ## sdks/java/container/boot.go: ## @@ -266,9 +267,12 @@ func makePipelineOptionsFile(options string) error { // it returns 70% of the physical memory on the machin

[GitHub] [beam] robertwb merged pull request #28114: [yaml] Add UDF support to mapping transforms

2023-09-13 Thread via GitHub
robertwb merged PR #28114: URL: https://github.com/apache/beam/pull/28114 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[GitHub] [beam] github-actions[bot] commented on pull request #28441: use go 1.21.1 for build

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28441: URL: https://github.com/apache/beam/pull/28441#issuecomment-1718495696 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn for label build. Available commands: - `stop revi

[GitHub] [beam] codecov[bot] commented on pull request #28444: Prism docker env

2023-09-13 Thread via GitHub
codecov[bot] commented on PR #28444: URL: https://github.com/apache/beam/pull/28444#issuecomment-1718492854 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/28444?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

[GitHub] [beam] lostluck opened a new pull request, #28444: Prism docker env

2023-09-13 Thread via GitHub
lostluck opened a new pull request, #28444: URL: https://github.com/apache/beam/pull/28444 Enable support for using docker containers with prism. * Artifact service is current all In Memory, rather than a local file cache. * Artifact service is going to be global for a given instanc

[GitHub] [beam] github-actions[bot] commented on pull request #28442: Sets recommended max Xmx 32G when set_recommended_max_xmx experiment is enabled

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28442: URL: https://github.com/apache/beam/pull/28442#issuecomment-1718444208 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

[GitHub] [beam] github-actions[bot] commented on pull request #28443: Bump HCLS API [08/30]

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28443: URL: https://github.com/apache/beam/pull/28443#issuecomment-1718440700 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

[GitHub] [beam] github-actions[bot] commented on pull request #28443: Bump HCLS API [08/30]

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28443: URL: https://github.com/apache/beam/pull/28443#issuecomment-1718423552 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

[GitHub] [beam] codecov[bot] commented on pull request #28443: Bump HCLS API [08/30]

2023-09-13 Thread via GitHub
codecov[bot] commented on PR #28443: URL: https://github.com/apache/beam/pull/28443#issuecomment-1718412959 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/28443?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

[GitHub] [beam] svetakvsundhar opened a new pull request, #28443: Bump HCLS API [08/30]

2023-09-13 Thread via GitHub
svetakvsundhar opened a new pull request, #28443: URL: https://github.com/apache/beam/pull/28443 Bumping client to `com.google.apis:google-api-services-healthcare:v1-rev20230830` Thank you for your contribution! Follow this checklist to help us incorpo

[GitHub] [beam] udim commented on pull request #28403: Add flag to control automatic exception sampling in Java (disabled)

2023-09-13 Thread via GitHub
udim commented on PR #28403: URL: https://github.com/apache/beam/pull/28403#issuecomment-1718397271 Run Java PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [beam] udim merged pull request #28418: Add flag to control automatic exception sampling in Python (disabled)

2023-09-13 Thread via GitHub
udim merged PR #28418: URL: https://github.com/apache/beam/pull/28418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.org

[GitHub] [beam] arvindram03 opened a new pull request, #28442: Sets recommended max Xmx 32G when set_recommended_max_xmx experiment is enabled

2023-09-13 Thread via GitHub
arvindram03 opened a new pull request, #28442: URL: https://github.com/apache/beam/pull/28442 We set the Xmx to the recommended max value(32G) with set_recommended_max_xmx is enabled. Under 32G JVM enables CompressedOops. CompressedOops utilizes memory more efficiently, and has positive

[GitHub] [beam] codecov[bot] commented on pull request #28437: Bump pyarrow upper bound

2023-09-13 Thread via GitHub
codecov[bot] commented on PR #28437: URL: https://github.com/apache/beam/pull/28437#issuecomment-1718360533 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/28437?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

[GitHub] [beam] codecov[bot] commented on pull request #28441: use go 1.21.1 for build

2023-09-13 Thread via GitHub
codecov[bot] commented on PR #28441: URL: https://github.com/apache/beam/pull/28441#issuecomment-1718356100 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/28441?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

[GitHub] [beam] Abacn commented on a diff in pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28274: URL: https://github.com/apache/beam/pull/28274#discussion_r1325089805 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java: ## @@ -669,9 +668,17 @@ public GenericDatumTransformer( S

[GitHub] [beam] liferoad opened a new pull request, #28441: use go 1.21.1 for build

2023-09-13 Thread via GitHub
liferoad opened a new pull request, #28441: URL: https://github.com/apache/beam/pull/28441 Fix [CVE-2023-39320](https://security-tracker.debian.org/tracker/CVE-2023-39320 Thank you for your contribution! Follow this checklist to help us incorporate yo

[GitHub] [beam] Abacn merged pull request #28434: Revert "Fix flaky test StreamingDataflowWorkerTest"

2023-09-13 Thread via GitHub
Abacn merged PR #28434: URL: https://github.com/apache/beam/pull/28434 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

[GitHub] [beam] Abacn commented on a diff in pull request #28440: Fix Java PreCommit Action correct branch to run

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28440: URL: https://github.com/apache/beam/pull/28440#discussion_r1325076983 ## .github/workflows/beam_PreCommit_Java.yml: ## @@ -172,10 +173,11 @@ jobs: -PdisableSpotlessCheck=true \ -PdisableCheckStyle=true \ - na

[GitHub] [beam] Abacn commented on pull request #28440: Fix Java PreCommit Action correct branch to run

2023-09-13 Thread via GitHub
Abacn commented on PR #28440: URL: https://github.com/apache/beam/pull/28440#issuecomment-1718308043 using a script checked that this the only one missed `./.github/actions/setup-action` (by searching `uses: actions/checkout` and no `.github/actions/setup-action`) -- This is an automated

[GitHub] [beam] github-actions[bot] commented on pull request #28440: Fix Java PreCommit Action correct branch to run

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28440: URL: https://github.com/apache/beam/pull/28440#issuecomment-1718307505 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

[GitHub] [beam] damccorm commented on a diff in pull request #28440: Fix Java PreCommit Action correct branch to run

2023-09-13 Thread via GitHub
damccorm commented on code in PR #28440: URL: https://github.com/apache/beam/pull/28440#discussion_r1325070157 ## .github/workflows/beam_PreCommit_Java.yml: ## @@ -172,10 +173,11 @@ jobs: -PdisableSpotlessCheck=true \ -PdisableCheckStyle=true \ -

[GitHub] [beam] Abacn opened a new pull request, #28440: Fix Java PreCommit Action correct branch to run

2023-09-13 Thread via GitHub
Abacn opened a new pull request, #28440: URL: https://github.com/apache/beam/pull/28440 Found in https://github.com/apache/beam/pull/28434#issuecomment-1718278586 Also addressing https://github.com/apache/beam/pull/28075#issuecomment-1714652977 * Also upload human readable test

[GitHub] [beam] Abacn commented on pull request #28440: Fix Java PreCommit Action correct branch to run

2023-09-13 Thread via GitHub
Abacn commented on PR #28440: URL: https://github.com/apache/beam/pull/28440#issuecomment-1718305557 R: @andreydevyatkin @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [beam] damccorm commented on a diff in pull request #28439: Migrate "beam_PostCommit_Python_ValidatesRunner_*" Jenkins jobs to GitHub Actions

2023-09-13 Thread via GitHub
damccorm commented on code in PR #28439: URL: https://github.com/apache/beam/pull/28439#discussion_r1325057213 ## .github/workflows/beam_PostCommit_Python_ValidatesRunner_Flink.yml: ## @@ -0,0 +1,108 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# con

[GitHub] [beam] github-actions[bot] commented on pull request #28439: Migrate "beam_PostCommit_Python_ValidatesRunner_*" Jenkins jobs to GitHub Actions

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28439: URL: https://github.com/apache/beam/pull/28439#issuecomment-1718282795 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damccorm for label build. Available commands: - `stop r

[GitHub] [beam] damondouglas commented on pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
damondouglas commented on PR #28274: URL: https://github.com/apache/beam/pull/28274#issuecomment-1718279824 @johnjcasey / @Abacn `Java_GCP_IO_Direct` keeps failing for a reason seemingly independent of this PR's code changes. I was able to validate these changes on my own running the two gr

[GitHub] [beam] Abacn commented on pull request #28434: Revert "Fix flaky test StreamingDataflowWorkerTest"

2023-09-13 Thread via GitHub
Abacn commented on PR #28434: URL: https://github.com/apache/beam/pull/28434#issuecomment-1718278586 Ironically the PreCommit GitHub Action still fails this test even it's reverted in this PR: https://github.com/apache/beam/actions/runs/6174695355/job/16759856184?pr=28434 ``` ```

[GitHub] [beam] damondouglas commented on a diff in pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
damondouglas commented on code in PR #28274: URL: https://github.com/apache/beam/pull/28274#discussion_r1325047291 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java: ## @@ -669,9 +668,17 @@ public GenericDatumTransformer(

[GitHub] [beam] Abacn merged pull request #28196: Add PostCommit Go github action

2023-09-13 Thread via GitHub
Abacn merged PR #28196: URL: https://github.com/apache/beam/pull/28196 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

[GitHub] [beam] Abacn merged pull request #28207: Add GitHub Workflow Replacement for Jenkins job_PostCommit_Java

2023-09-13 Thread via GitHub
Abacn merged PR #28207: URL: https://github.com/apache/beam/pull/28207 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

[GitHub] [beam] Abacn commented on a diff in pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28274: URL: https://github.com/apache/beam/pull/28274#discussion_r1325013235 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java: ## @@ -689,7 +696,7 @@ public void setSchema(org.apache.avro.Schem

[GitHub] [beam] Abacn commented on a diff in pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28274: URL: https://github.com/apache/beam/pull/28274#discussion_r1325013235 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java: ## @@ -689,7 +696,7 @@ public void setSchema(org.apache.avro.Schem

[GitHub] [beam] andreydevyatkin opened a new pull request, #28439: Migrate "beam_PostCommit_Python_ValidatesRunner_*" Jenkins jobs to GitHub Actions

2023-09-13 Thread via GitHub
andreydevyatkin opened a new pull request, #28439: URL: https://github.com/apache/beam/pull/28439 The following jenkins jobs have been migrated: - https://ci-beam.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/ - https://ci-beam.apache.org/job/beam_PostCommit_Python_Va

[GitHub] [beam] Abacn commented on a diff in pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28274: URL: https://github.com/apache/beam/pull/28274#discussion_r1325000766 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java: ## @@ -721,16 +728,9 @@ public static TypedRead read(Serializabl

[GitHub] [beam] Abacn commented on a diff in pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28274: URL: https://github.com/apache/beam/pull/28274#discussion_r1324984327 ## sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java: ## @@ -689,7 +696,7 @@ public void setSchema(org.apache.avro.Schem

[GitHub] [beam] tvalentyn commented on issue #27221: Support Pandas==2.x in Apache Beam.

2023-09-13 Thread via GitHub
tvalentyn commented on issue #27221: URL: https://github.com/apache/beam/issues/27221#issuecomment-1718199854 Thanks a lot for stepping in to help with this effort, @caneff . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] tvalentyn merged pull request #28375: Remove level and errors arguments for Pandas 2 compatibility.

2023-09-13 Thread via GitHub
tvalentyn merged PR #28375: URL: https://github.com/apache/beam/pull/28375 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apach

[GitHub] [beam] tvalentyn merged pull request #28396: Remove append method for Pandas >= 2.0.

2023-09-13 Thread via GitHub
tvalentyn merged PR #28396: URL: https://github.com/apache/beam/pull/28396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apach

[GitHub] [beam] tvalentyn commented on pull request #28434: Revert "Fix flaky test StreamingDataflowWorkerTest"

2023-09-13 Thread via GitHub
tvalentyn commented on PR #28434: URL: https://github.com/apache/beam/pull/28434#issuecomment-1718192066 LGTM, thanks. Sorry about the noise it caused. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [beam] sjvanrossum commented on pull request #28389: Add missing access modifiers to SimpleRateLimitPolicy

2023-09-13 Thread via GitHub
sjvanrossum commented on PR #28389: URL: https://github.com/apache/beam/pull/28389#issuecomment-1718174564 Run Java PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [beam] rohdesamuel commented on pull request #28418: Add flag to control automatic exception sampling in Python (disabled)

2023-09-13 Thread via GitHub
rohdesamuel commented on PR #28418: URL: https://github.com/apache/beam/pull/28418#issuecomment-1718108148 Run Portable_Python PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [beam] damccorm merged pull request #28436: Unpin transformers for pydoc

2023-09-13 Thread via GitHub
damccorm merged PR #28436: URL: https://github.com/apache/beam/pull/28436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[GitHub] [beam] tvalentyn opened a new pull request, #28437: Update setup.py

2023-09-13 Thread via GitHub
tvalentyn opened a new pull request, #28437: URL: https://github.com/apache/beam/pull/28437 Upgrade allowed pyarrow dependency **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to h

[GitHub] [beam] Polber commented on pull request #28114: [yaml] Add UDF support to mapping transforms

2023-09-13 Thread via GitHub
Polber commented on PR #28114: URL: https://github.com/apache/beam/pull/28114#issuecomment-1718058283 > > @robertwb I was having some issues getting the js2py library to pickle with cloudpickle, and then later had issues with portablerunner tests that were pickling js2py with dill pickle, b

[GitHub] [beam] github-actions[bot] commented on pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28274: URL: https://github.com/apache/beam/pull/28274#issuecomment-1718054833 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

[GitHub] [beam] damondouglas commented on pull request #28274: Remove TableSchema to JSON conversion.

2023-09-13 Thread via GitHub
damondouglas commented on PR #28274: URL: https://github.com/apache/beam/pull/28274#issuecomment-1718053021 R: @johnjcasey :-) Thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [beam] github-actions[bot] commented on pull request #28436: Unpin transformers for pydoc

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28436: URL: https://github.com/apache/beam/pull/28436#issuecomment-1718044415 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @AnandInguva for label python. Available commands: - `st

[GitHub] [beam] codecov[bot] commented on pull request #28436: Unpin transformers for pydoc

2023-09-13 Thread via GitHub
codecov[bot] commented on PR #28436: URL: https://github.com/apache/beam/pull/28436#issuecomment-1717951471 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/28436?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report

[GitHub] [beam] riteshghorse opened a new pull request, #28436: Unpin transformers for pydoc

2023-09-13 Thread via GitHub
riteshghorse opened a new pull request, #28436: URL: https://github.com/apache/beam/pull/28436 Since torch is added to `autodoc_mock_import`, when importing transformers it throws an error when importing `from transformers import Pipeline`. In one of the steps it checks the `torch.__version

[GitHub] [beam] rohdesamuel commented on pull request #28418: Add flag to control automatic exception sampling in Python (disabled)

2023-09-13 Thread via GitHub
rohdesamuel commented on PR #28418: URL: https://github.com/apache/beam/pull/28418#issuecomment-1717922750 Run Python_Runners PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [beam] rohdesamuel commented on pull request #28403: Add flag to control automatic exception sampling in Java (disabled)

2023-09-13 Thread via GitHub
rohdesamuel commented on PR #28403: URL: https://github.com/apache/beam/pull/28403#issuecomment-1717922174 Run Java PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [beam] damccorm opened a new pull request, #28435: Reenable TestFhirIO.* on GHA

2023-09-13 Thread via GitHub
damccorm opened a new pull request, #28435: URL: https://github.com/apache/beam/pull/28435 I updated the service account with the appropriate permissions needed and ran this successfully - https://github.com/apache/beam/actions/runs/6174868819 Fixes #28227 -

[GitHub] [beam] github-actions[bot] commented on pull request #28434: Revert "Fix flaky test StreamingDataflowWorkerTest"

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28434: URL: https://github.com/apache/beam/pull/28434#issuecomment-1717878407 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

[GitHub] [beam] Abacn commented on pull request #28434: Revert "Fix flaky test StreamingDataflowWorkerTest"

2023-09-13 Thread via GitHub
Abacn commented on PR #28434: URL: https://github.com/apache/beam/pull/28434#issuecomment-1717875812 R: @tvalentyn CC: @olalamichelle thanks willing to dig into this in the original PR. The branch hash is stay so we can always come back and investigate. For now I would propose this chan

[GitHub] [beam] github-actions[bot] commented on pull request #28411: Add Python Load Tests FnApiRunner Microbenchmark github action

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28411: URL: https://github.com/apache/beam/pull/28411#issuecomment-1717871099 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn for label build. Available commands: - `stop revi

[GitHub] [beam] ahmedabu98 merged pull request #28312: Add file loads streaming integration tests

2023-09-13 Thread via GitHub
ahmedabu98 merged PR #28312: URL: https://github.com/apache/beam/pull/28312 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apac

[GitHub] [beam] github-actions[bot] commented on pull request #28431: Add Python Load Tests Combine Dataflow Batch github action

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28431: URL: https://github.com/apache/beam/pull/28431#issuecomment-1717870926 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damccorm for label build. Available commands: - `stop r

[GitHub] [beam] ahmedabu98 commented on pull request #28312: Add file loads streaming integration tests

2023-09-13 Thread via GitHub
ahmedabu98 commented on PR #28312: URL: https://github.com/apache/beam/pull/28312#issuecomment-1717867057 > is the test specified specific zone No specific zone for these tests, they all default to US multi-region -- This is an automated message from the Apache Git Service. To resp

[GitHub] [beam] ahmedabu98 commented on a diff in pull request #28312: Add file loads streaming integration tests

2023-09-13 Thread via GitHub
ahmedabu98 commented on code in PR #28312: URL: https://github.com/apache/beam/pull/28312#discussion_r1324703132 ## sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/FileLoadsStreamingIT.java: ## @@ -0,0 +1,511 @@ +/* + * Licensed to the Apache

[GitHub] [beam] Abacn commented on a diff in pull request #28312: Add file loads streaming integration tests

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28312: URL: https://github.com/apache/beam/pull/28312#discussion_r1324700855 ## sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/FileLoadsStreamingIT.java: ## @@ -0,0 +1,511 @@ +/* + * Licensed to the Apache Soft

[GitHub] [beam] Abacn commented on a diff in pull request #28312: Add file loads streaming integration tests

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28312: URL: https://github.com/apache/beam/pull/28312#discussion_r1324700855 ## sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/FileLoadsStreamingIT.java: ## @@ -0,0 +1,511 @@ +/* + * Licensed to the Apache Soft

[GitHub] [beam] damccorm merged pull request #28407: Add GitHub Workflow Replacement for Jenkins job_PostCommit_Java_Sickbay

2023-09-13 Thread via GitHub
damccorm merged PR #28407: URL: https://github.com/apache/beam/pull/28407 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[GitHub] [beam] johnjcasey closed pull request #26943: Vortex test

2023-09-13 Thread via GitHub
johnjcasey closed pull request #26943: Vortex test URL: https://github.com/apache/beam/pull/26943 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github

[GitHub] [beam] ahmedabu98 commented on pull request #28091: Return errors for insert_rows_json exceptions (#21080)

2023-09-13 Thread via GitHub
ahmedabu98 commented on PR #28091: URL: https://github.com/apache/beam/pull/28091#issuecomment-1717796956 Run Python 3.8 PostCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [beam] ahmedabu98 commented on pull request #26943: Vortex test

2023-09-13 Thread via GitHub
ahmedabu98 commented on PR #26943: URL: https://github.com/apache/beam/pull/26943#issuecomment-1717780410 Yes I'm addressing these load tests in #28264 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [beam] mkhludnev commented on pull request #27329: BEAM-12877: fix avro utils for decimals etc

2023-09-13 Thread via GitHub
mkhludnev commented on PR #27329: URL: https://github.com/apache/beam/pull/27329#issuecomment-1717773735 > Kind ping on this PR. Pardon. I'll get back to it only in Nov. (2023, I suppose) -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] johnjcasey commented on pull request #26943: Vortex test

2023-09-13 Thread via GitHub
johnjcasey commented on PR #26943: URL: https://github.com/apache/beam/pull/26943#issuecomment-1717769674 I believe this scenario has been handled by the tests @ahmedabu98 has added, is that correct? If so, we can close this -- This is an automated message from the Apache Git Service. To

[GitHub] [beam] jrmccluskey merged pull request #28413: Route remaining prints in boot.go through logging service if possible, add periodic flush for PIP invocations

2023-09-13 Thread via GitHub
jrmccluskey merged PR #28413: URL: https://github.com/apache/beam/pull/28413 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

[GitHub] [beam] Abacn commented on a diff in pull request #28312: Add file loads streaming integration tests

2023-09-13 Thread via GitHub
Abacn commented on code in PR #28312: URL: https://github.com/apache/beam/pull/28312#discussion_r1324541921 ## sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/FileLoadsStreamingIT.java: ## @@ -0,0 +1,511 @@ +/* + * Licensed to the Apache Soft

[GitHub] [beam] Abacn merged pull request #28433: remove sonarqube jenkins report

2023-09-13 Thread via GitHub
Abacn merged PR #28433: URL: https://github.com/apache/beam/pull/28433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

[GitHub] [beam] aleksandr-dudko commented on a diff in pull request #28407: Add GitHub Workflow Replacement for Jenkins job_PostCommit_Java_Sickbay

2023-09-13 Thread via GitHub
aleksandr-dudko commented on code in PR #28407: URL: https://github.com/apache/beam/pull/28407#discussion_r1324515093 ## .github/workflows/beam_PostCommit_Java_Sickbay.yml: ## @@ -0,0 +1,82 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor l

[GitHub] [beam] ahmedabu98 commented on pull request #28312: Add file loads streaming integration tests

2023-09-13 Thread via GitHub
ahmedabu98 commented on PR #28312: URL: https://github.com/apache/beam/pull/28312#issuecomment-1717618138 Failing tests are unrelated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [beam] github-actions[bot] commented on pull request #27390: Fix staging corrupted file

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #27390: URL: https://github.com/apache/beam/pull/27390#issuecomment-1717554464 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. -- This is

[GitHub] [beam] github-actions[bot] closed pull request #27390: Fix staging corrupted file

2023-09-13 Thread via GitHub
github-actions[bot] closed pull request #27390: Fix staging corrupted file URL: https://github.com/apache/beam/pull/27390 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [beam] github-actions[bot] closed pull request #27397: [WIP] Modify JVM options if enableHeapDumps is specified to dump heap in directory that MemoryMonitor will look in.

2023-09-13 Thread via GitHub
github-actions[bot] closed pull request #27397: [WIP] Modify JVM options if enableHeapDumps is specified to dump heap in directory that MemoryMonitor will look in. URL: https://github.com/apache/beam/pull/27397 -- This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [beam] github-actions[bot] commented on pull request #28262: [runners-flink] #28258 Wait infinitely if the duration value is less …

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28262: URL: https://github.com/apache/beam/pull/28262#issuecomment-1717510460 Reminder, please take a look at this pr: @chamikaramj -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [beam] damccorm commented on a diff in pull request #28407: Add GitHub Workflow Replacement for Jenkins job_PostCommit_Java_Sickbay

2023-09-13 Thread via GitHub
damccorm commented on code in PR #28407: URL: https://github.com/apache/beam/pull/28407#discussion_r1324414525 ## .github/workflows/beam_PostCommit_Java_Sickbay.yml: ## @@ -0,0 +1,82 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

[GitHub] [beam] damccorm merged pull request #28391: Github Workflow Replacement for Jenkins Job, beam_PostCommit_Website_Publish

2023-09-13 Thread via GitHub
damccorm merged PR #28391: URL: https://github.com/apache/beam/pull/28391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[GitHub] [beam] damccorm commented on a diff in pull request #28391: Github Workflow Replacement for Jenkins Job, beam_PostCommit_Website_Publish

2023-09-13 Thread via GitHub
damccorm commented on code in PR #28391: URL: https://github.com/apache/beam/pull/28391#discussion_r1324405302 ## .github/workflows/beam_PostCommit_Website_Publish.yml: ## @@ -0,0 +1,63 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor licen

[GitHub] [beam] damccorm merged pull request #28423: Update Dataflow container used by dev SDKs

2023-09-13 Thread via GitHub
damccorm merged PR #28423: URL: https://github.com/apache/beam/pull/28423 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

[GitHub] [beam] github-actions[bot] commented on pull request #28433: remove sonarqube jenkins report

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28433: URL: https://github.com/apache/beam/pull/28433#issuecomment-1717473107 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control -- This is an automated message from the Apache Git Serv

[GitHub] [beam] volatilemolotov opened a new pull request, #28433: remove sonarqube jenkins report

2023-09-13 Thread via GitHub
volatilemolotov opened a new pull request, #28433: URL: https://github.com/apache/beam/pull/28433 Talked offline to @Abacn and seems that sonarqube report is red and has not been used for some time. Here is a PR for removal Solves #24768 Thank you for y

[GitHub] [beam] magicgoody opened a new pull request, #28432: Github Workflow Replacement for Jenkins Jobs, beam_PostCommit_XVR_*

2023-09-13 Thread via GitHub
magicgoody opened a new pull request, #28432: URL: https://github.com/apache/beam/pull/28432 PR migrates Jenkins Jobs to Github Actions Workflow: 1. ".github/workflows/beam_PostCommit_XVR_Direct.yml" 2. ".github/workflows/beam_PostCommit_XVR_Flink.yml" 3. ".github/workflows/beam_

[GitHub] [beam] ajdub508 commented on pull request #28091: Return errors for insert_rows_json exceptions (#21080)

2023-09-13 Thread via GitHub
ajdub508 commented on PR #28091: URL: https://github.com/apache/beam/pull/28091#issuecomment-1717395699 @liferoad @ahmedabu98 Moving this out of draft status, ready for review. I did not change handling of HttpErrors because they are different from GoogleAPICallError exceptions. Excep

[GitHub] [beam] github-actions[bot] commented on pull request #28301: Add GitHub Workflow Replacement for Jenkins job_PostCommit_Python

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28301: URL: https://github.com/apache/beam/pull/28301#issuecomment-1717375542 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn for label build. Available commands: - `stop revi

[GitHub] [beam] github-actions[bot] commented on pull request #28407: Add GitHub Workflow Replacement for Jenkins job_PostCommit_Java_Sickbay

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28407: URL: https://github.com/apache/beam/pull/28407#issuecomment-1717375251 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damccorm for label build. Available commands: - `stop r

[GitHub] [beam] github-actions[bot] commented on pull request #28412: Add GitHub Workflow Replacement for Jenkins job_PostCommit_Java_PVR_Flink_Streaming, job_PostCommit_Java_PVR_Samza, job_PostCommit

2023-09-13 Thread via GitHub
github-actions[bot] commented on PR #28412: URL: https://github.com/apache/beam/pull/28412#issuecomment-1717375111 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @Abacn for label build. Available commands: - `stop revi

[GitHub] [beam] leo9827 commented on issue #28096: [Bug]: start-build-end.sh fails with go.mod file not found

2023-09-13 Thread via GitHub
leo9827 commented on issue #28096: URL: https://github.com/apache/beam/issues/28096#issuecomment-1717313136 I try to do this and it works: first, comment 'RUN go get github.com/linkedin/goavro/v2' in `start-build-env.sh` second, run `start-build-env.sh` now, if there dont have other

[GitHub] [beam] caneff commented on a diff in pull request #28396: Remove append method for Pandas >= 2.0.

2023-09-13 Thread via GitHub
caneff commented on code in PR #28396: URL: https://github.com/apache/beam/pull/28396#discussion_r1324268863 ## sdks/python/apache_beam/dataframe/frame_base.py: ## @@ -588,15 +622,23 @@ def format_section(header): return wrap -def populate_defaults(base_type): +def popula

[GitHub] [beam] Amar3tto opened a new pull request, #28431: Add Python Load Tests Combine Dataflow Batch github action

2023-09-13 Thread via GitHub
Amar3tto opened a new pull request, #28431: URL: https://github.com/apache/beam/pull/28431 The following jenkins job has been migrated: https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Batch https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_

[GitHub] [beam] magicgoody commented on a diff in pull request #28391: Github Workflow Replacement for Jenkins Job, beam_PostCommit_Website_Publish

2023-09-13 Thread via GitHub
magicgoody commented on code in PR #28391: URL: https://github.com/apache/beam/pull/28391#discussion_r1324174827 ## .github/workflows/beam_PostCommit_Website_Publish.yml: ## @@ -0,0 +1,63 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor lic

  1   2   >