Re: [I] [Bug]: YAML examples don't render emojis [beam]

2025-05-04 Thread via GitHub
TanuSharma2511 commented on issue #34770: URL: https://github.com/apache/beam/issues/34770#issuecomment-2850040206 So, I already tested using this but the generated HTML file includes the emoji character as expected. But It seems that the page when rendered by the server is using a differen

Re: [PR] Bump github.com/nats-io/nats-server/v2 from 2.11.2 to 2.11.3 in /sdks [beam]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #34838: URL: https://github.com/apache/beam/pull/34838#issuecomment-285898 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @jrmccluskey for label go. Available commands: - `stop r

Re: [PR] Update pypi documentation 30145 [beam]

2025-05-04 Thread via GitHub
codecov[bot] commented on PR #34329: URL: https://github.com/apache/beam/pull/34329#issuecomment-2850001126 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/34329?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term

Re: [PR] Bump github.com/nats-io/nats.go from 1.41.2 to 1.42.0 in /sdks [beam]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #34839: URL: https://github.com/apache/beam/pull/34839#issuecomment-285794 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @shunping for label go. Available commands: - `stop revi

Re: [PR] Bump cloud.google.com/go/storage from 1.52.0 to 1.53.0 in /sdks [beam]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #34840: URL: https://github.com/apache/beam/pull/34840#issuecomment-285720 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] Update pypi documentation 30145 [beam]

2025-05-04 Thread via GitHub
rakeshcusat commented on PR #34329: URL: https://github.com/apache/beam/pull/34329#issuecomment-2849990097 Run Prism_Python PreCommit 3.9 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] use batch delete for GCS IO [beam]

2025-05-04 Thread via GitHub
rakeshcusat commented on code in PR #34835: URL: https://github.com/apache/beam/pull/34835#discussion_r2072877918 ## sdks/python/apache_beam/io/gcp/gcsio.py: ## @@ -265,10 +265,23 @@ def delete(self, path, recursive=False): bucket_name, blob_name = parse_gcs_path(path)

[PR] Bump cloud.google.com/go/storage from 1.52.0 to 1.53.0 in /sdks [beam]

2025-05-04 Thread via GitHub
dependabot[bot] opened a new pull request, #34840: URL: https://github.com/apache/beam/pull/34840 Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.52.0 to 1.53.0. Release notes Sourced from https://github.com/googleapis/google-cloud-go/rele

[PR] Bump github.com/nats-io/nats.go from 1.41.2 to 1.42.0 in /sdks [beam]

2025-05-04 Thread via GitHub
dependabot[bot] opened a new pull request, #34839: URL: https://github.com/apache/beam/pull/34839 Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go) from 1.41.2 to 1.42.0. Release notes Sourced from https://github.com/nats-io/nats.go/releases";>github.com/nats-i

[PR] Bump github.com/nats-io/nats-server/v2 from 2.11.2 to 2.11.3 in /sdks [beam]

2025-05-04 Thread via GitHub
dependabot[bot] opened a new pull request, #34838: URL: https://github.com/apache/beam/pull/34838 Bumps [github.com/nats-io/nats-server/v2](https://github.com/nats-io/nats-server) from 2.11.2 to 2.11.3. Release notes Sourced from https://github.com/nats-io/nats-server/releases";>g

Re: [PR] Encode paneinfo with PaneInfoCoder. [beam]

2025-05-04 Thread via GitHub
shunping commented on PR #34824: URL: https://github.com/apache/beam/pull/34824#issuecomment-2849771349 > > Just out of curiosity, what's wrong with not having a PaneInfoCoder. I see the issue #34826, but does FastPrimitiveCoder still work? > > FastPrimitiveCoder ends up falling back

Re: [PR] Update pypi documentation 30145 [beam]

2025-05-04 Thread via GitHub
liferoad commented on PR #34329: URL: https://github.com/apache/beam/pull/34329#issuecomment-2849732981 > @liferoad do we have any shortcut to re-run the failed test tasks? https://github.com/apache/beam/blob/master/.github/workflows/README.md#running-workflows-manually or using trig

Re: [PR] Add checkpoint during progress reporting. [beam]

2025-05-04 Thread via GitHub
shunping commented on code in PR #34828: URL: https://github.com/apache/beam/pull/34828#discussion_r2072775884 ## sdks/go/pkg/beam/runners/prism/internal/stage.go: ## @@ -218,58 +223,75 @@ progress: } slog.Debug("progress report",

Re: [PR] Add OrderedList and Set state [beam]

2025-05-04 Thread via GitHub
liferoad merged PR #34836: URL: https://github.com/apache/beam/pull/34836 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Add powershell command 32307 [beam]

2025-05-04 Thread via GitHub
liferoad merged PR #34837: URL: https://github.com/apache/beam/pull/34837 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Update the README file [beam-starter-python]

2025-05-04 Thread via GitHub
liferoad merged PR #43: URL: https://github.com/apache/beam-starter-python/pull/43 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@be

Re: [PR] Add checkpoint during progress reporting. [beam]

2025-05-04 Thread via GitHub
lostluck commented on code in PR #34828: URL: https://github.com/apache/beam/pull/34828#discussion_r2072774157 ## sdks/go/pkg/beam/runners/prism/internal/stage.go: ## @@ -218,58 +223,75 @@ progress: } slog.Debug("progress report",

Re: [PR] Add powershell command 32307 [beam]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #34837: URL: https://github.com/apache/beam/pull/34837#issuecomment-2849703604 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @liferoad for label website. Available commands: - `stop

Re: [PR] Add checkpoint during progress reporting. [beam]

2025-05-04 Thread via GitHub
shunping commented on code in PR #34828: URL: https://github.com/apache/beam/pull/34828#discussion_r2072768046 ## sdks/go/pkg/beam/runners/prism/internal/stage.go: ## @@ -218,58 +223,75 @@ progress: } slog.Debug("progress report",

Re: [PR] Add checkpoint during progress reporting. [beam]

2025-05-04 Thread via GitHub
shunping commented on code in PR #34828: URL: https://github.com/apache/beam/pull/34828#discussion_r2072763240 ## sdks/go/pkg/beam/runners/prism/internal/stage.go: ## @@ -218,58 +223,75 @@ progress: } slog.Debug("progress report",

Re: [PR] Add checkpoint during progress reporting. [beam]

2025-05-04 Thread via GitHub
shunping commented on code in PR #34828: URL: https://github.com/apache/beam/pull/34828#discussion_r2072762099 ## sdks/go/pkg/beam/runners/prism/internal/stage.go: ## @@ -218,58 +223,75 @@ progress: } slog.Debug("progress report",

Re: [PR] Add checkpoint during progress reporting. [beam]

2025-05-04 Thread via GitHub
shunping commented on code in PR #34828: URL: https://github.com/apache/beam/pull/34828#discussion_r2072762099 ## sdks/go/pkg/beam/runners/prism/internal/stage.go: ## @@ -218,58 +223,75 @@ progress: } slog.Debug("progress report",

Re: [PR] Add OrderedList and Set state [beam]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #34836: URL: https://github.com/apache/beam/pull/34836#issuecomment-2849669585 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @kennknowles for label website. Available commands: - `s

Re: [PR] Update pypi documentation 30145 [beam]

2025-05-04 Thread via GitHub
rakeshcusat commented on PR #34329: URL: https://github.com/apache/beam/pull/34329#issuecomment-2849606958 @liferoad do we have any shortcut to re-run the failed test tasks? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [I] [Feature Request]: Running Word-Count with Gradle for PowerShell [beam]

2025-05-04 Thread via GitHub
rakeshcusat commented on issue #32307: URL: https://github.com/apache/beam/issues/32307#issuecomment-2849603031 @KomiB-Atsou I guess you are looking for this change: https://github.com/apache/beam/pull/34837 -- This is an automated message from the Apache Git Service. To respond

[PR] Add powershell command 32307 [beam]

2025-05-04 Thread via GitHub
rakeshcusat opened a new pull request, #34837: URL: https://github.com/apache/beam/pull/34837 Added command for powershell Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]

Re: [PR] Add OrderedList and Set state [beam]

2025-05-04 Thread via GitHub
rakeshcusat commented on PR #34836: URL: https://github.com/apache/beam/pull/34836#issuecomment-2849596904 cc: @liferoad -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Update the README file [beam-starter-python]

2025-05-04 Thread via GitHub
rakeshcusat commented on PR #43: URL: https://github.com/apache/beam-starter-python/pull/43#issuecomment-2849502135 cc: @liferoad -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[PR] Update the README file [beam-starter-python]

2025-05-04 Thread via GitHub
rakeshcusat opened a new pull request, #43: URL: https://github.com/apache/beam-starter-python/pull/43 Updated the readme file to explicitly define the intent behind this repo. Thank you for your contribution! Follow this checklist to help us incorporat

Re: [I] Add template pipelines [beam-starter-python]

2025-05-04 Thread via GitHub
rakeshcusat commented on issue #42: URL: https://github.com/apache/beam-starter-python/issues/42#issuecomment-2849502084 @liferoad please check this PR https://github.com/apache/beam-starter-python/pull/43 -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] Add checkpoint during progress reporting. [beam]

2025-05-04 Thread via GitHub
lostluck commented on code in PR #34828: URL: https://github.com/apache/beam/pull/34828#discussion_r2072742789 ## sdks/go/pkg/beam/runners/prism/internal/stage.go: ## @@ -218,58 +223,75 @@ progress: } slog.Debug("progress report",

Re: [I] Add template pipelines [beam-starter-python]

2025-05-04 Thread via GitHub
rakeshcusat commented on issue #42: URL: https://github.com/apache/beam-starter-python/issues/42#issuecomment-2849498892 I will just update the description to make it clear. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [I] Add template pipelines [beam-starter-python]

2025-05-04 Thread via GitHub
liferoad commented on issue #42: URL: https://github.com/apache/beam-starter-python/issues/42#issuecomment-2849491107 Sounds good to me. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] Add template pipelines [beam-starter-python]

2025-05-04 Thread via GitHub
rakeshcusat commented on issue #42: URL: https://github.com/apache/beam-starter-python/issues/42#issuecomment-2849490787 @liferoad thank you for pointing that. Can we update the Readme.md file to include the intent behind this repo? otherwise, it looks a little bit confusing. -- This i

Re: [PR] Add set state [beam]

2025-05-04 Thread via GitHub
rakeshcusat commented on PR #34836: URL: https://github.com/apache/beam/pull/34836#issuecomment-2849490044 cc: @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] Add set state [beam]

2025-05-04 Thread via GitHub
rakeshcusat opened a new pull request, #34836: URL: https://github.com/apache/beam/pull/34836 Set State documentation was missing. This PR is basically adding the documentation and code examples. Thank you for your contribution! Follow this checklist to

Re: [PR] Add checkpoint during progress reporting. [beam]

2025-05-04 Thread via GitHub
lostluck commented on code in PR #34828: URL: https://github.com/apache/beam/pull/34828#discussion_r2072731387 ## sdks/go/pkg/beam/runners/prism/internal/stage.go: ## @@ -218,58 +223,75 @@ progress: } slog.Debug("progress report",

Re: [I] Add template pipelines [beam-starter-python]

2025-05-04 Thread via GitHub
liferoad commented on issue #42: URL: https://github.com/apache/beam-starter-python/issues/42#issuecomment-2849483083 More resources: https://github.com/GoogleCloudPlatform/dataflow-cookbook, https://github.com/apache/beam/tree/master/sdks/python/apache_beam/examples I think this rep

Re: [I] Add template pipelines [beam-starter-python]

2025-05-04 Thread via GitHub
rakeshcusat commented on issue #42: URL: https://github.com/apache/beam-starter-python/issues/42#issuecomment-2849477408 cc: @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[I] Add template pipelines [beam-starter-python]

2025-05-04 Thread via GitHub
rakeshcusat opened a new issue, #42: URL: https://github.com/apache/beam-starter-python/issues/42 It would make more sense if we create some template pipeline with some basic operations. This will be close to their use cases and easier to modify and bringup a pipeline. One example templ

Re: [PR] Encode paneinfo with PaneInfoCoder. [beam]

2025-05-04 Thread via GitHub
claudevdm commented on PR #34824: URL: https://github.com/apache/beam/pull/34824#issuecomment-2849474854 > Just out of curiosity, what's wrong with not having a PaneInfoCoder. I see the issue #34826, but does FastPrimitiveCoder still work? FastPrimitiveCoder ends up falling back to Pi

Re: [PR] Bump github.com/golang-cz/devslog from 0.0.11 to 0.0.13 in /sdks [beam]

2025-05-04 Thread via GitHub
lostluck merged PR #34758: URL: https://github.com/apache/beam/pull/34758 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Bump google.golang.org/api from 0.229.0 to 0.231.0 in /sdks [beam]

2025-05-04 Thread via GitHub
lostluck merged PR #34784: URL: https://github.com/apache/beam/pull/34784 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Bump github.com/go-sql-driver/mysql from 1.9.1 to 1.9.2 in /sdks [beam]

2025-05-04 Thread via GitHub
lostluck merged PR #34759: URL: https://github.com/apache/beam/pull/34759 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] use batch delete for GCS IO [beam]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #34835: URL: https://github.com/apache/beam/pull/34835#issuecomment-2849417228 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @claudevdm for label python. Available commands: - `stop

Re: [I] [Bug]: apache_beam.io.gcp.bigquery.ReadFromBigQuery with EXPORT is slow when handling large amount of data [beam]

2025-05-04 Thread via GitHub
liferoad commented on issue #34792: URL: https://github.com/apache/beam/issues/34792#issuecomment-2849379884 > > Thanks for working on this! Another thing I want to report is that it's also really slow when deleting the temporary files from the BQ EXPORT. I'm not sure if it would be better

[PR] use batch delete for GCS IO [beam]

2025-05-04 Thread via GitHub
liferoad opened a new pull request, #34835: URL: https://github.com/apache/beam/pull/34835 Fixes https://github.com/apache/beam/issues/34834 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easi

[I] [Bug]: Slow when deleting the temp files from BQ EXPORT [beam]

2025-05-04 Thread via GitHub
liferoad opened a new issue, #34834: URL: https://github.com/apache/beam/issues/34834 ### What happened? This could be slow: ``` File "/Users/jinholee/Library/Caches/pypoetry/virtualenvs/moloco-forest-q8jAuzyK-py3.10/lib/python3.10/site-packages/apache_beam/io/gcp/big

Re: [PR] Add Git commit SHA to artifacts using buildnumber-maven-plugin (#18227) [beam]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #34833: URL: https://github.com/apache/beam/pull/34833#issuecomment-2849267454 Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`: R: @chamikaramj for label java. Available commands: - `stop

[PR] Add Git commit SHA to artifacts using buildnumber-maven-plugin (#18227) [beam]

2025-05-04 Thread via GitHub
gayatrikate04 opened a new pull request, #34833: URL: https://github.com/apache/beam/pull/34833 This pull request introduces the `buildnumber-maven-plugin` to the Apache Beam project to include the Git commit SHA in the `MANIFEST.MF` file of the generated artifacts. This update helps in ide

Re: [PR] Replace StorageV1 client with GCS client - Draft [beam]

2025-05-04 Thread via GitHub
github-actions[bot] commented on PR #28733: URL: https://github.com/apache/beam/pull/28733#issuecomment-2849199942 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull r