Re: [PR] GH-47244: [CI][Dev] Fix shellcheck errors in the ci/scripts/msys2_setup.sh [arrow]

2025-08-04 Thread via GitHub
conbench-apache-arrow[bot] commented on PR #47245: URL: https://github.com/apache/arrow/pull/47245#issuecomment-3153723763 After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 22676fe398f3dfc4bcc0458ae4a42f2f7fd4e1da. There weren't

[PR] chore: bump ruby/setup-ruby from 1.253.0 to 1.254.0 [arrow-adbc]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #3237: URL: https://github.com/apache/arrow-adbc/pull/3237 Bumps [ruby/setup-ruby](https://github.com/ruby/setup-ruby) from 1.253.0 to 1.254.0. Release notes Sourced from https://github.com/ruby/setup-ruby/releases";>ruby/setup-ruby's rel

Re: [PR] feat: add support for utf8view type [arrow-js]

2025-08-04 Thread via GitHub
NguyenHoangSon96 commented on PR #225: URL: https://github.com/apache/arrow-js/pull/225#issuecomment-3153693686 @trxcllnt @domoritz Hi guys, thank you for your input. I will be working on implementing the view type properly. I will do some research. -- This is an automated messag

Re: [PR] GH-47213: [R] Require CMake 3.26 or later [arrow]

2025-08-04 Thread via GitHub
kou commented on PR #47217: URL: https://github.com/apache/arrow/pull/47217#issuecomment-3153686494 Oh, sorry. I missed it. Updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] GH-47232: [Ruby] Suppress warnings in test with Ruby 3.5 [arrow]

2025-08-04 Thread via GitHub
kou merged PR #47233: URL: https://github.com/apache/arrow/pull/47233 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.or

Re: [PR] GH-47232: [Ruby] Suppress warnings in test with Ruby 3.5 [arrow]

2025-08-04 Thread via GitHub
kou commented on PR #47233: URL: https://github.com/apache/arrow/pull/47233#issuecomment-3153682836 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

Re: [I] [Release] Use "upstream" as apache/arrow remote name [arrow]

2025-08-04 Thread via GitHub
kou commented on issue #47223: URL: https://github.com/apache/arrow/issues/47223#issuecomment-3153649675 > Do we have any idea where/when the project started using the apache remote name? I think that https://github.com/apache/arrow/pull/626 is the first commit that we use "apache" a

Re: [PR] GH-47230: [C++] Fixes C++23 compatibility issues [arrow]

2025-08-04 Thread via GitHub
kou commented on PR #47231: URL: https://github.com/apache/arrow/pull/47231#issuecomment-3153371641 We need to work on #47208 before this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [I] [C++] c++23 supported? [arrow]

2025-08-04 Thread via GitHub
kou commented on issue #47207: URL: https://github.com/apache/arrow/issues/47207#issuecomment-3153371105 OK. Could you create subissues as normal issues? I'll set associations later. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] 8013 improve performance of i256 to f64 [arrow-rs]

2025-08-04 Thread via GitHub
klion26 commented on PR #8041: URL: https://github.com/apache/arrow-rs/pull/8041#issuecomment-3153348556 Added a benchmark for the `to_f64` function and made a benchmark on different branches 1. The main branch (`i256_to_f64_base` in the result) 2. The current implementation(`8013_impr

Re: [I] Invalid Input Error: Computed AES tag differs from read AES tag while trying to read encrypted parquet file in Dbeaver/Duckdb [arrow]

2025-08-04 Thread via GitHub
ssvenkatesh commented on issue #47254: URL: https://github.com/apache/arrow/issues/47254#issuecomment-3153313130 Tried with footer_key_metadata(KEY_LABEL) and disable_aad_prefix_storage() got the same error. also tried to read the AES tag from the parquet file with a python file (

Re: [PR] 8013 improve performance of i256 to f64 [arrow-rs]

2025-08-04 Thread via GitHub
klion26 commented on code in PR #8041: URL: https://github.com/apache/arrow-rs/pull/8041#discussion_r2253106687 ## arrow-buffer/src/bigint/mod.rs: ## @@ -586,6 +586,25 @@ impl i256 { pub const fn is_positive(self) -> bool { self.high.is_positive() || self.high == 0

[PR] 8013 improve performance of i256 to f64 [arrow-rs]

2025-08-04 Thread via GitHub
klion26 opened a new pull request, #8041: URL: https://github.com/apache/arrow-rs/pull/8041 # Which issue does this PR close? - Closes #8013 . # What changes are included in this PR? Improve the logic `i256` to `f64` by 1. Erase all the leading sign bit in `i256`,

Re: [PR] feat: add support for utf8view type [arrow-js]

2025-08-04 Thread via GitHub
kou commented on PR #225: URL: https://github.com/apache/arrow-js/pull/225#issuecomment-3153174086 We can release a new version whenever we release a new version because we split the JS implementation from apache/arrow. For example, we can release a new version once this is merged. --

Re: [PR] feat: add support for utf8view type [arrow-js]

2025-08-04 Thread via GitHub
Copilot commented on code in PR #225: URL: https://github.com/apache/arrow-js/pull/225#discussion_r2253038956 ## src/visitor/vectorloader.ts: ## @@ -72,6 +72,9 @@ export class VectorLoader extends Visitor { public visitUtf8(type: T, { length, nullCount } = this.nextFieldNo

[PR] chore: bump webpack from 5.100.1 to 5.101.0 [arrow-js]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #231: URL: https://github.com/apache/arrow-js/pull/231 Bumps [webpack](https://github.com/webpack/webpack) from 5.100.1 to 5.101.0. Release notes Sourced from https://github.com/webpack/webpack/releases";>webpack's releases. v5.101.

Re: [PR] MINOR: Fix format [arrow-java]

2025-08-04 Thread via GitHub
lidavidm merged PR #809: URL: https://github.com/apache/arrow-java/pull/809 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apa

[PR] chore: bump eslint from 9.31.0 to 9.32.0 [arrow-js]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #230: URL: https://github.com/apache/arrow-js/pull/230 Bumps [eslint](https://github.com/eslint/eslint) from 9.31.0 to 9.32.0. Release notes Sourced from https://github.com/eslint/eslint/releases";>eslint's releases. v9.32.0 Featu

[PR] chore: bump google-github-actions/auth from 2.1.11 to 2.1.12 [arrow-adbc]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #3236: URL: https://github.com/apache/arrow-adbc/pull/3236 Bumps [google-github-actions/auth](https://github.com/google-github-actions/auth) from 2.1.11 to 2.1.12. Release notes Sourced from https://github.com/google-github-actions/auth/r

[PR] chore: bump @types/node from 24.0.15 to 24.2.0 [arrow-js]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #229: URL: https://github.com/apache/arrow-js/pull/229 Bumps [@types/node](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/node) from 24.0.15 to 24.2.0. Commits See full diff in https://github.com/DefinitelyTyped/De

Re: [PR] refactor(rust/core)!: move the driver_manager feature to the new adbc_driver_manager package [arrow-adbc]

2025-08-04 Thread via GitHub
eitsupi commented on PR #3197: URL: https://github.com/apache/arrow-adbc/pull/3197#issuecomment-3153146955 Thank you, I'm out now so I'll resolve the conflicts tonight. Please merge if you like then! -- This is an automated message from the Apache Git Service. To respond to the message,

[PR] chore: bump typescript-eslint from 8.38.0 to 8.39.0 [arrow-js]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #228: URL: https://github.com/apache/arrow-js/pull/228 Bumps [typescript-eslint](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/typescript-eslint) from 8.38.0 to 8.39.0. Release notes Sourced from https://github

Re: [PR] [Variant] Proposal for `variant_get` and Shredded `VariantArray` [arrow-rs]

2025-08-04 Thread via GitHub
scovich commented on PR #8021: URL: https://github.com/apache/arrow-rs/pull/8021#issuecomment-3153144846 > @scovich @carpecodeum and @Samyak2 this PR I think is ready for review Whoop, I somehow missed the notify. I'll try to take a look in the next day or two! -- This is an automa

[PR] chore(go/adbc): bump modernc.org/sqlite from 1.38.1 to 1.38.2 in /go/adbc [arrow-adbc]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #3235: URL: https://github.com/apache/arrow-adbc/pull/3235 Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite) from 1.38.1 to 1.38.2. Commits https://gitlab.com/cznic/sqlite/commit/84c00b42e43aa9af62ef42e03684f7ad767b1756";>84c

Re: [PR] fix(csharp/src/Drivers/Databricks): Set enable_run_async_thrift default true [arrow-adbc]

2025-08-04 Thread via GitHub
CurtHagenlocher merged PR #3232: URL: https://github.com/apache/arrow-adbc/pull/3232 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@

Re: [I] [R] Stable cookbook build failing on reticulate [arrow-cookbook]

2025-08-04 Thread via GitHub
amoeba commented on issue #381: URL: https://github.com/apache/arrow-cookbook/issues/381#issuecomment-3153094973 Looks like https://github.com/apache/arrow-cookbook/pull/386 fixed it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] [Release] 21.0.0 post release tasks [arrow]

2025-08-04 Thread via GitHub
amoeba commented on issue #47127: URL: https://github.com/apache/arrow/issues/47127#issuecomment-3153097809 Cookbooks are now updated after fixing https://github.com/apache/arrow-cookbook/issues/381. All post-release tasks are done. Thanks everyone for the help with the release, espe

Re: [PR] chore: bump ts-jest from 29.1.4 to 29.4.0 [arrow-js]

2025-08-04 Thread via GitHub
dependabot[bot] closed pull request #165: chore: bump ts-jest from 29.1.4 to 29.4.0 URL: https://github.com/apache/arrow-js/pull/165 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] chore: bump ts-jest from 29.1.4 to 29.4.0 [arrow-js]

2025-08-04 Thread via GitHub
dependabot[bot] commented on PR #165: URL: https://github.com/apache/arrow-js/pull/165#issuecomment-3153093407 Superseded by #227. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[PR] chore: bump ts-jest from 29.1.4 to 29.4.1 [arrow-js]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #227: URL: https://github.com/apache/arrow-js/pull/227 Bumps [ts-jest](https://github.com/kulshekhar/ts-jest) from 29.1.4 to 29.4.1. Release notes Sourced from https://github.com/kulshekhar/ts-jest/releases";>ts-jest's releases. v29

Re: [PR] GH-381: [R] Use RETICULATE_PYTHON="managed" in test.R [arrow-cookbook]

2025-08-04 Thread via GitHub
amoeba merged PR #386: URL: https://github.com/apache/arrow-cookbook/pull/386 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.a

[PR] chore: bump docker/login-action from 3.4.0 to 3.5.0 [arrow-adbc]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #3234: URL: https://github.com/apache/arrow-adbc/pull/3234 Bumps [docker/login-action](https://github.com/docker/login-action) from 3.4.0 to 3.5.0. Release notes Sourced from https://github.com/docker/login-action/releases";>docker/login-a

Re: [I] Improve performance of `i256` to `f64` [arrow-rs]

2025-08-04 Thread via GitHub
klion26 commented on issue #8013: URL: https://github.com/apache/arrow-rs/issues/8013#issuecomment-3153060953 take -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[PR] [R] Use RETICULATE_PYTHON="managed" in test.R [arrow-cookbook]

2025-08-04 Thread via GitHub
amoeba opened a new pull request, #386: URL: https://github.com/apache/arrow-cookbook/pull/386 I'm somewhat confident this will fix the CI issue on the stable branch we're seeing in https://github.com/apache/arrow-cookbook/issues/381. I did some testing on draft PRs. -- This is an

Re: [PR] DRAFT 2: Fix/gh 381 r fix reticulate error [arrow-cookbook]

2025-08-04 Thread via GitHub
amoeba closed pull request #385: DRAFT 2: Fix/gh 381 r fix reticulate error URL: https://github.com/apache/arrow-cookbook/pull/385 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[PR] chore(go/adbc): bump google.golang.org/api from 0.243.0 to 0.244.0 in /go/adbc [arrow-adbc]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #3233: URL: https://github.com/apache/arrow-adbc/pull/3233 Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.243.0 to 0.244.0. Release notes Sourced from https://github.com/googleapis/google-api-go-c

[PR] DRAFT 2: Fix/gh 381 r fix reticulate error [arrow-cookbook]

2025-08-04 Thread via GitHub
amoeba opened a new pull request, #385: URL: https://github.com/apache/arrow-cookbook/pull/385 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] MINOR: Fix format [arrow-java]

2025-08-04 Thread via GitHub
lidavidm opened a new pull request, #809: URL: https://github.com/apache/arrow-java/pull/809 ## What's Changed Apply pre-commit since I forgot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] GH-725: Added ExtensionReader [arrow-java]

2025-08-04 Thread via GitHub
lidavidm commented on PR #726: URL: https://github.com/apache/arrow-java/pull/726#issuecomment-3153019113 argh...I forgot to reapprove workflows...let me fix thigns -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] GH-725: Added ExtensionReader [arrow-java]

2025-08-04 Thread via GitHub
lidavidm merged PR #726: URL: https://github.com/apache/arrow-java/pull/726 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apa

Re: [PR] feat(go/adbc): Initial implement Databricks go ADBC driver [arrow-adbc]

2025-08-04 Thread via GitHub
lidavidm commented on code in PR #2998: URL: https://github.com/apache/arrow-adbc/pull/2998#discussion_r2252920241 ## go/adbc/driver/databricks/statement_test.go: ## @@ -0,0 +1,55 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license a

[PR] chore: Bump modernc.org/sqlite from 1.29.6 to 1.38.2 [arrow-go]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #460: URL: https://github.com/apache/arrow-go/pull/460 Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite) from 1.29.6 to 1.38.2. Commits https://gitlab.com/cznic/sqlite/commit/84c00b42e43aa9af62ef42e03684f7ad767b1756";>84c00b4

Re: [PR] chore: Bump modernc.org/sqlite from 1.29.6 to 1.38.0 [arrow-go]

2025-08-04 Thread via GitHub
dependabot[bot] closed pull request #399: chore: Bump modernc.org/sqlite from 1.29.6 to 1.38.0 URL: https://github.com/apache/arrow-go/pull/399 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] chore: Bump modernc.org/sqlite from 1.29.6 to 1.38.0 [arrow-go]

2025-08-04 Thread via GitHub
dependabot[bot] commented on PR #399: URL: https://github.com/apache/arrow-go/pull/399#issuecomment-3153011808 Superseded by #460. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [I] [Java] How to read file in S3 or Minio by Dataset api? [arrow-java]

2025-08-04 Thread via GitHub
lidavidm commented on issue #805: URL: https://github.com/apache/arrow-java/issues/805#issuecomment-3152996547 You should be able to read from S3 by passing an `s3://` URI. I don't have an example of this off-hand, though. I'm not sure how/if Minio can be configured. -- This is an automa

Re: [PR] GH-794: Avro file read and write support [arrow-java]

2025-08-04 Thread via GitHub
lidavidm commented on code in PR #802: URL: https://github.com/apache/arrow-java/pull/802#discussion_r2252909105 ## adapter/avro/src/main/java/org/apache/arrow/adapter/avro/AvroFileReader.java: ## @@ -0,0 +1,374 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

Re: [PR] GH-804: Prepend JDBC FlightSQL version to user agent [arrow-java]

2025-08-04 Thread via GitHub
lidavidm commented on code in PR #806: URL: https://github.com/apache/arrow-java/pull/806#discussion_r2252897294 ## flight/flight-core/src/main/java/org/apache/arrow/flight/grpc/NettyClientBuilder.java: ## @@ -130,6 +131,11 @@ public NettyClientBuilder verifyServer(boolean veri

Re: [PR] DRAFT: Testing a fix for reticulate tests [arrow-cookbook]

2025-08-04 Thread via GitHub
amoeba closed pull request #384: DRAFT: Testing a fix for reticulate tests URL: https://github.com/apache/arrow-cookbook/pull/384 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] DRAFT: Testing a fix for reticulate tests [arrow-cookbook]

2025-08-04 Thread via GitHub
amoeba commented on PR #384: URL: https://github.com/apache/arrow-cookbook/pull/384#issuecomment-3152965777 Looks like I can't use tmate here, > mxschmitt/action-tmate@v3 is not allowed to be used in apache/arrow-cookbook. Actions in this workflow must be: within a repository that be

Re: [I] Arrow Arith 50.0.0: multiple applicable items in scope [arrow-rs]

2025-08-04 Thread via GitHub
ChristopherRabotin commented on issue #8038: URL: https://github.com/apache/arrow-rs/issues/8038#issuecomment-3152965274 Interesting, thanks. I'm not using chrono in my crate, it's one of my dependencies. It seems that as recently as last week, one solution has been to lock to a lower

[PR] DRAFT: Testing a fix for reticulate tests [arrow-cookbook]

2025-08-04 Thread via GitHub
amoeba opened a new pull request, #384: URL: https://github.com/apache/arrow-cookbook/pull/384 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] Arrow Arith 50.0.0: multiple applicable items in scope [arrow-rs]

2025-08-04 Thread via GitHub
mapleFU commented on issue #8038: URL: https://github.com/apache/arrow-rs/issues/8038#issuecomment-3152938953 https://github.com/apache/arrow-rs/issues/7196 Maybe try the solving here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] Release object store `0.13.0` (breaking) - Target July 2025 [arrow-rs-object-store]

2025-08-04 Thread via GitHub
johnnyg commented on issue #367: URL: https://github.com/apache/arrow-rs-object-store/issues/367#issuecomment-3152926129 @alamb not waiting on a new feature but rather would like a release with https://github.com/apache/arrow-rs-object-store/commit/1e6c78ed08c04a84e4e508fdd0aa94f4936b917d

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
scovich commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252866464 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into Ar

Re: [I] [C++][Python] pa.compute.fill_null produces unexpected result in arrow 21 on windows [arrow]

2025-08-04 Thread via GitHub
amoeba commented on issue #47234: URL: https://github.com/apache/arrow/issues/47234#issuecomment-3152913326 I de-assigned myself since I don't have time this week to look into this further but I think this still needs investigating. -- This is an automated message from the Apache Git Serv

[PR] fix(csharp/src/Drivers/Databricks): Set enable_run_async_thrift default true [arrow-adbc]

2025-08-04 Thread via GitHub
jackyhu-db opened a new pull request, #3232: URL: https://github.com/apache/arrow-adbc/pull/3232 ## Motivation In PR https://github.com/apache/arrow-adbc/pull/3171, `RunAsync` option in `TExecuteStatementReq` was added and exposed via connection parameter `adbc.databricks.enable_run_

Re: [PR] docs: clarify relationship specification.rst to adbc.h [arrow-adbc]

2025-08-04 Thread via GitHub
amoeba commented on PR #3226: URL: https://github.com/apache/arrow-adbc/pull/3226#issuecomment-3152906732 Thanks for the review, merged! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] docs: clarify relationship specification.rst to adbc.h [arrow-adbc]

2025-08-04 Thread via GitHub
amoeba merged PR #3226: URL: https://github.com/apache/arrow-adbc/pull/3226 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apa

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
scovich commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252856054 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into Ar

[PR] Expose memory tracking API to Array and ArrayData [arrow-rs]

2025-08-04 Thread via GitHub
waynexia opened a new pull request, #8040: URL: https://github.com/apache/arrow-rs/pull/8040 # Which issue does this PR close? We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an i

Re: [PR] MINOR: [Release] Make post-08-remove-old-artifacts.sh crossplatform [arrow]

2025-08-04 Thread via GitHub
amoeba commented on PR #47250: URL: https://github.com/apache/arrow/pull/47250#issuecomment-3152883533 Merged, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] MINOR: [Release] Make post-08-remove-old-artifacts.sh crossplatform [arrow]

2025-08-04 Thread via GitHub
amoeba merged PR #47250: URL: https://github.com/apache/arrow/pull/47250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252820147 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

Re: [PR] MINOR: [Release] Make post-08-remove-old-artifacts.sh crossplatform [arrow]

2025-08-04 Thread via GitHub
amoeba commented on code in PR #47250: URL: https://github.com/apache/arrow/pull/47250#discussion_r2252843402 ## dev/release/post-08-remove-old-artifacts.sh: ## @@ -43,7 +43,7 @@ old_releases=$( grep -E '^arrow-[0-9]' | \ sort --version-sort --reverse | \ tail -n +2 | \

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252820147 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252836569 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

[PR] chore: Bump github.com/substrait-io/substrait-go/v4 from 4.3.0 to 4.4.0 [arrow-go]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #459: URL: https://github.com/apache/arrow-go/pull/459 Bumps [github.com/substrait-io/substrait-go/v4](https://github.com/substrait-io/substrait-go) from 4.3.0 to 4.4.0. Release notes Sourced from https://github.com/substrait-io/substrait

Re: [PR] MINOR: [Release] Make post-08-remove-old-artifacts.sh crossplatform [arrow]

2025-08-04 Thread via GitHub
kou commented on code in PR #47250: URL: https://github.com/apache/arrow/pull/47250#discussion_r2252830626 ## dev/release/post-08-remove-old-artifacts.sh: ## @@ -43,7 +43,7 @@ old_releases=$( grep -E '^arrow-[0-9]' | \ sort --version-sort --reverse | \ tail -n +2 | \ -

[PR] chore: Bump google.golang.org/grpc from 1.73.0 to 1.74.2 [arrow-go]

2025-08-04 Thread via GitHub
dependabot[bot] opened a new pull request, #458: URL: https://github.com/apache/arrow-go/pull/458 Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.73.0 to 1.74.2. Release notes Sourced from https://github.com/grpc/grpc-go/releases";>google.golang.org/grpc's r

Re: [PR] refactor(rust/core)!: move the driver_manager feature to the new adbc_driver_manager package [arrow-adbc]

2025-08-04 Thread via GitHub
lidavidm commented on PR #3197: URL: https://github.com/apache/arrow-adbc/pull/3197#issuecomment-3152845683 @eitsupi wanna rebase this, then I can just go ahead and merge? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252820147 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

Re: [PR] chore(rust): bump the arrow-datafusion group across 1 directory with 4 updates [arrow-adbc]

2025-08-04 Thread via GitHub
dependabot[bot] commented on PR #3229: URL: https://github.com/apache/arrow-adbc/pull/3229#issuecomment-3152844308 This pull request was built based on a group rule. Closing it will not ignore any of these versions in future pull requests. To ignore these dependencies, configure [igno

Re: [PR] chore(rust): bump the arrow-datafusion group across 1 directory with 4 updates [arrow-adbc]

2025-08-04 Thread via GitHub
lidavidm closed pull request #3229: chore(rust): bump the arrow-datafusion group across 1 directory with 4 updates URL: https://github.com/apache/arrow-adbc/pull/3229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] chore(rust): support arrow 56 [arrow-adbc]

2025-08-04 Thread via GitHub
lidavidm merged PR #3230: URL: https://github.com/apache/arrow-adbc/pull/3230 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.a

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252820147 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

Re: [I] [CI][Dev] Fix shellcheck errors in the ci/scripts/msys2_setup.sh [arrow]

2025-08-04 Thread via GitHub
kou commented on issue #47244: URL: https://github.com/apache/arrow/issues/47244#issuecomment-3152841904 Issue resolved by pull request 47245 https://github.com/apache/arrow/pull/47245 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] GH-47244: [CI][Dev] Fix shellcheck errors in the ci/scripts/msys2_setup.sh [arrow]

2025-08-04 Thread via GitHub
kou merged PR #47245: URL: https://github.com/apache/arrow/pull/47245 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.or

Re: [PR] fix(csharp/src/Drivers/Databricks): Correct DatabricksCompositeReader and StatusPoller to Stop/Dispose Appropriately [arrow-adbc]

2025-08-04 Thread via GitHub
toddmeng-db commented on code in PR #3217: URL: https://github.com/apache/arrow-adbc/pull/3217#discussion_r2252808634 ## csharp/src/Drivers/Databricks/DatabricksCompositeReader.cs: ## @@ -66,10 +63,16 @@ internal DatabricksCompositeReader(DatabricksStatement statement, Schema s

Re: [PR] fix(csharp/src/Drivers/Databricks): Correct DatabricksCompositeReader and StatusPoller to Stop/Dispose Appropriately [arrow-adbc]

2025-08-04 Thread via GitHub
toddmeng-db commented on code in PR #3217: URL: https://github.com/apache/arrow-adbc/pull/3217#discussion_r2252808868 ## csharp/src/Drivers/Databricks/DatabricksOperationStatusPoller.cs: ## @@ -97,9 +98,20 @@ public void Dispose() if (_internalCts != null)

Re: [PR] Add arrow-avro `SchemaStore` and fingerprinting [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on PR #8039: URL: https://github.com/apache/arrow-rs/pull/8039#issuecomment-3152768433 @scovich @alamb Here's that first PR for the `SchemaStore` work. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[PR] Add arrow-avro `SchemaStore` and fingerprinting [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 opened a new pull request, #8039: URL: https://github.com/apache/arrow-rs/pull/8039 # Which issue does this PR close? - Part of https://github.com/apache/arrow-rs/issues/4886 - Pre-work for https://github.com/apache/arrow-rs/pull/8006 # Rationale for this chang

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
scovich commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252770776 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into Ar

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
scovich commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252769379 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into Ar

Re: [PR] ci(parquet/pqarrow): integration tests for reading shredded variants DO NOT MERGE YET [arrow-go]

2025-08-04 Thread via GitHub
rdblue commented on PR #455: URL: https://github.com/apache/arrow-go/pull/455#issuecomment-3152748447 @zeroshade, sorry for the confusion here. You're right about a lot of those test cases. They are not allowed by the spec. The implementation I generated these cases from is defensive and tr

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
scovich commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252763116 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into Ar

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#issuecomment-3152727580 > > To move forward, would it be best to simply focus on getting the `schema.rs` changes in first (~500-600 LOC) and then follow-up with a `arrow-avro/src/reader/mod.rs` PR? >

Re: [PR] fix(csharp/src/Drivers/Databricks): Correct DatabricksCompositeReader and StatusPoller to Stop/Dispose Appropriately [arrow-adbc]

2025-08-04 Thread via GitHub
alexguo-db commented on code in PR #3217: URL: https://github.com/apache/arrow-adbc/pull/3217#discussion_r2252739395 ## csharp/src/Drivers/Databricks/DatabricksCompositeReader.cs: ## @@ -66,10 +63,16 @@ internal DatabricksCompositeReader(DatabricksStatement statement, Schema sc

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252735697 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252735697 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252735697 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

Re: [I] Can't view system tables due to Unsupported ArrowType Utf8View [arrow-java]

2025-08-04 Thread via GitHub
lidavidm commented on issue #807: URL: https://github.com/apache/arrow-java/issues/807#issuecomment-3152669556 Well, a PR would be welcome. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
scovich commented on PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#issuecomment-3152638873 > this PR has a lot of comments and quite a few refinements were needed. I also know it was way too big. Honestly, I think the "state machine" for avro decoding is just really com

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
scovich commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252706588 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into Ar

Re: [PR] GH-47189: [C++][Parquet] Fix ParquetFilePrinter to produce valid JSON statistics [arrow]

2025-08-04 Thread via GitHub
conbench-apache-arrow[bot] commented on PR #47190: URL: https://github.com/apache/arrow/pull/47190#issuecomment-3152567425 After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 19f3b85d168b69f524e813848aefb57941261272. There weren't

Re: [I] Double url-encoding of special characters in key names [arrow-rs-object-store]

2025-08-04 Thread via GitHub
tustvold commented on issue #457: URL: https://github.com/apache/arrow-rs-object-store/issues/457#issuecomment-3152429299 Yeah, it's a bit of a historical quirk that'd now be quite difficult to change -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] Use custom thrift decoder to improve speed of parsing parquet metadata [arrow-rs]

2025-08-04 Thread via GitHub
etseidl commented on issue #5854: URL: https://github.com/apache/arrow-rs/issues/5854#issuecomment-3152261449 @alamb if it's ok with you, I plan to create a branch for this work after #8037 is merged. Since all of these changes will be breaking, it will be nice to have a place to make incre

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#issuecomment-3152179396 @scovich @alamb I know this PR has a lot of comments and quite a few refinements were needed. I also know it was way too big. To move forward, would it be best to simpl

Re: [PR] [PoC]: Add unknown field to Parquet thrift unions [arrow-rs]

2025-08-04 Thread via GitHub
etseidl closed pull request #7995: [PoC]: Add unknown field to Parquet thrift unions URL: https://github.com/apache/arrow-rs/pull/7995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [PoC]: Add unknown field to Parquet thrift unions [arrow-rs]

2025-08-04 Thread via GitHub
etseidl commented on PR #7995: URL: https://github.com/apache/arrow-rs/pull/7995#issuecomment-3152121211 Closing as this has served its purpose. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Implement arrow-avro SchemaStore and Fingerprinting To Enable Schema Resolution [arrow-rs]

2025-08-04 Thread via GitHub
jecsand838 commented on code in PR #8006: URL: https://github.com/apache/arrow-rs/pull/8006#discussion_r2252426527 ## arrow-avro/src/reader/mod.rs: ## @@ -124,23 +132,26 @@ fn read_header(mut reader: R) -> Result { /// A low-level interface for decoding Avro-encoded bytes into

  1   2   >