Re: [I] [C++] Re-enable inlineshidden symbol visibility in Meson configuration [arrow]

2025-09-13 Thread via GitHub
kou commented on issue #47554: URL: https://github.com/apache/arrow/issues/47554#issuecomment-3289242025 Issue resolved by pull request 47556 https://github.com/apache/arrow/pull/47556 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] GH-47554: [C++] Fix Meson Parquet symbol visibility issues [arrow]

2025-09-13 Thread via GitHub
kou merged PR #47556: URL: https://github.com/apache/arrow/pull/47556 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.or

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324#issuecomment-3284658662 πŸ€–: Benchmark completed Details ``` group main variant-builder-custom-state -

Re: [PR] GH-47234: [C++][Python] fill_null regression on windows [arrow]

2025-09-13 Thread via GitHub
pitrou commented on PR #47249: URL: https://github.com/apache/arrow/pull/47249#issuecomment-3266540448 @github-actions crossbow submit wheel-windows-cp313-cp313-amd64 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] chore: bump to version 21/1.9.0 [arrow-adbc]

2025-09-13 Thread via GitHub
lidavidm merged PR #3424: URL: https://github.com/apache/arrow-adbc/pull/3424 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.a

Re: [I] adbc_ingest no possibility of overwrite the exact same elements [arrow-adbc]

2025-09-13 Thread via GitHub
lidavidm commented on issue #3102: URL: https://github.com/apache/arrow-adbc/issues/3102#issuecomment-3289095638 Yes, you need some sort of primary key to accomplish this. I also have realized this may be a duplicate of https://github.com/apache/arrow-adbc/issues/2046 -- This is

Re: [I] CMake not finding configuration for Arrow in 21.0.0 [arrow]

2025-09-13 Thread via GitHub
samueljamesbader commented on issue #47557: URL: https://github.com/apache/arrow/issues/47557#issuecomment-3289051365 Update: Our system has been upgraded from SLES 12 to SLES 15, and now pyarrow installation by pip works smoothly. I'm still using the same cmake version, so I'm not sure wh

Re: [I] java: publish adbc-driver-jni 0.20.0 to Maven Central [arrow-adbc]

2025-09-13 Thread via GitHub
lidavidm commented on issue #3425: URL: https://github.com/apache/arrow-adbc/issues/3425#issuecomment-3288931211 Duplicate of https://github.com/apache/arrow-adbc/issues/2689 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [I] [Python] Add support for pandas DataFrame.attrs [arrow]

2025-09-13 Thread via GitHub
rmnskb commented on issue #45382: URL: https://github.com/apache/arrow/issues/45382#issuecomment-327382 Hey @wohenbushuang ! 1. This change supports only the attributes of `pd.DataFrame`, as they were in scope for this issue. I'm not entirely sure if the `pd.Series` attributes can be

Re: [I] Implement GeoArrow in Go. [arrow-go]

2025-09-13 Thread via GitHub
Mandukhai-Alimaa commented on issue #504: URL: https://github.com/apache/arrow-go/issues/504#issuecomment-323620 take -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] chore: bump typedoc from 0.28.11 to 0.28.12 [arrow-js]

2025-09-13 Thread via GitHub
kou merged PR #271: URL: https://github.com/apache/arrow-js/pull/271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

Re: [PR] GH-35508: [arrow]

2025-09-13 Thread via GitHub
github-actions[bot] commented on PR #47553: URL: https://github.com/apache/arrow/pull/47553#issuecomment-3284223822 :warning: GitHub issue #35508 **has been automatically assigned in GitHub** to PR creator. -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [I] adbc_ingest no possibility of overwrite the exact same elements [arrow-adbc]

2025-09-13 Thread via GitHub
nikfio commented on issue #3102: URL: https://github.com/apache/arrow-adbc/issues/3102#issuecomment-3288877196 Hi all, sorry for my late reply. I managed to achieve the result by explicitly executing a clean of all rows with the exact same timestamp and keeping valid the first one

Re: [I] Alias `Record` to `RecordBatch` and soft-deprecate `Record` [arrow-go]

2025-09-13 Thread via GitHub
prochac commented on issue #457: URL: https://github.com/apache/arrow-go/issues/457#issuecomment-3288867608 I have no personal experience with this tool, but possibly it could prevent the next breaking change in a patch version. Ofc, it can't detect logic breaking changes, but these users

Re: [PR] Add storage class for aws, gcp, and azure [arrow-rs-object-store]

2025-09-13 Thread via GitHub
alamb merged PR #456: URL: https://github.com/apache/arrow-rs-object-store/pull/456 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@a

Re: [I] CMake not finding configuration for Arrow in 21.0.0 [arrow]

2025-09-13 Thread via GitHub
samueljamesbader commented on issue #47557: URL: https://github.com/apache/arrow/issues/47557#issuecomment-3288797461 Thanks! Here's the relevant excerpt of that full build log, with some paths redacted by [[double-square-brackets]]. ... CMake Error at CMakeLists.tx

Re: [PR] GH-47348: [C++][Python] Make S3FileSystem pickle-able with retry strategy [arrow]

2025-09-13 Thread via GitHub
wingkitlee0 commented on PR #47350: URL: https://github.com/apache/arrow/pull/47350#issuecomment-3288790775 bump -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [PR] Fix host handling for default HDFS URI (fix for #25324 when used via `from_uri()`) [arrow]

2025-09-13 Thread via GitHub
dsevilla commented on PR #47458: URL: https://github.com/apache/arrow/pull/47458#issuecomment-3288777956 I added a new issue. Now this pull request fixes #47560. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Variant] Add tests for variant_get requesting Some struct [arrow-rs]

2025-09-13 Thread via GitHub
scovich commented on PR #8343: URL: https://github.com/apache/arrow-rs/pull/8343#issuecomment-3288721664 CC @alamb @codephage2020 -- another quickie (once the PR it depends on merges) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] Fix host handling for default HDFS URI (fix for #25324 when used via `from_uri()`) [arrow]

2025-09-13 Thread via GitHub
dsevilla commented on PR #47458: URL: https://github.com/apache/arrow/pull/47458#issuecomment-3288755660 Any work on this? It is not working the "default" value of HDFS host if used in `from_uri()`. -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [I] Archery integration test SIGSEGV [arrow-go]

2025-09-13 Thread via GitHub
zeroshade commented on issue #405: URL: https://github.com/apache/arrow-go/issues/405#issuecomment-3288524552 Is this still reproducible? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] The link on the main repository page is broken [arrow-go]

2025-09-13 Thread via GitHub
zeroshade commented on issue #491: URL: https://github.com/apache/arrow-go/issues/491#issuecomment-3288520886 Fixed the link in #492 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] [Variant] Make VariantToArrowRowBuilder an enum [arrow-rs]

2025-09-13 Thread via GitHub
scovich opened a new pull request, #8345: URL: https://github.com/apache/arrow-rs/pull/8345 * NOTE: Stacked on https://github.com/apache/arrow-rs/pull/8344, ignore the first two commits # Which issue does this PR close? We generally require a GitHub issue to be filed for all bu

[PR] [Variant] Add tests for variant_get requesting Some struct [arrow-rs]

2025-09-13 Thread via GitHub
scovich opened a new pull request, #8343: URL: https://github.com/apache/arrow-rs/pull/8343 * NOTE: stacked on https://github.com/apache/arrow-rs/pull/8342/, ignore the first commit # Which issue does this PR close? We generally require a GitHub issue to be filed for all bug fi

Re: [PR] [Variant] Make VariantToArrowRowBuilder an enum [arrow-rs]

2025-09-13 Thread via GitHub
scovich commented on PR #8345: URL: https://github.com/apache/arrow-rs/pull/8345#issuecomment-3288732702 @alamb -- interested to hear your thoughts on this change? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [Variant] Rename VariantShreddingRowBuilder to VariantToArrowRowBuilder [arrow-rs]

2025-09-13 Thread via GitHub
scovich commented on PR #8344: URL: https://github.com/apache/arrow-rs/pull/8344#issuecomment-3288726697 CC @alamb @codephage2020 -- a quickie -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] [Variant] Rename VariantShreddingRowBuilder to VariantToArrowRowBuilder [arrow-rs]

2025-09-13 Thread via GitHub
scovich opened a new pull request, #8344: URL: https://github.com/apache/arrow-rs/pull/8344 # Which issue does this PR close? We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an is

[PR] [Variant] Add nullable arg to StructArrayBuilder::with_field [arrow-rs]

2025-09-13 Thread via GitHub
scovich opened a new pull request, #8342: URL: https://github.com/apache/arrow-rs/pull/8342 # Which issue does this PR close? We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an is

Re: [PR] [Variant] Add nullable arg to StructArrayBuilder::with_field [arrow-rs]

2025-09-13 Thread via GitHub
scovich commented on PR #8342: URL: https://github.com/apache/arrow-rs/pull/8342#issuecomment-3288715584 CC @alamb @codephage2020 -- should be a quickie -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] GH-47532: [C++] Fixes for Arrow STL iterator for custom types [arrow]

2025-09-13 Thread via GitHub
bkietz commented on code in PR #47531: URL: https://github.com/apache/arrow/pull/47531#discussion_r2346805616 ## cpp/src/arrow/stl_iterator.h: ## @@ -247,33 +248,39 @@ class ChunkedArrayIterator { }; /// Return an iterator to the beginning of the chunked array -template ::Ar

Re: [I] [Parquet] Expose predicates from RowFilter [arrow-rs]

2025-09-13 Thread via GitHub
alamb closed issue #8314: [Parquet] Expose predicates from RowFilter URL: https://github.com/apache/arrow-rs/issues/8314 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [I] [Variant] Support Shredded Objects in `variant_get`: typed path access (STEP 1) [arrow-rs]

2025-09-13 Thread via GitHub
alamb closed issue #8150: [Variant] Support Shredded Objects in `variant_get`: typed path access (STEP 1) URL: https://github.com/apache/arrow-rs/issues/8150 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [I] Alias `Record` to `RecordBatch` and soft-deprecate `Record` [arrow-go]

2025-09-13 Thread via GitHub
Mandukhai-Alimaa commented on issue #457: URL: https://github.com/apache/arrow-go/issues/457#issuecomment-3288669101 Hello, I read your comment. I apologize for the inconvenience this caused. We can’t revert this change because the number of people impacted was very small, and most have alr

Re: [PR] [Parquet] Support page level cache for reading [arrow-rs]

2025-09-13 Thread via GitHub
XiangpengHao commented on PR #8306: URL: https://github.com/apache/arrow-rs/pull/8306#issuecomment-3288555935 > it would be very helpful in real-world projects if users could use caching to avoid as much computation (decompression, serialization, etc.) and I/O as possible. πŸ’―, I tota

Re: [PR] chore: Bump github.com/stretchr/testify from 1.11.0 to 1.11.1 [arrow-go]

2025-09-13 Thread via GitHub
zeroshade merged PR #488: URL: https://github.com/apache/arrow-go/pull/488 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apac

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324#issuecomment-3288138294 πŸ€– `./gh_compare_arrow.sh` [Benchmark Script](https://github.com/alamb/datafusion-benchmarking/blob/main/scripts/gh_compare_arrow.sh) Running Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ub

Re: [PR] GH-46375: [C++] Add adapters/orc directory to Meson [arrow]

2025-09-13 Thread via GitHub
wgtmac commented on PR #46906: URL: https://github.com/apache/arrow/pull/46906#issuecomment-3288456949 Can we try `set(ORC_PACKAGE_KIND "conan")`? https://github.com/apache/orc/blob/main/cmake_modules/ThirdpartyToolchain.cmake#L269 -- This is an automated message from the Apache Gi

Re: [PR] GH-47554: [C++] Fix Meson Parquet symbol visibility issues [arrow]

2025-09-13 Thread via GitHub
WillAyd commented on code in PR #47556: URL: https://github.com/apache/arrow/pull/47556#discussion_r2346744076 ## cpp/src/arrow/util/visibility.h: ## @@ -67,6 +67,11 @@ #ifndef ARROW_NO_EXPORT # define ARROW_NO_EXPORT [[gnu::visibility("hidden")]] #endif +#if

Re: [PR] GH-47559: [Python] Fix missing argument in pyarrow fs [arrow]

2025-09-13 Thread via GitHub
github-actions[bot] commented on PR #47497: URL: https://github.com/apache/arrow/pull/47497#issuecomment-3288386858 :warning: GitHub issue #47559 **has been automatically assigned in GitHub** to PR creator. -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] Add storage class for aws, gcp, and azure [arrow-rs-object-store]

2025-09-13 Thread via GitHub
alamb commented on code in PR #456: URL: https://github.com/apache/arrow-rs-object-store/pull/456#discussion_r2346578715 ## src/attributes.rs: ## @@ -45,6 +45,14 @@ pub enum Attribute { /// /// See [Cache-Control](https://developer.mozilla.org/en-US/docs/Web/HTTP/Hea

Re: [PR] GH-46375: [C++] Add adapters/orc directory to Meson [arrow]

2025-09-13 Thread via GitHub
kou commented on PR #46906: URL: https://github.com/apache/arrow/pull/46906#issuecomment-3288343759 @wgtmac Can Apache ORC also try finding CMake config packages? For example, can https://github.com/apache/orc/blob/main/cmake_modules/FindSnappy.cmake call `find_package(Snappy CONFIG)` like

Re: [PR] Add storage class for aws, gcp, and azure [arrow-rs-object-store]

2025-09-13 Thread via GitHub
alamb commented on PR #456: URL: https://github.com/apache/arrow-rs-object-store/pull/456#issuecomment-3288329804 Thanks everyone! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [I] Support setting storage class when objects are written [arrow-rs-object-store]

2025-09-13 Thread via GitHub
alamb closed issue #330: Support setting storage class when objects are written URL: https://github.com/apache/arrow-rs-object-store/issues/330 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324#issuecomment-3288144407 πŸ€– `./gh_compare_arrow.sh` [Benchmark Script](https://github.com/alamb/datafusion-benchmarking/blob/main/scripts/gh_compare_arrow.sh) Running Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ub

Re: [PR] Fix `can_cast_types` for temporal to `Utf8View` [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on code in PR #8328: URL: https://github.com/apache/arrow-rs/pull/8328#discussion_r2346575847 ## arrow-cast/src/cast/mod.rs: ## @@ -5775,28 +5774,9 @@ mod tests { assert!(c.is_null(2)); } -#[test] -fn test_cast_date32_to_string() { -

Re: [PR] Add arrow-avro examples and Reader documentation [arrow-rs]

2025-09-13 Thread via GitHub
alamb merged PR #8316: URL: https://github.com/apache/arrow-rs/pull/8316 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache

Re: [PR] Add arrow-avro examples and Reader documentation [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on PR #8316: URL: https://github.com/apache/arrow-rs/pull/8316#issuecomment-3288322728 Thanks again @jecsand838 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Fix `can_cast_types` for temporal to `Utf8View` [arrow-rs]

2025-09-13 Thread via GitHub
alamb merged PR #8328: URL: https://github.com/apache/arrow-rs/pull/8328 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache

Re: [PR] Add storage class for aws, gcp, and azure [arrow-rs-object-store]

2025-09-13 Thread via GitHub
alamb commented on PR #456: URL: https://github.com/apache/arrow-rs-object-store/pull/456#issuecomment-3288129864 @tustvold are you happy with merging this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb merged PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324#issuecomment-3288321333 Looks great and the performance seems like they are even a little faster. πŸš€ thank you so much @scovich -- This is an automated message from the Apache Git Service. To respond to the me

Re: [I] [CI][Crossbow] Use apache/arrow instead of separated repository (e.g. ursacomputing/crossbow) [arrow]

2025-09-13 Thread via GitHub
kou commented on issue #46014: URL: https://github.com/apache/arrow/issues/46014#issuecomment-3288312341 > matlab We should include this to `nightly-packaging`. (BTW, it seems that we can merge it to `.github/workflows/matlab.yml`.) > r-recheck-strong > r-recheck-most

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324#issuecomment-3288145130 πŸ€–: Benchmark completed Details ``` group main variant-builder-custom-state -

Re: [PR] GH-47554: [C++] Fix Meson Parquet symbol visibility issues [arrow]

2025-09-13 Thread via GitHub
kou commented on code in PR #47556: URL: https://github.com/apache/arrow/pull/47556#discussion_r2346507974 ## cpp/src/arrow/util/visibility.h: ## @@ -67,6 +67,11 @@ #ifndef ARROW_NO_EXPORT # define ARROW_NO_EXPORT [[gnu::visibility("hidden")]] #endif +#if def

Re: [PR] GH-47554: [C++] Fix Meson Parquet symbol visibility issues [arrow]

2025-09-13 Thread via GitHub
kou commented on code in PR #47556: URL: https://github.com/apache/arrow/pull/47556#discussion_r2346507974 ## cpp/src/arrow/util/visibility.h: ## @@ -67,6 +67,11 @@ #ifndef ARROW_NO_EXPORT # define ARROW_NO_EXPORT [[gnu::visibility("hidden")]] #endif +#if def

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324#issuecomment-3288144377 πŸ€–: Benchmark completed Details ``` group main variant-builder-custom-state -

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on code in PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324#discussion_r2346439492 ## parquet-variant/src/builder.rs: ## @@ -736,34 +748,68 @@ impl BuilderSpecificState for ObjectParentState<'_> { /// the parent, and we cannot "split" a mutable refere

Re: [PR] [Variant] ParentState tracks builder-specific state in a uniform way [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on PR #8324: URL: https://github.com/apache/arrow-rs/pull/8324#issuecomment-3288131550 πŸ€– `./gh_compare_arrow.sh` [Benchmark Script](https://github.com/alamb/datafusion-benchmarking/blob/main/scripts/gh_compare_arrow.sh) Running Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ub

Re: [PR] aws: downgrade credential provider info! log messages to debug! [arrow-rs-object-store]

2025-09-13 Thread via GitHub
alamb commented on PR #436: URL: https://github.com/apache/arrow-rs-object-store/pull/436#issuecomment-3288127800 Thanks @asubiotto and @philjb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] aws: downgrade credential provider info! log messages to debug! [arrow-rs-object-store]

2025-09-13 Thread via GitHub
alamb merged PR #436: URL: https://github.com/apache/arrow-rs-object-store/pull/436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@a

Re: [PR] Adds additional type support to arrow-avro writer [arrow-rs]

2025-09-13 Thread via GitHub
alamb merged PR #8298: URL: https://github.com/apache/arrow-rs/pull/8298 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache

Re: [I] [C++][Python] Add default data type for completely null arrays when field is not populated in pyarrow.csv.ConvertOptions [arrow]

2025-09-13 Thread via GitHub
MurrayData commented on issue #47314: URL: https://github.com/apache/arrow/issues/47314#issuecomment-3287959166 > If I understand correctly you are suggesting empty columns that would be created as Null Type to be stored as empty strings? Not necessarily, I'm suggesting user defined.

Re: [PR] Minor: avoid an `Arc::clone` in CacheOptions for Parquet PredicateCache [arrow-rs]

2025-09-13 Thread via GitHub
mbrobbel merged PR #8338: URL: https://github.com/apache/arrow-rs/pull/8338 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apa

[PR] chore: Fix permission error on deploying main docs [arrow-dotnet]

2025-09-13 Thread via GitHub
kou opened a new pull request, #38: URL: https://github.com/apache/arrow-dotnet/pull/38 ## What's Changed We need `permissions: contents: write` to push the `asf-site` branch. We don't need `contents: write` for the `package` job. Closes #37. -- This is an automate

Re: [PR] Add `variant_experimental` feature to `parquet` crate [arrow-rs]

2025-09-13 Thread via GitHub
alamb commented on code in PR #8133: URL: https://github.com/apache/arrow-rs/pull/8133#discussion_r2330885535 ## parquet/Cargo.toml: ## @@ -124,6 +128,8 @@ encryption = ["dep:ring"] # Explicitely enabling rust_backend and zlib-rs features for flate2 flate2-rust_backened = ["fl

Re: [I] [Variant] `VariantArray::data_type` returns `StructType`, causing `Array::as_struct` to panic [arrow-rs]

2025-09-13 Thread via GitHub
scovich commented on issue #8319: URL: https://github.com/apache/arrow-rs/issues/8319#issuecomment-3285956937 It seems like no matter what, a variant column is is just a plain old ordinary `StructType` and `StructArray`. We could take several approaches to the variant extension type

Re: [I] `LocalFileSystem.head()` does not work on directories [arrow-rs-object-store]

2025-09-13 Thread via GitHub
tustvold commented on issue #483: URL: https://github.com/apache/arrow-rs-object-store/issues/483#issuecomment-3286402705 Yes we explicitly workaround azure hierarchical namespaces - https://github.com/apache/arrow-rs-object-store/blob/main/src%2Fazure%2Fclient.rs#L954 This ensures c

Re: [PR] feat(go/adbc): Initial Databricks Driver - Continuation of Jade's PR [arrow-adbc]

2025-09-13 Thread via GitHub
jasonlin45 commented on code in PR #3325: URL: https://github.com/apache/arrow-adbc/pull/3325#discussion_r2338853218 ## go/adbc/driver/databricks/statement_test.go: ## @@ -0,0 +1,46 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license

[PR] Bounds checking for Flatbuf should be enabled in the default build [arrow-dotnet]

2025-09-13 Thread via GitHub
CurtHagenlocher opened a new pull request, #47: URL: https://github.com/apache/arrow-dotnet/pull/47 ## What's Changed Enables bounds checking for Flatbuf as input can't generally be trusted. Adds a test for a malformed column name length. Makes some fixes required to be able to b

Re: [PR] Bounds checking for Flatbuf should be enabled in the default build [arrow-dotnet]

2025-09-13 Thread via GitHub
github-actions[bot] commented on PR #47: URL: https://github.com/apache/arrow-dotnet/pull/47#issuecomment-3286838925 Documentation preview URL: https://CurtHagenlocher.github.io/arrow-dotnet If the preview URL doesn't work, you may need to configure your fork repository for preview.

Re: [PR] Implemented casting for RunEnd Encoding [arrow-rs]

2025-09-13 Thread via GitHub
Rich-T-kid commented on PR #7713: URL: https://github.com/apache/arrow-rs/pull/7713#issuecomment-3286049774 Yes, I removed the double copying for each cast. Im implementing the cast operation for each supported type in groups. Im just a bit busy as im taking 20 credits this semester with a

Re: [PR] fix: Fix wrong NuGet package extension in `dev/release/release.sh` [arrow-dotnet]

2025-09-13 Thread via GitHub
github-actions[bot] commented on PR #54: URL: https://github.com/apache/arrow-dotnet/pull/54#issuecomment-3286936944 Documentation preview URL: https://kou.github.io/arrow-dotnet If the preview URL doesn't work, you may need to configure your fork repository for preview. See https

Re: [PR] chore(client/retry): include error info in logs when retry occurs [arrow-rs-object-store]

2025-09-13 Thread via GitHub
tustvold merged PR #487: URL: https://github.com/apache/arrow-rs-object-store/pull/487 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr..

Re: [I] When a client http request is retried, I would like more information in the `info!` about the retry [arrow-rs-object-store]

2025-09-13 Thread via GitHub
tustvold closed issue #486: When a client http request is retried, I would like more information in the `info!` about the retry URL: https://github.com/apache/arrow-rs-object-store/issues/486 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] chore: Fix descriptions/examples in `dev/release/README.md` [arrow-dotnet]

2025-09-13 Thread via GitHub
kou merged PR #53: URL: https://github.com/apache/arrow-dotnet/pull/53 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.o