Re: [I] Return dataset or list of created files from pyarrow.parquet.write_to_dataset() [arrow]

2024-05-26 Thread via GitHub
AlenkaF commented on issue #41399: URL: https://github.com/apache/arrow/issues/41399#issuecomment-2132771738 I would suggest using `file_visitor` keyword to supply a visitor that will be called with each file created and will store file paths. See https://arrow.apache.org/docs/dev/python/da

Re: [PR] GH-41755: [C++][ORC] Teach CheckTimeZoneDatabaseAvailability how to inspect conda environments [arrow]

2024-05-26 Thread via GitHub
h-vetinari commented on code in PR #41767: URL: https://github.com/apache/arrow/pull/41767#discussion_r1615551852 ## cpp/src/arrow/adapters/orc/adapter.cc: ## @@ -189,15 +189,21 @@ liborc::RowReaderOptions DefaultRowReaderOptions() { #ifdef ARROW_ORC_NEED_TIME_ZONE_DATABASE_CHE

Re: [PR] GH-41818: [C++][Parquet] normalize dictionary encoding to use RLE_DICTIONARY [arrow]

2024-05-26 Thread via GitHub
wgtmac commented on code in PR #41819: URL: https://github.com/apache/arrow/pull/41819#discussion_r1615548005 ## cpp/src/parquet/encoding.cc: ## @@ -442,12 +442,12 @@ class DictEncoderImpl : public EncoderImpl, virtual public DictEncoder { constexpr static int32_t kDataPageB

Re: [PR] GH-41818: [C++][Parquet] normalize dictionary encoding to use RLE_DICTIONARY [arrow]

2024-05-26 Thread via GitHub
mapleFU commented on PR #41819: URL: https://github.com/apache/arrow/pull/41819#issuecomment-2132747143 cc @wgtmac @pitrou @ClifHouck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] Object Store HTTP Rate Limiting [arrow-rs]

2024-05-26 Thread via GitHub
hesampakdaman commented on issue #5396: URL: https://github.com/apache/arrow-rs/issues/5396#issuecomment-2132702717 @tustvold I'll gladly take a stab at this. Am I correct in understanding that we would like to limit the number of requests in `send_retry`? ```diff modified object

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132646608 Revision: 110760c46ae9fc256ff1bfccb7a518ac3cd40ad7 Submitted crossbow builds: [ursacomputing/crossbow @ actions-e0edde6931](https://github.com/ursacomputing/crossbow/bra

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
kou commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132644654 @github-actions crossbow submit almalinux-9-amd64 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] GH-41806: [GLib][CI] Use vcpkg for C++ dependencies when building GLib libraries with MSVC [arrow]

2024-05-26 Thread via GitHub
kou commented on code in PR #41839: URL: https://github.com/apache/arrow/pull/41839#discussion_r1615444868 ## .github/workflows/ruby.yml: ## @@ -387,11 +392,28 @@ jobs: env: # We can invalidate the current cache by updating this. CACHE_VERSION: "20

Re: [I] Issue using open_dataset() in r4.4.0 [arrow]

2024-05-26 Thread via GitHub
SHEvElynP commented on issue #41835: URL: https://github.com/apache/arrow/issues/41835#issuecomment-2132624801 Sure: > sessionInfo() R version 4.4.0 (2024-04-24) Platform: x86_64-pc-linux-gnu Running under: Red Hat Enterprise Linux 8.8 (Ootpa) > Matrix products: default

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
kiszk commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132624012 Yeah, interesting. While I close this, I will include a link to this PR in related issues. -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
kiszk closed pull request #41832: [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 URL: https://github.com/apache/arrow/pull/41832 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] Issue using open_dataset() in r4.4.0 [arrow]

2024-05-26 Thread via GitHub
assignUser commented on issue #41835: URL: https://github.com/apache/arrow/issues/41835#issuecomment-2132621183 Just to avoid any confussion could you post the output off `sessionInfo()` here? -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [I] Issue using open_dataset() in r4.4.0 [arrow]

2024-05-26 Thread via GitHub
SHEvElynP commented on issue #41835: URL: https://github.com/apache/arrow/issues/41835#issuecomment-2132601682 Hello! Thank you for responding. I think I'm on Intel (computer itself is a Thinkpad with an intel core i5 processor). Are you planning on making the new version available for 4.4

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132596289 Revision: 51d6c738cecc5d0ce2d2425b686e790130f17929 Submitted crossbow builds: [ursacomputing/crossbow @ actions-43a53ea857](https://github.com/ursacomputing/crossbow/bra

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
kou commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132594761 @github-actions crossbow submit almalinux-9-amd64 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
kou commented on code in PR #41837: URL: https://github.com/apache/arrow/pull/41837#discussion_r1615442491 ## java/dataset/src/main/cpp/jni_wrapper.cc: ## @@ -27,7 +27,9 @@ #include "arrow/dataset/file_base.h" #include "arrow/filesystem/localfs.h" #include "arrow/filesystem/p

Re: [I] Issue using open_dataset() in r4.4.0 [arrow]

2024-05-26 Thread via GitHub
assignUser commented on issue #41835: URL: https://github.com/apache/arrow/issues/41835#issuecomment-2132592302 You are on mac? Intel or arm (apple silicone)? We just released a new version and the binaries are now available for mac (except for 4.4 intel) so just installing again might sol

Re: [PR] GH-41806: [GLib][CI] Use vcpkg for C++ dependencies when building GLib libraries with MSVC [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41839: URL: https://github.com/apache/arrow/pull/41839#issuecomment-2132590595 :warning: GitHub issue #41806 **has been automatically assigned in GitHub** to PR creator. -- This is an automated message from the Apache Git Service. To respond to the mes

[PR] GH-41806: [GLib][CI] Use vcpkg for C++ dependencies when building GLib libraries with MSVC [arrow]

2024-05-26 Thread via GitHub
adamreeve opened a new pull request, #41839: URL: https://github.com/apache/arrow/pull/41839 ### Rationale for this change This is more consistent as vcpkg is now used for both the Arrow C++ dependencies and GLib library dependencies, and also fixes building arrow-flight-glib and arr

Re: [PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
PHILO-HE commented on code in PR #41837: URL: https://github.com/apache/arrow/pull/41837#discussion_r1615434993 ## java/dataset/src/main/cpp/jni_wrapper.cc: ## @@ -27,7 +27,9 @@ #include "arrow/dataset/file_base.h" #include "arrow/filesystem/localfs.h" #include "arrow/filesys

Re: [I] [Java] Jni mvn generate-resources failed because not generate arrow-bom [arrow]

2024-05-26 Thread via GitHub
jinchengchenghh commented on issue #41808: URL: https://github.com/apache/arrow/issues/41808#issuecomment-2132579569 I cannot follow the guide to build jni libraries. The command is `mvn generate-resources -Pgenerate-libs-jni-macos-linux -N` https://arrow.apache.org/docs/developers/

Re: [I] [R] CRAN packaging checklist for version 16.1.0 [arrow]

2024-05-26 Thread via GitHub
assignUser commented on issue #41647: URL: https://github.com/apache/arrow/issues/41647#issuecomment-2132575287 but also: ``` Arrow package version: 16.1.0 Capabilities: acero TRUE datasetTRUE substrait FALSE parquetTRUE json TRUE s3

Re: [I] [R] CRAN packaging checklist for version 16.1.0 [arrow]

2024-05-26 Thread via GitHub
assignUser commented on issue #41647: URL: https://github.com/apache/arrow/issues/41647#issuecomment-2132573195 And the error is gone again? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] GH-41810: [C++] Support cast kernel from (dense or sparse) union to (large) string [arrow]

2024-05-26 Thread via GitHub
llama90 commented on code in PR #41827: URL: https://github.com/apache/arrow/pull/41827#discussion_r1615425769 ## cpp/src/arrow/compute/kernels/scalar_cast_string.cc: ## @@ -510,6 +510,60 @@ void AddBinaryToFixedSizeBinaryCast(CastFunction* func) { AddBinaryToFixedSizeBinaryC

Re: [PR] GH-41810: [C++] Support cast kernel from (dense or sparse) union to (large) string [arrow]

2024-05-26 Thread via GitHub
llama90 commented on code in PR #41827: URL: https://github.com/apache/arrow/pull/41827#discussion_r1615425029 ## cpp/src/arrow/compute/kernels/scalar_cast_string.cc: ## @@ -510,6 +510,60 @@ void AddBinaryToFixedSizeBinaryCast(CastFunction* func) { AddBinaryToFixedSizeBinaryC

Re: [PR] GH-41608: [C++][Python] Extends the add_key_value to parquet::arrow and PyArrow [arrow]

2024-05-26 Thread via GitHub
mapleFU commented on code in PR #41633: URL: https://github.com/apache/arrow/pull/41633#discussion_r1615416973 ## cpp/src/parquet/arrow/writer.h: ## @@ -143,6 +143,16 @@ class PARQUET_EXPORT FileWriter { virtual ~FileWriter(); virtual MemoryPool* memory_pool() const = 0;

Re: [PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
kou commented on code in PR #41837: URL: https://github.com/apache/arrow/pull/41837#discussion_r1615414913 ## java/dataset/src/main/cpp/jni_wrapper.cc: ## @@ -27,7 +27,9 @@ #include "arrow/dataset/file_base.h" #include "arrow/filesystem/localfs.h" #include "arrow/filesystem/p

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132546096 Revision: 02ad5f1bb1ad8c58d99de787649a3d64e1453415 Submitted crossbow builds: [ursacomputing/crossbow @ actions-198c2e90b4](https://github.com/ursacomputing/crossbow/bra

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
kou commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132544432 @github-actions crossbow submit almalinux-9-amd64 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
PHILO-HE commented on code in PR #41837: URL: https://github.com/apache/arrow/pull/41837#discussion_r1615413660 ## java/dataset/src/main/cpp/jni_wrapper.cc: ## @@ -27,7 +27,9 @@ #include "arrow/dataset/file_base.h" #include "arrow/filesystem/localfs.h" #include "arrow/filesys

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132544254 Revision: 001315e217e368aa47a8d1a5fdf0fe2785bd78f6 Submitted crossbow builds: [ursacomputing/crossbow @ actions-b49b3b10b5](https://github.com/ursacomputing/crossbow/bra

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132542541 :warning: GitHub issue #41784 **has been automatically assigned in GitHub** to PR creator. -- This is an automated message from the Apache Git Service. To respond to the mes

[PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
kou opened a new pull request, #41838: URL: https://github.com/apache/arrow/pull/41838 ### Rationale for this change We should use `arrow${SO_VERSION}-libs` not `arrow${MAJOR_VERSION}-libs` to co-exist newer versions and older versions. ### What changes are included in this PR?

Re: [PR] GH-41784: [Packaging][RPM] Use SO version for -libs package name [arrow]

2024-05-26 Thread via GitHub
kou commented on PR #41838: URL: https://github.com/apache/arrow/pull/41838#issuecomment-2132542522 @github-actions crossbow submit almalinux-9-amd64 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] [Packaging][deb] libarrow1600 shoud be libarrow1601 for 16.1.0 [arrow]

2024-05-26 Thread via GitHub
kou commented on issue #41679: URL: https://github.com/apache/arrow/issues/41679#issuecomment-2132536058 It seems that we have a logic for this: https://github.com/apache/arrow/blob/1c9e393b73195840960dfb9eca8c0dc390be751a/dev/release/post-11-bump-versions.sh#L70-L105 But it seems tha

Re: [PR] GH-41810: [C++] Support cast kernel from (dense or sparse) union to (large) string [arrow]

2024-05-26 Thread via GitHub
ZhangHuiGui commented on code in PR #41827: URL: https://github.com/apache/arrow/pull/41827#discussion_r1615404981 ## cpp/src/arrow/compute/kernels/scalar_cast_string.cc: ## @@ -510,6 +510,60 @@ void AddBinaryToFixedSizeBinaryCast(CastFunction* func) { AddBinaryToFixedSizeBin

Re: [I] [Packaging][deb] libarrow1600 shoud be libarrow1601 for 16.1.0 [arrow]

2024-05-26 Thread via GitHub
kou commented on issue #41679: URL: https://github.com/apache/arrow/issues/41679#issuecomment-2132534303 @h-vetinari Sorry... I was wrong... We should have used a minor-level pinning. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] GH-41810: [C++] Support cast kernel from (dense or sparse) union to (large) string [arrow]

2024-05-26 Thread via GitHub
ZhangHuiGui commented on code in PR #41827: URL: https://github.com/apache/arrow/pull/41827#discussion_r1615404981 ## cpp/src/arrow/compute/kernels/scalar_cast_string.cc: ## @@ -510,6 +510,60 @@ void AddBinaryToFixedSizeBinaryCast(CastFunction* func) { AddBinaryToFixedSizeBin

Re: [PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
kou commented on code in PR #41837: URL: https://github.com/apache/arrow/pull/41837#discussion_r1615398790 ## java/dataset/src/main/cpp/jni_wrapper.cc: ## @@ -27,7 +27,9 @@ #include "arrow/dataset/file_base.h" #include "arrow/filesystem/localfs.h" #include "arrow/filesystem/p

Re: [PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41837: URL: https://github.com/apache/arrow/pull/41837#issuecomment-2132509158 Revision: 1ef554d51d772a7c5970abc3b8f53afbb0924be6 Submitted crossbow builds: [ursacomputing/crossbow @ actions-8150e0c94c](https://github.com/ursacomputing/crossbow/bra

Re: [PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
vibhatha commented on PR #41837: URL: https://github.com/apache/arrow/pull/41837#issuecomment-2132507132 @github-actions crossbow submit -g java -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] GH-41608: [C++][Python] Extends the add_key_value to parquet::arrow and PyArrow [arrow]

2024-05-26 Thread via GitHub
wgtmac commented on code in PR #41633: URL: https://github.com/apache/arrow/pull/41633#discussion_r1615387576 ## cpp/src/parquet/arrow/writer.h: ## @@ -143,6 +143,16 @@ class PARQUET_EXPORT FileWriter { virtual ~FileWriter(); virtual MemoryPool* memory_pool() const = 0;

Re: [PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41837: URL: https://github.com/apache/arrow/pull/41837#issuecomment-2132489474 :warning: GitHub issue #41836 **has been automatically assigned in GitHub** to PR creator. -- This is an automated message from the Apache Git Service. To respond to the mes

[PR] GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF [arrow]

2024-05-26 Thread via GitHub
PHILO-HE opened a new pull request, #41837: URL: https://github.com/apache/arrow/pull/41837 ### Rationale for this change ### What changes are included in this PR? ### Are these changes tested? ### Are there any user-facing changes?

Re: [I] [Python] Extend csv `invalid_row_handler` with `fill_null` and `ignore_unknown` [arrow]

2024-05-26 Thread via GitHub
djouallah commented on issue #35198: URL: https://github.com/apache/arrow/issues/35198#issuecomment-2132462514 is this implemented yet ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
lidavidm commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132429205 Interesting, it looks like anything beyond 3.2 does not work -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] Stateless prepared statements wrap `DoPutPreparedStatementResult` with `Any` which is differs from Go implementation [arrow-rs]

2024-05-26 Thread via GitHub
lidavidm commented on issue #5731: URL: https://github.com/apache/arrow-rs/issues/5731#issuecomment-2132429001 Maybe we should start an issue to list the problems so we remember what we'd like to fix? -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] Stateless prepared statements wrap `DoPutPreparedStatementResult` with `Any` which is differs from Go implementation [arrow-rs]

2024-05-26 Thread via GitHub
lidavidm commented on issue #5731: URL: https://github.com/apache/arrow-rs/issues/5731#issuecomment-2132428915 > I think lets just change the Rust implementation to match the others, whilst I can dream of a FlightSqlV2 that is less of an incoherent mess, and perhaps uses gRPC directly to de

Re: [PR] WIP: [Format] Add Other canonical extension type [arrow]

2024-05-26 Thread via GitHub
rok commented on code in PR #41823: URL: https://github.com/apache/arrow/pull/41823#discussion_r1615320030 ## docs/source/format/CanonicalExtensions.rst: ## @@ -283,6 +283,59 @@ UUID A specific UUID version is not required or guaranteed. This extension represents UUIDs

Re: [PR] GH-41834: [R] Better error handling in dplyr code [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41576: URL: https://github.com/apache/arrow/pull/41576#issuecomment-2132379978 :warning: GitHub issue #41834 **has been automatically assigned in GitHub** to PR creator. -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] GH-41755: [C++][ORC] Teach CheckTimeZoneDatabaseAvailability how to inspect conda environments [arrow]

2024-05-26 Thread via GitHub
kou commented on code in PR #41767: URL: https://github.com/apache/arrow/pull/41767#discussion_r1615318742 ## cpp/src/arrow/adapters/orc/adapter.cc: ## @@ -189,15 +189,21 @@ liborc::RowReaderOptions DefaultRowReaderOptions() { #ifdef ARROW_ORC_NEED_TIME_ZONE_DATABASE_CHECK //

Re: [I] ADBC Python Postgres - Stuck connections to the database [arrow-adbc]

2024-05-26 Thread via GitHub
gaspardc-met commented on issue #1881: URL: https://github.com/apache/arrow-adbc/issues/1881#issuecomment-2132300261 1. Never touched the postgres server pod before, during or after the issue. 2. Did not try restarting the server with ADBC 3. Using SQLalchemy seems to have fixed the is

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132269583 Revision: 317361271167808349f6ba51953d7444b47c2f3c Submitted crossbow builds: [ursacomputing/crossbow @ actions-406ecd371b](https://github.com/ursacomputing/crossbow/bra

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132268994 @github-actions crossbow submit test-r-linux-as-cran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132260844 Revision: 9d773e51bc0230011839f6b5aa45cd0eb5009300 Submitted crossbow builds: [ursacomputing/crossbow @ actions-019fb3b20f](https://github.com/ursacomputing/crossbow/bra

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132260184 @github-actions crossbow submit test-r-linux-as-cran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132259576 Revision: 8ecb4b44513d31e2d4518fd1c2b5bd5c118ed2f6 Submitted crossbow builds: [ursacomputing/crossbow @ actions-5ade7889bb](https://github.com/ursacomputing/crossbow/bra

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132258946 @github-actions crossbow submit test-r-linux-as-cran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132257770 Revision: 2d626410451b456bf4920bda7dabbfa944b01c59 Submitted crossbow builds: [ursacomputing/crossbow @ actions-5d28f4cf8f](https://github.com/ursacomputing/crossbow/bra

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132257017 @github-actions crossbow submit test-r-linux-as-cran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132254638 Revision: 49a6ac68f7829e9451198aeef303f3d475dc4f6d Submitted crossbow builds: [ursacomputing/crossbow @ actions-9eada8f15b](https://github.com/ursacomputing/crossbow/bra

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132253954 @github-actions crossbow submit test-r-linux-as-cran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132248928 Revision: 0fb5faad09e5d9061577c37d050adfa16818945b Submitted crossbow builds: [ursacomputing/crossbow @ actions-8134fb2db6](https://github.com/ursacomputing/crossbow/bra

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
kiszk commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132248339 @github-actions crossbow submit -g java -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132233777 Revision: 86dd93278f17e948b21635d0da4087e3b5bcb8c7 Submitted crossbow builds: [ursacomputing/crossbow @ actions-211370147c](https://github.com/ursacomputing/crossbow/bra

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132233180 @github-actions crossbow submit test-r-linux-as-cran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132232065 Revision: ff98bc1a2c5c651e5bd2800fa443aa22e979fbb7 Submitted crossbow builds: [ursacomputing/crossbow @ actions-3fc5d8254d](https://github.com/ursacomputing/crossbow/bra

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132231441 @github-actions crossbow submit test-r-linux-as-cran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132217367 Revision: 3308bacc34596ecf848547c9c3fd7f9059508dc9 Submitted crossbow builds: [ursacomputing/crossbow @ actions-3cca51e59a](https://github.com/ursacomputing/crossbow/bra

Re: [PR] GH-41668: [C++] Support cast kernel from list-like to (large) string [arrow]

2024-05-26 Thread via GitHub
llama90 commented on code in PR #41831: URL: https://github.com/apache/arrow/pull/41831#discussion_r1615198228 ## cpp/src/arrow/compute/kernels/scalar_cast_test.cc: ## @@ -2476,54 +2508,137 @@ TEST(Cast, ListToFSL) { CastOptions::Safe(fixed_size_li

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132216706 @github-actions crossbow submit test-r-linux-as-cran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] Testing: add remote testing to CRAN tests [arrow]

2024-05-26 Thread via GitHub
jonkeane commented on PR #41828: URL: https://github.com/apache/arrow/pull/41828#issuecomment-2132215066 > Are we sure these jobs have recent enough versions of R? AH you're totally right these are the old rhub images which have stopped updating. I thought I caught all of

Re: [I] Stateless prepared statements wrap `DoPutPreparedStatementResult` with `Any` which is differs from Go implementation [arrow-rs]

2024-05-26 Thread via GitHub
tustvold commented on issue #5731: URL: https://github.com/apache/arrow-rs/issues/5731#issuecomment-2132191796 I think lets just change the Rust implementation to match the others, whilst I can dream of a FlightSqlV2 that is less of an incoherent mess, and perhaps uses gRPC directly to defi

Re: [I] Reduce Allocations When Reading Parquet Metadata [arrow-rs]

2024-05-26 Thread via GitHub
alamb commented on issue #5775: URL: https://github.com/apache/arrow-rs/issues/5775#issuecomment-2132161545 2x for decoding parquet metadata, often cited as the long pole for handling parquet files with large schemas, seems a very good justification for a custom code generator (or just hard

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132138614 Revision: 6f15afccffec2b959e12a71aad612cd35ee2f0aa Submitted crossbow builds: [ursacomputing/crossbow @ actions-9180e72cd2](https://github.com/ursacomputing/crossbow/bra

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
kiszk commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132138001 @github-actions crossbow submit -g java -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132134812 ``` Unable to match any tasks for `test-spark` The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/9241881252 ``` -- This is an automa

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
kiszk commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132134512 @github-actions crossbow submit test-spark -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] [Java] bump maven.plugins:maven-shade-plugin to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
kiszk commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132128775 3.4.2 causes the following error ``` [INFO] ---< org.apache.arrow:arrow-vector > [INFO] Building Arrow Vectors 17.0.0-SNAPSHOT

Re: [PR] bump to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132122919 Revision: 889de170acf2f24551d8acf067955b0493578576 Submitted crossbow builds: [ursacomputing/crossbow @ actions-407ac80468](https://github.com/ursacomputing/crossbow/bra

Re: [PR] WIP: [Format] Add Other canonical extension type [arrow]

2024-05-26 Thread via GitHub
lidavidm commented on code in PR #41823: URL: https://github.com/apache/arrow/pull/41823#discussion_r1615101285 ## docs/source/format/CanonicalExtensions.rst: ## @@ -283,6 +283,59 @@ UUID A specific UUID version is not required or guaranteed. This extension represents U

Re: [PR] bump to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
lidavidm commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132122094 @github-actions crossbow submit -g java -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] GH-41668: [WIP][C++] Support cast kernel from list-like to (large) string [arrow]

2024-05-26 Thread via GitHub
llama90 commented on PR #41831: URL: https://github.com/apache/arrow/pull/41831#issuecomment-2132121449 The reason for handling these types in a PR. - list, large list, list view, large list view, fixed-size list, and map ```mermaid classDiagram NestedType <|-- BaseLis

Re: [PR] bump to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #41832: URL: https://github.com/apache/arrow/pull/41832#issuecomment-2132120280 Thanks for opening a pull request! If this is not a [minor PR](https://github.com/apache/arrow/blob/main/CONTRIBUTING.md#Minor-Fixes). Could you open an issue f

[PR] bump to 3.4.2 [arrow]

2024-05-26 Thread via GitHub
kiszk opened a new pull request, #41832: URL: https://github.com/apache/arrow/pull/41832 ### Rationale for this change Bumps [org.apache.maven.plugins:maven-shade-plugin](https://github.com/apache/maven-shade-plugin) from 3.2.4 to newer version, but not to 3.5.2 ##

[PR] GH-41668: [WIP][C++] Support cast kernel from list-like to (large) string [arrow]

2024-05-26 Thread via GitHub
llama90 opened a new pull request, #41831: URL: https://github.com/apache/arrow/pull/41831 ### Rationale for this change Support `cast` kernel from list-like (such as `list`, `large list`, `list view`, `large list view`, `fixed size list`, and `map`) to (large) string