[jira] [Commented] (ARROW-17918) [Python] ExtensionArray.__getitem__ is not called if called from StructArray

2022-10-03 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612489#comment-17612489 ] Joris Van den Bossche commented on ARROW-17918: --- bq. It seems that when ge

[jira] [Assigned] (ARROW-17240) [Release][CI] Exercise the binary verification tasks on a nightly basis

2022-10-03 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kouhei Sutou reassigned ARROW-17240: Assignee: Kouhei Sutou > [Release][CI] Exercise the binary verification tasks on a night

[jira] [Resolved] (ARROW-17856) [CI][Archery] Add new Archery command to delete old branches and tags on crossbow repository

2022-10-03 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kouhei Sutou resolved ARROW-17856. -- Fix Version/s: 10.0.0 Resolution: Fixed Issue resolved by pull request 14248 [https://g

[jira] [Created] (ARROW-17923) [C++] Consider dictionary arrays for special fragment fields

2022-10-03 Thread Will Jones (Jira)
Will Jones created ARROW-17923: -- Summary: [C++] Consider dictionary arrays for special fragment fields Key: ARROW-17923 URL: https://issues.apache.org/jira/browse/ARROW-17923 Project: Apache Arrow

[jira] [Commented] (ARROW-17918) [Python] ExtensionArray.__getitem__ is not called if called from StructArray

2022-10-03 Thread Balazs Jeszenszky (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612437#comment-17612437 ] Balazs Jeszenszky commented on ARROW-17918: --- This is not limited to Structs -

[jira] [Created] (ARROW-17922) AWS SSO for R package

2022-10-03 Thread Brian Broderick (Jira)
Brian Broderick created ARROW-17922: --- Summary: AWS SSO for R package Key: ARROW-17922 URL: https://issues.apache.org/jira/browse/ARROW-17922 Project: Apache Arrow Issue Type: Improvement

[jira] [Updated] (ARROW-17922) AWS SSO for R package

2022-10-03 Thread Brian Broderick (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Broderick updated ARROW-17922: Description: We'd like to use the arrow library to access datasets in AWS S3 but we are re

[jira] [Created] (ARROW-17921) [Java][Doc] Define next steps for Arrow Tools module

2022-10-03 Thread David Dali Susanibar Arce (Jira)
David Dali Susanibar Arce created ARROW-17921: - Summary: [Java][Doc] Define next steps for Arrow Tools module Key: ARROW-17921 URL: https://issues.apache.org/jira/browse/ARROW-17921 Project

[jira] [Commented] (ARROW-17920) Built-in GRPC health checks in FlightServerBase

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612429#comment-17612429 ] David Li commented on ARROW-17920: -- This is probably best proposed on the [mailing lis

[jira] [Created] (ARROW-17920) Built-in GRPC health checks in FlightServerBase

2022-10-03 Thread Akshaya Annavajhala (AK) (Jira)
Akshaya Annavajhala (AK) created ARROW-17920: Summary: Built-in GRPC health checks in FlightServerBase Key: ARROW-17920 URL: https://issues.apache.org/jira/browse/ARROW-17920 Project: Apach

[jira] [Commented] (ARROW-17919) [Java] Potentially inefficient variable-width vector reallocation

2022-10-03 Thread Larry White (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612408#comment-17612408 ] Larry White commented on ARROW-17919: - I will take this one. Thanks [~apitrou]  > [

[jira] [Assigned] (ARROW-17919) [Java] Potentially inefficient variable-width vector reallocation

2022-10-03 Thread Larry White (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry White reassigned ARROW-17919: --- Assignee: Larry White > [Java] Potentially inefficient variable-width vector reallocation >

[jira] [Assigned] (ARROW-17826) [Python] Allow scalars when creating expression from compute kernels

2022-10-03 Thread Miles Granger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Granger reassigned ARROW-17826: - Assignee: Miles Granger > [Python] Allow scalars when creating expression from compute

[jira] [Assigned] (ARROW-16858) [C++] Adding Join Relation ToProto

2022-10-03 Thread Apache Arrow JIRA Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Arrow JIRA Bot reassigned ARROW-16858: - Assignee: (was: Vibhatha Lakmal Abeykoon) > [C++] Adding Join Relat

[jira] [Assigned] (ARROW-15754) [Java] ORC JNI bridge should use the C data interface

2022-10-03 Thread Apache Arrow JIRA Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Arrow JIRA Bot reassigned ARROW-15754: - Assignee: (was: Larry White) > [Java] ORC JNI bridge should use the

[jira] [Commented] (ARROW-16858) [C++] Adding Join Relation ToProto

2022-10-03 Thread Apache Arrow JIRA Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612399#comment-17612399 ] Apache Arrow JIRA Bot commented on ARROW-16858: --- This issue was last updat

[jira] [Assigned] (ARROW-15829) [C++] Support `SetNull` in NumericalBuilder

2022-10-03 Thread Apache Arrow JIRA Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Arrow JIRA Bot reassigned ARROW-15829: - Assignee: (was: Zeyuan Shang) > [C++] Support `SetNull` in Numerica

[jira] [Commented] (ARROW-15829) [C++] Support `SetNull` in NumericalBuilder

2022-10-03 Thread Apache Arrow JIRA Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612397#comment-17612397 ] Apache Arrow JIRA Bot commented on ARROW-15829: --- This issue was last updat

[jira] [Commented] (ARROW-15754) [Java] ORC JNI bridge should use the C data interface

2022-10-03 Thread Apache Arrow JIRA Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612398#comment-17612398 ] Apache Arrow JIRA Bot commented on ARROW-15754: --- This issue was last updat

[jira] [Assigned] (ARROW-12787) [Python] pyarrow.compute not consistent on memory_pool usage

2022-10-03 Thread Miles Granger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Granger reassigned ARROW-12787: - Assignee: Miles Granger > [Python] pyarrow.compute not consistent on memory_pool usage

[jira] [Updated] (ARROW-17919) [Java] Potentially inefficient variable-width vector reallocation

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-17919: --- Description: In several places in the Java codebase you can see this kind of pattern: {code:

[jira] [Created] (ARROW-17919) [Java] Potentially inefficient variable-width vector reallocation

2022-10-03 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-17919: -- Summary: [Java] Potentially inefficient variable-width vector reallocation Key: ARROW-17919 URL: https://issues.apache.org/jira/browse/ARROW-17919 Project: Apache

[jira] [Commented] (ARROW-17919) [Java] Potentially inefficient variable-width vector reallocation

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612393#comment-17612393 ] Antoine Pitrou commented on ARROW-17919: cc [~ljw1001] [~lidavidm] [~emkornfield

[jira] [Commented] (ARROW-17918) [Python] ExtensionArray.__getitem__ is not called if called from StructArray

2022-10-03 Thread Rok Mihevc (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612385#comment-17612385 ] Rok Mihevc commented on ARROW-17918: [~jorisvandenbossche] what's your opinion on th

[jira] [Created] (ARROW-17918) [Python] ExtensionArray.__getitem__ is not called if called from StructArray

2022-10-03 Thread Rok Mihevc (Jira)
Rok Mihevc created ARROW-17918: -- Summary: [Python] ExtensionArray.__getitem__ is not called if called from StructArray Key: ARROW-17918 URL: https://issues.apache.org/jira/browse/ARROW-17918 Project: Apa

[jira] [Commented] (ARROW-17917) [C++] Add opaque device id identification to InputStream

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612381#comment-17612381 ] Antoine Pitrou commented on ARROW-17917: I have no precise idea of how statistic

[jira] [Assigned] (ARROW-17915) [C++] Error when using Substrait ProjectRel

2022-10-03 Thread Vibhatha Lakmal Abeykoon (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vibhatha Lakmal Abeykoon reassigned ARROW-17915: Assignee: Vibhatha Lakmal Abeykoon > [C++] Error when using Subst

[jira] [Commented] (ARROW-17917) [C++] Add opaque device id identification to InputStream

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612378#comment-17612378 ] David Li commented on ARROW-17917: -- To me it sounds like having statistics on the input

[jira] [Commented] (ARROW-17917) [C++] Add opaque device id identification to InputStream

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612374#comment-17612374 ] Antoine Pitrou commented on ARROW-17917: To the former: yes. To the latter: I d

[jira] [Commented] (ARROW-17917) [C++] Add opaque device id identification to InputStream

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612375#comment-17612375 ] Antoine Pitrou commented on ARROW-17917: This might also be useful for OpenTelem

[jira] [Commented] (ARROW-17917) [C++] Add opaque device id identification to InputStream

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612371#comment-17612371 ] David Li commented on ARROW-17917: -- This is in relation to ARROW-17913? Do we really w

[jira] [Commented] (ARROW-17917) [C++] Add opaque device id identification to InputStream

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612370#comment-17612370 ] Antoine Pitrou commented on ARROW-17917: cc [~marsupialtail] [~westonpace] [~lid

[jira] [Created] (ARROW-17917) [C++] Add opaque device id identification to InputStream

2022-10-03 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-17917: -- Summary: [C++] Add opaque device id identification to InputStream Key: ARROW-17917 URL: https://issues.apache.org/jira/browse/ARROW-17917 Project: Apache Arrow

[jira] [Resolved] (ARROW-17016) [C++][Python] Run Arrow Python C++ with pytest and make sure they are run by the CI

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-17016. Resolution: Fixed Issue resolved by pull request 14117 [https://github.com/apache/arrow/pu

[jira] [Resolved] (ARROW-17888) [Docs] Add reference of the cookbook contrib page to New Contributor's Guide

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alenka Frim resolved ARROW-17888. - Fix Version/s: 10.0.0 Resolution: Fixed Issue resolved by pull request 14283 [https://git

[jira] [Updated] (ARROW-17888) [Docs] Add reference of the cookbook contrib page to New Contributor's Guide

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alenka Frim updated ARROW-17888: Component/s: Documentation > [Docs] Add reference of the cookbook contrib page to New Contributor'

[jira] [Commented] (ARROW-17913) feather.read_table 150x slower when reading columns in newer versions

2022-10-03 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-17913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612361#comment-17612361 ] Håkon Magne Holmen commented on ARROW-17913: Maybe use something akin to the

[jira] [Updated] (ARROW-17898) pyarrow.parquet.read_table fs (filesystem) argument does not work with fsspec.implementations.arrow.ArrowFSWrapper objects

2022-10-03 Thread Anshul Kanakia (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anshul Kanakia updated ARROW-17898: --- Description: My version of PyArrow=8.0.0. When I attempt to use a PyArrow LocalFileSystem o

[jira] [Resolved] (ARROW-17857) [C++] Table::CombineChunksToBatch segfaults on empty tables

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-17857. Resolution: Fixed Issue resolved by pull request 14249 [https://github.com/apache/arrow/pu

[jira] [Resolved] (ARROW-17697) [Python] Cython warning in types.pxi

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-17697. Resolution: Fixed Issue resolved by pull request 14280 [https://github.com/apache/arrow/pu

[jira] [Commented] (ARROW-17913) feather.read_table 150x slower when reading columns in newer versions

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612341#comment-17612341 ] Antoine Pitrou commented on ARROW-17913: At some point I think we may have to bi

[jira] [Updated] (ARROW-17279) [R] Error: package or namespace load failed for ‘arrow’ in inDL(x, as.logical(local), as.logical(now), ...):

2022-10-03 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-17279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raúl Cumplido updated ARROW-17279: -- Fix Version/s: (was: 8.0.1) > [R] Error: package or namespace load failed for ‘arrow’ in i

[jira] [Commented] (ARROW-17904) [C++] Parquet support read page with crc32 checking

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612339#comment-17612339 ] Antoine Pitrou commented on ARROW-17904: That would certainly be a welcome addit

[jira] [Updated] (ARROW-17904) [C++] Parquet support read page with crc32 checking

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-17904: --- Priority: Major (was: Minor) > [C++] Parquet support read page with crc32 checking > --

[jira] [Commented] (ARROW-17913) feather.read_table 150x slower when reading columns in newer versions

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612327#comment-17612327 ] David Li commented on ARROW-17913: -- I guess the issue is that we need to know whether t

[jira] [Commented] (ARROW-17913) feather.read_table 150x slower when reading columns in newer versions

2022-10-03 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612326#comment-17612326 ] Joris Van den Bossche commented on ARROW-17913: --- The {{ReadFieldsSubset}}

[jira] [Comment Edited] (ARROW-17913) feather.read_table 150x slower when reading columns in newer versions

2022-10-03 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612323#comment-17612323 ] Joris Van den Bossche edited comment on ARROW-17913 at 10/3/22 2:49 PM: --

[jira] [Resolved] (ARROW-11841) [R][C++] Allow cancelling long-running commands

2022-10-03 Thread Dewey Dunnington (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dewey Dunnington resolved ARROW-11841. -- Resolution: Fixed Issue resolved by pull request 13635 [https://github.com/apache/arro

[jira] [Commented] (ARROW-17913) feather.read_table 150x slower when reading columns in newer versions

2022-10-03 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612323#comment-17612323 ] Joris Van den Bossche commented on ARROW-17913: --- I am not directly sure wh

[jira] [Updated] (ARROW-17898) pyarrow.parquet.read_table fs (filesystem) argument does not work with fsspec.implementations.arrow.ArrowFSWrapper objects

2022-10-03 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raúl Cumplido updated ARROW-17898: -- Fix Version/s: (was: 8.0.2) > pyarrow.parquet.read_table fs (filesystem) argument does not

[jira] [Commented] (ARROW-9938) [Python] Add filesystem capabilities to other IO formats (feather, csv, json, ..)

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612318#comment-17612318 ] Antoine Pitrou commented on ARROW-9938: --- cc [~milesgranger], [~alenka]. Nothing ear

[jira] [Commented] (ARROW-17916) [Python] Allow disabling more components

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612317#comment-17612317 ] Antoine Pitrou commented on ARROW-17916: [~alenka] [~jorisvandenbossche] > [Pyt

[jira] [Updated] (ARROW-17916) [Python] Allow disabling more components

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-17916: --- Fix Version/s: 11.0.0 > [Python] Allow disabling more components > -

[jira] [Created] (ARROW-17916) [Python] Allow disabling more components

2022-10-03 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-17916: -- Summary: [Python] Allow disabling more components Key: ARROW-17916 URL: https://issues.apache.org/jira/browse/ARROW-17916 Project: Apache Arrow Issue Typ

[jira] [Commented] (ARROW-17826) [Python] Allow scalars when creating expression from compute kernels

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612313#comment-17612313 ] Antoine Pitrou commented on ARROW-17826: cc [~milesgranger] > [Python] Allow sc

[jira] [Commented] (ARROW-12787) [Python] pyarrow.compute not consistent on memory_pool usage

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612312#comment-17612312 ] Antoine Pitrou commented on ARROW-12787: I'm not sure this issue still applies.

[jira] [Commented] (ARROW-13952) [Python] Add initial type testing for compute kernels

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612311#comment-17612311 ] Antoine Pitrou commented on ARROW-13952: [~westonpace] Do you think this should

[jira] [Commented] (ARROW-10784) [Python] Loading pyarrow.compute isn't thread safe

2022-10-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612310#comment-17612310 ] Antoine Pitrou commented on ARROW-10784: [~emkornfield] Should we close this? >

[jira] [Updated] (ARROW-17912) [C++] IPC writer does not write an empty batch in the case of an empty table, which PySpark cannot handle

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Li updated ARROW-17912: - Summary: [C++] IPC writer does not write an empty batch in the case of an empty table, which PySpark can

[jira] [Commented] (ARROW-17912) Arrow C++ IPC fails to send an empty table, but Arrow Java can do it.

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612300#comment-17612300 ] David Li commented on ARROW-17912: -- A single Arrow stream has a consistent schema, so y

[jira] [Updated] (ARROW-17915) [C++] Error when using Substrait ProjectRel

2022-10-03 Thread Dewey Dunnington (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dewey Dunnington updated ARROW-17915: - Description: After ARROW-16989 and ARROW-15584, there is new behaviour with ProjectRel.

[jira] [Updated] (ARROW-17915) [C++] Error when using Substrait ProjectRel

2022-10-03 Thread Dewey Dunnington (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dewey Dunnington updated ARROW-17915: - Description: After ARROW-16989 and ARROW-15584, there is new behaviour with ProjectRel.

[jira] [Comment Edited] (ARROW-17912) Arrow C++ IPC fails to send an empty table, but Arrow Java can do it.

2022-10-03 Thread Liangcai li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612284#comment-17612284 ] Liangcai li edited comment on ARROW-17912 at 10/3/22 1:24 PM:

[jira] [Updated] (ARROW-17915) [C++] Error when using Substrait ProjectRel

2022-10-03 Thread Dewey Dunnington (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dewey Dunnington updated ARROW-17915: - Description: After ARROW-16989 and ARROW-15584, there is new behaviour with ProjectRel.

[jira] [Comment Edited] (ARROW-17912) Arrow C++ IPC fails to send an empty table, but Arrow Java can do it.

2022-10-03 Thread Liangcai li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612284#comment-17612284 ] Liangcai li edited comment on ARROW-17912 at 10/3/22 1:16 PM:

[jira] [Comment Edited] (ARROW-17912) Arrow C++ IPC fails to send an empty table, but Arrow Java can do it.

2022-10-03 Thread Liangcai li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612284#comment-17612284 ] Liangcai li edited comment on ARROW-17912 at 10/3/22 1:14 PM:

[jira] [Commented] (ARROW-17912) Arrow C++ IPC fails to send an empty table, but Arrow Java can do it.

2022-10-03 Thread Liangcai li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612284#comment-17612284 ] Liangcai li commented on ARROW-17912: - Thx a lot for review. --- Why not provide th

[jira] [Comment Edited] (ARROW-17912) Arrow C++ IPC fails to send an empty table, but Arrow Java can do it.

2022-10-03 Thread Liangcai li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612284#comment-17612284 ] Liangcai li edited comment on ARROW-17912 at 10/3/22 1:14 PM:

[jira] [Created] (ARROW-17915) [C++] Error when using Substrait ProjectRel

2022-10-03 Thread Dewey Dunnington (Jira)
Dewey Dunnington created ARROW-17915: Summary: [C++] Error when using Substrait ProjectRel Key: ARROW-17915 URL: https://issues.apache.org/jira/browse/ARROW-17915 Project: Apache Arrow Is

[jira] [Created] (ARROW-17914) [Java] Support reading a subset of fields from an IPC file or stream

2022-10-03 Thread David Li (Jira)
David Li created ARROW-17914: Summary: [Java] Support reading a subset of fields from an IPC file or stream Key: ARROW-17914 URL: https://issues.apache.org/jira/browse/ARROW-17914 Project: Apache Arrow

[jira] [Assigned] (ARROW-17799) [C++][Parquet] Add DELTA_LENGTH_BYTE_ARRAY encoder to Parquet writer

2022-10-03 Thread Rok Mihevc (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rok Mihevc reassigned ARROW-17799: -- Assignee: Rok Mihevc > [C++][Parquet] Add DELTA_LENGTH_BYTE_ARRAY encoder to Parquet writer >

[jira] [Updated] (ARROW-17900) [Python] combine_chunks on DictionaryArray appears to be broken

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alenka Frim updated ARROW-17900: Component/s: C++ > [Python] combine_chunks on DictionaryArray appears to be broken > -

[jira] [Updated] (ARROW-17900) [C++] combine_chunks on DictionaryArray appears to be broken

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alenka Frim updated ARROW-17900: Summary: [C++] combine_chunks on DictionaryArray appears to be broken (was: [Python] combine_chun

[jira] [Resolved] (ARROW-17287) [C++] Create scan node that doesn't rely on the merged generator

2022-10-03 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weston Pace resolved ARROW-17287. - Fix Version/s: 10.0.0 Resolution: Fixed Issue resolved by pull request 13782 [https://git

[jira] [Commented] (ARROW-17900) [Python] combine_chunks on DictionaryArray appears to be broken

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612265#comment-17612265 ] Alenka Frim commented on ARROW-17900: - No, I do not think it is a release blocker. J

[jira] [Assigned] (ARROW-6459) [C++] Remove "python" from conda_env_cpp.txt

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alenka Frim reassigned ARROW-6459: -- Assignee: (was: Alenka Frim) > [C++] Remove "python" from conda_env_cpp.txt >

[jira] [Commented] (ARROW-17900) [Python] combine_chunks on DictionaryArray appears to be broken

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612251#comment-17612251 ] David Li commented on ARROW-17900: -- Well, that'd make this the open Jira issue for it :

[jira] [Commented] (ARROW-17912) Arrow C++ IPC fails to send an empty table, but Arrow Java can do it.

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612250#comment-17612250 ] David Li commented on ARROW-17912: -- Looks like PySpark should have the schema in ArrowS

[jira] [Commented] (ARROW-17912) Arrow C++ IPC fails to send an empty table, but Arrow Java can do it.

2022-10-03 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612249#comment-17612249 ] David Li commented on ARROW-17912: -- Hmm, I'd rather not adjust the C++ side. Why not pr

[jira] [Commented] (ARROW-17898) pyarrow.parquet.read_table fs (filesystem) argument does not work with fsspec.implementations.arrow.ArrowFSWrapper objects

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612246#comment-17612246 ] Alenka Frim commented on ARROW-17898: - I haven't used {{ArrowFSWrapper}} or {{fsspec

[jira] [Commented] (ARROW-17900) [Python] combine_chunks on DictionaryArray appears to be broken

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612230#comment-17612230 ] Alenka Frim commented on ARROW-17900: - [~lidavidm] I _think_ this could be a bug in

[jira] [Commented] (ARROW-17901) [Python] pyarrow missing py.typed marker file

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612220#comment-17612220 ] Alenka Frim commented on ARROW-17901: - I think Will gave a great answer on GitHub is

[jira] [Commented] (ARROW-17017) [C++][Python] Enable automate re-build of Arrow Python

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612218#comment-17612218 ] Alenka Frim commented on ARROW-17017: - It would be nice that PyArrow C++ code gets r

[jira] [Closed] (ARROW-17017) [C++][Python] Enable automate re-build of Arrow Python

2022-10-03 Thread Apache Arrow JIRA Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Arrow JIRA Bot closed ARROW-17017. - > [C++][Python] Enable automate re-build of Arrow Python > -

[jira] [Resolved] (ARROW-17017) [C++][Python] Enable automate re-build of Arrow Python

2022-10-03 Thread Alenka Frim (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alenka Frim resolved ARROW-17017. - Resolution: Abandoned > [C++][Python] Enable automate re-build of Arrow Python > ---

[jira] [Commented] (ARROW-14998) [R] Support for HTTPS Filesystem access

2022-10-03 Thread Zac Davies (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612210#comment-17612210 ] Zac Davies commented on ARROW-14998: This would be great, as far as I can tell, this