[jira] [Commented] (ARROW-7661) [Python] Specify number of batches for read_csv

[ https://issues.apache.org/jira/browse/ARROW-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023412#comment-17023412 ] Takuya Kato commented on ARROW-7661: The size of `test.csv` file seems to be 246 byte

[jira] [Closed] (ARROW-7678) [C++][Parquet] setting TZ= in environment on Linux causes broken parquet

[ https://issues.apache.org/jira/browse/ARROW-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua Pedrick closed ARROW-7678. - Resolution: Invalid Managed to recreate the bug without setting TZ. > [C++][Parquet] setting TZ=

[jira] [Created] (ARROW-7679) [R] Purge unnecessary dataset classes and methods

Neal Richardson created ARROW-7679: -- Summary: [R] Purge unnecessary dataset classes and methods Key: ARROW-7679 URL: https://issues.apache.org/jira/browse/ARROW-7679 Project: Apache Arrow Is

[jira] [Assigned] (ARROW-7651) [CI][Crossbow] Nightly macOS wheel builds fail

[ https://issues.apache.org/jira/browse/ARROW-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs reassigned ARROW-7651: -- Assignee: Krisztian Szucs > [CI][Crossbow] Nightly macOS wheel builds fail > -

[jira] [Resolved] (ARROW-7651) [CI][Crossbow] Nightly macOS wheel builds fail

[ https://issues.apache.org/jira/browse/ARROW-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs resolved ARROW-7651. Resolution: Fixed Issue resolved by pull request 6278 [https://github.com/apache/arrow/pull

[jira] [Resolved] (ARROW-7668) [Packaging][RPM] Use NInja if possible to reduce build time

[ https://issues.apache.org/jira/browse/ARROW-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kouhei Sutou resolved ARROW-7668. - Fix Version/s: 0.16.0 Resolution: Fixed Issue resolved by pull request 6276 [https://githu

[jira] [Created] (ARROW-7678) [C++][Parquet] setting TZ= in environment on Linux causes broken parquet

Joshua Pedrick created ARROW-7678: - Summary: [C++][Parquet] setting TZ= in environment on Linux causes broken parquet Key: ARROW-7678 URL: https://issues.apache.org/jira/browse/ARROW-7678 Project: Apa

[jira] [Resolved] (ARROW-7674) Add helpful message for captcha challenge in merge_arrow_pr.py

[ https://issues.apache.org/jira/browse/ARROW-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques resolved ARROW-7674. --- Fix Version/s: 0.16.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (ARROW-7651) [CI][Crossbow] Nightly macOS wheel builds fail

[ https://issues.apache.org/jira/browse/ARROW-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7651: -- Labels: pull-request-available (was: ) > [CI][Crossbow] Nightly macOS wheel builds fail >

[jira] [Commented] (ARROW-7677) [C++] Handle Windows file paths with backslashes in GetTargetStats

[ https://issues.apache.org/jira/browse/ARROW-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023197#comment-17023197 ] Joris Van den Bossche commented on ARROW-7677: -- cc [~apitrou] [~bkietz] (no

[jira] [Created] (ARROW-7677) [C++] Handle Windows file paths with backslashes in GetTargetStats

Joris Van den Bossche created ARROW-7677: Summary: [C++] Handle Windows file paths with backslashes in GetTargetStats Key: ARROW-7677 URL: https://issues.apache.org/jira/browse/ARROW-7677 Proj

[jira] [Created] (ARROW-7676) [Packaging][Python] Ensure that the static libraries are not built in the wheel scripts

Krisztian Szucs created ARROW-7676: -- Summary: [Packaging][Python] Ensure that the static libraries are not built in the wheel scripts Key: ARROW-7676 URL: https://issues.apache.org/jira/browse/ARROW-7676

[jira] [Commented] (ARROW-7596) [Python] Only apply zero-copy DataFrame block optimizations when split_blocks=True

[ https://issues.apache.org/jira/browse/ARROW-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023156#comment-17023156 ] Bryan Cutler commented on ARROW-7596: - Linking some discussion on the mailing list re

[jira] [Commented] (ARROW-7513) [JS] Arrow Tutorial: Common data types

[ https://issues.apache.org/jira/browse/ARROW-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023149#comment-17023149 ] Leo Meyerovich commented on ARROW-7513: --- Thanks Brian! I'm slammed for another ~2w,

[jira] [Resolved] (ARROW-7518) [Python] Use PYARROW_WITH_HDFS when building wheels, conda packages

[ https://issues.apache.org/jira/browse/ARROW-7518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-7518. Resolution: Fixed Issue resolved by pull request 6203 [https://github.com/apache/arrow/pull

[jira] [Commented] (ARROW-7669) [CI] [C++] Turn optimizations off on AppVeyor

[ https://issues.apache.org/jira/browse/ARROW-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023125#comment-17023125 ] Neal Richardson commented on ARROW-7669: You're right, it is orthogonal, though m

[jira] [Updated] (ARROW-7662) [R] Support auto-inferring list column type

[ https://issues.apache.org/jira/browse/ARROW-7662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7662: -- Labels: pull-request-available (was: ) > [R] Support auto-inferring list column type > ---

[jira] [Commented] (ARROW-7669) [CI] [C++] Turn optimizations off on AppVeyor

[ https://issues.apache.org/jira/browse/ARROW-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023106#comment-17023106 ] Antoine Pitrou commented on ARROW-7669: --- While the build script would be different,

[jira] [Updated] (ARROW-7672) NULL pointer dereference bug

[ https://issues.apache.org/jira/browse/ARROW-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-7672: --- Component/s: C++ > NULL pointer dereference bug > > >

[jira] [Updated] (ARROW-7672) [C++] NULL pointer dereference bug

[ https://issues.apache.org/jira/browse/ARROW-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-7672: --- Summary: [C++] NULL pointer dereference bug (was: NULL pointer dereference bug) > [C++] NUL

[jira] [Commented] (ARROW-7669) [CI] [C++] Turn optimizations off on AppVeyor

[ https://issues.apache.org/jira/browse/ARROW-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023095#comment-17023095 ] Neal Richardson commented on ARROW-7669: For R I'm planning to take up ARROW-7675

[jira] [Created] (ARROW-7675) [R][CI] Move Windows CI from Appveyor to GHA

Neal Richardson created ARROW-7675: -- Summary: [R][CI] Move Windows CI from Appveyor to GHA Key: ARROW-7675 URL: https://issues.apache.org/jira/browse/ARROW-7675 Project: Apache Arrow Issue T

[jira] [Resolved] (ARROW-7659) [Rust] Reduce Rc usage

[ https://issues.apache.org/jira/browse/ARROW-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale resolved ARROW-7659. --- Fix Version/s: 0.16.0 Resolution: Fixed Issue resolved by pull request 6263 [https://g

[jira] [Updated] (ARROW-7674) Add helpful message for captcha challenge in merge_arrow_pr.py

[ https://issues.apache.org/jira/browse/ARROW-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7674: -- Labels: pull-request-available (was: ) > Add helpful message for captcha challenge in merge_ar

[jira] [Created] (ARROW-7674) Add helpful message for captcha challenge in merge_arrow_pr.py

Brian Hulette created ARROW-7674: Summary: Add helpful message for captcha challenge in merge_arrow_pr.py Key: ARROW-7674 URL: https://issues.apache.org/jira/browse/ARROW-7674 Project: Apache Arrow

[jira] [Resolved] (ARROW-7513) [JS] Arrow Tutorial: Common data types

[ https://issues.apache.org/jira/browse/ARROW-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette resolved ARROW-7513. -- Fix Version/s: 0.16.0 Resolution: Fixed Issue resolved by pull request 6163 [https://git

[jira] [Resolved] (ARROW-7647) [C++] JSON reader fails to read arrays with few values

[ https://issues.apache.org/jira/browse/ARROW-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques resolved ARROW-7647. --- Resolution: Fixed > [C++] JSON reader fails to read arrays with few values >

[jira] [Created] (ARROW-7673) [C++][Dataset] Revisit File discovery failure mode

Francois Saint-Jacques created ARROW-7673: - Summary: [C++][Dataset] Revisit File discovery failure mode Key: ARROW-7673 URL: https://issues.apache.org/jira/browse/ARROW-7673 Project: Apache Arr

[jira] [Created] (ARROW-7672) NULL pointer dereference bug

daehee jang created ARROW-7672: -- Summary: NULL pointer dereference bug Key: ARROW-7672 URL: https://issues.apache.org/jira/browse/ARROW-7672 Project: Apache Arrow Issue Type: Bug Enviro

[jira] [Updated] (ARROW-7647) [C++] JSON reader fails to read arrays with few values

[ https://issues.apache.org/jira/browse/ARROW-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-7647: -- Fix Version/s: 0.16.0 > [C++] JSON reader fails to read arrays with few values > --

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022941#comment-17022941 ] Fabian Höring commented on ARROW-7584: -- An alternative would be to just do Python (a

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022941#comment-17022941 ] Fabian Höring edited comment on ARROW-7584 at 1/24/20 1:41 PM:

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022935#comment-17022935 ] Antoine Pitrou commented on ARROW-7584: --- It's exposed in R AFAIK. > [Python] Impro

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022932#comment-17022932 ] Fabian Höring commented on ARROW-7584: -- By the way do you already use the C++ FileSy

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022929#comment-17022929 ] Fabian Höring edited comment on ARROW-7584 at 1/24/20 1:16 PM:

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022929#comment-17022929 ] Fabian Höring commented on ARROW-7584: -- What I propose is written in the description

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022923#comment-17022923 ] Fabian Höring edited comment on ARROW-7584 at 1/24/20 1:06 PM:

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022925#comment-17022925 ] Antoine Pitrou commented on ARROW-7584: --- I mean whatever you're proposing we should

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022923#comment-17022923 ] Fabian Höring edited comment on ARROW-7584 at 1/24/20 1:05 PM:

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022923#comment-17022923 ] Fabian Höring edited comment on ARROW-7584 at 1/24/20 1:04 PM:

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022923#comment-17022923 ] Fabian Höring commented on ARROW-7584: -- You mean by wrapping everything on top of Py

[jira] [Created] (ARROW-7671) [Python][Dataset] Add bindings for the DatasetFactory

Krisztian Szucs created ARROW-7671: -- Summary: [Python][Dataset] Add bindings for the DatasetFactory Key: ARROW-7671 URL: https://issues.apache.org/jira/browse/ARROW-7671 Project: Apache Arrow

[jira] [Updated] (ARROW-7380) [C++][Dataset] Implement DatasetFactory

[ https://issues.apache.org/jira/browse/ARROW-7380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-7380: --- Fix Version/s: 0.16.0 > [C++][Dataset] Implement DatasetFactory > ---

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022917#comment-17022917 ] Fabian Höring edited comment on ARROW-7584 at 1/24/20 12:57 PM: ---

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022919#comment-17022919 ] Antoine Pitrou commented on ARROW-7584: --- At some point someone has to show that it

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022838#comment-17022838 ] Fabian Höring edited comment on ARROW-7584 at 1/24/20 12:56 PM: ---

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022917#comment-17022917 ] Fabian Höring commented on ARROW-7584: -- Yes, that's why I suggest to not to do yet a

[jira] [Updated] (ARROW-7670) [Python][Dataset] Better ergonomics for the filter expressions

[ https://issues.apache.org/jira/browse/ARROW-7670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7670: -- Labels: pull-request-available (was: ) > [Python][Dataset] Better ergonomics for the filter ex

[jira] [Updated] (ARROW-7670) [Python][Dataset] Better ergonomics for the filter expressions

[ https://issues.apache.org/jira/browse/ARROW-7670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-7670: --- Fix Version/s: 0.16.0 > [Python][Dataset] Better ergonomics for the filter expressions >

[jira] [Created] (ARROW-7670) [Python][Dataset] Better ergonomics for the filter expressions

Krisztian Szucs created ARROW-7670: -- Summary: [Python][Dataset] Better ergonomics for the filter expressions Key: ARROW-7670 URL: https://issues.apache.org/jira/browse/ARROW-7670 Project: Apache Arro

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022877#comment-17022877 ] Antoine Pitrou commented on ARROW-7584: --- By the way, if you look at https://github

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022838#comment-17022838 ] Fabian Höring commented on ARROW-7584: -- Thanks for the tip for pickle. I will have a

[jira] [Comment Edited] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022826#comment-17022826 ] Antoine Pitrou edited comment on ARROW-7584 at 1/24/20 10:11 AM: --

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022826#comment-17022826 ] Antoine Pitrou commented on ARROW-7584: --- As {{pickle}}, you should really use a mod

[jira] [Updated] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated ARROW-7584: - Description: The [new Python FileSystem API |https://github.com/apache/arrow/blob/master/python/

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022824#comment-17022824 ] Antoine Pitrou commented on ARROW-7584: --- Even if not, we could fix DataSet if we de

[jira] [Updated] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Höring updated ARROW-7584: - Description: The [new Python FileSystem API |https://github.com/apache/arrow/blob/master/python/

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022820#comment-17022820 ] Fabian Höring commented on ARROW-7584: -- One other use case: {code} with hdfs.open("

[jira] [Commented] (ARROW-7584) [Python] Improve ergonomics of new FileSystem API

[ https://issues.apache.org/jira/browse/ARROW-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022819#comment-17022819 ] Fabian Höring commented on ARROW-7584: -- So that means the DataSet API is somehow abs

[jira] [Created] (ARROW-7669) [CI] [C++] Turn optimizations off on AppVeyor

Antoine Pitrou created ARROW-7669: - Summary: [CI] [C++] Turn optimizations off on AppVeyor Key: ARROW-7669 URL: https://issues.apache.org/jira/browse/ARROW-7669 Project: Apache Arrow Issue Ty

[jira] [Commented] (ARROW-7669) [CI] [C++] Turn optimizations off on AppVeyor

[ https://issues.apache.org/jira/browse/ARROW-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022817#comment-17022817 ] Antoine Pitrou commented on ARROW-7669: --- cc [~kou] [~npr] > [CI] [C++] Turn optimi