[jira] [Resolved] (ARROW-11159) [Developer] Consolidate pull request related jobs

2021-01-07 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kouhei Sutou resolved ARROW-11159. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 9120 [https://git

[jira] [Updated] (ARROW-11157) [Python] Consistent handling of categoricals

2021-01-07 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale updated ARROW-11157: --- Summary: [Python] Consistent handling of categoricals (was: Consistent handling of categori

[jira] [Updated] (ARROW-11149) [Rust] create_batch_empty - support List, LargeList

2021-01-07 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale updated ARROW-11149: --- Summary: [Rust] create_batch_empty - support List, LargeList (was: create_batch_empty - sup

[jira] [Updated] (ARROW-11075) Getting reference not found with OCR enabled pyarrow

2021-01-07 Thread Kandarpa (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kandarpa updated ARROW-11075: - Priority: Blocker (was: Major) > Getting reference not found with OCR enabled pyarrow > ---

[jira] [Updated] (ARROW-10299) [Rust] Support reading and writing V5 of IPC metadata

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-10299: --- Labels: pull-request-available (was: ) > [Rust] Support reading and writing V5 of IPC metad

[jira] [Assigned] (ARROW-10299) [Rust] Support reading and writing V5 of IPC metadata

2021-01-07 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale reassigned ARROW-10299: -- Assignee: Neville Dipale (was: meng qingyou) > [Rust] Support reading and writing V5

[jira] [Commented] (ARROW-9777) [Rust] Implement IPC changes to catch up to 1.0.0 format

2021-01-07 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260316#comment-17260316 ] Neville Dipale commented on ARROW-9777: --- Hi [~andygrove], I've opened the PR that c

[jira] [Assigned] (ARROW-10917) [Rust][Doc] Update feature matrix

2021-01-07 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale reassigned ARROW-10917: -- Assignee: Neville Dipale > [Rust][Doc] Update feature matrix > --

[jira] [Created] (ARROW-11160) [Rust] pitfall in xxx_equal functions

2021-01-07 Thread meng qingyou (Jira)
meng qingyou created ARROW-11160: Summary: [Rust] pitfall in xxx_equal functions Key: ARROW-11160 URL: https://issues.apache.org/jira/browse/ARROW-11160 Project: Apache Arrow Issue Type: Impr

[jira] [Updated] (ARROW-10917) [Rust][Doc] Update feature matrix

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-10917: --- Labels: pull-request-available (was: ) > [Rust][Doc] Update feature matrix > --

[jira] [Assigned] (ARROW-10259) [Rust] Support field metadata

2021-01-07 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale reassigned ARROW-10259: -- Assignee: meng qingyou > [Rust] Support field metadata >

[jira] [Resolved] (ARROW-10259) [Rust] Support field metadata

2021-01-07 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale resolved ARROW-10259. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 9025 [https:/

[jira] [Updated] (ARROW-11160) [Rust] pitfall in xxx_equal functions

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meng qingyou updated ARROW-11160: - Description: Functions `pub(super) fn _equal` in rust/src/array/equal/ MUST fail if called

[jira] [Updated] (ARROW-11160) [Rust] pitfall in xxx_equal functions

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meng qingyou updated ARROW-11160: - Description: Functions `pub(super) fn _equal` in rust/src/array/equal/ MUST fail if called

[jira] [Updated] (ARROW-3690) [Rust] Add Rust to the format integration testing

2021-01-07 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale updated ARROW-3690: -- Fix Version/s: (was: 3.0.0) 4.0.0 > [Rust] Add Rust to the format integr

[jira] [Commented] (ARROW-11160) [Rust] pitfall in xxx_equal functions

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260431#comment-17260431 ] meng qingyou commented on ARROW-11160: -- I did some updates to demonstrate possible

[jira] [Comment Edited] (ARROW-11160) [Rust] pitfall in xxx_equal functions

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260431#comment-17260431 ] meng qingyou edited comment on ARROW-11160 at 1/7/21, 11:29 AM: --

[jira] [Comment Edited] (ARROW-11160) [Rust] pitfall in xxx_equal functions

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260431#comment-17260431 ] meng qingyou edited comment on ARROW-11160 at 1/7/21, 11:32 AM: --

[jira] [Reopened] (ARROW-11131) [Rust] Improve performance of bool_equal

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meng qingyou reopened ARROW-11131: -- > [Rust] Improve performance of bool_equal > > >

[jira] [Updated] (ARROW-11131) [Rust] Improve performance of bool_equal

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meng qingyou updated ARROW-11131: - Description: It seems that the performance of `bool_equal` in ``  can be improved. (was: ARROW-

[jira] [Comment Edited] (ARROW-11131) [Rust] Improve performance of bool_equal

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259426#comment-17259426 ] meng qingyou edited comment on ARROW-11131 at 1/7/21, 12:52 PM: --

[jira] [Issue Comment Deleted] (ARROW-11131) [Rust] Improve performance of bool_equal

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meng qingyou updated ARROW-11131: - Comment: was deleted (was: This was resolved by https://issues.apache.org/jira/browse/ARROW-1112

[jira] [Updated] (ARROW-11131) [Rust] Improve performance of bool_equal

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meng qingyou updated ARROW-11131: - Labels: (was: pull-request-available) > [Rust] Improve performance of bool_equal > ---

[jira] [Updated] (ARROW-11131) [Rust] Improve performance of bool_equal

2021-01-07 Thread meng qingyou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meng qingyou updated ARROW-11131: - Description: It seems that the performance of `bool_equal` in `arrow/src/array/equal/boolean.rs`

[jira] [Updated] (ARROW-11131) [Rust] Improve performance of bool_equal

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-11131: --- Labels: pull-request-available (was: ) > [Rust] Improve performance of bool_equal > ---

[jira] [Assigned] (ARROW-11030) [Rust] [DataFusion] HashJoinExec slow with many batches

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb reassigned ARROW-11030: --- Assignee: Daniël Heres > [Rust] [DataFusion] HashJoinExec slow with many batches >

[jira] [Resolved] (ARROW-11030) [Rust] [DataFusion] HashJoinExec slow with many batches

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb resolved ARROW-11030. - Resolution: Fixed Issue resolved by pull request 9070 [https://github.com/apache/arrow/pull/9070

[jira] [Updated] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Nicolas Renkamp (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Renkamp updated ARROW-11161: Attachment: Screen Shot 2021-01-07 at 15.23.07.png > [Python][C++] S3Filesystem: file Cont

[jira] [Created] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Nicolas Renkamp (Jira)
Nicolas Renkamp created ARROW-11161: --- Summary: [Python][C++] S3Filesystem: file Content-Type not set correctly? Key: ARROW-11161 URL: https://issues.apache.org/jira/browse/ARROW-11161 Project: Apach

[jira] [Updated] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Nicolas Renkamp (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Renkamp updated ARROW-11161: Description: I am using the Fileystem abstraction to write out html / text files to the l

[jira] [Created] (ARROW-11162) [C++] Fix crash on Decimal256 Parquet file (OSS-Fuzz)

2021-01-07 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-11162: -- Summary: [C++] Fix crash on Decimal256 Parquet file (OSS-Fuzz) Key: ARROW-11162 URL: https://issues.apache.org/jira/browse/ARROW-11162 Project: Apache Arrow

[jira] [Updated] (ARROW-11162) [C++] Fix crash on Decimal256 Parquet file (OSS-Fuzz)

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-11162: --- Labels: pull-request-available (was: ) > [C++] Fix crash on Decimal256 Parquet file (OSS-Fu

[jira] [Created] (ARROW-11163) [C++][Python] Compressed Feather file written with pyarrow 0.17 not readable in pyarrow 2.0.0+

2021-01-07 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-11163: - Summary: [C++][Python] Compressed Feather file written with pyarrow 0.17 not readable in pyarrow 2.0.0+ Key: ARROW-11163 URL: https://issues.apache.org/jira/brow

[jira] [Updated] (ARROW-11163) [C++][Python] Compressed Feather file written with pyarrow 0.17 not readable in pyarrow 2.0.0+

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-11163: -- Issue Type: Bug (was: Improvement) > [C++][Python] Compressed Feather file wr

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260566#comment-17260566 ] Antoine Pitrou commented on ARROW-11161: I had no idea S3 stored a content-type

[jira] [Updated] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Nicolas Renkamp (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Renkamp updated ARROW-11161: Attachment: boto3-metadata.png > [Python][C++] S3Filesystem: file Content-Type not set cor

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Nicolas Renkamp (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260574#comment-17260574 ] Nicolas Renkamp commented on ARROW-11161: - [~apitrou] Uploaded. Yes, it was als

[jira] [Assigned] (ARROW-11163) [C++][Python] Compressed Feather file written with pyarrow 0.17 not readable in pyarrow 2.0.0+

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-11163: - Assignee: Joris Van den Bossche > [C++][Python] Compressed Feather file

[jira] [Created] (ARROW-11164) [Rust][DataFusion] Implement optional second argument to ltrim and rtrim functions

2021-01-07 Thread Andrew Lamb (Jira)
Andrew Lamb created ARROW-11164: --- Summary: [Rust][DataFusion] Implement optional second argument to ltrim and rtrim functions Key: ARROW-11164 URL: https://issues.apache.org/jira/browse/ARROW-11164 Proj

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260579#comment-17260579 ] Antoine Pitrou commented on ARROW-11161: I don't think the C++ AWS SDK uses any

[jira] [Created] (ARROW-11165) [Rust] [DataFusion] Document the desired SQL dialect for DataFusion

2021-01-07 Thread Andrew Lamb (Jira)
Andrew Lamb created ARROW-11165: --- Summary: [Rust] [DataFusion] Document the desired SQL dialect for DataFusion Key: ARROW-11165 URL: https://issues.apache.org/jira/browse/ARROW-11165 Project: Apache Arr

[jira] [Updated] (ARROW-11138) [Rust] [DataFusion] Support ltrim, rtrim

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb updated ARROW-11138: Summary: [Rust] [DataFusion] Support ltrim, rtrim (was: [Rust] Support ltrim, rtrim) > [Rust] [D

[jira] [Updated] (ARROW-11138) [Rust] [DataFusion] Support ltrim, rtrim

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb updated ARROW-11138: Component/s: (was: Rust) Rust - DataFusion > [Rust] [DataFusion] Support ltri

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Nicolas Renkamp (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260585#comment-17260585 ] Nicolas Renkamp commented on ARROW-11161: - I am struggling to find this default

[jira] [Assigned] (ARROW-11138) [Rust] [DataFusion] Support ltrim, rtrim

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb reassigned ARROW-11138: --- Assignee: Patsura Dmitry > [Rust] [DataFusion] Support ltrim, rtrim > -

[jira] [Resolved] (ARROW-11138) [Rust] [DataFusion] Support ltrim, rtrim

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb resolved ARROW-11138. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 9108 [https://githu

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260589#comment-17260589 ] Antoine Pitrou commented on ARROW-11161: If you grep for AMZN_XML_CONTENT_TYPE y

[jira] [Comment Edited] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260589#comment-17260589 ] Antoine Pitrou edited comment on ARROW-11161 at 1/7/21, 3:48 PM: -

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260590#comment-17260590 ] Antoine Pitrou commented on ARROW-11161: That said, "binary/octet-stream" isn't

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260591#comment-17260591 ] Antoine Pitrou commented on ARROW-11161: And to answer your other question, we a

[jira] [Created] (ARROW-11166) [Python][Compute] Add bindings for ProjectOptions

2021-01-07 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-11166: - Summary: [Python][Compute] Add bindings for ProjectOptions Key: ARROW-11166 URL: https://issues.apache.org/jira/browse/ARROW-11166 Project: Apache Ar

[jira] [Updated] (ARROW-11166) [Python][Compute] Add bindings for ProjectOptions

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-11166: -- Fix Version/s: 3.0.0 > [Python][Compute] Add bindings for ProjectOptions > ---

[jira] [Updated] (ARROW-11166) [Python][Compute] Add bindings for ProjectOptions

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-11166: -- Priority: Blocker (was: Major) > [Python][Compute] Add bindings for ProjectOp

[jira] [Commented] (ARROW-11166) [Python][Compute] Add bindings for ProjectOptions

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260595#comment-17260595 ] Joris Van den Bossche commented on ARROW-11166: --- (it would be nice to have

[jira] [Updated] (ARROW-11165) [Rust] [DataFusion] Document the desired SQL dialect for DataFusion

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-11165: --- Labels: pull-request-available (was: ) > [Rust] [DataFusion] Document the desired SQL diale

[jira] [Created] (ARROW-11167) [Python][Compute] Improve usability for defining sort options

2021-01-07 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-11167: - Summary: [Python][Compute] Improve usability for defining sort options Key: ARROW-11167 URL: https://issues.apache.org/jira/browse/ARROW-11167 Proje

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Nicolas Renkamp (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260599#comment-17260599 ] Nicolas Renkamp commented on ARROW-11161: - You are right, found it. Thanks for t

[jira] [Updated] (ARROW-11163) [C++][Python] Compressed Feather file written with pyarrow 0.17 not readable in pyarrow 2.0.0+

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-11163: --- Labels: pull-request-available (was: ) > [C++][Python] Compressed Feather file written with

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260608#comment-17260608 ] Antoine Pitrou commented on ARROW-11161: [~npr] Do you have opinions on this? >

[jira] [Commented] (ARROW-10850) [R] Unrecognized compression type: LZ4 on Windows

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260609#comment-17260609 ] Joris Van den Bossche commented on ARROW-10850: --- ARROW-11163 has a reprodu

[jira] [Updated] (ARROW-10850) [R] Unrecognized compression type: LZ4 on Windows

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-10850: -- Fix Version/s: 3.0.0 > [R] Unrecognized compression type: LZ4 on Windows > ---

[jira] [Assigned] (ARROW-10905) [Python] Add support for Python 3.9 windows wheels

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson reassigned ARROW-10905: --- Assignee: Neal Richardson (was: Terence Honles) > [Python] Add support for Python

[jira] [Assigned] (ARROW-10905) [Python] Add support for Python 3.9 windows wheels

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson reassigned ARROW-10905: --- Assignee: Terence Honles (was: Neal Richardson) > [Python] Add support for Python

[jira] [Assigned] (ARROW-10457) [CI] Fix Spark branch-3.0 integration tests

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson reassigned ARROW-10457: --- Assignee: Neal Richardson (was: Andrew Wieteska) > [CI] Fix Spark branch-3.0 integ

[jira] [Assigned] (ARROW-10457) [CI] Fix Spark branch-3.0 integration tests

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson reassigned ARROW-10457: --- Assignee: Andrew Wieteska (was: Neal Richardson) > [CI] Fix Spark branch-3.0 integ

[jira] [Resolved] (ARROW-9187) [R] Add bindings for arithmetic kernels

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-9187. Resolution: Fixed Issue resolved by pull request 9117 [https://github.com/apache/arrow/pull

[jira] [Updated] (ARROW-10941) [Doc][C++] Document supported Parquet encryption features

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-10941: --- Fix Version/s: 3.0.0 > [Doc][C++] Document supported Parquet encryption features > -

[jira] [Resolved] (ARROW-10097) [C++] Persist SetLookupState in between usages of IsIn when filtering dataset batches

2021-01-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman resolved ARROW-10097. -- Resolution: Fixed > [C++] Persist SetLookupState in between usages of IsIn when filtering data

[jira] [Resolved] (ARROW-8876) [C++] Implement casts from date types to Timestamp

2021-01-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman resolved ARROW-8876. - Resolution: Fixed > [C++] Implement casts from date types to Timestamp >

[jira] [Updated] (ARROW-10439) [C++][Dataset] Add max file size as a dataset writing option

2021-01-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman updated ARROW-10439: - Fix Version/s: (was: 3.0.0) 4.0.0 > [C++][Dataset] Add max file size as a

[jira] [Updated] (ARROW-10768) [Python] pandas deprecated passing ndim=None to Block constructor

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-10768: -- Fix Version/s: (was: 3.0.0) > [Python] pandas deprecated passing ndim=None

[jira] [Commented] (ARROW-10436) [Python][Dataset] Deprecate RowGroupInfo

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260636#comment-17260636 ] Joris Van den Bossche commented on ARROW-10436: --- (since it's not yet clear

[jira] [Updated] (ARROW-10436) [Python][Dataset] Deprecate RowGroupInfo

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-10436: -- Fix Version/s: (was: 3.0.0) 4.0.0 > [Python][Dataset] D

[jira] [Assigned] (ARROW-10768) [Python] pandas deprecated passing ndim=None to Block constructor

2021-01-07 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-10768: - Assignee: (was: Joris Van den Bossche) > [Python] pandas deprecated

[jira] [Updated] (ARROW-11075) Getting reference not found with OCR enabled pyarrow

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-11075: Component/s: (was: C++) Python > Getting reference not found with OCR

[jira] [Updated] (ARROW-11075) [Python] Getting reference not found with OCR enabled pyarrow

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-11075: Summary: [Python] Getting reference not found with OCR enabled pyarrow (was: Getting refe

[jira] [Updated] (ARROW-11075) Getting reference not found with OCR enabled pyarrow

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-11075: Priority: Major (was: Blocker) > Getting reference not found with OCR enabled pyarrow > -

[jira] [Updated] (ARROW-11122) [Rust] Add FFI for date and time

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb updated ARROW-11122: Component/s: Rust > [Rust] Add FFI for date and time > > >

[jira] [Resolved] (ARROW-11122) [Rust] Add FFI for date and time

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb resolved ARROW-11122. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 9089 [https://githu

[jira] [Commented] (ARROW-11161) [Python][C++] S3Filesystem: file Content-Type not set correctly?

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260647#comment-17260647 ] Neal Richardson commented on ARROW-11161: - If the aws-sdk-cpp has an API for set

[jira] [Resolved] (ARROW-10864) [Rust] Use standard ordering for floats

2021-01-07 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lamb resolved ARROW-10864. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 8882 [https://githu

[jira] [Created] (ARROW-11168) [Rust] cargo doc warnings

2021-01-07 Thread meng qingyou (Jira)
meng qingyou created ARROW-11168: Summary: [Rust] cargo doc warnings Key: ARROW-11168 URL: https://issues.apache.org/jira/browse/ARROW-11168 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-11169) [Rust] Add a comment explaining where float total_order algorithm came from

2021-01-07 Thread Andrew Lamb (Jira)
Andrew Lamb created ARROW-11169: --- Summary: [Rust] Add a comment explaining where float total_order algorithm came from Key: ARROW-11169 URL: https://issues.apache.org/jira/browse/ARROW-11169 Project: Ap

[jira] [Created] (ARROW-11170) [Rust] limit unnecessary public

2021-01-07 Thread meng qingyou (Jira)
meng qingyou created ARROW-11170: Summary: [Rust] limit unnecessary public Key: ARROW-11170 URL: https://issues.apache.org/jira/browse/ARROW-11170 Project: Apache Arrow Issue Type: Improvemen

[jira] [Updated] (ARROW-11169) [Rust] Add a comment explaining where float total_order algorithm came from

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-11169: --- Labels: pull-request-available (was: ) > [Rust] Add a comment explaining where float total_

[jira] [Created] (ARROW-11171) [Go] Build fails on s390x with noasm tag

2021-01-07 Thread Jonathan Albrecht (Jira)
Jonathan Albrecht created ARROW-11171: - Summary: [Go] Build fails on s390x with noasm tag Key: ARROW-11171 URL: https://issues.apache.org/jira/browse/ARROW-11171 Project: Apache Arrow Iss

[jira] [Resolved] (ARROW-10941) [Doc][C++] Document supported Parquet encryption features

2021-01-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-10941. Resolution: Fixed Issue resolved by pull request 8974 [https://github.com/apache/arrow/pul

[jira] [Updated] (ARROW-9856) [R] Add bindings for string compute functions

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-9856: --- Fix Version/s: (was: 3.0.0) 4.0.0 > [R] Add bindings for string comput

[jira] [Assigned] (ARROW-10953) [R] Validate when creating Table with schema

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson reassigned ARROW-10953: --- Fix Version/s: (was: 3.0.0) 4.0.0 Assignee: Ian Cook

[jira] [Commented] (ARROW-11157) [Python] Consistent handling of categoricals

2021-01-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260751#comment-17260751 ] Wes McKinney commented on ARROW-11157: -- This looks buggy to me. Less consideration

[jira] [Commented] (ARROW-11120) [Python][R] Prove out plumbing to pass data between Python and R using rpy2

2021-01-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260759#comment-17260759 ] Wes McKinney commented on ARROW-11120: -- It seems like it would be more maintainable

[jira] [Commented] (ARROW-11143) [C++] Support status return for method MemoryPool::Free

2021-01-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260762#comment-17260762 ] Wes McKinney commented on ARROW-11143: -- Indeed. If you need to be able to capture f

[jira] [Updated] (ARROW-10247) [C++][Dataset] Cannot write dataset with dictionary column as partition field

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-10247: --- Labels: dataset pull-request-available (was: dataset) > [C++][Dataset] Cannot write dataset

[jira] [Updated] (ARROW-10437) [C++][Dataset] Ensure virtual columns are not materialized on write

2021-01-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman updated ARROW-10437: - Fix Version/s: (was: 3.0.0) 4.0.0 > [C++][Dataset] Ensure virtual columns

[jira] [Updated] (ARROW-10485) open_dataset(): specifying partition when hive_style =TRUE fails silently

2021-01-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman updated ARROW-10485: - Description: When writing a dataset with hive_style = TRUE, now the default, that dataset has t

[jira] [Commented] (ARROW-10485) open_dataset(): specifying partition when hive_style =TRUE fails silently

2021-01-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260817#comment-17260817 ] Ben Kietzman commented on ARROW-10485: -- To be clear: the issue here stems from the

[jira] [Created] (ARROW-11172) NumPyBuffer does not set mutable_data_

2021-01-07 Thread Arthur Peters (Jira)
Arthur Peters created ARROW-11172: - Summary: NumPyBuffer does not set mutable_data_ Key: ARROW-11172 URL: https://issues.apache.org/jira/browse/ARROW-11172 Project: Apache Arrow Issue Type: B

[jira] [Assigned] (ARROW-11166) [Python][Compute] Add bindings for ProjectOptions

2021-01-07 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman reassigned ARROW-11166: Assignee: Ben Kietzman > [Python][Compute] Add bindings for ProjectOptions >

[jira] [Commented] (ARROW-10485) open_dataset(): specifying partition when hive_style =TRUE fails silently

2021-01-07 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260835#comment-17260835 ] Neal Richardson commented on ARROW-10485: - "Constructing a {{HivePartitioning}}"

[jira] [Updated] (ARROW-11166) [Python][Compute] Add bindings for ProjectOptions

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-11166: --- Labels: pull-request-available (was: ) > [Python][Compute] Add bindings for ProjectOptions

  1   2   >