[jira] [Updated] (ARROW-3246) [Python][Parquet] direct reading/writing of pandas categoricals in parquet

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3246: Summary: [Python][Parquet] direct reading/writing of pandas categoricals in parquet (was: [Python]

[jira] [Closed] (ARROW-3066) [Wiki] Add "How to contribute" to developer wiki

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-3066. --- Resolution: Fixed Assignee: Wes McKinney Fix Version/s: (was: 0.14.0)

[jira] [Updated] (ARROW-3080) [Python] Unify Arrow to Python object conversion paths

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3080: Fix Version/s: (was: 0.14.0) 0.15.0 > [Python] Unify Arrow to Python object

[jira] [Updated] (ARROW-3066) [Wiki] Add "How to contribute" to developer wiki

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3066: Fix Version/s: 0.14.0 > [Wiki] Add "How to contribute" to developer wiki >

[jira] [Commented] (ARROW-3052) [C++] Detect ORC system packages

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806012#comment-16806012 ] Wes McKinney commented on ARROW-3052: - I just repurposed this issue to be about fixin

[jira] [Updated] (ARROW-3052) [C++] Detect ORC system packages

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3052: Fix Version/s: 0.14.0 > [C++] Detect ORC system packages > > >

[jira] [Updated] (ARROW-3052) [C++] Detect ORC system packages

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3052: Summary: [C++] Detect ORC system packages (was: [C++] Support ORC, GRPC, Thrift, and Protobuf when

[jira] [Updated] (ARROW-3052) [C++] Detect ORC system packages

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3052: Description: See https://github.com/apache/arrow/blob/master/cpp/cmake_modules/ThirdpartyToolchain.

[jira] [Resolved] (ARROW-3434) [Packaging] Add Apache ORC C++ library to conda-forge

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-3434. - Resolution: Fixed Assignee: Uwe L. Korn Fix Version/s: (was: 0.14.0)

[jira] [Updated] (ARROW-3032) [Python] Clean up NumPy-related C++ headers

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3032: Fix Version/s: 0.15.0 > [Python] Clean up NumPy-related C++ headers > -

[jira] [Updated] (ARROW-3016) [C++] Add ability to enable call stack logging for each memory allocation

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3016: Fix Version/s: 0.14.0 > [C++] Add ability to enable call stack logging for each memory allocation >

[jira] [Updated] (ARROW-3399) [Python] Cannot serialize numpy matrix object

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-3399: Fix Version/s: 0.14.0 > [Python] Cannot serialize numpy matrix object > ---

[jira] [Updated] (ARROW-2984) [JS] Refactor release verification script to share code with main source release verification script

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2984: Fix Version/s: (was: JS-0.5.0) 0.14.0 > [JS] Refactor release verification s

[jira] [Commented] (ARROW-2984) [JS] Refactor release verification script to share code with main source release verification script

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806007#comment-16806007 ] Wes McKinney commented on ARROW-2984: - Hopefully Arrow 0.14.0 will include JavaScript

[jira] [Commented] (ARROW-2938) [Packaging] Make the source release via crossbow

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806005#comment-16806005 ] Wes McKinney commented on ARROW-2938: - I'm not sure this is desirable from a security

[jira] [Commented] (ARROW-3399) [Python] Cannot serialize numpy matrix object

2019-03-30 Thread Mitar (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806006#comment-16806006 ] Mitar commented on ARROW-3399: -- This is still happening in 0.12.1. I think this should be f

[jira] [Updated] (ARROW-2967) [Python] Add option to treat invalid PyObject* values as null in pyarrow.array

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2967: Fix Version/s: 0.14.0 > [Python] Add option to treat invalid PyObject* values as null in pyarrow.ar

[jira] [Updated] (ARROW-2939) [Python] API documentation version doesn't match latest on PyPI

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2939: Fix Version/s: 0.14.0 > [Python] API documentation version doesn't match latest on PyPI > -

[jira] [Updated] (ARROW-2882) [C++][Python] Support AWS Firehose partition_scheme implementation for Parquet datasets

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2882: Summary: [C++][Python] Support AWS Firehose partition_scheme implementation for Parquet datasets (

[jira] [Commented] (ARROW-2882) [C++][Python] Support AWS Firehose partition_scheme implementation for Parquet datasets

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806004#comment-16806004 ] Wes McKinney commented on ARROW-2882: - I added the C++ component since this will be h

[jira] [Updated] (ARROW-2882) [C++][Python] Support AWS Firehose partition_scheme implementation for Parquet datasets

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2882: Labels: dataset parquet (was: parquet) > [C++][Python] Support AWS Firehose partition_scheme imple

[jira] [Updated] (ARROW-2860) [Python][Parquet] Null values in a single partition of Parquet dataset, results in invalid schema on read

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2860: Summary: [Python][Parquet] Null values in a single partition of Parquet dataset, results in invalid

[jira] [Commented] (ARROW-465) [C++] Investigate usage of madvise

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806002#comment-16806002 ] Wes McKinney commented on ARROW-465: We would need to have a benchmark that exhibits t

[jira] [Closed] (ARROW-2743) [Java] Travis CI test scripts did not catch POM file bug fixed in ARROW-2727

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-2743. --- Resolution: Cannot Reproduce Closing for now until the issue recurs > [Java] Travis CI test scripts

[jira] [Commented] (ARROW-4301) [Java][Gandiva] Maven snapshot version update does not seem to update Gandiva submodule

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805996#comment-16805996 ] Wes McKinney commented on ARROW-4301: - [~kou] FYI -- master build will be broken afte

[jira] [Reopened] (ARROW-4301) [Java][Gandiva] Maven snapshot version update does not seem to update Gandiva submodule

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reopened ARROW-4301: - > [Java][Gandiva] Maven snapshot version update does not seem to update Gandiva > submodule > --

[jira] [Commented] (ARROW-4301) [Java][Gandiva] Maven snapshot version update does not seem to update Gandiva submodule

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805995#comment-16805995 ] Wes McKinney commented on ARROW-4301: - Reopening, this did not work for the 0.13 rele

[jira] [Updated] (ARROW-4301) [Java][Gandiva] Maven snapshot version update does not seem to update Gandiva submodule

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-4301: Fix Version/s: (was: 0.13.0) 0.14.0 > [Java][Gandiva] Maven snapshot version

[jira] [Updated] (ARROW-2572) [Python] Add factory function to create a Table from Columns and Schema.

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2572: Fix Version/s: 0.14.0 > [Python] Add factory function to create a Table from Columns and Schema. >

[jira] [Commented] (ARROW-2572) [Python] Add factory function to create a Table from Columns and Schema.

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805981#comment-16805981 ] Wes McKinney commented on ARROW-2572: - Do you want to try contributing a patch? > [P

[jira] [Updated] (ARROW-2512) [Python] Enable direct interaction of GPU Objects in Python

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2512: Summary: [Python] Enable direct interaction of GPU Objects in Python (was: [Python ]Enable direct

[jira] [Updated] (ARROW-2358) [C++][Python] API for Writing to Multiple Feather Files

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2358: Summary: [C++][Python] API for Writing to Multiple Feather Files (was: API for Writing to Multiple

[jira] [Updated] (ARROW-2186) [C++] Clean up architecture specific compiler flags

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2186: Fix Version/s: 0.14.0 > [C++] Clean up architecture specific compiler flags > -

[jira] [Updated] (ARROW-2164) [C++] Clean up unnecessary decimal module refs

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2164: Fix Version/s: 0.14.0 > [C++] Clean up unnecessary decimal module refs > --

[jira] [Commented] (ARROW-2186) [C++] Clean up architecture specific compiler flags

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805979#comment-16805979 ] Wes McKinney commented on ARROW-2186: - Is this fixed now maybe? > [C++] Clean up arc

[jira] [Closed] (ARROW-1880) [Python] Plasma test flakiness in Travis CI

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-1880. --- Resolution: Cannot Reproduce These issues seem to not be occurring lately > [Python] Plasma test fla

[jira] [Updated] (ARROW-1846) [C++] Implement "any" reduction kernel for boolean data, with the ability to short circuit when applying on chunked data

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1846: Labels: analytics (was: ) > [C++] Implement "any" reduction kernel for boolean data, with the abil

[jira] [Updated] (ARROW-1798) [C++] Implement x86 SIMD-accelerated binary arithmetic kernels

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1798: Labels: analytics (was: ) > [C++] Implement x86 SIMD-accelerated binary arithmetic kernels > -

[jira] [Updated] (ARROW-1797) [C++] Implement binary arithmetic kernels for numeric arrays

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1797: Labels: analytics (was: ) > [C++] Implement binary arithmetic kernels for numeric arrays > ---

[jira] [Closed] (ARROW-1843) Merge tool occasionally leaves JIRAs in an invalid state

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-1843. --- Resolution: Not A Problem Haven't seen this in a long time. I'm going to assume it was a hiccup with

[jira] [Updated] (ARROW-1761) [C++] Multi argument operator kernel behavior for decimal columns

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1761: Summary: [C++] Multi argument operator kernel behavior for decimal columns (was: Multi argument op

[jira] [Updated] (ARROW-1699) [C++] Forward, backward fill kernel functions

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1699: Labels: analytics (was: ) > [C++] Forward, backward fill kernel functions > --

[jira] [Updated] (ARROW-1644) [C++][Parquet] Read and write nested Parquet data with a mix of struct and list nesting levels

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1644: Summary: [C++][Parquet] Read and write nested Parquet data with a mix of struct and list nesting le

[jira] [Updated] (ARROW-1644) [C++][Parquet] Read and write nested Parquet data with a mix of struct and list nesting levels

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1644: Component/s: C++ > [C++][Parquet] Read and write nested Parquet data with a mix of struct and > li

[jira] [Updated] (ARROW-1599) [C++][Parquet] Unable to read Parquet files with list inside struct

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1599: Summary: [C++][Parquet] Unable to read Parquet files with list inside struct (was: [Python] Unable

[jira] [Updated] (ARROW-1599) [C++][Parquet] Unable to read Parquet files with list inside struct

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1599: Component/s: C++ > [C++][Parquet] Unable to read Parquet files with list inside struct > --

[jira] [Updated] (ARROW-1894) [Python] Treat CPython memoryview or buffer objects equivalently to pyarrow.Buffer in pyarrow.serialize

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1894: Labels: (was: beginner) > [Python] Treat CPython memoryview or buffer objects equivalently to >

[jira] [Closed] (ARROW-1552) [C++] Enable Arrow production builds on Linux / macOS without Boost dependency

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-1552. --- Resolution: Won't Fix I'm not sure this is the best use of our time. If someone comes along and wants

[jira] [Updated] (ARROW-1389) [Python] Support arbitrary precision integers

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1389: Component/s: Python > [Python] Support arbitrary precision integers > -

[jira] [Updated] (ARROW-1389) [Python] Support arbitrary precision integers

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1389: Summary: [Python] Support arbitrary precision integers (was: Support arbitrary precision integers)

[jira] [Updated] (ARROW-1059) [C++] Define API for embedding user-defined metadata / Flatbuffer message types in Arrow IPC machinery

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1059: Fix Version/s: 0.15.0 > [C++] Define API for embedding user-defined metadata / Flatbuffer message

[jira] [Commented] (ARROW-843) [C++] Parquet merging unequal but equivalent schemas

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805967#comment-16805967 ] Wes McKinney commented on ARROW-843: I changed this to a C++ issue since a lot of the

[jira] [Updated] (ARROW-843) [C++] Parquet merging unequal but equivalent schemas

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-843: --- Labels: dataset parquet (was: parquet) > [C++] Parquet merging unequal but equivalent schemas > -

[jira] [Updated] (ARROW-843) [C++] Parquet merging unequal but equivalent schemas

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-843: --- Summary: [C++] Parquet merging unequal but equivalent schemas (was: [Python] Parquet merging unequal

[jira] [Updated] (ARROW-843) [C++] Parquet merging unequal but equivalent schemas

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-843: --- Component/s: (was: Python) C++ > [C++] Parquet merging unequal but equivalent sch

[jira] [Updated] (ARROW-840) [Python] Provide Python API for creating user-defined data types that can survive Arrow IPC

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-840: --- Fix Version/s: 0.14.0 > [Python] Provide Python API for creating user-defined data types that can > s

[jira] [Commented] (ARROW-840) [Python] Provide Python API for creating user-defined data types that can survive Arrow IPC

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805966#comment-16805966 ] Wes McKinney commented on ARROW-840: This is within reach now because of the C++ exten

[jira] [Commented] (ARROW-823) [Python] Devise a means to serialize arrays of arbitrary Python objects in Arrow IPC messages

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805964#comment-16805964 ] Wes McKinney commented on ARROW-823: This can be implemented now with ExtensionType >

[jira] [Updated] (ARROW-823) [Python] Devise a means to serialize arrays of arbitrary Python objects in Arrow IPC messages

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-823: --- Fix Version/s: 0.14.0 > [Python] Devise a means to serialize arrays of arbitrary Python objects in >

[jira] [Updated] (ARROW-792) [Java] Allow loading/unloading vectors without using FieldNodes

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-792: --- Component/s: Java > [Java] Allow loading/unloading vectors without using FieldNodes >

[jira] [Updated] (ARROW-799) [Java] Provide guidance in documentation for using Arrow in an uberjar setting

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-799: --- Component/s: Java > [Java] Provide guidance in documentation for using Arrow in an uberjar > setting

[jira] [Updated] (ARROW-730) [Format] Define Flatbuffers metadata for random-access compressed block memory format

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-730: --- Fix Version/s: 0.15.0 > [Format] Define Flatbuffers metadata for random-access compressed block > mem

[jira] [Updated] (ARROW-791) [Java] Check if ArrowBuf is empty buffer in getActualConsumedMemory() and getPossibleConsumedMemory()

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-791: --- Component/s: Java > [Java] Check if ArrowBuf is empty buffer in getActualConsumedMemory() and > getPo

[jira] [Updated] (ARROW-790) [Java] Fix getField() for NullableMapVector

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-790: --- Component/s: Java > [Java] Fix getField() for NullableMapVector >

[jira] [Updated] (ARROW-473) [C++/Python] Add public API for retrieving block locations for a particular HDFS file

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-473: --- Labels: hdfs pull-request-available (was: pull-request-available) > [C++/Python] Add public API for r

[jira] [Commented] (ARROW-412) [Format] Handling of buffer padding in the IPC metadata

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805962#comment-16805962 ] Wes McKinney commented on ARROW-412: My inclination on this would be that the {{Buffer

[jira] [Updated] (ARROW-300) [Format] Add buffer compression option to IPC file format

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-300: --- Fix Version/s: (was: 0.14.0) 0.15.0 > [Format] Add buffer compression option to

[jira] [Updated] (ARROW-114) Bring in java-unsafe-tools as utility library for Arrow

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-114: --- Component/s: Java > Bring in java-unsafe-tools as utility library for Arrow >

[jira] [Updated] (ARROW-258) [Format] clarify definition of Buffer in context of RPC, IPC, File

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-258: --- Fix Version/s: (was: 1.0.0) 0.14.0 > [Format] clarify definition of Buffer in c

[jira] [Updated] (ARROW-114) [Java] Bring in java-unsafe-tools as utility library for Arrow

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-114: --- Summary: [Java] Bring in java-unsafe-tools as utility library for Arrow (was: [JBring in java-unsafe-

[jira] [Updated] (ARROW-241) [Java] Implement splitAndTransfer for UnionVector

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-241: --- Summary: [Java] Implement splitAndTransfer for UnionVector (was: Implement splitAndTransfer for Union

[jira] [Updated] (ARROW-114) [JBring in java-unsafe-tools as utility library for Arrow

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-114: --- Summary: [JBring in java-unsafe-tools as utility library for Arrow (was: Bring in java-unsafe-tools a

[jira] [Updated] (ARROW-258) [Format] clarify definition of Buffer in context of RPC, IPC, File

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-258: --- Summary: [Format] clarify definition of Buffer in context of RPC, IPC, File (was: clarify definition

[jira] [Closed] (ARROW-110) [C++] Decide on optimal growth factor when appending to buffers/arrays

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-110. -- Resolution: Done It seems we'll settle on 2x for now until it can be demonstrated to be a performance p

[jira] [Closed] (ARROW-41) C++: Convert RecordBatch to StructArray, and back

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-41?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-41. - Resolution: Won't Fix Closing also like ARROW-40 until there is a clearly articulated need > C++: Convert

[jira] [Commented] (ARROW-61) [Java] Method can return the value bigger than long MAX_VALUE

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-61?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805954#comment-16805954 ] Wes McKinney commented on ARROW-61: --- Is this still an issue? > [Java] Method can return

[jira] [Closed] (ARROW-40) C++: Reinterpret Struct arrays as tables

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-40. - Resolution: Won't Fix I suspect if this is every needed it will be implemented as part of some other patch

[jira] [Updated] (ARROW-61) [Java] Method can return the value bigger than long MAX_VALUE

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-61?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-61: -- Summary: [Java] Method can return the value bigger than long MAX_VALUE (was: Method can return the value

[jira] [Closed] (ARROW-4985) [C++] arrow/testing headers are not installed

2019-03-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney closed ARROW-4985. --- Resolution: Duplicate Fix Version/s: (was: 0.14.0) this was resolved in ARROW-5012 > [C++

[jira] [Commented] (ARROW-5068) [Gandiva][Packaging] Fix gandiva nightly builds after the CMake refactor

2019-03-30 Thread Praveen Kumar Desabandu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805862#comment-16805862 ] Praveen Kumar Desabandu commented on ARROW-5068: [~kszucs] I am fixing it

[jira] [Comment Edited] (ARROW-4844) Static libarrow is missing vendored libdouble-conversion

2019-03-30 Thread Jeroen (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805787#comment-16805787 ] Jeroen edited comment on ARROW-4844 at 3/30/19 12:10 PM: - For exa

[jira] [Commented] (ARROW-4844) Static libarrow is missing vendored libdouble-conversion

2019-03-30 Thread Jeroen (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805787#comment-16805787 ] Jeroen commented on ARROW-4844: --- For example opencv ships the vendored static libs in a spe

[jira] [Updated] (ARROW-4959) [Gandiva][Crossbow] Builds broken

2019-03-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-4959: -- Labels: pull-request-available (was: ) > [Gandiva][Crossbow] Builds broken > -