[jira] [Commented] (ARROW-5949) [Rust] Implement DictionaryArray

2020-02-27 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047269#comment-17047269 ] Neville Dipale commented on ARROW-5949: --- I'm unable to assign this to andy-thomason, I don't have

[jira] [Resolved] (ARROW-5949) [Rust] Implement DictionaryArray

2020-02-27 Thread Neville Dipale (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Dipale resolved ARROW-5949. --- Resolution: Fixed Issue resolved by pull request 6095

[jira] [Assigned] (ARROW-7958) [Java] Update Avro to version 1.9.2

2020-02-27 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Kornfield reassigned ARROW-7958: -- Assignee: Ismaël Mejía > [Java] Update Avro to version 1.9.2 >

[jira] [Resolved] (ARROW-7958) [Java] Update Avro to version 1.9.2

2020-02-27 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Kornfield resolved ARROW-7958. Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 6500

[jira] [Created] (ARROW-7960) Add support for schema translation from parquet nodes back to arrow for missing types

2020-02-27 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-7960: -- Summary: Add support for schema translation from parquet nodes back to arrow for missing types Key: ARROW-7960 URL: https://issues.apache.org/jira/browse/ARROW-7960

[jira] [Created] (ARROW-7959) [Ruby] Add support for Ruby 2.3 again

2020-02-27 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7959: --- Summary: [Ruby] Add support for Ruby 2.3 again Key: ARROW-7959 URL: https://issues.apache.org/jira/browse/ARROW-7959 Project: Apache Arrow Issue Type:

[jira] [Updated] (ARROW-7959) [Ruby] Add support for Ruby 2.3 again

2020-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7959: -- Labels: pull-request-available (was: ) > [Ruby] Add support for Ruby 2.3 again >

[jira] [Commented] (ARROW-3247) [Python] Support spark parquet array and map types

2020-02-27 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047208#comment-17047208 ] Micah Kornfield commented on ARROW-3247: {quote} group (MAP) { repeated group key_value {

[jira] [Commented] (ARROW-6887) [Java] Create prose documentation for using ValueVectors

2020-02-27 Thread Ji Liu (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047169#comment-17047169 ] Ji Liu commented on ARROW-6887: --- Seems the docs we added in this issue didn't work in website?

[jira] [Updated] (ARROW-7957) [Python] ParquetDataset cannot take HadoopFileSystem as filesystem

2020-02-27 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-7957: Summary: [Python] ParquetDataset cannot take HadoopFileSystem as filesystem (was: ParquetDataset

[jira] [Updated] (ARROW-7958) [Java] Update Avro to version 1.9.2

2020-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7958: -- Labels: pull-request-available (was: ) > [Java] Update Avro to version 1.9.2 >

[jira] [Created] (ARROW-7958) [Java] Update Avro to version 1.9.2

2020-02-27 Thread Jira
Ismaël Mejía created ARROW-7958: --- Summary: [Java] Update Avro to version 1.9.2 Key: ARROW-7958 URL: https://issues.apache.org/jira/browse/ARROW-7958 Project: Apache Arrow Issue Type: Bug

[jira] [Updated] (ARROW-7951) [Python][Parquet] Expose BYTE_STREAM_SPLIT to pyarrow

2020-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7951: -- Labels: parquet pull-request-available (was: parquet) > [Python][Parquet] Expose

[jira] [Resolved] (ARROW-7916) [C++][Dataset] Project IPC record batches to materialized fields

2020-02-27 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman resolved ARROW-7916. - Resolution: Fixed Issue resolved by pull request 6474

[jira] [Updated] (ARROW-7957) ParquetDataset cannot take HadoopFileSystem as filesystem

2020-02-27 Thread Catherine (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catherine updated ARROW-7957: - Description: {{from pyarrow.fs import HadoopFileSystem}} {{import pyarrow.parquet as pq}}  

[jira] [Updated] (ARROW-7957) ParquetDataset cannot take HadoopFileSystem as filesystem

2020-02-27 Thread Catherine (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catherine updated ARROW-7957: - Description: {{from pyarrow.fs import HadoopFileSystem}} {{import pyarrow.parquet as pq}}  

[jira] [Created] (ARROW-7957) ParquetDataset cannot take HadoopFileSystem as filesystem

2020-02-27 Thread Catherine (Jira)
Catherine created ARROW-7957: Summary: ParquetDataset cannot take HadoopFileSystem as filesystem Key: ARROW-7957 URL: https://issues.apache.org/jira/browse/ARROW-7957 Project: Apache Arrow Issue

[jira] [Commented] (ARROW-7956) [Python] Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas

2020-02-27 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046864#comment-17046864 ] Wes McKinney commented on ARROW-7956: - I reopened this as I want to make sure there is an appropriate

[jira] [Updated] (ARROW-7956) [Python] Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas

2020-02-27 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-7956: Fix Version/s: 1.0.0 > [Python] Memory leak in pyarrow functions >

[jira] [Updated] (ARROW-7956) [Python] Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas

2020-02-27 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-7956: Affects Version/s: (was: 0.16.0) > [Python] Memory leak in pyarrow functions >

[jira] [Reopened] (ARROW-7956) Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas

2020-02-27 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reopened ARROW-7956: - > Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas >

[jira] [Updated] (ARROW-7956) [Python] Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas

2020-02-27 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-7956: Summary: [Python] Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas (was:

[jira] [Commented] (ARROW-7956) Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas

2020-02-27 Thread Denis (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046827#comment-17046827 ] Denis commented on ARROW-7956: -- Not reproduced with pyarrow==0.16.0. Closing this ticket > Memory leak in

[jira] [Commented] (ARROW-560) [C++] Add support for zero-copy libhdfs reads

2020-02-27 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046821#comment-17046821 ] Antoine Pitrou commented on ARROW-560: -- In any case, I've built a prototype, but it crashes when

[jira] [Commented] (ARROW-560) [C++] Add support for zero-copy libhdfs reads

2020-02-27 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046781#comment-17046781 ] Antoine Pitrou commented on ARROW-560: -- One caveat here is that positioned reads (ReadAt) are not

[jira] [Resolved] (ARROW-7746) [Java] Support large buffer for Flight

2020-02-27 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Kornfield resolved ARROW-7746. Resolution: Invalid > [Java] Support large buffer for Flight >

[jira] [Commented] (ARROW-7746) [Java] Support large buffer for Flight

2020-02-27 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046771#comment-17046771 ] Micah Kornfield commented on ARROW-7746: thanks [~fan_li_ya].  I don't think this Jira will be

[jira] [Resolved] (ARROW-7926) [Developer] "archery lint" target is not ergonomic for running a single check like IWYU

2020-02-27 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs resolved ARROW-7926. Resolution: Fixed Issue resolved by pull request 6491

[jira] [Resolved] (ARROW-7886) [C++][Dataset] Consolidate Source and Dataset

2020-02-27 Thread Ben Kietzman (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Kietzman resolved ARROW-7886. - Resolution: Fixed Issue resolved by pull request 6470

[jira] [Commented] (ARROW-7926) [Developer] "archery lint" target is not ergonomic for running a single check like IWYU

2020-02-27 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046673#comment-17046673 ] Krisztian Szucs commented on ARROW-7926: The numpydoc validation can't. > [Developer] "archery

[jira] [Updated] (ARROW-7917) [CMake] FindPythonInterp should check for python3

2020-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7917: -- Labels: pull-request-available (was: ) > [CMake] FindPythonInterp should check for python3 >

[jira] [Updated] (ARROW-7956) Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas

2020-02-27 Thread Denis (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis updated ARROW-7956: - Priority: Critical (was: Major) > Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas >

[jira] [Assigned] (ARROW-7917) [CMake] FindPythonInterp should check for python3

2020-02-27 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-7917: - Assignee: Antoine Pitrou > [CMake] FindPythonInterp should check for python3 >

[jira] [Created] (ARROW-7956) Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas

2020-02-27 Thread Denis (Jira)
Denis created ARROW-7956: Summary: Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas Key: ARROW-7956 URL: https://issues.apache.org/jira/browse/ARROW-7956 Project: Apache Arrow

[jira] [Updated] (ARROW-7789) [R] Can't initialize arrow objects when R.oo package is loaded

2020-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7789: -- Labels: pull-request-available (was: ) > [R] Can't initialize arrow objects when R.oo package

[jira] [Assigned] (ARROW-7789) [R] Can't initialize arrow objects when R.oo package is loaded

2020-02-27 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson reassigned ARROW-7789: -- Assignee: Neal Richardson > [R] Can't initialize arrow objects when R.oo package is

[jira] [Updated] (ARROW-7789) [R] Can't initialize arrow objects when R.oo package is loaded

2020-02-27 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-7789: --- Summary: [R] Can't initialize arrow objects when R.oo package is loaded (was: [R] Unknown

[jira] [Commented] (ARROW-7789) [R] Unknown error when using arrow::write_feather()  in R 3.5.3

2020-02-27 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046627#comment-17046627 ] Neal Richardson commented on ARROW-7789: Thanks for the tip, [~karldw]. The problem seems to be

[jira] [Commented] (ARROW-7048) [Java] Support for combining multiple vectors under VectorSchemaRoot

2020-02-27 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046623#comment-17046623 ] Liya Fan commented on ARROW-7048: - [~yogeshtewari] Sorry for the long wait. We have provided a PR for

[jira] [Updated] (ARROW-7048) [Java] Support for combining multiple vectors under VectorSchemaRoot

2020-02-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-7048: -- Labels: pull-request-available (was: ) > [Java] Support for combining multiple vectors under

[jira] [Commented] (ARROW-7906) [C++][Python] Full functionality for ORC format

2020-02-27 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046586#comment-17046586 ] Antoine Pitrou commented on ARROW-7906: --- [~PereTang] Do you want to submit a PR? > [C++][Python]

[jira] [Updated] (ARROW-7949) [Developer] Update to '.gitignore' to not track user specific 'cpp/Brewfile.lock.json' file

2020-02-27 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-7949: -- Component/s: Developer Tools > [Developer] Update to '.gitignore' to not track user specific

[jira] [Assigned] (ARROW-7949) [Developer] Update to '.gitignore' to not track user specific 'cpp/Brewfile.lock.json' file

2020-02-27 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-7949: - Assignee: Tarek Allam (was: Antoine Pitrou) > [Developer] Update to '.gitignore' to

[jira] [Assigned] (ARROW-7949) [Developer] Update to '.gitignore' to not track user specific 'cpp/Brewfile.lock.json' file

2020-02-27 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-7949: - Assignee: Antoine Pitrou > [Developer] Update to '.gitignore' to not track user

[jira] [Resolved] (ARROW-7949) [Developer] Update to '.gitignore' to not track user specific 'cpp/Brewfile.lock.json' file

2020-02-27 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-7949. --- Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 6494

[jira] [Commented] (ARROW-3247) [Python] Support spark parquet array and map types

2020-02-27 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046482#comment-17046482 ] Brian Hulette commented on ARROW-3247: -- Thanks Micah, could you link those here? When searching for

[jira] [Commented] (ARROW-7746) [Java] Support large buffer for Flight

2020-02-27 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046431#comment-17046431 ] Liya Fan commented on ARROW-7746: - It seems the PR for ARROW-7610 is already big enough. To make code

[jira] [Created] (ARROW-7955) [Java] Support large buffer for file/stream IPC

2020-02-27 Thread Liya Fan (Jira)
Liya Fan created ARROW-7955: --- Summary: [Java] Support large buffer for file/stream IPC Key: ARROW-7955 URL: https://issues.apache.org/jira/browse/ARROW-7955 Project: Apache Arrow Issue Type:

[jira] [Updated] (ARROW-7746) [Java] Support large buffer for Flight

2020-02-27 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-7746: Summary: [Java] Support large buffer for Flight (was: [Java] Support large buffer for IPC) > [Java]

[jira] [Commented] (ARROW-7746) [Java] Support large buffer for IPC

2020-02-27 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046316#comment-17046316 ] Liya Fan commented on ARROW-7746: - [~emkornfi...@gmail.com] Sorry. There must be some misunderstanding