[jira] [Updated] (ARROW-5419) [C++] CSV strings_can_be_null option doesn't respect all null_values

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5419: - Labels: csv (was: ) > [C++] CSV strings_can_be_null option doesn't respect all n

[jira] [Updated] (ARROW-5419) [C++] CSV strings_can_be_null option doesn't respect all null_values

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5419: - Description: Relates to ARROW-5195 and [https://github.com/apache/arrow/issues/41

[jira] [Updated] (ARROW-5419) [C++] CSV strings_can_be_null option doesn't respect all null_values

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5419: - Fix Version/s: 0.14.0 > [C++] CSV strings_can_be_null option doesn't respect all

[jira] [Commented] (ARROW-5419) [C++] CSV strings_can_be_null option doesn't respect all null_values

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848741#comment-16848741 ] Joris Van den Bossche commented on ARROW-5419: -- As a sidenote: an "empty" fi

[jira] [Updated] (ARROW-5349) [Python/C++] Provide a way to specify the file path in parquet ColumnChunkMetaData

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5349: - Attachment: test_pyspark_dataset.zip > [Python/C++] Provide a way to specify the

[jira] [Commented] (ARROW-5349) [Python/C++] Provide a way to specify the file path in parquet ColumnChunkMetaData

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848753#comment-16848753 ] Joris Van den Bossche commented on ARROW-5349: -- Summary of the resolution: h

[jira] [Commented] (ARROW-3531) [Python] Deprecate Schema.field_by_name in favor of __getitem__

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848892#comment-16848892 ] Joris Van den Bossche commented on ARROW-3531: -- We may also want to have a {

[jira] [Assigned] (ARROW-5169) [Python] non-nullable fields are converted to nullable in {{Table.from_pandas}}

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-5169: Assignee: Joris Van den Bossche > [Python] non-nullable fields are convert

[jira] [Commented] (ARROW-1983) [Python] Add ability to write parquet `_metadata` file

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849118#comment-16849118 ] Joris Van den Bossche commented on ARROW-1983: -- {quote}Correspondingly, plea

[jira] [Created] (ARROW-5427) [Python] RangeIndex serialization change implications

2019-05-27 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5427: Summary: [Python] RangeIndex serialization change implications Key: ARROW-5427 URL: https://issues.apache.org/jira/browse/ARROW-5427 Project: Apache Ar

[jira] [Commented] (ARROW-1983) [Python] Add ability to write parquet `_metadata` file

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849187#comment-16849187 ] Joris Van den Bossche commented on ARROW-1983: -- I think so yes (at least whe

[jira] [Comment Edited] (ARROW-1983) [Python] Add ability to write parquet `_metadata` file

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849187#comment-16849187 ] Joris Van den Bossche edited comment on ARROW-1983 at 5/27/19 8:29 PM:

[jira] [Comment Edited] (ARROW-1983) [Python] Add ability to write parquet `_metadata` file

2019-05-27 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849187#comment-16849187 ] Joris Van den Bossche edited comment on ARROW-1983 at 5/27/19 8:33 PM:

[jira] [Updated] (ARROW-5430) [Python] Can read but not write parquet partitioned on large ints

2019-05-28 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5430: - Labels: parquet (was: ) > [Python] Can read but not write parquet partitioned on

[jira] [Commented] (ARROW-5430) [Python] Can read but not write parquet partitioned on large ints

2019-05-28 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849483#comment-16849483 ] Joris Van den Bossche commented on ARROW-5430: -- Thanks for the report! The e

[jira] [Commented] (ARROW-5430) [Python] Can read but not write parquet partitioned on large ints

2019-05-28 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849485#comment-16849485 ] Joris Van den Bossche commented on ARROW-5430: -- Actually, I see we had ARROW

[jira] [Commented] (ARROW-5430) [Python] Can read but not write parquet partitioned on large ints

2019-05-28 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849491#comment-16849491 ] Joris Van den Bossche commented on ARROW-5430: -- I agree that ideally we shou

[jira] [Commented] (ARROW-5430) [Python] Can read but not write parquet partitioned on large ints

2019-05-28 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849499#comment-16849499 ] Joris Van den Bossche commented on ARROW-5430: -- Not fully, see my first comm

[jira] [Commented] (ARROW-5430) [Python] Can read but not write parquet partitioned on large ints

2019-05-28 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849539#comment-16849539 ] Joris Van den Bossche commented on ARROW-5430: -- The keys come from the direc

[jira] [Commented] (ARROW-5430) [Python] Can read but not write parquet partitioned on large ints

2019-05-28 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850158#comment-16850158 ] Joris Van den Bossche commented on ARROW-5430: -- Robin: yes, a fix for the er

[jira] [Created] (ARROW-5436) [Python] expose filters argument in parquet.read_table

2019-05-29 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5436: Summary: [Python] expose filters argument in parquet.read_table Key: ARROW-5436 URL: https://issues.apache.org/jira/browse/ARROW-5436 Project: Apache A

[jira] [Created] (ARROW-5514) [C++] Printer for uint64 shows wrong values

2019-06-05 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5514: Summary: [C++] Printer for uint64 shows wrong values Key: ARROW-5514 URL: https://issues.apache.org/jira/browse/ARROW-5514 Project: Apache Arrow

[jira] [Commented] (ARROW-5138) [Python/C++] Row group retrieval doesn't restore index properly

2019-06-05 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856508#comment-16856508 ] Joris Van den Bossche commented on ARROW-5138: -- [~wesmckinn] I don't think t

[jira] [Commented] (ARROW-2667) [C++/Python] Add pandas-like take method to Array

2019-06-05 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856516#comment-16856516 ] Joris Van den Bossche commented on ARROW-2667: -- [~wesmckinn] you renamed thi

[jira] [Comment Edited] (ARROW-2667) [C++/Python] Add pandas-like take method to Array

2019-06-05 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856516#comment-16856516 ] Joris Van den Bossche edited comment on ARROW-2667 at 6/5/19 8:55 AM: -

[jira] [Commented] (ARROW-5450) [Python] TimestampArray.to_pylist() fails with OverflowError: Python int too large to convert to C long

2019-06-05 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856527#comment-16856527 ] Joris Van den Bossche commented on ARROW-5450: -- Thanks for the report! The

[jira] [Updated] (ARROW-5104) [Python/C++] Schema for empty tables include index column as integer

2019-06-05 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5104: - Fix Version/s: 0.14.0 > [Python/C++] Schema for empty tables include index column

[jira] [Commented] (ARROW-5480) [Python] Pandas categorical type doesn't survive a round-trip through parquet

2019-06-05 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856967#comment-16856967 ] Joris Van den Bossche commented on ARROW-5480: -- [~wesmckinn] I think this ca

[jira] [Commented] (ARROW-5450) [Python] TimestampArray.to_pylist() fails with OverflowError: Python int too large to convert to C long

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858365#comment-16858365 ] Joris Van den Bossche commented on ARROW-5450: -- Yes, certainly given the tim

[jira] [Updated] (ARROW-4350) [Python] nested numpy arrays

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-4350: - Description: Nested numpy arrays cannot be converted to a list-of-list type array

[jira] [Updated] (ARROW-4350) [Python] nested numpy arrays cannot be converted to ListArray

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-4350: - Summary: [Python] nested numpy arrays cannot be converted to ListArray (was: [Py

[jira] [Updated] (ARROW-4350) [Python] nested numpy arrays cannot be converted to a list-of-list ListArray

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-4350: - Summary: [Python] nested numpy arrays cannot be converted to a list-of-list ListA

[jira] [Updated] (ARROW-4350) [Python] nested numpy arrays cannot be converted to ListArray

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-4350: - Description: Nested numpy arrays (as the scalar value) cannot be converted to a l

[jira] [Commented] (ARROW-4350) [Python] nested numpy arrays cannot be converted to a list-of-list ListArray

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858438#comment-16858438 ] Joris Van den Bossche commented on ARROW-4350: -- Updated the title and top po

[jira] [Commented] (ARROW-3801) [Python] Pandas-Arrow roundtrip makes pd categorical index not writeable

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858460#comment-16858460 ] Joris Van den Bossche commented on ARROW-3801: -- [~buhrmann] do you know whic

[jira] [Resolved] (ARROW-3801) [Python] Pandas-Arrow roundtrip makes pd categorical index not writeable

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche resolved ARROW-3801. -- Resolution: Works for Me I am going to close this issue, as I think it is fixed

[jira] [Commented] (ARROW-2298) [Python] Add option to not consider NaN to be null when converting to an integer Arrow type

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858547#comment-16858547 ] Joris Van den Bossche commented on ARROW-2298: -- [~farnoy] For me, the exampl

[jira] [Commented] (ARROW-3801) [Python] Pandas-Arrow roundtrip makes pd categorical index not writeable

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858552#comment-16858552 ] Joris Van den Bossche commented on ARROW-3801: -- I am not yet too familiar wi

[jira] [Assigned] (ARROW-2818) [Python] Better error message when passing SparseDataFrame into Table.from_pandas

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-2818: Assignee: Joris Van den Bossche > [Python] Better error message when passi

[jira] [Commented] (ARROW-2037) [Python]: Add tests for ARROW-1941 cases where pandas inferred type is 'empty'

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858688#comment-16858688 ] Joris Van den Bossche commented on ARROW-2037: -- Not fully sure what is left

[jira] [Commented] (ARROW-2037) [Python]: Add tests for ARROW-1941 cases where pandas inferred type is 'empty'

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858692#comment-16858692 ] Joris Van den Bossche commented on ARROW-2037: -- You get an "empty" inferred

[jira] [Comment Edited] (ARROW-2037) [Python]: Add tests for ARROW-1941 cases where pandas inferred type is 'empty'

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858692#comment-16858692 ] Joris Van den Bossche edited comment on ARROW-2037 at 6/7/19 2:19 PM: -

[jira] [Commented] (ARROW-2037) [Python]: Add tests for ARROW-1941 cases where pandas inferred type is 'empty'

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858694#comment-16858694 ] Joris Van den Bossche commented on ARROW-2037: -- And that case is already tes

[jira] [Updated] (ARROW-2037) [Python]: Add tests for ARROW-1941 cases where pandas inferred type is 'empty'

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-2037: - Fix Version/s: (was: 0.14.0) > [Python]: Add tests for ARROW-1941 cases where

[jira] [Closed] (ARROW-2037) [Python]: Add tests for ARROW-1941 cases where pandas inferred type is 'empty'

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche closed ARROW-2037. Resolution: Invalid > [Python]: Add tests for ARROW-1941 cases where pandas inferre

[jira] [Commented] (ARROW-1989) [Python] Better UX on timestamp conversion to Pandas

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858724#comment-16858724 ] Joris Van den Bossche commented on ARROW-1989: -- Looking into this. But, I ca

[jira] [Comment Edited] (ARROW-1989) [Python] Better UX on timestamp conversion to Pandas

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858724#comment-16858724 ] Joris Van den Bossche edited comment on ARROW-1989 at 6/7/19 3:00 PM: -

[jira] [Commented] (ARROW-1989) [Python] Better UX on timestamp conversion to Pandas

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858736#comment-16858736 ] Joris Van den Bossche commented on ARROW-1989: -- The mention of {{allow_trunc

[jira] [Commented] (ARROW-3801) [Python] Pandas-Arrow roundtrip makes pd categorical index not writeable

2019-06-07 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858756#comment-16858756 ] Joris Van den Bossche commented on ARROW-3801: -- In general, or only for this

[jira] [Commented] (ARROW-2136) [Python] Non-nullable schema fields not checked in conversions from pandas

2019-06-11 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861474#comment-16861474 ] Joris Van den Bossche commented on ARROW-2136: -- I have a PR for ARROW-5169 (

[jira] [Commented] (ARROW-5514) [C++] Printer for uint64 shows wrong values

2019-06-11 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861504#comment-16861504 ] Joris Van den Bossche commented on ARROW-5514: -- Sorry for the slow reply (an

[jira] [Commented] (ARROW-840) [Python] Provide Python API for creating user-defined data types that can survive Arrow IPC

2019-06-11 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861515#comment-16861515 ] Joris Van den Bossche commented on ARROW-840: - So the first bullet point (enab

[jira] [Commented] (ARROW-5568) [Python] Allow parsing more general JSON formats

2019-06-11 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861790#comment-16861790 ] Joris Van den Bossche commented on ARROW-5568: -- {quote}I have JSON data wher

[jira] [Closed] (ARROW-5424) [Doc] [Python] Add docs for JSON reader

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche closed ARROW-5424. Resolution: Duplicate > [Doc] [Python] Add docs for JSON reader > -

[jira] [Updated] (ARROW-5562) pyarrow parquet writer does not handle negative zero correctly

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5562: - Labels: parquet (was: ) > pyarrow parquet writer does not handle negative zero c

[jira] [Updated] (ARROW-5562) pyarrow parquet writer does not handle negative zero correctly

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5562: - Component/s: C++ > pyarrow parquet writer does not handle negative zero correctly

[jira] [Updated] (ARROW-5562) [C++] parquet writer does not handle negative zero correctly

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5562: - Summary: [C++] parquet writer does not handle negative zero correctly (was: pyar

[jira] [Commented] (ARROW-5540) [Python] pa.lib.tzinfo_to_string(tz) throws ValueError: Unable to convert timezone `tzoffset(None, -14400)` to string

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861965#comment-16861965 ] Joris Van den Bossche commented on ARROW-5540: -- [~Koojav] Thanks for the rep

[jira] [Commented] (ARROW-5248) [Python] support dateutil timezones

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861969#comment-16861969 ] Joris Van den Bossche commented on ARROW-5248: -- Another example of dateutil

[jira] [Created] (ARROW-5572) [Python] raise error message when passing invalid filter in parquet reading

2019-06-12 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5572: Summary: [Python] raise error message when passing invalid filter in parquet reading Key: ARROW-5572 URL: https://issues.apache.org/jira/browse/ARROW-5572

[jira] [Updated] (ARROW-5532) [JS] Field Metadata Not Read

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5532: - Labels: Javas (was: ) > [JS] Field Metadata Not Read > -

[jira] [Updated] (ARROW-5532) [JS] Field Metadata Not Read

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5532: - Component/s: JavaScript > [JS] Field Metadata Not Read >

[jira] [Commented] (ARROW-5540) [Python] pa.lib.tzinfo_to_string(tz) throws ValueError: Unable to convert timezone `tzoffset(None, -14400)` to string

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862079#comment-16862079 ] Joris Van den Bossche commented on ARROW-5540: -- Thanks for the follow-up. OK

[jira] [Closed] (ARROW-5540) [Python] pa.lib.tzinfo_to_string(tz) throws ValueError: Unable to convert timezone `tzoffset(None, -14400)` to string

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche closed ARROW-5540. Resolution: Duplicate > [Python] pa.lib.tzinfo_to_string(tz) throws ValueError: Una

[jira] [Commented] (ARROW-2298) [Python] Add option to not consider NaN to be null when converting to an integer Arrow type

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862275#comment-16862275 ] Joris Van den Bossche commented on ARROW-2298: -- I am not sure I fully unders

[jira] [Assigned] (ARROW-3686) [Python] Support for masked arrays in to/from numpy

2019-06-12 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-3686: Assignee: Joris Van den Bossche > [Python] Support for masked arrays in to

[jira] [Commented] (ARROW-5220) [Python] index / unknown columns in specified schema in Table.from_pandas

2019-06-13 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863527#comment-16863527 ] Joris Van den Bossche commented on ARROW-5220: -- I can look into taking the i

[jira] [Created] (ARROW-5603) [Python] registere pytest markers to avoid warnings

2019-06-14 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5603: Summary: [Python] registere pytest markers to avoid warnings Key: ARROW-5603 URL: https://issues.apache.org/jira/browse/ARROW-5603 Project: Apache Arro

[jira] [Updated] (ARROW-5603) [Python] registere pytest markers to avoid warnings

2019-06-14 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5603: - Description: Currently the python test suite gives warnings like: {code} /home/j

[jira] [Created] (ARROW-5606) [Python] pandas.RangeIndex._start/_stop/_step are deprecated

2019-06-14 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5606: Summary: [Python] pandas.RangeIndex._start/_stop/_step are deprecated Key: ARROW-5606 URL: https://issues.apache.org/jira/browse/ARROW-5606 Project: A

[jira] [Updated] (ARROW-5618) [C++] [Parquet] Using deprecated Int96 storage for timestamps triggers integer overflow in some cases

2019-06-17 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5618: - Labels: parquet (was: ) > [C++] [Parquet] Using deprecated Int96 storage for tim

[jira] [Commented] (ARROW-5208) [Python] Inconsistent resulting type during casting in pa.array() when mask is present

2019-06-17 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865558#comment-16865558 ] Joris Van den Bossche commented on ARROW-5208: -- [~ArtemK] still interested t

[jira] [Commented] (ARROW-5220) [Python] index / unknown columns in specified schema in Table.from_pandas

2019-06-17 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865966#comment-16865966 ] Joris Van den Bossche commented on ARROW-5220: -- [~wesmckinn] what do you thi

[jira] [Assigned] (ARROW-5309) [Python] Add clarifications to Python "append" methods that return new objects

2019-06-18 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-5309: Assignee: Joris Van den Bossche > [Python] Add clarifications to Python "a

[jira] [Assigned] (ARROW-4076) [Python] schema validation and filters

2019-06-18 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-4076: Assignee: Joris Van den Bossche > [Python] schema validation and filters >

[jira] [Assigned] (ARROW-4847) [Python] Add pyarrow.table factory function that dispatches to various ctors based on type of input

2019-06-18 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-4847: Assignee: Joris Van den Bossche (was: Wes McKinney) > [Python] Add pyarro

[jira] [Commented] (ARROW-2572) [Python] Add factory function to create a Table from Columns and Schema.

2019-06-18 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866393#comment-16866393 ] Joris Van den Bossche commented on ARROW-2572: -- The {{Table.from_arrays}} no

[jira] [Assigned] (ARROW-5241) [Python] Add option to disable writing statistics to parquet file

2019-06-18 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-5241: Assignee: Joris Van den Bossche > [Python] Add option to disable writing s

[jira] [Created] (ARROW-5654) [C++] ChunkedArray should validate the types of the arrays

2019-06-19 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5654: Summary: [C++] ChunkedArray should validate the types of the arrays Key: ARROW-5654 URL: https://issues.apache.org/jira/browse/ARROW-5654 Project: Apac

[jira] [Created] (ARROW-5655) [Python] Table.from_pydict/from_arrays not using types in specified schema correctly

2019-06-19 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5655: Summary: [Python] Table.from_pydict/from_arrays not using types in specified schema correctly Key: ARROW-5655 URL: https://issues.apache.org/jira/browse/ARROW-565

[jira] [Commented] (ARROW-5630) [Python] Table of nested arrays doesn't round trip

2019-06-19 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867981#comment-16867981 ] Joris Van den Bossche commented on ARROW-5630: -- It is somehow related to the

[jira] [Commented] (ARROW-5630) [Python] Table of nested arrays doesn't round trip

2019-06-19 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867988#comment-16867988 ] Joris Van den Bossche commented on ARROW-5630: -- Yes, with the default of nul

[jira] [Commented] (ARROW-5630) [Python] Table of nested arrays doesn't round trip

2019-06-19 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867997#comment-16867997 ] Joris Van den Bossche commented on ARROW-5630: -- Sure, I didn't yet look into

[jira] [Comment Edited] (ARROW-5630) [Python] Table of nested arrays doesn't round trip

2019-06-19 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867997#comment-16867997 ] Joris Van den Bossche edited comment on ARROW-5630 at 6/19/19 8:48 PM:

[jira] [Commented] (ARROW-5665) ArrowInvalid on converting Pandas Series with dtype float64

2019-06-20 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868572#comment-16868572 ] Joris Van den Bossche commented on ARROW-5665: -- [~tnesztler] Can you try to

[jira] [Updated] (ARROW-5665) [Python] ArrowInvalid on converting Pandas Series with dtype float64

2019-06-20 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5665: - Summary: [Python] ArrowInvalid on converting Pandas Series with dtype float64 (w

[jira] [Commented] (ARROW-5666) [Python] Underscores in partition (string) values are dropped when reading dataset

2019-06-20 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868583#comment-16868583 ] Joris Van den Bossche commented on ARROW-5666: -- Thanks for the report! The

[jira] [Updated] (ARROW-5666) [Python] Underscores in partition (string) values are dropped when reading dataset

2019-06-20 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5666: - Labels: parquet (was: ) > [Python] Underscores in partition (string) values are

[jira] [Commented] (ARROW-2136) [Python] Non-nullable schema fields not checked in conversions from pandas

2019-06-21 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869274#comment-16869274 ] Joris Van den Bossche commented on ARROW-2136: -- You can also run into this w

[jira] [Commented] (ARROW-2136) [Python] Non-nullable schema fields not checked in conversions from pandas

2019-06-21 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869281#comment-16869281 ] Joris Van den Bossche commented on ARROW-2136: -- For {{Table.from_pandas}}, i

[jira] [Assigned] (ARROW-5668) [Python] Display "not null" in Schema.__repr__ for non-nullable fields

2019-06-21 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-5668: Assignee: Joris Van den Bossche > [Python] Display "not null" in Schema.__

[jira] [Commented] (ARROW-3176) [Python] Overflow in Date32 column conversion to pandas

2019-06-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16870886#comment-16870886 ] Joris Van den Bossche commented on ARROW-3176: -- I fixed the issue on the pan

[jira] [Updated] (ARROW-5655) [Python] Table.from_pydict/from_arrays not using types in specified schema correctly

2019-06-25 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5655: - Fix Version/s: 1.0.0 > [Python] Table.from_pydict/from_arrays not using types in

[jira] [Updated] (ARROW-5811) [C++] CSV reader: Ability to not infer column types.

2019-07-04 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5811: - Component/s: C++ > [C++] CSV reader: Ability to not infer column types. > ---

[jira] [Updated] (ARROW-5811) [C++] CSV reader: Ability to not infer column types.

2019-07-04 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5811: - Summary: [C++] CSV reader: Ability to not infer column types. (was: [Python] pya

[jira] [Updated] (ARROW-3408) [C++] Add option to CSV reader to dictionary encode individual columns or all string / binary columns

2019-07-04 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-3408: - Labels: csv datasets (was: datasets) > [C++] Add option to CSV reader to diction

[jira] [Updated] (ARROW-3378) [C++] Implement whitespace CSV tokenizer

2019-07-04 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-3378: - Labels: csv (was: ) > [C++] Implement whitespace CSV tokenizer > ---

[jira] [Updated] (ARROW-5825) [Python] Exceptions swallowed in ParquetManifest._visit_directories

2019-07-04 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5825: - Labels: parquet (was: Parquet) > [Python] Exceptions swallowed in ParquetManifes

[jira] [Commented] (ARROW-5825) [Python] Exceptions swallowed in ParquetManifest._visit_directories

2019-07-04 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878763#comment-16878763 ] Joris Van den Bossche commented on ARROW-5825: -- [~gsakkis] do you have a rep

[jira] [Assigned] (ARROW-5817) [Python] Use pytest marks for Flight test to avoid silently skipping unit tests due to import failures

2019-07-04 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche reassigned ARROW-5817: Assignee: Joris Van den Bossche > [Python] Use pytest marks for Flight tes

<    1   2   3   4   5   6   7   8   9   10   >