[jira] [Created] (ARROW-17539) Reading a StructArray column with an ExtensionType causes segfault

2022-08-26 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-17539: Summary: Reading a StructArray column with an ExtensionType causes segfault Key: ARROW-17539 URL: https://issues.apache.org/jira/browse/ARROW-17539 Project: Apache Ar

[jira] [Created] (ARROW-16348) ParquetWriter use_compliant_nested_type=True does not preserve ExtensionArray when reading back

2022-04-26 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-16348: Summary: ParquetWriter use_compliant_nested_type=True does not preserve ExtensionArray when reading back Key: ARROW-16348 URL: https://issues.apache.org/jira/browse/ARROW-16348

[jira] [Created] (ARROW-14770) Direct (individualized) access to definition levels, repetition levels, and numeric data of a column

2021-11-18 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-14770: Summary: Direct (individualized) access to definition levels, repetition levels, and numeric data of a column Key: ARROW-14770 URL: https://issues.apache.org/jira/browse/ARROW-147

[jira] [Created] (ARROW-14547) Reading FixedSizeListArray from Parquet with nulls

2021-11-01 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-14547: Summary: Reading FixedSizeListArray from Parquet with nulls Key: ARROW-14547 URL: https://issues.apache.org/jira/browse/ARROW-14547 Project: Apache Arrow Iss

[jira] [Created] (ARROW-14525) Writing DictionaryArrays with ExtensionType to Parquet

2021-10-29 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-14525: Summary: Writing DictionaryArrays with ExtensionType to Parquet Key: ARROW-14525 URL: https://issues.apache.org/jira/browse/ARROW-14525 Project: Apache Arrow

[jira] [Created] (ARROW-14522) Can't read empty-but-for-nulls data from Parquet if it has an ExtensionType

2021-10-29 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-14522: Summary: Can't read empty-but-for-nulls data from Parquet if it has an ExtensionType Key: ARROW-14522 URL: https://issues.apache.org/jira/browse/ARROW-14522 Project:

[jira] [Created] (ARROW-14485) ParquetFile.read_row_group looses struct nullability when selecting one column from a struct

2021-10-26 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-14485: Summary: ParquetFile.read_row_group looses struct nullability when selecting one column from a struct Key: ARROW-14485 URL: https://issues.apache.org/jira/browse/ARROW-14485

[jira] [Commented] (ARROW-14196) [C++][Parquet] Default to compliant nested types in Parquet writer

2021-10-08 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426167#comment-17426167 ] Jim Pivarski commented on ARROW-14196: -- If it's changing a default, I can just set

[jira] [Commented] (ARROW-13151) [Python] Unable to read single child field of struct column from Parquet

2021-06-25 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369582#comment-17369582 ] Jim Pivarski commented on ARROW-13151: -- Great, thank you! I see now that your calli

[jira] [Commented] (ARROW-13151) [Python] Unable to read single child field of struct column from Parquet

2021-06-25 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369517#comment-17369517 ] Jim Pivarski commented on ARROW-13151: -- I hope reading a single field of a struct c

[jira] [Commented] (ARROW-13040) [Python] to_pandas_dtype values are wrong or unimplemented for date-time types

2021-06-11 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361650#comment-17361650 ] Jim Pivarski commented on ARROW-13040: -- Oh, I didn't realize that. I would be in f

[jira] [Created] (ARROW-13040) to_pandas_dtype values are wrong or unimplemented for date-time types

2021-06-10 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-13040: Summary: to_pandas_dtype values are wrong or unimplemented for date-time types Key: ARROW-13040 URL: https://issues.apache.org/jira/browse/ARROW-13040 Project: Apache

[jira] [Commented] (ARROW-10930) In pyarrow, LargeListArray doesn't have a value_field

2020-12-15 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249926#comment-17249926 ] Jim Pivarski commented on ARROW-10930: -- Incidentally, this is what I'm using as a w

[jira] [Created] (ARROW-10930) In pyarrow, LargeListArray doesn't have a value_field

2020-12-15 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-10930: Summary: In pyarrow, LargeListArray doesn't have a value_field Key: ARROW-10930 URL: https://issues.apache.org/jira/browse/ARROW-10930 Project: Apache Arrow

[jira] [Commented] (ARROW-9801) DictionaryArray with non-unique values are silently corrupted when written to a Parquet file

2020-08-19 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180638#comment-17180638 ] Jim Pivarski commented on ARROW-9801: - Why does JIRA garble markdown from its own vis

[jira] [Created] (ARROW-9801) DictionaryArray with non-unique values are silently corrupted when written to a Parquet file

2020-08-19 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-9801: --- Summary: DictionaryArray with non-unique values are silently corrupted when written to a Parquet file Key: ARROW-9801 URL: https://issues.apache.org/jira/browse/ARROW-9801

[jira] [Commented] (ARROW-9577) [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

2020-08-05 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171630#comment-17171630 ] Jim Pivarski commented on ARROW-9577: - Sure! And thanks for the fix! > [Python][C++]

[jira] [Commented] (ARROW-9577) [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

2020-08-05 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171616#comment-17171616 ] Jim Pivarski commented on ARROW-9577: - I think it's the CONFIG_SWAP. This is what I f

[jira] [Commented] (ARROW-9577) [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

2020-08-05 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171581#comment-17171581 ] Jim Pivarski commented on ARROW-9577: - Thank you: making a tiny C program helps a lot

[jira] [Commented] (ARROW-9577) [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

2020-08-05 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171512#comment-17171512 ] Jim Pivarski commented on ARROW-9577: - I've reproduced the error, but again using the

[jira] [Updated] (ARROW-9577) [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

2020-08-05 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Pivarski updated ARROW-9577: Attachment: location-of-pxi-files.log > [Python][C++] posix_madvise error on Debian in pyarrow 1.0.

[jira] [Updated] (ARROW-9577) [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

2020-08-05 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Pivarski updated ARROW-9577: Attachment: strace-parquet-read.log > [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

[jira] [Updated] (ARROW-9577) [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

2020-08-05 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Pivarski updated ARROW-9577: Attachment: stuff.parquet > [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0 >

[jira] [Commented] (ARROW-9577) [Python][C++] posix_madvise error on Debian in pyarrow 1.0.0

2020-08-05 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171474#comment-17171474 ] Jim Pivarski commented on ARROW-9577: - The computer in question is a Chromebook—I don

[jira] [Created] (ARROW-9577) posix_madvise error on Debian in pyarrow 1.0.0

2020-07-27 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-9577: --- Summary: posix_madvise error on Debian in pyarrow 1.0.0 Key: ARROW-9577 URL: https://issues.apache.org/jira/browse/ARROW-9577 Project: Apache Arrow Issue Type:

[jira] [Commented] (ARROW-9556) Segfaults in UnionArray with null values

2020-07-24 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164722#comment-17164722 ] Jim Pivarski commented on ARROW-9556: - The second case (segfault on construction) is

[jira] [Commented] (ARROW-9556) Segfaults in UnionArray with null values

2020-07-24 Thread Jim Pivarski (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164662#comment-17164662 ] Jim Pivarski commented on ARROW-9556: - (JIRA incorrectly formatted my "expect null he

[jira] [Created] (ARROW-9556) Segfaults in UnionArray with null values

2020-07-24 Thread Jim Pivarski (Jira)
Jim Pivarski created ARROW-9556: --- Summary: Segfaults in UnionArray with null values Key: ARROW-9556 URL: https://issues.apache.org/jira/browse/ARROW-9556 Project: Apache Arrow Issue Type: Bug