[
https://issues.apache.org/jira/browse/ARROW-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antoine Pitrou resolved ARROW-6780.
-----------------------------------
Resolution: Fixed
Issue resolved by pull request 12449
[https://github.com/apache/arrow/pull/12449]
> [C++][Parquet] Support DurationType in writing/reading parquet
> --------------------------------------------------------------
>
> Key: ARROW-6780
> URL: https://issues.apache.org/jira/browse/ARROW-6780
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Joris Van den Bossche
> Assignee: Joris Van den Bossche
> Priority: Major
> Labels: parquet, pull-request-available
> Fix For: 8.0.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Currently this is not supported:
> {code}
> In [37]: table = pa.table({'a': pa.array([1, 2], pa.duration('s'))})
> In [39]: table
> Out[39]:
> pyarrow.Table
> a: duration[s]
> In [41]: pq.write_table(table, 'test_duration.parquet')
> ...
> ArrowNotImplementedError: Unhandled type for Arrow to Parquet schema
> conversion: duration[s]
> {code}
> There is no direct mapping to Parquet logical types. There is an INTERVAL
> type, but this more matches Arrow's ( YEAR_MONTH or DAY_TIME) interval type.
> But, those duration values could be stored as just integers, and based on the
> serialized arrow schema, it could be restored when reading back in.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
