John Wilson created ARROW-5895: ---------------------------------- Summary: [Python] New version stores timestamps as epoch ms instead of ISO timestamp string Key: ARROW-5895 URL: https://issues.apache.org/jira/browse/ARROW-5895 Project: Apache Arrow Issue Type: Bug Components: Python Affects Versions: 0.14.0 Environment: Linux dev.office.whoop.com 3.10.0-957.21.3.el7.x86_64 #1 SMP Tue Jun 18 16:35:19 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Reporter: John Wilson Just upgraded from pyarrow 0.13 to 0.14. Columns of type TimestampType(timestmap[ns]) now get written as epoch ms values: 1561939200507 Where 0.13 wrote TimestampType(timestamp[ns]) as an ISO string: 2019-07-01T00:00:00.507Z This broke my implementation. How do I get pyarrow to write ISO strings again in 0.14? Here is my table write: {{ pyarrow.parquet.write_to_dataset(table=tbl, root_path=local_path,}} {{ partition_cols=['env', 'dt'],}} {{ coerce_timestamps='ms',}} {{ allow_truncated_timestamps=True,}} {{ version='2.0',}} {{ compression='SNAPPY')}} -- This message was sent by Atlassian JIRA (v7.6.3#76005)