msalib commented on issue #1932:
URL: https://github.com/apache/arrow-rs/issues/1932#issuecomment-1165074201
Sure! For me, expected behavior is that `pandas` will read a rust-produced
parquet file with UTC timestamp columns and recognize that they're UTC. Like
this:
```python
import pandas as pd
assert str(pd.read_parquet("/tmp/q.parquet").dtypes.metric_date) ==
'datetime64[ns, UTC]'
# and not 'datetime64[ns]'
```
Thank you so much for explaining that given the nature of the specification,
this might not be feasible; I was going crazy. In part, because this used to
work (I have a python unit test that invokes rust code and reads parquet files
generated by rust). Up to version 14 of parquet+arrow, this worked fine. But as
of version 15, the behavior changed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]