[ https://issues.apache.org/jira/browse/ARROW-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17661514#comment-17661514 ]
Rok Mihevc commented on ARROW-4492: ----------------------------------- This issue has been migrated to [issue #21046|https://github.com/apache/arrow/issues/21046] on GitHub. Please see the [migration documentation|https://github.com/apache/arrow/issues/14542] for further details. > [Python] Failure reading Parquet column as pandas Categorical in 0.12 > --------------------------------------------------------------------- > > Key: ARROW-4492 > URL: https://issues.apache.org/jira/browse/ARROW-4492 > Project: Apache Arrow > Issue Type: Bug > Components: Python > Affects Versions: 0.12.0 > Reporter: George Sakkis > Priority: Major > Labels: Parquet > Fix For: 0.12.1 > > Attachments: slug.pq > > > On pyarrow 0.12.0 some (but not all) columns cannot be read as category > dtype. Attached is an extracted failing sample. > {noformat} > import dask.dataframe as dd > df = dd.read_parquet('slug.pq', categories=['slug'], > engine='pyarrow').compute() > print(len(df['slug'].dtype.categories)) > {noformat} > This works on pyarrow 0.11.1 (and fastparquet 0.2.1). -- This message was sent by Atlassian Jira (v8.20.10#820010)