emkornfield commented on issue #7909: URL: https://github.com/apache/arrow-rs/issues/7909#issuecomment-3074298514
> For ColumnOrder we could just ignore the statistics in that case, but I'm not sure whether in general this would just move the error to another place in the code. I'd argue the specific intent for ColumnOrder being unknown means statistics should be ignored. > but I'm not sure whether in general this would just move the error to another place in the code. It really is likely a case by case issue (i.e. at the parquet level) not the at the thrift level on whether an unknown enum should fail the read. But in most cases at least, one wouldn't want to necessarily fail at thrift parsing time because of the different type of filtering that parquet supports post-footer reading. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
