stuartcarnie commented on issue #2982: URL: https://github.com/apache/arrow-datafusion/issues/2982#issuecomment-1199968275
@alamb I have a hacky solution that removes all the metadata except the `ARROW:schema` key in this code path. I saw there is an option in the arrow-rs repo for the `ParquetFileArrowReader` to skip metadata: https://github.com/apache/arrow-rs/blob/bedeb4f66663a868846c713bdd8ff0c5bd0983d4/parquet/src/arrow/arrow_reader.rs#L268-L270 However, a similar option wasn't available here. If you have a suggested direction for a fix, I am happy to work on a PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
