westonpace commented on issue #11044: URL: https://github.com/apache/arrow/issues/11044#issuecomment-912063826
Thank you very much for giving us a reproducible test case. I don't know that it would have been obvious at all without it. https://issues.apache.org/jira/browse/ARROW-13871 The root cause was that a column needed to be a list (e.g. "null": ["46.0"]) and the final chunk of the file could not contain the column at all. It didn't appear in small files because they were all one chunk. It actually had nothing to do with the word "null" after all. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
