yikf commented on pull request #973: URL: https://github.com/apache/orc/pull/973#issuecomment-997547955
@dongjoon-hyun Also, the configuration default value is true, There are some compatibility problems We have a case, In spark 2.4, the table can be queried normally even if the schema of the table and file is different in case But in spark 3.1, we need to explicitly configure orc.schema.evolution.case.sensitive as false to query normally.(https://github.com/apache/orc/blob/aee81324507de1c5eb8e86bd7aa93a0f6b02bfd9/java/core/src/java/org/apache/orc/impl/SchemaEvolution.java#L514) this cause `fileIncluded ` not to include this column and cant read data Wether we should set default value as false to maintain compatibility. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
