dwsmith1983 commented on issue #5801: URL: https://github.com/apache/datafusion-comet/issues/5801#issuecomment-5672595635
> Let's fall back to Spark if we cannot resolve promptly. We should try to avoid producing wrong results silently. Agreed on the principle. #5654 already closes this one without a silent path: the footer check validates the columns a read requests, and the adapter raises Spark's duplicate field id error for a referenced column that matches two file fields, including the no-metadata, no-predicate case where DataFusion's opener skips the adapter. It is waiting on merge order with #5786, which adds a broader pre-decoder guard on the same call site. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
