ulysses-you commented on PR #45202: URL: https://github.com/apache/spark/pull/45202#issuecomment-1958576391
Thank you for the fix. The issue seems happen with normal filter `select * from t1 where d > null;` if we disable the NullPropagation rule. `set spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.NullPropagation;` Is it possible to make ParquetFilter dateToDays handle null ? It seems other data types in ParquetFilter handle and allow null value. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
