GayathriSrividya commented on issue #859: URL: https://github.com/apache/hudi-rs/issues/859#issuecomment-6890176462
Opened [apache/hudi-rs#1022](https://github.com/apache/hudi-rs/pull/1022) to address this. The change detects NaNs in Float32/Float64 input batches and marks those column ranges unknown, preventing incomplete Parquet min/max statistics from incorrectly pruning files. The regression test covers both float widths and confirms finite-column stats remain usable; the targeted test passes locally. A Spark read check was not run because SPARK_HOME and spark-submit are unavailable, and the PR workflows currently show action_required with no CI results. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
