HuaHuaY opened a new pull request, #50807: URL: https://github.com/apache/arrow/pull/50807
### Rationale for this change Implement IEEE 754 total order and NaN counts from https://github.com/apache/parquet-format/pull/514. ### What changes are included in this PR? - Use IEEE total order by default, with a writer-level TYPE order fallback. - Add `nan_count` to statistics and `nan_counts` to PageIndex. - Preserve NaN payloads and signed zero in statistics and dictionary encoding. - Make Dataset pruning NaN-aware (except FLOAT16). ### Are these changes tested? Yes. ### Are there any user-facing changes? - `cpp/src/parquet/types.h`: Adds `ColumnOrder::IEEE_754_TOTAL_ORDER`. - `cpp/src/parquet/properties.h`: Adds the floating-point column-order writer property. - `cpp/src/parquet/schema.h`: Makes column descriptors recognize valid IEEE order/type combinations. - `cpp/src/parquet/page_index.h`: Exposes `has_nan_counts()` and `nan_counts()`. - `cpp/src/parquet/statistics.h`: Adds NaN fields and presence APIs to `EncodedStatistics` and `Statistics`, and extends encoded-state `Statistics::Make` / `MakeStatistics` overloads with `nan_count` and `has_nan_count`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
