deniskuzZ commented on code in PR #8202: URL: https://github.com/apache/iceberg/pull/8202#discussion_r1941770061
########## format/puffin-spec.md: ########## @@ -181,6 +181,23 @@ for Puffin v1. [roaring-bitmap-portable-serialization]: https://github.com/RoaringBitmap/RoaringFormatSpec?tab=readme-ov-file#extension-for-64-bit-implementations [roaring-bitmap-general-layout]: https://github.com/RoaringBitmap/RoaringFormatSpec?tab=readme-ov-file#general-layout +#### `hive-column-statistics-obj` blob type + +A serialized form of Hive ColumnStatsObject. + +The ColumnStatsObject supports Histograms, NDV, Min and Max values, Number of nulls, Number of trues, column name, type. +A full list of supported statistics is listed in the table here: +[ColumnStatistics](https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-ColumnStatistics) + +#### `apache-datasketches-KLL-sketch` blob type + +A serialized form of a "compact" KLL-sketch produced by the [Apache +DataSketches](https://datasketches.apache.org/) library. +Apache-Datasketches-KLL-sketch is an implementation of a very compact quantiles +sketch with lazy compaction scheme and nearly optimal accuracy per bit. + +Histograms are derived from this sketch. Review Comment: more details: https://issues.apache.org/jira/browse/HIVE-26221 ########## format/puffin-spec.md: ########## @@ -181,6 +181,23 @@ for Puffin v1. [roaring-bitmap-portable-serialization]: https://github.com/RoaringBitmap/RoaringFormatSpec?tab=readme-ov-file#extension-for-64-bit-implementations [roaring-bitmap-general-layout]: https://github.com/RoaringBitmap/RoaringFormatSpec?tab=readme-ov-file#general-layout +#### `hive-column-statistics-obj` blob type + +A serialized form of Hive ColumnStatsObject. + +The ColumnStatsObject supports Histograms, NDV, Min and Max values, Number of nulls, Number of trues, column name, type. +A full list of supported statistics is listed in the table here: +[ColumnStatistics](https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-ColumnStatistics) + +#### `apache-datasketches-KLL-sketch` blob type + +A serialized form of a "compact" KLL-sketch produced by the [Apache +DataSketches](https://datasketches.apache.org/) library. +Apache-Datasketches-KLL-sketch is an implementation of a very compact quantiles +sketch with lazy compaction scheme and nearly optimal accuracy per bit. + +Histograms are derived from this sketch. Review Comment: per column more details: https://issues.apache.org/jira/browse/HIVE-26221 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
