jorisvandenbossche commented on issue #38441: URL: https://github.com/apache/arrow/issues/38441#issuecomment-1777667545
At the very least, we should also improve the documention around the different encoding options. Currently we just have this table listing them: https://arrow.apache.org/docs/dev/cpp/parquet.html#encodings (and this brief section in the Python user guide: https://arrow.apache.org/docs/dev/python/parquet.html#compression-encoding-and-file-compatibility) For example mention for which data types they are relevant (eg BYTE_STREAM_SPLIT is only for floats, DELTA_BINARY_PACKED for integers), or if they are useful for specific characteristcs (eg many repeated values, sorted data, ..), etc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
