[GitHub] [spark] tinhto-000 commented on pull request #29383: [SPARK-31703][SQL] Parquet RLE float/double are read incorrectly on big endian platforms

2020-08-11 Thread GitBox
tinhto-000 commented on pull request #29383: URL: https://github.com/apache/spark/pull/29383#issuecomment-672072900 @kiszk thanks for the great suggestion and point out. Turned out ColumnarBatchSuite.scala failed on big endian as well. The "Double APIs" and "Float APIs" are using `p

[GitHub] [spark] tinhto-000 commented on pull request #29383: [SPARK-31703][SQL] Parquet RLE float/double are read incorrectly on big endian platforms

2020-08-07 Thread GitBox
tinhto-000 commented on pull request #29383: URL: https://github.com/apache/spark/pull/29383#issuecomment-670612143 > Seems reasonable - is there any case where we would need putFloats separately from putFloatsLittleEndian? like would you ever legitimately not care about endianness of the