[GitHub] [orc] PengleiShi commented on issue #1061: RecordReaderImpl.getValueRange() may cause incorrect results

[GitBox]

PengleiShi commented on issue #1061:
URL: https://github.com/apache/orc/issues/1061#issuecomment-1064735958


   > @dongjoon-hyun. Trino won't write string column statistics if string value 
is bigger than 64 bytes 
![wecom-temp-6a63fc2f2a72e176c2d1fc77699f880b](https://user-images.githubusercontent.com/23723660/157658223-8a2ed05e-67cc-469c-953b-d393303fa42d.png)
 Here is a orc file wrote by trino and contains only one row 
![image](https://user-images.githubusercontent.com/23723660/157658559-4fd3bce8-9359-4a40-b613-6ac2987df69c.png)
 Test with spark3.2
   > 
   > ```
   > select * from xxx; 
   > select * from xxx where name is not null;
   > ```
   > 
   > 
[20220310_100444_03858_nbvwj_53625cc9-7183-4beb-be48-9d059d8fa560.zip](https://github.com/apache/orc/files/8223249/20220310_100444_03858_nbvwj_53625cc9-7183-4beb-be48-9d059d8fa560.zip)
   
   @pgaref  here i have uploaded a problematic file for test. Its meta shows 
below
   
![image](https://user-images.githubusercontent.com/23723660/157794530-8094c74d-d6c2-4910-b488-d4fd51aa710e.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@orc.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org