rayokota opened a new issue, #3735:
URL: https://github.com/apache/parquet-java/issues/3735

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   The Variant spec requires the field ids in an object's header to be sorted 
by the                                                                          
                       
     **UTF-8 byte order** of the field names, so a reader can binary-search 
them.                                                                           
                           
     `VariantBuilder` sorted the fields — and `Variant.getFieldByKey` 
binary-searched them —                                                          
                                 
     using `String.compareTo`, which orders by **UTF-16 code units**, not UTF-8 
bytes.                                                                          
                       
                                                                                
                                                                                
                       
     The two orderings are identical for all field names in the Basic 
Multilingual Plane, but                                                         
                                 
     they diverge for names containing supplementary-plane characters (U+10000 
and above):                                                                     
                        
     `String.compareTo` orders a leading high surrogate (0xD800–0xDBFF) before 
code points in
   
   ### Component(s)
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to