alamb opened a new issue, #10306:
URL: https://github.com/apache/arrow-rs/issues/10306

   ### Describe the bug
   
   Related to 
   - https://github.com/apache/parquet-format/pull/591
   
   on 
https://github.com/apache/parquet-format/pull/591#issuecomment-4816035024, 
@HuaHuaY reports
   
   >  I found that arrow-rs already allows to omit value array. 
https://github.com/apache/arrow-rs/blob/7616e10f12894232eacb807993e55427a067d061/parquet-variant-compute/src/variant_array.rs#L858
   
   
   Specifically, according to this report when a shredded variant value array 
contains only nulls, then the arrow-rs writer omits writing it. According to 
the discussion  https://github.com/apache/parquet-format/pull/591 the spac 
*requires* writiing a value field (even though there are examples that don't 
have the value field)
   
   
   
   
   
   ### To Reproduce
   
   _No response_
   
   ### Expected behavior
   
   Not sure
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to