Can I note on this that multiple seem to have got the isSorted handling of objects wrong...did it change late in the spec?
1. Test files for variants are needed. Has anyone started on that 2. Everyone who does a binary search for object fields should only do it if the sorted flag is set (header bit 0x10), or they sort fields when they cache keys. On Sun, 24 Aug 2025 at 17:16, Aihua Xu <[email protected]> wrote: > Hi everyone, > > Thank you to all who participated in the vote to finalize the Variant and > Shredding specifications. > > Vote results: > > - > > +1: 6 (binding), 7 (non-binding) > - > > +0: 0 (binding), 0 (non-binding) > - > > -1: 0 (binding), 0 (non-binding) > > The vote has passed! We will proceed to merge PR #509 > <https://github.com/apache/parquet-format/pull/509> to finalize the > specifications. > > Thanks again for your input and support. > > Aihua > > On Fri, Aug 22, 2025 at 10:03 AM Prashant Singh <[email protected]> > wrote: > > > +1 (non-binding) > > > > On Fri, Aug 22, 2025 at 9:52 AM Amogh Jahagirdar <[email protected]> > > wrote: > > > > > +1 (non-binding) > > > > > > On 2025/08/20 18:25:19 Aihua Xu wrote: > > > > Hi community, > > > > > > > > I’d like to follow up on our community sync to proceed with > finalizing > > > the > > > > variant spec. > > > > > > > > Per the Parquet specification requirements, two reference > > implementations > > > > are needed to finalize the Variant logical type. Both Java and Go > > > > implementations now support variant encoding and shredding. > > > > > > > > Java already has the encoding and shredding implementations in place: > > > > apache/parquet-java#3197 < > > > https://github.com/apache/parquet-java/pull/3197> > > > > apache/parquet-java#3202 < > > > https://github.com/apache/parquet-java/pull/3202> > > > > apache/parquet-java#3223 > > > > <https://github.com/apache/parquet-java/issues/3223> > > > > apache/parquet-java#3211 > > > > <https://github.com/apache/parquet-java/issues/3211> > > > > > > > > Go also includes encoding and shredding support: > > > > apache/arrow-go#344 <https://github.com/apache/arrow-go/pull/344> > > > > apache/arrow-go#434 <https://github.com/apache/arrow-go/pull/434> > > > > > > > > In addition, we have also completed cross-language validations > between > > > the > > > > Java and Go implementations (PR#3258 > > > > <https://github.com/apache/parquet-java/pull/3258> and PR#455 > > > > <https://github.com/apache/arrow-go/pull/455>) to confirm > > compatibility > > > and > > > > make sure that the specs can be interpreted consistently. Rust has > also > > > > validated against the Variant test suites in PR#8104 > > > > <https://github.com/apache/arrow-rs/pull/8104>. > > > > > > > > Given this progress, I propose that we remove the "under development" > > > notes > > > > from the documentation and move forward with finalizing the > > > specifications (PR > > > > #509 <https://github.com/apache/parquet-format/pull/509>). > > > > This vote will be open for at least 72 hours. > > > > > > > > [ ] +1 Finalize Varint and Shredding Spec > > > > [ ] +0 > > > > [ ] -1 Do not release this because... > > > > > > > > > >
