There are examples of both variant[1] and shredded_variant[2] in parquet-testing
I am not sure about if/when it changed. Andrew [1]: https://github.com/apache/parquet-testing/tree/master/variant [2]: https://github.com/apache/parquet-testing/tree/master/shredded_variant On Mon, Apr 27, 2026 at 12:44 PM Steve Loughran <[email protected]> wrote: > Can I note on this that multiple seem to have got the isSorted handling of > objects wrong...did it change late in the spec? > > > 1. Test files for variants are needed. Has anyone started on that > 2. Everyone who does a binary search for object fields should only do it > if the sorted flag is set (header bit 0x10), or they sort fields when > they > cache keys. > > > > > On Sun, 24 Aug 2025 at 17:16, Aihua Xu <[email protected]> wrote: > > > Hi everyone, > > > > Thank you to all who participated in the vote to finalize the Variant and > > Shredding specifications. > > > > Vote results: > > > > - > > > > +1: 6 (binding), 7 (non-binding) > > - > > > > +0: 0 (binding), 0 (non-binding) > > - > > > > -1: 0 (binding), 0 (non-binding) > > > > The vote has passed! We will proceed to merge PR #509 > > <https://github.com/apache/parquet-format/pull/509> to finalize the > > specifications. > > > > Thanks again for your input and support. > > > > Aihua > > > > On Fri, Aug 22, 2025 at 10:03 AM Prashant Singh < > [email protected]> > > wrote: > > > > > +1 (non-binding) > > > > > > On Fri, Aug 22, 2025 at 9:52 AM Amogh Jahagirdar <[email protected]> > > > wrote: > > > > > > > +1 (non-binding) > > > > > > > > On 2025/08/20 18:25:19 Aihua Xu wrote: > > > > > Hi community, > > > > > > > > > > I’d like to follow up on our community sync to proceed with > > finalizing > > > > the > > > > > variant spec. > > > > > > > > > > Per the Parquet specification requirements, two reference > > > implementations > > > > > are needed to finalize the Variant logical type. Both Java and Go > > > > > implementations now support variant encoding and shredding. > > > > > > > > > > Java already has the encoding and shredding implementations in > place: > > > > > apache/parquet-java#3197 < > > > > https://github.com/apache/parquet-java/pull/3197> > > > > > apache/parquet-java#3202 < > > > > https://github.com/apache/parquet-java/pull/3202> > > > > > apache/parquet-java#3223 > > > > > <https://github.com/apache/parquet-java/issues/3223> > > > > > apache/parquet-java#3211 > > > > > <https://github.com/apache/parquet-java/issues/3211> > > > > > > > > > > Go also includes encoding and shredding support: > > > > > apache/arrow-go#344 <https://github.com/apache/arrow-go/pull/344> > > > > > apache/arrow-go#434 <https://github.com/apache/arrow-go/pull/434> > > > > > > > > > > In addition, we have also completed cross-language validations > > between > > > > the > > > > > Java and Go implementations (PR#3258 > > > > > <https://github.com/apache/parquet-java/pull/3258> and PR#455 > > > > > <https://github.com/apache/arrow-go/pull/455>) to confirm > > > compatibility > > > > and > > > > > make sure that the specs can be interpreted consistently. Rust has > > also > > > > > validated against the Variant test suites in PR#8104 > > > > > <https://github.com/apache/arrow-rs/pull/8104>. > > > > > > > > > > Given this progress, I propose that we remove the "under > development" > > > > notes > > > > > from the documentation and move forward with finalizing the > > > > specifications (PR > > > > > #509 <https://github.com/apache/parquet-format/pull/509>). > > > > > This vote will be open for at least 72 hours. > > > > > > > > > > [ ] +1 Finalize Varint and Shredding Spec > > > > > [ ] +0 > > > > > [ ] -1 Do not release this because... > > > > > > > > > > > > > > >
