+1 (binding) On Thu, Aug 27, 2026 at 10:21 AM Zehua Zou <[email protected]> wrote:
> +1 (non-binding) > > > On Aug 27, 2026, at 06:23, Julien Le Dem <[email protected]> wrote: > > > > +1 (binding) > > > > On Wed, Aug 26, 2026 at 2:00 PM Ed Seidl <[email protected]> wrote: > > > >> +1 (non-binding) > >> > >> On 2026/08/26 20:12:17 Ryan Blue wrote: > >>> +1 (binding) > >>> > >>> On Wed, Aug 26, 2026 at 11:01 AM PRATEEK GAUR <[email protected]> > >> wrote: > >>> > >>>> +1 (non-binding). Thanks for pushing for this Alkis. > >>>> > >>>> On Wed, Aug 26, 2026 at 10:57 AM Daniel Weeks <[email protected]> > >> wrote: > >>>> > >>>>> +1 (binding) > >>>>> > >>>>> On Tue, Aug 25, 2026 at 12:51 PM Burak Yavuz <[email protected]> > >> wrote: > >>>>> > >>>>>> +1 (non-binding) > >>>>>> > >>>>>> On Tue, Aug 25, 2026 at 12:17 PM Micah Kornfield < > >>>> [email protected]> > >>>>>> wrote: > >>>>>> > >>>>>>> +1 binding. > >>>>>>> > >>>>>>> On Tue, Aug 25, 2026 at 12:10 PM Antoine Pitrou < > >> [email protected]> > >>>>>>> wrote: > >>>>>>> > >>>>>>>> > >>>>>>>> +1 (binding) > >>>>>>>> > >>>>>>>> > >>>>>>>> Le 24/08/2026 à 16:02, Alkis Evlogimenos via dev a écrit : > >>>>>>>>> Hi folks, > >>>>>>>>> > >>>>>>>>> I would like to start a vote on adopting the format change > >> in PR > >>>>> 603 > >>>>>>> [1]: > >>>>>>>>> remove self-references from the FILE logical type. This came > >> out > >>>> of > >>>>>> the > >>>>>>>>> discussion on inheriting the inline codec [2]. > >>>>>>>>> > >>>>>>>>> FILE as merged lets a value set offset and size with no uri, > >>>> which > >>>>>>>>> addresses a byte range inside the containing file. This byte > >>>> range > >>>>> is > >>>>>>>>> effectively owned by the Parquet writer. Specifying that > >> range > >>>>>> properly > >>>>>>>>> means giving it a compression block, an encryption module, > >> an AAD > >>>>>>>> identity, > >>>>>>>>> and its own size accounting. That is a second page mechanism > >>>>>> reachable > >>>>>>>> only > >>>>>>>>> through FILE. The use case is mid sized values and it is > >> better > >>>>>> served > >>>>>>> by > >>>>>>>>> non-contiguous pages, which we will propose separately. > >> Removing > >>>>>>>>> self-references keeps FILE to the forms it specifies cleanly, > >>>> while > >>>>>> the > >>>>>>>>> format has not shipped in a release. > >>>>>>>>> > >>>>>>>>> The changes: > >>>>>>>>> > >>>>>>>>> 1. Remove self-references. A value that sets offset and size > >> with > >>>>> no > >>>>>>> uri > >>>>>>>> is > >>>>>>>>> invalid. offset may only be set together with uri. > >>>>>>>>> 2. Resolve uri uniformly as an external reference, including > >> when > >>>>> it > >>>>>>>> names > >>>>>>>>> the file that contains it. Parquet applies no compression or > >>>>>> encryption > >>>>>>>> of > >>>>>>>>> its own to those bytes. The parquet writer does NOT own these > >>>>> bytes. > >>>>>> An > >>>>>>>>> earlier draft forbade referencing the current file, but > >> neither a > >>>>>>> writer > >>>>>>>>> nor a reader can check that, so the encoding is uniform > >> instead. > >>>>>>>>> 3. Drop the prohibition on modular encryption. It existed > >> only > >>>>>> because > >>>>>>>>> self-referenced ranges were not encryption modules. The > >> fields > >>>> of a > >>>>>>> FILE > >>>>>>>>> group are ordinary columns and are encoded, compressed, and > >>>>> encrypted > >>>>>>>> like > >>>>>>>>> any other column, inline included. > >>>>>>>>> 4. Allow inline together with the locator fields. Both must > >>>> denote > >>>>>> the > >>>>>>>> same > >>>>>>>>> bytes, so a reader may resolve from either and get the same > >>>> result, > >>>>>> and > >>>>>>>>> inline is the cheaper path because it needs no external > >> access. > >>>> If > >>>>>> the > >>>>>>>> two > >>>>>>>>> disagree the value is invalid, and a reader is not required > >> to > >>>>> detect > >>>>>>> it. > >>>>>>>>> This combination was underspecified before. > >>>>>>>>> > >>>>>>>>> The spec changes are in > >>>>>>>> https://github.com/apache/parquet-format/pull/603 > >>>>>>>>> and touch LogicalTypes.md and a comment in parquet.thrift. > >>>>>>> Encryption.md > >>>>>>>> is > >>>>>>>>> unchanged from master and no Thrift structures change. > >> Inline and > >>>>>>>> external > >>>>>>>>> references behave as before for existing readers and writers. > >>>>>>>>> > >>>>>>>>> Please vote in the next 72 hours. > >>>>>>>>> > >>>>>>>>> [ ] +1 Approve the proposed format change > >>>>>>>>> [ ] +0 No opinion > >>>>>>>>> [ ] -1 Do not approve (please provide specific reasons) > >>>>>>>>> > >>>>>>>>> Cheers, > >>>>>>>>> > >>>>>>>>> [1] https://github.com/apache/parquet-format/pull/603 > >>>>>>>>> [2] > >>>>> https://lists.apache.org/thread/zrzc7t9fccg92rx3h4fw3ndw3bdo5xr7 > >>>>>>>> > >>>>>>>> > >>>>>>>> > >>>>>>> > >>>>>> > >>>>> > >>>> > >>> > >> > >
