Hi Antoine, There is a defined order for dictionaries in metadata. What isn't well defined is relative ordering between record batches and Delta dictionaries.
However, this point seems confusing. I can't think of a real-world use case we're it would be valuable enough to include, so I will remove Delta dictionaries. So let's cancel this vote and I'll start a new one after the update. Thanks, Micah On Thursday, October 24, 2019, Antoine Pitrou <[email protected]> wrote: > > Le 24/10/2019 à 04:39, Micah Kornfield a écrit : > > > > 3. Clarifies that the file format, can only contain 1 "NON-delta" > > dictionary batch and multiple "delta" dictionary batches. > > This is a bit weird. If the file format can carry delta dictionaries, > it means order is significant, so it may as well contain dictionary > redefinitions. > > If the file format is meant to be truly readable in random order, then > it should also forbid delta dictionaries. > > Regards > > Antoine. >
