Thanks, that was very helpful. Incidentally (and FWIW) the information associated with SQL Server in that thread and document is incorrect. MS SQL Server doesn't have an interval type, and the linked documentation is part of the ODBC specification.
-Curt On Fri, Oct 13, 2023 at 4:56 PM Micah Kornfield <emkornfi...@gmail.com> wrote: > My understanding is that the intent in Arrow is that intervals are signed > ([1] has the discussion on the types). IIUC, this aligns with most SQL > type systems. I don't have context on Parquet (and I think Avro) chose to > make them unsigned. > > Also, note that because of this there is no canonical way of mapping Arrow > Interval's directly to parquet intervals. In the past there have been some > proposals to add a new logical type to parquet but nobody has followed > through on them. > > Thanks, > Micah > > [1] https://lists.apache.org/thread/pqs6qnjvw1gxfkxz02bntvvyqxvw34mm > > On Fri, Oct 13, 2023 at 4:40 PM Curt Hagenlocher <c...@hagenlocher.org> > wrote: > > > The Parquet specification clearly states that the components of a Parquet > > interval are unsigned integers. I couldn't find an equivalent statement > for > > Arrow, and the C++ implementation has these as signed. Is it correct to > > assume that the intent for Arrow intervals is that they should be > > non-negative? > > > > Thanks, > > -Curt > > >
