hi Keith, That's right -- see https://github.com/apache/parquet-cpp/blob/master/src/parquet/schema.cc#L577. You're welcome to store the levels indicating repetition level and definition level indicating null/not null in the Node object.
- Wes On Mon, Apr 17, 2017 at 7:43 PM, Keith Chapman <[email protected]> wrote: > Hi Wes, > > I was looking into how I could recreate a record from the columnReaders. > From reading through the code I understand the the hierarchy is stored > using NodePtr's, i don't see them storing the definition level or the > repitition levels though, am I missing something? From what I see the > max_repitition_level and the max_definitinition level is only stored in the > ColumnDescriptor and not in the Node > > Regards, > Keith. > > http://keith-chapman.com > > On Wed, Apr 5, 2017 at 2:26 PM, Keith Chapman <[email protected]> > wrote: > >> Thanks for the info Wes, I looked around the code and did not find >> anything about how I could construct a row from a bunch of columnar >> readers. Reconstructing records from columns with a nested schema may be >> something that other folks are also interested in. I'm trying to do some >> read up on parquet and trying to understand how I would do it, would live >> to put it out there for feedback and potentially up streaming once I have >> something working. >> >> Regards, >> Keith. >> >> http://keith-chapman.com >> >> On Wed, Apr 5, 2017 at 2:20 PM, Wes McKinney <[email protected]> wrote: >> >>> hi Keith -- we have focused so far on columnar reads (i.e. Arrow) vs. >>> row/record reads. We would welcome contributions to add a record >>> reader interface >>> >>> Thanks >>> Wes >>> >>> On Tue, Apr 4, 2017 at 8:21 PM, Keith Chapman <[email protected]> >>> wrote: >>> > Hi, >>> > >>> > I'm trying to read a parquet file which has a nested schema, i seen >>> that >>> > the java library have a record reader API which helps construct a >>> record. >>> > Does the cpp API have something equivalent? If not what is the >>> > recomendation as to how to read a nested parquet file using the cpp >>> API. >>> > >>> > Regards, >>> > Keith. >>> > >>> > http://keith-chapman.com >>> >> >> >
