To clarify … is there a public Parquet Java API that includes writing Definition Levels like the C++ low-level API provides?
https://github.com/apache/parquet-mr/blob/master/parquet-column/src/main/java/org/apache/parquet/column/ColumnWriter.java appears to be an internal API. Are Definition Levels exposed in a public API, and are there Java examples using Definition Levels. We have a Java use case that needs to write Definition Levels. Thanks, Briian From: Brian Bowman <[email protected]> Date: Wednesday, May 6, 2020 at 9:52 AM To: "[email protected]" <[email protected]> Cc: Karl Moss <[email protected]>, Paul Tomas <[email protected]> Subject: Java API that matches C++ low-level write_batch Here’s some Parquet low-level API C++ code used to write a batch of IEEE doubles in a RowGroup. Is there a public Java API equivalent for writing Parquet files? 456 // Append a RowGroup with a specific number of rows. 457 parquet::RowGroupWriter* rg_writer = file_writer->AppendRowGroup(); 502 auto *double_writer = 503 static_cast<parquet::DoubleWriter *>(rg_writer->NextColumn()); 504 505 double_writer->WriteBatch(num_rows, defLevels, nullptr, (double *) double_rows); Thanks, Brian
