The parquet-tools code should be pretty helpful (although it's Java)
https://github.com/apache/incubator-parquet-mr/tree/master/parquet-tools/src/main/java/parquet/tools/command
On 3/10/15 12:25 AM, Shuai Zheng wrote:
Hi All,
I have a lot of parquet files, and I try to open them directly instead
of load them into RDD in driver (so I can optimize some performance
through special logic).
But I do some research online and can’t find any example to access
parquet directly from scala, anyone has done this before?
Regards,
Shuai
