Re: Implement Dataset reader from SEQ file with protobuf to Dataset

2017-10-08 Thread Michael Armbrust
spark-avro <https://github.com/databricks/spark-avro> would be a good example to start with. On Sun, Oct 8, 2017 at 3:00 AM, Serega Sheypak <serega.shey...@gmail.com> wrote: > Hi, did anyone try to implement Spark SQL dataset reader from SEQ file > with protobuf inside to Data

Implement Dataset reader from SEQ file with protobuf to Dataset

2017-10-08 Thread Serega Sheypak
Hi, did anyone try to implement Spark SQL dataset reader from SEQ file with protobuf inside to Dataset? Imagine I have protobuf def Person - name: String - lastName: String - phones: List[String] and generated scala case class: case class Person(name:String, lastName: String, phones: List