Hi, did anyone try to implement Spark SQL dataset reader from SEQ file with protobuf inside to Dataset?
Imagine I have protobuf def
Person
- name: String
- lastName: String
- phones: List[String]
and generated scala case class:
case class Person(name:String, lastName: String, phones: List[String])
I want to write some component that gives me Dataset with types schema.
val personsDataset = spark.read
.option("inferSchema", "true")[Person]
Where can I take a look at references?
