I do not know of any existing way to do this. It should be possible using the new public API for applying schema (will be available in 1.1) to an RDD. Basically you'll need to convert the proto buff records into rows, and also create a StructType that represents the schema. With this two things you can all the applySchema method on SparkContext.
Would be great if you could contribute this back. On Wed, Aug 20, 2014 at 5:57 PM, Dmitriy Lyubimov <dlie...@gmail.com> wrote: > Hello, > > is there any known work to adapt protobuf schema to Spark QL data > sourcing? If not, would it present interest to contribute one? > > thanks. > -d >
