Re: Spark1.3.1 build issue with CDH5.4.0 getUnknownFields

2015-05-29 Thread Alex Robbins
I've gotten that error when something is trying to use a different version of protobuf than you want. Maybe check out a `mvn dependency:tree` to see if someone is trying to use something other than libproto 2.5.0. (At least, 2.5.0 was current when I was having the problem) On Fri, May 29, 2015 at

Re: Implementing custom RDD in Java

2015-05-26 Thread Alex Robbins
:19 PM, Alex Robbins alexander.j.robb...@gmail.com wrote: If a Hadoop InputFormat already exists for your data source, you can load it from there. Otherwise, maybe you can dump your data source out as text and load it from there. Without more detail on what your data source is, it'll be hard