Re: Protobuff 3.0 for Spark

I have not run into any linkage problem, but maybe I was lucky. :-). The reason I wanted to use protobuf 3 is mainly for Map type support. On Thu, Nov 5, 2015 at 4:43 AM, Steve Loughran wrote: > > > On 5 Nov 2015, at 00:12, Lan Jiang wrote: > > > > I

Re: Protobuff 3.0 for Spark

> On 5 Nov 2015, at 00:12, Lan Jiang wrote: > > I have used protobuf 3 successfully with Spark on CDH 5.4, even though Hadoop > itself comes with protobuf 2.5. I think the steps apply to HDP too. You need > to do the following Protobuf.jar has been so brittle in the past

Protobuff 3.0 for Spark

Hi, Does spark support protobuff 3.0? I used protobuff 2.5 with spark-1.4 built for HDP 2.3. Given that protobuff has compatibility issues , want to know if spark supports protbuff 3.0 LCassa

Re: Protobuff 3.0 for Spark

protobuf 3 jar file either through —jars during the spark-submit or package it into a uber jar file with your own classes. Lan > On Nov 4, 2015, at 4:07 PM, Cassa L <lcas...@gmail.com> wrote: > > Hi, > Does spark support protobuff 3.0? I used protobuff 2.5 with spark-1.4 bu