thanks! my bad On Wed, Feb 18, 2015 at 2:00 PM, Sandy Ryza <[email protected]> wrote:
> Hi Koert, > > You should be using "-Phadoop-2.3" instead of "-Phadoop2.3". > > -Sandy > > On Wed, Feb 18, 2015 at 10:51 AM, Koert Kuipers <[email protected]> wrote: > >> does anyone have the right maven invocation for cdh5 with yarn? >> i tried: >> $ mvn -Phadoop2.3 -Dhadoop.version=2.5.0-cdh5.2.3 -Pyarn -DskipTests >> clean package >> $ mvn -Phadoop2.3 -Dhadoop.version=2.5.0-cdh5.2.3 -Pyarn test >> >> it builds and passes tests just fine, but when i deploy on cluster and i >> try to run SparkPi i get: >> Caused by: java.lang.VerifyError: class >> org.apache.hadoop.yarn.proto.YarnServiceProtos$GetApplicationReportRequestProto >> overrides final method getUnknownFields.()Lcom/google/p\ >> rotobuf/UnknownFieldSet; >> >> so clearly i am doing something wrong. something with protobuf 2.4 versus >> 2.5 >> >> i do not want to use the cloudera version of spark for cdh 5 (it includes >> the wrong akka version for me) >> >> thanks >> > >
