You can checkout the docs mentioned in the vote thread. There is also
a pre-build binary for hadoop2 that is compiled for YARN 2.2
- Patrick
On Sun, Dec 15, 2013 at 4:31 AM, Azuryy Yu azury...@gmail.com wrote:
yarn 2.2, not yarn 0.22, I am so sorry.
On Sun, Dec 15, 2013 at 8:31 PM, Azuryy Yu
Hi Azuryy
Please Check https://spark-project.atlassian.net/browse/SPARK-995 for this
protobuf version issue
Best Regards,
Raymond Liu
-Original Message-
From: Azuryy Yu [mailto:azury...@gmail.com]
Sent: Monday, December 16, 2013 10:30 AM
To: dev@spark.incubator.apache.org
Subject: Re:
That issue is for 0.9's solution.
And if you mean for 0.8.1, when you build against hadoop 2.2 Yarn, protobuf is
already using 2.5.0 instead of 2.4.1. so it will works fine with hadoop 2.2
And regarding on 0.8.1 you build against hadoop 2.2 Yarn, while run upon
mesos... strange combination, I
Mesos will almost certainly compile fine with protobuf 2.5. The protobuf
compiler and binary format is forward-compatible across releases, it’s just the
Java artifacts that aren’t. You’ll need to ask Mesos to provide a version with
protobuf 2.5, and use that with these versions of Hadoop.
Maybe I am not give a clear description. I am runing Spark on yarn. instead
of Mesos. I just want build Spark with protobuf2.5. I am not care about
Mesos.
I've changed Spark pom.xml to probobuf2.5 manually.
On Mon, Dec 16, 2013 at 2:02 PM, Matei Zaharia matei.zaha...@gmail.comwrote:
Mesos
