Maybe I am not give a clear description. I am runing Spark on yarn. instead
of Mesos. I just want build Spark with protobuf2.5. I am not care about
Mesos.
I've changed Spark pom.xml to probobuf2.5 manually.
On Mon, Dec 16, 2013 at 2:02 PM, Matei Zaharia wrote:
> Mesos will almost certainly co
Mesos will almost certainly compile fine with protobuf 2.5. The protobuf
compiler and binary format is forward-compatible across releases, it’s just the
Java artifacts that aren’t. You’ll need to ask Mesos to provide a version with
protobuf 2.5, and use that with these versions of Hadoop.
Matei
That issue is for 0.9's solution.
And if you mean for 0.8.1, when you build against hadoop 2.2 Yarn, protobuf is
already using 2.5.0 instead of 2.4.1. so it will works fine with hadoop 2.2
And regarding on 0.8.1 you build against hadoop 2.2 Yarn, while run upon
mesos... strange combination, I am
Hi Azuryy
Please Check https://spark-project.atlassian.net/browse/SPARK-995 for this
protobuf version issue
Best Regards,
Raymond Liu
-Original Message-
From: Azuryy Yu [mailto:azury...@gmail.com]
Sent: Monday, December 16, 2013 10:30 AM
To: dev@spark.incubator.apache.org
Subject: Re:
Hi here,
Do we have plan to upgrade protobuf from 2.4.1 to 2.5.0? PB has some
uncompatable API between these two versions.
Hadoop-2.x using protobuf-2.5.0
but if some guys want to run Spark on mesos, then mesos using
protobuf-2.4.1 currently. so we may discuss here for a better solution.
On Mo
Thanks Patrick.
On 16 Dec 2013 02:43, "Patrick Wendell" wrote:
> You can checkout the docs mentioned in the vote thread. There is also
> a pre-build binary for hadoop2 that is compiled for YARN 2.2
>
> - Patrick
>
> On Sun, Dec 15, 2013 at 4:31 AM, Azuryy Yu wrote:
> > yarn 2.2, not yarn 0.22, I
You can checkout the docs mentioned in the vote thread. There is also
a pre-build binary for hadoop2 that is compiled for YARN 2.2
- Patrick
On Sun, Dec 15, 2013 at 4:31 AM, Azuryy Yu wrote:
> yarn 2.2, not yarn 0.22, I am so sorry.
>
>
> On Sun, Dec 15, 2013 at 8:31 PM, Azuryy Yu wrote:
>
>> H
Hi,
Spark-0.8.1 supports yarn 0.22 right? where to find the release note?
Thanks.
On Sun, Dec 15, 2013 at 3:20 AM, Henry Saputra wrote:
> Yeah seems like it. He was ok with our prev release.
> Let's wait for his reply
>
> On Saturday, December 14, 2013, Patrick Wendell wrote:
>
> > Henry - from
yarn 2.2, not yarn 0.22, I am so sorry.
On Sun, Dec 15, 2013 at 8:31 PM, Azuryy Yu wrote:
> Hi,
> Spark-0.8.1 supports yarn 0.22 right? where to find the release note?
> Thanks.
>
>
> On Sun, Dec 15, 2013 at 3:20 AM, Henry Saputra wrote:
>
>> Yeah seems like it. He was ok with our prev release.
