Tsai dbt...@dbtsai.com
Komu: Marcelo Vanzin van...@cloudera.com
Datum: 5. 12. 2014 22:31:13
Předmět: Re: Protobuf version in mvn vs sbt
As Marcelo said, CDH5.3 is based on hadoop 2.3, so please try
./make-distribution.sh -Pyarn -Phive -Phadoop-2.3
-Dhadoop.version=2.3.0-cdh5.1.3 -DskipTests
See
Hi devs,
I play with your amazing Spark here in Prague for some time. I have
stumbled on a thing which I like to ask about. I create assembly jars from
source and then use it to run simple jobs on our 2.3.0-cdh5.1.3 cluster
using yarn. Example of my usage [1]. Formerly I had started to use
When building against Hadoop 2.x, you need to enable the appropriate
profile, aside from just specifying the version. e.g. -Phadoop-2.3
for Hadoop 2.3.
On Fri, Dec 5, 2014 at 12:51 PM, spark.dubovsky.ja...@seznam.cz wrote:
Hi devs,
I play with your amazing Spark here in Prague for some
As Marcelo said, CDH5.3 is based on hadoop 2.3, so please try
./make-distribution.sh -Pyarn -Phive -Phadoop-2.3
-Dhadoop.version=2.3.0-cdh5.1.3 -DskipTests
See the detail of how to change the profile at
https://spark.apache.org/docs/latest/building-with-maven.html
Sincerely,
DB Tsai
(Nit: CDH *5.1.x*, including 5.1.3, is derived from Hadoop 2.3.x. 5.3
is based on 2.5.x)
On Fri, Dec 5, 2014 at 3:29 PM, DB Tsai dbt...@dbtsai.com wrote:
As Marcelo said, CDH5.3 is based on hadoop 2.3, so please try
-
To
oh, I meant to say cdh5.1.3 used by Jakub's company is based on 2.3. You
can see it from the first part of the Cloudera's version number - 2.3.0-cdh
5.1.3.
Sincerely,
DB Tsai
---
My Blog: https://www.dbtsai.com
LinkedIn:
