yes, only for engine, but maybe newer version has more optimization from tungsten project? at least since spark 1.6?
> ---------- Forwarded message ---------- > From: Mich Talebzadeh <mich.talebza...@gmail.com> > Date: 27 May 2016 at 17:09 > Subject: Re: Pros and Cons > To: Teng Qiu <teng...@gmail.com> > Cc: Ted Yu <yuzhih...@gmail.com>, Koert Kuipers <ko...@tresata.com>, Jörn > Franke <jornfra...@gmail.com>, user <user@spark.apache.org>, Aakash Basu > <raj2coo...@gmail.com>, Reynold Xin <r...@databricks.com> > > > not worth spending time really. > > The only version that works is Spark 1.3.1 with Hive 2 > To be perfectly honest deploying Spark as Hive engine only requires certain > Spark capabilities that I think 1.3.1 is OK with it. Remember we are talking > about engine not HQL etc. That is all provided by Hive itself. > > To me a gain in performance at least 2 compared to MR is perfectly > acceptable. > > > Dr Mich Talebzadeh > > > > LinkedIn > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > > > http://talebzadehmich.wordpress.com > > > > > On 27 May 2016 at 16:58, Teng Qiu <teng...@gmail.com> wrote: >> >> tried spark 2.0.0 preview, but no assembly jar there... then just gave >> up... :p >> --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
