How did you build your spark distribution? Could you detail the steps? Hive afaik is dependent on hadoop. If you don't configure ur spark correctly it will assume hadoop is ur filesystem... I m not using hadoop or hive.....u might want to get a cloudera distribution which has spark hadoop and hive by default.... Hth
On 22 Jul 2016 6:34 pm, "Inam Ur Rehman" <inam.rehma...@gmail.com> wrote: > Hello guys..i know its irrelevant to this topic but i've been looking > desperately for the solution. I am facing en exception > http://apache-spark-user-list.1001560.n3.nabble.com/how-to-resolve-you-must-build-spark-with-hive-exception-td27390.html > > plz help me.. I couldn't find any solution..plz > > On Fri, Jul 22, 2016 at 5:50 PM, Jean Georges Perrin <j...@jgp.net> wrote: > >> Thanks Marco - I like the idea of sticking with DataFrames ;) >> >> >> On Jul 22, 2016, at 7:07 AM, Marco Mistroni <mmistr...@gmail.com> wrote: >> >> Hello Jean >> you can take ur current DataFrame and send them to mllib (i was doing >> that coz i dindt know the ml package),but the process is littlebit >> cumbersome >> >> >> 1. go from DataFrame to Rdd of Rdd of [LabeledVectorPoint] >> 2. run your ML model >> >> i'd suggest you stick to DataFrame + ml package :) >> >> hth >> >> >> >> On Fri, Jul 22, 2016 at 4:41 AM, Jean Georges Perrin <j...@jgp.net> wrote: >> >>> Hi, >>> >>> I am looking for some really super basic examples of MLlib (like a >>> linear regression over a list of values) in Java. I have found a few, but I >>> only saw them using JavaRDD... and not DataFrame. >>> >>> I was kind of hoping to take my current DataFrame and send them in >>> MLlib. Am I too optimistic? Do you know/have any example like that? >>> >>> Thanks! >>> >>> jg >>> >>> >>> Jean Georges Perrin >>> j...@jgp.net / @jgperrin >>> >>> >>> >>> >>> >> >> >
