Re: RowSimilakrity : NotSerializableException

2016-05-07 Thread Dmitriy Lyubimov
you can also wrap mahout context around existing spark session (aka context). On Sat, May 7, 2016 at 9:41 PM, Rohit Jain wrote: > Yes, we did figure out this problem. And realised that instead sparkcontext > I have to use mahoutsparkcontext, > > On Sun, May 8, 2016 at 4:26 AM, Pat Ferrel wrote:

Re: RowSimilakrity : NotSerializableException

2016-05-07 Thread Rohit Jain
Yes, we did figure out this problem. And realised that instead sparkcontext I have to use mahoutsparkcontext, On Sun, May 8, 2016 at 4:26 AM, Pat Ferrel wrote: > I think you have to create a SparkDistributedContext, which has Mahout > specific Kryo serialization and adds Mahout jars. If you let

Re: RowSimilakrity : NotSerializableException

2016-05-07 Thread Pat Ferrel
I think you have to create a SparkDistributedContext, which has Mahout specific Kryo serialization and adds Mahout jars. If you let Mahout create the Spark context it’s simpler val implicit mc = mahoutSparkContext(masterUr = “local", appName = “SparkExample”) As I recall the sc will then be