Re: No configuration setting found for key 'akka.event-handlers' when running spark-itemsimilarity

2014-12-22 Thread hlqv
@Pat Ferrel: thanks for your helping My environment: Spark 1.1.0-chd4 (built for Hadoop 2.0.0-mr1-cdh4.2.0) Hadoop 2.0.0-mr1-cdh4.1.2 Mahout 1.0 Snapshot build with default (mvn -DskipTests clean install) But I still got the error Initial job has not accepted any resources; check your cluster

Re: spark-itemsimilarity out of memory problem

2014-12-22 Thread Pat Ferrel
Also Ted has an ebook you can download: mapr.com/practical-machine-learning On Dec 22, 2014, at 10:52 AM, Pat Ferrel wrote: Hi Hani, I recently read about Souq.com. A vey promising project. If you are looking at the spark-itemsimilarity for ecommerce type recommendations you may be intereste

Re: spark-itemsimilarity out of memory problem

2014-12-22 Thread Pat Ferrel
Hi Hani, I recently read about Souq.com. A vey promising project. If you are looking at the spark-itemsimilarity for ecommerce type recommendations you may be interested in some slide decs and blog posts I’ve done on the subject. Check out: http://occamsmachete.com/ml/2014/10/07/creating-a-uni

Re: spark-itemsimilarity out of memory problem

2014-12-22 Thread Ted Dunning
Can you say what kind of cluster you have? How many machines? How much memory? How much memory is given to Spark? On Sun, Dec 21, 2014 at 11:44 PM, AlShater, Hani wrote: > Hi All, > > I am trying to use spark-itemsimilarity on 160M user interactions dataset. > The job launches and running su

Re: No configuration setting found for key 'akka.event-handlers' when running spark-itemsimilarity

2014-12-22 Thread Pat Ferrel
For local mode the job is running with the bits it was linked to. Make sure these are the same bits running on your cluster. Mahout links to Spark 1.1.0, is that what you are running on the cluster? On Dec 21, 2014, at 9:06 PM, hlqv wrote: @Pat Ferrel: Thank you so much. I restarted Hadoop and

Re: spark-itemsimilarity out of memory problem

2014-12-22 Thread Pat Ferrel
The job has an option -sem to set the spark.executor.memory config. Also you can change runtime job config with -D:key=value to access any of the Spark config values. On Dec 21, 2014, at 11:44 PM, AlShater, Hani wrote: Hi All, I am trying to use spark-itemsimilarity on 160M user interactions

Re: No configuration setting found for key 'akka.event-handlers' when running spark-itemsimilarity

2014-12-22 Thread Pat Ferrel
Mahout 1.0 snapshot currently requires Spark 1.1.0 On Dec 21, 2014, at 6:34 PM, Queen Kappa wrote: Hi Pat, I also got the same error with hlqv. My environment is spark-1.2.0-bin-cdh4 & mahout-1.0-SNAPSHOT. The Spark examples works fine for my Spark Clusters. Best regards, Joe On Sun, 21 Dec 2