Re: java.lang.OutOfMemoryError with Mahout 0.10 and Spark 1.1.1

2015-08-05 Thread Rodolfo Viana
trings? This total will give > you an idea for what the minimum for your client. You will need more to > hold the mapped integers and for the indexes but it will give you an idea. > > 6G is a lot of string storage. > > On Aug 4, 2015, at 11:58 AM, Rodolfo Viana > wrote: > &g

Re: java.lang.OutOfMemoryError with Mahout 0.10 and Spark 1.1.1

2015-08-04 Thread Rodolfo Viana
> (which i don't believe is a true optimal thing to do though). > > On Mon, Jul 20, 2015 at 1:40 PM, Rodolfo Viana < > rodolfodelimavi...@gmail.com > > wrote: > > > I’m trying to run Mahout 0.10 with Spark 1.1.1. > > I have input files with 8k, 10M, 20M, 25M.

Re: IndexOutOfBoundsException in ALS recommendation

2015-07-27 Thread Rodolfo Viana
When I got this error it was because I didn't have the input file in the correct form. Check especially the last line, your last line can not be a black space. On Mon, Jul 27, 2015 at 8:09 PM, Suman Somasundar < suman.somasun...@oracle.com> wrote: > Hi, > > > > I am getting the following error wh

java.lang.OutOfMemoryError with Mahout 0.10 and Spark 1.1.1

2015-07-20 Thread Rodolfo Viana
I’m trying to run Mahout 0.10 with Spark 1.1.1. I have input files with 8k, 10M, 20M, 25M. So far I run with the following configuration: 8k with 1,2,3 slaves 10M with 1, 2, 3 slaves 20M with 1,2,3 slaves But when I try to run bin/mahout spark-itemsimilarity --master spark://node1:7077 --input f

Re: Mahout 0.10 with Spark 1.1.1

2015-07-14 Thread Rodolfo Viana
.executor.instances=4 > -D:spark.executor.cores=4 -D:spark.yarn.queue=spark-prod > > > It worked fine for me. > > > - Kidong. > > > > 2015-07-08 3:34 GMT+09:00 Rodolfo Viana : > > > Hi, > > > > I’m trying to run Mahout 0.10 using Spark 1.1.1 and so far I didn’t have

Re: Mahout 0.10 with Spark 1.1.1

2015-07-07 Thread Rodolfo Viana
lists. > > > On Tue, Jul 7, 2015 at 10:30 AM, Rodolfo Viana < > rodolfodelimavi...@gmail.com > > wrote: > > > Hi, > > > > I’m trying to run Mahout 0.10 using Spark 1.1.1 and so far I didn’t have > > any success passing a file on hdfs. My actual probl

Mahout 0.10 with Spark 1.1.1

2015-07-07 Thread Rodolfo Viana
Hi, I’m trying to run Mahout 0.10 using Spark 1.1.1 and so far I didn’t have any success passing a file on hdfs. My actual problem is when I try to run the example: bin/mahout spark-itemsimilarity --input hdfs://localhost:9000/input --output hdfs://localhost:9000/output And I’m having this error