Re: Using Mahout 1.0-SNAPSHOT with yarn cluster continued

2015-01-09 Thread Dmitriy Lyubimov
strange. legacy still depends on m-math and should include it into job jar. or did it get that much out of hand after MR deprecation? On Fri, Jan 9, 2015 at 8:51 AM, mw m...@plista.com wrote: I found a solution! I had to upload the missing jars onto yarn hdfs and add the following to the

Re: Using Mahout 1.0-SNAPSHOT with yarn cluster continued

2015-01-09 Thread mw
I found a solution! I had to upload the missing jars onto yarn hdfs and add the following to the hadoop Configuration: hadoopConf.set(tmpjars,/lib/mahout-math-1.0-20150108.230237-316.jar,/lib/commons-cli-2.0-mahout.jar); Best, Max On 01/09/2015 02:13 PM, mw wrote: I looked into the submitted

Re: Using Mahout 1.0-SNAPSHOT with yarn cluster continued

2015-01-09 Thread mw
I wrote a message to the hadoop list about it. Also i found this https://issues.apache.org/jira/browse/MAHOUT-1498 ticket. Could it be a related bug? Best, Max On 01/08/2015 06:18 PM, Pat Ferrel wrote: That sounds like a Hadoop list question. All I can say is there is a job.jar in

Re: Using Mahout 1.0-SNAPSHOT with yarn cluster continued

2015-01-09 Thread mw
I looked into the submitted job.jar and i found that the missing class(org.apache.mahout.math.Vector) is not contained. On 01/09/2015 12:57 PM, mw wrote: I wrote a message to the hadoop list about it. Also i found this https://issues.apache.org/jira/browse/MAHOUT-1498 ticket. Could it be a

Re: Using Mahout 1.0-SNAPSHOT with yarn cluster continued

2015-01-08 Thread mw
Hello again, maybe my question was misleading. I am asking whether the intended usage is to provide the job with the required library’s and sent those together with the job to yarn(if yes how can this be done?), or to add the required classes to the classpath of every node in the cluster.

Re: Using Mahout 1.0-SNAPSHOT with yarn cluster continued

2015-01-08 Thread Pat Ferrel
That sounds like a Hadoop list question. All I can say is there is a job.jar in mrlegacy/target with all dependencies packaged. This should have everything needed for lda. On Jan 8, 2015, at 5:50 AM, mw m...@plista.com wrote: Hello again, maybe my question was misleading. I am asking whether

Using Mahout 1.0-SNAPSHOT with yarn cluster continued

2015-01-07 Thread mw
Hello, the first error was due to a missing property in yarn.xml. However no i have a different problem. i am working on a web application that should execute lda on a external yarn cluster. I am uploading all the relevant sequence files onto the yarn cluter. This is how it try to