Hi,
I am discovering Mahout which I installed on a mapr cluster using the
mapr-mahout package.
I try some very little test on recommenders:
My input is the following $MAHOUT_HOME/input/test.txt:
0,1,4
0,4,2
5,1,2
5,4,3
5,7,5
8,1,2
8,7,1
I go in $MAHOUT_HOME and I run:
mahout recommenditembased -s SIMILARITY_PEARSON_CORRELATION -i
input/test.txt -o output --numRecommendations 5
I get the following error message:
No MAHOUT_CONF_DIR found
Running on hadoop, using /opt/mapr/hadoop/hadoop-0.20.2/bin/hadoop and
HADOOP_CONF_DIR=
MAHOUT-JOB: /opt/mapr/mahout/mahout-0.9/mahout-examples-0.9-mapr-job.jar
14/08/05 09:53:53 WARN driver.MahoutDriver: No recommenditembased.props
found on classpath, will use command-line arguments only
14/08/05 09:53:54 INFO common.AbstractJob: Command line arguments:
{--booleanData=[false], --endPhase=[2147483647],
--input=[input/test.txt], --maxPrefsInItemSimilarity=[500],
--maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100],
--minPrefsPerUser=[1], --numRecommendations=[5], --output=[output],
--similarityClassname=[SIMILARITY_PEARSON_CORRELATION],
--startPhase=[0], --tempDir=[temp]}
14/08/05 09:53:54 INFO common.AbstractJob: Command line arguments:
{--booleanData=[false], --endPhase=[2147483647],
--input=[input/test.txt], --minPrefsPerUser=[1],
--output=[temp/preparePreferenceMatrix], --ratingShift=[0.0],
--startPhase=[0], --tempDir=[temp]}
14/08/05 09:53:54 INFO fs.JobTrackerWatcher: Current running JobTracker
is: fb-mapr1.c.mindful-origin-252.internal/10.240.1.96:9001
14/08/05 09:53:54 INFO mapred.JobClient: Cleaning up the staging area
maprfs:/var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201408041502_0035
Exception in thread "main"
org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path
does not exist: input/test.txt
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:248)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:273)
at
org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1033)
at
org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1050)
at
org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:173)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:934)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:885)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:885)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:573)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:603)
at
org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:77)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at
org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at
org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
Precision: i set MAHOUT_CONF_DIR=/opt/mapr/mahout/mahout-0.9/conf.new
because I did not know how to set it.
Can you help me solve this very frustrating problem?
