[
https://issues.apache.org/jira/browse/MAHOUT-350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851912#action_12851912
]
Hui Wen Han edited comment on MAHOUT-350 at 3/31/10 3:57 PM:
-------------------------------------------------------------
get following error:
10/03/31 10:34:12 WARN mapred.JobClient: Use GenericOptionsParser for parsing
the arguments. Applications should implement Tool for the same.
10/03/31 10:34:12 WARN mapred.JobClient: No job jar file set. User classes may
not be found. See JobConf(Class) or JobConf#setJar(String).
10/03/31 10:34:12 INFO mapred.FileInputFormat: Total input paths to process : 1
10/03/31 10:34:13 INFO mapred.JobClient: Running job: job_201003221228_0349
10/03/31 10:34:14 INFO mapred.JobClient: map 0% reduce 0%
10/03/31 10:34:25 INFO mapred.JobClient: Task Id :
attempt_201003221228_0349_m_000000_0, Status : FAILED
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
java.lang.ClassNotFoundException:
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:840)
at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:771)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:808)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:832)
... 12 more
Caused by: java.lang.ClassNotFoundException:
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:806)
... 13 more
may be need following in AbstractJob :
jobConf.setJarByClass(AbstractJob.class);
was (Author: huiwenhan):
get following error:
10/03/31 10:34:12 WARN mapred.JobClient: Use GenericOptionsParser for parsing
the arguments. Applications should implement Tool for the same.
10/03/31 10:34:12 WARN mapred.JobClient: No job jar file set. User classes may
not be found. See JobConf(Class) or JobConf#setJar(String).
10/03/31 10:34:12 INFO mapred.FileInputFormat: Total input paths to process : 1
10/03/31 10:34:13 INFO mapred.JobClient: Running job: job_201003221228_0349
10/03/31 10:34:14 INFO mapred.JobClient: map 0% reduce 0%
10/03/31 10:34:25 INFO mapred.JobClient: Task Id :
attempt_201003221228_0349_m_000000_0, Status : FAILED
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
java.lang.ClassNotFoundException:
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:840)
at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:771)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:808)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:832)
... 12 more
Caused by: java.lang.ClassNotFoundException:
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:806)
... 13 more
may be need following in AbstractJob :
jobConf.setJarByClass(Mapper.class);
> add one "JobName" and reduceNumber parameter to
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> ------------------------------------------------------------------------------------------------------
>
> Key: MAHOUT-350
> URL: https://issues.apache.org/jira/browse/MAHOUT-350
> Project: Mahout
> Issue Type: Improvement
> Components: Collaborative Filtering
> Affects Versions: 0.4
> Reporter: Hui Wen Han
> Priority: Minor
> Attachments: screenshot-1.jpg
>
>
> Can add one "JobName" parameter to
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob?
> if there's a lot of RecommenderJob,it's hard to distinguish those jobs.
> also RecommenderJob has four sub jobs (or phase ) ,can add sub-job name to
> those phase ?
> Because RecommenderJob has not setNumReduceTasks ,it seems that the
> performance is not good in reduce phase.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
