U seem to be missing google collections in ur IDE class path Sent from my iPhone
On Apr 9, 2013, at 4:50 PM, Cyril Bogus <cyrilbo...@gmail.com> wrote: > So I am trying to run a Canopy Clustering on a small data imported in the > hdfs. > My Program is running on an IDE with Java and I have all the tools in my > build path > > I setup JobConf with my own core-site.xml / hdfs-site.xml and > mapred-site.xml > > Whenever I run the Canopy on the clustering I get the following error in > Java: > > 13/04/09 16:45:52 INFO canopy.CanopyDriver: Build Clusters Input: > datafileimporter/data Out: datafileimporter/clusters Measure: > org.apache.mahout.common.distance.EuclideanDistanceMeasure@2efb56b1 t1: > 10.0 t2: 2.0 > 13/04/09 16:45:52 WARN mapred.JobClient: Use GenericOptionsParser for > parsing the arguments. Applications should implement Tool for the same. > 13/04/09 16:45:53 INFO input.FileInputFormat: Total input paths to process > : 1 > 13/04/09 16:45:53 INFO mapred.JobClient: Running job: job_201304021251_0022 > 13/04/09 16:45:54 INFO mapred.JobClient: map 0% reduce 0% > 13/04/09 16:46:06 INFO mapred.JobClient: Task Id : > attempt_201304021251_0022_m_000000_0, Status : FAILED > java.lang.RuntimeException: java.lang.reflect.InvocationTargetException > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:719) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:416) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > at org.apache.hadoop.mapred.Child.main(Child.java:249) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:532) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113) > ... 7 more > *Caused by: java.lang.NoClassDefFoundError: com/google/common/collect/Lists* > at > org.apache.mahout.clustering.canopy.CanopyMapper.<init>(CanopyMapper.java:32) > ... 12 more > *Caused by: java.lang.ClassNotFoundException: > com.google.common.collect.Lists* > at java.net.URLClassLoader$1.run(URLClassLoader.java:217) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:205) > at java.lang.ClassLoader.loadClass(ClassLoader.java:321) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) > at java.lang.ClassLoader.loadClass(ClassLoader.java:266) > ... 13 more > > 13/04/09 16:46:12 INFO mapred.JobClient: Task Id : > attempt_201304021251_0022_m_000000_1, Status : FAILED > java.lang.RuntimeException: java.lang.reflect.InvocationTargetException > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:719) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:416) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > at org.apache.hadoop.mapred.Child.main(Child.java:249) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:532) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113) > ... 7 more > Caused by: java.lang.NoClassDefFoundError: com/google/common/collect/Lists > at > org.apache.mahout.clustering.canopy.CanopyMapper.<init>(CanopyMapper.java:32) > ... 12 more > Caused by: java.lang.ClassNotFoundException: com.google.common.collect.Lists > at java.net.URLClassLoader$1.run(URLClassLoader.java:217) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:205) > at java.lang.ClassLoader.loadClass(ClassLoader.java:321) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) > at java.lang.ClassLoader.loadClass(ClassLoader.java:266) > ... 13 more > > 13/04/09 16:46:18 INFO mapred.JobClient: Task Id : > attempt_201304021251_0022_m_000000_2, Status : FAILED > java.lang.RuntimeException: java.lang.reflect.InvocationTargetException > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:719) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:416) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > at org.apache.hadoop.mapred.Child.main(Child.java:249) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:532) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113) > ... 7 more > Caused by: java.lang.NoClassDefFoundError: com/google/common/collect/Lists > at > org.apache.mahout.clustering.canopy.CanopyMapper.<init>(CanopyMapper.java:32) > ... 12 more > Caused by: java.lang.ClassNotFoundException: com.google.common.collect.Lists > at java.net.URLClassLoader$1.run(URLClassLoader.java:217) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:205) > at java.lang.ClassLoader.loadClass(ClassLoader.java:321) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) > at java.lang.ClassLoader.loadClass(ClassLoader.java:266) > ... 13 more > > 13/04/09 16:46:30 INFO mapred.JobClient: Job complete: job_201304021251_0022 > 13/04/09 16:46:30 INFO mapred.JobClient: Counters: 7 > 13/04/09 16:46:30 INFO mapred.JobClient: Job Counters > 13/04/09 16:46:30 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=24503 > 13/04/09 16:46:30 INFO mapred.JobClient: Total time spent by all > reduces waiting after reserving slots (ms)=0 > 13/04/09 16:46:30 INFO mapred.JobClient: Total time spent by all maps > waiting after reserving slots (ms)=0 > 13/04/09 16:46:30 INFO mapred.JobClient: Launched map tasks=4 > 13/04/09 16:46:30 INFO mapred.JobClient: Data-local map tasks=4 > 13/04/09 16:46:30 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0 > 13/04/09 16:46:30 INFO mapred.JobClient: Failed map tasks=1 > java.lang.InterruptedException: Canopy Job failed processing > datafileimporter/data > at > org.apache.mahout.clustering.canopy.CanopyDriver.buildClustersMR(CanopyDriver.java:363) > at > org.apache.mahout.clustering.canopy.CanopyDriver.buildClusters(CanopyDriver.java:248) > at > org.apache.mahout.clustering.canopy.CanopyDriver.run(CanopyDriver.java:155) > at > org.apache.mahout.clustering.canopy.CanopyDriver.run(CanopyDriver.java:170) > at DataImporter.main(DataImporter.java:66) > > > > Apparently the error is caused because it is looking for a class that IS in > my build path. > I even downloaded an older version to check if the issue persist but still > get the same error. > > I am using mahout-core-0.7.jar > > Best Regards.
