if edward has be come back at next week, we will make pseudo-distributed
operation system and test it.
2008/9/8, Edward J. Yoon <[EMAIL PROTECTED]>:
>
> This issue was addressed by HAMA-53, And I just committed this. Please
> re-try on your cluster. : )
>
> Thanks, Edward
>
>
> On Mon, Sep 8, 2008 at 6:17 AM, Edward J. Yoon <[EMAIL PROTECTED]>
> wrote:
> > Hmm, it was bug. Thanks for your report.
> >
> > On Mon, Sep 8, 2008 at 4:51 PM, Kyungho Jeon <[EMAIL PROTECTED]>
> wrote:
> >> A NullPointerException occurred in my system (Pseudo-distributed
> operation),
> >> too.
> >>
> >> I will try standalone mode.
> >>
> >> Thank you for an answer.
> >>
> >> --
> >> kyungho jeon
> >>
> >> On Mon, Sep 8, 2008 at 4:40 PM, Edward J. Yoon <[EMAIL PROTECTED]
> >wrote:
> >>
> >>> Are you ready to run the Hama on the Hadoop + Hbase cluster? Then,
> >>> This is quick guide for you :
> >>>
> >>> 1. [hama-trunk]# ant clean package
> >>> Then, You should add hama-x.x.x.jar to the $HADOOP_HOME/lib and
> >>> copy these changes across your cluster.
> >>>
> >>> 2. [hama-trunk]# cp ./build/hama-0.1.0-dev.jar {HADOOP_HOME}/lib
> >>> You also need to restart your hadoop cluster.
> >>>
> >>> 3. [hama-trunk]# cp ./build/hama-0.1.0-dev-examples.jar {HADOOP_HOME}
> >>> 4. [hadoop-0.17.1]# ./bin/hadoop jar hama-0.1.0-dev-examples.jar
> addition 2
> >>> 2
> >>> ...
> >>>
> >>> BTW, It seems work just fine on Eclipse (local mode), but I recieved
> >>> an NullPointerException when I run it on 2-node cluster. I'll fix it.
> >>>
> >>> Thanks, Edward
> >>>
> >>> On Mon, Sep 8, 2008 at 1:27 PM, Kyungho Jeon <[EMAIL PROTECTED]>
> >>> wrote:
> >>> > I installed hadoop, hbase, and hama in pseudo-distributed operation
> mode,
> >>> >
> >>> > but I can not run the example code. How can I fix it?
> >>> >
> >>> > (Sorry for the messy logs...)
> >>> >
> >>> > They are installed on following directories:
> >>> >
> >>> > /home/khjeon/mapred/hadoop
> >>> > /home/khjeon/mapred/hbase
> >>> > /home/khjeon/mapred/hama-trunk
> >>> >
> >>> > In addition, my hadoop-env.sh file contains following lines
> >>> > export HBASE_HOME=/home/khjeon/mapred/hbase
> >>> > export HAMA_HOME=/home/khjeon/mapred/hama-trunk
> >>> >
> >>> > export
> >>> >
> >>>
> HADOOP_CLASSPATH=${HBASE_HOME}:${HBASE_HOME}/hbase-0.2.0.jar:${HBASE_HOME}/conf
> >>> > export
> >>> >
> >>>
> HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:${HAMA_HOME}:${HAMA_HOME}/build:${HAMA_HOME}/build/hama-0.1.0-dev.jar:${HAMA_HOME}/conf
> >>> >
> >>> > I got errors like these:
> >>> >
> >>> > ../hadoop/bin/hadoop jar build/hama-0.1.0-dev-examples.jar addition 3
> 3
> >>> >
> >>> > 08/09/08 13:05:52 WARN fs.FileSystem: "localhost:9000" is a
> deprecated
> >>> > filesystem name. Use "hdfs://localhost:9000/" instead.
> >>> > 08/09/08 13:05:53 INFO hama.AbstractMatrix: Initializing the matrix
> >>> storage.
> >>> > 08/09/08 13:06:03 INFO hama.AbstractMatrix: Create the 3 * 3 random
> >>> matrix :
> >>> > randjowrz
> >>> > 08/09/08 13:06:03 INFO hama.AbstractMatrix: Initializing the matrix
> >>> storage.
> >>> > 08/09/08 13:06:13 INFO hama.AbstractMatrix: Create the 3 * 3 random
> >>> matrix :
> >>> > randswrhz
> >>> > 08/09/08 13:06:13 INFO hama.AbstractMatrix: Initializing the matrix
> >>> storage.
> >>> > 08/09/08 13:06:23 WARN fs.FileSystem: "localhost:9000" is a
> deprecated
> >>> > filesystem name. Use "hdfs://localhost:9000/" instead.
> >>> > 08/09/08 13:06:23 WARN mapred.JobClient: No job jar file set. User
> >>> classes
> >>> > may not be found. See JobConf(Class) or JobConf#setJar(String).
> >>> > 08/09/08 13:06:23 INFO mapred.JobClient: Running job:
> >>> job_200809081230_0008
> >>> > 08/09/08 13:06:24 INFO mapred.JobClient: map 0% reduce 0%
> >>> > 08/09/08 13:06:29 INFO mapred.JobClient: Task Id :
> >>> > task_200809081230_0008_m_000000_0, Status : FAILED
> >>> > java.lang.RuntimeException: java.lang.RuntimeException:
> >>> > java.lang.ClassNotFoundException: org.apache.hama.DenseVector
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:633)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.JobConf.getMapOutputValueClass(JobConf.java:552)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:369)
> >>> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:185)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2122)
> >>> > Caused by: java.lang.RuntimeException:
> java.lang.ClassNotFoundException:
> >>> > org.apache.hama.DenseVector
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:601)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:625)
> >>> > ... 4 more
> >>> > Caused by: java.lang.ClassNotFoundException:
> org.apache.hama.DenseVector
> >>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> >>> > at java.security.AccessController.doPrivileged(Native Method)
> >>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >>> > at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> >>> > at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> >>> > at java.lang.Class.forName0(Native Method)
> >>> > at java.lang.Class.forName(Class.java:242)
> >>> > at
> >>> >
> >>>
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:581)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:599)
> >>> > ... 5 more
> >>> >
> >>> > 08/09/08 13:06:33 INFO mapred.JobClient: Task Id :
> >>> > task_200809081230_0008_r_000000_0, Status : FAILED
> >>> > java.lang.RuntimeException: java.lang.RuntimeException:
> >>> > java.lang.ClassNotFoundException:
> org.apache.hama.algebra.AdditionReduce
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:633)
> >>> > at
> >>> > org.apache.hadoop.mapred.JobConf.getReducerClass(JobConf.java:747)
> >>> > at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2122)
> >>> > Caused by: java.lang.RuntimeException:
> java.lang.ClassNotFoundException:
> >>> > org.apache.hama.algebra.AdditionReduce
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:601)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:625)
> >>> > ... 3 more
> >>> > Caused by: java.lang.ClassNotFoundException:
> >>> > org.apache.hama.algebra.AdditionReduce
> >>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> >>> > at java.security.AccessController.doPrivileged(Native Method)
> >>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >>> > at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> >>> > at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> >>> > at java.lang.Class.forName0(Native Method)
> >>> > at java.lang.Class.forName(Class.java:242)
> >>> > at
> >>> >
> >>>
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:581)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:599)
> >>> > ... 4 more
> >>> >
> >>> > 08/09/08 13:06:34 INFO mapred.JobClient: Task Id :
> >>> > task_200809081230_0008_m_000000_1, Status : FAILED
> >>> > java.lang.RuntimeException: java.lang.RuntimeException:
> >>> > java.lang.ClassNotFoundException: org.apache.hama.DenseVector
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:633)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.JobConf.getMapOutputValueClass(JobConf.java:552)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:369)
> >>> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:185)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2122)
> >>> > Caused by: java.lang.RuntimeException:
> java.lang.ClassNotFoundException:
> >>> > org.apache.hama.DenseVector
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:601)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:625)
> >>> > ... 4 more
> >>> > Caused by: java.lang.ClassNotFoundException:
> org.apache.hama.DenseVector
> >>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> >>> > at java.security.AccessController.doPrivileged(Native Method)
> >>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >>> > at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> >>> > at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> >>> > at java.lang.Class.forName0(Native Method)
> >>> > at java.lang.Class.forName(Class.java:242)
> >>> > at
> >>> >
> >>>
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:581)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:599)
> >>> > ... 5 more
> >>> >
> >>> > 08/09/08 13:06:37 INFO mapred.JobClient: Task Id :
> >>> > task_200809081230_0008_r_000000_1, Status : FAILED
> >>> > java.lang.RuntimeException: java.lang.RuntimeException:
> >>> > java.lang.ClassNotFoundException:
> org.apache.hama.algebra.AdditionReduce
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:633)
> >>> > at
> >>> > org.apache.hadoop.mapred.JobConf.getReducerClass(JobConf.java:747)
> >>> > at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2122)
> >>> > Caused by: java.lang.RuntimeException:
> java.lang.ClassNotFoundException:
> >>> > org.apache.hama.algebra.AdditionReduce
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:601)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:625)
> >>> > ... 3 more
> >>> > Caused by: java.lang.ClassNotFoundException:
> >>> > org.apache.hama.algebra.AdditionReduce
> >>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> >>> > at java.security.AccessController.doPrivileged(Native Method)
> >>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >>> > at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> >>> > at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> >>> > at java.lang.Class.forName0(Native Method)
> >>> > at java.lang.Class.forName(Class.java:242)
> >>> > at
> >>> >
> >>>
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:581)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:599)
> >>> > ... 4 more
> >>> >
> >>> > 08/09/08 13:06:39 INFO mapred.JobClient: Task Id :
> >>> > task_200809081230_0008_m_000000_2, Status : FAILED
> >>> > java.lang.RuntimeException: java.lang.RuntimeException:
> >>> > java.lang.ClassNotFoundException: org.apache.hama.DenseVector
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:633)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.JobConf.getMapOutputValueClass(JobConf.java:552)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:369)
> >>> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:185)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2122)
> >>> > Caused by: java.lang.RuntimeException:
> java.lang.ClassNotFoundException:
> >>> > org.apache.hama.DenseVector
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:601)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:625)
> >>> > ... 4 more
> >>> > Caused by: java.lang.ClassNotFoundException:
> org.apache.hama.DenseVector
> >>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> >>> > at java.security.AccessController.doPrivileged(Native Method)
> >>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >>> > at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> >>> > at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> >>> > at java.lang.Class.forName0(Native Method)
> >>> > at java.lang.Class.forName(Class.java:242)
> >>> > at
> >>> >
> >>>
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:581)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:599)
> >>> > ... 5 more
> >>> >
> >>> > 08/09/08 13:06:43 INFO mapred.JobClient: Task Id :
> >>> > task_200809081230_0008_r_000000_2, Status : FAILED
> >>> > java.lang.RuntimeException: java.lang.RuntimeException:
> >>> > java.lang.ClassNotFoundException:
> org.apache.hama.algebra.AdditionReduce
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:633)
> >>> > at
> >>> > org.apache.hadoop.mapred.JobConf.getReducerClass(JobConf.java:747)
> >>> > at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
> >>> > at
> >>> >
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2122)
> >>> > Caused by: java.lang.RuntimeException:
> java.lang.ClassNotFoundException:
> >>> > org.apache.hama.algebra.AdditionReduce
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:601)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:625)
> >>> > ... 3 more
> >>> > Caused by: java.lang.ClassNotFoundException:
> >>> > org.apache.hama.algebra.AdditionReduce
> >>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> >>> > at java.security.AccessController.doPrivileged(Native Method)
> >>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >>> > at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> >>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> >>> > at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> >>> > at java.lang.Class.forName0(Native Method)
> >>> > at java.lang.Class.forName(Class.java:242)
> >>> > at
> >>> >
> >>>
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:581)
> >>> > at
> >>> > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:599)
> >>> > ... 4 more
> >>> >
> >>> > 08/09/08 13:06:44 INFO mapred.JobClient: map 100% reduce 100%
> >>> > java.io.IOException: Job failed!
> >>> > at
> org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1062)
> >>> > at org.apache.hama.DenseMatrix.add(DenseMatrix.java:146)
> >>> > at
> >>> > org.apache.hama.examples.MatrixAddition.main(MatrixAddition.java:44)
> >>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>> > at
> >>> >
> >>>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >>> > at
> >>> >
> >>>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>> > at java.lang.reflect.Method.invoke(Method.java:597)
> >>> > at
> >>> >
> >>>
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> >>> > at
> >>> > org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> >>> > at
> >>> > org.apache.hama.examples.ExampleDriver.main(ExampleDriver.java:29)
> >>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>> > at
> >>> >
> >>>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >>> > at
> >>> >
> >>>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>> > at java.lang.reflect.Method.invoke(Method.java:597)
> >>> > at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
> >>> > at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194)
> >>> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>> > at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220)
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> Best regards, Edward J. Yoon
> >>> [EMAIL PROTECTED]
> >>> http://blog.udanax.org
> >>>
> >>
> >
> >
> >
> > --
> > Best regards, Edward J. Yoon
> > [EMAIL PROTECTED]
> > http://blog.udanax.org
> >
>
>
>
>
> --
>
> Best regards, Edward J. Yoon
> [EMAIL PROTECTED]
> http://blog.udanax.org
>
--
Yoon Joo Sun
Java Developer Engineer
Blog - http://www.ologist.co.kr
