Check the log directory and see if you see any log file with rpc or mapred in the file name? What does the hadoop-metrics.properties look like? What version of hadoop are you running?
regards, Eric 2011/7/1 孙长 <[email protected]>: > i know where the problem is , i didn't put log4j and hadoop-metrics file > into all nodes' hadoop conf dir. > Now the problem disapears > but for hadoop metrics, i only got dfs data in mysql, no mapreduce, jvm, rpc > data, why? > thank you~ > > > At 2011-07-01 22:59:41，"Eric Yang" <[email protected]> wrote: > >>Looks like mapreduce can not find json.jar in its class path. Which >>version of Hadoop are you using? >> >>regards, >>Eric >> >>2011/7/1 孙长 <[email protected]>: >>> hi,i have copied chukwa-hadoop-*-client.jar and json.jar to >>> HADOOP_HOME/lib, and restarted hadoop, but the MR job lanched by demux runs >>> error: >>> task error is as follows: >>> >>> Error: java.lang.ClassNotFoundException: org.json.JSONException >>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307) >>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:252) >>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) >>> at java.lang.Class.forName0(Native Method) >>> at java.lang.Class.forName(Class.java:169) >>> at >>> org.apache.hadoop.chukwa.extraction.demux.processor.mapper.MapProcessorFactory.getProcessor(MapProcessorFactory.java:40) >>> at >>> org.apache.hadoop.chukwa.extraction.demux.Demux$MapClass.map(Demux.java:95) >>> at >>> org.apache.hadoop.chukwa.extraction.demux.Demux$MapClass.map(Demux.java:64) >>> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) >>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358) >>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) >>> at org.apache.hadoop.mapred.Child.main(Child.java:170) >>> >>> At 2011-07-01 13:17:42，"Eric Yang" <[email protected]> wrote: >>> >>>>Did you copy chukwa-hadoop-*-client.jar and json.jar to >>>>HADOOP_HOME/lib, and restart hadoop? >>>> >>>>regards, >>>>Eric >>>> >>>>2011/6/30 孙长 <[email protected]>: >>>>> Hi, I am using chukwa 0.4 , and i start a collector and a agent on two >>>>> nodes, but i only got system metrics in mysql, no hadoop metrics like jvm, >>>>> dfs, mapred >>>>> dbAdmin.sh is running background, log4j.properties >>>>> and hadoop-metrics.properties in hadoop conf dir are set according to user >>>>> guide >>>>> no dfs, mapred logs in chukwa/log/metrics dir. >>>>> thank you ~ >>>>> >>>>> >>> >>> >>> > > >
