It looks pretty obvious what your issue is. My guess is that your child process needs its heap size bumped up.
Look for the child parameters configuration in your hadoop-default.xml (or your mapred-default.xml if 0.20.x hadoop). St.Ack On Tue, Jun 9, 2009 at 10:05 AM, llpind <[email protected]> wrote: > > Hmm...jobtracker UI has the following: > > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact > region server 192.168.0.195:60020 for region TestTable,,1244499094604, row > '0000010477', but failed after 10 attempts. > Exceptions: > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > > at > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:859) > at > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.processBatchOfRows(HConnectionManager.java:951) > at > org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1397) > at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1341) > at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1321) > at > > org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest.testRow(PerformanceEvaluation.java:515) > at > > org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:386) > at > > org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:583) > at > > org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:182) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342) > at org.apache.hadoop.mapred.Child.main(Child.java:158) > > ================================================= > > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact > region server 192.168.0.195:60020 for region TestTable,,1244499094604, row > '0002107629', but failed after 10 attempts. > Exceptions: > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > java.lang.OutOfMemoryError: Java heap space > > at > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:859) > at > > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.processBatchOfRows(HConnectionManager.java:951) > at > org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1397) > at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1341) > at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1321) > at > > org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest.testRow(PerformanceEvaluation.java:515) > at > > org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:386) > at > > org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:583) > at > > org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:182) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342) > at org.apache.hadoop.mapred.Child.main(Child.java:158) > > > > > stack-3 wrote: > > > > Look at why the job failed in the jobtracker UI -- usually on port 50030. > > Looks like your job launched fine. You have the conf dir on the > > HADOOP_CLASSPATH so the MR job can find hbase? > > St.Ack > > > > On Tue, Jun 9, 2009 at 9:25 AM, llpind <[email protected]> wrote: > > > >> > >> Hey all, > >> > >> getting started with map/reduce jobs. Figured I'd try the > >> PerformanceEvaluation test program first. > >> > >> After adding HBase jar files to HADOOP_CLASSPATH in hadoop-env.sh, I > >> issue > >> the following command: > >> > >> hadoop19/bin/hadoop org.apache.hadoop.hbase.PerformanceEvaluation > >> sequentialWrite 4 > >> > >> and get the following output: > >> > >> 09/06/09 09:20:54 WARN mapred.JobClient: Use GenericOptionsParser for > >> parsing the arguments. Applications should implement Tool for the same. > >> 09/06/09 09:20:55 INFO mapred.FileInputFormat: Total input paths to > >> process > >> : 1 > >> 09/06/09 09:20:56 INFO mapred.JobClient: Running job: > >> job_200906090918_0001 > >> 09/06/09 09:20:57 INFO mapred.JobClient: map 0% reduce 0% > >> java.io.IOException: Job failed! > >> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232) > >> at > >> > >> > org.apache.hadoop.hbase.PerformanceEvaluation.doMapReduce(PerformanceEvaluation.java:293) > >> at > >> > >> > org.apache.hadoop.hbase.PerformanceEvaluation.runNIsMoreThanOne(PerformanceEvaluation.java:221) > >> at > >> > >> > org.apache.hadoop.hbase.PerformanceEvaluation.runTest(PerformanceEvaluation.java:639) > >> at > >> > >> > org.apache.hadoop.hbase.PerformanceEvaluation.doCommandLine(PerformanceEvaluation.java:748) > >> at > >> > >> > org.apache.hadoop.hbase.PerformanceEvaluation.main(PerformanceEvaluation.java:768) > >> > >> > >> What am I doing wrong...? > >> > >> > >> -- > >> View this message in context: > >> > http://www.nabble.com/PerformanceEvaluation-test-tp23946437p23946437.html > >> Sent from the HBase User mailing list archive at Nabble.com. > >> > >> > > > > > > -- > View this message in context: > http://www.nabble.com/PerformanceEvaluation-test-tp23946437p23947225.html > Sent from the HBase User mailing list archive at Nabble.com. > >
