Re: region server hanging

2008-06-05 Thread Billy Pearson
Yes this could be the problem as I testing one regions server vary hard to find a breaking point with a datanode and 4 task trackers on the same server. The server is only a dual 2.4Ghz with 4Gb memory with a 147GB SCSI 10K rpm drive I got 16 threads on 4 server includeing the region server

Re: need help for setting muti-node hbase on hadoop

2008-06-05 Thread 晋光峰
Thanks for your instructions! Now i have setup the hbase following the configurations on the machines and i can startup hbase after hdfs started. But when I use hql to execute some commands, the error happened. The shell console list many messages below: Retrying connect to server: /127.0.0.2:6

Re: Need some help? LongWritable cast to Text Error

2008-06-05 Thread Todd Lipcon
Hi William, For TextInputFormat, the keys produced by the input format will be LongWritables equal to the line number of the input line. Hope that helps -Todd On Thu, 5 Jun 2008, William Clay Moody wrote: Newbie Question: I am trying to write a MapReduce from a text file in HDFS into a HBa

Need some help? LongWritable cast to Text Error

2008-06-05 Thread William Clay Moody
Newbie Question: I am trying to write a MapReduce from a text file in HDFS into a HBase table. I am getting the following run-time error 08/06/05 17:24:08 INFO mapred.JobClient: Task Id : task_200806041619_0009_m_01_0, Status : FAILED java.lang.ClassCastException: org.apache.hadoop.io.L

Re: need help for setting muti-node hbase on hadoop

2008-06-05 Thread stack
晋光峰 wrote: So my questions are: 1, Do i need to install hbase software on all the four machines? Yes. 2, Is the configuration parameters in hbase master node are same as hbase region server node? Yes. 3, Is hbase-0.1.2 support lates hadoop-0.17.0? No. HBase runs

Re: need help for setting muti-node hbase on hadoop

2008-06-05 Thread 晋光峰
> Dears, > > now i'm try to using hbase on hadoop. I have developed the source code > running on single machine, and hbase/hadoop working fine. > > now I try to move the program to mutiple node. The machines are organized > like this: > machine 1: act as namenode and jobtracker > machine

Re: region server hanging

2008-06-05 Thread stack
We'll see issues like the below and the issue you reported subsequently about regionservers sleeping 10x longer than scheduled sleep time when hosts are heavily loaded (Lots of heavy duty MR jobs running on hosts that are also carrying regionservers and datanodes). Is this the case with your m

Re: region server hanging

2008-06-05 Thread Billy Pearson
Also I get these after the hangs 2008-06-05 03:33:28,609 WARN org.apache.hadoop.hbase.util.Sleeper: We slept 74521ms, ten times longer than scheduled: 3000

region server hanging

2008-06-05 Thread Billy Pearson
I see the below error a lot when the region server seams to just stop and wait a few secs to a min then it go's on like nothing happened sometimes hangeing my MR task but these errors are the only thing I can find wrong. Any one know any more about this error? 2008-06-05 03:16:03,666 ERROR org