Re: Facing problem

2008-10-16 Thread rathi
Version : hbase-0.2.0. I have enabled the Debug. Nothing in the logs. I have tried with one as well as two region servers. Even if i restart it does not work. Let me explain the setup as well. I have not enabled hdfs. I am still using local disc but the region servers are distributed.The same conf

Re: out of memory error

2008-10-16 Thread Rui Xing
Sorry for the missing of necessary information. The hardware configuration is 16G mem/8 CPUs. The cluster is 5 datanodes and 1 name nodes. The version of Hadoop/HBase is hadoop-0.17.1/hbase-0.2.1. We allocated 65535 file descriptors and the specific changes made to config files are: In hadoop-env

Re: HBase and hadoop cluster rebalance

2008-10-16 Thread Slava Gorelik
No :-) My question is : I defined Hadoop cluster with 7 datanodes and one namenode. The cluster capacity (from the Hadoop web admin page) is about 700GB. From this i understand that default usage for datanode disk space is 100GB / datanode. Please correct me if i wrong. Best Regards. On Fri, Oct

Re: HBase and hadoop cluster rebalance

2008-10-16 Thread stack
Are you asking about the below Slava? dfs.block.size 67108864 The default block size for new files. I do not know of a 100GB configuration in hadoop/hbase? If so, if configuring for hbase, you need to add the configuration to hbase-site.xml or add under your hbase conf an hadoop-site.xml

Re: HBase and hadoop cluster rebalance

2008-10-16 Thread Slava Gorelik
Hi.Small question, little bit off topic. How can i change the default 100GB datanode size to be something else ? Best Regards. On Thu, Oct 16, 2008 at 10:41 PM, stack <[EMAIL PROTECTED]> wrote: > Daniel Ploeg wrote: > >> Hi all, >> >> I performed a cluster rebalance on my test cluster yesterday

Re: [VOTE] hbase 0.18.1 release candidate 1

2008-10-16 Thread Clint Morgan
I was hoping someone could take a look at 910. It seems like a critical issue to me. On Thu, Oct 16, 2008 at 2:12 PM, stack <[EMAIL PROTECTED]> wrote: > hbase 0.18.1 release candidate 1 is available for download: > > > http://people.apache.org/~stack/hbase-0.18.1-candidate-1/

[VOTE] hbase 0.18.1 release candidate 1

2008-10-16 Thread stack
hbase 0.18.1 release candidate 1 is available for download: http://people.apache.org/~stack/hbase-0.18.1-candidate-1/ It fixes 14 issues: http://tinyurl.com/49fuha Shall we release this RC as hbase 0.18.1? Vote closes Monday, 20th October. Thanks, St.Ack P.S. Devs, 0.18 branch is frozen whi

Re: HBase and hadoop cluster rebalance

2008-10-16 Thread stack
Daniel Ploeg wrote: Hi all, I performed a cluster rebalance on my test cluster yesterday (5 regionserver / datanodes each with approx 400GB - total approx 2TB HDFS) and I would like to know if the mailing lists have seen similar results to what I've seen. I talked to the lads running hbase

Re: Dataloss HBASE-728

2008-10-16 Thread stack
Jean-Adrien wrote: Hello. I have some questions for the hbase-users (and developers) team. I'll post them in different threads since it concerns different subjects I read the jira issue tracker content, and I have a question about case http://issues.apache.org/jira/browse/HBASE-728 HBASE-728 .

Re: Facing problem

2008-10-16 Thread stack
What version? Anything in the logs? Do you have DEBUG enabled? (See FAQ for how.) If you restart, does it start working again? How many regions? St.Ack rathi wrote: My Hbase installation was working fine. I dont know what happened may be i changed something but now the meta region is not

RE: out of memory error

2008-10-16 Thread Jim Kellerman (POWERSET)
In the future, you will get a more timely response for hbase questions if you post them on the hbase-user@hadoop.apache.org mailing list. In order to address your question, it would be helpful to know your hardware configuration (memory, # of cores), any changes you have made to hbase-site.xml, ho

RE: Regionserver sleeps too much

2008-10-16 Thread Jonathan Gray
With only 1GB of memory, you definitely want to reduce the heap size given to the JVM running regionservers and datanodes. You can change this for hbase in conf/hbase-env.sh, export HBASE_HEAPSIZE=SIZE_IN_MB. I'd say you want to configure everything so you won't be out of memory when every java p

Facing problem

2008-10-16 Thread rathi
My Hbase installation was working fine. I dont know what happened may be i changed something but now the meta region is not assigned to any region server. Earlier I was getting prints in the log telling "RegionManager.metaScanner scanning meta region {regionname: .META" and "scanning meta region

Regionserver sleeps too much

2008-10-16 Thread Jean-Adrien
Hello again. My second question concerns one of my region server (often the same) which shutdowns often because it misses the window to heartbeats to master: Maybe it is overloaded. But it misses it for about 6min. I turned the log file to debug mode, but I havn't found anything more interesting

Re: out of memory error

2008-10-16 Thread Rong-en Fan
On Thu, Oct 16, 2008 at 8:18 PM, Rui Xing <[EMAIL PROTECTED]> wrote: > Hello List, > > We encountered an out-of-memory error in data loading. We have 5 data nodes > and 1 name node distributed on 6 machines. Block-level compression was used. > Following is the log output. Seems the problem was caus

Dataloss HBASE-728

2008-10-16 Thread Jean-Adrien
Hello. I have some questions for the hbase-users (and developers) team. I'll post them in different threads since it concerns different subjects I read the jira issue tracker content, and I have a question about case http://issues.apache.org/jira/browse/HBASE-728 HBASE-728 . I was wondering in

out of memory error

2008-10-16 Thread Rui Xing
Hello List, We encountered an out-of-memory error in data loading. We have 5 data nodes and 1 name node distributed on 6 machines. Block-level compression was used. Following is the log output. Seems the problem was caused in compression. Is there anybody who ever experienced such error? Any helps