Re: HBase bulk loaded region can't be splitted

2012-05-12 Thread Yifeng Jiang
Hi, You need to create your table with pre-split regions. $hbase org.apache.hadoop.hbase.util.RegionSplitter -c 10 -f region_name your_table This command will pre-create 10 regions in your table using MD5 strings as region boundaries. You can also customize the splitting algorithm. Please see

Re: HBase HDFS disk space usage

2012-05-07 Thread Yifeng Jiang
Hi Otis, This command might be what you want: hadoop fs -dus /hbase -Yifeng On May 7, 2012, at 11:41 AM, Otis Gospodnetic wrote: > Hello, > > Does HBase know how much space it is occupying on HDFS? > I looked at these two: > http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/regionserver/

Re: bulk load issues with negotiated timeout

2012-05-07 Thread Yifeng Jiang
Beside the HBase side configuration, you need to add the following to your ZOOKEEPER/conf/zoo.cfg, and then restart ZooKeeper will allow you to change the 40 secs. maxSessionTimeout= 12 Details can be found here. http://hadoop.apache.org/zookeeper/docs/current/zookeeperProgrammers.html#ch_zk

Re: HTable both enable and disable failed

2012-05-04 Thread Yifeng Jiang
That is okay. What do you get from the describe command? hbase> describe 'cjjWaitHash' -Yifeng On May 4, 2012, at 6:33 PM, Jiajun Chen wrote: > start and end is null , is that normal? > > cjjWaitHash,,1335522190862.4d0399bcdf15727b1cdf73abaec2e7f8. id: > 1335522190862 encoded_name: 4d0399bcdf15

Re: Hbase RegionServer could not resolve DNS name of master

2012-04-29 Thread Yifeng Jiang
Hi, > Master:/etc/hosts > 127.0.0.1 localhost > 127.0.0.1 master > > Slave1:/etc/hosts > 127.0.0.1 localhost > 127.0.0.1 slave1 If you DNS works well, you should not need to use hosts file. Can you remove master and slave1 record from your /etc/hosts file and then try a clean setup again? -Yife

Re: Exceptions with importtsv

2012-04-29 Thread Yifeng Jiang
Hi Sambit, Are you specifying a local file system path on the command line? Before invoking importtsv, you will need to copy your tsv files to HDFS at first. -Yifeng On Apr 27, 2012, at 6:08 PM, Sambit Tripathy wrote: > I am able to run this command but it goes on forever. I don't see any data

Re: Hadoop corrupt blocks after killing name node - during adding Hbase data

2012-01-10 Thread Yifeng Jiang
The NameNode keeps in safe mode might because it can not reach the block reported ratio threshold as some files are corrupted. You can use hadoop dfsadmin -safemode leave to leave safe mode at first, and then hadoop fsck / -move or -delete to move/delete inconsistent files. -Yifeng On Jan 10, 2

Re: What's the scenario of manual hlog splitting?

2011-12-26 Thread Yifeng Jiang
his farms work out the the nodes and > should significantly speedup up recovery in these scenarios. > > Jon. > > On Fri, Dec 23, 2011 at 6:59 PM, Yifeng Jiang wrote: > >> Hi, >> >> As mentioned in HBase Book, we can force a manual hlog splitting by: >>

What's the scenario of manual hlog splitting?

2011-12-23 Thread Yifeng Jiang
Hi, As mentioned in HBase Book, we can force a manual hlog splitting by: hbase org.apache.hadoop.hbase.regionserver.wal.HLog --split hdfs://example.org:8020/hbase/.logs/example.org,60020,1283516293161/ What's the use case of this manual splitting? If RS is crashed, the hlog splitting will be tri

Re: Filter for deprecated mapred APIs

2011-01-25 Thread Yifeng Jiang
Hi Stack, I have tested it using org.apache.hadoop.hbase.filte.PrefixFilter. And the result is same when using my own filter. So I created the following issue. Please check the details at here. https://issues.apache.org/jira/browse/HBASE-3477 Thanks. On 01/25/2011 02:44 PM, Yifeng Jiang wrote

Re: Filter for deprecated mapred APIs

2011-01-24 Thread Yifeng Jiang
/1/24 Yifeng Jiang: Hi, I has a MyFilter class extends FilterBase, and a MyInputFormat extends hbase.mapred.TableInputFormat, the deprecated mapred APIs. It seems that the filter will not be invoke when there are only a few data in the table. This is the code in my InputFormat's configure m

Filter for deprecated mapred APIs

2011-01-24 Thread Yifeng Jiang
er. Is there something wrong in my code? I'm using HBase0.90.0 and have put MyFilter in HBase's classpath. Thanks. -- Yifeng Jiang

Re: NullPointerException in ReplicationLogCleaner

2011-01-23 Thread Yifeng Jiang
LogCleaner is running without replication being enabled means that your hbase-default.xml is from an older version. Please refresh it. J-D 2011/1/20 Yifeng Jiang: Hi, I'm using HBase-0.90 and I found this exception in my HMaster's log. In ReplicationLogCleaner.java, it seems that th

NullPointerException in ReplicationLogCleaner

2011-01-20 Thread Yifeng Jiang
leaner.run(LogCleaner.java:167) Thanks -- Yifeng Jiang

Can I run HBase on Hadoop-0.20.2

2010-12-09 Thread Yifeng Jiang
? We don't have so many user yet now, so the version change of Hadoop is not so difficult. Thanks. -- Yifeng Jiang