Re: Re: Creation of Hfiles for multiple tables using Single Bulk Load Job?

2011-10-30 Thread Christopher Dorner
Hi, i am facing a similar problem. I Need to read a large file to put into different hbase tables. Until now i have done it with MultiTableOutputFormat directly from the Mapper. Thats works ok, but i believe it will become quite slow when i try larger files. But I thought it is a good chance

Region has been OPENING for too long

2011-10-30 Thread Matthew Tovbin
Hi guys, I've bulkloaded a solid amount of data (650GB, ~14000 files) into Hbase (1master + 3regions) and now enabling the table results the following behavior on the cluster: 1. Master says that opening started - "org.apache.hadoop.hbase.master.AssignmentManager: Handling transitio

Re: Region has been OPENING for too long

2011-10-30 Thread Ted Yu
I assume you're using HBase 0.90.x where HBASE-4015 isn't available. >> 5. And so on, till some of Slaves fail with "java.net.SocketException: Too many open files". Do you have some monitoring setup so that you can know the number of open file handles ? Cheers On Sun, Oct 30, 2011 at 7:21 AM, Ma

Re: async HBase

2011-10-30 Thread tsuna
On Thu, Oct 27, 2011 at 4:24 PM, Jignesh Patel wrote: > How efficient it is to use asynch HBase for the performance improvement so > that it can be used for accepting real time request from the online web > application? > https://github.com/stumbleupon/asynchbase You might wanna ask people on the

Remove single bulkLoadHFile method from HRegionInterface

2011-10-30 Thread Ted Yu
>From Todd's comment for HBASE-4677: I don't think we need to deprecate this before removal, because IMO HRegionInterface is not a public API. Users should only be using the public interfaces like HTable, LoadIncrementalHFiles, etc. There is no real legitimate use to directly access the HRI API. S

Hmaster can't start for the latest trunk version

2011-10-30 Thread Gaojinchao
The latest trunk version. Throw this logs: 2011-10-31 00:09:09,549 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown. java.io.FileNotFoundException: File does not exist: hdfs://C3S31:9000/hbase at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStat

Deployments of HBase with Hadoop 0.20.205?

2011-10-30 Thread Francis Christopher Liu
Hi, We're interested in deploying Hbase with hadoop .205 in our sandbox environment. Has anyone tried sizable deployments of hbase with Hadoop 0.20.205? What are your experiences? Thanks, Francis

Re: Hmaster can't start for the latest trunk version

2011-10-30 Thread Harsh J
Hi Gaojinchao, -user (bcc) +dev This appears to be due to https://issues.apache.org/jira/browse/HBASE-4680 (and also HBASE-4510 which sourced the whole issue), and is caused by the fact that /hbase doesn't exist yet when you first start it up. I've filed https://issues.apache.org/jira/browse/H