Re: some region Could not seek StoreFileScanner[HFileScanner for reader

2012-04-20 Thread 永江梁
hi Jonathan Hsieh: en, that file is not exist. now, every time i scan these failed row, it will throw the error, then the scanner wiil timeout. how i can fix the problem. use the table compact can be work? 在 2012年4月21日 上午12:43,Jonathan Hsieh 写道: > Yongjiang, > > Seems to be somethin

Kundera 2.0.6 Released

2012-04-20 Thread Amresh Kumar Singh
Hi All, We are happy to announce release of Kundera 2.0.6. Kundera is a JPA 2.0 based, object-datastore papping library for NoSQL datastores. The idea behind Kundera is to make working with NoSQL Databases drop-dead simple and fun. It currently supports Cassandra, HBase, MongoDB and relational

Re: HBase Cyclic Replication Issue: some data are missing in the replication for intensive write

2012-04-20 Thread lars hofhansl
I see. Does this only happen when cyclic replication is enabled in this way (i.e. master <-> master replication). The replication back does take some overhead as the replicator needs to filter edits from being replication back to the originator, but I would not have thought that would cause any

Re: HBase Cyclic Replication Issue: some data are missing in the replication for intensive write

2012-04-20 Thread Jerry Lam
Hi Lars: I'm using hbase 0.92.1 and Hadoop 1.0.1. Yes, you are right. I'm replicating from cluster A to cluster B only with cyclic replication configured. Eventually I will test replicating cluster A to cluster B and vice versa with high intensive write workload but if this replication doesn't

Re: HBase Cyclic Replication Issue: some data are missing in the replication for intensive write

2012-04-20 Thread Jerry Lam
Hi Himanshu: I'm using hbase 0.92.1 and hadoop 1.0.1 migrating from hbase 0.90.4 and Hadoop 0.20 with append feature. It is a one side replication (cluster A to cluster B) with cyclic replication enabled (i.e. add_peer of the other cluster configured). Best Regards, Jerry Sent from my iPad

Re: HBase Cyclic Replication Issue: some data are missing in the replication for intensive write

2012-04-20 Thread Ted Yu
Jerry: Currently TestReplicationPeer and TestReplication don't involve load balancing scenario. If you can write a test where load balancer re-assigns some regions, that would help us pinpoint the problem. Cheers On Fri, Apr 20, 2012 at 12:34 PM, lars hofhansl wrote: > Hi Jerry, > > which versi

Re: Compare range of numbers on column family

2012-04-20 Thread anil gupta
> put 'innar_demo', 'PK.akbar.20120418', 'alternateKey:city', 'Ahmedabad' > put 'innar_demo', 'PK.akbar.20120418', 'alternateKey:phone', '0002' > put 'innar_demo', 'PK.akbar.20120418', 'a

Re: HBase Cyclic Replication Issue: some data are missing in the replication for intensive write

2012-04-20 Thread lars hofhansl
Hi Jerry, which version of HBase are you using? You are not using cyclic backup, that needs >2 clusters. I assume you're just replicating from one cluster to another, right? There is never data loss in Cluster A? -- Lars - Original Message - From: Jerry Lam To: user@hbase.apache.org

Re: some region Could not seek StoreFileScanner[HFileScanner for reader

2012-04-20 Thread Jonathan Hsieh
Yongjiang, Seems to be something wrong with this file. Is it present? 2012/4/18 永江梁 ... > Caused by: java.io.IOException: Cannot open filename > /hbase/csmt.table/340943837/meta/6858363498326682689 > > If so, are you using permissions on your hdfs cluster? Can you check out this file to see if

Re: Storing extremely large size file

2012-04-20 Thread Brock Noland
This should be about right: Configuration conf = new Configuration(); FileSystem fs = FileSystem.get(conf); OutputStream os = fs.create(new Path("/images/img.jpg")); os.write()... os.close(); Or even: Configuration conf = new Configuration(); FileSystem fs = FileSystem.get(conf); fs.copyFromLoca

Re: HBase Cyclic Replication Issue: some data are missing in the replication for intensive write

2012-04-20 Thread Himanshu Vashishtha
Hello Jerry, Which HBase version? You are not "using" cyclic replication? Its simple one side replication, right? Thanks, Himanshu On Fri, Apr 20, 2012 at 5:38 AM, Jerry Lam wrote: > Hi HBase community: > > We have been testing cyclic replication for 1 week. The basic functionality > seems to

HBase Cyclic Replication Issue: some data are missing in the replication for intensive write

2012-04-20 Thread Jerry Lam
Hi HBase community: We have been testing cyclic replication for 1 week. The basic functionality seems to work as described in the document however when we started to increase the write workload, the replication starts to miss data (i.e. some data are not replicated to the other cluster). We hav

Re: Storing extremely large size file

2012-04-20 Thread vishnupriyaa
Hi Brock, I am new to hbase ,can you help me with some sort of code to store directly in HDFS. Brock Noland-2 wrote: > > Hi, > > Any reason you cannot have an exception marker for large files and > then store them directly in HDFS? > > Brock > > On Tue, Apr 17, 2012 at 1:06 PM, vishnupriyaa

RE: Compare range of numbers on column family

2012-04-20 Thread Bijieshan
;, 'PK.akbar.20120418', 'alternateKey:city', 'Ahmedabad' put 'innar_demo', 'PK.akbar.20120418', 'alternateKey:phone', '0002' put 'innar_demo', 'PK.akbar.20120418', 'alternateKey:ms', '2000'