Build failed in Jenkins: HBase-TRUNK-security #196

2012-05-08 Thread Apache Jenkins Server
See Changes: [stack] HBASE-5925 Issue with only using the old config param hbase.hstore.compactionThreshold but not the corresponding new one -- [...truncated 8336 lines...] Running org.apa

Re: modularizing trunk

2012-05-08 Thread Ted Yu
Thanks Jesse for the nice writeup. w.r.t. timing of integration of HBASE-4336, we should plan in advance. Currently there're several big patches pending checkin, e.g. HBASE-5732 (Remove the SecureRPCEngine and merge the security-related logic in the core engine). Such patches would need rebasing i

modularizing trunk

2012-05-08 Thread Jesse Yates
Hi devs, I'm just finishing up work on HBASE-4336- modularization of hbase - and am planning to work with Stack to commit the patch to trunk. If there are no objections, the planned refactor is on *May 23, 2012 (hbase hackathon).* *What does this

RE: HBase backup option

2012-05-08 Thread Vladimir Rodionov
Carlos, How did you achieve consistency? Are table snapshots consistent? If not, what are the odds to get something not recoverable? Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com

Build failed in Jenkins: HBase-0.92 #402

2012-05-08 Thread Apache Jenkins Server
See Changes: [stack] HBASE-5942 HConnnectionManager.getRegionServerWithRetries doesn't call afterCall properly -- [...truncated 1792 lines...] Running org.apache.hadoop.hbase.master.TestDistributedLog

Build failed in Jenkins: HBase-TRUNK #2857

2012-05-08 Thread Apache Jenkins Server
See Changes: [stack] HBASE-5925 Issue with only using the old config param hbase.hstore.compactionThreshold but not the corresponding new one -- [...truncated 8268 lines...] Running org.apache.hadoo

Re: HBase backup option

2012-05-08 Thread Jesse Yates
Cool stuff guys! This is pretty similar to what the FB guys did with their backup stuff. Using the WALPlayer is really nice though and solid docs. Have you taken a look at https://issues.apache.org/jira/browse/HBASE-5547? It might help with your backup M/R job (nit: not quite snapshot, but pretty

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-08 Thread Elliott Clark
14 machine 1 Master (nn 2nn jt hmaster) 13 slaves (dn tt rs) -> 4hhd's each with 2xQuad Core intel w/HT Sampling of Configs: -Xmx10G -XX:CMSInitiatingOccupancyFraction=75 -XX:NewSize=256m -XX:MaxNewSize=256m hbase.hregion.memstore.flush.size = 2147483648 hbase.hregion.max.filesize = 2147483648

Re: HBase backup option

2012-05-08 Thread Stack
On Tue, May 8, 2012 at 1:46 PM, Espinoza,Carlos wrote: > Hi, > > I was asked to mention this on the mailing list. At OCLC, we are working > towards moving our data to HBase. A huge requirement is to backup our > data, obviously, and seeing that this is still a work in progress, we > decided to wri

HBase backup option

2012-05-08 Thread Espinoza,Carlos
Hi, I was asked to mention this on the mailing list. At OCLC, we are working towards moving our data to HBase. A huge requirement is to backup our data, obviously, and seeing that this is still a work in progress, we decided to write something for ourselves. Using all the resources that we found

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-08 Thread lars hofhansl
Hmm... So our "performance release" is slightly slower than 0.92. With all the optimizations that went into 0.94 I find that a bit hard to believe. Can you tell us more about the testing? How many machines, setup, was that test IO or CPU bound, etc? Anything else of note? Thanks for doing this!

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-08 Thread Elliott Clark
Probably not. The number for on cluster are just so close that it looks like the only large differences in perf were on standalone installs. Since everywhere that talks about standalone talks about how it's not to be used as a basis for performance evaluation I think things are fine. 0.94 looks

RE: HBase Between Filters

2012-05-08 Thread sanky999
When using org.apache.hadoop.hbase.client.Increment api it allows to addColumn with Long value, but there is no way to do the same using org.apache.hadoop.hbase.client.Put api and when I tried adding Long values using Put api it stores in\x0 format but when I try to retrieve it, it prints as unkno

RE: HBase Between Filters

2012-05-08 Thread sanky999
@Anoop - Tried your suggestions too, no success. I mean stored values as bytes but int format now \x00\x00\x00\x17 but while filtering it goofs up and picks up incorrect data. -- View this message in context: http://apache-hbase.679495.n3.nabble.com/HBase-Between-Filters-tp3962242p3971107.html Se

RE: HBase Between Filters

2012-05-08 Thread sanky999
@RamKrishna - I have inserted records as integer but when I go for filtering them using filters it still gives wrong data, I just apply filters as mentioned that's how the records should be picked, but the filter goes for toss. -- View this message in context: http://apache-hbase.679495.n3.nabble

RE: HBase Between Filters

2012-05-08 Thread Ramkrishna.S.Vasudevan
Just adding on to Anoop's reply SingleColumnValueFilter filter1 = new SingleColumnValueFilter(Bytes.toBytes("TRAN"), Bytes.toBytes("TRAN_ID"), CompareFilter.CompareOp.GREATER, new BinaryComparator(Bytes.toBytes(1000))); filter1.setFilterIfMissing(true); filte

RE: HBase Between Filters

2012-05-08 Thread Anoop Sam John
@sanky "It still picks up record 120, 117... when given range is 1000-2000." How you have saved the int data value into HBase column? Have you not used Bytes.toBytes(int) ?? If you have used the same, the BinaryComparator would have worked fine I guess..