[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2018-09-20 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623041#comment-16623041 ] Lars Hofhansl commented on HBASE-13082: --- [~ram_krish] Above sounded a bit more whiny than

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2018-09-20 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622426#comment-16622426 ] ramkrishna.s.vasudevan commented on HBASE-13082: HBASE-20704 though I started seeing it

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2018-09-20 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622421#comment-16622421 ] ramkrishna.s.vasudevan commented on HBASE-13082: [~lhofhansl] I agree to your point that

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2018-09-20 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622352#comment-16622352 ] Andrew Purtell commented on HBASE-13082: bq. I don't like reference counting... In this case you

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2018-09-19 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621508#comment-16621508 ] Lars Hofhansl commented on HBASE-13082: --- Interestingly we just upgraded one of our clusters to

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-03-04 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181607#comment-15181607 ] Lars Hofhansl commented on HBASE-13082: --- [~ramkrishna.s.vasude...@gmail.com] [~anoop.hbase], Yep,

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-03-04 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181578#comment-15181578 ] ramkrishna.s.vasudevan commented on HBASE-13082: [~lhofhansl] In the current trunk and

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-03-04 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181541#comment-15181541 ] Anoop Sam John commented on HBASE-13082: So this means when there are parallel scanners, the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-03-04 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181406#comment-15181406 ] Lars Hofhansl commented on HBASE-13082: --- So I found a deceptively simple way of (1) avoiding the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-01-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114679#comment-15114679 ] Hudson commented on HBASE-13082: SUCCESS: Integrated in HBase-1.3-IT #460 (See

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-01-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114824#comment-15114824 ] Hudson commented on HBASE-13082: SUCCESS: Integrated in HBase-1.3 #513 (See

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113280#comment-15113280 ] Hudson commented on HBASE-13082: SUCCESS: Integrated in HBase-1.3 #509 (See

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113298#comment-15113298 ] Hudson commented on HBASE-13082: SUCCESS: Integrated in HBase-1.3-IT #454 (See

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110921#comment-15110921 ] Hudson commented on HBASE-13082: FAILURE: Integrated in HBase-1.3 #505 (See

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111600#comment-15111600 ] Hudson commented on HBASE-13082: SUCCESS: Integrated in HBase-1.3-IT #451 (See

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2016-01-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108407#comment-15108407 ] Hudson commented on HBASE-13082: FAILURE: Integrated in HBase-Trunk_matrix #645 (See

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048506#comment-15048506 ] ramkrishna.s.vasudevan commented on HBASE-13082: Oops. I need to prepare a patch for 1.3

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-04 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041432#comment-15041432 ] Anoop Sam John commented on HBASE-13082: Can we have it in 1.3 also? > Coarsen StoreScanner

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041873#comment-15041873 ] stack commented on HBASE-13082: --- Wahoo. +1 on 1.3. Probably too late for 1.2. > Coarsen StoreScanner

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041227#comment-15041227 ] Hudson commented on HBASE-13082: FAILURE: Integrated in HBase-Trunk_matrix #530 (See

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034534#comment-15034534 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033927#comment-15033927 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-01 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033578#comment-15033578 ] Anoop Sam John commented on HBASE-13082: sortCompactedfiles This is already been called on new

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033596#comment-15033596 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.sortCompactedfiles This is already

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-12-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033701#comment-15033701 ] ramkrishna.s.vasudevan commented on HBASE-13082: Changed the way isReferencedInREads is

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-29 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031384#comment-15031384 ] ramkrishna.s.vasudevan commented on HBASE-13082: Will commit this patch shortly. >

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027356#comment-15027356 ] stack commented on HBASE-13082: --- +1 Thanks [~ram_krish] StoreFileManager and StoreFileInfo all needs

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024811#comment-15024811 ] Hadoop QA commented on HBASE-13082: --- {color:green}+1 overall{color}. Here are the results of testing

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024368#comment-15024368 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.Could also have the method internally

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021943#comment-15021943 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq. Do it up here where compactedfiles

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023787#comment-15023787 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.Do you have to have 'Compacted' in

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-23 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023832#comment-15023832 ] stack commented on HBASE-13082: --- Nice explanation on compactedfiles bq.// Sorting may not be really

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-23 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023099#comment-15023099 ] stack commented on HBASE-13082: --- bq. The TTLCleaner works every 5 mins for the secondary region replica. So

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021609#comment-15021609 ] stack commented on HBASE-13082: --- bq. Oops. Latest comments. I will check them too. Thanks. Sorry. Done now

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-22 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021589#comment-15021589 ] ramkrishna.s.vasudevan commented on HBASE-13082: Oops. Latest comments. I will check them

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021607#comment-15021607 ] stack commented on HBASE-13082: --- You think we need to do checkFlushed(); on each seek call? Would doing

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021585#comment-15021585 ] stack commented on HBASE-13082: --- Looking at v14: Yeah, talk about how stuff is different now in the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-20 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015577#comment-15015577 ] ramkrishna.s.vasudevan commented on HBASE-13082: Thanks for the reviews Stack. bq. Need

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-20 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018970#comment-15018970 ] stack commented on HBASE-13082: --- bq. Will update the comment and say that 'these files are not included in

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015253#comment-15015253 ] ramkrishna.s.vasudevan commented on HBASE-13082: Did some JMH microbenchmark test by

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-19 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015321#comment-15015321 ] stack commented on HBASE-13082: --- bq. // Start the CompactedHFileCleaner here This is new? Where

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-19 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015281#comment-15015281 ] stack commented on HBASE-13082: --- An order of magnitude improvement * 2. Not bad [~ramkrishna]. Thanks for

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-16 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006602#comment-15006602 ] ramkrishna.s.vasudevan commented on HBASE-13082: Ping for reviews. !!!

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-11 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000264#comment-15000264 ] ramkrishna.s.vasudevan commented on HBASE-13082: Withpatch === Avg: 324secs

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-10 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1432#comment-1432 ] ramkrishna.s.vasudevan commented on HBASE-13082: Ping for reviews !! Will do some more

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996209#comment-14996209 ] Hadoop QA commented on HBASE-13082: --- {color:green}+1 overall{color}. Here are the results of testing

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14995572#comment-14995572 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14993688#comment-14993688 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-05 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991542#comment-14991542 ] ramkrishna.s.vasudevan commented on HBASE-13082: I just saw this {code} if

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-05 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992285#comment-14992285 ] Enis Soztutar commented on HBASE-13082: --- bq. In one of the test case - so may this is what I was

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-05 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14993245#comment-14993245 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.The locks are not the problem, it's

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-05 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991667#comment-14991667 ] Lars Hofhansl commented on HBASE-13082: --- bq. The volatile check is still a memory fence barrier

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-04 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990891#comment-14990891 ] Enis Soztutar commented on HBASE-13082: --- The volatile check is still a memory fence barrier similar

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-04 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990872#comment-14990872 ] Enis Soztutar commented on HBASE-13082: --- bq. HDFS does not allow to rename if there are any active

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-04 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991079#comment-14991079 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq. The way region replicas work is that

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-11-04 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991115#comment-14991115 ] ramkrishna.s.vasudevan commented on HBASE-13082: I think [~enis] your point makes sense.

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983917#comment-14983917 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982585#comment-14982585 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-30 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982561#comment-14982561 ] ramkrishna.s.vasudevan commented on HBASE-13082: After doing the code changes and testing

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-29 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980263#comment-14980263 ] ramkrishna.s.vasudevan commented on HBASE-13082: One interesting part while doing this is

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979769#comment-14979769 ] ramkrishna.s.vasudevan commented on HBASE-13082: Regarding the memstore files getting

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-20 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964695#comment-14964695 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.This status is in reader? It suits

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963297#comment-14963297 ] Anoop Sam John commented on HBASE-13082: So we wont reset the heap of the files during the scan.

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963400#comment-14963400 ] Anoop Sam John commented on HBASE-13082: Good doc explaining the change. bq. Along with the ref

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963502#comment-14963502 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.What about flush? Once the flush is

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964005#comment-14964005 ] stack commented on HBASE-13082: --- The one pager is great ([~lhofhansl]!). Nice summary of the issue up top.

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964031#comment-14964031 ] stack commented on HBASE-13082: --- bq. When we mark a file as compacted the confusion can be like whether

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963860#comment-14963860 ] ramkrishna.s.vasudevan commented on HBASE-13082: But again if handling flushes is a

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963858#comment-14963858 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.So we wont change the store file's

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964476#comment-14964476 ] Anoop Sam John commented on HBASE-13082: Not getting cells from bulk loaded files which is loaded

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964555#comment-14964555 ] Duo Zhang commented on HBASE-13082: --- I mean maybe we could have a fast path without locking for normal

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964567#comment-14964567 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.I mean maybe we could have a fast

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964536#comment-14964536 ] ramkrishna.s.vasudevan commented on HBASE-13082: We can rename the states to ACTIVE and

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964481#comment-14964481 ] Duo Zhang commented on HBASE-13082: --- {quote} On flush, what if we let all Scans complete before letting

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963561#comment-14963561 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.Because during flush the reads can

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963558#comment-14963558 ] Anoop Sam John commented on HBASE-13082: bq.But one thing may be to check is that if we open but

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-16 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961093#comment-14961093 ] ramkrishna.s.vasudevan commented on HBASE-13082: Next week beginning I will upload a one

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-16 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960548#comment-14960548 ] ramkrishna.s.vasudevan commented on HBASE-13082: https://reviews.apache.org/r/39393/- RB

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960851#comment-14960851 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-16 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960961#comment-14960961 ] stack commented on HBASE-13082: --- This is an important fix. I started to look at the rb and then got lost on

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958882#comment-14958882 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956369#comment-14956369 ] Hadoop QA commented on HBASE-13082: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-06 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946193#comment-14946193 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.So, bulk load won't show mid-scan...

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-06 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946198#comment-14946198 ] stack commented on HBASE-13082: --- bq. New files added by bulk load during an on going scan won't be included

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-06 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945926#comment-14945926 ] stack commented on HBASE-13082: --- bq. But in case of bulk loaded files, currently in between a scan if a new

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940078#comment-14940078 ] ramkrishna.s.vasudevan commented on HBASE-13082: bq.I'm a little late to the party but

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-09-29 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934759#comment-14934759 ] Lars Hofhansl commented on HBASE-13082: --- Feel free [~ram_krish]. I just happened to look at the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-09-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934576#comment-14934576 ] ramkrishna.s.vasudevan commented on HBASE-13082: Thanks Stack. Better to go ahead with

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-09-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934572#comment-14934572 ] ramkrishna.s.vasudevan commented on HBASE-13082: Any one planning to work on this. I am

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-09-28 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934574#comment-14934574 ] stack commented on HBASE-13082: --- Please bring it home [~ram_krish] Its an important one. > Coarsen

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-05-29 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564821#comment-14564821 ] Anoop Sam John commented on HBASE-13082: [~larsh] are you working on the idea of

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-05-29 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565613#comment-14565613 ] Lars Hofhansl commented on HBASE-13082: --- I am backed up at the moment, would love

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-04-20 Thread Jonathan Lawlor (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503889#comment-14503889 ] Jonathan Lawlor commented on HBASE-13082: - I'm a little late to the party but

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-04-20 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504350#comment-14504350 ] Lars Hofhansl commented on HBASE-13082: --- Correct. No more locking other than to fix

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-03-24 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377564#comment-14377564 ] Anoop Sam John commented on HBASE-13082: If scanners can continue read from the

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-03-24 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378784#comment-14378784 ] stack commented on HBASE-13082: --- I ran this patch on my rig and see ~6-7% more throughput

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-03-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378969#comment-14378969 ] Lars Hofhansl commented on HBASE-13082: --- Thanks [~stack]. That's with 1000 bytes

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-03-24 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379236#comment-14379236 ] stack commented on HBASE-13082: --- Sorry.. average size about 180k rows. So, yeah, probably

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-03-24 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379235#comment-14379235 ] stack commented on HBASE-13082: --- [~lhofhansl] 10 columns zipfian sized from 0 to 8k.

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-03-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378169#comment-14378169 ] Lars Hofhansl commented on HBASE-13082: --- Exactly. Logically it's relatively simple.

  1   2   >