Re: Fwd:

2018-05-02 Thread ramkrishna vasudevan
Regarding the read flow this is what happens 1) Create a region level scanner 2) the region level scanner can comprise of more than one store scanner (each store scanner works on one column family). 3) Every store scanner wil comprise of memstore scanner and a set of hfile scanners (based on

[jira] [Created] (HBASE-20523) PE tool should support configuring client side buffering sizes

2018-05-02 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created HBASE-20523: -- Summary: PE tool should support configuring client side buffering sizes Key: HBASE-20523 URL: https://issues.apache.org/jira/browse/HBASE-20523

Re: Fwd:

2018-05-02 Thread Xi Yang
Hi Tim, Thanks for confirm the question. That question confused me for a long time. Really appreciate. About another question, I still don't know whether ModelA is correct or Model B is correct. Still confused Thanks, Alex 2018-05-02 13:53 GMT-07:00 Tim Robertson

[jira] [Created] (HBASE-20522) Maven artifacts for HBase 2 are not available at maven central

2018-05-02 Thread JIRA
Ismaël Mejía created HBASE-20522: Summary: Maven artifacts for HBase 2 are not available at maven central Key: HBASE-20522 URL: https://issues.apache.org/jira/browse/HBASE-20522 Project: HBase

[jira] [Created] (HBASE-20521) TableOutputFormat.checkOutputSpecs conf checking sequence cause pig script fails

2018-05-02 Thread Michael Jin (JIRA)
Michael Jin created HBASE-20521: --- Summary: TableOutputFormat.checkOutputSpecs conf checking sequence cause pig script fails Key: HBASE-20521 URL: https://issues.apache.org/jira/browse/HBASE-20521

Re: Fwd:

2018-05-02 Thread Tim Robertson
Thanks Alex, Yes, looking at that code I believe you are correct - the memStore scanner is appended after the block scanners. The block scanners may or may not see hits in the block cache when they read. If they don't get a hit, they'll open the block from the underlying HFile(s). On Wed, May

Re: Fwd:

2018-05-02 Thread Xi Yang
Hi Tim, Thank you for detailed explanation. Yes, that really helps me! I really appreciate it! But I still confused about the sequence: I've read these codes in *HStore.getScanners* : *// TODO this used to get the store files in descending order,* *// but now we get them in ascending

[jira] [Created] (HBASE-20520) Failed effort upping default HDFS blocksize, hbase.regionserver.hlog.blocksize

2018-05-02 Thread stack (JIRA)
stack created HBASE-20520: - Summary: Failed effort upping default HDFS blocksize, hbase.regionserver.hlog.blocksize Key: HBASE-20520 URL: https://issues.apache.org/jira/browse/HBASE-20520 Project: HBase

[jira] [Created] (HBASE-20519) [Chaos] Add more chaos options

2018-05-02 Thread stack (JIRA)
stack created HBASE-20519: - Summary: [Chaos] Add more chaos options Key: HBASE-20519 URL: https://issues.apache.org/jira/browse/HBASE-20519 Project: HBase Issue Type: Umbrella Components:

Re: Snapshotted files after compactions

2018-05-02 Thread Josh Elser
I might be wrong, but I don't think the HFileLink is used in the case that you're asking about. I think for your situation (file no longer exists in data/, but is now in archive/), HBase knows how to find this file purely by knowing tableName, colfam, region, and file name and checking in

[jira] [Created] (HBASE-20518) Need to serialize the enabled field for UpdatePeerConfigProcedure

2018-05-02 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-20518: - Summary: Need to serialize the enabled field for UpdatePeerConfigProcedure Key: HBASE-20518 URL: https://issues.apache.org/jira/browse/HBASE-20518 Project: HBase

Re: Fwd:

2018-05-02 Thread Tim Robertson
Hi Alex, I'm not sure I fully follow your question without the images but I'll try and help. When a read request comes in, my understanding of the order of execution is as follows (perhaps someone can verify this): 1) It looks in the block cache for the cells (this is a read only cache

Re: Fwd:

2018-05-02 Thread Xi Yang
OK, I got it. I've understood the Q2 by your help, thanks! Seems like I have to use some other way to draw my images, Here is the updated version Q1: Q1 I found that HFileScannerImpl.getCachedBlock(...) get block from BlockCache. This CachedBlock is used by StoreFileScanner. Is that mean the