[jira] [Updated] (HBASE-17373) Reverse the order of snapshot creation in the CompactingMemStore

2016-12-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17373: -- Assignee: Eshcar Hillel Status: Patch Available (was: Open) > Reverse the order of

[jira] [Commented] (HBASE-17373) Reverse the order of snapshot creation in the CompactingMemStore

2016-12-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782585#comment-15782585 ] Eshcar Hillel commented on HBASE-17373: --- [~ted_yu] patch is attached, and also a link to review

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operation

2016-12-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783540#comment-15783540 ] Eshcar Hillel commented on HBASE-17339: --- We can use existing TRT, no need for a new one. Only need

[jira] [Comment Edited] (HBASE-17339) Scan-Memory-First Optimization for Get Operation

2016-12-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783540#comment-15783540 ] Eshcar Hillel edited comment on HBASE-17339 at 12/28/16 7:19 PM: - We can

[jira] [Assigned] (HBASE-17081) Flush the entire CompactingMemStore content to disk

2016-12-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel reassigned HBASE-17081: - Assignee: Eshcar Hillel (was: Anastasia Braginsky) > Flush the entire

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operation

2016-12-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15780373#comment-15780373 ] Eshcar Hillel commented on HBASE-17339: --- Thanks [~yangzhe1991] for your suggestion. I agree that a

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization

2016-12-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Attachment: HBASE-17339-V01.patch > Scan-Memory-First Optimization >

[jira] [Updated] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17407: -- Status: Patch Available (was: Open) > Correct update of maxFlushedSeqId in HRegion >

[jira] [Updated] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17407: -- Attachment: HBASE-17407-V01.patch > Correct update of maxFlushedSeqId in HRegion >

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-03-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Attachment: read-latency-mixed-workload.jpg > Scan-Memory-First Optimization for Get

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-03-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942225#comment-15942225 ] Eshcar Hillel commented on HBASE-17339: --- I am attaching results of an experiment with mixed

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-03-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Attachment: HBASE-17339-V06.patch > Scan-Memory-First Optimization for Get Operations >

[jira] [Commented] (HBASE-17765) Reviving the merge possibility in the CompactingMemStore

2017-03-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942179#comment-15942179 ] Eshcar Hillel commented on HBASE-17765: --- I added a minor comment on RB to extract the threshold

[jira] [Commented] (HBASE-17633) Update unflushed sequence id in SequenceIdAccounting after flush with the minimum sequence id in memstore

2017-03-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15943123#comment-15943123 ] Eshcar Hillel commented on HBASE-17633: --- [~Apache9] can you please post a link to the RB, thanks.

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-03-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15943102#comment-15943102 ] Eshcar Hillel commented on HBASE-17339: --- Yes, sure I can run with your patch [~ben.manes] :) I just

[jira] [Commented] (HBASE-17633) Update unflushed sequence id in SequenceIdAccounting after flush with the minimum sequence id in memstore

2017-03-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15943252#comment-15943252 ] Eshcar Hillel commented on HBASE-17633: --- (y) > Update unflushed sequence id in

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-03-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V08.patch > Removing MemStoreScanner and SnapshotScanner >

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932319#comment-15932319 ] Eshcar Hillel commented on HBASE-16417: --- bq. I don't get why reading from multiple indices ups our

[jira] [Commented] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-03-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932474#comment-15932474 ] Eshcar Hillel commented on HBASE-17655: --- Thank [~ram_krish] I will rebase later today and re-run

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932430#comment-15932430 ] Eshcar Hillel commented on HBASE-16417: --- I can use the code of HBASE-17655 to run the mixed

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417-benchmarkresults-20170317.pdf > In-Memory MemStore Policy for

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929565#comment-15929565 ] Eshcar Hillel commented on HBASE-16417: --- Updated benchmarks report. You can see in Figure 8 that

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417-benchmarkresults-20170309.pdf > In-Memory MemStore Policy for

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903176#comment-15903176 ] Eshcar Hillel commented on HBASE-16417: --- NEW BENCHMARKS RESULTS ARE ATTACHED!!! We focus on small

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904985#comment-15904985 ] Eshcar Hillel commented on HBASE-16417: --- We already ran some experiments with merge with really

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888755#comment-15888755 ] Eshcar Hillel commented on HBASE-16417: --- I am running YCSB, size of values is set to 100B. I

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V06.patch > Removing MemStoreScanner and SnapshotScanner >

[jira] [Commented] (HBASE-18375) The pool chunks from ChunkCreator are deallocated while in pool because there is no reference to them

2017-08-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121672#comment-16121672 ] Eshcar Hillel commented on HBASE-18375: --- lgtm left some comments in review board +1 > The pool

[jira] [Commented] (HBASE-18294) Flush is based on data size instead of heap size

2017-07-02 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071594#comment-16071594 ] Eshcar Hillel commented on HBASE-18294: --- Considering heap size for triggering global heap pressure

[jira] [Commented] (HBASE-18294) Flush is based on data size instead of heap size

2017-07-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073265#comment-16073265 ] Eshcar Hillel commented on HBASE-18294: --- bq. We should change the 128 MB flush size default value

[jira] [Commented] (HBASE-18294) Flush is based on data size instead of heap size

2017-07-03 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072467#comment-16072467 ] Eshcar Hillel commented on HBASE-18294: --- The per-cell metadata overhead with basic compaction is

[jira] [Commented] (HBASE-18010) Connect CellChunkMap to be used for flattening in CompactingMemStore

2017-07-05 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074450#comment-16074450 ] Eshcar Hillel commented on HBASE-18010: --- lgtm +1 > Connect CellChunkMap to be used for flattening

[jira] [Created] (HBASE-18294) Flush policy checks data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-18294: - Summary: Flush policy checks data size instead of heap size Key: HBASE-18294 URL: https://issues.apache.org/jira/browse/HBASE-18294 Project: HBase Issue

[jira] [Commented] (HBASE-18294) Flush policy checks data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068102#comment-16068102 ] Eshcar Hillel commented on HBASE-18294: --- While benchmarking, we noticed the number of flushes in

[jira] [Commented] (HBASE-18294) Flush policy checks data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068379#comment-16068379 ] Eshcar Hillel commented on HBASE-18294: --- Currently the total memstore size in a region also

[jira] [Updated] (HBASE-18294) Flush is based on data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Summary: Flush is based on data size instead of heap size (was: Flush policy checks data size

[jira] [Updated] (HBASE-18294) Flush is based on data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Description: A region is flushed if its memory component exceed a threshold (default size is

[jira] [Commented] (HBASE-17343) Make Compacting Memstore default in 2.0 with BASIC as the default type

2017-04-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15984401#comment-15984401 ] Eshcar Hillel commented on HBASE-17343: --- +1 from me once QA passes. @anoop, nice performance

[jira] [Commented] (HBASE-17343) Make Compacting Memstore default in 2.0 with BASIC as the default type

2017-04-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15984658#comment-15984658 ] Eshcar Hillel commented on HBASE-17343: --- I understand -- thanks for explaining. If indeed the

[jira] [Commented] (HBASE-17343) Make Compacting Memstore default in 2.0 with BASIC as the default type

2017-04-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15984627#comment-15984627 ] Eshcar Hillel commented on HBASE-17343: --- but can you explain how your change fixes the problem? >

[jira] [Commented] (HBASE-17343) Make Compacting Memstore default in 2.0 with BASIC as the default type

2017-04-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15984588#comment-15984588 ] Eshcar Hillel commented on HBASE-17343: --- bq. I just did a change here like 1st I change the size

[jira] [Commented] (HBASE-16436) Add the CellChunkMap variant

2017-05-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006448#comment-16006448 ] Eshcar Hillel commented on HBASE-16436: --- Reviewed the code +1 here > Add the CellChunkMap variant

[jira] [Commented] (HBASE-18056) Change CompactingMemStore in BASIC mode to merge multiple segments in pipeline

2017-05-21 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018768#comment-16018768 ] Eshcar Hillel commented on HBASE-18056: --- I think we are missing the point here. The original need

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-06-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033707#comment-16033707 ] Eshcar Hillel commented on HBASE-17339: --- After some time away from this Jira, and some additional

[jira] [Commented] (HBASE-18010) Connect CellChunkMap to be used for flattening in CompactingMemStore

2017-06-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16050263#comment-16050263 ] Eshcar Hillel commented on HBASE-18010: --- I left some comments on review board, will continue

[jira] [Commented] (HBASE-18010) Connect CellChunkMap to be used for flattening in CompactingMemStore

2017-06-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053700#comment-16053700 ] Eshcar Hillel commented on HBASE-18010: --- In RB I am suggesting to use a cell set factory

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.02.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417-V01.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191144#comment-16191144 ] Eshcar Hillel commented on HBASE-16417: --- After a long period of time we experimented with different

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Status: Patch Available (was: Open) > In-Memory MemStore Policy for Flattening and

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417 - parameter tuning - 20171001.pdf > In-Memory MemStore Policy for

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417 - Adaptive Compaction Policy - 20171001.pdf > In-Memory MemStore

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Fix Version/s: (was: 2.0.0) 3.0.0 > In-Memory MemStore Policy for

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.01.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198545#comment-16198545 ] Eshcar Hillel commented on HBASE-16417: --- bq. So ur tests are with MSLAB feature turned OFF right?

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-16 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.04.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.05.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207679#comment-16207679 ] Eshcar Hillel commented on HBASE-16417: --- QA passed. Any additional comments or questions? If no

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-07 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195745#comment-16195745 ] Eshcar Hillel commented on HBASE-16417: --- Thanks all for your questions. bq. Can this go into

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.03.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Description: This Jira explores the performance of different memstore compaction policies. It

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.08.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.09.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Status: Patch Available (was: Open) > In-Memory MemStore Policy for Flattening and

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Status: Open (was: Patch Available) > In-Memory MemStore Policy for Flattening and

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208246#comment-16208246 ] Eshcar Hillel commented on HBASE-16417: --- bq. I do have concern over the 2% size threshold to make

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.06.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.07.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.07.patch > In-Memory MemStore Policy for Flattening and Compactions >

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Status: Patch Available (was: Open) > In-Memory MemStore Policy for Flattening and

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-10-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Status: Open (was: Patch Available) > In-Memory MemStore Policy for Flattening and

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Affects Version/s: 3.0.0 Status: Patch Available (was: Open) Attaching an

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.01.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.02.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253139#comment-16253139 ] Eshcar Hillel commented on HBASE-18294: --- Attaching a new patch with region level counters and

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268647#comment-16268647 ] Eshcar Hillel commented on HBASE-18294: --- I think I understand where our different view stem from.

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265945#comment-16265945 ] Eshcar Hillel commented on HBASE-18294: --- Ram and Anoop, the reason we see so much heap global

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-23 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264459#comment-16264459 ] Eshcar Hillel commented on HBASE-18294: --- I am back with some numbers. First, I noticed that master

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.07.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Summary: Reduce global heap pressure: flush based on heap occupancy (was: Flush is based on

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Issue Type: Improvement (was: Bug) > Reduce global heap pressure: flush based on heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.06.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258493#comment-16258493 ] Eshcar Hillel commented on HBASE-18294: --- A new patch is available, also on RB. Added a new region

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.05.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Commented] (HBASE-19288) Intermittent test failure in TestHStore.testRunDoubleMemStoreCompactors

2017-11-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258430#comment-16258430 ] Eshcar Hillel commented on HBASE-19288: --- I agree setting the in-memory flush factor to 0.25 in this

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259239#comment-16259239 ] Eshcar Hillel commented on HBASE-18294: --- With the new property the user is not obligated to set

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259214#comment-16259214 ] Eshcar Hillel commented on HBASE-18294: --- [~anoopsamjohn] I hope you don't mind I'm adding your

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.03.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-16 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.04.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-11-16 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255021#comment-16255021 ] Eshcar Hillel commented on HBASE-18294: --- Third rebase... hope this time it works !! > Reduce

[jira] [Commented] (HBASE-19095) Add CP hooks in RegionObserver for in memory compaction

2017-11-05 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239437#comment-16239437 ] Eshcar Hillel commented on HBASE-19095: --- I already reviewed the code last week. All hooks seem to

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-11-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417.branch-2.17.patch > In-Memory MemStore Policy for Flattening and

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-11-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233729#comment-16233729 ] Eshcar Hillel commented on HBASE-16417: --- QA passed, committing this patch. Thanks all reviews and

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-11-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234101#comment-16234101 ] Eshcar Hillel commented on HBASE-16417: --- Test failures are unrelated (in replication package).

[jira] [Commented] (HBASE-18294) Flush is based on data size instead of heap size

2017-11-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245388#comment-16245388 ] Eshcar Hillel commented on HBASE-18294: --- bq. How would the off-heap threshold be determined ? This

[jira] [Commented] (HBASE-18294) Flush is based on data size instead of heap size

2017-11-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243816#comment-16243816 ] Eshcar Hillel commented on HBASE-18294: --- Last thing I wrote in the developer thread: bq. Here is a

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-11-02 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Fix Version/s: 2.0.0 Release Note: A new memstore compaction policy: Adaptive. Adaptive

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-11-02 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Resolution: Resolved Status: Resolved (was: Patch Available) > In-Memory MemStore

[jira] [Commented] (HBASE-19095) Add CP hooks in RegionObserver for in memory compaction

2017-10-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223956#comment-16223956 ] Eshcar Hillel commented on HBASE-19095: --- The current default is the Basic in-memory compaction

[jira] [Commented] (HBASE-19095) Add CP hooks in RegionObserver for in memory compaction

2017-10-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224011#comment-16224011 ] Eshcar Hillel commented on HBASE-19095: --- Indeed currently

<    1   2   3   4   5   6   7   8   >