[ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395713#comment-15395713 ]
Eshcar Hillel commented on HBASE-14921: --------------------------------------- We are trying to reproduce the PE results you reported [~anoop.hbase] and [~ram_krish], and we need your help with the following questions: 1. What is the exact cluster configuration you are running on? Is it a single machine hosting both the master and 1 RS? What is the setting of the underlying HDFS? Again NN and 1 DN on the same machine? 2. --inmemoryCompaction flag you are using in PE is not in master? Can you open a Jira to share the patch with this supplement so we don't need to re-implement this or even better commit this code to master. 3. How much time the experiment is expected to run (approximately)? One major drawback of the PE tool is that it does not allow to benchmark concurrent reads and writes. Once we are able to test 100% writes and have results for all settings we should also compare the 50%-50% workload. But we can discuss this when we get there. > Memory optimizations > -------------------- > > Key: HBASE-14921 > URL: https://issues.apache.org/jira/browse/HBASE-14921 > Project: HBase > Issue Type: Sub-task > Affects Versions: 2.0.0 > Reporter: Eshcar Hillel > Assignee: Anastasia Braginsky > Attachments: CellBlocksSegmentInMemStore.pdf, > CellBlocksSegmentinthecontextofMemStore(1).pdf, HBASE-14921-V01.patch, > HBASE-14921-V02.patch, HBASE-14921-V03.patch, HBASE-14921-V04-CA-V02.patch, > HBASE-14921-V04-CA.patch, HBASE-14921-V05-CAO.patch, > HBASE-14921-V06-CAO.patch, InitialCellArrayMapEvaluation.pdf, > IntroductiontoNewFlatandCompactMemStore.pdf, NewCompactingMemStoreFlow.pptx > > > Memory optimizations including compressed format representation and offheap > allocations -- This message was sent by Atlassian JIRA (v6.3.4#6332)