[ https://issues.apache.org/jira/browse/HBASE-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13809791#comment-13809791 ]
Enis Soztutar commented on HBASE-8541: -------------------------------------- forwarding my +1 from RB. > implement flush-into-stripes in stripe compactions > -------------------------------------------------- > > Key: HBASE-8541 > URL: https://issues.apache.org/jira/browse/HBASE-8541 > Project: HBase > Issue Type: Sub-task > Reporter: Sergey Shelukhin > Assignee: Sergey Shelukhin > Attachments: HBASE-8541-latest-with-dependencies.patch, > HBASE-8541-latest-with-dependencies.patch, > HBASE-8541-latest-with-dependencies.patch, > HBASE-8541-latest-with-dependencies.patch, HBASE-8541-v0.patch, > HBASE-8541-v1.patch, HBASE-8541-v2.patch, HBASE-8541-v3.patch, > HBASE-8541-v4.patch, HBASE-8541-v5.patch > > > Flush will be able to flush into multiple files under this design, avoiding > L0 I/O amplification. > I have the patch which is missing just one feature - support for concurrent > flushes and stripe changes. This can be done via extensive try-locking of > stripe changes and flushes, or advisory flags without blocking flushes, > dumping conflicting flushes into L0 in case of (very rare) collisions. For > file loading for the latter, a set-cover-like problem needs to be solved to > determine optimal stripes. That will also address Jimmy's concern of getting > rid of metadata, btw. However currently I don't have time for that. I plan to > attach the try-locking patch first, but this won't happen for a couple weeks > probably and should not block main reviews. Hopefully this will be added on > top of main reviews. -- This message was sent by Atlassian JIRA (v6.1#6144)