[ 
https://issues.apache.org/jira/browse/HBASE-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13814837#comment-13814837
 ] 

Hudson commented on HBASE-8541:
-------------------------------

SUCCESS: Integrated in HBase-TRUNK #4670 (See 
[https://builds.apache.org/job/HBase-TRUNK/4670/])
HBASE-8541 implement flush-into-stripes in stripe compactions (sershe: rev 
1539211)
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreFileManager.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreFlusher.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileManager.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StripeMultiFileWriter.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StripeStoreConfig.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StripeStoreEngine.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StripeStoreFileManager.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StripeStoreFlusher.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/StripeCompactionPolicy.java
* 
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStripeCompactor.java
* 
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStripeStoreFileManager.java
* 
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/compactions/TestStripeCompactionPolicy.java


> implement flush-into-stripes in stripe compactions
> --------------------------------------------------
>
>                 Key: HBASE-8541
>                 URL: https://issues.apache.org/jira/browse/HBASE-8541
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HBASE-8541-latest-with-dependencies.patch, 
> HBASE-8541-latest-with-dependencies.patch, 
> HBASE-8541-latest-with-dependencies.patch, 
> HBASE-8541-latest-with-dependencies.patch, HBASE-8541-v0.patch, 
> HBASE-8541-v1.patch, HBASE-8541-v2.patch, HBASE-8541-v3.patch, 
> HBASE-8541-v4.patch, HBASE-8541-v5.patch
>
>
> Flush will be able to flush into multiple files under this design, avoiding 
> L0 I/O amplification.
> I have the patch which is missing just one feature - support for concurrent 
> flushes and stripe changes. This can be done via extensive try-locking of 
> stripe changes and flushes, or advisory flags without blocking flushes, 
> dumping conflicting flushes into L0 in case of (very rare) collisions. For 
> file loading for the latter, a set-cover-like problem needs to be solved to 
> determine optimal stripes. That will also address Jimmy's concern of getting 
> rid of metadata, btw. However currently I don't have time for that. I plan to 
> attach the try-locking patch first, but this won't happen for a couple weeks 
> probably and should not block main reviews. Hopefully this will be added on 
> top of main reviews.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to