[jira] [Commented] (HBASE-14496) Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy

2016-03-03 Thread Vladimir Rodionov (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179255#comment-15179255
 ] 

Vladimir Rodionov commented on HBASE-14496:
---

{quote}
What if memory pressure causes many small flushes? How does this interact with 
the max number of store files?
{quote}

Should be increased from default value.

> Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy
> -
>
> Key: HBASE-14496
> URL: https://issues.apache.org/jira/browse/HBASE-14496
> Project: HBase
>  Issue Type: New Feature
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-14496.v1.patch, HBASE-14496.v2.patch
>
>
> Delayed compaction feature for RatioBasedCompactionPolicy allows to specify 
> maximum compaction delay for newly created store files. Files will be 
> eligible for compaction only if their age exceeds this delay. This will allow 
> to preserve new data in a block cache. For most applications, the newer the 
> data is the more frequently it is accessed. The frequent compactions of a new 
> store files result in high block cache churn rate and affects read 
> performance and read latencies badly. 
> The configuration will be global, per table, per column family.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HBASE-14496) Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy

2016-03-03 Thread Hadoop QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179216#comment-15179216
 ] 

Hadoop QA commented on HBASE-14496:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 4s {color} 
| {color:red} HBASE-14496 does not apply to master. Rebase required? Wrong 
Branch? See https://yetus.apache.org/documentation/latest/precommit-patchnames 
for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12767143/HBASE-14496.v2.patch |
| JIRA Issue | HBASE-14496 |
| Powered by | Apache Yetus 0.1.0   http://yetus.apache.org |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/827/console |


This message was automatically generated.



> Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy
> -
>
> Key: HBASE-14496
> URL: https://issues.apache.org/jira/browse/HBASE-14496
> Project: HBase
>  Issue Type: New Feature
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-14496.v1.patch, HBASE-14496.v2.patch
>
>
> Delayed compaction feature for RatioBasedCompactionPolicy allows to specify 
> maximum compaction delay for newly created store files. Files will be 
> eligible for compaction only if their age exceeds this delay. This will allow 
> to preserve new data in a block cache. For most applications, the newer the 
> data is the more frequently it is accessed. The frequent compactions of a new 
> store files result in high block cache churn rate and affects read 
> performance and read latencies badly. 
> The configuration will be global, per table, per column family.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HBASE-14496) Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy

2016-03-03 Thread Dave Latham (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179121#comment-15179121
 ] 

Dave Latham commented on HBASE-14496:
-

What if memory pressure causes many small flushes?  How does this interact with 
the max number of store files?

> Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy
> -
>
> Key: HBASE-14496
> URL: https://issues.apache.org/jira/browse/HBASE-14496
> Project: HBase
>  Issue Type: New Feature
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-14496.v1.patch, HBASE-14496.v2.patch
>
>
> Delayed compaction feature for RatioBasedCompactionPolicy allows to specify 
> maximum compaction delay for newly created store files. Files will be 
> eligible for compaction only if their age exceeds this delay. This will allow 
> to preserve new data in a block cache. For most applications, the newer the 
> data is the more frequently it is accessed. The frequent compactions of a new 
> store files result in high block cache churn rate and affects read 
> performance and read latencies badly. 
> The configuration will be global, per table, per column family.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HBASE-14496) Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy

2015-10-16 Thread Hadoop QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961673#comment-14961673
 ] 

Hadoop QA commented on HBASE-14496:
---

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12767143/HBASE-14496.v2.patch
  against master branch at commit 6774f223a4a1cfd3cd81a17861ac94faad3b2916.
  ATTACHMENT ID: 12767143

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 2 new 
or modified tests.

{color:green}+1 hadoop versions{color}. The patch compiles with all 
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.6.1 2.7.0 
2.7.1)

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 protoc{color}.  The applied patch does not increase the 
total number of protoc compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 checkstyle{color}.  The applied patch does not increase the 
total number of checkstyle errors

{color:green}+1 findbugs{color}.  The patch does not introduce any  new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn post-site goal succeeds with this patch.

{color:green}+1 core tests{color}.  The patch passed unit tests in .

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/16072//testReport/
Release Findbugs (version 2.0.3)warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/16072//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors: 
https://builds.apache.org/job/PreCommit-HBASE-Build/16072//artifact/patchprocess/checkstyle-aggregate.html

  Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/16072//console

This message is automatically generated.

> Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy
> -
>
> Key: HBASE-14496
> URL: https://issues.apache.org/jira/browse/HBASE-14496
> Project: HBase
>  Issue Type: New Feature
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-14496.v1.patch, HBASE-14496.v2.patch
>
>
> Delayed compaction feature for RatioBasedCompactionPolicy allows to specify 
> maximum compaction delay for newly created store files. Files will be 
> eligible for compaction only if their age exceeds this delay. This will allow 
> to preserve new data in a block cache. For most applications, the newer the 
> data is the more frequently it is accessed. The frequent compactions of a new 
> store files result in high block cache churn rate and affects read 
> performance and read latencies badly. 
> The configuration will be global, per table, per column family.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HBASE-14496) Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy

2015-10-07 Thread Hadoop QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14948013#comment-14948013
 ] 

Hadoop QA commented on HBASE-14496:
---

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12765489/HBASE-14496.v1.patch
  against master branch at commit 7e30436e3fa84525b85b05b9e23cb01b2ada7c12.
  ATTACHMENT ID: 12765489

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 2 new 
or modified tests.

{color:green}+1 hadoop versions{color}. The patch compiles with all 
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.6.1 2.7.0 
2.7.1)

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 protoc{color}.  The applied patch does not increase the 
total number of protoc compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 checkstyle{color}.  The applied patch does not increase the 
total number of checkstyle errors

{color:green}+1 findbugs{color}.  The patch does not introduce any  new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn post-site goal succeeds with this patch.

{color:green}+1 core tests{color}.  The patch passed unit tests in .

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/15908//testReport/
Release Findbugs (version 2.0.3)warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/15908//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors: 
https://builds.apache.org/job/PreCommit-HBASE-Build/15908//artifact/patchprocess/checkstyle-aggregate.html

  Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/15908//console

This message is automatically generated.

> Compaction improvements: Delayed compaction in RatioBasedCompactionPolicy
> -
>
> Key: HBASE-14496
> URL: https://issues.apache.org/jira/browse/HBASE-14496
> Project: HBase
>  Issue Type: New Feature
>Reporter: Vladimir Rodionov
>Assignee: Vladimir Rodionov
> Attachments: HBASE-14496.v1.patch
>
>
> Delayed compaction feature for RatioBasedCompactionPolicy allows to specify 
> maximum compaction delay for newly created store files. Files will be 
> eligible for compaction only if their age exceeds this delay. This will allow 
> to preserve new data in a block cache. For most applications, the newer the 
> data is the more frequently it is accessed. The frequent compactions of a new 
> store files result in high block cache churn rate and affects read 
> performance and read latencies badly. 
> The configuration will be global, per table, per column family.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)