[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293153#comment-14293153 ] Hudson commented on HBASE-12627: SUCCESS: Integrated in HBase-0.98-on-Hadoop-1.1 #779 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/779/]) HBASE-12627 Add back snapshot batching facility (apurtell: rev c32e76518f832566bd67c80588cd99d6ad315641) * hbase-server/src/test/java/org/apache/hadoop/hbase/master/snapshot/TestSnapshotFileCache.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotLogCleaner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotHFileCleaner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotFileCache.java > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack >Assignee: churro morales > Fix For: 2.0.0, 0.98.10, 1.1.0 > > Attachments: HBASE-12627-v1.patch, HBASE-12627.patch > > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293146#comment-14293146 ] Hudson commented on HBASE-12627: SUCCESS: Integrated in HBase-1.0 #692 (See [https://builds.apache.org/job/HBase-1.0/692/]) HBASE-12627 Add back snapshot batching facility (apurtell: rev bb85917ee8046d23ee51ca77e0ff92c996500a01) * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotLogCleaner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotHFileCleaner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotFileCache.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/snapshot/TestSnapshotFileCache.java > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack >Assignee: churro morales > Fix For: 2.0.0, 0.98.10, 1.1.0 > > Attachments: HBASE-12627-v1.patch, HBASE-12627.patch > > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293066#comment-14293066 ] Hudson commented on HBASE-12627: SUCCESS: Integrated in HBase-0.98 #819 (See [https://builds.apache.org/job/HBase-0.98/819/]) HBASE-12627 Add back snapshot batching facility (apurtell: rev c32e76518f832566bd67c80588cd99d6ad315641) * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotHFileCleaner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotLogCleaner.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/snapshot/TestSnapshotFileCache.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotFileCache.java > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack >Assignee: churro morales > Fix For: 2.0.0, 0.98.10, 1.1.0 > > Attachments: HBASE-12627-v1.patch, HBASE-12627.patch > > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292965#comment-14292965 ] Hudson commented on HBASE-12627: FAILURE: Integrated in HBase-1.1 #113 (See [https://builds.apache.org/job/HBase-1.1/113/]) HBASE-12627 Add back snapshot batching facility (apurtell: rev 3bf34993a8da3e4cf96d1abbef841f89c0d8e1ad) * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotLogCleaner.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/snapshot/TestSnapshotFileCache.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotFileCache.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotHFileCleaner.java > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack >Assignee: churro morales > Fix For: 2.0.0, 0.98.10, 1.1.0 > > Attachments: HBASE-12627-v1.patch, HBASE-12627.patch > > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292950#comment-14292950 ] Hudson commented on HBASE-12627: FAILURE: Integrated in HBase-TRUNK #6058 (See [https://builds.apache.org/job/HBase-TRUNK/6058/]) HBASE-12627 Add back snapshot batching facility (apurtell: rev a85cb0f89a01495897e513df37e435d013e152ce) * hbase-server/src/test/java/org/apache/hadoop/hbase/master/snapshot/TestSnapshotFileCache.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotLogCleaner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotFileCache.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/SnapshotHFileCleaner.java > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack >Assignee: churro morales > Fix For: 2.0.0, 0.98.10, 1.1.0 > > Attachments: HBASE-12627-v1.patch, HBASE-12627.patch > > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292927#comment-14292927 ] Enis Soztutar commented on HBASE-12627: --- bq. I have it staged for branch-1.0, ok to push now Enis Soztutar? Should be ok if snapshot tests pass. > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack >Assignee: churro morales > Fix For: 2.0.0, 0.98.10, 1.1.0 > > Attachments: HBASE-12627-v1.patch, HBASE-12627.patch > > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292698#comment-14292698 ] Andrew Purtell commented on HBASE-12627: Going to commit shortly > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack >Assignee: churro morales > Fix For: 2.0.0, 0.98.10, 1.0.1, 1.1.0 > > Attachments: HBASE-12627-v1.patch, HBASE-12627.patch > > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278987#comment-14278987 ] Andrew Purtell commented on HBASE-12627: +1 > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack >Assignee: churro morales > Fix For: 1.0.0, 2.0.0, 0.98.10, 1.1.0 > > Attachments: HBASE-12627-v1.patch, HBASE-12627.patch > > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[
https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274203#comment-14274203
]
Hadoop QA commented on HBASE-12627:
---
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12691706/HBASE-12627-v1.patch
against master branch at commit 5b850caa801d033d800bf6c1bea32aa2c7bda273.
ATTACHMENT ID: 12691706
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified tests.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/12422//console
This message is automatically generated.
> Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
> ---
>
> Key: HBASE-12627
> URL: https://issues.apache.org/jira/browse/HBASE-12627
> Project: HBase
> Issue Type: Improvement
> Components: master, scaling
>Reporter: stack
>Assignee: churro morales
> Fix For: 1.0.0, 2.0.0, 0.98.10, 1.1.0
>
> Attachments: HBASE-12627-v1.patch, HBASE-12627.patch
>
>
> HBASE-11742 dropped the batching facility from HBASE-11360. It is less
> necessary now we do manifests rather than file-per but on big clusters the
> batching will come in handy. This issue is about studying and porting over
> the HBASE-11360 batching.
> This issue comes of discussion up on dev list
> http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[
https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272207#comment-14272207
]
Hadoop QA commented on HBASE-12627:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12691425/HBASE-12627.patch
against master branch at commit 4bfd35aabc83b007871fe9a8537cd5ac9cd84500.
ATTACHMENT ID: 12691425
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified tests.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:red}-1 checkstyle{color}. The applied patch generated
2077 checkstyle errors (more than the master's current 2076 errors).
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/12393//console
This message is automatically generated.
> Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
> ---
>
> Key: HBASE-12627
> URL: https://issues.apache.org/jira/browse/HBASE-12627
> Project: HBase
> Issue Type: Improvement
> Components: master, scaling
>Reporter: stack
>Assignee: churro morales
> Fix For: 1.0.0, 2.0.0, 0.98.10, 1.1.0
>
> Attachments: HBASE-12627.patch
>
>
> HBASE-11742 dropped the batching facility from HBASE-11360. It is less
> necessary now we do manifests rather than file-per but on big clusters the
> batching will come in handy. This issue is about studying and porting over
> the HBASE-11360 batching.
> This issue comes of discussion up on dev list
> http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-12627) Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742
[ https://issues.apache.org/jira/browse/HBASE-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233493#comment-14233493 ] stack commented on HBASE-12627: --- >From the above noted thread: "Even with the manifest feature, it is still >inefficient to iterate over every hfile in the archive and check with the namenode to see if there is a new snapshot manifest that may reference that single hfile rather than doing that check a single time for the list of all archived hfiles." -- Dave Latham > Add back snapshot batching facility from HBASE-11360 dropped by HBASE-11742 > --- > > Key: HBASE-12627 > URL: https://issues.apache.org/jira/browse/HBASE-12627 > Project: HBase > Issue Type: Improvement > Components: master, scaling >Reporter: stack > > HBASE-11742 dropped the batching facility from HBASE-11360. It is less > necessary now we do manifests rather than file-per but on big clusters the > batching will come in handy. This issue is about studying and porting over > the HBASE-11360 batching. > This issue comes of discussion up on dev list > http://search-hadoop.com/m/DHED40jnXP Marked as component 'scaling'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
