[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630914#comment-13630914
]
Hudson commented on HBASE-7636:
---
Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #496 (See
[https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/496/])
HBASE-7636 TestDistributedLogSplitting#testThreeRSAbort fails against
hadoop 2.0 (Revision 1467426)
Result = FAILURE
jmhsieh :
Files :
*
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch, hbase-7636.v3.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630892#comment-13630892
]
Hudson commented on HBASE-7636:
---
Integrated in hbase-0.95-on-hadoop2 #67 (See
[https://builds.apache.org/job/hbase-0.95-on-hadoop2/67/])
HBASE-7636 TestDistributedLogSplitting#testThreeRSAbort fails against
hadoop 2.0 (Revision 1467425)
Result = FAILURE
jmhsieh :
Files :
*
/hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch, hbase-7636.v3.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630806#comment-13630806
]
Hudson commented on HBASE-7636:
---
Integrated in HBase-TRUNK #4059 (See
[https://builds.apache.org/job/HBase-TRUNK/4059/])
HBASE-7636 TestDistributedLogSplitting#testThreeRSAbort fails against
hadoop 2.0 (Revision 1467426)
Result = SUCCESS
jmhsieh :
Files :
*
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch, hbase-7636.v3.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630504#comment-13630504
]
Jonathan Hsieh commented on HBASE-7636:
---
>From Colin's comments, it seems like for the short term we should disable SCR
>for this test and consider it for all the others. Since log recovery is
>critical functionality, I'm going to commit this version (which just targets
>this test) and file a follow up so when Colin or someone else from hdfs-land
>is able to help us to ferret out the root cause.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch, hbase-7636.v3.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630477#comment-13630477
]
Colin Patrick McCabe commented on HBASE-7636:
-
bq. Is HDFS-347 the "new" version?
Yes.
bq. Is the current short circuit read (HDFS-2246?) in hadoop1 different from
hadoop2's?
It's very similar.
bq. What is the fix version/target version for HDFS-347 – what HDFS branches
are you targeting?
It's going to be merged to trunk at first.
bq. From HBase's point of view, this is purely a unit test fix and specifically
for the MiniDFSCluster. Do you think disabling the SCR feature for unit tests
is a prudent idea?
If you are just trying to test functionality rather than performance, it's
easiest to keep it off.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch, hbase-7636.v3.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630471#comment-13630471
]
Hadoop QA commented on HBASE-7636:
--
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12578458/hbase-7636.v3.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 hadoop2.0{color}. The patch compiles against the hadoop
2.0 profile.
{color:red}-1 javadoc{color}. The javadoc tool appears to have generated 2
warning messages.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/5295//console
This message is automatically generated.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch, hbase-7636.v3.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630468#comment-13630468
]
Jonathan Hsieh commented on HBASE-7636:
---
Colin, thanks for chiming in.
Is HDFS-347 the "new" version?
Is the current short circuit read (HDFS-2246?) in hadoop1 different from
hadoop2's?
What is the fix version/target version for HDFS-347 -- what HDFS branches are
you targeting?
>From HBase's point of view, this is purely a unit test fix and specifically
>for the MiniDFSCluster. Do you think disabling the SCR feature for unit tests
>is a prudent idea?
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch, hbase-7636.v3.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630453#comment-13630453
]
Colin Patrick McCabe commented on HBASE-7636:
-
I was not able to find any HDFS logs attached (but maybe I didn't look in the
right place?) If you can find where the test puts those, your answer is almost
certainly in there. And it's almost certainly a configuration problem.
In general, configuring short circuit reads is complex. For old-style
short-circuit reads, you need to set up special permissions on your DataNode
storage directories. You also need to specify the right user for
{{dfs.block.local-path-access.user}}. For new-style short-circuit reads, you
need to have {{libhadoop.so}} installed, and possibly be running with the
native profile {{-Pnative}} so that Maven will set up {{LD_LIBRARY_PATH}}
correctly. Then you need to set a valid socket path.
It's probably best to wait until we finish merging the HDFS-347 branch (vote
was successful, now we just need to do the work in svn), and then I'll help you
set up the conf for this test. You probably want to have a fallback for if
native code is not enabled.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch, hbase-7636.v3.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630376#comment-13630376
]
Jonathan Hsieh commented on HBASE-7636:
---
The test failures are unrelated because I only change the
TestDistributedLogSplitting test case, and not the core code or any of the
flaking hadoopqa bot tests.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630306#comment-13630306
]
Hadoop QA commented on HBASE-7636:
--
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12578426/hbase-7636.v2.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 hadoop2.0{color}. The patch compiles against the hadoop
2.0 profile.
{color:red}-1 javadoc{color}. The javadoc tool appears to have generated 2
warning messages.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint
org.apache.hadoop.hbase.replication.TestMultiSlaveReplication
{color:red}-1 core zombie tests{color}. There are 2 zombie test(s):
at
org.apache.hadoop.hbase.io.encoding.TestChangingEncoding.testCrazyRandomChanges(TestChangingEncoding.java:265)
at
org.apache.hadoop.hbase.coprocessor.TestMasterObserver.testRegionTransitionOperations(TestMasterObserver.java:1185)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/5292//console
This message is automatically generated.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630224#comment-13630224
]
Ted Yu commented on HBASE-7636:
---
{code}
+// test ThreeRSAbort fails under hadoop2 if shortcircuit-read (scr) is on.
this turns it off
{code}
hadoop2 has several releases.
I think it should be noted which specific release exhibited this behavior.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.v2.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630138#comment-13630138
]
Ted Yu commented on HBASE-7636:
---
I am a little confused: the patch contains change for TestJoinedScanners.java
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630124#comment-13630124
]
Jonathan Hsieh commented on HBASE-7636:
---
Mind if I commit this to fix the test for the time being and file follow-ons
for these hadoop2 SCR issues and the perf regressions in HBASE-7606/HBASE-7605?
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629429#comment-13629429
]
stack commented on HBASE-7636:
--
[~ted_yu] Thanks for the totally content-free contribution with punt to an
inspecific 'Someone'. I would suggest keeping such substance-less commentary
to yourself.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629423#comment-13629423
]
Jonathan Hsieh commented on HBASE-7636:
---
My question is specifically comparing 2.0.2, which fails for you, against the
2.0.4-snapshot where you have it passing. I don't think HDFS-1623 is relevant
here since it landed at 2.0.0.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629404#comment-13629404
]
Ted Yu commented on HBASE-7636:
---
I am going over the JIRAs that went into branch 2.
There were some big features, such as HDFS-1623.
Someone more familiar with hdfs may have more insight.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629346#comment-13629346
]
Jonathan Hsieh commented on HBASE-7636:
---
can you provide details or a theory on *why* the cases are different?
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629303#comment-13629303
]
Ted Yu commented on HBASE-7636:
---
I did a comparison on MacBook.
With 2.0.2-alpha, I got the following for
TestDistributedLogSplitting#testThreeRSAbort:
{code}
Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting
2013-04-11 13:11:43.140 java[86243:dc07] Unable to load realm info from
SCDynamicStore
2013-04-11 13:11:43.210 java[86243:dc07] Unable to load realm info from
SCDynamicStore
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 114.58 sec <<<
FAILURE!
Results :
Failed tests:
testThreeRSAbort(org.apache.hadoop.hbase.master.TestDistributedLogSplitting):
Timedout
{code}
With 2.0.4-SNAPSHOT, the test finished in 16.6 seconds.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629126#comment-13629126
]
Ted Yu commented on HBASE-7636:
---
bq. understand why hfds short-circuit-read causes this test to fail.
I think we should do the above.
I was trying to do some analysis yesterday but unit test against hadoop 2.0 was
broken.
If we (HBase dev, hdfs dev) can discover something which needs fixing, it
better go to 2.0.4-alpha.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628765#comment-13628765
]
Hadoop QA commented on HBASE-7636:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12578137/hbase-7636.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified tests.
{color:green}+1 hadoop2.0{color}. The patch compiles against the hadoop
2.0 profile.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/5259//console
This message is automatically generated.
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
>Affects Versions: 0.95.0
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-7636.patch
>
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628556#comment-13628556
]
Jonathan Hsieh commented on HBASE-7636:
---
This test passes under hadoop2 when hdfs shortcircuit read is off. This was a
feature enabled by default for tests in HBASE-6783.
The PriviledgedActionException is [~tlipcon]
{code}
mvn clean test -Dtest=TestDistributedLogSplitting#testThreeRSAbort
-Dhadoop.profile=2.0 -Dhbase.tests.use.shortcircuit.reads=false
-Dmaven.test.redirectTestOutputToFile=true
...
---
T E S T S
---
Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.299 sec
{code}
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7636) TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
[
https://issues.apache.org/jira/browse/HBASE-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628481#comment-13628481
]
Jonathan Hsieh commented on HBASE-7636:
---
I bumped the some timeouts higher and improved failure messages in an
experiment.
The test basically creates a table on 6 rs's (thread), kills 3 rs's, and then
makes sure that all regions get back up.
When running this, we get to a state where a region cannot be opened after a RS
is aborted.
{code}
java.lang.AssertionError:
Took too long to get all the regions back online. Have 36 but want at least 41
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.hadoop.hbase.master.TestDistributedLogSplitting.testThreeRSAbort(TestDistributedLogSplitting.java:276)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
{code}
The root is some sort of hadoop access control problem (with different combos
fo IPC Server handler # and user jon.hfs.*)
{code}
2013-04-10 14:46:17,426 ERROR [IPC Server handler 7 on 46469]
security.UserGroupInformation(1370): PriviledgedActionException as:jon.hfs.1
(auth:SIMPLE) cause:org.apache.hadoop.security.AccessControlException:
Can't continue with getBlockLocalPathInfo() authorization. The user
jon.hfs.1 is not allowed to call getBlockLocalPathInfo
{code}
when trying to open the region (different region server codes, but all with the
same region failing):
{code}
2013-04-10 14:44:16,384 ERROR [RS_OPEN_REGION-localhost,50866,1365630214743-0]
handler.OpenRegionHandler(464): Failed open of region=table,,136563021
7156.7c1b2def33bf6627d581ecf6fbb389f3., starting to roll back the global
memstore size.
{code}
> TestDistributedLogSplitting#testThreeRSAbort fails against hadoop 2.0
> -
>
> Key: HBASE-7636
> URL: https://issues.apache.org/jira/browse/HBASE-7636
> Project: HBase
> Issue Type: Sub-task
>Reporter: Ted Yu
>Assignee: Jonathan Hsieh
>
> From
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/364/testReport/org.apache.hadoop.hbase.master/TestDistributedLogSplitting/testThreeRSAbort/
> :
> {code}
> 2013-01-21 11:49:34,276 DEBUG
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> client.HConnectionManager$HConnectionImplementation(956): Looked up root
> region location, connection=hconnection 0x12f19fe;
> serverName=juno.apache.org,55531,1358768819479
> 2013-01-21 11:49:34,278 INFO
> [MASTER_SERVER_OPERATIONS-juno.apache.org,57966,1358768818594-0]
> catalog.CatalogTracker(576): Failed verification of .META.,,1 at
> address=juno.apache.org,57582,1358768819456;
> org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is
> in the failed servers list: juno.apache.org/67.195.138.61:57582
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
