[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Resolution: Fixed Status: Resolved (was: Patch Available) > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Labels: hbck > Fix For: 1.0.0, 2.0.0, 0.98.10, 1.1.0 > > Attachments: 12607-v1.txt, 12607-v2.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Fix Version/s: 0.98.10 1.0.0 > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Labels: hbck > Fix For: 1.0.0, 2.0.0, 0.98.10, 1.1.0 > > Attachments: 12607-v1.txt, 12607-v2.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Fix Version/s: 1.1.0 2.0.0 Hadoop Flags: Reviewed > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Labels: hbck > Fix For: 2.0.0, 1.1.0 > > Attachments: 12607-v1.txt, 12607-v2.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Issue Type: Bug (was: Test) The current code depends on a bug in hdfs which was fixed in hadoop 2.6.0 With the bug fixed, the second attempt at invoking hbck would keep on retrying until it can successfully create the lock file. Proposed fix is to fail the second attempt since initiation of the second attempt overlaps the first invocation of hbck. > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Labels: hbck > Attachments: 12607-v1.txt, 12607-v2.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Attachment: (was: 12607-v2.txt) > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Labels: hbck > Attachments: 12607-v1.txt, 12607-v2.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Attachment: 12607-v2.txt > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Labels: hbck > Attachments: 12607-v1.txt, 12607-v2.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Attachment: 12607-v2.txt In patch v2, fail checkAndMarkRunningHbck() if it took long to obtain lock. [~busbey]: What do you think ? > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Labels: hbck > Attachments: 12607-v1.txt, 12607-v2.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Labels: hbck (was: ) > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Labels: hbck > Attachments: 12607-v1.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Status: Patch Available (was: Open) > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Attachments: 12607-v1.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Attachment: 12607-v1.txt Patch that allows the test to pass based on hadoop 2.6.0 Still looking for a way to either disable the retry or making the retry timeout lower at hdfs level. > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Priority: Minor > Attachments: 12607-v1.txt, > org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12607) TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0
[ https://issues.apache.org/jira/browse/HBASE-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12607: --- Attachment: org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 > - > > Key: HBASE-12607 > URL: https://issues.apache.org/jira/browse/HBASE-12607 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Priority: Minor > Attachments: org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt > > > TestHBaseFsck#testParallelHbck consistently fails on both Linux and Mac. > I added more logging as shown below: > {code} > HBaseFsck h1 = hbck1.get(); > HBaseFsck h2 = hbck2.get(); > LOG.warn("h1: " + h1); > LOG.warn("h2: " + h2); > {code} > I saw the following in test output: > {code} > 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: > org.apache.hadoop.hbase.util.HBaseFsck@72aa738e > 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: > org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)