subject:"\[jira\] \[Updated\] \(HDFS\-13559\) TestBlockScanner does not close TestContext properly"

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

2018-05-25 Thread Anbang Hu (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anbang Hu updated HDFS-13559:
-
Issue Type: Test  (was: Bug)

> TestBlockScanner does not close TestContext properly
> 
>
> Key: HDFS-13559
> URL: https://issues.apache.org/jira/browse/HDFS-13559
> Project: Hadoop HDFS
>  Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
>  Labels: Windows
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3
>
> Attachments: HDFS-13559.000.patch, HDFS-13559.001.patch
>
>
> Without closing ctx in testMarkSuspectBlock, testIgnoreMisplacedBlock, 
> testAppendWhileScanning, some tests fail on Windows:
> {color:#d04437}[INFO] Running 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 0, 
> Time elapsed: 113.398 s <<< FAILURE! - in 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] 
> testScanAllBlocksWithRescan(org.apache.hadoop.hdfs.server.datanode.TestBlockScanner)
>  Time elapsed: 0.031 s <<< ERROR!{color}
> {color:#d04437}java.io.IOException: Could not fully delete 
> E:\OSS\hadoop-branch-2\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name1{color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1047){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:883){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:514){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:473){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner$TestContext.(TestBlockScanner.java:102){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksImpl(TestBlockScanner.java:366){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksWithRescan(TestBlockScanner.java:435){color}
> {color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method){color}
> {color:#d04437} at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
> {color:#d04437} at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43){color}
> {color:#d04437} at java.lang.reflect.Method.invoke(Method.java:498){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47){color}
> {color:#d04437} at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74){color}
> {color:#d04437}...{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[INFO] Results:{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Errors:{color}
> {color:#d04437}[ERROR] TestBlockScanner.testAppendWhileScanning:899 ╗ IO 
> Could not fully delete E:\OS...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testCorruptBlockHandling:488 ╗ IO 
> Could not fully delete E:\O...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testDatanodeCursor:531 ╗ IO Could not 
> fully delete E:\OSS\had...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testMarkSuspectBlock:717 ╗ IO Could 
> not fully delete E:\OSS\h...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testScanAllBlocksWithRescan:435->testScanAllBlocksImpl:366 ╗ 
> IO{color}
> {color:#d04437}[ERROR] TestBlockScanner.testScanRateLimit:450 ╗ IO Could not 
> fully delete E:\OSS\hado...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithCaching:261->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithoutCaching:256->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 
> 0{color}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

2018-05-25 Thread Anbang Hu (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anbang Hu updated HDFS-13559:
-
Priority: Minor  (was: Major)

> TestBlockScanner does not close TestContext properly
> 
>
> Key: HDFS-13559
> URL: https://issues.apache.org/jira/browse/HDFS-13559
> Project: Hadoop HDFS
>  Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: Windows
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3
>
> Attachments: HDFS-13559.000.patch, HDFS-13559.001.patch
>
>
> Without closing ctx in testMarkSuspectBlock, testIgnoreMisplacedBlock, 
> testAppendWhileScanning, some tests fail on Windows:
> {color:#d04437}[INFO] Running 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 0, 
> Time elapsed: 113.398 s <<< FAILURE! - in 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] 
> testScanAllBlocksWithRescan(org.apache.hadoop.hdfs.server.datanode.TestBlockScanner)
>  Time elapsed: 0.031 s <<< ERROR!{color}
> {color:#d04437}java.io.IOException: Could not fully delete 
> E:\OSS\hadoop-branch-2\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name1{color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1047){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:883){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:514){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:473){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner$TestContext.(TestBlockScanner.java:102){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksImpl(TestBlockScanner.java:366){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksWithRescan(TestBlockScanner.java:435){color}
> {color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method){color}
> {color:#d04437} at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
> {color:#d04437} at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43){color}
> {color:#d04437} at java.lang.reflect.Method.invoke(Method.java:498){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47){color}
> {color:#d04437} at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74){color}
> {color:#d04437}...{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[INFO] Results:{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Errors:{color}
> {color:#d04437}[ERROR] TestBlockScanner.testAppendWhileScanning:899 ╗ IO 
> Could not fully delete E:\OS...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testCorruptBlockHandling:488 ╗ IO 
> Could not fully delete E:\O...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testDatanodeCursor:531 ╗ IO Could not 
> fully delete E:\OSS\had...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testMarkSuspectBlock:717 ╗ IO Could 
> not fully delete E:\OSS\h...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testScanAllBlocksWithRescan:435->testScanAllBlocksImpl:366 ╗ 
> IO{color}
> {color:#d04437}[ERROR] TestBlockScanner.testScanRateLimit:450 ╗ IO Could not 
> fully delete E:\OSS\hado...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithCaching:261->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithoutCaching:256->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 
> 0{color}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

2018-05-16 Thread JIRA


 [ 
https://issues.apache.org/jira/browse/HDFS-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Íñigo Goiri updated HDFS-13559:
---
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 3.0.3
   2.9.2
   3.1.1
   3.2.0
   2.10.0
   Status: Resolved  (was: Patch Available)

Thanks [~huanbang1993] for the fix.
Committed to trunk, branch-3.1, branch-3.0, branch-2, and branch-2.9.

> TestBlockScanner does not close TestContext properly
> 
>
> Key: HDFS-13559
> URL: https://issues.apache.org/jira/browse/HDFS-13559
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
>  Labels: Windows
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3
>
> Attachments: HDFS-13559.000.patch, HDFS-13559.001.patch
>
>
> Without closing ctx in testMarkSuspectBlock, testIgnoreMisplacedBlock, 
> testAppendWhileScanning, some tests fail on Windows:
> {color:#d04437}[INFO] Running 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 0, 
> Time elapsed: 113.398 s <<< FAILURE! - in 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] 
> testScanAllBlocksWithRescan(org.apache.hadoop.hdfs.server.datanode.TestBlockScanner)
>  Time elapsed: 0.031 s <<< ERROR!{color}
> {color:#d04437}java.io.IOException: Could not fully delete 
> E:\OSS\hadoop-branch-2\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name1{color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1047){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:883){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:514){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:473){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner$TestContext.(TestBlockScanner.java:102){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksImpl(TestBlockScanner.java:366){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksWithRescan(TestBlockScanner.java:435){color}
> {color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method){color}
> {color:#d04437} at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
> {color:#d04437} at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43){color}
> {color:#d04437} at java.lang.reflect.Method.invoke(Method.java:498){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47){color}
> {color:#d04437} at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74){color}
> {color:#d04437}...{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[INFO] Results:{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Errors:{color}
> {color:#d04437}[ERROR] TestBlockScanner.testAppendWhileScanning:899 ╗ IO 
> Could not fully delete E:\OS...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testCorruptBlockHandling:488 ╗ IO 
> Could not fully delete E:\O...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testDatanodeCursor:531 ╗ IO Could not 
> fully delete E:\OSS\had...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testMarkSuspectBlock:717 ╗ IO Could 
> not fully delete E:\OSS\h...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testScanAllBlocksWithRescan:435->testScanAllBlocksImpl:366 ╗ 
> IO{color}
> {color:#d04437}[ERROR] TestBlockScanner.testScanRateLimit:450 ╗ IO Could not 
> fully delete E:\OSS\hado...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithCaching:261->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithoutCaching:256->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 
> 0{color}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-ma

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

2018-05-16 Thread Anbang Hu (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anbang Hu updated HDFS-13559:
-
Attachment: HDFS-13559.001.patch

> TestBlockScanner does not close TestContext properly
> 
>
> Key: HDFS-13559
> URL: https://issues.apache.org/jira/browse/HDFS-13559
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
>  Labels: Windows
> Attachments: HDFS-13559.000.patch, HDFS-13559.001.patch
>
>
> Without closing ctx in testMarkSuspectBlock, testIgnoreMisplacedBlock, 
> testAppendWhileScanning, some tests fail on Windows:
> {color:#d04437}[INFO] Running 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 0, 
> Time elapsed: 113.398 s <<< FAILURE! - in 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] 
> testScanAllBlocksWithRescan(org.apache.hadoop.hdfs.server.datanode.TestBlockScanner)
>  Time elapsed: 0.031 s <<< ERROR!{color}
> {color:#d04437}java.io.IOException: Could not fully delete 
> E:\OSS\hadoop-branch-2\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name1{color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1047){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:883){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:514){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:473){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner$TestContext.(TestBlockScanner.java:102){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksImpl(TestBlockScanner.java:366){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksWithRescan(TestBlockScanner.java:435){color}
> {color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method){color}
> {color:#d04437} at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
> {color:#d04437} at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43){color}
> {color:#d04437} at java.lang.reflect.Method.invoke(Method.java:498){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47){color}
> {color:#d04437} at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74){color}
> {color:#d04437}...{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[INFO] Results:{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Errors:{color}
> {color:#d04437}[ERROR] TestBlockScanner.testAppendWhileScanning:899 ╗ IO 
> Could not fully delete E:\OS...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testCorruptBlockHandling:488 ╗ IO 
> Could not fully delete E:\O...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testDatanodeCursor:531 ╗ IO Could not 
> fully delete E:\OSS\had...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testMarkSuspectBlock:717 ╗ IO Could 
> not fully delete E:\OSS\h...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testScanAllBlocksWithRescan:435->testScanAllBlocksImpl:366 ╗ 
> IO{color}
> {color:#d04437}[ERROR] TestBlockScanner.testScanRateLimit:450 ╗ IO Could not 
> fully delete E:\OSS\hado...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithCaching:261->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithoutCaching:256->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 
> 0{color}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

2018-05-14 Thread Anbang Hu (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anbang Hu updated HDFS-13559:
-
Attachment: HDFS-13559.000.patch
Status: Patch Available  (was: Open)

Applies to both trunk and branch-2. After the patch:

{color:#14892c}[INFO] Running 
org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
{color:#14892c}[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time 
elapsed: 383.185 s - in 
org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
{color:#14892c}[INFO]{color}
{color:#14892c}[INFO] Results:{color}
{color:#14892c}[INFO]{color}
{color:#14892c}[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0{color}

> TestBlockScanner does not close TestContext properly
> 
>
> Key: HDFS-13559
> URL: https://issues.apache.org/jira/browse/HDFS-13559
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
>  Labels: Windows
> Attachments: HDFS-13559.000.patch
>
>
> Without closing ctx in testMarkSuspectBlock, testIgnoreMisplacedBlock, 
> testAppendWhileScanning, some tests fail on Windows:
> {color:#d04437}[INFO] Running 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 0, 
> Time elapsed: 113.398 s <<< FAILURE! - in 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner{color}
> {color:#d04437}[ERROR] 
> testScanAllBlocksWithRescan(org.apache.hadoop.hdfs.server.datanode.TestBlockScanner)
>  Time elapsed: 0.031 s <<< ERROR!{color}
> {color:#d04437}java.io.IOException: Could not fully delete 
> E:\OSS\hadoop-branch-2\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name1{color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1047){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:883){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:514){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:473){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner$TestContext.(TestBlockScanner.java:102){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksImpl(TestBlockScanner.java:366){color}
> {color:#d04437} at 
> org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanAllBlocksWithRescan(TestBlockScanner.java:435){color}
> {color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method){color}
> {color:#d04437} at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
> {color:#d04437} at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43){color}
> {color:#d04437} at java.lang.reflect.Method.invoke(Method.java:498){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47){color}
> {color:#d04437} at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12){color}
> {color:#d04437} at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17){color}
> {color:#d04437} at 
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74){color}
> {color:#d04437}...{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[INFO] Results:{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Errors:{color}
> {color:#d04437}[ERROR] TestBlockScanner.testAppendWhileScanning:899 ╗ IO 
> Could not fully delete E:\OS...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testCorruptBlockHandling:488 ╗ IO 
> Could not fully delete E:\O...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testDatanodeCursor:531 ╗ IO Could not 
> fully delete E:\OSS\had...{color}
> {color:#d04437}[ERROR] TestBlockScanner.testMarkSuspectBlock:717 ╗ IO Could 
> not fully delete E:\OSS\h...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testScanAllBlocksWithRescan:435->testScanAllBlocksImpl:366 ╗ 
> IO{color}
> {color:#d04437}[ERROR] TestBlockScanner.testScanRateLimit:450 ╗ IO Could not 
> fully delete E:\OSS\hado...{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithCaching:261->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[ERROR] 
> TestBlockScanner.testVolumeIteratorWithoutCaching:256->testVolumeIteratorImpl:169
>  ╗ IO{color}
> {color:#d04437}[INFO]{color}
> {color:#d04437}[ERROR] Tests run: 14, Failures: 0, Errors: 8, Skipped: 
> 0{color}

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

[jira] [Updated] (HDFS-13559) TestBlockScanner does not close TestContext properly

5 matches

Site Navigation

Mail list logo

Footer information