[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-09-30 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14937837#comment-14937837
 ] 

Hudson commented on HDFS-8460:
--

FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #473 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/473/])
HDFS-8460. Erasure Coding: stateful read result doesn't match data (zhezhang: 
rev 2eee19cd1d8e16f0631d78474e387ca4c526f47e)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java


> Erasure Coding: stateful read result doesn't match data occasionally because 
> of flawed test
> ---
>
> Key: HDFS-8460
> URL: https://issues.apache.org/jira/browse/HDFS-8460
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: test
>Reporter: Yi Liu
>Assignee: Walter Su
> Fix For: HDFS-7285
>
> Attachments: HDFS-8460-HDFS-7285.001.patch, 
> HDFS-8460-HDFS-7285.002.patch
>
>
> I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
> occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-09-30 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14938056#comment-14938056
 ] 

Hudson commented on HDFS-8460:
--

FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #439 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/439/])
HDFS-8460. Erasure Coding: stateful read result doesn't match data (zhezhang: 
rev 2eee19cd1d8e16f0631d78474e387ca4c526f47e)
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt


> Erasure Coding: stateful read result doesn't match data occasionally because 
> of flawed test
> ---
>
> Key: HDFS-8460
> URL: https://issues.apache.org/jira/browse/HDFS-8460
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: test
>Reporter: Yi Liu
>Assignee: Walter Su
> Fix For: HDFS-7285
>
> Attachments: HDFS-8460-HDFS-7285.001.patch, 
> HDFS-8460-HDFS-7285.002.patch
>
>
> I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
> occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-09-30 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14938626#comment-14938626
 ] 

Hudson commented on HDFS-8460:
--

FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #465 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/465/])
HDFS-8460. Erasure Coding: stateful read result doesn't match data (zhezhang: 
rev 2eee19cd1d8e16f0631d78474e387ca4c526f47e)
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java


> Erasure Coding: stateful read result doesn't match data occasionally because 
> of flawed test
> ---
>
> Key: HDFS-8460
> URL: https://issues.apache.org/jira/browse/HDFS-8460
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: test
>Reporter: Yi Liu
>Assignee: Walter Su
> Fix For: HDFS-7285
>
> Attachments: HDFS-8460-HDFS-7285.001.patch, 
> HDFS-8460-HDFS-7285.002.patch
>
>
> I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
> occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-09-30 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14938434#comment-14938434
 ] 

Hudson commented on HDFS-8460:
--

FAILURE: Integrated in Hadoop-Mapreduce-trunk #2408 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2408/])
HDFS-8460. Erasure Coding: stateful read result doesn't match data (zhezhang: 
rev 2eee19cd1d8e16f0631d78474e387ca4c526f47e)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java


> Erasure Coding: stateful read result doesn't match data occasionally because 
> of flawed test
> ---
>
> Key: HDFS-8460
> URL: https://issues.apache.org/jira/browse/HDFS-8460
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: test
>Reporter: Yi Liu
>Assignee: Walter Su
> Fix For: HDFS-7285
>
> Attachments: HDFS-8460-HDFS-7285.001.patch, 
> HDFS-8460-HDFS-7285.002.patch
>
>
> I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
> occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-09-30 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14937580#comment-14937580
 ] 

Hudson commented on HDFS-8460:
--

FAILURE: Integrated in Hadoop-Yarn-trunk #1203 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/1203/])
HDFS-8460. Erasure Coding: stateful read result doesn't match data (zhezhang: 
rev 2eee19cd1d8e16f0631d78474e387ca4c526f47e)
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt


> Erasure Coding: stateful read result doesn't match data occasionally because 
> of flawed test
> ---
>
> Key: HDFS-8460
> URL: https://issues.apache.org/jira/browse/HDFS-8460
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: test
>Reporter: Yi Liu
>Assignee: Walter Su
> Fix For: HDFS-7285
>
> Attachments: HDFS-8460-HDFS-7285.001.patch, 
> HDFS-8460-HDFS-7285.002.patch
>
>
> I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
> occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-09-30 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14937333#comment-14937333
 ] 

Hudson commented on HDFS-8460:
--

FAILURE: Integrated in Hadoop-trunk-Commit #8548 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/8548/])
HDFS-8460. Erasure Coding: stateful read result doesn't match data (zhezhang: 
rev 2eee19cd1d8e16f0631d78474e387ca4c526f47e)
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java


> Erasure Coding: stateful read result doesn't match data occasionally because 
> of flawed test
> ---
>
> Key: HDFS-8460
> URL: https://issues.apache.org/jira/browse/HDFS-8460
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: test
>Reporter: Yi Liu
>Assignee: Walter Su
> Fix For: HDFS-7285
>
> Attachments: HDFS-8460-HDFS-7285.001.patch, 
> HDFS-8460-HDFS-7285.002.patch
>
>
> I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
> occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-09-30 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14937136#comment-14937136
 ] 

Hudson commented on HDFS-8460:
--

FAILURE: Integrated in Hadoop-Hdfs-trunk #2379 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/2379/])
HDFS-8460. Erasure Coding: stateful read result doesn't match data (zhezhang: 
rev 2eee19cd1d8e16f0631d78474e387ca4c526f47e)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java
* 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java


> Erasure Coding: stateful read result doesn't match data occasionally because 
> of flawed test
> ---
>
> Key: HDFS-8460
> URL: https://issues.apache.org/jira/browse/HDFS-8460
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: test
>Reporter: Yi Liu
>Assignee: Walter Su
> Fix For: HDFS-7285
>
> Attachments: HDFS-8460-HDFS-7285.001.patch, 
> HDFS-8460-HDFS-7285.002.patch
>
>
> I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
> occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-06-05 Thread Zhe Zhang (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575185#comment-14575185
 ] 

Zhe Zhang commented on HDFS-8460:
-

+1 on the patch. I just committed to the branch. Thanks Walter for catching the 
issue!

 Erasure Coding: stateful read result doesn't match data occasionally because 
 of flawed test
 ---

 Key: HDFS-8460
 URL: https://issues.apache.org/jira/browse/HDFS-8460
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: test
Reporter: Yi Liu
Assignee: Walter Su
 Fix For: HDFS-7285

 Attachments: HDFS-8460-HDFS-7285.001.patch, 
 HDFS-8460-HDFS-7285.002.patch


 I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
 occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-05-30 Thread Hadoop QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565946#comment-14565946
 ] 

Hadoop QA commented on HDFS-8460:
-

\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | pre-patch |   5m 35s | Findbugs (version ) appears to 
be broken on HDFS-7285. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any 
@author tags. |
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to 
include 2 new or modified test files. |
| {color:green}+1{color} | javac |   7m 26s | There were no new javac warning 
messages. |
| {color:red}-1{color} | release audit |   0m 13s | The applied patch generated 
1 release audit warnings. |
| {color:green}+1{color} | checkstyle |   0m 37s | There were no new checkstyle 
issues. |
| {color:green}+1{color} | whitespace |   0m  0s | The patch has no lines that 
end in whitespace. |
| {color:green}+1{color} | install |   1m 35s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 32s | The patch built with 
eclipse:eclipse. |
| {color:red}-1{color} | findbugs |   3m 24s | The patch appears to introduce 1 
new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native |   1m 20s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 172m 49s | Tests failed in hadoop-hdfs. |
| | | 193m 35s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-hdfs |
| Failed unit tests | hadoop.hdfs.TestEncryptedTransfer |
|   | hadoop.hdfs.TestDFSStripedInputStream |
|   | hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS |
|   | hadoop.hdfs.TestRecoverStripedFile |
|   | hadoop.hdfs.server.namenode.TestAuditLogs |
|   | hadoop.hdfs.server.blockmanagement.TestBlockInfo |
|   | hadoop.hdfs.server.namenode.TestFileTruncate |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12736319/HDFS-8460-HDFS-7285.002.patch
 |
| Optional Tests | javac unit findbugs checkstyle |
| git revision | HDFS-7285 / 1299357 |
| Release Audit | 
https://builds.apache.org/job/PreCommit-HDFS-Build/11172/artifact/patchprocess/patchReleaseAuditProblems.txt
 |
| Findbugs warnings | 
https://builds.apache.org/job/PreCommit-HDFS-Build/11172/artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
 |
| hadoop-hdfs test log | 
https://builds.apache.org/job/PreCommit-HDFS-Build/11172/artifact/patchprocess/testrun_hadoop-hdfs.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-HDFS-Build/11172/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | 
https://builds.apache.org/job/PreCommit-HDFS-Build/11172/console |


This message was automatically generated.

 Erasure Coding: stateful read result doesn't match data occasionally because 
 of flawed test
 ---

 Key: HDFS-8460
 URL: https://issues.apache.org/jira/browse/HDFS-8460
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: test
Reporter: Yi Liu
Assignee: Walter Su
 Attachments: HDFS-8460-HDFS-7285.001.patch, 
 HDFS-8460-HDFS-7285.002.patch


 I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
 occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-05-29 Thread Jing Zhao (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565129#comment-14565129
 ] 

Jing Zhao commented on HDFS-8460:
-

We can use {{DataNodeTestUtil#setHeartbeatsDisabledForTests}} to disable the 
heartbeat. Other than this looks good to me.

 Erasure Coding: stateful read result doesn't match data occasionally because 
 of flawed test
 ---

 Key: HDFS-8460
 URL: https://issues.apache.org/jira/browse/HDFS-8460
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: test
Reporter: Yi Liu
Assignee: Walter Su
 Attachments: HDFS-8460-HDFS-7285.001.patch


 I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
 occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

2015-05-23 Thread Hadoop QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557185#comment-14557185
 ] 

Hadoop QA commented on HDFS-8460:
-

\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch |   5m 18s | Pre-patch HDFS-7285 compilation 
is healthy. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any 
@author tags. |
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to 
include 2 new or modified test files. |
| {color:green}+1{color} | javac |   7m 33s | There were no new javac warning 
messages. |
| {color:red}-1{color} | release audit |   0m 13s | The applied patch generated 
1 release audit warnings. |
| {color:green}+1{color} | checkstyle |   0m 40s | There were no new checkstyle 
issues. |
| {color:green}+1{color} | whitespace |   0m  0s | The patch has no lines that 
end in whitespace. |
| {color:green}+1{color} | install |   1m 38s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 34s | The patch built with 
eclipse:eclipse. |
| {color:red}-1{color} | findbugs |   3m 12s | The patch appears to introduce 1 
new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native |   1m 20s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 172m 56s | Tests failed in hadoop-hdfs. |
| | | 193m 27s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-hdfs |
|  |  Inconsistent synchronization of 
org.apache.hadoop.hdfs.DFSOutputStream.streamer; locked 88% of time  
Unsynchronized access at DFSOutputStream.java:88% of time  Unsynchronized 
access at DFSOutputStream.java:[line 146] |
| Failed unit tests | hadoop.hdfs.server.blockmanagement.TestBlockInfo |
|   | hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS |
|   | hadoop.hdfs.server.namenode.TestAuditLogs |
|   | hadoop.hdfs.server.namenode.TestFileTruncate |
|   | hadoop.hdfs.TestEncryptedTransfer |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12734985/HDFS-8460-HDFS-7285.001.patch
 |
| Optional Tests | javac unit findbugs checkstyle |
| git revision | HDFS-7285 / 6313225 |
| Release Audit | 
https://builds.apache.org/job/PreCommit-HDFS-Build/3/artifact/patchprocess/patchReleaseAuditProblems.txt
 |
| Findbugs warnings | 
https://builds.apache.org/job/PreCommit-HDFS-Build/3/artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
 |
| hadoop-hdfs test log | 
https://builds.apache.org/job/PreCommit-HDFS-Build/3/artifact/patchprocess/testrun_hadoop-hdfs.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-HDFS-Build/3/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | 
https://builds.apache.org/job/PreCommit-HDFS-Build/3/console |


This message was automatically generated.

 Erasure Coding: stateful read result doesn't match data occasionally because 
 of flawed test
 ---

 Key: HDFS-8460
 URL: https://issues.apache.org/jira/browse/HDFS-8460
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: test
Reporter: Yi Liu
Assignee: Walter Su
 Attachments: HDFS-8460-HDFS-7285.001.patch


 I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
 occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally

2015-05-22 Thread Walter Su (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557104#comment-14557104
 ] 

Walter Su commented on HDFS-8460:
-

I'm working on this. If you have found out the causes. Please let me know.

 Erasure Coding: stateful read result doesn't match data occasionally
 

 Key: HDFS-8460
 URL: https://issues.apache.org/jira/browse/HDFS-8460
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Yi Liu
Assignee: Walter Su

 I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
 occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally

2015-05-22 Thread Walter Su (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557115#comment-14557115
 ] 

Walter Su commented on HDFS-8460:
-

*Causes*
{code:title=DFSTestUtil.java}
1910   public static Block addStripedBlockToFile(ListDataNode dataNodes,
   ...
1926   DatanodeStorage storage = new 
DatanodeStorage(UUID.randomUUID().toString());
{code}
If DN itself sends a blockreport, the storage with randomUUID will be 
considered zombie and be removed.

*reproduce problem*
{code}
 DFSTestUtil.createStripedFile(cluster, filePath, null, numBlocks,
 NUM_STRIPE_PER_BLOCK, false);
+cluster.triggerHeartbeats();
 LocatedBlocks lbs = 
fs.getClient().namenode.getBlockLocations(filePath.toString(), 0, fileSize);
{code}


 Erasure Coding: stateful read result doesn't match data occasionally
 

 Key: HDFS-8460
 URL: https://issues.apache.org/jira/browse/HDFS-8460
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Yi Liu
Assignee: Walter Su
 Attachments: HDFS-8460-HDFS-7285.001.patch


 I found this issue in TestDFSStripedInputStream, {{testStatefulRead}} failed 
 occasionally shows that read result doesn't match data written.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)