[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649325#comment-15649325 ]
Hadoop QA commented on HDFS-11056: ---------------------------------- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 26s{color} | {color:blue} Docker mode activated. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 2 new or modified test files. {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 20s{color} | {color:green} branch-2 passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 48s{color} | {color:green} branch-2 passed with JDK v1.8.0_101 {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 45s{color} | {color:green} branch-2 passed with JDK v1.7.0_111 {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 28s{color} | {color:green} branch-2 passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 53s{color} | {color:green} branch-2 passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 16s{color} | {color:green} branch-2 passed {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 57s{color} | {color:green} branch-2 passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 3s{color} | {color:green} branch-2 passed with JDK v1.8.0_101 {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 49s{color} | {color:green} branch-2 passed with JDK v1.7.0_111 {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 46s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 46s{color} | {color:green} the patch passed with JDK v1.8.0_101 {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 46s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 43s{color} | {color:green} the patch passed with JDK v1.7.0_111 {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 43s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 26s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 13s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 57s{color} | {color:green} the patch passed with JDK v1.8.0_101 {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 33s{color} | {color:green} the patch passed with JDK v1.7.0_111 {color} | | {color:red}-1{color} | {color:red} unit {color} | {color:red} 71m 3s{color} | {color:red} hadoop-hdfs in the patch failed with JDK v1.7.0_111. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 20s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black}168m 18s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | JDK v1.8.0_101 Failed junit tests | hadoop.hdfs.server.datanode.TestFsDatasetCache | | JDK v1.7.0_111 Failed junit tests | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure | \\ \\ || Subsystem || Report/Notes || | Docker | Image:yetus/hadoop:b59b8b7 | | JIRA Issue | HDFS-11056 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12838052/HDFS-11056.branch-2.patch | | Optional Tests | asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle | | uname | Linux 2b8b5a8d049c 3.13.0-96-generic #143-Ubuntu SMP Mon Aug 29 20:15:20 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh | | git revision | branch-2 / b77239b | | Default Java | 1.7.0_111 | | Multi-JDK versions | /usr/lib/jvm/java-8-oracle:1.8.0_101 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_111 | | findbugs | v3.0.0 | | unit | https://builds.apache.org/job/PreCommit-HDFS-Build/17475/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_111.txt | | JDK v1.7.0_111 Test Results | https://builds.apache.org/job/PreCommit-HDFS-Build/17475/testReport/ | | modules | C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs | | Console output | https://builds.apache.org/job/PreCommit-HDFS-Build/17475/console | | Powered by | Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org | This message was automatically generated. > Concurrent append and read operations lead to checksum error > ------------------------------------------------------------ > > Key: HDFS-11056 > URL: https://issues.apache.org/jira/browse/HDFS-11056 > Project: Hadoop HDFS > Issue Type: Bug > Components: datanode, httpfs > Reporter: Wei-Chiu Chuang > Assignee: Wei-Chiu Chuang > Attachments: HDFS-11056.001.patch, HDFS-11056.002.patch, > HDFS-11056.branch-2.patch, HDFS-11056.reproduce.patch > > > If there are two clients, one of them open-append-close a file continuously, > while the other open-read-close the same file continuously, the reader > eventually gets a checksum error in the data read. > On my local Mac, it takes a few minutes to produce the error. This happens to > httpfs clients, but there's no reason not believe this happens to any append > clients. > I have a unit test that demonstrates the checksum error. Will attach later. > Relevant log: > {quote} > 2016-10-25 15:34:45,153 INFO audit - allowed=true ugi=weichiu > (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/bar.txt > dst=null perm=null proto=rpc > 2016-10-25 15:34:45,155 INFO DataNode - Receiving > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 src: > /127.0.0.1:51130 dest: /127.0.0.1:50131 > 2016-10-25 15:34:45,155 INFO FsDatasetImpl - Appending to FinalizedReplica, > blk_1073741825_1182, FINALIZED > getNumBytes() = 182 > getBytesOnDisk() = 182 > getVisibleLength()= 182 > getVolume() = > /Users/weichiu/sandbox/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/dfs/data/data1 > getBlockURI() = > file:/Users/weichiu/sandbox/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/dfs/data/data1/current/BP-837130339-172.16.1.88-1477434851452/current/finalized/subdir0/subdir0/blk_1073741825 > 2016-10-25 15:34:45,167 INFO DataNode - opReadBlock > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 received exception > java.io.IOException: No data exists for block > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 > 2016-10-25 15:34:45,167 WARN DataNode - > DatanodeRegistration(127.0.0.1:50131, > datanodeUuid=41c96335-5e4b-4950-ac22-3d21b353abb8, infoPort=50133, > infoSecurePort=0, ipcPort=50134, > storageInfo=lv=-57;cid=testClusterID;nsid=1472068852;c=1477434851452):Got > exception while serving > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 to /127.0.0.1:51121 > java.io.IOException: No data exists for block > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 > at > org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.getBlockInputStream(FsDatasetImpl.java:773) > at > org.apache.hadoop.hdfs.server.datanode.BlockSender.<init>(BlockSender.java:400) > at > org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:581) > at > org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opReadBlock(Receiver.java:150) > at > org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:102) > at > org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:289) > at java.lang.Thread.run(Thread.java:745) > 2016-10-25 15:34:45,168 INFO FSNamesystem - > updatePipeline(blk_1073741825_1182, newGS=1183, newLength=182, > newNodes=[127.0.0.1:50131], client=DFSClient_NONMAPREDUCE_-1743096965_197) > 2016-10-25 15:34:45,168 ERROR DataNode - 127.0.0.1:50131:DataXceiver error > processing READ_BLOCK operation src: /127.0.0.1:51121 dst: /127.0.0.1:50131 > java.io.IOException: No data exists for block > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 > at > org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.getBlockInputStream(FsDatasetImpl.java:773) > at > org.apache.hadoop.hdfs.server.datanode.BlockSender.<init>(BlockSender.java:400) > at > org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:581) > at > org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opReadBlock(Receiver.java:150) > at > org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:102) > at > org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:289) > at java.lang.Thread.run(Thread.java:745) > 2016-10-25 15:34:45,168 INFO FSNamesystem - > updatePipeline(blk_1073741825_1182 => blk_1073741825_1183) success > 2016-10-25 15:34:45,170 WARN DFSClient - Found Checksum error for > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 from > DatanodeInfoWithStorage[127.0.0.1:50131,DS-a1878418-4f7f-4fc9-b3f7-d7ed780b5373,DISK] > at 0 > 2016-10-25 15:34:45,170 WARN DFSClient - No live nodes contain block > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 after checking > nodes = > [DatanodeInfoWithStorage[127.0.0.1:50131,DS-a1878418-4f7f-4fc9-b3f7-d7ed780b5373,DISK]], > ignoredNodes = null > 2016-10-25 15:34:45,170 INFO DFSClient - Could not obtain > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 from any node: No > live nodes contain current block Block locations: > DatanodeInfoWithStorage[127.0.0.1:50131,DS-a1878418-4f7f-4fc9-b3f7-d7ed780b5373,DISK] > Dead nodes: > DatanodeInfoWithStorage[127.0.0.1:50131,DS-a1878418-4f7f-4fc9-b3f7-d7ed780b5373,DISK]. > Will get new block locations from namenode and retry... > 2016-10-25 15:34:45,170 WARN DFSClient - DFS chooseDataNode: got # 1 > IOException, will wait for 981.8085941094539 msec. > 2016-10-25 15:34:45,171 INFO clienttrace - src: /127.0.0.1:51130, dest: > /127.0.0.1:50131, bytes: 183, op: HDFS_WRITE, cliID: > DFSClient_NONMAPREDUCE_-1743096965_197, offset: 0, srvID: > 41c96335-5e4b-4950-ac22-3d21b353abb8, blockid: > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1183, duration: 2175363 > 2016-10-25 15:34:45,171 INFO DataNode - PacketResponder: > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1183, > type=LAST_IN_PIPELINE terminating > 2016-10-25 15:34:45,172 INFO FSNamesystem - BLOCK* blk_1073741825_1183 is > COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /tmp/bar.txt > 2016-10-25 15:34:45,576 INFO StateChange - DIR* completeFile: /tmp/bar.txt > is closed by DFSClient_NONMAPREDUCE_-1743096965_197 > 2016-10-25 15:34:45,577 INFO httpfsaudit - [/tmp/bar.txt] > 2016-10-25 15:34:45,579 INFO AppendTestUtil - seed=-3144873070946578911, > size=1 > 2016-10-25 15:34:45,590 INFO audit - allowed=true ugi=weichiu > (auth:PROXY) via weichiu (auth:SIMPLE) ip=/127.0.0.1 cmd=append > src=/tmp/bar.txt dst=null perm=null proto=rpc > 2016-10-25 15:34:45,593 INFO DataNode - Receiving > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1183 src: > /127.0.0.1:51132 dest: /127.0.0.1:50131 > 2016-10-25 15:34:45,593 INFO FsDatasetImpl - Appending to FinalizedReplica, > blk_1073741825_1183, FINALIZED > getNumBytes() = 183 > getBytesOnDisk() = 183 > getVisibleLength()= 183 > getVolume() = > /Users/weichiu/sandbox/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/dfs/data/data1 > getBlockURI() = > file:/Users/weichiu/sandbox/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/dfs/data/data1/current/BP-837130339-172.16.1.88-1477434851452/current/finalized/subdir0/subdir0/blk_1073741825 > 2016-10-25 15:34:45,603 INFO FSNamesystem - > updatePipeline(blk_1073741825_1183, newGS=1184, newLength=183, > newNodes=[127.0.0.1:50131], client=DFSClient_NONMAPREDUCE_-1743096965_197) > 2016-10-25 15:34:45,603 INFO FSNamesystem - > updatePipeline(blk_1073741825_1183 => blk_1073741825_1184) success > 2016-10-25 15:34:45,605 INFO clienttrace - src: /127.0.0.1:51132, dest: > /127.0.0.1:50131, bytes: 184, op: HDFS_WRITE, cliID: > DFSClient_NONMAPREDUCE_-1743096965_197, offset: 0, srvID: > 41c96335-5e4b-4950-ac22-3d21b353abb8, blockid: > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1184, duration: 1377229 > 2016-10-25 15:34:45,605 INFO DataNode - PacketResponder: > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1184, > type=LAST_IN_PIPELINE terminating > 2016-10-25 15:34:45,606 INFO FSNamesystem - BLOCK* blk_1073741825_1184 is > COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /tmp/bar.txt > 2016-10-25 15:34:46,009 INFO StateChange - DIR* completeFile: /tmp/bar.txt > is closed by DFSClient_NONMAPREDUCE_-1743096965_197 > 2016-10-25 15:34:46,010 INFO httpfsaudit - [/tmp/bar.txt] > 2016-10-25 15:34:46,012 INFO AppendTestUtil - seed=-263001291976323720, > size=1 > 2016-10-25 15:34:46,022 INFO audit - allowed=true ugi=weichiu > (auth:PROXY) via weichiu (auth:SIMPLE) ip=/127.0.0.1 cmd=append > src=/tmp/bar.txt dst=null perm=null proto=rpc > 2016-10-25 15:34:46,024 INFO DataNode - Receiving > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1184 src: > /127.0.0.1:51133 dest: /127.0.0.1:50131 > 2016-10-25 15:34:46,024 INFO FsDatasetImpl - Appending to FinalizedReplica, > blk_1073741825_1184, FINALIZED > getNumBytes() = 184 > getBytesOnDisk() = 184 > getVisibleLength()= 184 > getVolume() = > /Users/weichiu/sandbox/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/dfs/data/data1 > getBlockURI() = > file:/Users/weichiu/sandbox/hadoop/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/test-dir/dfs/data/data1/current/BP-837130339-172.16.1.88-1477434851452/current/finalized/subdir0/subdir0/blk_1073741825 > 2016-10-25 15:34:46,032 INFO FSNamesystem - > updatePipeline(blk_1073741825_1184, newGS=1185, newLength=184, > newNodes=[127.0.0.1:50131], client=DFSClient_NONMAPREDUCE_-1743096965_197) > 2016-10-25 15:34:46,032 INFO FSNamesystem - > updatePipeline(blk_1073741825_1184 => blk_1073741825_1185) success > 2016-10-25 15:34:46,033 INFO clienttrace - src: /127.0.0.1:51133, dest: > /127.0.0.1:50131, bytes: 185, op: HDFS_WRITE, cliID: > DFSClient_NONMAPREDUCE_-1743096965_197, offset: 0, srvID: > 41c96335-5e4b-4950-ac22-3d21b353abb8, blockid: > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1185, duration: 1112564 > 2016-10-25 15:34:46,033 INFO DataNode - PacketResponder: > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1185, > type=LAST_IN_PIPELINE terminating > 2016-10-25 15:34:46,033 INFO FSNamesystem - BLOCK* blk_1073741825_1185 is > COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /tmp/bar.txt > 2016-10-25 15:34:46,156 INFO audit - allowed=true ugi=weichiu > (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/bar.txt > dst=null perm=null proto=rpc > 2016-10-25 15:34:46,158 INFO StateChange - *DIR* reportBadBlocks for block: > BP-837130339-172.16.1.88-1477434851452:blk_1073741825_1182 on datanode: > 127.0.0.1:50131 > Exception in thread "Thread-144" java.lang.RuntimeException: > org.apache.hadoop.fs.ChecksumException: Checksum CRC32C not matched for file > /tmp/bar.txt at position 0: expected=C893FEDE but computed=69322F90, > algorithm=PureJavaCrc32C > at > org.apache.hadoop.fs.http.client.BaseTestHttpFSWith$1ReaderRunnable.run(BaseTestHttpFSWith.java:309) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.hadoop.fs.ChecksumException: Checksum CRC32C not > matched for file /tmp/bar.txt at position 0: expected=C893FEDE but > computed=69322F90, algorithm=PureJavaCrc32C > at > org.apache.hadoop.util.DataChecksum.throwChecksumException(DataChecksum.java:407) > at > org.apache.hadoop.util.DataChecksum.verifyChunked(DataChecksum.java:351) > at > org.apache.hadoop.util.DataChecksum.verifyChunkedSums(DataChecksum.java:311) > at > org.apache.hadoop.hdfs.client.impl.BlockReaderRemote.readNextPacket(BlockReaderRemote.java:216) > at > org.apache.hadoop.hdfs.client.impl.BlockReaderRemote.read(BlockReaderRemote.java:144) > at > org.apache.hadoop.hdfs.ByteArrayStrategy.readFromBlock(ReaderStrategy.java:119) > at > org.apache.hadoop.hdfs.DFSInputStream.readBuffer(DFSInputStream.java:704) > at > org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:765) > at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:814) > at java.io.DataInputStream.read(DataInputStream.java:149) > at > org.apache.hadoop.fs.http.client.BaseTestHttpFSWith$1ReaderRunnable.run(BaseTestHttpFSWith.java:302) > ... 1 more > 2016-10-25 15:34:46,437 INFO StateChange - DIR* completeFile: /tmp/bar.txt > is closed by DFSClient_NONMAPREDUCE_-1743096965_197 > 2016-10-25 15:34:46,437 INFO httpfsaudit - [/tmp/bar.txt] > 2016-10-25 15:34:46,440 INFO AppendTestUtil - seed=8756761565208093670, > size=1 > 2016-10-25 15:34:46,450 WARN StateChange - DIR* NameSystem.append: append: > lastBlock=blk_1073741825_1185 of src=/tmp/bar.txt is not sufficiently > replicated yet. > 2016-10-25 15:34:46,450 INFO Server - IPC Server handler 7 on 50130, call > Call#25082 Retry#0 org.apache.hadoop.hdfs.protocol.ClientProtocol.append from > 127.0.0.1:50147 > java.io.IOException: append: lastBlock=blk_1073741825_1185 of > src=/tmp/bar.txt is not sufficiently replicated yet. > at > org.apache.hadoop.hdfs.server.namenode.FSDirAppendOp.appendFile(FSDirAppendOp.java:136) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.appendFile(FSNamesystem.java:2423) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.append(NameNodeRpcServer.java:773) > at > org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.append(ClientNamenodeProtocolServerSideTranslatorPB.java:444) > at > org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:467) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:990) > at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:845) > at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:788) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1795) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2535) > Exception in thread "Thread-143" java.lang.RuntimeException: > java.io.IOException: HTTP status [500], exception > [org.apache.hadoop.ipc.RemoteException], message [append: > lastBlock=blk_1073741825_1185 of src=/tmp/bar.txt is not sufficiently > replicated yet.] > at > org.apache.hadoop.fs.http.client.BaseTestHttpFSWith$1.run(BaseTestHttpFSWith.java:283) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.io.IOException: HTTP status [500], exception > [org.apache.hadoop.ipc.RemoteException], message [append: > lastBlock=blk_1073741825_1185 of src=/tmp/bar.txt is not sufficiently > replicated yet.] > at > org.apache.hadoop.util.HttpExceptionUtils.validateResponse(HttpExceptionUtils.java:159) > at > org.apache.hadoop.fs.http.client.HttpFSFileSystem$HttpFSDataOutputStream.close(HttpFSFileSystem.java:470) > at > org.apache.hadoop.fs.http.client.BaseTestHttpFSWith$1.run(BaseTestHttpFSWith.java:279) > ... 1 more > org.apache.hadoop.fs.ChecksumException: Checksum CRC32C not matched for file > /tmp/bar.txt at position 0: expected=C893FEDE but computed=69322F90, > algorithm=PureJavaCrc32C > at > org.apache.hadoop.util.DataChecksum.throwChecksumException(DataChecksum.java:407) > at > org.apache.hadoop.util.DataChecksum.verifyChunked(DataChecksum.java:351) > at > org.apache.hadoop.util.DataChecksum.verifyChunkedSums(DataChecksum.java:311) > at > org.apache.hadoop.hdfs.client.impl.BlockReaderRemote.readNextPacket(BlockReaderRemote.java:216) > at > org.apache.hadoop.hdfs.client.impl.BlockReaderRemote.read(BlockReaderRemote.java:144) > at > org.apache.hadoop.hdfs.ByteArrayStrategy.readFromBlock(ReaderStrategy.java:119) > at > org.apache.hadoop.hdfs.DFSInputStream.readBuffer(DFSInputStream.java:704) > at > org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:765) > at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:814) > at java.io.DataInputStream.read(DataInputStream.java:149) > at > org.apache.hadoop.fs.http.client.BaseTestHttpFSWith$1ReaderRunnable.run(BaseTestHttpFSWith.java:302) > at java.lang.Thread.run(Thread.java:745) > {quote} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org