[ https://issues.apache.org/jira/browse/HDFS-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kihwal Lee resolved HDFS-3356. ------------------------------ Resolution: Won't Fix This is not an issue since we now have minimum block size enforcement. > When dfs.block.size is configured to 0 the block which is created in rbw is > never deleted > ----------------------------------------------------------------------------------------- > > Key: HDFS-3356 > URL: https://issues.apache.org/jira/browse/HDFS-3356 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode > Affects Versions: 2.0.0-alpha > Reporter: J.Andreina > Priority: Minor > > dfs.block.size=0 > step 1: start NN and DN > step 2: write a file "a.txt" > The block is created in rbw and since the blocksize is 0 write fails and the > file is not closed. DN sents in the block report , number of blocks as 1 > Even after the DN has sent the block report and directory scan has been done > , the block is not invalidated for ever. > But In earlier version when the block.size is configured to 0 default value > will be taken and write will be successful. > NN logs: > ======== > {noformat} > 2012-04-24 19:54:27,089 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* > processReport: from DatanodeRegistration(.18.40.117, > storageID=DS-452047493-xx.xx.xx.xx-50076-1335277451277, infoPort=50075, > ipcPort=50077, > storageInfo=lv=-40;cid=CID-742fda5f-68f7-40a5-9d52-a2a15facc6af;nsid=797082741;c=0), > blocks: 0, processing time: 0 msecs > 2012-04-24 19:54:29,689 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* > NameSystem.allocateBlock: /1._COPYING_. > BP-1612285678-xx.xx.xx.xx-1335277427136 > blk_-262107679534121671_1002{blockUCState=UNDER_CONSTRUCTION, > primaryNodeIndex=-1, > replicas=[ReplicaUnderConstruction[xx.xx.xx.xx:50076|RBW]]} > 2012-04-24 19:54:30,113 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* > processReport: from DatanodeRegistration(xx.xx.xx.xx, > storageID=DS-452047493-xx.xx.xx.xx-50076-1335277451277, infoPort=50075, > ipcPort=50077, > storageInfo=lv=-40;cid=CID-742fda5f-68f7-40a5-9d52-a2a15facc6af;nsid=797082741;c=0), > blocks: 1, processing time: 0 msecs{noformat} > Exception message while writing a file: > ======================================= > {noformat} > ./hdfs dfs -put hadoop /1 > 12/04/24 19:54:30 WARN hdfs.DFSClient: DataStreamer Exception > java.io.IOException: BlockSize 0 is smaller than data size. Offset of packet > in block 4745 Aborting file /1._COPYING_ > at > org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:467) > put: BlockSize 0 is smaller than data size. Offset of packet in block 4745 > Aborting file /1._COPYING_ > 12/04/24 19:54:30 ERROR hdfs.DFSClient: Failed to close file /1._COPYING_ > java.io.IOException: BlockSize 0 is smaller than data size. Offset of packet > in block 4745 Aborting file /1._COPYING_ > at > org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:467){noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)