Why do sequential block IDs begin from 2^30?

2016-08-25 Thread Ewan Higgs
Hi all, I see in o.a.h.hdfs.server.blockmanagement.SequentialBlockIdGenerator that the low 30 bits of the Block ID are reserved. This was set out in HDFS-4645 [1,2]: β€œβ€β€ We do not change the block ID of any existing blocks on upgrade. Such existing blocks whose IDs were randomly generated are su

Re: Why do sequential block IDs begin from 2^30?

2016-08-31 Thread Arpit Agarwal
Hi Ewan, It’s not the low 30 bits that are reserved. Just the first 2^30 block IDs. Block IDs are longs so we are unlikely to ever run out. The choice was arbitrary and not based on likelihood of collision with earlier block IDs. On 8/25/16, 2:38 AM, "Ewan Higgs" wrote: Hi all, I s