Re: Kudu Data Storage Size Mistmatch On dashboard / data folder

2016-04-29 Thread Amit Adhau
Thank you Todd. Thanks, Amit On Thu, Apr 28, 2016 at 9:25 PM, Todd Lipcon wrote: > Hi Amit, > > What you're probably seeing is container pre-allocation. We use > 'fallocate' to preallocate space in the block container files, to avoid > fragmentation on disk. So, the disk

Re: Kudu Data Storage Size Mistmatch On dashboard / data folder

2016-04-28 Thread Todd Lipcon
Hi Amit, What you're probably seeing is container pre-allocation. We use 'fallocate' to preallocate space in the block container files, to avoid fragmentation on disk. So, the disk usage will increase in multiples of 32MB within each data container file. You can see the number of active

Kudu Data Storage Size Mistmatch On dashboard / data folder

2016-04-28 Thread Amit Adhau
Hi Kudu team, I have below observations for kudu data storage size mismatch; I was having similar observation last week when total on-disk size was between 4-5GB and data folder was showing 180GB. Hence, we have cleaned all kudu data and created new master and tablet data directories. That means