[PATCH v4 2/2] erofs-utils: optimize buffer allocation logic

2021-01-15 Thread Gao Xiang via Linux-erofs
From: Hu Weiwen When using EROFS to pack our dataset which consists of millions of files, mkfs.erofs is very slow compared with mksquashfs. The bottleneck is `erofs_balloc` and `erofs_mapbh` function, which iterate over all previously allocated buffer blocks, making the complexity of the algrith

Re: [PATCH v3 2/2] erofs-utils: optimize mkfs to O(N), N = #files

2021-01-15 Thread Gao Xiang
Hi Weiwen, On Sat, Jan 16, 2021 at 01:04:38PM +0800, Gao Xiang via Linux-erofs wrote: > From: Hu Weiwen > > When using EROFS to pack our dataset which consists of millions of > files, mkfs.erofs is very slow compared with mksquashfs. > > The bottleneck is `erofs_balloc` and `erofs_mapbh` functi

[PATCH v3 2/2] erofs-utils: optimize mkfs to O(N), N = #files

2021-01-15 Thread Gao Xiang via Linux-erofs
From: Hu Weiwen When using EROFS to pack our dataset which consists of millions of files, mkfs.erofs is very slow compared with mksquashfs. The bottleneck is `erofs_balloc` and `erofs_mapbh` function, which iterate over all previously allocated buffer blocks, making the complexity of the algrith

[PATCH v3 1/2] erofs-utils: get rid of `end' argument from erofs_mapbh()

2021-01-15 Thread Gao Xiang via Linux-erofs
From: Hu Weiwen `end` arguement is completely broken now. Also, it could be readded later if needed. Signed-off-by: Hu Weiwen Signed-off-by: Gao Xiang --- Hi Weiwen, Sorry for late update. I've cleaned up the patchset (mainly [PATCH 2/2], could you kindly recheck it on your side if it works, a