[gentoo-user] [OT] how to delete a directory tree really fast

2021-10-22 Thread Helmut Jarausch
Hi, Is there anything faster than rm -rf ? I'm using rync with the --link-dest= option. Since this option uses hard links extensively, both, and have to be on the same file system. Therefore, just re-making the file system anew, cannot be used. There are more than 55,000 files on som

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-22 Thread Rich Freeman
On Fri, Oct 22, 2021 at 7:36 AM Helmut Jarausch wrote: > > > There are more than 55,000 files on some which is located > on a BTRFS file system. > Standard 'rm -rf' is really slow. > > Is there anything I can do about this? > I don't have any solid suggestions as I haven't used btrfs in a while.

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-22 Thread Miles Malone
And honestly, expanding on what Rich said... Given your particular circumstances with the extensive number of hardlinks are pretty specific, I reckon you might be best off just setting up a small scale test of some options and profiling it. Converting it all to a btrfs subvolume might be a realis

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-22 Thread Rich Freeman
On Fri, Oct 22, 2021 at 8:39 AM Miles Malone wrote: > > small files... (Certainly dont quote me here, but wasnt JFS the king > of that back in the day? I cant quite recall) > It is lightning fast on lizardfs due to garbage collection, but metadata on lizardfs is expensive, requiring RAM on the m

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-22 Thread Vitor Hugo Nunes dos Santos
The real solution would have been having a subvolume for the directory. Subvolume deletion on BTRFS is near instant. Same for ZFS with datasets, etc. October 22, 2021 9:50 AM, "Rich Freeman" wrote: > On Fri, Oct 22, 2021 at 8:39 AM Miles Malone > wrote: > >> small files... (Certainly dont quot

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-22 Thread Helmut Jarausch
On 10/22/2021 06:15:58 PM, Vitor Hugo Nunes dos Santos wrote: The real solution would have been having a subvolume for the directory. Subvolume deletion on BTRFS is near instant. Same for ZFS with datasets, etc. Thanks! Is it possible to have a hard link from one subvolume to a different on

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-22 Thread Rich Freeman
On Fri, Oct 22, 2021 at 3:21 PM Helmut Jarausch wrote: > > Is it possible to have a hard link from one subvolume to a different > one? You could do a quick test, but I don't think so. I haven't used btrfs in years but they're basically separate filesystems as far as most commands are concerned.

RE: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-22 Thread Laurence Perkins
> -Original Message- > From: Rich Freeman > Sent: Friday, October 22, 2021 12:29 PM > To: gentoo-user@lists.gentoo.org > Subject: Re: [gentoo-user] [OT] how to delete a directory tree really fast > > On Fri, Oct 22, 2021 at 3:21 PM Helmut Jarausch wrote: >

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-24 Thread Helmut Jarausch
Many thanks to Rich, Miles, Vitor and Laurence for their hints on this subject. Especially the suggestion to use BTRFS Snapshots was very helpful. Finally I have come up with the following shell script for backing up my /home directory, comments are more than welcome, of course. (/HBackUp co

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-24 Thread Rich Freeman
On Sun, Oct 24, 2021 at 10:48 AM Helmut Jarausch wrote: > > Finally I have come up with the following shell script for backing up > my /home directory, > comments are more than welcome, of course. > (/HBackUp contains a BTRFS file system) > Is /home on btrfs? If not then something like this is p

Re: [gentoo-user] [OT] how to delete a directory tree really fast

2021-10-25 Thread Poncho
On 25.10.21 00:15, Rich Freeman wrote: I think there are tools out there which already implement this for btrfs. I personally use: app-backup/btrbk https://digint.ch/btrbk/ Tool for creating snapshots and remote backups of btrfs subvolumes