Re: [OpenAFS] Performance issues with Git repositories (or in general with many small files workloads)

2020-12-16 Thread Ciprian Dorin Craciun
On Thu, Dec 17, 2020 at 1:51 AM Douglas E Engert wrote: > If you are just backing up, consider "git bundle" that creates one file, > and git clone can read the bundle. > > https://stackoverflow.com/questions/5578270/fully-backup-a-git-repo Thank you for the suggestion. I know about `git-bundle`

Re: [OpenAFS] Performance issues with Git repositories (or in general with many small files workloads)

2020-12-16 Thread Douglas E Engert
If you are just backing up, consider "git bundle" that creates one file, and git clone can read the bundle. https://stackoverflow.com/questions/5578270/fully-backup-a-git-repo On 12/16/2020 4:21 PM, Ciprian Dorin Craciun wrote: Hello all! I'm trying to use AFS to backup various Git reposito

[OpenAFS] Re: Performance issues with Git repositories (or in general with many small files workloads)

2020-12-16 Thread Ciprian Dorin Craciun
After fiddling with the `fileserver` arguments, I think the problematic ones were `-p 128` and `-vhandle-max-cachesize 32768`, and perhaps the too large `-b`, `-l` and `-s`. (Also I've switched back to the non direct-attached variant of the servers.) The new arguments I'm using are: /usr/lib

[OpenAFS] Performance issues with Git repositories (or in general with many small files workloads)

2020-12-16 Thread Ciprian Dorin Craciun
Hello all! I'm trying to use AFS to backup various Git repositories. By "backup" actually mean `git push --mirror /afs/.cell/some-path/repository.git`, which has the following behaviour: it writes many small files in the `.git/objects` folder fanned by the first two hex digits of the object hash