On Wed, 20 Mar 2024 at 22:01, Kevin Kofler via devel < devel@lists.fedoraproject.org> wrote:
> Aoife Moloney wrote: > > The zstd compression type was chosen to match createrepo_c settings. > > As an alternative, we might want to choose xz, > > Since xz consistently compresses better than zstd, I would strongly > suggest > using xz everywhere to minimize download sizes. However: > > > especially after zlib-ng has been made the default in Fedora and brought > > performance improvements. > > zlib-ng is for gz, not xz, and gz is fast, but compresses extremely poorly > (which is mostly due to the format, so, while some implementations manage > to > do better than others at the expense of more compression time, there is a > limit to how well they can do and it is nowhere near xz or even zstd) and > should hence never be used at all. > > There are two parts to this which users will see as 'slowness'. Part one is downloading the data from a mirror. Part two is uncompressing the data. In work I have been a part of, we have found that while xz gave us much smaller files, the time to uncompress was so much larger that our download gains were lost. Using zstd gave larger downloads (maybe 10 to 20% bigger) but uncompressed much faster than xz. This is data dependent though so it would be good to see if someone could test to see if xz uncompression of the datafiles will be too slow. > Kevin Kofler > -- > _______________________________________________ > devel mailing list -- devel@lists.fedoraproject.org > To unsubscribe send an email to devel-le...@lists.fedoraproject.org > Fedora Code of Conduct: > https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org > Do not reply to spam, report it: > https://pagure.io/fedora-infrastructure/new_issue > -- Stephen Smoogen, Red Hat Automotive Let us be kind to one another, for most of us are fighting a hard battle. -- Ian MacClaren
-- _______________________________________________ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
