[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
This bug was fixed in the package apport - 2.20.11-0ubuntu2 --- apport (2.20.11-0ubuntu2) eoan; urgency=medium * test/test_backend_apt_dpkg.py: as of r3211 an error is not raised if the binary is not found. Cherry picked from upstream r3248. * backends/packaging-apt-dpkg.py: writing the contents mapping pickle file can Traceback on systems with little memory so don't write it. Cherry picked from upstream r3250. * test/test_apport_valgrind.py: skip test_sandbox_cache_options if system has little memory. -- Brian Murray Mon, 20 May 2019 18:39:46 -0700 ** Changed in: apport (Ubuntu Eoan) Status: In Progress => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
https://bazaar.launchpad.net/~apport-hackers/apport/trunk/revision/3240 ** Changed in: apport Status: In Progress => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
** Branch linked: lp:~ubuntu-core-dev/ubuntu/eoan/apport/ubuntu -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
** Changed in: apport (Ubuntu Eoan) Assignee: (unassigned) => Brian Murray (brian-murray) ** Changed in: apport (Ubuntu Eoan) Status: Triaged => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
** Changed in: apport Status: New => In Progress ** Changed in: apport Assignee: (unassigned) => Brian Murray (brian-murray) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
** Also affects: apport (Ubuntu Eoan) Importance: Medium Status: Triaged -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
** Changed in: apport (Ubuntu) Status: Confirmed => Triaged ** Changed in: apport (Ubuntu) Importance: Undecided => Medium -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
Ping? It’s still really frustrating to have the entire system go unresponsive for a minute just because gnome-shell crashed and apport won’t let it restart until it’s finished compressing the core dump. If you’re not willing to go all the way to zlib level 1, can we at least proceed with going down to 5 like you suggested? Alternatively, python3-brotli entered Ubuntu shortly after my original report. brotli level 2 compresses faster than zlib level 1 with smaller output than zlib level 9, while brotli level 1 is as almost as fast as lz4 with output size like zlib level 5! I don’t have the crash dump I used for the tests above, so here are some tests on a somewhat smaller one. zlib.compressobj(level=1) time=7.1 size=41822029 zlib.compressobj(level=2) time=7.1 size=40718379 zlib.compressobj(level=3) time=7.4 size=39638807 zlib.compressobj(level=4) time=13.1 size=31197301 zlib.compressobj(level=5) time=13.9 size=30423373 zlib.compressobj(level=6) time=15.1 size=29763741 zlib.compressobj(level=7) time=16.3 size=29526183 zlib.compressobj(level=8) time=25.6 size=29191955 zlib.compressobj(level=9) time=39.2 size=29067237 bz2.BZ2Compressor(compresslevel=1) time=25.0 size=25198553 bz2.BZ2Compressor(compresslevel=9) time=30.6 size=23280287 lz4.compress time=0.9 size=50649857 lz4.compressHC time=5.4 size=40462669 brotli.Compressor(quality=1) time=1.2 size=30559841 brotli.Compressor(quality=2) time=3.8 size=26162317 brotli.Compressor(quality=3) time=6.2 size=26256343 brotli.Compressor(quality=4) time=8.7 size=24982273 brotli.Compressor(quality=5) time=29.2 size=21744749 brotli.Compressor(quality=6) time=45.5 size=21502521 brotli.Compressor(quality=7) time=81.7 size=21355153 brotli.Compressor(quality=8) time=145.9 size=21249997 If a crash could be recorded in a second instead of a minute with almost no size difference, I’d call that a win. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
** Tags added: rls-x-incoming -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
Level 5 isn’t crazy, though it’s still some 70% slower than level 1. zlib.compressobj(level=1) time=7.6 size=84869397 zlib.compressobj(level=2) time=7.8 size=82465461 zlib.compressobj(level=3) time=8.4 size=79576183 zlib.compressobj(level=4) time=12.2 size=74672475 zlib.compressobj(level=5) time=13.2 size=72642875 zlib.compressobj(level=6) time=15.7 size=69988031 zlib.compressobj(level=7) time=17.9 size=69281853 zlib.compressobj(level=8) time=30.4 size=68666299 zlib.compressobj(level=9) time=59.0 size=68326007 bz2.BZ2Compressor(compresslevel=1) time=30.6 size=61319073 bz2.BZ2Compressor(compresslevel=9) time=40.0 size=54246781 lz4.compress time=2.4 size=108683033 Sizes are after base64 encoding. (If you’re worried about upload size, why not recompress the report at upload time, when it’s not going to take the user by surprise?) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: apport (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1537635] Re: Reduce zlib compression level for massive performance increase
How does it do with the default level of 5? 24% size increase is a lot, and uploading 30 MB extra is not trivial. So "5" might provide a better compromise here? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1537635 Title: Reduce zlib compression level for massive performance increase To manage notifications about this bug go to: https://bugs.launchpad.net/apport/+bug/1537635/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs