Re: LiveCD optimisations

2010-11-01 Thread John McCabe-Dansted
Hi Martin, I intended to send the following to lyx-devel, but my dog
ate it. Louis has mentioned AdvanceCOMP, but I thought you might find
the summary below useful. I think that the figures may be out by about
30%, possibly do to squashfs doing some form of intra-file
de-duplication, but I hope it gives a good feel as to where space can
be saved.

On Thu, Oct 14, 2010 at 5:45 PM, Scott Ritchie  wrote:
> On 10/03/2010 11:50 PM, Martin Pitt wrote:
>>  * Optimize images in packages, as proposed by Louis Simard in May.
>>
> We could do this in a very simple and automated fashion by just running
> pngcrush on every png image.  It could even be a part of the build
> daemon or built into debhelper.

Note that running advdef -z4 (after optipng) can further compress png
images, saving another 3MB. Advdef could also compress the existing gz
files by about 5MB (less if there are less gz files because we remove
man pages etc.). Optimizing svg files with Scour.py could save a
further 7MB on the LiveCD, but we should not run Scour on cards as
card games make use of non-visual tags in those SVG files [1]. Other
XML files can be optimized, but applications expect a particular
format; for a list of XML files safe to optimize see [2].

If we want to go crazy with lossless recompression we could also run
jpegrescan on jpegs saving 0.5MB, and replace gz files with lzma
saving up to 10MB. Optimizing HTML files with webpack and html::clean
could save 100k on the LiveCD (2MB when uncompressed) but doing this
right is hard, and probably not worth it.

By comparison, the changelogs take about 30MB, and manpages take about
15MB. If we keep the changelogs, they would be a good candidate for
lzma recompression since they shrink by 4.4MB.

For more information, see the thread:
  More LiveCD space optimizations
  http://osdir.com/ml/ubuntu-devel-discuss/2010-10/msg0.html

[1] 
http://www.mail-archive.com/ubuntu-devel-discuss@lists.ubuntu.com/msg11350.html
[2] 
http://www.mail-archive.com/ubuntu-devel-discuss@lists.ubuntu.com/msg11410.html

-- 
John C. McCabe-Dansted

-- 
Ubuntu-devel-discuss mailing list
Ubuntu-devel-discuss@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel-discuss


Re: LiveCD optimisations

2010-11-01 Thread Louis Simard
Hi Martin,

Thanks for the notification.

While you're working on PNG optimisations in the build scripts, I have
something to ask you.

There has been discussion on the "More LiveCD space optimisations"
thread [1] of using AdvanceCOMP to further reduce the size of PNG
files (even after OptiPNG, PNG files can get recompressed further!).
There has also been discussion of using jpegoptim to losslessly
recompress JPEG files, and AdvanceCOMP for ZIP/JAR and gzip files.

AdvanceCOMP is packaged in maverick "universe" as advancecomp.
jpegoptim is packaged in maverick "universe" as jpegoptim.

Could these programs be added to the build scripts, or would that be
discouraged since they're in "universe"? Would these optimisations be
a case for inclusion into "main"?

Regarding this:
> I'll package scour, and add it to cdbs gnome.mk with some test cases.

Thanks for this. Scour also has a fair amount of unit tests and other
test cases that you could use.

If you need to communicate with Scour for packaging adjustments, bugs
or gaps in documentation, don't hesitate to file bugs and/or patches
against Scour, or e-mail me. I'm the co-maintainer for Scour since
June 2010, but even if I can't do releases, I can commit to the trunk.

[1] 
https://lists.ubuntu.com/archives/ubuntu-devel-discuss/2010-October/012181.html

Regards,
--
Louis Simard


-- 
Ubuntu-devel-discuss mailing list
Ubuntu-devel-discuss@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel-discuss


Re: LiveCD optimisations

2010-11-01 Thread Martin Pitt
Hello Louis,

Louis Simard [2010-05-20 20:35 -0400]:
> Optimising the PNG images saves 5.5 MB on the filesystem.squashfs.

For the record, I just uploaded a new pkgbinarymangler to natty which
now calls optipng on PNG files, as part of
https://blueprints.launchpad.net/ubuntu/+spec/performance-desktop-n-install-footprint

Thanks a lot for bringing this up!

> Optimising the SVG files saves an additional 7 MB.

This is next on my list. I'll package scour, and add it to cdbs
gnome.mk with some test cases.

Thanks,

Martin
-- 
Martin Pitt| http://www.piware.de
Ubuntu Developer (www.ubuntu.com)  | Debian Developer  (www.debian.org)


signature.asc
Description: Digital signature
-- 
Ubuntu-devel-discuss mailing list
Ubuntu-devel-discuss@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel-discuss


Re: Mainstream Developers Repository

2010-11-01 Thread Scott Kitterman
On Saturday, October 30, 2010 02:35:21 pm Usama Akkad wrote:
> Wa alaikum alsalam,
> Bilal this is different from backports. for example Filezilla and Deluge
> have no problem have more recent release on windows than Linux. You
> already trust the developers of such applications. Why not help them
> reach the users directly under your supervision as Ubuntu.
> 
> You might say any one can create such a repo. Yes but it would hardly be
> in the Ubuntu way.

We had some sessions on this at UDS and are working to make the path smoother 
for upstreams to get new versions of existing packages to users more quickly 
nad easily via adjustments to the Backports Project.  So this is exactly 
backports.

Scott K

-- 
Ubuntu-devel-discuss mailing list
Ubuntu-devel-discuss@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel-discuss