Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-23 Thread Goswin von Brederlow
Russ Allbery r...@debian.org writes: Goswin von Brederlow goswin-...@web.de writes: Changing the name in the package would break tools that rely on the name (like packages.debian.org extracting the Changelog). Also ugly. We control the tools; we can change the tools. Multiarch is a big

Re: Endianness of data files in MultiArch (was: Please test gzip -9n - related to dpkg with multiarch support)

2012-02-13 Thread Aron Xu
On Sun, Feb 12, 2012 at 08:00, Carsten Hey cars...@debian.org wrote: * Aron Xu [2012-02-09 01:22 +0800]: Some packages come with data files that endianness matters, and many of them are large enough to split into a separate arch:all package if endianness were not something to care about. ...

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-13 Thread Ian Jackson
Steve Langasek writes (Re: Please test gzip -9n - related to dpkg with multiarch support): And what about adding 700 packages vs. adding no packages at all, in the case of systems which aren't going to have multiarch enabled? One thing that seems to have been overlooked in this discussion

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-13 Thread Ian Jackson
I wrote: Or to put it another way: if currently libfoo1 (1.1) contains and needs /usr/share/libfoo1/foo-data-1.1 libfoo1 (1.2) contains and needs /usr/share/libfoo2/foo-data-1.2 then splitting the foo-data out into libfoo1-data (1.1) -depends- libfoo1 (1.1) libfoo1-data (1.2)

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-13 Thread Goswin von Brederlow
Ian Jackson ijack...@chiark.greenend.org.uk writes: I wrote: Or to put it another way: if currently libfoo1 (1.1) contains and needs /usr/share/libfoo1/foo-data-1.1 libfoo1 (1.2) contains and needs /usr/share/libfoo2/foo-data-1.2 then splitting the foo-data out into libfoo1-data (1.1)

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-11 Thread Goswin von Brederlow
Steve Langasek vor...@debian.org writes: On Thu, Feb 09, 2012 at 01:40:41PM +0100, Goswin von Brederlow wrote: Steve Langasek vor...@debian.org writes: - For many of these files, it would be actively harmful to use architecture-qualified filenames. Manpages included in -dev packages

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-11 Thread Thorsten Glaser
Cyril Brulebois dixit: For those not subscribed to that bug, how to reproduce[1] and possible fix[2] are available now. There might be other places where buffers are reused, I only spent a few minutes on this during my lunch break. Your lunch breaks are amazing. Doesn’t this look like “uses

Re: Endianness of data files in MultiArch (was: Please test gzip -9n - related to dpkg with multiarch support)

2012-02-11 Thread Carsten Hey
* Aron Xu [2012-02-09 01:22 +0800]: Some packages come with data files that endianness matters, and many of them are large enough to split into a separate arch:all package if endianness were not something to care about. ... Debian Policy, begin of section 5.6.8: | Depending on context and the

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-10 Thread Goswin von Brederlow
Steve Langasek vor...@debian.org writes: On Thu, Feb 09, 2012 at 10:29:53PM +0100, Guillem Jover wrote: But the more interesting slowdown is that the amount of packages is general slows down apt operations in a rate that is around O(dependencies^2) (pure guess, perhaps someone has

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-10 Thread Steve Langasek
On Fri, Feb 10, 2012 at 12:47:20PM +0100, Goswin von Brederlow wrote: That's based on a sample of 1200 packages currently tagged Multi-Arch: same in the Ubuntu precise archive. If we have all packages in sections libs and libdevel converted for multiarch (which I suppose we eventually

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-10 Thread Jakub Wilk
* Guillem Jover guil...@debian.org, 2012-02-09, 03:45: But anyway, I believe that in the long run we should simply deprecate compressing stuff in /usr/share/doc/. So the main reason people are arguing for shared files boils down to used size, either in installed files, or Packages files, etc,

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-10 Thread Ian Jackson
Bastian Blank writes (Re: Please test gzip -9n - related to dpkg with multiarch support): On Thu, Feb 09, 2012 at 11:45:52AM -0400, Joey Hess wrote: And then if I have a multiarch system, and want to locally download the source of some library, build it and install it, dpkg will complain if I

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-10 Thread Russ Allbery
Steve Langasek vor...@debian.org writes: And what about adding 700 packages vs. adding no packages at all, in the case of systems which aren't going to have multiarch enabled? This would impact systems of all archs, not just those for which multiarch is a significant use case. I'm having a

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-10 Thread Steve Langasek
On Thu, Feb 09, 2012 at 01:40:41PM +0100, Goswin von Brederlow wrote: Steve Langasek vor...@debian.org writes: - For many of these files, it would be actively harmful to use architecture-qualified filenames. Manpages included in -dev packages should not change names based on the

Re: Endianness of data files in MultiArch (was: Please test gzip -9n - related to dpkg with multiarch support)

2012-02-09 Thread Jan Hauke Rahm
On Thu, Feb 09, 2012 at 01:58:28AM +0800, Aron Xu wrote: On Thu, Feb 9, 2012 at 01:35, Simon McVittie s...@debian.org wrote: On 08/02/12 17:22, Aron Xu wrote: Some packages come with data files that endianness matters, and many of them are large enough to split into a separate arch:all

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Wouter Verhelst
On Thu, Feb 09, 2012 at 03:45:50AM +0100, Guillem Jover wrote: While this could benefit the multiarch installations (for which they can easily use --path-exclude), it would use lots more space on single arch installations. Does it really? A quick test tells me that uncompressing every file

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Goswin von Brederlow
Josh Triplett j...@joshtriplett.org writes: The only downside that I can see: packages couldn't refer to a particular file under /usr/share/doc/$package/ by path, because those packages wouldn't know how the administrator might choose to compress their files. Given the policy of not

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Goswin von Brederlow
Adam Borowski kilob...@angband.pl writes: On Wed, Feb 08, 2012 at 02:14:22PM +0100, Cyril Brulebois wrote: For those not subscribed to that bug, how to reproduce[1] and possible fix[2] are available now. There might be other places where buffers are reused, I only spent a few minutes on this

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Andrea Bolognani
On Thu, Feb 09, 2012 at 01:33:58AM +, Wookey wrote: Some of the issues are already clear I think (moving arch-dependent headers into arch-qualified dirs, but leaving the others where they are) And what is considered the best way to share the architecture–independent headers between M-A:

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Goswin von Brederlow
Guillem Jover guil...@debian.org writes: On Wed, 2012-02-08 at 22:01:23 +0100, Jakub Wilk wrote: In practice, the only compressor we need to care is gzip, which is not actively maintained upstream[0]. Chances that a new version of it will break large number of packages are minute. That

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Goswin von Brederlow
Ian Jackson ijack...@chiark.greenend.org.uk writes: Russ Allbery writes (Re: Please test gzip -9n - related to dpkg with multiarch support): Another possible solution is to just give any package an implicit Replaces (possibly constrained to /usr/share/doc) on any other package with the same

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Goswin von Brederlow
Steve Langasek vor...@debian.org writes: - For many of these files, it would be actively harmful to use architecture-qualified filenames. Manpages included in -dev packages should not change names based on the architecture; having /usr/share/pam-config contain multiple files for

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Ian Jackson
Goswin von Brederlow writes (Re: Please test gzip -9n - related to dpkg with multiarch support): Ian Jackson ijack...@chiark.greenend.org.uk writes: One thing which no-one yet seems to have suggested is to have multiarch:same packages put the changelog in a filename which is distinct

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Goswin von Brederlow
Wouter Verhelst wou...@debian.org writes: On Thu, Feb 09, 2012 at 03:45:50AM +0100, Guillem Jover wrote: While this could benefit the multiarch installations (for which they can easily use --path-exclude), it would use lots more space on single arch installations. Does it really? A quick

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Goswin von Brederlow
Ian Jackson ijack...@chiark.greenend.org.uk writes: Goswin von Brederlow writes (Re: Please test gzip -9n - related to dpkg with multiarch support): Ian Jackson ijack...@chiark.greenend.org.uk writes: One thing which no-one yet seems to have suggested is to have multiarch:same packages

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Joey Hess
Goswin von Brederlow wrote: * after a bugfix (including security ones) Yes, but not a problem (other than a small race condition) since all buildds should have the same version. And then if I have a multiarch system, and want to locally download the source of some library, build it and

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread brian m. carlson
On Wed, Feb 08, 2012 at 03:06:46PM +0100, Adam Borowski wrote: gzip's output is likely to change: * on a different architecture * with different optimizations If either of these are the case (assuming a valid, deterministic, non-arch-specific implementation) then this violates C's as-if rule.

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Bastian Blank
On Thu, Feb 09, 2012 at 11:45:52AM -0400, Joey Hess wrote: And then if I have a multiarch system, and want to locally download the source of some library, build it and install it, dpkg will complain if I didn't use the same gzip that was used to build other arch versions I have installed.

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Riku Voipio
On Thu, Feb 09, 2012 at 03:34:28AM +0100, Guillem Jover wrote: Riku mentioned as an argument that this increases the data to download due to slightly bigger Packages files, but pdiffs were introduced exactly to fix that problem. And, as long as the packages do not get updated one should not

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Russ Allbery
Goswin von Brederlow goswin-...@web.de writes: Changing the name in the package would break tools that rely on the name (like packages.debian.org extracting the Changelog). Also ugly. We control the tools; we can change the tools. Multiarch is a big deal. We weren't going to get through this

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Guillem Jover
On Thu, 2012-02-09 at 21:50:17 +0200, Riku Voipio wrote: On Thu, Feb 09, 2012 at 03:34:28AM +0100, Guillem Jover wrote: Riku mentioned as an argument that this increases the data to download due to slightly bigger Packages files, but pdiffs were introduced exactly to fix that problem. And,

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Steve Langasek
On Thu, Feb 09, 2012 at 10:29:53PM +0100, Guillem Jover wrote: But the more interesting slowdown is that the amount of packages is general slows down apt operations in a rate that is around O(dependencies^2) (pure guess, perhaps someone has better knowledge?). We do remember apt-get

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread David Kalnischkies
On Thu, Feb 9, 2012 at 22:29, Guillem Jover guil...@debian.org wrote: On Thu, 2012-02-09 at 21:50:17 +0200, Riku Voipio wrote: On Thu, Feb 09, 2012 at 03:34:28AM +0100, Guillem Jover wrote: Riku mentioned as an argument that this increases the data to download due to slightly bigger Packages

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Riku Voipio
On Wed, Feb 08, 2012 at 03:06:46PM +0100, Adam Borowski wrote: gzip's output is likely to change: * on a new version * after a bugfix (including security ones) * on a different architecture * with different optimizations * with a different implementation (like those parallel ones) *

Re: Endianness of data files in MultiArch (was: Please test gzip -9n - related to dpkg with multiarch support)

2012-02-09 Thread Aron Xu
Sorry, the thread was broken and I saw your reply just now. On Thu, Feb 9, 2012 at 16:23, Jan Hauke Rahm j...@debian.org wrote: On Thu, Feb 09, 2012 at 01:58:28AM +0800, Aron Xu wrote: This is valid for most-used applications/formats like gettext, images that are designed to behave in this

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-09 Thread Wouter Verhelst
On Thu, Feb 09, 2012 at 02:54:43PM +0100, Goswin von Brederlow wrote: Wouter Verhelst wou...@debian.org writes: On Thu, Feb 09, 2012 at 03:45:50AM +0100, Guillem Jover wrote: While this could benefit the multiarch installations (for which they can easily use --path-exclude), it would use

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Neil Williams
On Wed, 8 Feb 2012 12:05:44 +1100 Russell Coker russ...@coker.com.au wrote: On Wed, 8 Feb 2012, Riku Voipio riku.voi...@iki.fi wrote: If it turns out not reasonable to expect the compression results to be identical It was reported that sometimes the size differs. Surely if nothing else

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Neil Williams
On Wed, 8 Feb 2012 02:52:52 +0200 Riku Voipio riku.voi...@iki.fi wrote: If it turns out not reasonable to expect the compression results to be identical, we should probably look into using dpkg --path-exclude= with /usr/share/{doc,man,info}/* when installing foreign-architecture packages.

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Bernhard R. Link
* Lars Wirzenius l...@liw.fi [120208 08:58]: On Tue, Feb 07, 2012 at 10:49:23PM +, Ben Hutchings wrote: But it's worse than this: even if dpkg decompresses before comparing, debsums won't (and mustn't, for backward compatibility). So it's potentially necessary to fix up the md5sums

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russell Coker
On Wed, 8 Feb 2012, Neil Williams codeh...@debian.org wrote: Expecting that the compression gives the smallest file every time is reasonable. By a single byte - I've not seen file size changes beyond that range. It's a matter of principle. A compression program is supposed to reliably

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Neil Williams
On Wed, 8 Feb 2012 21:54:30 +1100 Russell Coker russ...@coker.com.au wrote: On Wed, 8 Feb 2012, Neil Williams codeh...@debian.org wrote: Expecting that the compression gives the smallest file every time is reasonable. By a single byte - I've not seen file size changes beyond that

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Daniel Baumann
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/07/2012 11:04 PM, Neil Williams wrote: I'm not convinced that this is fixable at the gzip level, nor is it likely to be fixable by the trauma of changing from gzip to something else. while the original point of not considering compressors

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Simon McVittie
On 08/02/12 10:22, Neil Williams wrote: Nothing in /usr/share/ matters for a cross package created by dpkg-cross (with the possible exception of /usr/share/pkg-config which was always anachronistic). I'd understood that /usr/share/pkgconfig should be used for the sort of packages that would

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Ben Hutchings
On Wed, 2012-02-08 at 07:57 +, Lars Wirzenius wrote: On Tue, Feb 07, 2012 at 10:49:23PM +, Ben Hutchings wrote: But it's worse than this: even if dpkg decompresses before comparing, debsums won't (and mustn't, for backward compatibility). So it's potentially necessary to fix up the

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Wouter Verhelst
On Tue, Feb 07, 2012 at 10:04:04PM +, Neil Williams wrote: Maybe the way to solve this properly is to remove compression from the uniqueness check - compare the contents of the file in memory after decompression. Yes, it will take longer but it is only needed when the md5sum (which already

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Cyril Brulebois
Neil Williams codeh...@debian.org (07/02/2012): I'd like to ask for some help with a bug which is tripping up my tests with the multiarch-aware dpkg from experimental - #647522 - non-deterministic behaviour of gzip -9n. For those not subscribed to that bug, how to reproduce[1] and possible

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Cyril Brulebois
(Dropping everyone but dd@.) Wouter Verhelst wou...@debian.org (08/02/2012): As an additional benefit, this will also allow those among us (like me) who hate having to use 'gunzip -c /usr/share/doc/foo/bar.pdf.gz /tmp/bar.pdf; xpdf /tmp/bar.pdf' in order to be able to read some

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Ian Jackson
Russ Allbery writes (Re: Please test gzip -9n - related to dpkg with multiarch support): Another possible solution is to just give any package an implicit Replaces (possibly constrained to /usr/share/doc) on any other package with the same name and version and a different architecture

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Adam Borowski
On Wed, Feb 08, 2012 at 02:14:22PM +0100, Cyril Brulebois wrote: For those not subscribed to that bug, how to reproduce[1] and possible fix[2] are available now. There might be other places where buffers are reused, I only spent a few minutes on this during my lunch break. 2.

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Josh Triplett
Wouter Verhelst wrote: On Tue, Feb 07, 2012 at 10:04:04PM +, Neil Williams wrote: Maybe the way to solve this properly is to remove compression from the uniqueness check - compare the contents of the file in memory after decompression. Yes, it will take longer but it is only needed when

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Neil Williams
On Wed, 8 Feb 2012 14:14:22 +0100 Cyril Brulebois k...@debian.org wrote: Neil Williams codeh...@debian.org (07/02/2012): I'd like to ask for some help with a bug which is tripping up my tests with the multiarch-aware dpkg from experimental - #647522 - non-deterministic behaviour of gzip

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread brian m. carlson
On Wed, Feb 08, 2012 at 11:33:37AM +0100, Bernhard R. Link wrote: On the other hand most uncompressors silently ignore unexpected data after end of file markers. So the compressed file is even more easily tempered with (especially as debsums only stores md5 without size and md5 does not

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Neil Williams
On Wed, 8 Feb 2012 15:06:46 +0100 Adam Borowski kilob...@angband.pl wrote: On Wed, Feb 08, 2012 at 02:14:22PM +0100, Cyril Brulebois wrote: For those not subscribed to that bug, how to reproduce[1] and possible fix[2] are available now. There might be other places where buffers are reused,

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Guillem Jover
On Wed, 2012-02-08 at 13:19:17 +, Ian Jackson wrote: Well, it does mean that you might be lacking important information because the other changelog wouldn't be present on the system. While the implicit Replaces seems the easy way out, it just seems even more fragile than the shared files

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Mike Hommey
On Wed, Feb 08, 2012 at 05:13:20PM +0100, Guillem Jover wrote: On Wed, 2012-02-08 at 13:19:17 +, Ian Jackson wrote: Well, it does mean that you might be lacking important information because the other changelog wouldn't be present on the system. While the implicit Replaces seems the

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Guillem Jover
On Wed, 2012-02-08 at 17:29:22 +0100, Mike Hommey wrote: If you remove the shared files approach, how do you handle files like lintian overrides, reportbug presubj and scripts, etc. ? The same principle that applies to all dpkg output to avoid ambiguity would apply everywhere, whenever there's

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Ian Jackson
Guillem Jover writes (Re: Please test gzip -9n - related to dpkg with multiarch support): On Wed, 2012-02-08 at 13:19:17 +, Ian Jackson wrote: One thing which no-one yet seems to have suggested is to have multiarch:same packages put the changelog in a filename which is distinct

Endianness of data files in MultiArch (was: Please test gzip -9n - related to dpkg with multiarch support)

2012-02-08 Thread Aron Xu
I want to speak up about endianness of data files, this is a suggestion but not a flaw which I just want to discover the possibility of improvement to current status by the chance of implementing Multi-Arch in Debian. Some packages come with data files that endianness matters, and many of them

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Jonathan Nieder
Ian Jackson wrote: Another relevant question is whether there are other files that are shared, and which don't want to move, besides ones in /usr/share/doc. One example is header files in /usr/include, from -dev packages. In the simple examples I've seen, putting them in /usr/include/triplet,

Re: Endianness of data files in MultiArch (was: Please test gzip -9n - related to dpkg with multiarch support)

2012-02-08 Thread Simon McVittie
On 08/02/12 17:22, Aron Xu wrote: Some packages come with data files that endianness matters, and many of them are large enough to split into a separate arch:all package if endianness were not something to care about. AFAIK some maintainers are not aware of endianness issues in their packages

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Riku Voipio
On Wed, Feb 08, 2012 at 05:56:11PM +0100, Guillem Jover wrote: On Wed, 2012-02-08 at 17:29:22 +0100, Mike Hommey wrote: If you remove the shared files approach, how do you handle files like lintian overrides, reportbug presubj and scripts, etc. ? The same principle that applies to all dpkg

Re: Endianness of data files in MultiArch (was: Please test gzip -9n - related to dpkg with multiarch support)

2012-02-08 Thread Aron Xu
On Thu, Feb 9, 2012 at 01:35, Simon McVittie s...@debian.org wrote: On 08/02/12 17:22, Aron Xu wrote: Some packages come with data files that endianness matters, and many of them are large enough to split into a separate arch:all package if endianness were not something to care about. AFAIK

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Neil Williams
On Wed, 8 Feb 2012 17:13:20 +0100 Guillem Jover guil...@debian.org wrote: On Wed, 2012-02-08 at 13:19:17 +, Ian Jackson wrote: Well, it does mean that you might be lacking important information because the other changelog wouldn't be present on the system. Instead of this, I'd rather

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Don Armstrong
On Wed, 08 Feb 2012, Neil Williams wrote: I don't get it. That would only affect packages which were built during the time that a new upload of gzip is made and all the buildd's making that new version available. Now, if there is a binNMU after a new version of gzip is uploaded, yes it is

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russ Allbery
Guillem Jover guil...@debian.org writes: On Wed, 2012-02-08 at 13:19:17 +, Ian Jackson wrote: Well, it does mean that you might be lacking important information because the other changelog wouldn't be present on the system. While the implicit Replaces seems the easy way out, it just

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Roger Leigh
On Wed, Feb 08, 2012 at 11:47:19AM -0800, Russ Allbery wrote: Guillem Jover guil...@debian.org writes: On Wed, 2012-02-08 at 13:19:17 +, Ian Jackson wrote: And while the binNMU changelog issues might seem like a corner case, it's just a symptom of something that's not quite right.

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russ Allbery
Riku Voipio riku.voi...@iki.fi writes: On Wed, Feb 08, 2012 at 05:56:11PM +0100, Guillem Jover wrote: The same principle that applies to all dpkg output to avoid ambiguity would apply everywhere, whenever there's a “Multi-Arch: same” package name that needs to be unambiguous, it just always

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Guillem Jover
On Wed, 2012-02-08 at 11:25:28 -0800, Don Armstrong wrote: On Wed, 08 Feb 2012, Neil Williams wrote: I don't get it. That would only affect packages which were built during the time that a new upload of gzip is made and all the buildd's making that new version available. Now, if there is a

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russ Allbery
Guillem Jover guil...@debian.org writes: Let's assume compressor (gzip/bzip2/xz/etc) version M gets uploaded to sid generating a reproducible output across all current architectures. Time passes, compressor version N (and even O and P and Q etc) gets uploaded, which starts producing new ouput

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russ Allbery
Roger Leigh rle...@codelibre.net writes: On Wed, Feb 08, 2012 at 11:47:19AM -0800, Russ Allbery wrote: Also true. In fact, it's something that's been bothering me for a long time with linked doc directories. I'd like to prohibit them in more cases so that we get the binNMU changelogs on

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Neil Williams
On Wed, 08 Feb 2012 11:56:06 -0800 Russ Allbery r...@debian.org wrote: There are two main cases for libfoo-dev that I think cover most such packages: 1. The header files are architecture-dependent (definitions of data member sizes, for example), in which case they need to be

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russ Allbery
Joey Hess jo...@debian.org writes: pristine-tar hat tricks[1] aside, none of gzip, bzip2, xz are required to always produce the same compressed file for a given input file, and I can tell you from experience that there is a wide amount of variation. If multiarch requires this, then its design

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Ben Hutchings
On Wed, Feb 08, 2012 at 07:54:47PM +, Roger Leigh wrote: On Wed, Feb 08, 2012 at 11:47:19AM -0800, Russ Allbery wrote: Guillem Jover guil...@debian.org writes: On Wed, 2012-02-08 at 13:19:17 +, Ian Jackson wrote: And while the binNMU changelog issues might seem like a corner case,

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Guillem Jover
On Wed, 2012-02-08 at 11:56:06 -0800, Russ Allbery wrote: Riku Voipio riku.voi...@iki.fi writes: That is a major waste of space of having multiple copies of identical files with different arch-qualified names. Is that really better architecture to have multiple copies of identical files on

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Jakub Wilk
* Ben Hutchings b...@decadent.org.uk, 2012-02-08, 20:23: Relating to binNMU changelogs: do they really serve any purpose? There are no source changes, so is there any real need for a changelog change at all? AFAICT the only reason we do for historical reasons, it being the only way previously

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Riku Voipio
On Wed, Feb 08, 2012 at 09:02:43PM +0100, Guillem Jover wrote: Let's assume compressor (gzip/bzip2/xz/etc) version M gets uploaded to sid generating a reproducible output across all current architectures. Time passes, compressor version N (and even O and P and Q etc) gets uploaded, which

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Jakub Wilk
* Guillem Jover guil...@debian.org, 2012-02-08, 21:02: Let's assume compressor (gzip/bzip2/xz/etc) version M gets uploaded to sid generating a reproducible output across all current architectures. Time passes, compressor version N (and even O and P and Q etc) gets uploaded, which starts

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Sune Vuorela
On 2012-02-08, Russ Allbery r...@debian.org wrote: There are two main cases for libfoo-dev that I think cover most such packages: 3) to ensure that things can keep working on slow archs while they build a new edition of src:foo /Sune -- To UNSUBSCRIBE, email to

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russ Allbery
Neil Williams codeh...@debian.org writes: Russ Allbery r...@debian.org wrote: There are two main cases for libfoo-dev that I think cover most such packages: 1. The header files are architecture-dependent (definitions of data member sizes, for example), in which case they need to be

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Steve Langasek
On Wed, Feb 08, 2012 at 11:56:06AM -0800, Russ Allbery wrote: Riku Voipio riku.voi...@iki.fi writes: On Wed, Feb 08, 2012 at 05:56:11PM +0100, Guillem Jover wrote: The same principle that applies to all dpkg output to avoid ambiguity would apply everywhere, whenever there's a “Multi-Arch:

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Steve Langasek
On Wed, Feb 08, 2012 at 10:22:17AM +, Neil Williams wrote: After all, this is how cross/foreign architecture packages have *always* been handled in Debian via dpkg-cross. Nothing in /usr/share/ matters for a cross package created by dpkg-cross (with the possible exception of

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Charles Plessy
Le Wed, Feb 08, 2012 at 07:54:47PM +, Roger Leigh a écrit : Relating to binNMU changelogs: do they really serve any purpose? There are no source changes, so is there any real need for a changelog change at all? AFAICT the only reason we do for historical reasons, it being the only way

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russ Allbery
Steve Langasek vor...@debian.org writes: The unfounded assumption here is that you will always install a foreign-arch M-A: same package together with the native-arch version. If I install libaudio2:i386 because I want to play a game that's only available as a 32-bit binary and has this lib as

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Steve Langasek
On Wed, Feb 08, 2012 at 04:55:02PM -0800, Russ Allbery wrote: Steve Langasek vor...@debian.org writes: The unfounded assumption here is that you will always install a foreign-arch M-A: same package together with the native-arch version. If I install libaudio2:i386 because I want to play a

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Russ Allbery
Steve Langasek vor...@debian.org writes: On Wed, Feb 08, 2012 at 04:55:02PM -0800, Russ Allbery wrote: Steve Langasek vor...@debian.org writes: The unfounded assumption here is that you will always install a foreign-arch M-A: same package together with the native-arch version. If I install

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Wookey
+++ Russ Allbery [2012-02-08 13:47 -0800]: Neil Williams codeh...@debian.org writes: Russ Allbery r...@debian.org wrote: Oh, good point, I'd forgotten that for multiarch the symlink is architecture-dependent. So yes, the -dev package is inherently architecture-dependent. I would drop

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Guillem Jover
On Wed, 2012-02-08 at 15:14:35 -0800, Steve Langasek wrote: So I had a look at the Ubuntu archive, which already has a large collection of packages converted to Multi-Arch: same, to provide some hard facts for this discussion. - 2197 files are shipped in /usr/share by these packages,

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Guillem Jover
On Wed, 2012-02-08 at 22:01:23 +0100, Jakub Wilk wrote: In practice, the only compressor we need to care is gzip, which is not actively maintained upstream[0]. Chances that a new version of it will break large number of packages are minute. That assumes that we will never want to switch to a

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-08 Thread Marco d'Itri
On Feb 09, Steve Langasek vor...@debian.org wrote: I think there are pretty solid benefits to proceeding with a dpkg that allows sharing files across M-A: same packages. Agreed. Fix the tools instead of breaking the standard to adapt to broken tools. Myself, I like the idea of the implicit

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Neil Williams
On Mon, 6 Feb 2012 08:31:15 +0100 Raphael Hertzog hert...@debian.org wrote: If you discover any bug in dpkg's multiarch implementation, please report it to the BTS (against the version 1.16.2~wipmultiarch). I'd like to ask for some help with a bug which is tripping up my tests with the

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Michael Biebl
On 07.02.2012 10:59, Neil Williams wrote: It would be a very laborious task to check the md5sums of every .gz file in /usr/share/doc in every MultiArch: same package across all architectures and the Contents-* files on the mirrors don't contain the filesize of the listed files. Does anyone

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Joey Hess
Neil Williams wrote: I'd like to ask for some help with a bug which is tripping up my tests with the multiarch-aware dpkg from experimental - #647522 - non-deterministic behaviour of gzip -9n. pristine-tar hat tricks[1] aside, none of gzip, bzip2, xz are required to always produce the same

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Michael Biebl
On 07.02.2012 18:07, Joey Hess wrote: Neil Williams wrote: I'd like to ask for some help with a bug which is tripping up my tests with the multiarch-aware dpkg from experimental - #647522 - non-deterministic behaviour of gzip -9n. pristine-tar hat tricks[1] aside, none of gzip, bzip2, xz

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Steve Langasek
Hi Joey, On Tue, Feb 07, 2012 at 01:07:11PM -0400, Joey Hess wrote: Neil Williams wrote: I'd like to ask for some help with a bug which is tripping up my tests with the multiarch-aware dpkg from experimental - #647522 - non-deterministic behaviour of gzip -9n. pristine-tar hat tricks[1]

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Neil Williams
On Tue, 07 Feb 2012 19:11:16 +0100 Michael Biebl bi...@debian.org wrote: On 07.02.2012 18:07, Joey Hess wrote: Neil Williams wrote: I'd like to ask for some help with a bug which is tripping up my tests with the multiarch-aware dpkg from experimental - #647522 - non-deterministic

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Neil Williams
On Tue, 7 Feb 2012 14:01:57 -0800 Steve Langasek vor...@debian.org wrote: There are various ways to meet both the multiarch constraints and the policy requirements, including shipping an arch:all common package that will contain the changelog for each multiarch library, which then ships just a

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Ben Hutchings
On Tue, Feb 07, 2012 at 10:04:04PM +, Neil Williams wrote: On Tue, 07 Feb 2012 19:11:16 +0100 Michael Biebl bi...@debian.org wrote: On 07.02.2012 18:07, Joey Hess wrote: Neil Williams wrote: I'd like to ask for some help with a bug which is tripping up my tests with the

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Russ Allbery
Neil Williams codeh...@debian.org writes: Maybe the way to solve this properly is to remove compression from the uniqueness check - compare the contents of the file in memory after decompression. Yes, it will take longer but it is only needed when the md5sum (which already exists) doesn't

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Henrique de Moraes Holschuh
On Tue, 07 Feb 2012, Ben Hutchings wrote: But it's worse than this: even if dpkg decompresses before comparing, debsums won't (and mustn't, for backward compatibility). So it's Maybe you can switch to sha256 and add the new functionality while at it? Detect which mode (md5sum raw, sha256

Re: Please test gzip -9n - related to dpkg with multiarch support

2012-02-07 Thread Jonathan Nieder
Henrique de Moraes Holschuh wrote: Maybe you can switch to sha256 and add the new functionality while at it? Detect which mode (md5sum raw, sha256 uncompress) by the size of the hash. Old debsums won't work with the new files, but is that really a problem? That's what stable updates and

  1   2   >