Re: jigdo-lite Error: ... does not match checksum in template data
On Sat, Oct 02, 2004 at 06:52:40PM +0200, Richard Atterer wrote: > >$ jigdo-file mt -fi adduser_3.59_all.deb -j grr.jigdo -t grr.template >adduser_3.59_all.deb >Match of `adduser_3.59_all.deb' at offset 0 >Finished - image size is 93882 bytes. >$ jigdo-file ls -t grr.template >need-file 093882 K3IwZGUJlF7q6sCv7t8PfA kRjI35yjRzk >image-info 93882 K3IwZGUJlF7q6sCv7t8PfA 1024 >$ jigdo-file ls -t grr.template --hex >need-file 093882 2b7230646509945eeaeac0afeedf0f7c >9118c8df9ca34739 >image-info 93882 2b7230646509945eeaeac0afeedf0f7c 1024 > >This means that the Rsync64Sum expected by jigdo-file is kRjI35yjRzk, or >9118c8df9ca34739 in hexadecimal. For the algorithm, this means that >lo=0xdfc81891, hi=0x3947a39c. > >The JTE-generated .template contains something else: > >$ jigdo-file ls -t sarge-i386-1.template|grep 52803584 >need-file 5280358493882 K3IwZGUJlF7q6sCv7t8PfA gIOeQJMjgK4 >$ jigdo-file ls -t sarge-i386-1.template --hex|grep 52803584 >need-file 5280358493882 2b7230646509945eeaeac0afeedf0f7c >80839e40932380ae > >So for JTE, lo=0x409e8380 and hi=0xae802393 - the bytes are not just >reordered like I initially suspected, but completely different. %-| Having >stared at JTE's implementation of the algorithm as well as jigdo-file's (in >src/rsyncsum.cc:73), I cannot figure out any differences. Grr, I'll have a >closer look tomorrow - unless Steve beats me in finding the bug. ;-) I can't promise anything at the moment; I'm stuck away from home with a family emergency right now. I tested this, so I'm surprised it doesn't work... :-( I'll see if I can take a look. -- Steve McIntyre, Cambridge, UK.[EMAIL PROTECTED] We don't need no education. We don't need no thought control. signature.asc Description: Digital signature
Re: Latest Sarge dvd jigdos - NFA needed
On Sunday 03 October 2004 03:31, Robert Parker wrote: > I just downloaded the latest jigdos and templates from: > > http://cdimage.debian.org/pub/cdimage-testing/dvd/jigdo-area/i386/ > > Not only do I get 100% (or nearly so) rejection due to errors from my loop > mounted iso's from last week, I get the same error rate from my local > mirror and also when I access: > > http://gluck.debian.org/cdimage/snapshot/dvd/i386/Debian/ > > Hardly conducive to keeping the load off the servers! > > What gives. > > Bob Sorry, just got Richards post on this list. No action needed. Bob -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Latest Sarge dvd jigdos
I just downloaded the latest jigdos and templates from: http://cdimage.debian.org/pub/cdimage-testing/dvd/jigdo-area/i386/ Not only do I get 100% (or nearly so) rejection due to errors from my loop mounted iso's from last week, I get the same error rate from my local mirror and also when I access: http://gluck.debian.org/cdimage/snapshot/dvd/i386/Debian/ Hardly conducive to keeping the load off the servers! What gives. Bob -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: jigdo-lite Error: ... does not match checksum in template data
OK, I know now what causes the problem. I haven't found the error in JTE (or jigdo-file?) yet. Downloaders, as a short-term workaround add "--no-check-files" to jigdoOpts in your ~/.jigdo-lite. As of version 1.12, JTE not only outputs md5sums for each file, but also an "Rsync64Sum" for the first 1k of each file. I asked Steve to implement this - in the future, it'll allow the jigdo GUI to abort downloads early if the checksum of the first 1k doesn't match during the download. JTE 1.11 outputs a zero "blockLen" field to the .template, which switches off comparison of Rsync64Sums by "jigdo-file make-image" (used by jigdo-lite). JTE 1.12 sets "blockLen" to 1024, but outputs a wrong Rsync64Sum. With our example file, adduser_3.59_all.deb: $ jigdo-file mt -fi adduser_3.59_all.deb -j grr.jigdo -t grr.template adduser_3.59_all.deb Match of `adduser_3.59_all.deb' at offset 0 Finished - image size is 93882 bytes. $ jigdo-file ls -t grr.template need-file 093882 K3IwZGUJlF7q6sCv7t8PfA kRjI35yjRzk image-info 93882 K3IwZGUJlF7q6sCv7t8PfA 1024 $ jigdo-file ls -t grr.template --hex need-file 093882 2b7230646509945eeaeac0afeedf0f7c 9118c8df9ca34739 image-info 93882 2b7230646509945eeaeac0afeedf0f7c 1024 This means that the Rsync64Sum expected by jigdo-file is kRjI35yjRzk, or 9118c8df9ca34739 in hexadecimal. For the algorithm, this means that lo=0xdfc81891, hi=0x3947a39c. The JTE-generated .template contains something else: $ jigdo-file ls -t sarge-i386-1.template|grep 52803584 need-file 5280358493882 K3IwZGUJlF7q6sCv7t8PfA gIOeQJMjgK4 $ jigdo-file ls -t sarge-i386-1.template --hex|grep 52803584 need-file 5280358493882 2b7230646509945eeaeac0afeedf0f7c 80839e40932380ae So for JTE, lo=0x409e8380 and hi=0xae802393 - the bytes are not just reordered like I initially suspected, but completely different. %-| Having stared at JTE's implementation of the algorithm as well as jigdo-file's (in src/rsyncsum.cc:73), I cannot figure out any differences. Grr, I'll have a closer look tomorrow - unless Steve beats me in finding the bug. ;-) Cheers, Richard -- __ _ |_) /| Richard Atterer | GnuPG key: | \/¯| http://atterer.net | 0x888354F7 ¯ '` ¯ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: jigdo-lite Error: ... does not match checksum in template data
( Sorry for sending this again but the first was only a follow-up post through a news2mail gateway to [EMAIL PROTECTED] ) Richard Atterer <[EMAIL PROTECTED]> wrote: > On Sat, Oct 02, 2004 at 03:12:14PM +0200, Achim Löbbert wrote: > > using yesterday's official sarge templates I am getting tons of errors > > once jigdo-lite starts to write the DVD iso image: > [...] > > Merging parts from `file:' URIs, if any... > > Found 6720 of the 6720 files required by the template > > Error: > > `/pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb' does > > not match checksu m in template data > > Error: `/pub/mirrors/ftp.debian.org/debian/pool/main/a/apt/apt_0.5.27_i386.deb' > > does not match checksum in template data > > As you say later, this error only happens if a file's md5sum changes > between the initial scan and copying the matching file to the image. :-| This time I let it run until it wrote 100% of the image. Then it started to download files in some random, at least non-alphabetic order. After the first 10 files there is this message: FINISHED --16:15:24-- Downloaded: 4,462,916 bytes in 10 files Found 10 of the 5042 files required by the template which indicates to me that it wants to download 5042 of the 6720 files required by the template. Of course I stopped it again. > Apart from undetected read errors on your HD (unlikely...), another I compared the files downloaded to a tmp directory with the ones of my mirror and found them to be identical: $ cd ./sarge-i386-1.iso.tmpdir/gluck.debian.org/cdimage/snapshot/dvd/i386/Debian/pool/main $ find -type f ./g/gxine/gxine_0.3.3-3_i386.deb ./g/gnutls11/gnutls-bin_1.0.16-7_i386.deb ./j/joystick/joystick_20010903-2_i386.deb ./l/lg-issue50/lg-issue50_2-1_all.deb ./s/sc/sc_7.16-2_i386.deb ./libc/libcaca/libcaca-dev_0.9-4_i386.deb ./libh/libhtml-tree-perl/libhtml-tree-perl_3.18-1_all.deb ./libp/libproplist/libproplist0_0.10.1-8_i386.deb ./libt/libtool/libtool-doc_1.5.6-2_all.deb $ cmp g/gnutls11/gnutls-bin_1.0.16-7_i386.deb \ /pub/mirrors/ftp.debian.org/debian/pool/main/g/gnutls11/gnutls-bin_1.0.16-7_i386.deb > reason for this might be a corrupted cache file. I first tried with a two week old jigdo-file-cache.db in the same directory. Next time I deleted it prior to running jigdo-lite, both with the same result. > You can check whether this is the case by trying > > jigdo-file --cache=path/to/cache.db md5sum > /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3 .59_all.deb > > once with and once without the --cache switch. $ jigdo-file --cache=jigdo-file-cache.db md5sum /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_ 3.59_all.deb K3IwZGUJlF7q6sCv7t8PfA /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb $ jigdo-file md5sum /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb K3IwZGUJlF7q6sCv7t8PfA /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb Both checksums look the same. > This problem with the cache will also appear if something changed the > content of files in your mirror without also changing the mtime of the > file. Examples include incorrect mirroring (rsync problems?) or storing the > mirror on a FAT32 filesystem and enabling its broken CRLF<->LF conversion. The mirror is on a ReiserFS on kernel 2.6.8.1, kept up-to-date by a modified debmirror. Purging is done by own script with 90 days latency. The mirror logs show no problems. > > Files in the local mirror [file:/pub/mirrors/ftp.debian.org/debian/] are > > unlikely to have changed between the scan and writing the image. Two > > weeks ago jigdo-lite version 0.7.1-4 did not produce such errors. > > And the version that exhibits the problem is also 0.7.1-4? Yes, I use that version since July 6th. Achim
Re: jigdo-lite Error: ... does not match checksum in template data
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Achim Achim Löbbert wrote: | using yesterday's official sarge templates I am getting tons of errors | once jigdo-lite starts to write the DVD iso image: Same Problem here. I think there's a problem in the jidgo-templates, last weeks templates worked perfectly. Greetings Markus -BEGIN PGP SIGNATURE- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFBXsEw7DLmG4oCQnQRAgMYAJ9ibnNH8iNwY3V1S/x3+nMk1sybFACcCeXX rW2f2s/X6CIvz11Krgqb6vA= =qiDf -END PGP SIGNATURE-
Bug#274511: devfs on sarge install cd is confusing for newbies
reassign 274511 debian-installer severity 274511 wishlist thanks On Sat, Oct 02, 2004 at 01:25:38PM +0200, Rene Engelhard wrote: > Package: cdrom, d-i > Severity: important > > [ not sure which package to file it against; reassign as appropriate if > needed ] > > Hi, > > when you install sarge (or use the rescue system) you get devfs. This *so* won't be fixed for sarge. :-) It's quite deeply embedded in the d-i code. For etch, we'll probably move to something else, but now is not the time. > However, Linux newbies or people switching from other distributions not > using devfs (and not knowing that something like this exists or how it > works - devfs is deprecated after all) are going to be seriously > confused By and large, they shouldn't have to care. The installed system doesn't use devfs, and new users won't have to poke around in the installer environment too much. > The resulting system installed by d-i doesn't so what is the reason > you use devfs/the desired effect? We don't have room for static device nodes, and no alternatives were available at the time when that part of d-i was originally written. devfsd wouldn't fit in a number of the images, and would probably only cause unnecessary confusion. Cheers, -- Colin Watson [EMAIL PROTECTED] -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: jigdo-lite Error: ... does not match checksum in template data
Richard Atterer <[EMAIL PROTECTED]> wrote: > On Sat, Oct 02, 2004 at 03:12:14PM +0200, Achim Löbbert wrote: > > using yesterday's official sarge templates I am getting tons of errors > > once jigdo-lite starts to write the DVD iso image: > [...] > > Merging parts from `file:' URIs, if any... > > Found 6720 of the 6720 files required by the template > > Error: > > `/pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb' does > > not match checksum in template data > > Error: `/pub/mirrors/ftp.debian.org/debian/pool/main/a/apt/apt_0.5.27_i386.deb' > > does not match checksum in template data > > As you say later, this error only happens if a file's md5sum changes > between the initial scan and copying the matching file to the image. :-| This time I let it run until it wrote 100% of the image. Then it started to download files in some random, at least non-alphabetic order. After the first 10 files there is this message: FINISHED --16:15:24-- Downloaded: 4,462,916 bytes in 10 files Found 10 of the 5042 files required by the template which indicates to me that it wants to download 5042 of the 6720 files required by the template. Of course I stopped it again. > Apart from undetected read errors on your HD (unlikely...), another I compared the files downloaded to a tmp directory with the ones of my mirror and found them to be identical: $ cd ./sarge-i386-1.iso.tmpdir/gluck.debian.org/cdimage/snapshot/dvd/i386/Debian/pool/main $ find -type f ./g/gxine/gxine_0.3.3-3_i386.deb ./g/gnutls11/gnutls-bin_1.0.16-7_i386.deb ./j/joystick/joystick_20010903-2_i386.deb ./l/lg-issue50/lg-issue50_2-1_all.deb ./s/sc/sc_7.16-2_i386.deb ./libc/libcaca/libcaca-dev_0.9-4_i386.deb ./libh/libhtml-tree-perl/libhtml-tree-perl_3.18-1_all.deb ./libp/libproplist/libproplist0_0.10.1-8_i386.deb ./libt/libtool/libtool-doc_1.5.6-2_all.deb $ cmp g/gnutls11/gnutls-bin_1.0.16-7_i386.deb \ /pub/mirrors/ftp.debian.org/debian/pool/main/g/gnutls11/gnutls-bin_1.0.16-7_i386.deb > reason for this might be a corrupted cache file. I first tried with a two week old jigdo-file-cache.db in the same directory. Next time I deleted it prior to running jigdo-lite, both with the same result. > You can check whether this is the case by trying > > jigdo-file --cache=path/to/cache.db md5sum > /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb > > once with and once without the --cache switch. $ jigdo-file --cache=jigdo-file-cache.db md5sum /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb K3IwZGUJlF7q6sCv7t8PfA /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb $ jigdo-file md5sum /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb K3IwZGUJlF7q6sCv7t8PfA /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb Both checksums look the same. > This problem with the cache will also appear if something changed the > content of files in your mirror without also changing the mtime of the > file. Examples include incorrect mirroring (rsync problems?) or storing the > mirror on a FAT32 filesystem and enabling its broken CRLF<->LF conversion. The mirror is on a ReiserFS on kernel 2.6.8.1, kept up-to-date by a modified debmirror. Purging is done by own script with 90 days latency. The mirror logs show no problems. > > Files in the local mirror [file:/pub/mirrors/ftp.debian.org/debian/] are > > unlikely to have changed between the scan and writing the image. Two > > weeks ago jigdo-lite version 0.7.1-4 did not produce such errors. > > And the version that exhibits the problem is also 0.7.1-4? Yes, I use that version since July 6th. Achim -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Processed: Re: Bug#274511: devfs on sarge install cd is confusing for newbies
Processing commands for [EMAIL PROTECTED]: > reassign 274511 debian-installer Bug#274511: devfs on sarge install cd is confusing for newbies Bug reassigned from package `cdrom, debian-installer' to `debian-installer'. > severity 274511 wishlist Bug#274511: devfs on sarge install cd is confusing for newbies Severity set to `wishlist'. > thanks Stopping processing here. Please contact me if you need assistance. Debian bug tracking system administrator (administrator, Debian Bugs database) -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: Calculation of cd sizes implemented and tested, should I commit?
Quoting Santiago Garcia Mantinan: > Hi! > > It is two weeks since we started using at gluck the code I made to try to > estimate the sizes of the cd parts that debian-cd was not controling, it > seems to be working ok, so I was wondering if I should commit it :-? Of course ! Please go for it. Cheers, -- Raphaël Hertzog -+- http://www.ouaza.com Formation Linux et logiciel libre : http://www.logidee.com Earn money with free software: http://www.geniustrader.org -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Re: jigdo-lite Error: ... does not match checksum in template data
On Sat, Oct 02, 2004 at 03:12:14PM +0200, Achim Löbbert wrote: > using yesterday's official sarge templates I am getting tons of errors > once jigdo-lite starts to write the DVD iso image: [...] > Merging parts from `file:' URIs, if any... > Found 6720 of the 6720 files required by the template > Error: `/pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb' > does not match checksum in template data > Error: `/pub/mirrors/ftp.debian.org/debian/pool/main/a/apt/apt_0.5.27_i386.deb' does > not match checksum in template data As you say later, this error only happens if a file's md5sum changes between the initial scan and copying the matching file to the image. :-| Apart from undetected read errors on your HD (unlikely...), another reason for this might be a corrupted cache file. You can check whether this is the case by trying jigdo-file --cache=path/to/cache.db md5sum /pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb once with and once without the --cache switch. This problem with the cache will also appear if something changed the content of files in your mirror without also changing the mtime of the file. Examples include incorrect mirroring (rsync problems?) or storing the mirror on a FAT32 filesystem and enabling its broken CRLF<->LF conversion. > Files in the local mirror [file:/pub/mirrors/ftp.debian.org/debian/] are > unlikely to have changed between the scan and writing the image. Two > weeks ago jigdo-lite version 0.7.1-4 did not produce such errors. And the version that exhibits the problem is also 0.7.1-4? Cheers, Richard -- __ _ |_) /| Richard Atterer | GnuPG key: | \/¯| http://atterer.net | 0x888354F7 ¯ '` ¯ -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
jigdo-lite Error: ... does not match checksum in template data
Hi, using yesterday's official sarge templates I am getting tons of errors once jigdo-lite starts to write the DVD iso image: [EMAIL PROTECTED]:[/pub/mirrors/cdimage.debian.org/cdimage-testing/dvd/jigdo-area/i386] > jigdo-lite sarge-i386-1.jigdo [...] Further information about `sarge-i386-1.iso': Generated on Fri, 1 Oct 2004 18:33:18 -0600 [...] Merging parts from `file:' URIs, if any... Found 6720 of the 6720 files required by the template Error: `/pub/mirrors/ftp.debian.org/debian/pool/main/a/adduser/adduser_3.59_all.deb' does not match checksum in template data Error: `/pub/mirrors/ftp.debian.org/debian/pool/main/a/apt/apt_0.5.27_i386.deb' does not match checksum in template data Error: `/pub/mirrors/ftp.debian.org/debian/pool/main/a/apt/apt-doc_0.5.27_all.deb' does not match checksum in template data Error: `/pub/mirrors/ftp.debian.org/debian/pool/main/a/apt/apt-utils_0.5.27_i386.deb' does not match checksum in template data [...] jigdo-file failed with code 130 - aborting. Here I stopped it using Control-C without waiting for it to complain about probably all files and possibly downloading them again. Files in the local mirror [file:/pub/mirrors/ftp.debian.org/debian/] are unlikely to have changed between the scan and writing the image. Two weeks ago jigdo-lite version 0.7.1-4 did not produce such errors. Does anyone else have similar problems? Achim -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Processed: Re: Bug#274511: Acknowledgement (devfs on sarge install cd is confusing for newbies)
Processing commands for [EMAIL PROTECTED]: > # oops, d-i isn't the pseudopqackage ;) > reassign 274511 cdrom, debian-installer Bug#274511: devfs on sarge install cd is confusing for newbies Warning: Unknown package 'd-i' Bug reassigned from package `cdrom, d-i' to `cdrom, debian-installer'. > thanks Stopping processing here. Please contact me if you need assistance. Debian bug tracking system administrator (administrator, Debian Bugs database) -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
Bug#274511: devfs on sarge install cd is confusing for newbies
Package: cdrom, d-i Severity: important [ not sure which package to file it against; reassign as appropriate if needed ] Hi, when you install sarge (or use the rescue system) you get devfs. While it was quite a culture shock for me when I tried this a few months ago where I first tried install sarge I did manage it with almost no big problems since I did know the logic a bit and could use bash to look. However, Linux newbies or people switching from other distributions not using devfs (and not knowing that something like this exists or how it works - devfs is deprecated after all) are going to be seriously confused They often just know about /dev/hda*, /dev/sda* etc. but not about /dev/ide/* etc. - especially since things like fdisk talk about /dev/hda etc. - but there is no symlink from the "normal, known names" to the devfs ones. Someone told me that devfsd normally does this? Can it be that it isn't ran? It either should be run to have those links or d-i shouldn't use devfs all all. The resulting system installed by d-i doesn't so what is the reason you use devfs/the desired effect? Grüße/Regards, René -- System Information: Debian Release: 3.1 APT prefers testing APT policy: (500, 'testing') Architecture: i386 (i686) Kernel: Linux 2.6.8.1 Locale: [EMAIL PROTECTED], [EMAIL PROTECTED] signature.asc Description: Digital signature
