Bug#1050815: snapshot.d.o has been in a bad state for several months
package: snapshot.debian.org severity: important x-debbugs-cc: debian-devel@lists.debian.org, reproducible-bui...@lists.alioth.debian.org Hi, filing this as a bug report, again, because the problem has become worse than when #1031628 was filed and since snapshot.d.o is part of the central services Debian provides and it should work better than it does right now. else, why do we operate it? ;) On Wed, Aug 02, 2023 at 01:33:11PM +0200, Johannes Schauer Marin Rodrigues wrote: > snapshot.debian.org is getting worse again. There is not a single snapshot for > August yet and the last days of July are spotty: > > http://snapshot.debian.org/archive/debian/?year=2023=7 > > None for the 29. and only a single timestamp for the 26., 27., 28. and 30. > There should be four per day. The situation is even worse for other archives. > For debian-ports, for the month of July, there are only 22 snapshots overall: > > http://snapshot.debian.org/archive/debian-ports/?year=2023=7 > > This problem has been known for half a year already: > > https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1031628 > > But that bug got closed in favor of #1029744 which was filed because > debian-ports had no snapshots at all for January and only three for February > this year but there is no reply to that bug. > > In #1031628 Julien said that there is "not much we can do about it at the > moment". > > What is the status of this problem? What is needed to fix it? Is this just a > problem of computational and/or storage resources which an be fixed by the > funds available to Debian? > > I'd argue that snapshot.d.o is part of the central services Debian provides > and > it should work better than it does right now. On https://snapshot.debian.org/archive/debian-ports/?year=2023=8 I count 31 snapshot for those 29 days of August so far, with no snapshots so far for 2023-08-01, 2023-08-08, 2023-08-17 and 2023-08-29. But it get's worse: On Wed, Aug 09, 2023 at 11:34:56AM -0400, Theodore Ts'o wrote: > BTW, it also looks like not only are some snapshots not being taken, > some of the snapshots are missing packages. For example: > >https://snapshot.debian.org/archive/debian/20230806T091912Z/ > > is missing the package libc-dev-bin, and: > >https://snapshot.debian.org/archive/debian/20230807T150823Z/ > > is missing the package dbus. Which is something that I'm finding when > I try building an kvm-xfstests VM using: > > https://github.com/tytso/xfstests-bld/blob/master/test-appliance/gen-image > > Ah, well, I guess I'll try the snapshot for 20230805T151946Z next Please don't just close this bug report as it was done with #1031628, it's useful to be able to track this, point out that this problem has been existed since some time and have a place to discussion workarounds. Also, how can one start helping with this issue (or others)? where does the snapshot team communicate? https://salsa.debian.org/snapshot-team/snapshot/-/commits/master has not seen any commit since 7 months. -- cheers, Holger ⢀⣴⠾⠻⢶⣦⠀ ⣾⠁⢠⠒⠀⣿⡁ holger@(debian|reproducible-builds|layer-acht).org ⢿⡄⠘⠷⠚⠋⠀ OpenPGP: B8BF54137B09D35CF026FE9D 091AB856069AAA1C ⠈⠳⣄ Alles weird gut. signature.asc Description: PGP signature
Re: snapshot.d.o has been in a bad state for several months
On 2023-08-02 13:33, Johannes Schauer Marin Rodrigues wrote: > snapshot.debian.org is getting worse again. There is not a single snapshot for > August yet and the last days of July are spotty: [...] > I'd argue that snapshot.d.o is part of the central services Debian provides > and > it should work better than it does right now. I second this, snapshot.d.o pas proven to be an invaluable tool for reproducing issues. Is there any way we can help resolve the open issues? Best, Christian
Re: snapshot.d.o has been in a bad state for several months
On Wed, Aug 09, 2023 at 08:31:09AM +0200, Bjørn Mork wrote: > "Theodore Ts'o" writes: > > > I was curious about this, since I rely on snapshots.debian.org in > > order to create repeatable builds for a file system test appliance, so > > I started digging a bit. Looking at the debian-bugs pseudo-package > > "snapshot.debian.org": > > > > https://bugs.debian.org/cgi-bin/pkgreport.cgi?package=snapshot.debian.org > > > > the maintainer is listed as: > > > > "snapshot.debian.org Team " > > > > But according to lists.debian.org, "debian-shaphots" is a dead list, > > "debian-shaphots" != "debian-shapshot" :-) > > https://lists.debian.org/debian-snapshot/ Ah, I see. I was looking for the mailing list under: https://lists.debian.org/devel.html and that seems to where the old debian-snapshots list. I guess at some point ten years ago that list was killed, and debian-snapshot was created under: https://lists.debian.org/misc.html BTW, it also looks like not only are some snapshots not being taken, some of the snapshots are missing packages. For example: https://snapshot.debian.org/archive/debian/20230806T091912Z/ is missing the package libc-dev-bin, and: https://snapshot.debian.org/archive/debian/20230807T150823Z/ is missing the package dbus. Which is something that I'm finding when I try building an kvm-xfstests VM using: https://github.com/tytso/xfstests-bld/blob/master/test-appliance/gen-image Ah, well, I guess I'll try the snapshot for 20230805T151946Z next - Ted
Re: snapshot.d.o has been in a bad state for several months
"Theodore Ts'o" writes: > I was curious about this, since I rely on snapshots.debian.org in > order to create repeatable builds for a file system test appliance, so > I started digging a bit. Looking at the debian-bugs pseudo-package > "snapshot.debian.org": > > https://bugs.debian.org/cgi-bin/pkgreport.cgi?package=snapshot.debian.org > > the maintainer is listed as: > > "snapshot.debian.org Team " > > But according to lists.debian.org, "debian-shaphots" is a dead list, "debian-shaphots" != "debian-shapshot" :-) https://lists.debian.org/debian-snapshot/ Bjørn
Re: snapshot.d.o has been in a bad state for several months
Hi Ted, * Theodore Ts'o [2023-08-08 20:28]: I was curious about this, since I rely on snapshots.debian.org in ^ snapshot ;) order to create repeatable builds for a file system test appliance, so I started digging a bit. Looking at the debian-bugs pseudo-package "snapshot.debian.org": https://bugs.debian.org/cgi-bin/pkgreport.cgi?package=snapshot.debian.org the maintainer is listed as: "snapshot.debian.org Team " But according to lists.debian.org, "debian-shaphots" is a dead list, and apparently the last archived message to the list is from September 2001: https://lists.debian.org/debian-snapshots/ ^ snapshot ;) The list is here and seems active: https://lists.debian.org/debian-snapshot/ @josch: maybe ask on that list as well. Cheers Jochen signature.asc Description: PGP signature
Re: snapshot.d.o has been in a bad state for several months
On Wed, Aug 02, 2023 at 01:33:11PM +0200, Johannes Schauer Marin Rodrigues wrote: > Hi, > > snapshot.debian.org is getting worse again. There is not a single snapshot for > August yet and the last days of July are spotty: > > http://snapshot.debian.org/archive/debian/?year=2023=7 > > None for the 29. and only a single timestamp for the 26., 27., 28. and 30. > There should be four per day. The situation is even worse for other archives. > For debian-ports, for the month of July, there are only 22 snapshots overall: > > http://snapshot.debian.org/archive/debian-ports/?year=2023=7 > > This problem has been known for half a year already: > > https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1031628 > > But that bug got closed in favor of #1029744 which was filed because > debian-ports had no snapshots at all for January and only three for February > this year but there is no reply to that bug. > > In #1031628 Julien said that there is "not much we can do about it at the > moment". > > What is the status of this problem? What is needed to fix it? Is this just a > problem of computational and/or storage resources which an be fixed by the > funds available to Debian? I was curious about this, since I rely on snapshots.debian.org in order to create repeatable builds for a file system test appliance, so I started digging a bit. Looking at the debian-bugs pseudo-package "snapshot.debian.org": https://bugs.debian.org/cgi-bin/pkgreport.cgi?package=snapshot.debian.org the maintainer is listed as: "snapshot.debian.org Team " But according to lists.debian.org, "debian-shaphots" is a dead list, and apparently the last archived message to the list is from September 2001: https://lists.debian.org/debian-snapshots/ That seems unfortunate. - Ted
snapshot.d.o has been in a bad state for several months
Hi, snapshot.debian.org is getting worse again. There is not a single snapshot for August yet and the last days of July are spotty: http://snapshot.debian.org/archive/debian/?year=2023=7 None for the 29. and only a single timestamp for the 26., 27., 28. and 30. There should be four per day. The situation is even worse for other archives. For debian-ports, for the month of July, there are only 22 snapshots overall: http://snapshot.debian.org/archive/debian-ports/?year=2023=7 This problem has been known for half a year already: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1031628 But that bug got closed in favor of #1029744 which was filed because debian-ports had no snapshots at all for January and only three for February this year but there is no reply to that bug. In #1031628 Julien said that there is "not much we can do about it at the moment". What is the status of this problem? What is needed to fix it? Is this just a problem of computational and/or storage resources which an be fixed by the funds available to Debian? I'd argue that snapshot.d.o is part of the central services Debian provides and it should work better than it does right now. Thanks! cheers, josch signature.asc Description: signature
