Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Sat, Jan 26, 2008 at 06:21:16PM +0100, Raphael Hertzog wrote: targetfile = %s/%s.0.txt % (dir, info['timestamp']) At least it'll fix the sorting order... Yes, but it will add the .0 to all files. While not using it we will have the extra digit only when needed, which I hope are exception rather than rules. If you really want to have the sorting fixed (which, let me insist, should be not that relevant, given that all the mails we are talking about have been sent in the very same second) I prefer to use a custom sorting function. Thanks for the feedback. Cheers. -- Stefano Zacchiroli -*- PhD in Computer Science ... now what? [EMAIL PROTECTED],cs.unibo.it,debian.org} -%- http://upsilon.cc/zack/ (15:56:48) Zack: e la demo dema ?/\All one has to do is hit the (15:57:15) Bac: no, la demo scema\/right keys at the right time -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Sun, 27 Jan 2008, Stefano Zacchiroli wrote: On Sat, Jan 26, 2008 at 06:21:16PM +0100, Raphael Hertzog wrote: targetfile = %s/%s.0.txt % (dir, info['timestamp']) At least it'll fix the sorting order... Yes, but it will add the .0 to all files. While not using it we will have the extra digit only when needed, which I hope are exception rather than rules. If you really want to have the sorting fixed (which, let me insist, should be not that relevant, given that all the mails we are talking about have been sent in the very same second) I prefer to use a custom sorting function. Do you really find the URL nice enough to worry for a .0 ? I believe the sorting to be important because even if it's the same second, I think they are sent in order of increasing versions. And it wouldn't be nice to see: Accepted 1.0-1 Accepted 1.0-3 Accepted 1.0-2 Cheers, -- Raphaël Hertzog Le best-seller français mis à jour pour Debian Etch : http://www.ouaza.com/livre/admin-debian/
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Fri, Jan 25, 2008 at 08:05:01PM +0100, Stefano Zacchiroli wrote: Moreover, and that's the main point of this report, it seems that the last time the clash happened was January 2006, no other clashes in 2007 nor 2008. Is it possible that the issue has been solved elsewhere and the clash no longer happens? And indeed this diff explains the reason: [EMAIL PROTECTED]:/srv/debian/pts/www/bin$ svn diff -r1281:1282 common.py|grep -C 2 raise +targetfile = %s/%s.txt % (dir, info['timestamp']) +if os.path.isfile(targetfile): +raise(Aiee, already such message %s % targetfile) +f = open(targetfile, w) f.write(msg.as_string()) it is dated February 2006. So, starting from there on, duplicate news are refused on the basis of its timestamp alone. I will then get rid of duplicates and see what to do with the other strange files ... Cheers. -- Stefano Zacchiroli -*- PhD in Computer Science ... now what? [EMAIL PROTECTED],cs.unibo.it,debian.org} -%- http://upsilon.cc/zack/ (15:56:48) Zack: e la demo dema ?/\All one has to do is hit the (15:57:15) Bac: no, la demo scema\/right keys at the right time -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Sat, 26 Jan 2008, Stefano Zacchiroli wrote: On Fri, Jan 25, 2008 at 08:05:01PM +0100, Stefano Zacchiroli wrote: Moreover, and that's the main point of this report, it seems that the last time the clash happened was January 2006, no other clashes in 2007 nor 2008. Is it possible that the issue has been solved elsewhere and the clash no longer happens? And indeed this diff explains the reason: [EMAIL PROTECTED]:/srv/debian/pts/www/bin$ svn diff -r1281:1282 common.py|grep -C 2 raise +targetfile = %s/%s.txt % (dir, info['timestamp']) +if os.path.isfile(targetfile): +raise(Aiee, already such message %s % targetfile) +f = open(targetfile, w) f.write(msg.as_string()) it is dated February 2006. So, starting from there on, duplicate news are refused on the basis of its timestamp alone. I will then get rid of duplicates and see what to do with the other strange files ... Note that this behaviour should be fixed. It happens that dak send several Accepted mails during the same second for example when the package gets out of NEW and when several upload happened while the package was sitting in NEW. I remember neuro complaining about getting bounces on those cases. Jeroen never got around to fix that. Cheers, -- Raphaël Hertzog Le best-seller français mis à jour pour Debian Etch : http://www.ouaza.com/livre/admin-debian/
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Sat, Jan 26, 2008 at 02:17:19PM +0100, Raphael Hertzog wrote: Note that this behaviour should be fixed. It happens that dak send several Accepted mails during the same second for example when the package gets out of NEW and when several upload happened while the package was sitting in NEW. I remember neuro complaining about getting bounces on those cases. Jeroen never got around to fix that. Ok, here is a proposed (yet untested) fix: [EMAIL PROTECTED]:/srv/debian/pts/www/bin$ svn diff common.py Index: common.py === --- common.py (revision 1821) +++ common.py (working copy) @@ -18,8 +18,13 @@ info = extract_info(msg) targetfile = %s/%s.txt % (dir, info['timestamp']) -if os.path.isfile(targetfile): -raise(Aiee, already such message %s % targetfile) +nonce = 0 +while os.path.isfile(targetfile): +nonce += 1 +if nonce 128: # eventually give up +raise(can't find a free slot to save message, last stried was %s\ +% targetfile) +targetfile = %s/%s.%d.txt % (dir, info['timestamp'], nonce) f = open(targetfile, w) f.write(msg.as_string()) f.close() It assumes however that all mails received in the very same second are to be kept, is it a correct assumption? Also, it sort strangely news received in the very same second, here is an example of what I mean (ipython session): In [18]: a=['1236.txt', '1235.txt', '1234.txt', '1235.1.txt', '1235.2.txt'] In [19]: a.sort() In [20]: a.reverse() In [21]: a Out[21]: ['1236.txt', '1235.txt', '1235.2.txt', '1235.1.txt', '1234.txt'] This can be fixed in update_news.py using an ad-hoc sorting function, but I don't think it's worth, after all those mail have all been received in the very same second, whatever order would do IMO. Let me know if you want me to commit this fix or not ... Cheers. -- Stefano Zacchiroli -*- PhD in Computer Science ... now what? [EMAIL PROTECTED],cs.unibo.it,debian.org} -%- http://upsilon.cc/zack/ (15:56:48) Zack: e la demo dema ?/\All one has to do is hit the (15:57:15) Bac: no, la demo scema\/right keys at the right time signature.asc Description: Digital signature
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Sat, 26 Jan 2008, Stefano Zacchiroli wrote: On Sat, Jan 26, 2008 at 02:17:19PM +0100, Raphael Hertzog wrote: Note that this behaviour should be fixed. It happens that dak send several Accepted mails during the same second for example when the package gets out of NEW and when several upload happened while the package was sitting in NEW. I remember neuro complaining about getting bounces on those cases. Jeroen never got around to fix that. Ok, here is a proposed (yet untested) fix: [EMAIL PROTECTED]:/srv/debian/pts/www/bin$ svn diff common.py Index: common.py === --- common.py (revision 1821) +++ common.py (working copy) @@ -18,8 +18,13 @@ info = extract_info(msg) targetfile = %s/%s.txt % (dir, info['timestamp']) targetfile = %s/%s.0.txt % (dir, info['timestamp']) At least it'll fix the sorting order... -if os.path.isfile(targetfile): -raise(Aiee, already such message %s % targetfile) +nonce = 0 +while os.path.isfile(targetfile): +nonce += 1 +if nonce 128: # eventually give up +raise(can't find a free slot to save message, last stried was %s\ s/stried/tried/ +% targetfile) +targetfile = %s/%s.%d.txt % (dir, info['timestamp'], nonce) f = open(targetfile, w) f.write(msg.as_string()) f.close() It assumes however that all mails received in the very same second are to be kept, is it a correct assumption? I think so. Also, it sort strangely news received in the very same second, here is an example of what I mean (ipython session): In [18]: a=['1236.txt', '1235.txt', '1234.txt', '1235.1.txt', '1235.2.txt'] In [19]: a.sort() In [20]: a.reverse() In [21]: a Out[21]: ['1236.txt', '1235.txt', '1235.2.txt', '1235.1.txt', '1234.txt'] This can be fixed in update_news.py using an ad-hoc sorting function, but I don't think it's worth, after all those mail have all been received in the very same second, whatever order would do IMO. You can also simply fix the default filename. :) Let me know if you want me to commit this fix or not ... Go ahead with the little changes above. Cheers, -- Raphaël Hertzog Le best-seller français mis à jour pour Debian Etch : http://www.ouaza.com/livre/admin-debian/
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Fri, Jan 25, 2008 at 08:05:01PM +0100, Stefano Zacchiroli wrote: If so we can just run a script to check whether the affected files are duplicates or not, get rid of all the duplicates ... and hope nothing else remains in the bucket :-) Just for fun I've actually searched for duplicated. Attached there's a list, 106 out of 386 weird sorted news dirs are duplicated, the remainder are not. Here is how I've created the attached file: [EMAIL PROTECTED]:/srv/packages.qa.debian.org/www$ cut -f 1 weird_sorted_news.txt \ | bin/find_dup_sorted_news.sh \ dup_sorted_news.txt So, we can't just remove all the weird files. Still, the non duplicates can be renamed so that they are properly sorted (for example renaming them from, say, 25.txt to TIMESTAMP.25.txt where TIMESTAMP.txt would have led to a clash). What do you think of this solution? (I volunteer to write the batch script which does this fix.) It remains still open the point of whether clashes can happen again or not ... (see my previous post). Cheers. -- Stefano Zacchiroli -*- PhD in Computer Science ... now what? [EMAIL PROTECTED],cs.unibo.it,debian.org} -%- http://upsilon.cc/zack/ (15:56:48) Zack: e la demo dema ?/\All one has to do is hit the (15:57:15) Bac: no, la demo scema\/right keys at the right time signature.asc Description: Digital signature
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Fri, Jan 25, 2008 at 08:48:05PM +0100, Stefano Zacchiroli wrote: Just for fun I've actually searched for duplicated. Attached there's a list, 106 out of 386 weird sorted news dirs are duplicated, the Ehm ... forgot attachment. -- Stefano Zacchiroli -*- PhD in Computer Science ... now what? [EMAIL PROTECTED],cs.unibo.it,debian.org} -%- http://upsilon.cc/zack/ (15:56:48) Zack: e la demo dema ?/\All one has to do is hit the (15:57:15) Bac: no, la demo scema\/right keys at the right time base/a/acpi/news/14.txt OK! base/a/aleph/news/19.txtDUP! base/a/amavis/news/23.txt OK! base/a/antennavis/news/4.txtOK! base/a/apple2/news/8.txtDUP! base/a/ara/news/11.txt OK! base/a/ara/news/8.txt OK! base/a/arch2darcs/news/6.txtOK! base/a/asclassic/news/19.txtDUP! base/a/asterisk-spandsp-plugins/news/7.txt OK! base/a/avscan/news/5.txtDUP! base/a/ayuda/news/4.txt DUP! base/b/bass/news/1.txt OK! base/b/bass/news/2.txt OK! base/b/bass/news/3.txt OK! base/b/bass/news/4.txt OK! base/b/bass/news/5.txt OK! base/b/bass/news/7.txt OK! base/b/bass/news/8.txt OK! base/b/bass/news/9.txt OK! base/b/bbsload/news/2.txt DUP! base/b/belocs-locales-bin/news/22.txt OK! base/b/bidentd/news/15.txt OK! base/b/bitmap-mule/news/28.txt DUP! base/b/blackbox/news/2.txt DUP! base/b/blender/news/5.txt DUP! base/b/bluefish/news/29.txt DUP! base/b/bug/news/14.txt DUP! base/c/canna-shion/news/2.txt DUP! base/c/cbmplugs/news/3.txt OK! base/c/cdrdao/news/6.txtDUP! base/c/chastity-list/news/8.txt DUP! base/c/cl-hyperobject/news/15.txt DUP! base/c/cl-utilities/news/8.txt DUP! base/c/cnews/news/25.txtDUP! base/c/coco-cs/news/6.txt OK! base/c/cooledit/news/15.txt DUP! base/c/courier/news/13.txt OK! base/c/crip/news/10.txt OK! base/c/crip/news/6.txt OK! base/c/crip/news/7.txt OK! base/c/criticalmass/news/15.txt OK! base/c/criticalmass/news/4.txt DUP! base/d/d4x/news/5.txt DUP! base/d/dares/news/2.txt DUP! base/d/dav-text/news/4.txt OK! base/d/dbconfig-common/news/19.txt OK! base/d/dbd-xbase/news/4.txt OK! base/d/dbus/news/9.txt DUP! base/d/dchub/news/13.txtDUP! base/d/dcmtk/news/5.txt DUP! base/d/ddd/news/9.txt DUP! base/d/deal/news/3.txt OK! base/d/debpool/news/6.txt OK! base/d/debrecipes-es/news/1.txt OK! base/d/debrecipes-es/news/2.txt OK! base/d/debrecipes-es/news/3.txt OK! base/d/debrecipes-es/news/4.txt OK! base/d/debrecipes-es/news/5.txt OK! base/d/debrecipes-es/news/7.txt OK! base/d/debrecipes-es/news/8.txt OK! base/d/debrecipes-es/news/9.txt OK! base/d/denemo/news/4.txtDUP! base/d/devhelp/news/28.txt OK! base/d/devhelp/news/8.txt DUP! base/d/dh-lisp/news/2.txt DUP! base/d/dh-make-perl/news/23.txt OK! base/d/dhcp-dns/news/6.txt OK! base/d/diasce/news/2.txtOK! base/d/diasce2/news/2.txt OK! base/d/dictdlib/news/7.txt OK! base/d/dictdlib/news/8.txt OK! base/d/distcc/news/21.txt DUP! base/d/djvulibre/news/4.txt DUP! base/d/dlint/news/9.txt DUP! base/d/doc-es-misc/news/1.txt OK! base/d/doc-es-misc/news/2.txt OK! base/d/doc-es-misc/news/3.txt OK! base/d/doc-es-misc/news/4.txt OK! base/d/doc-es-misc/news/5.txt OK! base/d/doc-es-misc/news/6.txt OK! base/d/doc-es-misc/news/7.txt OK! base/d/doc-es-misc/news/9.txt OK! base/d/drbdlinks/news/5.txt OK! base/d/droidbattles/news/2.txt DUP! base/d/drupal/news/9.txtOK! base/d/dvd+rw-tools/news/5.txt DUP! base/e/e16keyedit/news/13.txt OK! base/e/easyfw/news/1.txtOK! base/e/easyfw/news/2.txtOK! base/e/easyfw/news/3.txtOK! base/e/easyfw/news/5.txtOK! base/e/easyfw/news/6.txtOK! base/e/easyfw/news/7.txtOK! base/e/easyfw/news/8.txtOK! base/e/easyfw/news/9.txtOK! base/e/ekg/news/11.txt OK! base/e/eruby/news/21.txtOK! base/f/fgfs-base/news/9.txt DUP! base/f/flightgear/news/12.txt DUP! base/f/fml/news/14.txt DUP! base/f/foomatic-gui/news/23.txt OK! base/f/fpdns/news/2.txt DUP! base/f/ftnchek/news/4.txt DUP! base/f/fudgit/news/5.txtDUP! base/f/fuse/news/21.txt OK! base/f/fvwm95/news/15.txt DUP! base/f/fwbuilder/news/13.txtOK! base/g/gcalctool/news/17.txtOK! base/g/gcc/news/15.txt DUP! base/g/gedit/news/4.txt OK! base/g/gedit/news/9.txt OK! base/g/gettyps/news/3.txt DUP! base/g/giflib/news/3.txtOK! base/g/gnome-gv/news/23.txt DUP! base/g/gnut/news/9.txt OK! base/g/gopher/news/6.txtOK! base/g/gtk+extra/news/12.txtOK! base/g/gtkdiff/news/7.txt DUP! base/g/gtkdiskfree/news/2.txt OK! base/g/gtkdiskfree/news/3.txt OK! base/g/gtkdiskfree/news/5.txt OK! base/g/gtkdiskfree/news/6.txt OK! base/g/gtranscript/news/2.txt DUP! base/g/gzip/news/11.txt DUP! base/h/h5utils/news/22.txt OK! base/h/harden/news/12.txt DUP! base/h/haskelldb/news/10.txtOK! base/h/hdparm/news/21.txt
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Sun, 2006-02-26 at 12:39 +0100, Jeroen van Wolffelaar wrote: There are more packages effected, the reason is that now the PTS cannot have multiple entries of exactly the same second, and that during conversion, rathern than deleting clashing entries, I left them for now pending looking a bit better at whether they really are duplicate. This ruins sorting next to it being a duplicate anyway too. Jeroen, I've searched for the affected bug on master.debian.org. The result is attached, you can re-generate the list of affected packages running bin/find_weird_sorted_news.sh from /srv/packages.qa.debian.org/www on master.debian.org. The assumptions behind that is that the clash corresponds to file (mis-)named like 25.txt in the news/ directory (while other files have timestamp-like) names. Is the assumption correct? Moreover, and that's the main point of this report, it seems that the last time the clash happened was January 2006, no other clashes in 2007 nor 2008. Is it possible that the issue has been solved elsewhere and the clash no longer happens? If so we can just run a script to check whether the affected files are duplicates or not, get rid of all the duplicates ... and hope nothing else remains in the bucket :-) Cheers. -- Stefano Zacchiroli -*- PhD in Computer Science ... now what? [EMAIL PROTECTED],cs.unibo.it,debian.org} -%- http://upsilon.cc/zack/ (15:56:48) Zack: e la demo dema ?/\All one has to do is hit the (15:57:15) Bac: no, la demo scema\/right keys at the right time base/a/acpi/news/14.txt 2002-09-05 22:16:12.0 + base/a/aleph/news/19.txt2002-09-05 16:00:54.0 + base/a/amavis/news/23.txt 2002-09-05 22:18:36.0 + base/a/antennavis/news/4.txt2005-04-06 22:37:29.0 + base/a/apple2/news/8.txt2002-09-05 16:00:55.0 + base/a/ara/news/11.txt 2004-12-19 04:39:28.0 + base/a/ara/news/8.txt 2004-12-19 04:48:56.0 + base/a/arch2darcs/news/6.txt2005-04-16 09:53:06.0 + base/a/asclassic/news/19.txt2002-09-05 16:00:55.0 + base/a/asterisk-spandsp-plugins/news/7.txt 2005-03-18 10:38:03.0 + base/a/avscan/news/5.txt2005-12-11 22:08:48.0 + base/a/ayuda/news/4.txt 2002-09-05 16:02:48.0 + base/b/bass/news/1.txt 2005-03-20 01:25:46.0 + base/b/bass/news/2.txt 2005-03-20 01:25:44.0 + base/b/bass/news/3.txt 2005-03-20 01:25:42.0 + base/b/bass/news/4.txt 2005-03-20 01:25:41.0 + base/b/bass/news/5.txt 2005-03-20 01:25:39.0 + base/b/bass/news/7.txt 2005-03-20 01:24:24.0 + base/b/bass/news/8.txt 2005-03-20 01:24:23.0 + base/b/bass/news/9.txt 2005-03-20 01:24:22.0 + base/b/bbsload/news/2.txt 2005-12-11 22:08:48.0 + base/b/belocs-locales-bin/news/22.txt 2005-03-20 21:10:22.0 + base/b/bidentd/news/15.txt 2002-09-05 17:15:53.0 + base/b/bitmap-mule/news/28.txt 2002-09-05 14:59:26.0 + base/b/blackbox/news/2.txt 2005-12-11 22:08:48.0 + base/b/blender/news/5.txt 2005-12-11 22:08:47.0 + base/b/bluefish/news/29.txt 2002-09-05 16:02:44.0 + base/b/bug/news/14.txt 2002-09-05 16:01:28.0 + base/c/canna-shion/news/2.txt 2003-04-17 12:02:36.0 + base/c/cbmplugs/news/3.txt 2004-04-17 04:24:56.0 + base/c/cdrdao/news/6.txt2005-12-11 22:08:47.0 + base/c/chastity-list/news/8.txt 2003-04-16 20:16:10.0 + base/c/cl-hyperobject/news/15.txt 2003-04-16 22:46:57.0 + base/c/cl-utilities/news/8.txt 2005-12-11 22:08:47.0 + base/c/cnews/news/25.txt2002-09-05 16:01:28.0 + base/c/coco-cs/news/6.txt 2005-03-28 21:53:09.0 + base/c/cooledit/news/15.txt 2002-09-05 16:00:56.0 + base/c/courier/news/13.txt 2005-09-01 10:50:01.0 + base/c/crip/news/10.txt 2005-06-30 08:52:10.0 + base/c/crip/news/6.txt 2005-12-17 05:30:55.0 + base/c/crip/news/7.txt 2005-12-17 05:24:20.0 + base/c/criticalmass/news/15.txt 2004-03-06 05:45:31.0 + base/c/criticalmass/news/4.txt 2005-12-11 22:08:49.0 + base/d/d4x/news/5.txt 2005-12-11 22:08:49.0 + base/d/dares/news/2.txt 2005-12-11 22:08:47.0 + base/d/dav-text/news/4.txt 2005-06-16 23:23:42.0 + base/d/dbconfig-common/news/19.txt 2005-03-09 04:39:24.0 + base/d/dbd-xbase/news/4.txt 2002-09-05 17:09:35.0 + base/d/dbus/news/9.txt 2005-12-11 22:08:45.0 + base/d/dchub/news/13.txt2003-04-17 05:13:31.0 + base/d/dcmtk/news/5.txt 2005-12-11 22:08:46.0 + base/d/ddd/news/9.txt 2003-04-17 16:09:45.0 + base/d/deal/news/3.txt 2005-03-18
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
The same issue seem to affect masqmail, URL: http://packages.qa.debian.org/m/masqmail.html . Happy hacking, -- Petter Reinholdtsen -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
On Sat, Feb 25, 2006 at 01:40:50AM +0100, Micha Lenk wrote: Package: qa.debian.org Severity: minor Hi, I discovered that http://packages.qa.debian.org/m/mydns.html shows the acceptance of mydns 0.11.0-8 in unstable out of order on top of the list of latest news. Since it's the first line I got at a first glance the impression that the newest uploaded package of mydns is 0.11.0-8. It would be nice to have this fixed and having this news entry displayed in order. I don't know whether this is an error affecting more packages. There are more packages effected, the reason is that now the PTS cannot have multiple entries of exactly the same second, and that during conversion, rathern than deleting clashing entries, I left them for now pending looking a bit better at whether they really are duplicate. This ruins sorting next to it being a duplicate anyway too. --Jeroen -- Jeroen van Wolffelaar [EMAIL PROTECTED] (also for Jabber MSN; ICQ: 33944357) http://Jeroen.A-Eskwadraat.nl -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Bug#354307: packages.qa.debian.org/m/mydsn.html has weird sorted news
Package: qa.debian.org Severity: minor Hi, I discovered that http://packages.qa.debian.org/m/mydns.html shows the acceptance of mydns 0.11.0-8 in unstable out of order on top of the list of latest news. Since it's the first line I got at a first glance the impression that the newest uploaded package of mydns is 0.11.0-8. It would be nice to have this fixed and having this news entry displayed in order. I don't know whether this is an error affecting more packages. Yours Micha -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
