Bug#1056051: reportbug: obsolete NEWQUEUE_URL, giving a 301 Moved Permanently, which is ignored

[Vincent Lefevre]

On 2023-11-16 17:34:57 +0100, Nis Martensen wrote:
> On 16.11.2023 12.48, Vincent Lefevre wrote:
> > Control: retitle -1 reportbug: obsolete NEWQUEUE_URL, giving a 301 Moved 
> > Permanently
> > 
> > On 2023-11-16 12:34:17 +0100, Vincent Lefevre wrote:
> >> So this URL gives a 301 Moved Permanently with
> >> https://ftp-master.debian.org/new.822 as the new URL,
> >> and reportbug does not attempt to use this new URL.
> 
> It will in the next version. This was fixed in git already:
> https://salsa.debian.org/reportbug-team/reportbug/-/commit/7fef65e8bf41a9946eb416597c39408a77aa3f56

I think that the URL given in the reportbug output should
be corrected too. It says

  Checking for newer versions at madison and 
https://ftp-master.debian.org/new.html

but the URL will actually be https://ftp-master.debian.org/new.822
and the contents are different from new.html! See

  https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1055931#34

-- 
Vincent Lefèvre  - Web: 
100% accessible validated (X)HTML - Blog: 
Work: CR INRIA - computer arithmetic / AriC project (LIP, ENS-Lyon)

Bug#1056051: reportbug: obsolete NEWQUEUE_URL, giving a 301 Moved Permanently, which is ignored

[Nis Martensen]

control: tags -1 pending

On 16.11.2023 12.48, Vincent Lefevre wrote:
> Control: retitle -1 reportbug: obsolete NEWQUEUE_URL, giving a 301 Moved 
> Permanently
> 
> On 2023-11-16 12:34:17 +0100, Vincent Lefevre wrote:
>> So this URL gives a 301 Moved Permanently with
>> https://ftp-master.debian.org/new.822 as the new URL,
>> and reportbug does not attempt to use this new URL.

It will in the next version. This was fixed in git already:
https://salsa.debian.org/reportbug-team/reportbug/-/commit/7fef65e8bf41a9946eb416597c39408a77aa3f56

Bug#1056051: reportbug: obsolete NEWQUEUE_URL, giving a 301 Moved Permanently, which is ignored

[Vincent Lefevre]

Control: retitle -1 reportbug: obsolete NEWQUEUE_URL, giving a 301 Moved 
Permanently

On 2023-11-16 12:34:17 +0100, Vincent Lefevre wrote:
> So this URL gives a 301 Moved Permanently with
> https://ftp-master.debian.org/new.822 as the new URL,
> and reportbug does not attempt to use this new URL.

Sorry, it actually seems to be used (the information is now encrypted
in the strace output, hence the confusion).

-- 
Vincent Lefèvre  - Web: 
100% accessible validated (X)HTML - Blog: 
Work: CR INRIA - computer arithmetic / AriC project (LIP, ENS-Lyon)

Bug#1056051: reportbug: obsolete NEWQUEUE_URL, giving a 301 Moved Permanently, which is ignored

[Vincent Lefevre]

Package: reportbug
Version: 12.0.0
Severity: normal

In it search for newer versions of the package, reportbug outputs

  Checking for newer versions at madison and 
https://ftp-master.debian.org/new.html

However, /usr/lib/python3/dist-packages/reportbug/checkversions.py
has

NEWQUEUE_URL = 'http://ftp-master.debian.org/new.822'

In the strace output, I can see

193537 connect(45, {sa_family=AF_INET, sin_port=htons(80), 
sin_addr=inet_addr("192.91.235.231")}, 16) = -1 EINPROGRESS (Operation now in 
progress)
193537 poll([{fd=45, events=POLLOUT|POLLERR}], 1, 6) = 1 ([{fd=45, 
revents=POLLOUT}])
193537 getsockopt(45, SOL_SOCKET, SO_ERROR, [0], [4]) = 0
193537 poll([{fd=45, events=POLLOUT}], 1, 6) = 1 ([{fd=45, 
revents=POLLOUT}])
193537 sendto(45, "GET /new.822 HTTP/1.1\r\nHost: 
ftp-master.debian.org\r\nUser-Agent: reportbug/12.0.0 
(Debian)\r\nAccept-Encoding: gzip;q=1.0, deflate;q=0.9, 
identity;q=0.5\r\nAccept: */*\r\nConnection: keep-alive\r\n\r\n", 190, 0, NULL, 
0) = 190
193537 ioctl(45, FIONBIO, [1])  = 0
193537 poll([{fd=45, events=POLLIN}], 1, 6) = 1 ([{fd=45, revents=POLLIN}])
193537 recvfrom(45, "HTTP/1.1 301 Moved Permanently\r\nDate: Tue, 14 Nov 2023 
14:11:18 GMT\r\nServer: Apache\r\nX-Content-Type-Options: 
nosniff\r\nX-Frame-Options: sameorigin\r\nReferrer-Policy: 
no-referrer\r\nX-Xss-Protection: 1\r\nPermissions-Policy: 
interest-cohort=()\r\nLocation: 
https://ftp-master.debian.org/new.822\r\nContent-Length: 316\r\nKeep-Alive: 
timeout=5, max=100\r\nConnection: Keep-Alive\r\nContent-Type: text/html; 
charset=iso-8859-1\r\n\r\n\n\n301 Moved 
Permanently\n\nMoved Permanently\nThe document 
has moved https://ftp-master.debian.org/new.822\;>here.\n\nApache
 Server at ftp-master.debian.org Port 80\n\n", 8192, 0, 
NULL, NULL) = 727

So this URL gives a 301 Moved Permanently with
https://ftp-master.debian.org/new.822 as the new URL,
and reportbug does not attempt to use this new URL.

So there are several issues:

1. The NEWQUEUE_URL URL is obsolete (this seems to have been fixed
in Git, but even unstable is still affected).

2. In the output, https://ftp-master.debian.org/new.html does not match
what is actually used (or is this on purpose in case this has the same
contents?).

3. The "301 Moved Permanently" is ignored. If this is on purpose,
I think that a warning should be output in order to be aware of the
issue, in case of a future move.

-- Package-specific info:
** Environment settings:
EDITOR="/home/vinc17/bin/eclient"
PAGER="less -Lis"
VISUAL="/home/vinc17/bin/eclient"
EMAIL="vinc...@vinc17.net"
INTERFACE="text"

** /home/vinc17/.reportbugrc:
reportbug_version "2.10"
mode advanced
ui text
realname "Vincent Lefevre"
email "vinc...@vinc17.net"
mua mutt
cc
timeout 20

-- System Information:
Debian Release: 12.2
  APT prefers stable-updates
  APT policy: (900, 'stable-updates'), (900, 'stable-security'), (900, 
'stable-debug'), (900, 'proposed-updates-debug'), (900, 'stable'), (500, 
'unstable-debug'), (500, 'unstable'), (500, 'testing'), (1, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 6.1.0-13-amd64 (SMP w/16 CPU threads; PREEMPT)
Locale: LANG=POSIX, LC_CTYPE=C.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages reportbug depends on:
ii  apt2.6.1
ii  python33.11.2-1+b1
ii  python3-reportbug  12.0.0
ii  sensible-utils 0.0.17+nmu1

reportbug recommends no packages.

Versions of packages reportbug suggests:
pn  claws-mail  
ii  debconf 1.5.82
ii  debsums 3.0.2.1
ii  dlocate 1.12
ii  emacs-bin-common1:28.2+1-15
ii  file1:5.44-3
ii  gnupg   2.2.40-1.1
ii  postfix [mail-transport-agent]  3.7.6-0+deb12u2
pn  python3-urwid   
pn  reportbug-gtk   
ii  xdg-utils   1.1.3-4.1

Versions of packages python3-reportbug depends on:
ii  apt2.6.1
ii  file   1:5.44-3
ii  python33.11.2-1+b1
ii  python3-apt2.6.0
ii  python3-debian 0.1.49
ii  python3-debianbts  4.0.1
ii  python3-requests   2.28.1+dfsg-1
ii  sensible-utils 0.0.17+nmu1

python3-reportbug suggests no packages.

-- no debconf information

-- 
Vincent Lefèvre  - Web: 
100% accessible validated (X)HTML - Blog: 
Work: CR INRIA - computer arithmetic / AriC project (LIP, ENS-Lyon)