Error 500 on BTS' SOAP interface (was: Cron nice -15 flock -n /srv/qa.debian.org/lock/wnpp-tagging /srv/qa.debian.org/data/cronjobs/wnpp-tagging)

2015-05-29 Thread Raphael Geissert
Hi,

There's a script on quantz that uses the BTS' SOAP interface, but for the
last few days it has receiving an error 500 response. Is it expected? was
anything changed?

Thanks in advance.

Cheers,

-- Forwarded message -
From: Cron Daemon 
Date: Fri, 29 May 2015 at 20:08
Subject: Cron  nice -15 flock -n /srv/
qa.debian.org/lock/wnpp-tagging /srv/
qa.debian.org/data/cronjobs/wnpp-tagging
To: , 


Error while retrieving bug statuses from SOAP server: 500 Internal Server
Error
Null message body; hope that's ok


Bug#784786: debsources: enable CORS on /api

2015-05-08 Thread Raphael Geissert
Package: qa.debian.org
Severity: wishlist
User: qa.debian@packages.debian.org
Usertags: debsources

Hi,

I think it would make sense to enable CORS on requests to /api.
Otherwise the API is of no use to anything but debsources itself and
non-browser clients.

More info at:
http://enable-cors.org/

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
https://lists.debian.org/CAA7hUgGOJhgAL1XC+m0J-FnR=GcrQzO_kV9wxnsDShA5=h7...@mail.gmail.com



Re: http.debian.net down via IPv6

2013-10-12 Thread Raphael Geissert
On Friday 11 October 2013 22:41:24 Raphael Geissert wrote:
> I was hoping it would be solved quite fast, but as of this time all I
> know is that it appears that the whole /64 is unreachable over IPv6.

The issue was solved last night thanks to Joerg.

> I've dropped the  record in the mean time and will restore it once v6
> connectivity is back.

And the record added a few minutes later.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201310121527.39318.geiss...@debian.org



Re: http.debian.net down via IPv6

2013-10-11 Thread Raphael Geissert
Hi,

On Friday 11 October 2013 20:00:39 Michael Stapelberg wrote:
[...]
> $ ping6 -c 1 http.debian.net
> PING http.debian.net(raphael.ganneff.de) 56 data bytes
> 
> --- http.debian.net ping statistics ---
> 1 packets transmitted, 0 received, 100% packet loss, time 0ms
> 
> Can you please have a look at what’s wrong here?

I was hoping it would be solved quite fast, but as of this time all I know 
is that it appears that the whole /64 is unreachable over IPv6.

I've dropped the  record in the mean time and will restore it once v6 
connectivity is back.

Apologies,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


--
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201310112241.29134.geiss...@debian.org



Re: Broken links/redirections due to URL encoding issues

2013-09-29 Thread Raphael Geissert
Hi Cyril,

On Sunday 29 September 2013 20:04:09 Cyril Brulebois wrote:
> xorg-server's PTS page[1] links to the oldstable-bpo .dsc[2] and that
> one returns broken results
>  1. http://packages.qa.debian.org/x/xorg-server.html
>  2.
> http://http.debian.net/debian-backports/pool/main/x/xorg-server/xorg-ser
> ver_1.10.4-1~bpo60+1.dsc
> 
> wget is happy for IPv4, but 404's for IPv6:
[...]
> which obviously 404's later on (%20 = space).
> 
> Various tries on IPv4 returned URLs for different mirrors, not encoded,
> and non 404-ing.

Apologies, it is fixed now. IPv6 is currently served by a different instance 
running a new codebase - hence the differente results.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201309300112.09259.geiss...@debian.org



Bug#712810: mole is broken

2013-06-29 Thread Raphael Geissert
reopen 712810
thanks

And they are back :-/

-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201306291223.51333.geiss...@debian.org



Bug#712925: qa.debian.org: there are no longer email notifications on for commits

2013-06-21 Thread Raphael Geissert
Hi Paul,

On 21 June 2013 05:06, Paul Wise  wrote:
> Do you remember when this last worked?

Last I received was on the third of June.

> Where are the mails meant to go?

qa.debian@packages.qa.debian.org

Cheers,
--
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/CAA7hUgHMRS-X5UNsM0CFo57QDvhMsJKZwndtsn=rPy0q=lz...@mail.gmail.com



Bug#712925: qa.debian.org: there are no longer email notifications on for commits

2013-06-20 Thread Raphael Geissert
Package: qa.debian.org

Hi,

As a side effect of the report about mole, I noticed that there no longer are 
email notifications on commits to the qa repository. Perhaps it is related to 
the upgrade of alioth?

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201306202204.12921.geiss...@debian.org



Bug#712810: mole is broken

2013-06-19 Thread Raphael Geissert
Package: qa.debian.org

Hi,

Just passing the notification:

All /.dump/ urls are returning 500 internal error starting around
Tuesday last week.

Cheers,
--
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/CAA7hUgF7AtJdi7gBOtx=B3yY4_dcMko6S=mepnzayxn3cri...@mail.gmail.com



Re: [Daca-general] Q: Automated Code Analysis is stopped?

2013-04-05 Thread Raphael Geissert
Hi,

On Tuesday 02 April 2013 06:43:39 Hideki Yamane wrote:
> Hi,
> 
>  I've seen Automated Code Analysis page and check my jd package
>  but its result is too old.
> 
>  Is there any problem to run it?

Sorry for the delay, I thought I had already replied.

Short answer is yes and no :) You can find a more detailed response at
http://lists.alioth.debian.org/pipermail/daca-general/2013-March/32.html

If you are interested in the subject, there was another discussion in March 
about DACA and similar projects.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201304052026.35600.geiss...@debian.org



Bug#698161: [PTS] RDF descriptions point to broken archive links in some cases

2013-01-14 Thread Raphael Geissert
Package: qa.debian.org

Hi,

Some RDF descriptions contain broken downloadUrl links. E.g.
http://packages.qa.debian.org/s/s-http-server.rdf

Links to:
http://http.debian.net/debian//s-http-
server_20080228.orig.tar.gz

Which doesn't exist.

From a quick look at a couple of such issues it seems that it is limited to 
packages which only "exist" in oldstable.

P.S. needless to say, even if the pool directory was right, the files are no 
longer there in the mirrors. Perhaps the code should be aware of archived 
releases and use http://http.debian.net/debian-archive/debian/ as the base 
URL.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


--
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201301141147.47322.geiss...@debian.org



Re: please kill a few qa processes on quantz

2012-11-01 Thread Raphael Geissert
Bart Martens wrote:
> Can someone kill the following processes on quantz or give me access to
> the qa user so that I can kill them myself ?

TERMed the wget process.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/k6vntj$520$1...@ger.gmane.org



Bug#519732: red colored correctly watch version

2012-08-15 Thread Raphael Geissert
On Monday 06 August 2012 14:55:28 Bart Martens wrote:
> I dropped the extra stripping code from the DDPO to fix bug 650857.  I
> expect the problem for krank 0.7+dfsg2-3 to be solved if the extra
> stripping code is dropped from mole/worker/watch-worker as well.  How is
> progress on "file bugs" and "grace period" ?

Huh, don't know. I'm not even sure I filed bug reports.

Back then I wrote a lintian check that should catch most of the affected 
packages. You should probably take a look at lintian.d.o and search for 
"mangle."

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201208151041.55459.geiss...@debian.org



Re: [UDD] DEHS information outdated?

2012-06-29 Thread Raphael Geissert
Andreas Tille wrote:
[...]
> Any reason why DEHS considers emboss outdated?

DHES was killed over a year ago. Whatever is currently used to run uscan 
isn't DEHS.

Regards,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/jslgc1$acj$1...@dough.gmane.org



Re: request for help to fix common mistakes in wnpp bugs

2012-06-08 Thread Raphael Geissert
Gergely Nagy wrote:
> In the future though, I'd rather script this, both to make it easier for
> people to do the work (and for the record, I much appreciate the effort,
> kudos!), and less error prone.

Parts of it are already written... http://deb.li/3epmN

/me stops repeating himself

-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/jqtbsq$kg8$1...@dough.gmane.org



Re: request for help to fix common mistakes in wnpp bugs

2012-06-07 Thread Raphael Geissert
Bart Martens wrote:

> Hi,
> 
> I hereby request help from anyone (including non-DDs) to fix common
> mistakes in wnpp bugs.
> 
> This report is updated daily :
> http://qa.debian.org/~bartm/wnpp/inconsistencies.txt

I made a similar call earlier this year[1], and another one years ago (can't 
find the email) but there doesn't seem to be much interest.

[1]https://lists.debian.org/debian-qa/2012/01/msg00022.html

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/jqqgi9$jga$1...@dough.gmane.org



Re: r2758 - /trunk/pts/www/bin/filter_mentors.pl

2012-05-27 Thread Raphael Geissert
On Sunday 27 May 2012 03:49:32 ba...@users.alioth.debian.org wrote:
> Author: bartm
> Date: Sun May 27 08:49:30 2012
> New Revision: 2758
[...]
> +my $page = read_page(
> "http://bugs.debian.org/cgi-bin/pkgreport.cgi?pkg=sponsorship-requests";
> ); +
> +$page =~ s/text-decoration:line-through.*$//s;
> +
> +my $re = '([^<]*)';

Huh, please use the SOAP interface.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201205271300.35181.geiss...@debian.org



Re: WNPP maintenance

2012-01-09 Thread Raphael Geissert

Paul Wise wrote:
> How about moving that script into the QA VCS? We can then run the cron
> jobs on quantz.

Both scripts are on the same git repo, the autotagging one is wnpp-
tagging.pl. On alioth I run it multiple times a day and pipe its output to a 
mail(1)-like shell function I wrote a while ago that generates an email and 
pipes it to sendmail.
I don't mind moving them to the qa repo.

Oh, and I just finished making some changes to the other script to produce 
some "safe automated changes," to ideally run it on a cronjob.
Will send a test email, which makes exactly 350 changes.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/jeg2o1$ker$1...@dough.gmane.org



WNPP maintenance

2012-01-09 Thread Raphael Geissert
Hi,

So, it's been a while since I last ran my wnpp-maintenance[1] script and 
noticed there are over 650 issues. Somebody wants to help clear that list?
I'm going to try to add some more auto corrections, but there are still a few 
issues that need to be checked by hand.

@Lucas [explicit bcc] and at anyone who decides to auto retitle old ITPs and 
ITAs: please _do_ clear the pending tag when doing so. It saves a lot of time 
when processing wnpp-maintenance output, since it assumes that the pending tag 
means that somebody forgot to s/RF/IT/. Thanks.

Oh and it seems that the alioth split nuked all cronjobs and the WNPP auto 
tagging hadn't been run ever since.

[1]http://anonscm.debian.org/gitweb/?p=users/atomo64-guest/misc-
devscripts.git;a=blob;f=wnpp-maintenance.pl;hb=HEAD

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201201091523.24607.geiss...@debian.org



Re: changing the default bugs view of the DDPO

2012-01-08 Thread Raphael Geissert
Raphael Geissert wrote:
> Does anyone mind if I make the "sum + RC" view the default of the DDPO?

Since I've seen no objection so far, I'm making the change. Thanks to those 
who have expressed their opinion (heya there!).

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/jedvf1$elu$1...@dough.gmane.org



Bug#652562: /usr/bin/rmadison: [rmadison] Not showing results for lenny suite

2012-01-04 Thread Raphael Geissert
On Tuesday 20 December 2011 10:16:06 Lucas Nussbaum wrote:
> This is not going to get fixed: it's not possible with the current UDD
> setup to provide information for lenny. The tables used for packages
> data are already too large for the current machine.

I don't know much about postgres, but wouldn't some partitioning and 
replication help?
For such a large (which is not THAT large) data set usage patterns need to be 
taken into consideration, I don't think any DBMS would excel at handling it 
out of the box.

I think last time I asked somebody from DSA (sorry, I don't remember who that 
was, but it was on #d-qa) he mentioned some issues with postgres' replication 
features. Checking now, it seems that even the in-core replication in 9.0+ 
wouldn't fit us, but slony and pgpool2 seem like they could do it. Can anyone 
familiar with the subject please comment?

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201201041439.21684.geiss...@debian.org



Bug#609800: Done

2012-01-04 Thread Raphael Geissert
On Thursday 29 December 2011 10:40:00 Iain Lane wrote:
> Hi,
> 
> Fixed in r2120 and deployed.
> 
>   ftpnew.sql: Add new views of the NEW queue for madison.cgi to use
> 
>   This adds two new views new_{sources,packages}_madison which
>   madison.cgi can use to display the NEW queue.
> 
>   Closes: #609857
> 
> Thanks!

Thanks, I just added support for those views in commit r2686. Somebody needs 
to svn up cgi-bin/madison.cgi (I won't, qa.d.o's shared svn+ssh setup is 
hateful.)

Pass table=new as parameter to use that table.

However, something seems to be broken:
udd=> select package from new_packages;
  package   

 python-ordereddict
(1 row)
udd=> select source from new_sources;
   source    
-----
 ordereddict
(1 row)

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201201041253.08979.geiss...@debian.org



changing the default bugs view of the DDPO

2012-01-04 Thread Raphael Geissert
Hi,

Does anyone mind if I make the "sum + RC" view the default of the DDPO?
Not only it allows me to see some more of the columns on my small screen, 
but even on a larger one it gives a clearer view (it goes from "hella + lots 
+ of + bugs" to "bugs + *RC*")

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/je251d$v69$1...@dough.gmane.org



Bug#647565: madison.cgi: make it produce an easier to parse output

2011-12-25 Thread Raphael Geissert
Alexander Wirt wrote:
>> > * Sandro Tosi , 2011-11-04, 00:41:
>> >> currently madison.cgi (and it's rmadison command friend) doesn't emit
>> >> an easy-to-parse output: please enable it. yaml, whatever that's easy
>> >> from a programming language to parse and understand.

How about consuming a web service?
I've been thinking about exporting a few things via xml-rpc, but soap is 
already used by the BTS and the PTS so I might just stick to that.

I don't think yaml or any other representation is appropriate. It would only 
hide the parsing while the querying is still custom-made.

> You may want to try the attached patch for madison.cgi. It adds a yaml
> parameter which produces an output like:

Huh, an exported "Dump," creepy. ;)

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4ef7f660.a54ab60a.5de1.a...@mx.google.com



Bug#609857: Bug#609800: qa.debian.org: please add NEW queue info to madison.php

2011-12-25 Thread Raphael Geissert

Lucas Nussbaum wrote:
> On 02/12/11 at 11:05 +, Iain Lane wrote:
>> Righto, how are these?
>> 
>>   CREATE OR REPLACE TEMPORARY VIEW new_sources_debian AS SELECT source,
>>   version, component, distribution AS release, TEXT 'debian' AS
>>   distribution FROM new_sources;
>> 
>>   CREATE OR REPLACE TEMPORARY VIEW new_packages_debian AS SELECT
>>   package, version, distribution AS release, architecture, component,
>>   TEXT 'debian'AS distribution from new_packages;
>> 
>> Is that what you need?
> 
> Raphael, ping?

It fell through the cracks, sorry. Yes, that seems to include everything 
that's needed.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4ef7f645.c335b60a.4c4b.a...@mx.google.com



Bug#609857: Bug#609800: qa.debian.org: please add NEW queue info to madison.php

2011-09-16 Thread Raphael Geissert
reopen 609857
thanks

On Wednesday 27 July 2011 17:51:32 Lucas Nussbaum wrote:
> On 12/01/11 at 23:07 -0600, Raphael Geissert wrote:
> > Only a small change needs to be made to UDD and the rest is a snap.
> 
> the release is there, except it's called distribution (which is not a
> very good name, I agree. But it's how ftpmasters call it).

My request still stands. I don't want to duplicate code in madison.cgi just to 
cope with that name.

If you don't want to modify that schema please consider adding a view.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201109161741.07020.geiss...@debian.org



Bug#630597: qa.debian.org: rmadison lacks experimental/main/debian-installer?

2011-07-04 Thread Raphael Geissert
On Monday 04 July 2011 16:19:02 Martin Zobel-Helas wrote:
> 
> So, what should DSA do here? we do not push stuff into UDD.

I apologise for not making it clear, I was asking for samosa's mirror to 
include the installer stuff for experimental. Apparently that's already done, 
and the problem lies in UDD's config. I was looking at an old config file.

Summarising for debian-admin: no action is need, my bad, sorry for the noise.

I will commit the necessary changes in a moment, but somebody from the udd 
group needs to update udd.d.o's subversion.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201107041744.04768.geiss...@debian.org



Bug#630597: qa.debian.org: rmadison lacks experimental/main/debian-installer?

2011-07-04 Thread Raphael Geissert
user qa.debian@packages.debian.org
usertag 630597 udd
thanks

Julien Cristau wrote:

> Package: qa.debian.org
> Severity: normal
> 
> $ rmadison xserver-xorg-video-vesa-udeb
> returns nothing.  Yet:

rmadison provides as much info as UDD does, but I _think_ UDD extracts as much 
info as it is available in the mirror it is configured to use. CC'ing debian-
admin for that bit, but I guess they'll ping debian-mirrors for the final 
tweak.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201107041604.52796.geiss...@debian.org



Re: DEHS moved to mole

2011-07-04 Thread Raphael Geissert
Christoph Berg wrote:

> Hi,
> 
> I've set up a WIP version of a new DEHS instance that uses the watch
> files from the lintian lab to submit uscan results to mole. The data
> is then extracted as a .db file and presented in DDPO.

I know I disappeared, but this is... *sigh*

There is more to it than just the data export and the fronted. There are 
also email notifications and a log of when a new upstream release was found, 
which is part of a plan to provide charts and maybe try to do things like 
estimating when a given upstream is more likely to release a new version, 
and more.

*sigh*

-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/iut85e$d0c$1...@dough.gmane.org



How DACA works (was: Re: [daca] http://qa.debian.org/daca is 404)

2011-06-28 Thread Raphael Geissert
Hi,

On Sunday 12 June 2011 11:38:11 Christoph Berg wrote:
> Re: Paul Wise 2011-06-12:
> > http://qa.debian.org/~geissert/daca/
> > 
> > Perhaps it should be moved into quantz:/srv/qa.debian.org/?

Yes. However, I think it would be better if a daca UNIX group existed so that 
people don't necessarily need to be part of 'qa' to work on DACA.
(oh and a 'daca-worker' user so that the tools are not with some DD's 
priviledges.)

> 
> Definitely. Does anyone besides Raphael know how DACA works? Reading
> the web page, there's hardware somewhere powering it.

The best documentation so far is the code itself, but here's an excerpt of an 
irc conversation a while ago in #debian-qa that explains some parts of DACA. 
Note the current design is very limited and doesn't scale. I already have 
plans for a better design that is scalable, but I need time to (at least) 
document and implemen it.

 phil: for source packages there are two ways it operates (depends on 
whether it is the local mode, or distributed mode.) On the former mode, it 
generates a list of paths to .dsc files out of a Sources file and then goes one 
by one adding a lock, unpacking the source package, running the tool, storing 
result, unlocking; and again and again
 Storing it where?
 on the distributed mode the master does basically the same as in the 
local mode except that it doesn't run the tool at all. It sends an HTTP query 
to a CGI on the worker host, and over and over until it reaches the max limit 
of jobs it should send. Then it sleeps a bit and queries to remote host in the 
hope that the checking is done
 the distributed worker only receives the dsc's file name and guesses 
the path to it and then unpacks, checks, stores result, and that's it
 phil: the results are stored as a file in a directory
 the same directory is used for locking the checks
 are the results large/huge?  or could they be transferred after the 
job finishes?
 say you have a dir called results/ and when locking it adds a 
$dsc_name.lock symlink to $PID, and another one to just $dsc_name. When 
storing the result it unlinks $dsc_name, replaces it, and finally it unlinks 
$dsc_name.lock
 weasel: cppcheck's and checkbashisms' are very small (in most cases 
1KB)
 but in the case of clang the output is more verbose
 how does it compare to say build logs?  way larger/about the same?
 weasel: it depends on what format we want to store the results. But 
I'd say that worst case is just like a build log
 ok, so it's still usually smallish
 raphael, weasel: For added fun it needs unstable chroots for the tools, 
I presume?
 phil: if it is going to build something, yes. Tools like cppcheck 
and checkbashisms only need a mirror at hand
...
 weasel: atm the master only sends .dsc file names (and the CGI only 
stores the request.) With a few tweaks I could make it run tools other than 
cppcheck
 (the jobs are started on the worker by inoticoming)

Now, the current distributed model was designed with ravel's limitations in 
mind: it can only serve static pages, no dynamic stuff. The worker requires a 
CGI-capable httpd.


The website side of the story (ugly and hackish):
Once the results are accumulated in ravel, a cronjob in quantz downloads 
everything from ravel's results dirs which are available via ~geissert/... 
with wget -N.
Once in quantz, a makefile is executed to generate the web version of the 
reports and then the static index.html pages for every tool by calling each 
dir's index.php via HTTP.

That's as far as it gets right now (and everything should be rewritten from 
scratch.) DACA, in its current incarnation, is based on a series of scripts I 
quickly wrote to run a few of the tools and see what the results were.

HTH.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201106241622.55322.geiss...@debian.org



mole is 500ing

2011-02-28 Thread Raphael Geissert
Hi,

Some of  mole's pages are 500ing. E.g.
http://qa.debian.org/cgi-bin/mole/dbgsym/.dump/dbgsym-debian-
lenny_proposed_updates-sparc

Can anyone fix them? (I can provide a list of ~500 URLs if needed)

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201102282057.21471.geiss...@debian.org



Re: Debian QA meeting in Paris (March 18-20) ??

2011-02-21 Thread Raphael Geissert
Ralf Treinen wrote:
> after discussion with Lucas about the planned attendance to the
> QA meeeting in Paris we decided to cancel the meeting. It seems to
> us that there is not sufficient momentum to have a full meeting. We
> think that it will be more efficient when people who are interested
> in particular coorporation projects do so by direct collaboration.

Some of us live far away from Europe. I personally think its not worth 
spending Debian money to help me attend a three days meeting (would be 
impossible for me to travel without sponsorship.)

Sometimes I wish such kind of meetings could take place on this side of the 
planet. Oh, wait, now people would have to fly from Europe and elsewhere.
Glad we have the internet.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/ijv8fa$3r3$1...@dough.gmane.org



Re: Switching to read-only repository on qa host

2011-02-18 Thread Raphael Geissert
Raphael Hertzog wrote:
> On Fri, 18 Feb 2011, Lucas Nussbaum wrote:
>> On 17/02/11 at 20:01 -0600, Raphael Geissert wrote:
>> > Unless there's any justified objection, I'm going to switch the qa
>> > repository checkout on quantz to use https instead of ssh.
>> > The side effects will be:
>> > a) no special subversion configuration will be needed for the qa user
>> > to update the repository, and
>> > b) it won't be possible to commit changes from within that checkout.
>> > 
>> > It would be great if the PTS followed the change too, but that's more
>> > on hands of Raphaël Hertzog and Stefano Zacchiroli. In fact, it would
>> > be even better if that mantra becomes part of the past.
>> 
>> Mmmh, I liked the fact that simple changes could be tested and committed
>> directly on the live instance.

We should better focus on providing a way to test changes without breaking 
or risking the infrastructure. Most, if not all, of the qa webpages can be 
run from a userdir without further changes and it will Just Work.

> I also often commit from the PTS repository on master.
> 
> What's the rationale for the change?

Because in order to commit changes from qa.d.o one has to do either of 
these:
a) type the password of the alioth account, which is risky
b) use an ssh key on a shared host, which again is risky and even more 
because they can't be restricted to, say, only execute svnserve because 
GForge rejects such kind of entries.


Switching to git could also be considered. That way people can commit and 
pull changes from a repo on their $HOME on quantz (or master), test, etc, 
and later push them to the alioth repo.

The idea is to stop doing risky things; especially since alioth is already 
very fragile (IMHO).

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/ijm27f$q3h$1...@dough.gmane.org



Switching to read-only repository on qa host

2011-02-17 Thread Raphael Geissert
Hi,

Unless there's any justified objection, I'm going to switch the qa 
repository checkout on quantz to use https instead of ssh.
The side effects will be:
a) no special subversion configuration will be needed for the qa user to 
update the repository, and
b) it won't be possible to commit changes from within that checkout.

It would be great if the PTS followed the change too, but that's more on 
hands of Raphaël Hertzog and Stefano Zacchiroli. In fact, it would be even 
better if that mantra becomes part of the past.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/ijkjtc$tap$1...@dough.gmane.org



Bug#612841: udd: package info from security mirror horribly out of date, still

2011-02-10 Thread Raphael Geissert
Package: qa.debian.org
Severity: important
User: qa.debian@packages.debian.org
Usertags: udd

Hi,

I reported at some point last year (back in September?) that the security 
mirror info from udd is out of date, and to date it still is.
Back then the local mirror was apparently not being updated, but I don't know 
what else, if anything was done.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201102102024.28224.geiss...@debian.org



Bug#611066: UDD: please import Packages and Sources from archived releases

2011-01-25 Thread Raphael Geissert
Package: qa.debian.org
User: qa.debian@packages.debian.org
Usertags: udd
Severity: wishlist

Hi,

It would be nice to have the list of packages and sources from archived 
releases in a some sort of archived_{packages,sources} tables.

Thanks in advance.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201101250317.07226.geiss...@debian.org



Re: [UDD] Packages flagged 'error' in DEHS import

2011-01-20 Thread Raphael Geissert
Raphael Geissert wrote:
> Experimental:
>> Last time checked: 2011-01-04 18:07:05
> Unstable:
>> Last time checked: 2011-01-04 18:07:24
> 
> Something must have went wrong between the two checks.

And it failed again. There seems to be something limiting the number of 
connections.

I've modified the database by hand so that ncbi-tools6 in unstable is marked 
as if it was checked yesterday, hoping that's enough.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/iharn4$atd$1...@dough.gmane.org



Re: [UDD] Packages flagged 'error' in DEHS import

2011-01-20 Thread Raphael Geissert
Andreas Tille wrote:

> On Wed, Jan 19, 2011 at 10:53:13PM -0600, Raphael Geissert wrote:
>> > Any reasonable explanation for this?
>> 
>> Experimental:
>> > Last time checked: 2011-01-04 18:07:05
>> Unstable:
>> > Last time checked: 2011-01-04 18:07:24
>> 
>> Something must have went wrong between the two checks.
> 
> How are these checks triggered?

There are multiple cronjobs that run the main script (dehs.sh) under 
different modes ('all' and 'new', mainly.)

> This check was two weeks ago - what is the period between two regular
> checks?

Normally, a watch file is checked at least every five days. Sooner if the 
package is updated before its next, scheduled, update.

> Can you force a new check?

Yes.


Apparently, the periodic update wasn't done because the script was dying 
because it exceeded the memory limit (meaning no update was done for about 
two weeks). I failed to notice the error message between the frequent 
ENOSPACE messages, *sigh*.
I just increased the memory limit and triggered an update, but I can see 
some ftp-related failure. Will investigate those later. 

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/ihafjo$p5e$1...@dough.gmane.org



Re: [UDD] Packages flagged 'error' in DEHS import

2011-01-19 Thread Raphael Geissert
Andreas Tille wrote:

> Hi,
> 
> I was wondering, why DEHS claims ncbi-tools6 as not 'uptodate' but rather
> 'error'. The DEHS page[1] says for experimental
> 
[...]
> I'm actually running into an error.  What I really do not understand is,
> that the package in unstable has the very same watch file and does not
> seem to produce an error because it correctly detects outdated and is
> linking to the new version.
> 
> Any reasonable explanation for this?

Experimental:
> Last time checked: 2011-01-04 18:07:05
Unstable:
> Last time checked: 2011-01-04 18:07:24

Something must have went wrong between the two checks.

-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/ih8f3q$v9c$3...@dough.gmane.org



Bug#609800: qa.debian.org: please add NEW queue info to madison.php

2011-01-12 Thread Raphael Geissert
user qa.debian@packages.debian.org
clone 609800 -1
block 609800 by -1
usertags -1 udd
retitle -1 udd: please add a 'release' column to new_{package,source}s
thanks

Paul Wise wrote:
> Package: qa.debian.org
> Severity: wishlist
> 
> Please add information about the NEW queue to madison.php so that

(requests to madison.php are rewritten to cgi-bin/madison.cgi)

> rmadison will show information about source and binary packages in the
> NEW queue. Machine-readable information about the NEW queue is here:
> 
> http://ftp-master.debian.org/new.822

Only a small change needs to be made to UDD and the rest is a snap.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4d2e8891.0431640a.09dd.5...@mx.google.com



Bug#597896: udd: should know about packages in debian-ports.org

2010-09-23 Thread Raphael Geissert
On 23 September 2010 17:44, Raphael Geissert  wrote:
> Would be great if UDD knew about debian-ports.org and that the sources
> and packages from there were added to all_packages and all_sources.
> That would make it trivial to fix #513685.

Er, I meant #431800.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/aanlktin4v8nc+oo-muo6_ca=x13kv9dvibgsoiq_1...@mail.gmail.com



Bug#597896: udd: should know about packages in debian-ports.org

2010-09-23 Thread Raphael Geissert
Package: qa.debian.org
Severity: wishlist
User: qa.debian.org
Usertags: udd

Hi,

Would be great if UDD knew about debian-ports.org and that the sources
and packages from there were added to all_packages and all_sources.
That would make it trivial to fix #513685.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/aanlkti=zqyxlrbkwqwujdcuzmpnu9uvdcrcubdwzu...@mail.gmail.com



Re: qa.debian.org moved to quantz, bugs.qa.debian.org to be dropped

2010-09-17 Thread Raphael Geissert
Christoph Berg wrote:

> We've just moved qa.debian.org to quantz.debian.org.
> 
> I've fixed most scripts and cronjobs, what's missing atm is a "dak ls"
> command so rmadison is currently broken. I hope to fix that tomorrow.

 pinotree: with the move of qa.d.o to another host, the original 
[rmadison] backend doesn't work anymore
 so I'm using an http redirect until we restore the original 
backend somehow, or a permissions problem is fixed and I can avoid the http 
redirect (which should fix lenny's rmadison)

Atm, upgrading to squeeze's devscripts (or the one in bpo), or modifying 
rmadison(1)'s call to curl so that it passes -L too, should fix it.

The current backend is fed by UDD, uses code names, and includes more 
suites. E.g.

$ rmadison lintian
 lintian | 1.23.28+etch1   | etch-security   | source, all
 lintian | 1.23.28+etch1   | etch| source, all
 lintian | 1.24.2.1+lenny1 | lenny-security  | source, all
 lintian | 1.24.2.1+lenny1 | lenny   | source, all
 lintian | 2.2.0~bpo40+1   | backports/etch  | source, all
 lintian | 2.4.3~bpo50+1   | backports/lenny | source, all
 lintian | 2.4.3   | squeeze | source, all
 lintian | 2.4.3   | sid | source, all

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/i7118l$dv...@dough.gmane.org



Re: Merkel going away

2010-09-05 Thread Raphael Geissert
Luk Claes wrote:

> On 09/05/2010 08:14 PM, Peter Palfrader wrote:
>> On Sun, 05 Sep 2010, Luk Claes wrote:
>>>> We have begun communicating with the affected teams about moving their
>>>> services to alternate machines.  The projectb mirror/ftp mirror will be
>>>> relocated in the near future to ries.
>>>
>>> Does that mean every DD can login to ries and that qa.debian.org will
>>> also move to ries?
>> 
>> yes.  and no.
>> 
>> I think the plan was to move qa to salieri, tho nothing has been done on
>> that front yet.
> 
> The reason I ask is because http://qa.debian.org/madison.php (which gets
> called from rmadison from the devscripts package) needs a working dak,
> so currently relies on the mirror being local.

An alternative (UDD-based) is [1], but the information provided by it can 
lag a few hours. That could of course be improved but that needs some 
coordination between the UDD maintainers, ftpmasters (maybe, not sure,) and 
DSA.

Shameless plug: you can also use the same CGI to check ubuntu, all the 
derivatives, and everything UDD knows about. You just need to pass it the 
"table" argument (with either debian, ubuntu, derivatives, or all.) E.g. 
http://qa.debian.org/cgi-bin/madison.cgi?package=lintian&table=all

[1] http://qa.debian.org/cgi-bin/madison.cgi
Also known as 'udd' to the rmadison script. I.e. `rmadison -u udd`

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4c84379b.9f3ae70a.73a6.9...@mx.google.com



Re: [UDD] dehs does not necessarily contain latest version

2010-08-05 Thread Raphael Geissert
Lucas Nussbaum wrote:
> I'm not sure of the problem here. It can either be:
> - In the dehs table, UDD shows the unstable_version as provided by DEHS,
>   which, due to synchronization delays, might not be the latest one in
>   unstable. => I don't think that this should be fixed

Not a sync problem, DEHS has the same version too.

> - DEHS is not aware that there can be multiple versions in unstable.
>   => This totally should be fixed

DEHS is aware of that and normally uses the latest version it finds. By 
taking a look at the code, there is a bug when handling epochs, which *is* 
the case.
The results of the query provided by Andreas first confused me, because I 
though there was no epoch at all and that that was not the bug.

Will fix it in a moment.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/i3f7p6$kr...@dough.gmane.org



Re: [poll] Ubuntu column on DDPO visible by default?

2010-08-05 Thread Raphael Geissert
Lucas Nussbaum wrote:
> I think that displaying all columns by default is fine. Most of us don't
> do development on netbooks with small resolutions. And those who do
> could change the config once (there's a cookie).

You should probably define what you mean by "us" because I'm sure you can 
not tell that for sure. But anyway, at home I have a desktop computer with a 
monitor of a maximum mode of 1024x768 and I can tell you for sure that the 
default DDPO view exceeds the width.

The problem is not just about how much data should to included: only 
information should be included while having usability in mind.

I can of course use my browser's feature of making the page fit to the 
screen's width or just zoom out: I have alternatives, but that's not the 
point.

That said, I'm now disabling the "binary packages" column from the default 
view given that nobody has objected at all, so far.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/i3f6hb$gf...@dough.gmane.org



Bug#591499: qa.debian.org: move configuration options/help below report

2010-08-03 Thread Raphael Geissert
Jakub Wilk wrote:
> * Vagrant Cascadian , 2010-08-03, 09:00:
>>i was wondering if it would be possible to move the configuration and
>>help options after the reported package information.
>>
>>with a web browser with a small display and no javascript, this would
>>make useful information available at the top of the screen without
>>having to configure anything, rather than having to scroll down, set
>>urls or configure a cookie ... just like the bad ol' days before you
>>could configure much.
> 
> "Display configuration" and "Help" boxes were there for a while; they
> were just hidden by default. Nowadays, even with 1280×1024 resolution,
> DDPO show exactly *no* useful information without scrolling.

Only if your browser doesn't support javascript or if you disable it.

But yeah, I guess I'm going to move them below the main tables.

-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4c58725f.8157e60a.71a8.d...@mx.google.com



Re: [poll] Ubuntu column on DDPO visible by default?

2010-08-03 Thread Raphael Geissert
Lucas Nussbaum wrote:
> Results: 15 votes, 10 for making it visible by default, 5 against, and
> nobody cared enough to start a flamewar on debian...@.
> 
> So I'm making it visible by default now.

I'm against that change. There are too many columns already and what we need 
is *useful* information, not just a zillion of links (for which we have the 
PTS, as it is a per-package view, instead of a per-maintainer view.)

I would actually like to hide some of them by default (e.g. who uses the 
"binaries" column at all?!)

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/i39rue$81...@dough.gmane.org



Bug#561655: qa.debian.org: Popcon statistics for a given source package should include old binary packages

2010-07-28 Thread Raphael Geissert
Hi,

There's no easy way to fix this without messing on the way the DDPO handles 
packages. One of the side effects of making this change would be that the DPPO 
would include all the binary packages even when they've been moved to a 
different source package in unstable.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201007281606.37755.geiss...@debian.org



Bug#577176: PTS: display info from security team's embedded-code-copies file

2010-06-24 Thread Raphael Geissert
clone 577176 -1
reassign -1 security-tracker
retitle -1 parse and provide list of packages embedding code copies
block 577176 by -1
thanks

Paul Wise wrote:
> It would be nice if the PTS could parse the security team's
> embedded-code-copies file[1] and put a TODO note for those source
> packages that are marked as  (embed). Some other types might
> also be appropriate for a TODO note, CCing the security team for input.
> 

The first blocker is that the sec tracker isn't parsing the file at all (and 
the file's format is not very well defined.)

The PTS' side of the issue is trivial, once the tracker starts providing the 
data feed.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4c23f3a9.0953e70a.0715.1...@mx.google.com



Bug#581752: qa.debian.org: watch file redirect service

2010-05-15 Thread Raphael Geissert
Osamu Aoki wrote:
> But this [qa.d.o/watch/sf.php] service is somewhat obscure and its source 
location and
> patch submission is hidden well into maze of Debian infrastructure.
> 

No, it isn't. It's where all the rest of the code of qa and collab-qa is: 
svn.d.o

> So my wishlists are:
> 
> 1. http://qa.debian.org/watch/README needs to provide required pointer
>to ket information site such as http://wiki.debian.org/debian/watch

Like http://qa.debian.org/watch/sf.php?

(manpages.d.n seems to be done atm, but that's another issue and is not on 
my hands.)

> 2. Publish redirector code

http://svn.debian.org/viewsvn/qa/trunk/wml/watch/sf.wml?view=markup
http://svn.debian.org/viewsvn/qa/trunk/data/watch/update-sf-list?view=markup

> The idea of redirector is great 

No, it is not. It is a workaround and workarounds are not "great."


If there's nothing else, I'm going to close the report.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4beecc58.1508c00a.07ba.7...@mx.google.com



Re: pilot-qof & dpkg-cross reports in PTS

2010-05-15 Thread Raphael Geissert
Neil Williams wrote:

> On Sat, 15 May 2010 15:20:23 +0200
> Florian Weimer  wrote:
>> I suppose the export script needs to skip issues which are marked as
>> unimportant.

Yes, that seems to be the reason why the PTS says there are 76 unfixed 
issues affecting php5.

> This CVE isn't unimportant, it is invalid and should be deleted, not
> ignored.

Once a CVE id is assigned it can not be deleted (removing it from the 
tracker wouldn't work either, as it would automatically inserted again.) 
They can however be marked as DISPUTED or REJECTED (by MITRE,) and the 
former seems to be how the pilot-qof and dpkg-cross issues were marked.

I think it is important to leave the name of the packages related to that   
CVE in the tracker for cross-referencing purposes, but something needs to be 
done about unimportant issues in general. They are usually completely 
ignored as if they never existed, and as such they may have incorrect 
information (e.g. the issue has been fixed at some point, the packaged 
removed, etc.)


> The dpkg-cross one also no longer applies - the gccross script migrated
> into a different package and the migrated version is soon to be removed
> from Debian anyway as it has been superseded. dpkg-cross in Debian no
> longer contains gccross. However, because there was no issue to
> resolve, the CVE just gets left behind??

There are two problems here, the one I just described that affects all 
issues marked as unimportant, and the other is the fact that we lack of 
proper tools to for example track files that are moved between packages.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4beec93a.1608c00a.13a0.7...@mx.google.com



Bug#581622: [qa.debian.org] Please provide a code.google.com redirector

2010-05-14 Thread Raphael Geissert
severity 581622 wishlist
thanks

Jakub Wilk wrote:
> * Peter Fritzsche , 2010-05-14, 13:07:
> 
>>Please provide a way to use uscan like we do it already with sourceforge.
> 
> That said, I concur that a redirector would be useful.

Before we get to that point, please try contacting them and explain the 
situation. A redirector still requires maintenance (and in this case it 
seems it would be necessary to actually make the redirector fetch a page, 
which is not something I'm very happy about.)

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4bee0ae4.1608c00a.0bad.6...@mx.google.com



Re: gob2_2.0.16-3_amd64.changes ACCEPTED

2010-04-28 Thread Raphael Geissert
Mark Brown wrote:
> Look, I'm not saying that there's no problem with the upload here.  What
> I'm saying is that an e-mail such as that which was sent originally sent
> tended rather to the hostile and appears to have unrealistic expectation
> as to the sort of work that a maintainer is going to do when orphaning a
> package.

You are right. I could have written my email in a much better way.
I apologise for that.

Regards,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4bd8ddc2.1ca6650a.7e63.1...@mx.google.com



Re: gob2_2.0.16-3_amd64.changes ACCEPTED

2010-04-27 Thread Raphael Geissert
Hi Mark,

Archive Administrator wrote:
> 
> Accepted:
> gob2_2.0.16-3.debian.tar.gz
>   to main/g/gob2/gob2_2.0.16-3.debian.tar.gz
> gob2_2.0.16-3.dsc
>   to main/g/gob2/gob2_2.0.16-3.dsc
> gob2_2.0.16-3_amd64.deb
>   to main/g/gob2/gob2_2.0.16-3_amd64.deb
> 
> 
> Override entries for your package:
> gob2_2.0.16-3.dsc - source devel
> gob2_2.0.16-3_amd64.deb - extra devel
> 
> Announcing to debian-devel-chan...@lists.debian.org

>From the changelog: 
>* Orphan package.

Right, but orphaned packages are _not_ set to this discussion ML.

A quick look at the devref or at any of the over 436 orphaned packages would 
have told you the correct address.
Even running lintian on the package you uploaded points you to the right 
direction:

$ lintian gob2_2.0.16-3.dsc
W: gob2 source: _changelog-should-mention-nmu_
W: gob2 source: source-nmu-has-incorrect-version-number 2.0.16-3
W: gob2 source: debhelper-but-no-misc-depends gob2
W: gob2 source: package-uses-deprecated-debhelper-compat-version 4
E: gob2 source: *wrong-debian-qa-address-set-as-maintainer* Debian QA 

W: gob2 source: _no-human-maintainers_
W: gob2 source: out-of-date-standards-version 3.8.2 (current is 3.8.4)

$ lintian-info -t wrong-debian-qa-address-set-as-maintainer
N: wrong-debian-qa-address-set-as-maintainer
N:
N:   Orphaned packages should no longer have the address
N:in the Maintainer field.
N:
N:   The correct Maintainer field for orphaned packages is Debian QA Group
N:   .
N:
N:   Refer to Debian Developer's Reference section 5.9.4 (Orphaning a
N:   package) for details.
N:
N:   Severity: important, Certainty: certain
N:


If tools are written for the purpose of catching mistakes (and bugs) 
beforehand *please use them*. Thanks.

Kind regards,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net


-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4bd78b2c.1608c00a.4fc5.c...@mx.google.com



Bug#577746: debcheck: not updated since 12 Feb 2010

2010-04-19 Thread Raphael Geissert
Thijs Kinkhorst wrote:
> 
> The pages at http://qa.debian.org/debcheck.php have not been updated
> anymore since two months now, as the footer shows.
> 

This is caused by #567528 and lack of code on debcheck's side to report the 
error (it just detects it and dies[1].)
I've asked our ftp-masters to please auto-reject packages triggering bad-
version-in-relation to help avoid such cases in the future, but a) no 
response so far, and b) it wouldn't have prevented python-kde4's bug because 
it was introduced by a binNMU.

Ideally both bugs should be fixed, but I guess the kde4 bug will be fixed 
way before somebody hacks debcheck (unless it is to comment the line that 
makes it abort, but I don't know the side-effects.)

[1] line 861 of data/debcheck/debcheck:
die ("malformed-relationship not supported yet\n")

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/4bcd0043.1402be0a.0a70.7...@mx.google.com



Re: Bug#576240: say what ITP means right there in the report

2010-04-08 Thread Raphael Geissert
Holger Levsen wrote:
> 
> If I look at the results at http://search.debian.org/?q=itp I roll my eyes
> and go away, sorry. As much as I'm impressed^wsurprised the search does
> something again, I'm totally unimpressed by those search results.
>  

See for more info:
http://wiki.debian.org/SummerOfCode2010/ImprovementsToDebianSearch

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/hpl00v$f4...@dough.gmane.org



Bug#576240: say what ITP means right there in the report

2010-04-07 Thread Raphael Geissert
FWIW:

1. If the BTS is going to be modified to display some alt text, then the bug 
should be reassigned to debbugs.

2. The wnpp BTS page already displays the complete text of each abbreviation.
(not sure if it is possible to for example remove the "Outstanding bugs" part, 
@owner?)

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201004071159.29642.geiss...@debian.org



Bug#561655: qa.debian.org: Popcon statistics for a given source package should include old binary packages

2009-12-25 Thread Raphael Geissert
Hi Mike,

Mike Hommey wrote:
[...] 
> It includes information about the most recent binary packages, from
> unstable, but doesn't track the packages from stable, which have different
> names. Their graphs are still available directly, though:
> http://qa.debian.org/popcon-graph.php?packages=xulrunner-1.9
> 

This should be easier to implement as soon as the qa scripts are switched to
use the pgsql database, until then I don't think this will be fixed (the
same problem affects developer.php).

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net





-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#560697: qa.debian.org: old watch file used for DEHS for pam-pgsql

2009-12-14 Thread Raphael Geissert
Hi,

2009/12/14 Jan Dittberner :
> On Fri, Dec 11, 2009 at 04:28:46PM -0600, Raphael Geissert wrote:
>>
>> It uses the watch file and version information from the first entry it finds
>> of a package in Sources. So yes, your package is not yet at the same
>> version in all the architectures.
>
> It is at least on all supported architectures in unstable. Even the version in
> testing has a newer watch file.

No, check packages.d.o, hurd still has the old version DEHS is finding.

>
>> I will eventually make it use the latest version no matter in what place in
>> the Sources file is, but this requires more work than what I am willing to
>> commit to DEHS right now.
>
> Would you like me to provide a patch for this issue?
>

Would be great if you could provide one. Basically what needs to be
done is move the code that injects the new packages in the temporary
tables outside the loop that reads the Sources file of each archive
area. That loop should then be modified to store in the hash the data
that is later to be injected into the database, and compare the
version numbers if an entry already exists on the hash. The db-related
code should then work based on the generated hash.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: Bug#560352: PTS page scew-up? (pcsc-omnikey)

2009-12-13 Thread Raphael Geissert
Lucas Nussbaum wrote:

> On 13/12/09 at 16:39 -0600, Raphael Geissert wrote:
>> * DEHS: fixed to make it work with current Sources, but it uses the first
>> version it finds, which happens to be the oldest
> 
> That doesn't really count as "fixed" :-)

It's better than just failing to update the database because the
(package,release) unique constraint is not met :).

> 
>> * security tracker: fixed
>> * lintian.d.o: not even reported, just noticed it
>> * PTS: dunno
> 
> * PTS: affected, not fixed yet
> * DDPO: affected, not fixed yet AFAIK
> * britney: fixed

Right, I forgot about britney migrating different package versions :)

> * piuparts.d.o: dunno
> * UDD: well, "it's not a bug, it's a feature". added a view to provide
>   the old information. Some CGIs or views are probably still broken.

Why not do it the other way around? that way less things will break.

> * my archive rebuild scripts were affected (fixed)

Mines will happily accept any number of versions, but it's useless to test
old versions.

> * Ubuntu syncs might be affected as well
> 

Yay, second breakage (merge-o-matic was broken with format 3.0 IIRC)

> Now, packages:
> * debmirror?

I only use it for binary packages, and seems to be working fine (in spite of
the multiple arch:all packages).

> * APT proxies?
> * Stuff in devscripts? (dd-list works fine)

Have you checked if it considers the latest version?

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#560697: qa.debian.org: old watch file used for DEHS for pam-pgsql

2009-12-13 Thread Raphael Geissert
Jan Dittberner wrote:

> Package: qa.debian.org
> Severity: normal
> 
> my DDPO shows an outdated upstream version in the unstable Watch column.
> Obviously DEHS does not use the current watch file from the package in
> unstable but an old version (maybe the one from the version in Lenny).
> 

It uses the watch file and version information from the first entry it finds
of a package in Sources. So yes, your package is not yet at the same
version in all the architectures.

I will eventually make it use the latest version no matter in what place in
the Sources file is, but this requires more work than what I am willing to
commit to DEHS right now.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net





-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: Bug#560352: PTS page scew-up? (pcsc-omnikey)

2009-12-13 Thread Raphael Geissert
Stefano Zacchiroli wrote:
> 
> I think we should understand how many things have been broken by this:
> if they're many we can ask for the revert and start porting the code, if
> we're a few just fix them. The PTS, for once, can easily be fixed: it
> would be enough to remember the most recent version read while importing
> Sources (but unfortunately I didn't have time to do that this week-end).
> 
> How about mailing -devel and ask people to report breakages? (better if
> with pointers to the already reported bugs)
> 

* DEHS: fixed to make it work with current Sources, but it uses the first
version it finds, which happens to be the oldest
* security tracker: fixed
* lintian.d.o: not even reported, just noticed it
* PTS: dunno
* UDD: dunno
* ...?

There might be as well many more.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: No more userdir on merkel (Was: UDD upload-history update-command broken)

2009-10-13 Thread Raphael Geissert
Bart Martens wrote:

> On Tue, Oct 13, 2009 at 04:16:33PM +0200, Sandro Tosi wrote:
>> On Tue, Oct 13, 2009 at 16:10, Raphael Geissert 
>> wrote:
>> > merkel has been moved to apache2 and php5 recently, and userdirs are
>> > disabled per DSA policy.
> 
> Userdirs still work on merkel.  See:
> http://merkel.debian.org/~morph/
> 

Yeah, but that's because it still uses apache, but DSA plans to switch
everything to apache2 sts.

>> 
>> Am I the only one quite unhappy with this change? If I'm alone, no
>> problem, I'll find something else, but if we are a bit more, what do
>> you think about contacting DSA and ask to rethink about this change?
>> 

I've asked them to re-enable it and it was denied, at least for the qa.d.o
case. One of the reasons was so that stuff that matters isn't restricted to
a person, so that in the event the person doesn't have time or whatever,
anyone else can take over.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: UDD upload-history update-command broken

2009-10-13 Thread Raphael Geissert
Hi Andreas, Filippo,

Andreas Tille wrote:

> Hi,
> 
> the upload-history seems to gather its information from
> 
>http://qa.debian.org/~filippo/ddc/
> 
> but this results in "Not found".  Any clue what happened
> to this page and where to obtain the information?

merkel has been moved to apache2 and php5 recently, and userdirs are
disabled per DSA policy. I've workarounded the problem by adding a symlink,
but Filippo, please move the files elsewhere (say directly under the qa.d.o
space).

Thanks.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#460983: PTS: Please link to Security Tracker

2009-09-23 Thread Raphael Geissert
merge 460983 520051
tag 460983 patch
thanks

Attached patch should do it. Not committing it as I would like another review 
(buxy already took a quick look at it).

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net
Index: www/xsl/pts-issues.xsl
===
--- www/xsl/pts-issues.xsl	(revision 2272)
+++ www/xsl/pts-issues.xsl	(working copy)
@@ -307,4 +307,17 @@
 
   
 
+  
+
+  There are
+	is
+	  http://security-tracker.debian.net/tracker/source-package/{$escaped-package}";>
+	  
+	  open security issues
+	, please fix them
+	it.
+  
+
+  
+
 
Index: www/bin/other_to_xml.py
===
--- www/bin/other_to_xml.py	(revision 2272)
+++ www/bin/other_to_xml.py	(working copy)
@@ -319,6 +319,11 @@
 dehs[pkgname] = {}
 dehs[pkgname]['error'] = msg
 
+# read list of unfixed security issues
+security = {}
+for pkgname, count in read_dehs(os.path.join(dir, "security_issues.txt")):
+security[pkgname] = count
+
 # read short descriptions
 shortdescs = read_shortdesc(os.path.join(dir, "shortdesc.txt"))
 
@@ -573,12 +578,22 @@
 else:
 shortdesc_sig = ''.__hash__()
 
+# Get security issues
+if security.has_key(pkg):
+elt = doc.createElement('security')
+root_elt.appendChild(elt)
+root_elt.setAttribute('security', security[pkg])
+sec_sig = security[pkg]
+else:
+root_elt.setAttribute('security', '0')
+sec_sig = '0'
+
 # TODO: try to do that signature checking before the creation of XML DOM
 # Build the sig and check if anything changed
 sig = (pts.get(pkg, "0"), dc_sig, wnpp_sig, override_sig, dehs_sig,
 ubuntu_sig, s_rc, s_normal, s_wishlist, s_fixed, s_gift, s_help,
 subsig, svnbuildstat_sig, transitions_sig, lintian_sig,
-shortdesc_sig, piuparts_sig, new_queue_sig, i18n_sig)
+shortdesc_sig, piuparts_sig, new_queue_sig, i18n_sig, sec_sig)
 if sigs.has_key(pkg) and sig == sigs[pkg] and \
 os.path.isfile("%s/%s/%s/other.xml" % (odir, hash, pkg)):
 continue
Index: www/bin/update_incoming.sh
===
--- www/bin/update_incoming.sh	(revision 2272)
+++ www/bin/update_incoming.sh	(working copy)
@@ -163,6 +163,10 @@
 nice_wget http://dehs.alioth.debian.org/no_upstream.txt \
 dehs_error.txt
 
+# download list of security issues
+nice_wget http://alioth.debian.org/~geissert/security-packages.txt \
+security_issues.txt
+
 # download NEW queue info
 nice_wget http://ftp-master.debian.org/new.822 new.822
 


Re: Bug#545785: PTS: lintian link issues

2009-09-10 Thread Raphael Geissert
Stefano Zacchiroli wrote:
> 
> Currently the PTS is aware only of errors and warnings, which are
> delivered to it via http://lintian.debian.org/qa-list.txt .
> 

Wouldn't it be easier to extract that information from UDD? that would
reduce the special-casing needed on lintian's side.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#537519: popcon tables again not updated

2009-09-07 Thread Raphael Geissert
Hi,

Felix Zielcke wrote:

> As you can see from the grub-pc popcon data the tables aren't again
> updated:
>
http://qa.debian.org/popcon-graph.php?packages=grub-pc&show_installed=on&want_legend=on&want_ticks=on&from_date=2009-09-01&to_date=&hlght_date=&date_fmt=%25Y-%25m&beenhere=1
> http://qa.debian.org/popcon.php?package=grub2
> (And yes the grub2 popcon stats are important to me ;)

The cronjob failed the other day and I had forgotten to remove the lock
file, but I did it yesterday night, so it should be just a matter of
waiting a couple of hours for the cronjob to be run again.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net





-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#520051: PTS: Please link to Security Tracker

2009-08-27 Thread Raphael Geissert
Hi,

As requested by zack via IRC when I sent him the address:
http://alioth.debian.org/~geissert/security-packages.txt

The file is automatically updated several times a day and should be enough to 
add a TODO or "problems" entry and a link to
http://security-tracker.debian.net/tracker/source-package/

It might be better to move the file somewhere else at some point, but once it 
is integrated into the PTS it would be a matter of changing the url, and I 
think I have enough privileges to do that.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#537519: http://qa.debian.org/popcon graphs not being updated

2009-08-26 Thread Raphael Geissert
On Wednesday 26 August 2009 15:55:59 Felix Zielcke wrote:
> Hello,
>
> thanks seems to be fixed now. First updated popcon count for grub-pc was
> ~3850 then 3910 and now it's 3897
> Though the pages still say `Last generated on Sun Jun 14'.

Yeah, that's normal, the .php files are not the ones that had to be 
modified/generated so the dates didn't change.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#537519: http://qa.debian.org/popcon graphs not being updated

2009-08-23 Thread Raphael Geissert
Hi,

On Sunday 23 August 2009 04:31:12 Felix Zielcke wrote:
> The tables were now updated at least once but they stopped being updated
> again.
> For example with grub-pc the graph shows ~3900 users but the table says
> only 3331. And both pages say `last generated on 14th July'.
>
> http://qa.debian.org/popcon-graph.php?packages=grub-pc&show_installed=on&wa
>nt_legend=on&want_ticks=on&date_fmt=%25Y-%25m&beenhere=1
> http://qa.debian.org/popcon.php?package=grub2

Thanks for reporting it, seems like the cronjob is failing at some point.
I've manually regenerated the files and added myself to the cronjob failures 
notification so that I get more information whenever it fails again.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#537519: Update problem inverted

2009-08-07 Thread Raphael Geissert
On Thursday 06 August 2009 23:56:36 Amos Jeffries wrote:
> Thank you, that does appear to have fixed the graphs.
>
> Now we have the tables not updating :(

I'm aware of that, I don't know why it failed to update the popcon data and so 
it left the lock which prevented further updates. I have now removed the lock 
and will ask somebody to re-run the cronjob, that should fix it.

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#499546: If UDD knew about this it would be easier...

2009-07-22 Thread Raphael Geissert
clone 499546 -1
user qa.debian@packages.debian.org
usertags -1 - dehs
usertags -1 + udd
retitle -1 [UDD] please provide information about packages in NEW
thanks

Cheers,
-- 
Raphael Geissert - Debian Developer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#532259: generator script of ddpo_maintainers misparses email addresses

2009-06-07 Thread Raphael Geissert
Package: qa.debian.org
User: qa.debian@packages.debian.org
Usertags: ddpo

Hi,

While hunting down bugs on ddpo-by-mail I found the following bug in 
ddpo_maintainers:
> ;bel...@fukt.bsnet.se;NOID;Teddy Hogeborn ,   
Björn Påhlsson;mandos#;;

Not sure what causes it (haven't looked at it actually). 

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



--
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: Problems witht the QA redirector

2009-05-20 Thread Raphael Geissert
Hi Martín,

Martín Ferrari wrote:
> Hi!
> 
> On Wed, May 20, 2009 at 20:01, Raphael Geissert
>  wrote:
>> (basically what I told you yesterday via IRC.)
> 
> Er... I don't have that in my backlog... Which channel?

I didn't explain all that, but:

#debian-devel:
16:54  Tincho: the sf redirector issue should be fixed as soon as
somebody commits a change I just sumbitted on #-qa and the redirector is
rebuilt


By the way, could you please update the DEHS link on pkg-perl.a.d.o so that
it uses report.php instead of maintainer.php?
Just replace it with:
http://dehs.alioth.debian.org/report.php?login=pkg-perl-maintain...@lists.alioth.debian.org

P.S. no need to CC me as long as -qa receives a copy :)

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: sf.net redirector reports 500 Internal Server Error

2009-05-20 Thread Raphael Geissert
Bart Martens wrote:
> On Sat, May 16, 2009 at 09:52:02PM -0500, Raphael Geissert wrote:
[...]
>> The way to
>> address the real issue is, like I've already said several times, to
>> contact sourceforge and reach an agreement.
> 
> As I wrote before, it is possible without such agreement, although
> probably easier with.

Since there's now a working mirror which doesn't need enhanced-matching this
discussion in my opinion is over.

What will follow now is a discussion with sourceforge so that we reach an
agreement. The reason for them to make mirrors stop displaying the
directory listing, I think, is related to the fact that they want all the
requests to go through their system and because no file can ever be removed
from a mirror. In the latter case, all a project admin can do is hide the
files, but by displaying the directory listing the mirror are not helping.

> Let's not confuse my previous attempt to join the DEHS team with the
> current one.

Am not confusing anything, I just don't forget. I have not seen you do
anything we talked about when you first wanted to join and you failed to
even explain in a human English what you wanted to do. Correct me if I'm
wrong.

> You wrote "I once wrote a script" and "nobody ever replied".  And now you
> wrote
> "it was never accepted". 

Ok, let me rephrase that: there was no support from the ML (whatever that
may mean for every reader of this list.)

> Well, in my opinion, if you've found a way to 
> improve
> efficiency with freshmeat and KDE, then it's well worth considering.  Do
> you need help with it ?
> 

All emails are archived, those threads should be there.

Regards,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: Bug#465434: qa.debian.org: Uscan Errors processing Watch File

2009-05-20 Thread Raphael Geissert
Bart Martens wrote:

> On Sun, May 17, 2009 at 11:27:25AM -0500, Raphael Geissert wrote:
[...]
> 
> Can you modify the rescanning so that such 403's are
> rescanned sooner than with the next total rescan every 4 days ? Note that

No matter how good that idea may sound, it isn't. By re-checking them all in
one go they are more prone to be checked together once again, and if a
temporary error affects them, they will all be affected.

There used to be a weekly cronjob that re-checked all the failed watch
files, but it didn't work well for the above mentioned problem.

> such 403's may (I'm guessing) repeat to be 403's as long as they're in the
> total rescan.

There's no such total rescan; rechecking all the 8431 watch files every four
days in one go would degrade the performance of the system. Every watch
file is independent of each other (and so their last-checked timestamp).

> Maybe  
> semi-automatically/manually rescan selectively and inject the successful
> results at some convenient point in the data flow to the
> qa-developer-pages ? It could be an effectively working workaround until
> DEHS2 is released.
> 

The BDBs and all the files used by external systems are regenerated every
time a run finishes (that includes the daily new packages processing and
the daily general processing).

>> 
>> >> > Displaying the old version on the
>> >> > qa-developer-pages until the next rescan is successful.
>> >> 
>> >> Something similar is planned for DEHS2
>> > 
>> > Release in 2009 ?
>> 
>> Of course; but some major work needs to be done in uscan first.
> 
> I understand that major work may be required for DEHS2, but I don't think
> that uscan needs any changes to have the old rescan results displayed on
> the
> qa-developer-pages until the next rescan is successful.

No, they aren't; but for uscan to be useful to DEHS2 it will be turned into
a perl module. No more workarounds for DEHS are going to be made, unless
there's a critical issue that needs to be fixed (and I don't expect any,
since the same code base has been used since 2004).

> Any chance that 
> this gets planned a bit earlier, so before the entire DEHS2 ?
> 

Nope
 
>> >> > Re-scanning selectively briefly (minutes/hours) after the failed
>> >> > scans to deal with temporary errors.
>> >> 
>> >> No, that won't happen as it would be easier to get alioth banned.
>> > 
>> > Isn't waiting an hour or 2 and try again exactly the approach to work
>> > around such temporary ban ? Or do you fear a permanent ban ?
>> > 
>> 
>> I'm not fearing a permanent ban, but for example berlios' ban lasts a
>> day.
> 
> So for Berlios re-scanning selectively briefly after the failed scans to
> deal with temporary errors could be done after one day, obviously.

That's exactly what happens, every four days.

Regards,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: Please apply patch to the redirector

2009-05-20 Thread Raphael Geissert
Filippo Giunchedi wrote:
[...]
> 
> done, should be live at next web rebuild (I have no qa sudo access and I
> missed the cronjob by 3 minutes)
> 

Great, thanks.

One more item off my to-do list :)

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: Problems witht the QA redirector

2009-05-20 Thread Raphael Geissert
Hi Martín,

(basically what I told you yesterday via IRC.)

Martín Ferrari wrote:
[...] 
> Last week the redirector started to give server errors (500 - No
> mirror could satisfy the request. Please report this message to
> debian-qa@lists.debian.org) and today it happened again.

This has now been fixed by adding another mirror that doesn't require
enhanced matching. The change introducing the new mirror has been committed
and it will be live in less than a day (I think the qa.d.o wlm pages are
rebuilt twice a day.)

> It seems that 
> this doesn't affect uscan, as one of the headers it sends
> (X-Uscan-Features: enhanced-matching) but it renders PET unusable.

enhanced-matching basically means storing the addresses of the all the pages
uscan is redirected to. Look at 367-387 and 845-870 of uscan.

The special header was introduced to avoid breaking older versions of uscan
and other implementations, so if you add support for enhanced matching
don't forget to send that header as well. That header's format is a
comma-separated list of features (enhanced-matching is the only existing
one atm.)

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Please apply patch to the redirector

2009-05-20 Thread Raphael Geissert
Hi,

>From IRC:
16:43  can anyone please apply
https://alioth.debian.org/~atomo64-guest/sf-heanet.diff to
qa/trunk/wml/watch/sf.wml
16:43  TIA
16:44  oh, and please make sure the live copy is rebuilt ASAP, so
that PET starts working once again

Re-sending now as email (can't log into IRC from here) since it hasn't yet
been applied.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#465434: qa.debian.org: Uscan Errors processing Watch File

2009-05-17 Thread Raphael Geissert
Bart Martens wrote:

> On Sat, May 16, 2009 at 10:35:08PM -0500, Raphael Geissert wrote:
>> 
>> cpan uses many many mirrors, and some are not up to date, not properly
>> setup, or cause many sort of weird errors. Since there's no easy way to
>> tell what mirror uscan connected to it is impossible for me to report
>> them to cpan. Random example from no_upstream.html:
>> 
>> uscan.pl warning: In watchfile /tmp/libclass-trigger-perl_watchyKgKAS,
>> reading webpage http://search.cpan.org/CPAN/authors/id/M/MI/MIYAGAWA/
>> failed: 403 Forbidden
>> (there are many 403s)
> 
> Can you send me a list of those ?


SELECT name FROM pkgs WHERE watch_warn LIKE '%search.cpan%403%';
 name
--
 libcrypt-gpg-perl
 libuniversal-moniker-perl
 libimage-info-perl
 libclass-dbi-plugin-retrieveall-perl
 libclass-base-perl
 libcgi-untaint-perl
 libthreads-perl
 libthreads-shared-perl
 libnet-dpap-client-perl
 libclass-dbi-pager-perl
 libclass-dbi-loader-perl
 libio-stty-perl
 libclass-trigger-perl
 dist

(yes, that's a source package name)

>> > Displaying the old version on the
>> > qa-developer-pages until the next rescan is successful.
>> 
>> Something similar is planned for DEHS2
> 
> Release in 2009 ?

Of course; but some major work needs to be done in uscan first.

> 
>> 
>> > Re-scanning selectively briefly (minutes/hours) after the failed scans
>> > to deal with temporary errors.
>> 
>> No, that won't happen as it would be easier to get alioth banned.
> 
> Isn't waiting an hour or 2 and try again exactly the approach to work
> around such temporary ban ? Or do you fear a permanent ban ?
> 

I'm not fearing a permanent ban, but for example berlios' ban lasts a day.

Regards,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net





-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#465434: qa.debian.org: Uscan Errors processing Watch File

2009-05-16 Thread Raphael Geissert

I though I had replied to this bug long time ago.

Dmitry E. Oboukhov wrote:
> Other packages are processed normally. Only 'iat' consistently shows
> error. Perhaps the problem with the firewall (OUTPUT to https)?

Actually, the problem is that berlios keeps on blocking alioth as soon as a
few requests are made (I guess they look for a U-A that looks like a
browser, and if it isn't then they are too sensitive to the number of
requests in a given period of time.)

FTR there are only 73 watch files that match the LIKE '%berlios%' query,
they aren't that many.

Bart Martens wrote:

> 
> But, there's more than "iat".  For example, the package libnet-cidr-perl
> is marked with "Error" on
> http://qa.debian.org/developer.php?login=ba...@debian.org&ordering=1 and I
> don't see why. 

Checking this too late, please attach the information provided by DEHS for
that package when you notice an error.

> Maybe there were temporary network problems, or maybe 
> cpan.org doesn't like the scanning for multiple packages in a row
> (hammering).

cpan uses many many mirrors, and some are not up to date, not properly
setup, or cause many sort of weird errors. Since there's no easy way to
tell what mirror uscan connected to it is impossible for me to report them
to cpan. Random example from no_upstream.html:

uscan.pl warning: In watchfile /tmp/libclass-trigger-perl_watchyKgKAS,
reading webpage http://search.cpan.org/CPAN/authors/id/M/MI/MIYAGAWA/
failed: 403 Forbidden
(there are many 403s)

> 
> Possible approaches to solve this: Adding some sleep calls between
> consecutive scans on the same website.

Different watch files are checked on different days and times during the
week; the archive hasn't changed enough to make that trick work again since
the release (which made me freeze DEHS for over a week.)

> Displaying the old version on the 
> qa-developer-pages until the next rescan is successful. 

Something similar is planned for DEHS2

> Re-scanning selectively briefly (minutes/hours) after the failed scans to
> deal with temporary errors.

No, that won't happen as it would be easier to get alioth banned.

Regards,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net





-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: sf.net redirector reports 500 Internal Server Error

2009-05-16 Thread Raphael Geissert
> header( "HTTP/1.0 404 Not Found" );

Wrong, the redirector is a gateway.

And the code you provided allows attacks to the SF servers and an XSS
vulnerability.

Regards,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: sf.net redirector reports 500 Internal Server Error

2009-05-16 Thread Raphael Geissert
Replying to put an end to this.

Bart Martens wrote:

> On Tue, 2009-05-12 at 20:33 -0500, Raphael Geissert wrote:
>> So you want merkel to download three html pages every time the redirector
>> is called?
> 
> Yes, three or more.

Then better make the maintainer specify the final url in the watch file; it
would avoid the maintenance burden on the qa.d.o side.
Another reasoning explained in a different email.

> 
>> 
>> DEHS currently has 1564 watch files that use the redirector, UEHS
>> (Ubuntu's DEHS) also got some (no way for me to tell how many), any
>> maintainer, DD, automated system might be using it.
>> Sticking with only the number of watch files in DEHS, and since the watch
>> files are checked at least every four days it would mean the redirector
>> would have to download at least 8211 pages every week, 183MBs (120KBs for
>> the three pages).
> 
> No need to check all files every four days.

Four days is a sensible period of time, remember that DEHS data is expected
to be up to date when using it in other QA processes. Stale data is
useless, would annoy, or even cause side-effects (e.g. false positives.)

> Results from anyone using the redirector can be fed back to DEHS.

That's not the way DEHS works.

> Also, checking should slow down 
[... more stuff that won't be implemented, since pointing to the final url
containing the files listing would be the "correct" approach ..]
> same result without actually checking every time.

> 
>>  Only to provide a feature that most people don't need,
> 
> It's about addressing the issue of "the only remaining sf mirror that
> keeps the redirector currently working".

No, what you are proposing is to address an insignificant feature request to
allow a maintainer to check files in a given download group. The way to
address the real issue is, like I've already said several times, to contact
sourceforge and reach an agreement.

> 
>> not to mention that it would be extremely easy to break?
> 
> Why would it ?

Care to look at the history of watch files and sourceforge? even the reason
behind the creating of the redirector?

[...]
> 
>>  And if you are to do that then why you don't simply take over
>> DEHS? oh, and write the watch files four spec and implement it.
> 
> I prefer to join the team and to enjoy fixing DEHS together as peers
> instead of taking over DEHS.

If you really prefer that why we never heard back from you when we told you
we preferred you to first send some patches to the ML (which was decided
after you failed to explain your real intentions in spite of the many times
we asked you, and failed to provide php code which is DEHS' language, a
patch, and a reason why we would need such a diverging change in DEHS
instead of in uscan.)

>> I once wrote a script to let watch files obtain the version information
>> from freshmeat and the kde-apps (and similar) sites which only required
>> one web page fetch, and nobody ever replied in spite of sending a couple
>> of pings on the ML and on IRC, poking people, and ... nobody ever
>> replied.
> 
> Is this still a problem today ? I'm not sure why you mention this here.

I mention this because in spite of being the only way to allow watch files
to use information from those websites (contrary to the sf case) and
requiring only one request per query (contrary to the at least three
requests per query approach you propose) it was never accepted.

Regards,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: debian/watch sf redirector docs ?

2009-05-12 Thread Raphael Geissert
Paul Wise wrote:

> On Wed, May 13, 2009 at 11:12 AM, Raphael Geissert
>  wrote:
> 
>> "Improving" is very subjective, but I do plan to make another attempt.
> 
> I find the recent changes to be a vast improvement on the old web
> interface and the old set of features.
> 

And I find some of them a major regression, but that's irrelevant.

> 
> They switched to trac for sf.net bug reports and docs:
> 

It was not me who opened the ticket, I would otherwise have a link on my
personal page; and last time I searched it was more than four months ago
and it didn't show up anywhere, not even on the closed tickets list.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: debian/watch sf redirector docs ?

2009-05-12 Thread Raphael Geissert
Paul Wise wrote:
> 
> Sourceforge seems to be improving a lot lately (for example: git VCS
> option, support via IRC). I suggest that they might be open to
> providing a permanent solution to this, like direct access to an
> apache-generated index of files available for each project.
> 

"Improving" is very subjective, but I do plan to make another attempt.
There was a ticket open which tried to reach an agreement, but I can no
longer find it anywhere in alexandria.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: sf.net redirector reports 500 Internal Server Error

2009-05-12 Thread Raphael Geissert
Daniel Leidert wrote:

> Raphael Geissert wrote:
>> Daniel Leidert wrote:
> 
> [sf.net redirector broken]
>> Being curious, why did you access the redirector directly and not via
>> uscan?
> 
> I found the problem, because PET currently fails on watch files
> with sf.net URLs. See for example here ("DownloadError"):

Will see what I can do to make them work again, I might contact one of the
mirror's admins and see if they can remove the index.html pages that
prevent the httpd from displaying the directory listing.

Once again, thanks for reporting :)

> 
> http://debichem.alioth.debian.org/cgi-bin/pet.cgi
> http://debian-xml-sgml.alioth.debian.org/cgi-bin/pet.cgi
> 
> Regards, Daniel

Regards,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: sf.net redirector reports 500 Internal Server Error

2009-05-12 Thread Raphael Geissert
Bart Martens wrote:
> On Tue, May 12, 2009 at 02:47:58PM -0500, Raphael Geissert wrote:
>> Daniel Leidert wrote:
[...]
>> > Using uscan on the command line works.
>> 
>> Only if it is from devscripts 2.10.31 or greater (lenny was released
>> with .35), which is smarter when redirected (required by the only
>> sourceforge mirror that keeps the redirector working.)
> 
> I understand that using one mirror directly is a temporary approach that
> should be replaced by something going via the sourceforge mirror-selection
> system.

That's not possible unless you reach an agreement with SF.

> This can be solved for debian/watch files using 
> http://sf.net//-(.*)\.tar\.gz and similar, by
> enhancing the sf.net redirector with the following algorithm:
> 

Patches welcome

> - Access http://sourceforge.net/projects/
>   Parse the html to find the value of the group_id.
> - Access http://sourceforge.net/project/showfiles.php?group_id=...
>   Parse the html to find the values of the package_id's.
> - For each package_id:
>   - Access
>   http://sourceforge.net/project/showfiles.php?group_id=...&package_id=...
> Parse the html to verify whether it contains files matching
> the pattern -(.*)\.tar\.gz.


So you want merkel to download three html pages every time the redirector is
called?

DEHS currently has 1564 watch files that use the redirector, UEHS (Ubuntu's
DEHS) also got some (no way for me to tell how many), any maintainer, DD,
automated system might be using it.
Sticking with only the number of watch files in DEHS, and since the watch
files are checked at least every four days it would mean the redirector
would have to download at least 8211 pages every week, 183MBs (120KBs for
the three pages). Only to provide a feature that most people don't need,
not to mention that it would be extremely easy to break?

>   - If it does contain files matching, then find the filename with the
> highest version number.  This is a preliminary result.
> - After processing all package_id's, select the preliminary result with
> the
>   highest version number.  This is the final result.
> 
> So far what to do to make the existing debian/watch files continue to work
> without depending on the only sf.net mirror that keeps the redirector
> currently working.
> 
> Later on, a nice-to-have would be support for specifying a package_id in
> debian/watch, so that the searching for the newest upstream release can be
> limited to only one sf.net package within the sf.net group, instead of all
> packages in the group.
> 

If you really want that then please provide the necessary patches and stay
tuned on the watch files failures so that you fix the redirector every time
it breaks. And if you are to do that then why you don't simply take over
DEHS? oh, and write the watch files four spec and implement it.

Look, I hate being sarcastic, but you are obviously talking and assuming
without knowing the real situation. If it was any simple, as you are
putting it, somebody or I would have done it long time ago.

I once wrote a script to let watch files obtain the version information from
freshmeat and the kde-apps (and similar) sites which only required one web
page fetch, and nobody ever replied in spite of sending a couple of pings
on the ML and on IRC, poking people, and ... nobody ever replied. Feel free
to do whatever you want, if you actually do anything.

P.S. I read the mailing list, so please respect the CoC and stop sending me
copies of your replies. And don't expect me to reply.

Regards,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: debian/watch sf redirector docs ?

2009-05-12 Thread Raphael Geissert
[don't CC me, thanks]

Bart Martens wrote:

> On Tue, May 12, 2009 at 02:26:54PM -0500, Raphael Geissert wrote:
> It is possible with group_id=...&package_id=... without using the
> redirector.
[...]
> I don't think we need additional info from sourceforge ; the approach with
> group_id=...&package_id=... is simply using the same information as used
> when browsing the sourceforge website.
> 

Sure, go ahead and see your watch files fail within a month, or whenever
sourceforge makes yet another change on their website.
It has already happened with the ftp mirror, the website, the
downloads.sf.net pages, now the rest of the mirrors, and will happen again.
The pourpose of the redirector is to provide the information without having
to deal with sourceforge's mess.

>> I need to contact them anyway to see if they are willing to
>> help DEHS do its stuff without messing with the mirrors.
> 
> It is, in my opinion, just a matter of enhancing the redirector,

(implementation and maintenance) patches welcome

> or documenting how things can be done without the redirector.

No.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: sf.net redirector reports 500 Internal Server Error

2009-05-12 Thread Raphael Geissert
Hi Daniel,

Daniel Leidert wrote:

> Hi,
> 
> When I type the requested URL, say for example
> 
> http://qa.debian.org/watch/sf.php/docbook-xsl
> 
> Then an Internal Server Error is reported and the page
> itself shows:
> 
> "No mirror could satisfy the request. Please report this
> message to debian-qa@lists.debian.org"
> 

Thanks for reporting, am already aware of it.
Sourceforge recently made some incompatible changes and there's at the
moment no workaround.

> Using uscan on the command line works.

Only if it is from devscripts 2.10.31 or greater (lenny was released
with .35), which is smarter when redirected (required by the only
sourceforge mirror that keeps the redirector working.)

Being curious, why did you access the redirector directly and not via uscan?

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: debian/watch sf redirector docs ?

2009-05-12 Thread Raphael Geissert
[Oh, just noticed you did read a message without being CC'ed]

Olivier Berger wrote:
[...]
> 
> I've just added a little bit of docs pointing to it in :
> http://wiki.debian.org/debian/watch
> 

Not sure pointing to the redirector's code is a good idea, it's
implementation may change at any time without further notice, provided that
the http://sf.net/foo/... like watch files keep working.
In fact, it has already changed once recently.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: debian/watch sf redirector docs ?

2009-05-12 Thread Raphael Geissert
[Mailing you a copy, hope that's ok]

Olivier Berger wrote:
[...]
> 
> As I understand it, the redirector doesn't use the web pages and goes
> directly checking the download areas... so no way to detect such
> "package" filtering ? :-(

No, there isn't, unless sourceforge decides to make that information
accessible. I need to contact them anyway to see if they are willing to
help DEHS do its stuff without messing with the mirrors.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: lintian errors/warnings on ddpo-by-mail emails

2009-04-30 Thread Raphael Geissert
Lucas Nussbaum wrote:
> 
> Also, if packages have lintian errors/warnings, please provide a link to
> the proper full list of errors and warnings for the maintainer.

Did you read my original email? :)

Let me quote it for you:
> === libflexmock-ruby:
> = Lintian reports 3 warning(s), you should consider fixing them.
>  See 
> http://lintian.debian.org/maintainer/acr-deb...@athenacr.com.html#libflexmock-ruby

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: lintian errors/warnings on ddpo-by-mail emails

2009-04-30 Thread Raphael Geissert
Sune Vuorela wrote:

> On 2009-04-30, Lucas Nussbaum  wrote:
>> On 30/04/09 at 01:43 -0500, Raphael Geissert wrote:
>>> But despite all that my original question hasn't quite been answered.
>>> Gregor is in favour of sending messages even if only lintian issues
>>> exist, but Lucas doesn't like the idea.
>>> What about something in between? only errors if another issue exists for
>>> the same given package? or only errors if there's an issue for any of
>>> the co-/maintained packages?
>>
>> I would be fine with any of that. However, the real problem is to keep
>> the signal-to-noise ratio high in ddpo mails. If it just becomes yet
>> another regular email that can be safely ignored, it will be a net loss
>> for QA.

Of course, and that's exactly what am trying to avoid. What about the
following combination?

* Lintian issues by themselves do not cause the email to be sent
* Only lintian errors cause a given package to be mentioned in the email,
not warnings.
* Errors and warnings counts are both included.

Or the following one:

* Lintian issues by themselves do not cause the email to be sent
* Neither lintian errors nor warnings cause a given package to be mentioned
in the email.
* Errors and warnings counts are both included.


> 
> And as lintian is already a tool that can be safely ignored, adding its
> output to the ddpo-by-mail emails will put them in the same box.

Mentioning the number of errors detected by lintian would be too much for
you? Since you are one of the few persons reading -qa who isn't keen on
lintian you could help us a bit here. What would be fine for you to
receive? and what is needed for lintian to be useful to you?

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: lintian errors/warnings on ddpo-by-mail emails

2009-04-30 Thread Raphael Geissert
Stefano Zacchiroli wrote:

> On Thu, Apr 30, 2009 at 01:43:55AM -0500, Raphael Geissert wrote:
> 
>> Gregor is in favour of sending messages even if only lintian issues
>> exist, but Lucas doesn't like the idea.  What about something in
>> between? only errors if another issue exists for the same given
>> package? or only errors if there's an issue for any of the
>> co-/maintained packages?
> 
> I'm fine with mentioning the lintian errors and warnings in the mail,
> with that not being a reason to send that email. However, only
> "certain" items should be mentioned that way (I know the certainty
> might be buggy, but everything can be, and that would be yet another
> chance to fix it).
> 

I do only plan to mention the *number* of issues, just like in the demo of
my original email.

> Still, a answer you did receive and on which I did not get how you
> intend to proceed, is that serious/certain lintian errors should be
> reported as RC bugs and as such, will be "inherited" by the
> ddpo-by-mail message. What is your take on that?

Well, if at some point lintian serious/certain issues are reported then
there won't be much I could do to avoid including them in the
lintian-reported issues *count*.

> Given that you, presumably, have the code already, would you be willing to
> be the bug submitter?

Sure, why not.

> Do we want a process for that or automatic bug submission 
> (on the basis of the certainty being "certain")?

I'm not quite sure that's a good idea, yet. I would only be in favour of
automatic bug reporting after reaching a concensus on -devel.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: lintian errors/warnings on ddpo-by-mail emails

2009-04-29 Thread Raphael Geissert
Russ Allbery wrote:

> Raphael Geissert  writes:
>> Lucas Nussbaum wrote:
> 
>>> Then how about sending a mail if one of the packages has (serious,
>>> certain) lintian errors?
> 
>> Lintian currently still uses the EWI code when generating the report
>> which later udd imports. This file lacks the severity and certainty
>> information, which means it would be necessary to keep a local copy of
>> lintian in sync with lintian.d.o's version so that they both match.
>> Not impossible, but doesn't feel right.
> 
> We can make available a better file, too.  I've thought about that off
> and on, but never had time to figure out just what should be in the file.

Maybe an XML report should be generated; that way it could be easier to
implement #512901

> 
>> I think I agree with zack; issues should be reported or the certainty
>> and severity tweaked.
> 
> I think there's quite a bit that's wrong about the certainty right now.
> The severity I'm more confident about, but there are a bunch of
> certainty: certain tags with a bunch of overrides, which is clearly
> wrong.
> 

Of course something is wrong, but that might either be the package or
lintian, or both :)


But despite all that my original question hasn't quite been answered. Gregor
is in favour of sending messages even if only lintian issues exist, but
Lucas doesn't like the idea.
What about something in between? only errors if another issue exists for the
same given package? or only errors if there's an issue for any of the
co-/maintained packages? 

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Bug#526238: qa.debian.org: please provide a copy of NEWS.Debian

2009-04-29 Thread Raphael Geissert
reassign 526238 www.debian.org
forcemerge 419201 526238
thanks

Andreas Beckmann wrote:

> Package: qa.debian.org
> Severity: wishlist
> 
> Hi,
> 
> is it possible to provide not only a copy of Changelog.Debian online,
> but also one of NEWS.Debian?
> 

If you pay more attention to the url of the changelog you will notice that
it is not served by *.qa.debian.org, but by packages.debian.org; from there
you will see a notice saying that in case of problems you should contact
the debian-www team (aka as www.debian.org on the BTS.)
And by checking www.d.o's BTS page you will see #419201, which is what you
want :)

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net





-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: lintian errors/warnings on ddpo-by-mail emails

2009-04-27 Thread Raphael Geissert
Lucas Nussbaum wrote:

> 
> Then how about sending a mail if one of the packages has (serious,
> certain) lintian errors?

Lintian currently still uses the EWI code when generating the report which
later udd imports. This file lacks the severity and certainty information,
which means it would be necessary to keep a local copy of lintian in sync
with lintian.d.o's version so that they both match.
Not impossible, but doesn't feel right.

I think I agree with zack; issues should be reported or the certainty and
severity tweaked.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



Re: lintian errors/warnings on ddpo-by-mail emails

2009-04-27 Thread Raphael Geissert
Lucas Nussbaum wrote:
> 
> I really don't think that we should send emails to maintainers if they
> only have lintian errors (no other problems, like RC bugs). If those
> lintian errors are so grave, maybe (RC) bugs should be filed?

Every check has a severity and certainty, so in theory if they those issues
were files as bug reports the severity mentioned in the check is the one
that should be used in the bug report.

Check the following page for some ideas.
http://lintian.debian.org/tags-severity.html

If you think the severity and/or certainty of a given tag is incorrect then
please do file a bug report against lintian so that it is discussed if
needed and fixed.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



lintian errors/warnings on ddpo-by-mail emails

2009-04-25 Thread Raphael Geissert
Hi all,

Most of those reading this email probably already know about it: I'm taking
over ddpo-by-mail. And so I decided to include the number of lintian errors
and warnings on the generated emails, but those not being a reason for the
message to be sent (i.e. it requires that an RC bug exists, the package has
no yet migrated, etc, for the email to be sent.)

But since I don't want the email to be too noisy, what do others think about
it?

A sample is:

To: foo 
X-Debian: ddpomail
Subject: Possible problems in your Debian packages

=== libactivesupport-ruby:
= No migration to testing for 181 days.
  See
<http://release.debian.org/migration/testing.pl?package=libactivesupport-ruby>
= Lintian reports 3 warning(s), you should consider fixing them.
 See
http://lintian.debian.org/maintainer/acr-deb...@athenacr.com.html#libactivesupport-ruby

=== libflexmock-ruby:
= Lintian reports 3 warning(s), you should consider fixing them.
 See
http://lintian.debian.org/maintainer/acr-deb...@athenacr.com.html#libflexmock-ruby

=== libtzinfo-ruby:
= 1 bug(s) that should be fixed for the next Debian release:
- #503591 <http://bugs.debian.org/503591>
  Please don't include yet another copy of tzdata in the archive
= Not in testing for 182 days.
  See
<http://release.debian.org/migration/testing.pl?package=libtzinfo-ruby>
= Lintian reports 6 warning(s), you should consider fixing them.
 See
http://lintian.debian.org/maintainer/acr-deb...@athenacr.com.html#libtzinfo-ruby

=== Packages with a new upstream version according to DEHS:
  libflexmock-ruby  0.8.6  (Debian: 0.8.5-1)
  libtzinfo-ruby  0.3.13  (Debian: 0.3.12-1)


Would it be ok to leave it that way? or only mention lintian errors? or only
when the same package has serious issues? or only when the same package
does *not* have any serious issue? or any combination of those? or should
lintian stuff be kept out of these emails?

Please take a couple of minutes and give your personal opinion.

Oh, and do it soon, since I'd like to send the first round before the next
week-end.

Cheers,
-- 
Raphael Geissert - Debian Maintainer
www.debian.org - get.debian.net



-- 
To UNSUBSCRIBE, email to debian-qa-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org



  1   2   >