Re: [Wikitech-l] Mailman archives broken?

2012-08-25 Thread Helder .
Is this issue fixed? I found a link on https://bugzilla.wikimedia.org/show_bug.cgi?id=35785 which points to http://lists.wikimedia.org/pipermail/wikitech-l/2012-April/059838.html but I don't see any relation between the bug and the thread on wikitech. The bug was opened on 2012-04-07. Best regar

Re: [Wikitech-l] Mailman archives broken?

2012-08-20 Thread Daniel Zahn
On Mon, Aug 20, 2012 at 11:29 AM, Derric Atzrott wrote: > Do our backups only go back a week? Or are backups only taken once a week? They are taken daily and go back one week. To be exact 6 "Daily"-slots exist in Amanda backup. -- Daniel Zahn Operations Engineer

Re: [Wikitech-l] Mailman archives broken?

2012-08-20 Thread Derric Atzrott
>I don't know where these come from. Are they really new since this incident? I would really prefer to not delete anything at this point and break links once again. Those emails are definitely new. I didn't see them in the archive earlier this month when I was going through it. >Backups are goin

Re: [Wikitech-l] Mailman archives broken?

2012-08-20 Thread Daniel Zahn
First of all, thank you Ryan, Faidon, Brandon and others for the related thread. Indeed it feels like a rough environment sometimes, especially on lists, sometimes also on IRC and I really appreciated seeing colleagues step in for me in that way. On Fri, Aug 17, 2012 at 1:59 PM, MZMcBride wrote:

Re: [Wikitech-l] Mailman archives broken?

2012-08-18 Thread David Gerard
On 18 August 2012 19:35, Platonides wrote: > Can we restore the old files from backups? How far back do we have backups? Is there any automated way to detect corruption in the archives? - d. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.or

Re: [Wikitech-l] Mailman archives broken?

2012-08-18 Thread Platonides
If I remember right, the issue of deleting old mails was not just that the ids moved the number of deleted mails, but that when rebuilding the archive, new versions rebuilt it differently. Thus the changed numeration. Can we restore the old files from backups? ___

Re: [Wikitech-l] Mailman archives broken?

2012-08-18 Thread Guillaume Paumier
Hi, On Sat, Aug 18, 2012 at 12:42 AM, Daniel Zahn wrote: > Alright, so inserted the exact number of messages i deleted on Aug. 2 > in the same places/dates, that should bring message numbering and > links > back to the same state before i deleted that thread. As others have > mentioned before the

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Platonides
On 18/08/12 00:42, Daniel Zahn wrote: > Alright, so inserted the exact number of messages i deleted on Aug. 2 > in the same places/dates, that should bring message numbering and > links > back to the same state before i deleted that thread. As others have > mentioned before there have been other in

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Daniel Zahn
Alright, so inserted the exact number of messages i deleted on Aug. 2 in the same places/dates, that should bring message numbering and links back to the same state before i deleted that thread. As others have mentioned before there have been other inconsistencies in it before though, so you can mo

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Daniel Zahn
On Fri, Aug 17, 2012 at 2:55 PM, Mark Holmquist wrote: > Maybe someone is rebuilding the archives? Could we have gotten notice about > that? Ohh.. yes, absolutely, i sent messages about it, yet they did not arrive on the list until just now since the mailbox is locked during the rebuilding proc

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Daniel Zahn
On Fri, Aug 17, 2012 at 3:38 AM, Federico Leva (Nemo) wrote: > I doubt fixing this requires rewriting mailman. It only requires dummy > messages to be reinserted where they've been deleted and the archives to be > rebuilt after this, just as if the correct procedure had been followed from > the st

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Mark Holmquist
On 12-08-16 02:00 AM, Guillaume Paumier wrote: I was told yesterday that the mailman/pipermail archives were broken, in that permalinks were no longer linking to the messages they used to link to (therefore not being "permalinks" at all). Is the current state of the archives related to these ev

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Daniel Zahn
Currently you will get "Private archive file not found" when trying to look at the wikitech-l archives. This is because the rebuilding process is running. Currently it is working on the year 2010.. Also i made a backup of the .mbox file before editing of course. -- Daniel Zahn Operations Enginee

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Daniel Zahn
On Fri, Aug 17, 2012 at 8:00 AM, Tilman Bayer wrote: > Many historical Signpost articles are affected as well: > https://en.wikipedia.org/w/index.php?title=Special%3ASearch&search=pipermail+wikitech+prefix%3AWikipedia%3AWikipedia+Signpost%2F2 All messages i removed on August 2nd have been posted

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Jeremy Baron
On Fri, Aug 17, 2012 at 7:17 AM, David Gerard wrote: > On 17 August 2012 11:46, MZMcBride wrote: > >> As MaxSem commented, perhaps Mailman ought to be re-evaluated as the mailing >> list software, though I've yet to come across (m)any software packages that >> are better, unfortunately. > > > The

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Tilman Bayer
On Fri, Aug 17, 2012 at 4:26 AM, MZMcBride wrote: > Guillaume Paumier wrote: >> I was told yesterday that the mailman/pipermail archives were broken, >> in that permalinks were no longer linking to the messages they used to >> link to (therefore not being "permalinks" at all). > > This is pretty d

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Guillaume Paumier
Hi, On Fri, Aug 17, 2012 at 12:38 PM, Federico Leva (Nemo) wrote: > I doubt fixing this requires rewriting mailman. It only requires dummy > messages to be reinserted where they've been deleted and the archives to be > rebuilt after this I've added your suggestion to a new RT ticket to "Attempt

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Thomas Morton
On 17 August 2012 12:17, David Gerard wrote: > On 17 August 2012 11:46, MZMcBride wrote: > > > As MaxSem commented, perhaps Mailman ought to be re-evaluated as the > mailing > > list software, though I've yet to come across (m)any software packages > that > > are better, unfortunately. > > > The

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread MZMcBride
Guillaume Paumier wrote: > I was told yesterday that the mailman/pipermail archives were broken, > in that permalinks were no longer linking to the messages they used to > link to (therefore not being "permalinks" at all). This is pretty devastating. It's difficult to overstate the importance of M

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread David Gerard
On 17 August 2012 11:46, MZMcBride wrote: > As MaxSem commented, perhaps Mailman ought to be re-evaluated as the mailing > list software, though I've yet to come across (m)any software packages that > are better, unfortunately. There isn't really anything better. It's ridiculously better than a

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread MZMcBride
David Gerard wrote: > On 17 August 2012 02:23, MZMcBride wrote: >> Daniel Zahn wrote: > >>> In this case the request was for a complete thread to be removed. >>> Since many people reply with full quotes it usually repeats the >>> information in almost every message. ("TOFU"-posting). But you are

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread Federico Leva (Nemo)
I doubt fixing this requires rewriting mailman. It only requires dummy messages to be reinserted where they've been deleted and the archives to be rebuilt after this, just as if the correct procedure had been followed from the start. This, by the way, is by some orders of magnitude easier and qu

Re: [Wikitech-l] Mailman archives broken?

2012-08-17 Thread David Gerard
On 17 August 2012 02:23, MZMcBride wrote: > Daniel Zahn wrote: >> In this case the request was for a complete thread to be removed. >> Since many people reply with full quotes it usually repeats the >> information in almost every message. ("TOFU"-posting). But you are >> right, even in these case

Re: [Wikitech-l] Mailman archives broken?

2012-08-16 Thread Guillaume Paumier
Hi, On Thu, Aug 16, 2012 at 7:07 PM, Daniel Zahn wrote: > > the last time we had to rebuild archives was about 2 weeks ago. > Unfortunately this is a major drawback of removing messages from > archives as you pointed out and we are aware of it. We had a thread > there though that contained privat

Re: [Wikitech-l] Mailman archives broken?

2012-08-16 Thread MZMcBride
Daniel Zahn wrote: > On Thu, Aug 16, 2012 at 1:49 PM, Federico Leva (Nemo) > wrote: >> Thanks Daniel. I don't understand, how can a message need to be removed >> completely? > > In this case the request was for a complete thread to be removed. > Since many people reply with full quotes it usually

Re: [Wikitech-l] Mailman archives broken?

2012-08-16 Thread Daniel Zahn
On Thu, Aug 16, 2012 at 1:49 PM, Federico Leva (Nemo) wrote: > Thanks Daniel. I don't understand, how can a message need to be removed > completely? In this case the request was for a complete thread to be removed. Since many people reply with full quotes it usually repeats the information in alm

Re: [Wikitech-l] Mailman archives broken?

2012-08-16 Thread Federico Leva (Nemo)
Thanks Daniel. I don't understand, how can a message need to be removed completely? I can't imagine anything which couldn't just be redacted by leaving at least the message's "skeleton" as demanded by Nemo _

Re: [Wikitech-l] Mailman archives broken?

2012-08-16 Thread Daniel Zahn
On Thu, Aug 16, 2012 at 2:00 AM, Guillaume Paumier wrote: > I was told yesterday that the mailman/pipermail archives were broken, > in that permalinks were no longer linking to the messages they used to > link to (therefore not being "permalinks" at all).\ Hi Guillaume, the last time we had to

[Wikitech-l] Mailman archives broken?

2012-08-16 Thread Guillaume Paumier
Hi, I was told yesterday that the mailman/pipermail archives were broken, in that permalinks were no longer linking to the messages they used to link to (therefore not being "permalinks" at all). I know this happened at least once in the past, when the archives were rebuilt. Retroactively fixing