Re: [Toolserver-l] Requests for expired pages

2014-01-14 Thread DaB.
Am 14.01.2014 15:11, schrieb Marlen Caemmerer:
   1 www.flickr.com

maybe you should have filtered the 404s ;-)

-- 
PGP: 0x2d3ee2d42b255885 – Mistrust unsigned mails!
Keyswitch to 0x7CD1E35FD2A3A158 in progress, details at
http://dabpunkt.eu/gnupg/keyswitch-0x2D3EE2D42B255885.txt.asc



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] My retirement

2014-01-03 Thread DaB.
Hello folks,

as announced at 16. November I retired as root today.

Normally you write in such mails that you are sad now and that you had a
great time while it lasted. But I’m glad that it is over.

Don’t get me wrong: There were times when the work was great and most
times the work was even fun. But there were also several times
(especially in the last 2 years) when the Toolserver was horror. WMDE
didn’t invest enough money, WMF found new problems with the TS, hardware
was broken or the users (both authors and tool-users) were ignorant or
impatient.
If I had knew in autumn 2011 how the Toolserver would developing in the
coming years, I had not overtake as main root. I learned the hard way,
that it doesn’t matter how much work and time you invest if the
leadership (WMDE and WMF) work against you; and the members of WMDE and
the Wikipedians (at least in deWP) were no great help either.

I learned many things (in technical and political sense), met nice
persons and helped to give the Wikimedia-universe some great tools,
that’s the positive side I take with me now. I’m sure that I will miss
the Toolserver and its users from time to time.

Those of you who switch to Labs I wish good luck. All of you (if retired
already or not) I like to thank for the good times and I wish you the
best for your future :-). I’m sure that I will meet some of you in the
coming years again.


Sincerely,
DaB.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Repairing of sql-s5 (dewiki)

2013-12-02 Thread DaB.
Hello all,

just to keep you updated: I contacted Asher at the WMF for a new dump of
s5 for a re-import. That should fix the replication-problem for now (the
disc-problem has to be fixed later).

Sincerely,
DaB.

-- 
PGP: 0x2d3ee2d42b255885



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Retirement as root at 3. January 2014

2013-11-16 Thread DaB.
Hello all,

as I announced before I will retire in a few weeks. To give you all a
exact date and so some dependability in planing, I hereby announce to
retire as root at

FRIDAY, 3. January 2014 24:00 MEZ.

I will use most of this day for clean-up, so if you want something you
should contact me the day before. After the date I will not be able to
re-new accounts, add ssh-keys or clean-up /tmp-partitions (so Wolfsbane
will become unavailable more often). If you need something after the
date, please try to reach Nosy or Amette during their work-hours.

Two days later my normal account will expire, which will end my work for
the Toolserver. I will send a last mail to you all than.


Sincerely,
DaB.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Fwd: Toolserver decommissioning

2013-11-15 Thread DaB.
Hello,
Am 15.11.2013 17:49, schrieb सौरभ भारती:
 I am not able to login to nightshade. Can an admin upload public key
 (attached) to my account: sbharti? Thanks.

no. Please open a JIRA-quest in the TS-queue [1].

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/TS




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Need Tool Labs migration support?

2013-10-13 Thread DaB.
Hello,
Hello all,
Am 13.10.2013 11:51, schrieb Federico Leva (Nemo):
 +1 on Maarten and also Magnus on public_html etc.

the cgi-dirs could contain passwords, so: no.

 I also assume all SVN repositories will be exported,

If somebody ask we will give the owner a svn-dump. Until now nobody
asked AFAIK.


 JIRA  tswiki etc. archived,

That’s unclear at the moment.


license information in LDAP preserved somewhere?

The LDAP with all data within will be deleted before the TS is shut down
for data privacy reasons. Maybe a root will do a
username/license-extract before.



 The roadmap contains no information whatsoever.

I’m sure Silke will handle this.

 Nemo

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Need Tool Labs migration support?

2013-10-13 Thread DaB.
Am 13.10.2013 20:29, schrieb Federico Leva (Nemo):
 Then I officially ask a svn dump of all SVN repos. Importing them on
 sourceforge looks rather easy:

I wrote “will give the OWNER a svn-dump”.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Need Tool Labs migration support?

2013-10-08 Thread DaB.
Hello,
Am 08.10.2013 00:42, schrieb Magnus Manske:
 Don't we have to state the license for all our code to get a password
 renewal? I remember setting that at some point...

yes, but you could and can chooses none or all rights reserved or
Freeware or anything else. We do not force people to license their
stuff as open source (and when I read something like we force them to
move, then I’m glad we didn’t).

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Need Tool Labs migration support?

2013-10-08 Thread DaB.
Hello Magnus,
Am 09.10.2013 00:45, schrieb Magnus Manske:
 Because then we could just make a copy of the tool in that nasty
 open-source way of Wikipedia, instead of having it die with the toolserver?

if somebody choose to move his/her tool to Labs: It’s their thing. But
why forcing people? If somebody chose to not move his/her stuff and let
the tools die: It’s their thing too.

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Short www-downtime at Sunday

2013-10-06 Thread DaB.
Hello all,
Am 04.10.2013 23:49, schrieb DaB.:
 Hello all,
 
 for adding a SSL-certificate I need to restart the web-loadbalancer
 and/or the webserver (not sure at the moment).

The maintenance is done now, the webservice was only away during the
restarts (couple of seconds).
If you notice any problems with HTTPS or webservice in general now,
please report.

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Security issue in Wikipedia projects

2013-10-04 Thread DaB.
Hello all,

how the WMF announced [1], the password-hashes and email addresses of
many users were public accessible in WikiLabs (and so ToolLabs) for 6
months.
So please make sure that you and your bots get a new password as soon as
possible! A well known bot in the wrong hands is dangerous, so change
the password now – don’t wait if you get a mail by the WMF (I got none,
but be affected AFAIS).

Sincerely,
DaB.

[1] https://meta.wikimedia.org/wiki/October_2013_private_data_security_issue



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] [Toolserver-announce] Security issue in Wikipedia projects

2013-10-04 Thread DaB.
Hello,
Am 04.10.2013 17:12, schrieb Marc A. Pelletier:
 every account that was affected was sent an email.

I got no mail, but MediaWiki logged me out and forced me to change my
password (so I guess that I’m affected).

Sincerely,
DaB.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] [Toolserver-announce] Security issue in Wikipedia projects

2013-10-04 Thread DaB.
Hello,
Am 04.10.2013 21:59, schrieb Marc A. Pelletier:
 so I guess it ended up in your spam trap or something?

no, and that’s for a simple reason: The eMail-address is invalid and
bounces (just re-tried for myself) – gmx decided somewhen last year that
this syntax is invalid (what is correct, but they didn’t care for years)
and does not longer accept mails for it.
Now two question: Why does WMF didn’t notice the bounce and why did WMF
not use my SUL-mail-address? And following question 1: How many other
bounces happened without notice?

And yes, I accept your apology. I also overreacted a bit, I’m sorry too.

BTW: While I have a PGP-key for that mail-address I did not use it for
years.

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Short www-downtime at Sunday

2013-10-04 Thread DaB.
Hello all,

for adding a SSL-certificate I need to restart the web-loadbalancer
and/or the webserver (not sure at the moment). I plan to do this at

SUNDAY, 13:00 UTC.

If all works right everything will be done in 1 minute, but if there
are problems there could be some downtime (max 1/2h) for webpages.

Sincerely,
DaB.

https://jira.toolserver.org/browse/MNT-1347



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance for DB cluster s2 : Resetup of commons

2013-09-10 Thread DaB.
Hallo Nosy,
Am 10.09.2013 22:38, schrieb Marlen Caemmerer:
 I will drop and reinsert it starting on
 
 Friday, 13th Sept 7 pm UTC

das ist etwas ungünstig weil z-dat-s2-b ein Linux-Host ist und ich den
zur dieser Zeit updaten möchte.

Ich kann gerne mit diesem Host anfangen, aber mein Fenster beginnt auch
erst um 21:00 MESZ.

Mit freundlichen Grüßen
DaB.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Linux-Maintenance next Friday and upgrade-announcement

2013-09-08 Thread DaB.
Hello all,

next

FRIDAY, 13. September 19:00-22:00 UTC

I will update our Linux-hosts with all non-critical updates that
happened since the last maintenance-window. This will include the
userland-hosts and the database-servers. Several downtimes may occur
during that window.
After the update I will prepare the upgrade from Debian Squeeeze
(oldstable) to Debian Wheezy (stable). The upgrade will surely break
some stuff, because several important packages will switch to a new
major release (for example perl from 5.10 to 5.14, php from 5.3 to 5.4).
I will send a further mail after Friday with details. The upgrade is
planed to happen 1 or 2 weeks later.

Sincerely,
DaB.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] TS and/vs. Labs

2013-08-30 Thread DaB.
Hello Ryan,
Am 29.08.2013 21:09, schrieb Ryan Lane:
 You're fighting against something that is providing everything you've
 been asking for and more.

just a notice here: The Toolserver IS everything I asked for. It’s only
problem is that it is underfunded. Otherwise it is great. It has a
living community, people use the offer to host tools and other people
use these tools. Most people are friendly, the Toolserver is accepted by
the Wikipedia-Communities (much more than WMDE or WMF), people think
that the Toolserver is a good goal for donations, users and tool-users
were most times very understanding if something didn’t work at first try
or never at all, and WMDE was wise enough to not interfere much.

The Toolserver developed MUCH better than I or anyone else predicted at
the start, it is the most successful project WMDE ever started.

At least for me and more is not possible.

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] TS and/vs. Labs

2013-08-29 Thread DaB.
Hello,
Am 29.08.2013 02:24, schrieb Ryan Lane:

 
 Please read: http://opensource.org/osd-annotated

let me quote the German Wikipedia, which is a lot clearer in this point
as the English Wikipedia

 Open Source [oʊpən ˈsɔːɹs] (engl., US), [əʊpən ˈsɔːs] (brit.) und
 quelloffen nennt man Software, deren Lizenzbestimmungen in Bezug auf
 die Weitergabe der Software besagen, dass der Quelltext öffentlich
 zugänglich ist und – je nach entsprechender Lizenz – frei kopiert,
 modifiziert und verändert wie unverändert weiterverbreitet werden
 darf.

As you can see it says clearly that OpenSource means ONLY that you can
look into the source – only the license can permit to
copy/modify/distribute whatever, A common example for a non-free
open-source software is PGP, where you can look into the source but has
to buy it to use it.

 @Dr. trigon: To answer you question what will happen to these tools:
 It is easy, they will die with the toolserver. WMDE and WMF destroy
 them together.
 
 
 Or people are free to move them to infrastructure that isn't funded
 by the donations to a movement that has Open Content as one of the
 five pillars 
 http://en.wikipedia.org/wiki/Wikipedia:Wikipedia_is_free_content.
 The tools and bots that keep this content alive and free are in my
 opinion an extension of that pillar.

The goal of Wikipedia is to create, store and provide free knowledge.
How we do this doesn’t matter. Most Wikipedians for example use Windows
as OS, nearly all pictures are taken with commercial cameras (with
unfree firmware), images are modified with Photoshop and videos are cut
with Adobe. And as long as the result is free, that doesn’t matter.
And a word of the goals of donators: They donate for Wikipedia. Not for
the WMF, the WMDE, Labs, Toolserver, Wikidata or free software. If I
remove a single associate of WMF or WMDE it would save more money than
removing the TS BTW.

 I'm more than happy to recommend a number of cloud services and am
 more than willing to give advice on how to configure and run tools
 and bots from those services. It's even possible to reuse the work
 we're doing in the tools project, or in the Wikimedia infrastructure
 via our puppet repository since our infrastructure is Open Source.

Very nice idea – how I get the mysql-replication-stream? I got several
offers of donation if the Toolserver would continue; the only problem is
the replication-data. But because the data is open-source, it shouldn’t
be a problem than, should it?

 - Ryan

Sincerely,
DaB.






signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] TS and/vs. Labs

2013-08-29 Thread DaB.
Hello,
Am 29.08.2013 23:21, schrieb Daniel Schwen:
  We've been singing the same song 

I guess the song is named Better a closed tool or none tool?.
What some guys here forget: Some of us do programming not for fun or as
a hobby, but as a job. And these are REALLY good. Merlissimo is one of
these, he is a professional programmer, he does it for live. Some of his
tools need to filter huge amounts of data, which can be hard work if you
plan to do it fast. Knowledge in this field of programming is worth
money – lots of it. Merlissimo is allowed to use some of these
algorithms and/or liberies in his tools (which is VERY kind).
You can not just exchange these parts of a program in an evening
session, it can take months or years of research.
That’s the reason it can sometimes be a good idea to allow
non-open/non-free-tools. Because there is no open/free/gratis/libre
alternative that is as good.

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] TS and/vs. Labs

2013-08-29 Thread DaB.
Am 30.08.2013 00:08, schrieb Erik Moeller:
 lack of compatibility with other licenses

good luck with using GPL-code in a BSD-project, or CC-text in GFDL-document.
Mixing licenses are problematic most times, no matter if
open-source-ones or proprietary ones.

And Wikimedia was not founded ON free-software, but WITH free-software –
because it was the cheapest solution. Or does somebody think we hadn’t
use MySQL if it would have been only gratis and not open-source?

And bitkeeper is very good example: Was the Linux-kernel unfreeer than
today? No it was not. It doesn’t matter what tools you use to create
free content. „Entscheidend ist, was hinten raus kommt.“.

(A funny fact is that Merlissimo and I use Thunderbird on Linux (free
software on a free OS), while Ryan and Erik use Google mail (a gratis
and non-open-source web-service)…).

Good night,
DaB.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] TS and/vs. Labs

2013-08-20 Thread DaB.
Hello,
Am 19.08.2013 23:49, schrieb Dr. Trigon:
 E.g. is it still planned to discontinue the TS? Having 2 payed admins
 does not sound like that... - good news?

yes, it is still the plan. The hiring of a second admin is independent
of everything.

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] TS and/vs. Labs

2013-08-10 Thread DaB.
Hello Dr. Trigon,
Am 10.08.2013 11:36, schrieb Dr. Trigon:
 Could you please give me a short update - the end of 2013 is
 approaching, what is the current state for TS resp. Labs?

The question seems to be a little bit to generic.

I can not speak for Labs, but the status of the Toolserver is more or
less the same as 6 moths ago – with the exception that there is now a
second paid root.
The TS is still underpaid and underpowered, but I guess there will be no
change of this until the end.
Personally I am more busy with my Non-TS-live at the moment.

If you make a more detailed question, maybe I can give you a more
detailed answer.

Sincerely,
DaB.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Reimport of wikidata, s5 will be stopped

2013-08-09 Thread DaB.
Hello,

after the wikidata-import-process failed last week, I will repeat it
tomorrow,

SATURDAY, 12:00 UTC.

See the old eMail below for details.

Sincerely,
DaB.

Am 30.07.2013 23:59, schrieb DaB.:
 Hello all,
 
 the WMF had some problems with one for their servers (db45).
 Unfortunately that’s the server we replicate s5 and wikidata of. Nosy
 fixed s5 already, but for wikidata it looks not that good – AFAIS a
 re-import is needed.
 For that reason I will stop the s5-replication
 
 WEDNESDAY, 20:00 UTC
 
 to create a dump and use Thursday to import wikidata everywhere again.
 
 You can follow the process at [1].
 
 Sincerely,
 DaB.
 
 [1] https://jira.toolserver.org/browse/MNT-1336
 
 
 
 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list: 
 https://wiki.toolserver.org/view/Mailing_list_etiquette
 




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Reimport of wikidata, s5 will be stopped

2013-07-30 Thread DaB.
Hello all,

the WMF had some problems with one for their servers (db45).
Unfortunately that’s the server we replicate s5 and wikidata of. Nosy
fixed s5 already, but for wikidata it looks not that good – AFAIS a
re-import is needed.
For that reason I will stop the s5-replication

WEDNESDAY, 20:00 UTC

to create a dump and use Thursday to import wikidata everywhere again.

You can follow the process at [1].

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1336



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] [Toolserver-announce] Short downtime of toolserver.org at Wednesday

2013-07-17 Thread DaB.
Hello all,

I was unavailable today and could not make the maintenance. So the
downtime-window will move to

FRIDAY, 14:00 UTC

Sincerely,
DaB.


Am 14.07.2013 23:52, schrieb DaB.:
 Hello guys,

 to prevent another problem with nginx and toolserver.org I plan to
 change something in our nginx-setup. For this I hereby announce a
 downtime of toolserver.org for

 WEDNESDAY, 14:00 UTC.

 The downtime should be less than 15 minutes.

 You can find details at [1].

 Sincerely,
 DaB.

 [1] https://jira.toolserver.org/browse/MNT-1332



 ___
 Toolserver-announce mailing list
 toolserver-annou...@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/toolserver-announce




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Short downtime of toolserver.org at Wednesday

2013-07-14 Thread DaB.
Hello guys,

to prevent another problem with nginx and toolserver.org I plan to
change something in our nginx-setup. For this I hereby announce a
downtime of toolserver.org for

WEDNESDAY, 14:00 UTC.

The downtime should be less than 15 minutes.

You can find details at [1].

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1332



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] toolserver web down

2013-07-13 Thread DaB.
Hello,
Am 13.07.2013 12:01, schrieb Platonides:
 toolserver.org isn't listening on port 80:
 willow ~ $ telnet toolserver.org 80
 Trying 2a02:ec80:101::1:4...
 telnet: connect to address 2a02:ec80:101::1:4: Connection refused
 Trying 185.15.59.214...
 telnet: Unable to connect to remote host: Connection refused
 
 Connecting directly to the web servers works.

Fixed.

Sincerely,
DaB.




signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Wikidata-Maintenance at s7 and daphne and z-dat-s2-b

2013-06-25 Thread DaB.
Hello all,

the copies of wikidata at daphne (commons) and z-dat-s2-b (s2) are so
outdated that the WMF has no masterlogs for them anymore. To fix this I
will dump a copy of wikidata from s7 and reimport it. I plan to do this on

FRIDAY, 14:00 UTC.

During the dump the replication of wikidata at s7 will stop. During the
import at z-dat-s2-b and daphne there will be not wikidata at these
hosts. I have no idea how long the hole thing will take, but you can
follow the progress at [1].

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1327

-- 
PGP: 0x2d3ee2d42b255885



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Fwd: [Wiki-research-l] WikiDashboard down - anyone knows how to contact people at PARC who developed it?

2013-06-14 Thread DaB.
Hello,
Am 15.06.2013 01:31, schrieb Samuel Klein:
 Are tools in expired user accounts backed up?   If a user disappears
 for a year and then comes back this time next year, will they be able
 to find their code and data?

yes.

Sincerely,
DaB.

-- 
Diese eMail sollte mit dem PGP-Schlüssel 0x2d3ee2d42b255885 signiert
sein. Misstrauen Sie unsignierten eMails!






signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] JIRA should work again

2013-06-12 Thread DaB.
Hello all,

amette reported yesterday that he found the problem with our
JIRA-installation and created a quick-fix to solve it. As far as I see
everything seems to works again. Give him some cheering!
Please be so nice and do some testing too in JIRA, close bugs that were
fixed and create new ones if you find a problem.

Sincerely,
DaB.

-- 
Benutzerseite: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885






signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] SQL S1

2013-06-03 Thread DaB.
Hello,
At Monday 03 June 2013 16:20:52 DaB. wrote:
 I am getting a ERROR 2003 (HY000): when trying to connect.

fixed. Tested also the other connections and found no problems there.

 
 John

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Linux/Solaris Lua on Toolserver: is it possible?

2013-05-31 Thread DaB.
Hello,
At Friday 31 May 2013 15:21:23 DaB. wrote:
 What about building a Lua bot framework or - at least - install Lua into
 Toolserver?

the linux hosts have already lua-packages installed AFAIS. Feel free to play 
with it.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Status update on Tool Labs

2013-05-31 Thread DaB.
Hello,
At Saturday 01 June 2013 02:19:13 DaB. wrote:
 Is there any how-to on moving SVN repo. along with it's history to TL? 
 Is it possible/planned at all?

the Toolserver stores the different repos in different directories so it is no 
problem from our side to give you the files when you leave. But I have no idea 
if TL can import it and who could do that.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] My fading out

2013-05-30 Thread DaB.
Hello,
At Thursday 30 May 2013 21:52:04 DaB. wrote:
  By efforts and
 resources I mean: the wiki, hardware, domains, etc.

the wiki (together with JIRA and maybe also the SVN) will vanish together with 
the toolserver. The plan for the hardware is AFAIk to donate it like WMF does 
it with their old stuff. I have no idea about the domain at the moment, but 
maybe WMF could use it to set up a redirect-server – or it will vanish too.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] My fading out

2013-05-30 Thread DaB.
At Friday 31 May 2013 01:24:38 DaB. wrote:
 On 05/30/2013 05:31 PM, DaB. wrote:
  that WMF has already won
 The WMF has not won anything, because there was never a contest or
 battle, nor was there an adversarial position to begin with.  

sorry, but that’s untrue. The hole thing started as WMF announced to WMDE that 
WMF will stop to provide database-replication and database-dumps in the 
future. For this reason the CEO of WMDE claimed that further investments in 
the Toolserver would be a waste of money (he also assure the general member 
meeting with that). If that is not adversarial I have no idea what is.


 My concern
 - and that of the Foundation - align exactly with yours: provide a good
 and stable environment for community developers to do their work with
 the least possible fuss.

The Toolserver is not just a place where you can put a program and run it or 
host a website. It’s a living community creating stuff in a anarchic way that 
works only in praxis but not in theory; it’s like Wikipedia. WikiLabs is more 
like Nupedia – in theory it is better, but in praxis it is empty and cold. The 
difference is that for Nupedia Jimbo accepted that it can not work and stopped 
it, and forced not Wikipedia user to switch to the _better_ platform. In our 
case it is just the way around: After the WMF noticed that nobody needed 
WikiLabs that started to look for a problem for their solution, and found the 
Toolserver. 


 
 You sincerely believe that the Toolserver was and is the best solution
 towards that objective.  I disagree, and think that the Foundation has
 more resources to set up and upkeep that environment and to insure its
 future.  Either way, it's the developer community that wins,
 regardless of where the actual environment ends up being.
 
 This does not, in any way, diminish the value of what you have done, or
 of the effort you have expended in doing it.  The Toolserver served its
 purpose very well for a number of years!  We have simply reached a point
 where the continued maintenance of such a critical service living
 outside the infrastructure remains rational.
 
 That we are
 in a position to support the developer community with more resources

So the WMF have more money, how great…. WMDE would have enough money to 
support the Toolserver and there are other chapters too that offered money. It 
is not a matter of resources it is a matter of control, because the WMF 
controls the database-access. Make your bosses release the threat, offer 
ToolLabs as an alternative of the Toolserver and see what’s happening – that 
would be a fair fight, and we all know that competition improves a product. 

 -- Marc

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] My fading out

2013-05-29 Thread DaB.
Hello guys,

I just extended my personal account until 5. January of 2014 – it is the last 
time I do this. At this day I will also remove my access as root of the 
Toolserver. Beginning of 1. July I will start my fade out, doing less and less 
work for the Toolserver until I am not longer visible. I announce that this 
early because I think it is fair for you to know that will happen and I like 
not just to vanish like some roots before.

There are 4 main factors why I decided to not continue my work until the end 
of the Toolserver in December 2014.

Reason 1 is that the Toolserver now has a second paid root and 6 months will 
be enough to teach amette and nosy what I know about the Toolserver.

Reason 2 is that there was no real investment in the Toolserver in the first 6 
months of 2013 and I very doubt that there will ever be any in the second half 
or beyond.

Reason 3 is that I learned during the last weekend that the support of the 
Toolserver in the board of WMDE reached its minimum.
One board-member announced publicly during the general meeting of WMDE that it 
is good that there is a timetable for the Toolserver now – I know only 1 
timetable for the Toolserver and that’s Silke’s splan of destruction/s 
roadmap for migration [1].
Another board-member told me during a chatting in the halls that ToolLabs (or 
the move to) is klasse (~great).
It is impossible to improve the Toolserver against the CEO *and* the board of 
WMDE.

Reason 4 are you, the tool-authors.
The participation in my survey [2] was pitiful low and the majority of these 
few who voted, voted to leave the Toolserver as soon as possible or this year 
– a trend that was already visible on the mailing-list before. So I conclude 
that the most of you don’t care and whose care will leave this year. 
While I asked for documentation (or at least correction) in the toolserver-
wikis for years, nearly nothing ever happened. But now that ToolLabs is on the 
horizon you write documentation for THAT – freely.
And it is really a joke to compare the empty new database-servers of ToolLabs 
with our old and heavy loaded servers for performance. Let’s see how fast they 
are if 10 slow queries, which had run for hours, run in parallel.
With very few exceptions none of you helped to protect the Toolserver against 
ToolLabs; all you were interested in was that ToolLabs provides the same 
environment so your tools can continue to run there. When I read such phrases 
like we have to stabilize the Toolserver until Labs is ready or now we need 
the Toolserver for redirects to ToolLabs I could vomit!

I promised in November 2012 that I will stay for another year and I will 
fulfill that promise – but not a day longer. There is no point in fighting for 
something if the something has already surrendered and no support is there 
(not from you, the toolusers, the board of WMDE, the CEO of WMDE or the 
general meeting of WMDE). 

These of you who are able to move to ToolLabs I wish luck. Let’s hope that the 
WMF does not decide to re-focus again too soon. Let’s hope that the WMF does 
not disable tools just because there are a little slow. Let’s hope that the 
WMF does not restrict the database-tables even more. Let’s hope that the WMF 
does not kick the volunteers out completely some days like they did with the 
WMF-wiki-admins some weeks ago. And hoping is all we can do, because the WMF 
is a undemocratic construct and ToolLabs is lead by paid roots, so whatever 
the WMF staff decides will happen. 
Maybe if one of these things happen you will remember the tiny, slow, 
unstable, but free Toolserver — but it will not be there anymore. 

Sincerely,
DaB.
 

[1] http://www.mediawiki.org/wiki/Tool_Labs/Roadmap_en
[2] https://wiki.toolserver.org/view/Labs-Moving-Survey


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] My fading out

2013-05-29 Thread DaB.
Hello,
At Wednesday 29 May 2013 22:17:22 DaB. wrote:
 (anonymous) wrote
 
  I just extended my personal account until 5. January of 2014 – it is the
  last time I do this. At this day I will also remove my access as root of
  the Toolserver. Beginning of 1. July I will start my fade out, doing
  less and less work for the Toolserver until I am not longer visible. I
  announce that this early because I think it is fair for you to know that
  will happen and I like not just to vanish like some roots before.
  
  [...]
 
 JFC, what a bunch of self-pitying bullshit.
 
 Democratic toolserver?  Was there a vote on the addition of
 new volunteer roots, or did someone just oppose it because
 they might not fit his personal agenda?  Who made it a rule,
 if someone phones my mother, they lose their account?

I never said that the toolserver was democratic. And like every root I can 
make rules as I please, yes.

 
 No documentation on the wiki by the users?  I can't find
 *any* mention of z-dat-s1-a and the other stuff *you* cre-
 ated on the wiki, and the only person who could have docu-
 mented it would have been *you*.  The times when you brought
 down the Toolserver by rebooting machines whose setups had
 not been documented -- should users have done that?

You can not find any information about z-dat-s1-a because there is no such 
server; there is only z-dat-s1-b. And that is a non-userland-server so I do 
not see why you need a documentation about it (BTW the solaris-zone-servers 
has not that much documentation too) – it is enough if the other roots know 
about it.
And when I brought the toolserver down the last time because of a reboot that 
was not announced? 

 
 At least Platonides and I contributed patches to JIRA to fix
 existing bugs.  It was neither WMDE, Pavel nor the GA that
 stood in the way to apply those fixes.
 
 Fading out?  You have been gone as a system administrator
 for a long time.  On April 30th, you said on IRC: I have a
 working cluster with commons+wikipedia here :-), while ac-
 tual Toolserver users had been complaining about replication
 lag and almost daily LDAP outages for months. 

I do not see the problem with the quote, because it compared the Toolserver 
with Labs and what I said was (and AFAIK is still) true. And yes, users 
complained about a high replag since months and so do I – but unfortunately I 
can not snip with my fingers and the problems are gone; money is needed here. 
The LDAP is another thing and yes it is partly my fault because I feared to 
touch it.

 You used your
 Toolserver privileges at least in the last year mainly for
 political campaigning.  You neither fixed the simple issues
 nor planned ahead for example the Solaris to Linux migration
 that then had to be done in a jiffy, but actively blocked
 any offer of help.

What a pity that you discovered my secret run for the CEO of the WMF! The plan 
to piss of some important people and keep complaining about a project neither 
WMDE nor WMF likes, should have work so well…. Just to calibrate you a little 
bit: I have no pretension for any political post – inside or outside of the 
Wikimedia universe. The only job I do that is elected is one nearly nobody 
else likes to do.

 
 Everybody has the right to leave, but don't try to put the
 blame on others.  The Toolserver users have had a *lot* of
 patience with you and your quirks.

And I’m thankful for the patience. 

 
 Tim

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Status of the toolserver

2013-05-19 Thread DaB.
Hello all,
At Sunday 19 May 2013 23:46:02 DaB. wrote:
 SGE will not be down the hole time, but better expect that it can be down 
 anytime during that timeframe.
 The LDAP-move will happen at a unknown timestamp tomorrow, but the
 downtime  should not be more than a few minutes

the SGE-move working more or less without a problem and everything seems to 
work AFAIS. It was noticed during the move that the solaris-version of 
qcronsub was broken and that was fix on the fly too.
The LDAP-move is not complete yet and Nosy will continue there tomorrow. So if 
you notice a LDAP or a (file-)right-problem tomorrow that is nothing to worry 
about.

Good night,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Status of the toolserver

2013-05-18 Thread DaB.
Hello all,
At Saturday 18 May 2013 22:29:07 DaB. wrote:
 We can only think of one solution: Replacing the solaris at the ha-nodes
 with  linux. But this can not start before Friday and it will take some
 time until everything is moved over.

I started today to move some services to the linux-version of the ha-cluster. 
Until now nagios (without web-interface), the sql-tunnel to the WMF and the 
ts-irc-bot moved over. The next big things are SGE and LDAP which will move 
tomorrow (Sunday). For this I announce a total downtime of SGE for

TOMORROW, between 18:00 and 22:00 UTC.

SGE will not be down the hole time, but better expect that it can be down 
anytime during that timeframe.
The LDAP-move will happen at a unknown timestamp tomorrow, but the downtime 
should not be more than a few minutes

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Status of the toolserver

2013-05-13 Thread DaB.
Hello all,

as you have surely noticed the toolserver is even more unstable and unreliable 
than normal at the moment. The reason is that our ha-nodes are not longer 
working as intended and neither Nosy nor I are able to fix this.

A quick word was ha-nodes are: The ha stands for high available and we 
have 2 servers for that. Some services at the toolserver are so important that 
a downtime is unacceptable (like /home, LDAP or the DNS) and for this reasons 
these services life at the ha-nodes. If one server goes down or crashes then 
the other can continue to operate all services with no or little interruption 
time and without working by a root. That worked great as long as River was 
here and not-so-good in the last months, but now it is totally broken.
The problem is that both ha-nodes run Solaris and all roots are no Solaris-
experts what makes it hard for us to find errors or in this case impossible. We 
have setup a very ugly workaround, but it is not stable and so the downtime of 
important services cause downtime for the hole toolserver – and more work for 
the roots.

We can only think of one solution: Replacing the solaris at the ha-nodes with 
linux. But this can not start before Friday and it will take some time until 
everything is moved over. It will also cause some hours of complete downtime 
while /home is copied (we will separately announce this). In best case when 
Whitsun is over everything will be working again, in worst case it will need 2 
weeks (I will be away between 21 and 26 for the general meeting of WMDE).
The repairing of the ha-nodes has top priority, so everything else will be 
delayed (linux-update, database-reimports, account-creation (for VERY 
important ones send me a mail), etc.).

If you have questions, please send them to the ML.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Can't login to willow

2013-05-12 Thread DaB.
Hello all,
At Sunday 12 May 2013 17:47:37 DaB. wrote:
 Until Nosy fix the problem again, the toolserver will be out-
 of-order – I know that that sucks but I can not change it.

just a status-update: I'm still not able to re-start the nfs-service, but I 
reached Nosy by SMS and she will take care of the problem in the evening CEST.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Upgrade to Debian 7 next Sunday

2013-05-12 Thread DaB.
Hello all,
At Sunday 12 May 2013 21:07:39 DaB. wrote:
 so for I announce a maintenance for 
 
 SUNDAY, 12. May 12:00 UTC

just for clarification: There was and will be no update today because of the 
outage. The update is postponed for 1 week and will happen next Sunday 
(despite being Whit Sunday).

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Can't login to willow

2013-05-11 Thread DaB.
Hello,
At Sunday 12 May 2013 02:48:40 DaB. wrote:
 Is this a side effect of the maintenance?

the server oh which we had setup the temporary solution yesterday crashed 
today. During the last 2.5h I tried to restarted the nfs-server but I was not 
successful and I am out of ideas now. Because Nosy didn't documented what she 
did yesterday I can not just repeat it and we have to wait until she is 
available again. Until Nosy fix the problem again, the toolserver will be out-
of-order – I know that that sucks but I can not change it.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: Solaris Updates

2013-05-10 Thread DaB.
Hello all,
At Saturday 11 May 2013 03:24:05 DaB. wrote:
 I will update the solaris user and web servers as well as the head nodes on

we had problems with the nfs-service and had build up a temporary solution for 
the time the root sleeps. FYI.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Upgrade to Debian 7 next Sunday

2013-05-05 Thread DaB.
Hello all.

Today Debian 7 was released as the new stable version. I now that some of you 
are eager to upgrade so you can get new version of programs. We will not 
disappoint you and so for I announce a maintenance for 

SUNDAY, 12. May 12:00 UTC

for the userland-servers. You can find the complete list of updates at [1], and 
a short summary below. If you notice a problem please leave a comment in the 
bug or at the mailing-list so the admins can look for a solution; please 
notice that most of the removals are just renamings – make sure to check the 
New-section also. 

Sincerely,
DaB.

Updates:
bash 4.1 → 4.2
emacs 23 → 45
g++ 4.4 → 4.7 
gcj 4.4 → 4.7
libboost 1.42 → 1.49
libc6 2.11 → 2.13
mono 2.6 → 2.10
perl 5.10 → 5.14
php5 5.3 → 5.4
vim 7.2 → 7.3 

New: 
python2.7
ruby1.9 

[1] https://jira.toolserver.org/browse/MNT-1322


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] SGE job queue availability and execution

2013-05-03 Thread DaB.
Hello,
At Friday 03 May 2013 10:54:42 DaB. wrote:
 I've noticed some irregularity in job execution through SGE over the past
 few days.  Currently it seems several queues are either disabled or in an
 error state.
 
 Is this expected?  Is there an easy way to get an idea about how many jobs
 are queued and how quickly they're executed, in other words how to predict
 when a certain job might be run?  Or maybe this is just a temporary issue
 that'll get resolved shortly?

If an queue is in a error-state something is wrong and it needs a root or an 
operator to fix this (most times just a clearing is enough). Queues that are 
disabled are deactivated by purpose. I cleared the error-queues now and I will 
look where the problem with mayapple is.
It is not a easy thing to get how many jobs are waiting. The reason is that 
some users commit a lot of jobs that are executed with a throttle (~commit 50 
jobs but do not more than 5 in parallel) – which is perfectly fine. Normally we 
have enough resources that no job waits more than a few hours at maximum – but 
there are exceptions.

 Cheers,
 Morten

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Survey: Moving to Labs

2013-05-02 Thread DaB.
Hello,
At Thursday 02 May 2013 15:29:07 DaB. wrote:
 I'm confused. I thought we were all here to support the readers, editors,
 researchers and developers of the Wikimedia projects? If the toolserver is
 empty because Labs is accomplishing the goal, isn't that a good thing?
 
 I've asked this before: why not help with Labs, rather than fighting
 everyone? Let's work as a team

do not forget who started the fighting: The WMF. The WMF announced to WMDE that 
the database-replication is going to end in the near future, what caused that 
WMDE stopped to support the Toolserver properly. The very goal with this was 
to let (Tool-)Labs be the only alternative.
A fair approach would have been to create Labs as an alternative to the 
Toolserver, letting the users (new and old) decide which system they want to 
use. Toolserver and Labs could have existed in coexistence, exchanging 
knowledge, and maybe specially in different fields after a while. But that was 
not what happened. Instead the WMF decided because the are bigger, have more 
money, servers and personal, and control the replication-data, that they just 
could put the toolserver to an end – what didn't work as well as expected. And 
now we are sitting here with confused tool-authors, annoyed tool-users and a 
angry root. 
I didn't start the fight and I am not interested in teaming-up with a party 
which was not interested to build a team in the very beginning when it 
counted. Switching or helping with Labs would signal that I'm fine with all 
what the WMF did – and I'm not.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Toolserver -- Labs

2013-05-01 Thread DaB.
Hello,
At Wednesday 01 May 2013 14:46:08 DaB. wrote:
  The Toolserver had a tendency to make breaking changes

sorry, I have to disagree here. We are very backwards-compatible. We still 
support a Solaris-login-server just because people are too lazzy to convert 
their stuff to Linux, we still support 2 variants of cron because the users can 
not decide which one to use. We have let people run non-SGE-task 2 YEARS after 
River announced the usage of SGE.
If our little changes are too much for you, than a moving to Labs will be out 
of question for you.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Survey: Moving to Labs

2013-05-01 Thread DaB.
Hello all,

until now I had the impression that we (you, the authors, and me) fight 
together against WMF and WMDE for keeping the Toolserver and against Labs. 
Some mails and discussion in the last days gives me now the impression that 
this was wrong and (at least some of) you are eager to leave the toolserver as 
soon as possible.
There is no point to beg the WMDE for new hardware and to invest much more 
time if 2 weeks after Labs is ready the toolserver will be empty. For this 
reason I created a survey at [1] that starts at midnight. Please take a moment 
of your time and place your nick in the section that suits you.

Sincerely,
DaB.

 
[1] https://wiki.toolserver.org/view/Labs-Moving-Survey

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Thoughts and questions to WMDE members about TS and expectations

2013-04-28 Thread DaB.
Hello,
At Monday 29 April 2013 01:11:46 DaB. wrote:
 On 04/28/2013 04:42 PM, Maarten Dammers wrote:
  I tried labs and I hate it, if someone tries to force it on my now I'll
  just shut down my tools and leave.
 
 Even more useful would be a list of actual issues you've encountered, so
 that we may address them in the future.

Even more useful would have been a We improved since last time, please come 
and check again.

 
 That said, far from ready is neither fair nor very accurate; unless
 your tool requires access to the database dumps - which are coming - the
 tools project /is/ ready and quite functional; and there are already
 several tools running there.

Until now I never found a tool-labs-URL in the wild. Is there a list of what 
you are hosting?

 
 -- Marc

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Thoughts and questions to WMDE members about TS and expectations

2013-04-27 Thread DaB.
Hello,
At Saturday 27 April 2013 17:19:29 DaB. wrote:
 To cut a long story short: I am not sure what you expect me to do in
 this situation. Please clarify! I don't want to deal with a task
 without a clear task.

as a WMDE-member and toolserver-admin I would like to answer you.

I expect you to represent the toolserver against your boss, Pavel. And I 
expect that you do it in favor of the toolserver and get us as much support 
(in money, man-power and other things) as possible.
I also expect you that you can differ between the part of your job that should 
help the toolserver and the part of your job that has the goal to destroy the 
toolserver; I do expect you to not do propaganda for Labs or ToolLabs (neutral 
information is ok).  

The goal of the toolserver is to help the Wikimedia-projects with tools. For 
this it provides a stable place for tool-authors for hosting their tools 
(before the toolserver tool-author had to host their stuff themself). There is 
no limit for this, because the Wikimedia-Projects have no limit too and 
continue to grow. The tool-authors expect that the toolserver is (more or 
less) stable, free, fast, maintained and that they will get help if needed. 
They do not like downtimes, replags, changing of rules and to document their 
stuff. Somewhere in the middle is the toolserver (we are free, somewhere 
stable, not very fast, more or less maintained, offer help if possible, have 
downtimes, much replag from time to time and change our rules sparely).
Your job is to help to move the toolserver nearer to the expectations of the 
users with buying hardware for the toolserver (for fastness and against 
replag) and hire admins (for offering help and do maintenance).
Every investment in the toolserver is a good investment because it helps the 
Wikimedia-projects. And it doesn't matter for how long the toolserver will 
exists – if you hire a person for 1 year that's more expensive than 1 server 
and after the year you have the hardware as a bonus.

And no, there was never a plan how the toolserver should grow; we always 
played by ear used how little money we had. In a ideal world WMDE would had 
read the toolserver-mailinglist and, if the complements of tool-authors 
increased, asked the admins how the cluster can be extended (in a VERY ideal 
world WMDE would had read the Wikipedia looking for complements of tool-
USERS). But this is not a ideal world – but WMDE wasn't able to help even if 
the admins ASKED themself. So why creating a long-time-plan if WMDE is not 
able to fix even short-time-problems?

To conclude this mail I come back to exceptions in the form what I expect 
from WMDE: Nothing. I do not think anymore that WMDE has the goal to support 
the toolserver. All WMDE cares for is to move the tools (with or without tool-
authors) to Labs as fast as possible, investing as few as it can in the 
toolserver, and shutdown the toolserver as early as possible.

Sincerely,
DaB.

P.S: And I understand that it is just your job. 

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Wikidata tables

2013-04-18 Thread DaB.
Hello,
At Thursday 18 April 2013 22:00:54 DaB. wrote:
  but the JSON data you are talking about does not seem
 copyrightable and much lower in volume.

if these JSON-data is stored where the normal wiki-text is, it is imposable 
for us to replicate it: Because we have no access to these wmf-servers, there 
would be no way to separate Wikidata from the rest and/or we have not enough 
disc-space. 

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Wikidata tables

2013-04-18 Thread DaB.
Hello,
At Friday 19 April 2013 01:03:25 DaB. wrote:
  would be no way to separate Wikidata from the rest
 
 I don't understand why separating plaintext storage between different
 projects would be an issue. Is it all lumped into one storage
 namespace?
 I'm sure nobody at Wikimedia would be the least bit motivated to make
 this data available to the toolserver, but maybe it will be usable in
 labs. Otherwise it would be quite a waste of a great opportunity.

as you may know there is a rev_text_id-field in the revision-table. This field 
points to the text-table where the actual text is – or should be. Because the 
WMF doesn’t store the text here, but only a pointer (DB://cluster25/11458305 
for example). If you query different wikis you will see that most of them point 
to the same cluster or one with a number short by. That says me (and I was 
also told so before) that all text of all wmf-projects are stored together.
The task would now to separate wikidata from the rest – but the storage-area 
has no clue from where a text is which makes the separating very hard. And 
there is another problem: Deleted texts are also in this area, so even more 
filtering would be needed.
I very doubt that this situation will change at the TS and I also doubt that 
it will be different for WikiLabs. So I guess your best bet is the API here.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Flue again

2013-04-15 Thread DaB.
Hello all,

just as short notice: I have the flue again and it is unlikely that I will 
administrate the toolserver until properly Friday. Please try to reach Nosy or 
one of the operators if you find a problem.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Restart of z-dat-s1-b (sql-s1-rr), z-dat-s2-b (sql-s2) and z-dat-s5-b (sql-5-user) TODAY

2013-04-12 Thread DaB.
Hello all,

I will piggyback Marlen’s window today to reboot the linux-database-servers 
for changing their IPs to the new range too. You can follow the progress at 
[1].

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1317

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Ipv6 issues

2013-04-06 Thread DaB.
Hello,
At Saturday 06 April 2013 21:22:53 DaB. wrote:
 Looks like ipv6 is broken at Willow and maybe at more servers. That 
 probably explains some of the problems we seem to be having right now.

AFAIS willow can not reached by IPv6 and can't reach anything with IPv6 
itself. AFAIS it is not a firewall-issue. My experince with ipv6 at Solaris is 
very limited so I would prefer that Nosy takes a look first.
Use one of the linux-host for bots as workaround if possible.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Adding of 2 operators

2013-04-01 Thread DaB.
Hello all,

the users apmon and timl swere now damned to do all the boring stuff in 
future/s were promoted to Operators to help the roots. Apmon will also put 
the needed OSM-configs into our puppet-system to make it possible to setup a 
new OSM-Server.
You can find the belonging ticket at [1].

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1313

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance for sql-s1-rr, sql-s2 and sql-s5-user

2013-03-28 Thread DaB.
Hello,

for a kernel-update I hereby announce downtime of sql-s1-rr-a, sql-s2 and sql-
s5-user for tomorrow

FRIDAY, 22:30 UTC.

The downtime of each host will be 20-40min. Not affected will be sql-s5-rr. 
sql-s1-rr will be switched to rosemary so no downtime there too, but sql-s1 
will be slower. See [1] for details.

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1311

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p

2013-03-23 Thread DaB.
Hello,
At Saturday 23 March 2013 18:24:48 DaB. wrote:
 I was just doing some investigating and discovered that we still have
 the cur table (it was removed in mediawiki v1.5) and that the jobs
 table isnt visible.

the cur-table was never removed it was just replaced. While it may not updated 
anymore it could still be that for some very old revision it is still read. 
The dropping of tables is BTW the job of the WMF-techs and while they not drop 
it I see no harm in having a view.
The job-table is not replicated for performance-reasons.

While we speak of enwiki: The import of commons on the new server is done. By 
Sunday or Monday evening we should have a complete and up2date sql-s1-rr 
again.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] IP Renumbering of the complete Toolserver cluster

2013-03-22 Thread DaB.
Hello,
At Friday 22 March 2013 13:50:28 DaB. wrote:
 Can you provide the new IP addresses already? At least their list without 
 assignment to servers...

we will move from 91.198.174. to 185.15.59. and from 2620:0:862:101: to 
2a02:ec80:101:. The local part will stay the same for first; so yarrow's IPv4 
will move from 91.198.174.216 to 185.15.59.216 for example. The only exception 
will be 2 internal database-servers (daphne and cassia) which will loose their 
public addresses and move to the internal (10.24.1.) net.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] suhosin log lines

2013-03-22 Thread DaB.
Hello all,

from time to time I find huge blocks of 

Mar 22 14:47:02 nightshade suhosin[14364]: ALERT - script tried to disable 
memory_limit by setting it to a negative value -1 bytes which is not allowed 
(attacker 'REMOTE_ADDR not set', file 'unknown')

in the syslogs of the userland-servers. Unfortunately I have no idea to whom 
these lines belong. So if you use suhosin could you please look if one of your 
tools have a problem? And if somebody has an idea how to identify the user I 
would like to read it too :-).

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] sql-s1-user-replication will stop

2013-03-20 Thread DaB.
Hello all,

it was discovered that an update at the WMF-side breaks our replication and 
makes some manual work necessary.  I have run these manual step on the new 
setuped s1-server now. The problem is that the other sq-server (rosemary) has 
~17k seconds replag and so the problem will occur during my sleep-phase. So 
most likely the replication of enwp will stop tomorrow morning and stay so 
until a root is awake.
Just as information.

@Nosy: If you are around when the problem occurs: Skip the queries that update 
the mysql.-tables (only these!) and run mysql_upgrade when it complains 
about a broken mysql.proc-table (the first should be an update in 
recentchanges).

Sincerly,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Status of the s1-reimport on sql-s1-rr

2013-03-19 Thread DaB.
Hello all,

just a quick status-report: The host was re-setuped, the binary dump was 
imported, wikidata was imported and both replags reached a point near 0s. As 
last step I'm importing now commons since yesterday after Nosy had setup the 
SAN-partition. I guess the import will need a few days (if I use the disc-
usage as measure: 20% are already imported).
The replag of enwiki at rosemary (sql-s1-user) is increasing slowly because of 
the load (rosemary has to handle now sql-s1-user AND sql-s1-rr). I'm sorry for 
this, but I can not change that because of insufficient hardware-resources 
(=too 
few servers).

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Interruption of database-connections tomorrow

2013-03-19 Thread DaB.
Hello all,

for a config-change at our sql-load-balancer (that's the software-thing that 
converts something like sql-s2-user to the real server) I hereby announce a 
maintenance-window for tomorrow,

WEDNESDAY, 20:05 UTC.

During the downtime no connections to the databases will be possible, running 
database-queries will be aborted. If all works correctly the downtime will be 
less than 1 minute (just the restart of the service), but just to be sure 
calculate with 1h of downtime. You can follow the process at [1].

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1308

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] /tmp is not a waste dump

2013-03-17 Thread DaB.
Hello,
At Sunday 17 March 2013 21:14:48 DaB. wrote:
 Hello all,
  over 9000 small files at the moment 

just to be fair: Platonides discovered that over 8800 of them were created by 
a munin-script that was written by me. I'm sorry.

 
 Sincerely,
 DaB.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Error in Revision Table in lbwiki

2013-03-15 Thread DaB.
Hello,
At Saturday 16 March 2013 01:41:47 DaB. wrote:
 Hi all,
 
 I have a script running collecting data in multiple wikipedia(s), I started
 to notice that revision table in lbwiki_p has some incorrect data.
 
 Here is an example:
 mysql select rev_id, rev_user, rev_page, rev_deleted, rev_len,
 rev_timestamp from revision where rev_id = 185751;
 ++--+--+-+-++
 
 | rev_id | rev_user | rev_page | rev_deleted | rev_len | rev_timestamp  |
 
 ++--+--+-+-++
 
 | 185751 |  580 |83446 |   0 |NULL | 20061203231418 |
 
 ++--+--+-+-++

The result is correct.

 
 According to my understanding if a record exist rev_len shouldn't be NULL,
 if the revision deleted then rev_deleted should get flag but rev_length
 should remain as it is.
 
 Hope someone can look into this, because people who are doing analysis
 might end up getting wrong results.

rev_lenght will remain as it is – the problem is that rev_lenght was not there 
from the very beginning and was never (AFAIK) back-populated; so very old rows 
has no lenght and are NULL.


 Best;
 --
 Anuradha Uduwage (Anu)

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] No user_properties table on arwiki_p database

2013-03-15 Thread DaB.
Hello,
At Saturday 16 March 2013 01:49:12 DaB. wrote:
 First of all thanks for toolserver, it's a great service!
 
 (I posted this question on jira as well but I'm not sure I found a way to
 assign it to someone and so if anyone saw it. The issue on Jira is at
 https://jira.toolserver.org/browse/DBQ-202 )

That's the wrong queue. DBQ is for non-ts-people to get sql-query running. If 
you have a problem wit the toolserver use the TS-queue.


 Can you verify if this is the case, please? I have a deadline for writing a
 paper based on these data on Friday 15 (tomorrow) and currently I'm missing
 the data for few wikis ;(

I fixed the problem. But at least for me your mail was here 18 minutes before 
Saturday – please notice we do not offer time-travels yet.

 
 Below a simple example that shows how the table user_properties is missing
 for arwiki (on sql7) and it is not missing on abwiki (on sql3).
 
 Thanks!

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Re-Setup of thyme (sql-s1-rr)

2013-03-14 Thread DaB.
Hello all,

as announced the s1-cluster will be the next for re-setup. It will begin with 
thyme which handles sql-s1-rr at the moment. The re-setup of thyme will begin 
today evening or tomorrow and will take the whole weekend. During the time 
rosemary will handle sql-s1-rr (and sql-s1-user), so no problems should occur.
Somewhen next week I will move over the user-databases than to re-setup 
rosemary – that will cause some read-only-time; I will send another mail for 
that.
You can follow the progress at [1].

Sincerely,
DaB.


[1] https://jira.toolserver.org/browse/MNT-1305

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] database lag issues

2013-03-10 Thread DaB.
Hello,
At Monday 11 March 2013 02:18:38 DaB. wrote:
 is the report that I just got, is there any particular reason that we
 have 15+ hour lags on s1,2,4 ? status just lists s5 during re-import.

s1 (rosemary) had some duplicated rows and  so the replication stopped until a 
root fixed it. s2-wd stopped for unknown reasons. All other databases were 
nearly up2date when I came around.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Introduction: Operators

2013-03-04 Thread DaB.
Hello,
At Monday 04 March 2013 21:17:26 DaB. wrote:
 As approval from WMDE and WMF will take some
 time anyway, we should start the process for Coren and Pla-
 tonides now.  When the paperwork is done in a few weeks, we
 can proceed further.

at this point in time I have not decided yet if there will be more roots and 
if, who that will be.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Introduction: Operators (was: Adding more roots)

2013-03-03 Thread DaB.
Hello all,

after our discussion about more roots I got the impression that for some of 
you the topic of more roots is quite urgent. To be honest I feel not very well 
to just add a few roots at the moment.
So I thought a compromise and created a new user-group: Operators [1]. 
Operators have a limited set of advantage rights – enough to help the roots 
and do every-day-jobs, but not enough rights to have access to sensible data 
(so no approval from WMDE or WMF is necessary).
For testing I gave operator-status to the following people: Merl, who manage 
SGE already, Danny_B, who manage the user-store already, and Platonides who 
volunteered. There will be more in the future, but at the moment these 3 will 
do.
In the new group the operators can collect experience while helping the users 
and the TS. And the roots can see who could get root-status someday and who 
not. The group is also a good place for users who like to help the TS, but can 
not invest the same amount of time like a root.

So let's see if this solution works.

Sincerely,
DaB.



[1] https://wiki.toolserver.org/view/Operators

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Reboot of the linux-userland-server this evening.

2013-03-02 Thread DaB.
Hello all,

for another kernel-update I have to reboot the linux-userland-boxes again. The 
reboot will happen 

TODAY, 20:00 UTC.

The reboots will happen (again) sequentially in 15min intervals. SGE will 
migrate/restart your jobs to other servers during the downtimes. You can 
follow the progress at [1].

Another news from the linux database-servers (sql-s2 and sql-s5-user): I still 
try to find the optimal configuration. For this I have to restart mysql every 
few hours to bring changes live. I try to keep the downtime there at a 
minimum, but I guess slow and very outdated databases helps no one.

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1300

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Less time this week and slower sql-s5-user

2013-02-26 Thread DaB.
Hello all,

as you may notice I was not online yesterday and today. The reason is that I 
have way more to do in real-life at the moment and a flu is visiting my family 
at the moment. For these reasons I will not be online as much as normal this 
week (maybe it will get better at the weekend). If something VERY urgent 
happens please send me a mail and I will look at it when I find time.
As you also may noticed is that sql-s5-user is slower than normal. The reason 
is simple: I import commons in parallel threads to have it available as soon 
as possible. If you need a fast and not much behind copy of s5 for READING use 
sql-s5-rr (you should ALWAYS use that or dewiki-p.rrdb.toolserver.org for 
reading).

Hope to see you soon.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Reboot of the linux-boxes today

2013-02-24 Thread DaB.
Hello all,

for a important kernel-update I need to reboot the linux-boxes today. The 
reboot will happen

TODAY, 20:00 UTC.

The linux userland-boxes will be away for ~10min and the database-servers 
(sql-s2 and sql-s2) for 30min (all values are estimates). Solaris-boxes are 
not affected. The reboots will happen sequentially so SGE should re-schedule 
tasks between the boxes so the downtime for each task should be short.

You can follow the progress at [1].

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1297

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Postmortem: General downtime yesterday

2013-02-24 Thread DaB.
Hello all,

during the maintenance window yesterday evening the hole cluster was down for 
~30min starting ~21:20 UTC. The problem was independent of the maintenance 
working, but caused the window to extend.
The problem was an out-of-memory on one of our HA-nodes. Unfortunately the box 
did not restart itself and its ha-buddy did not detect the problem too, so the 
services of the out-of-memory-box were not switched to the other box. This 
caused the hole cluster to stand until I manually rebooted the host. I will 
look if I can find some kind of sensor for that; in worst case I will enable 
our old reboot if low on memory-script again.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Short downtime of s2 tomorrow

2013-02-24 Thread DaB.
Hello all,

the reboot worked as planed (only a little late). It took more than 20 minutes 
because of a slow shutdown of mysql (I will try the trick at [1] next time, 
maybe it helps).
The performance increased not as much as I planed. I will change some more 
variables and test them with the reboot tonight.

Sincerely,
DaB

[1] http://www.mysqlperformanceblog.com/2009/04/15/how-to-decrease-innodb-
shutdown-times/

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] 2. Try: sql-s5 (dewiki) will be read-only tomorrow

2013-02-24 Thread DaB.
Hello all,
At Sunday 24 February 2013 15:28:18 DaB. wrote:
 the movement is done (commons is missing at the moment at s5). s2 was also 
 rebooted successful and we had a general downtime arround 21:20 UTC. More 
 details about all 3 tomorrow.

ok, now with more details (sorry, but I really had to went for bed last 
night).
The movement of the user-databases worked without problems. The dumpimport 
was done within 30min. The general downtime happened shortly after so sql-s5 
was read-only for longer because I had to fix the other problem first. Please 
check if everything was moved correct and message me if anything is missed 
(the old box will be there until Wednesday 12:00 UTC).
There was a unplanned restart of mysql of sql-s5 after the movement which 
caused a downtime for 10 minutes – sorry for that. The commons-import was not 
done at that time and broke for that reason. I will restart it after the 
reboot tonight.
Because z-dat-s5-b (the new host for sql-s5) shows similar performance-
problems like z-dat-s2-b (the new host for s2) I have configured the cassia 
(the old sql-s5 host) for sql-s5-rr to lift a little load from z-dat-s5-b; I 
will also add the same config-changes of z-dat-s2-b on z-dat-s5-b tonight.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Reboot of the linux-boxes today

2013-02-24 Thread DaB.
Hello all,

the reboots are done. No big problems occurred, only the user-store was missed 
for some minutes for unknown reasons.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] 2. Try: sql-s5 (dewiki) will be read-only tomorrow

2013-02-22 Thread DaB.
Hello all,

I just started replication on the fresh dump of s5 and will import commons 
later tonight. For tomorrow I plan a second try to move the user-databases 
from the old s5-host to the new one. So I hereby announce a read-only-time of 
s5 for

TOMORROW, 21:00 UTC 

of unknown length (should take not that long because the owner of the biggest 
databases contacted me telling that no movement is needed) – at minimum a few 
hours.

I will also dump wikidata from this fresh dump and import it everywhere during 
the next hours (so a correct wikidata-copy should be everywhere soon again).

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p

2013-02-22 Thread DaB.
Hello,
At Friday 22 February 2013 22:24:13 DaB. wrote:
 There have been multiple reports of corruption and at least 4 open
 tickets in JIRA about issues with enwiki's database issues going back
 about a year.

s1 is the next cluster for a re-import.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Short downtime of s2 tomorrow

2013-02-22 Thread DaB.
Hello all,

to (hopefully) speed up s2 I need to restart mysql to bring some config-changes 
live. Because of this there will be a downtime for sql-s2 starting

TOMORROW, 22:00 UTC.

The downtime should be less than 1h. You can follow the progress at [1].

Sincerely,
DaB.


[1] https://jira.toolserver.org/browse/MNT-1296

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Wikidata-moving

2013-02-20 Thread DaB.
Hello all,

it looks like the WMF-techs are moving wikidata to cluster s5 at the moment 
(without announcement of course).
I'm quite sure that this will break our wikidata-replication; so after my 
sleep I will look how the situation will be and than probably re-import 
wikidata everywhere (wikidata is still quite small at the moment so that's 
still possible). So expect the wikidata replag to rise during the next hours.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] List of tools on the toolserver - Help needed

2013-02-19 Thread DaB.
Hello,
At Tuesday 19 February 2013 15:58:26 DaB. wrote:
 Actually, it's not just you whom JIRA hates, and it's not
 just you who hates JIRA :-).

While jira hates me from time to time too, in this case it is either crowd, 
OpenDS or LDAP who hates you all (I'm not sure yet).

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] List of tools on the toolserver - Help needed

2013-02-19 Thread DaB.
Hello,
At Tuesday 19 February 2013 16:00:13 DaB. wrote:
 Must I add them to list?

no, but you can.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Short downtime for s2 today

2013-02-14 Thread DaB.
Hello all,

to update a package with a security-problem, I have to restart z-dat-s2-b 
today. This will cause sql-s2-user and sql-s2-rr to be down. The downtime wll 
start at

TODAY, 19:20 UTC and should not more than a few minutes.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Short downtime for s2 today

2013-02-14 Thread DaB.
Forgot the ticket-ID: MNT-1291 [1].

[1]  https://jira.toolserver.org/browse/MNT-1291

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Postmortem: Partial Toolserver-outage

2013-02-11 Thread DaB.
Hello all,

great parts of the toolserver-cluster were down or very slow in the last few 
hours. AFAIS it was a problem with the user-store or rosemary (where the user-
store is physically connected). I rebooted rosemary, but the reboot showed 
problems with its IPv6-address. I tried to fix that what caused several other 
reboots. Rosemary is now up and running but the user-store is not available 
(looks like Nosy just mounted it without updating the fstab-file). So I was 
forced to remove the user-store everywhere (beside on willow because it need a 
reboot to do that and a reboot is scheduled already later for today).
I will try if I can find the partition for user-store and mount it but I have 
not much hope (there are way to many devices to try) – just to be clear: There 
is no data lost. Also away will be munin, because its data is also mounted on 
that host. I fear that we have to wait for Nosy to recover before we get the 
user-store back.

tl;dr: TS had problems, user-store is away.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] [Toolserver-announce] Reboot of willow Monday

2013-02-11 Thread DaB.
Hello all,

the reboot worked without a problem, please take a look if everything of you 
runs like normal.
Please notice again that all bots have to run by SGE now (for details see 
[1]).

Sincerely,
DaB.

[1] http://lists.wikimedia.org/pipermail/toolserver-announce/2013-
January/000557.html

Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Reboot of willow Monday

2013-02-10 Thread DaB.
Hello all,

while I was killing some bot-processes on willow to reduce the high load I 
accidentally pressed return too early and killed a random number of processes 
with that. I restarted the system-processes, but I am not sure if everything 
is completely right. Just to be sure I hereby announce a reboot for tomorrow,

Monday, 19:05 UTC.

Willow will be away for some minutes. Please notice that the history shows 
that cron on solaris does not start all processes during the reboot, so you 
should check after the reboot if everything works. Please notice that in a few 
minutes the new no bots without SGE-rule ([1]) becomes active, so please 
make sure that your bot uses SGE or I might disable it.

I have no idea how many user-processes were killed, but I'm sorry that it did  
happen nevertheless.

Sincerely,
DaB.


[1] http://lists.wikimedia.org/pipermail/toolserver-announce/2013-
January/000557.html


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] s2/s5 will be read-only at Saturday (was: Re: Split of s2/s5 (cassia))

2013-02-09 Thread DaB.
Hello all,

the split is done. s2 and s5 are not longer together (but they announced to be 
just friends in future).
For the users for which I moved user-databases: I will let the user-databases 
stay at cassia for another week. If you can find a moment of time: Please check 
if the moving was correct (I doubt that there are any problems, but you never 
know) and drop your user-databases at cassia if so. 
I imported wikidata at the new s2 yesterday (but forgot to create a view, 
which is done now). I will check if there is enough disc-space left to also 
import commons.

A more unpleasant news: I received a SMS by Nosy telling me that she is in the 
hospital for at least 1 week. Let us all hope that she and her child will be 
better soon!

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Replication stopped

2013-02-08 Thread DaB.
Hello,
At Friday 08 February 2013 14:18:03 DaB. wrote:
 Well no - WMDE did inform WMF about this issue several times last
 year. It's hard for me to follow-up why the replacement didn't happen
 then and to me, it is more important to make it happen now.

ok, I tried to phrase it diplomatically. The truth would be that WMDE was not 
able to replace the broken hardware in 5 months, although I told them several 
times that it is broken and it is important. It doesn't really matter if WMDE 
just not cared, was busy or the WMF did not respond.

 (And when I took over the coordination I wasn't aware that this still
 needs a follow-up because I thought Tampa was history which is
 obviously wrong.)

AFAIK you are a sys-op yourself. So all you needed to do was to look into our 
nagios, which would had told you that a.) amaranth is still active and b.) the 
hardware is still broken in it. Or you could have ask Nosy or me; or 
Sebastian. 

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Replication stopped

2013-02-07 Thread DaB.
Hello all,

around 3 o'clock UTC we lost connection to amaranth, our server in Tampa which 
handles the connection to the WMF-database-servers. Until now it is unclear if 
it is a server-problem or a connection-problem. I have tried to reach the wmf-
techs, but no response yet. I will keep you updated by mail, because JIRA is 
also hosted at amaranth and so also down.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Replication stopped

2013-02-07 Thread DaB.
Hello,
At Thursday 07 February 2013 23:15:23 DaB. wrote:
 Hi Daniel,
 
 Did some poking.

Thanks for that.

 Thanks to Andrew Otto and Chris Johnson the server is
 back online (hard reboot).

Yes, it is online and working again :-). Thanks to everyone involved!

 It looks like it has some faulty hardware:
 http://nagios.toolserver.org/cgi-bin/status.cgi?host=amaranth

Yes, the order for replacement got lost in the WMDE office, but they work on it 
now.

 
 Can you restart the replication?

Done with the exception of wikidata and commons on cassia. I will look for 
them now.

 
 Maarten

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Sick

2013-02-05 Thread DaB.
Hello Nosy,

you and the baby: Get better soon! The toolserver has a lower priority.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Adding more roots

2013-02-05 Thread DaB.
Hello,
At Tuesday 05 February 2013 15:27:24 DaB. wrote:
  wasn't thinking about a paid job, but harvesting the vol-
 unteer potential of the toolserver usership. 

AFAIK the WMF accepts only paid persons anymore.

But if the users would like to help, they can it even now: Update the pages in 
the wiki, write a patch for cron, add rules to puppet and help to clean it up, 
help newbies in the IRC and JIRA, add nagios-rules, prepare the switch from 
jira away (or find its problem), help Merl with the SGE, help Danny with the 
dumps, help Kai with OSM – and there are many more things.

I have no problems with more roots (heh, if there are enough, I can leave 
;-)). But beside the formal problems (WMF and WMDE), there is also the problem 
that to incorporate a new roots needs a lot of my time – and if the new root 
becomes inactive short time later my time was wasted. River appointed a few 
users to roots over the time, but I'm the only one left and most of my 
colleges were never very active.

So in a nutshell: If you like to help the TS: Do it. If you need a special 
right and I know you, ask me and I will see what I can do. If you need to 
become a root and are SURE to stay, fight with WMDE and WMF (and me) and if you 
are successful I will show you how deep the rabbit hole goes ;-).

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Adding more roots

2013-02-05 Thread DaB.
Hello,
At Tuesday 05 February 2013 20:24:03 DaB. wrote:
 Focusing solely on the replicated databases for a moment, they've been
 corrupt for months. Months and months. What can be done about this? Would
 having additional roots help with this?

it took a long time for different reasons (political ones, hardware-shortages, 
technology changes, learning and (for a very small part) personal-shortage). 
But the situation improved during the last weeks: I have written a replacement 
for trainwreck, the WMF provides dumps now on short-time-base (few days), we 
have a contact person there, I have learned how to import the new dump-format, 
and Nosy and I have setup 1 of the new servers as db-server.
The s2-import will be the first step to replace/re-import all clusters. I'm not 
sure about the sequence yet (but s5 will be the next), but if everything works 
all clusters SHOULD be new withing 6 weeks.
And no, in this special field another root would not help in my eyes.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Adding more roots

2013-02-05 Thread DaB.
Hello,
At Wednesday 06 February 2013 00:31:31 DaB. wrote:

 I also don't think that a lot of familiarization for new
 roots is necessary.  After all, the servers don't run on
 magic, but on software, and if you are able to find your way
 around JIRA, or OSM, or something else that needs attention,
 you are very probably skilled enough to read and under-
 stand configuration files and code.

Trust me, the toolserver is a *little* bit more complex than your machine at 
home. It is a full-grown cluster with more than a dozen hosts, a SAN-
infrastructure, HA-services and everything is mixed with Solaris and Debian. I 
have more than 20 years of computer-experience, but I needed over a year to 
understood everything (and I still discover new things from time to time). 


 On Labs, which is
 scheduled to have replicated databases by the end of the
 month, there is no such barrier, and it may become increas-
 ingly difficult to convince volunteers to invest any time in
 the toolserver.

In this case you should just wait until the end of the month and than switch 
to labs, leaving the toolserver with all its problems behind.
Just for clarification: I do not have convince people to come to the 
toolserver, they come by alone. And we will see how many users are eager to 
leave if Wikilabs is ever working.

Sincerely,
DaB.



-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Adding more roots

2013-02-04 Thread DaB.
Hello,
At Tuesday 05 February 2013 02:07:48 DaB. wrote:
 So we should add more roots, ideally of course Solaris/Linux
 bilinguals with 20+ years of HA and MySQL replication expe-
 rience and lots of spare time on their hands, practically
 any bright mind who can track down some bug, update the pup-
 pet configuration and care for all the other tidbits while
 documenting their work meticulously, so that the roots can
 focus on the more complicated stuff.

unfortunately it is not that easy (and finding a solaris-person is quite hard). 
There are other problems too. For example you have to find somebody who is 
accepted by WMDE (as owner) AND WMF (as database-owner). Than there is nearly 
no or no up2date docu. Also WMDE still believes that the toolserver will not 
survive this year so the contract would be limited (so much learning for a 
short job). The person would also have to life with me, you all and the 
community – and neither is easy sometimes.
Another point is that the influence of WMDE would increase (Wes Brot ich es, 
des Lied ich sing) and taken the position of WMDE I'm not sure if that is a 
good idea.

I know that some of you wait for stuff to happen and I'm sorry that it takes a 
lot of time sometimes – but my to-do-list is long and even my time is limited. 
I hope to fix some things during my next semester break (beginning in 2 weeks), 
but not everything will be fixed. 

Good night.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Contacting me

2013-02-03 Thread DaB.
Hello all,

few days ago my mom got a telephone-call by an English speaking person 
babbling something about servers (she was not able to understand more and 
terminated the line). I'm not saying that it was one of you, but the incident 
inspired me for the following declaration: *NEVER* call me by phone! Even if 
you are able to get a phone-number of me and even if the toolserver is 
melting: There is no reason ever to call me – if you call me and I am able to 
identify you I am going to delete your account. The only exception is Nosy who 
has my cell-phone-number. 
If you like to contact me try IRC. If I am not online try to contact another 
root so he/she can solve the problem. If you can't find another root or it has 
to be me and it is important, write my an eMail. If I am not able to check my 
mails the chance is VERY high that I'm can not ssh to the toolserver anyway.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Cron on submit

2013-02-03 Thread DaB.
Hello,
At Monday 04 February 2013 01:23:08 DaB. wrote:
 Hello!
 
 There were 2 messages here during Janury reporting problems with cron.

Both where on willow AFAIS, which is overloaded.

 I am now noticing issues with my cronjobs too.

What exactly is the problem?

  By looking at [1] you
 are able to see that the strange behaviour started somewhen week 2 and
 3 (mid January).

Sorry, I don't see anything. All I see is that the maximum number of cronjobs 
varies more since a few weeks (but we are way from the number in autumn if you 
look at the year-graph).

 Do we have again cron (the server) running out of
 memory or what is the issue here? DaB can you may be give some hints
 here? Or someone else?

I checked hawthorn and there are a few memory-problems at peak-times. I will 
see if I can add another patch. 

 
 Thanks a lot and greetings!
 DrTrigon

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

  1   2   3   4   5   >