Re: [Toolserver-l] Maintenance: Saturday: sql-user offline for about 1h

[Marlen Caemmerer]

Hey,

I was hindered by personal issues so I have to reschedule the date to

Wednesday, 9th Jul 7pm-9pm

Cheers
Marlen/nosy

On Thu, 3 Jul 2014, Marlen Caemmerer wrote:


Date: Thu, 3 Jul 2014 11:40:13
From: Marlen Caemmerer 
To: toolserver-l@lists.wikimedia.org
Subject: Maintenance: Saturday: sql-user offline for about 1h

Hello,

the database host sql-user has a problem with the local disks.
To avoid potential data loss and reduce possible outage I will move the user 
database completely to the SAN.
In case of system failure it will be much easier to migrate the SQL instance 
to another host.


I will take the databases completely offline at

Saturday, 5th Jul 7pm - 9pm for about an hour

Cheers
Marlen/nosy





___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: Saturday: sql-user offline for about 1h

[Marlen Caemmerer]

Hello,

the database host sql-user has a problem with the local disks.
To avoid potential data loss and reduce possible outage I will move the user 
database completely to the SAN.
In case of system failure it will be much easier to migrate the SQL instance to 
another host.

I will take the databases completely offline at

Saturday, 5th Jul 7pm - 9pm for about an hour

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: s1 commons

[Marlen Caemmerer]

Hello,

the commons copy for enwiki needs more space and I have to move it.
I will do this

this Friday, 20th  7pm-10pm

the whole enwiki DB will be offline for most of the time.

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: Solaris Updates

[Marlen Caemmerer]

Hello,

Alex and I will update the Solaris user land boxes on

Saturday, 8th Mar, 8 pm - 11 pm UTC.

This may require reboots.

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: Reboot+fsck of Toolserver user-store

[Marlen Caemmerer]

Hello,

NFS has been quite unstable lately regarding user-store and it seems a 
filesystem check for user-store is needed, too.

I have decided to reboot + check the machine.
This means, some tools and OSM will not work during the maintenance.
The filesystem check will take quite some time because the volume is quite big.

Maintenance will happen

Monday, 10th Feb 10pm UTC - Tuesday, 11th Feb 3am

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: dumping commons/s4 database

[Marlen Caemmerer]

Hello,

several copies of commons broke in Toolserver.
I'll pull a dump of it off s4-user starting

tomorrow, Tuesday, 8pm UTC

This means replication will be stopped during dump, the rest should work as 
usual.

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: PHP update tomorrow

[Marlen Caemmerer]

Hey,

there are some major inconveniences this update caused. I will do a downgrade 
to the recent PHP 5.3 on

Thursday, 19th Sept 7 pm - 9 pm UTC.

Cheers
nosy



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance for DB cluster s2 : Resetup of commons

[DaB.]

Hallo Nosy,
Am 10.09.2013 22:38, schrieb Marlen Caemmerer:
> I will drop and reinsert it starting on
> 
> Friday, 13th Sept 7 pm UTC

das ist etwas ungünstig weil z-dat-s2-b ein Linux-Host ist und ich den
zur dieser Zeit updaten möchte.

Ich kann gerne mit diesem Host anfangen, aber mein Fenster beginnt auch
erst um 21:00 MESZ.

Mit freundlichen Grüßen
DaB.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance for DB cluster s2 : Resetup of commons

[Marlen Caemmerer]

Hello,

the copy of the commons database in the s2 database cluster is broken - it is 
missing tables.
I have to get a copy of commons, drop the old commons copy and reinsert it.

I will drop and reinsert it starting on

Friday, 13th Sept 7 pm UTC

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: PHP update tomorrow

[Marlen Caemmerer]

Hey,

I updated PHP and tested some tools. It looks good so far but I changed the 
version from 5.3 to 5.4 so if anything does not work please consider this too 
but still write an email or file a ticket.

Cheers
nosy



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: Solaris Updates

[Marlen Caemmerer]

Hello,

next week there will be Solaris updates done by Alex Mette and me.
This means web servers, willow and submit/mail servers will be updated.

We will do this on Wednesday, 11th Sept 7-10 pm UTC.


Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: PHP update tomorrow

[Marlen Caemmerer]

Hello,

I will do a PHP update tomorrow

Thursday 7pm - 9pm

If interruptions occur they will be short.


Cheers
Marlen/nosy

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance tomorrow

[Marlen Caemmerer]

Hello,

I have to enhane the networking for one of the xen hosts.
That for I need to reconfigure the corresponding switch and network config of 
the host.

This means the s2 database cluster will not be avaible for some time - worst 
case 2 hours.

I will do this tomorrow, Wednesday 19:00 UTC - 21:00 UTC.

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance of LDAP tomorrow

[Marlen Caemmerer]

Hello,

the new LDAP service is ready and will be switched on tomorrow.
This will happen at

Friday (tomorrow), 19:00 UTC - 21:00 UTC

short offline times for services like ssh, mail and web are to be expected.

Cheers
Marlen/nosy

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance s1-user commons

[Marlen Caemmerer]

Hello,

unfortunatelly the commons copy on s1-user got terribly broken so I have to 
resetup this DB.
But I do have another copy of s4 on z-dat-s4-a that I will use for dumping (I 
will have to stop replication in the mean time)

I will do this on 
Friday after 7 pm UTC


which mean commons will not be available on this host until resetup has 
finished.

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: Solaris Updates

[DaB.]

Hello all,
At Saturday 11 May 2013 03:24:05 DaB. wrote:
> I will update the solaris user and web servers as well as the head nodes on

we had problems with the nfs-service and had build up a temporary solution for 
the time the root sleeps. FYI.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: Rebooting ortelius web server

[Platonides]

On 09/05/13 18:57, Tim Landscheidt wrote:
> Marlen Caemmerer  wrote:
> 
>> I would like to reboot ortelius, one of the web servers at
> 
>> tomorrow, Tuesday 1830 UTC
> 
> Apparently, wolfsbane rebooted today as well:
> 
> | timl@wolfsbane:~$ uptime
> |  16:49pm  up   5:00,  2 users,  load average: 1.16, 1.24, 1.47
> | timl@wolfsbane:~$
> 
> Perhaps related to that, SGE queues on ortelius and wolfs-
> bane are in state "au" (alarm, unknown):

Yes, sge_execd seems not to be running on them.

Plus medium and longrun queues in yarrow are in error state. I tried
cleaning them, but they failed again.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: Rebooting ortelius web server

[Tim Landscheidt]

Marlen Caemmerer  wrote:

> I would like to reboot ortelius, one of the web servers at

> tomorrow, Tuesday 1830 UTC

Apparently, wolfsbane rebooted today as well:

| timl@wolfsbane:~$ uptime
|  16:49pm  up   5:00,  2 users,  load average: 1.16, 1.24, 1.47
| timl@wolfsbane:~$

Perhaps related to that, SGE queues on ortelius and wolfs-
bane are in state "au" (alarm, unknown):

| timl@wolfsbane:~$ qstat -f -explain a | sed -ne '1,2p' -e 
'/ortelius\|wolfsbane/,/^-/p'
| queuename  qtype resv/used/tot. load_avg arch  
states
| 
-
| short-sol@ortelius.toolserver. B 0/0/8  -NA- sol-amd64 au
| error: no value for "np_load_short" because execd is in unknown state
| error: no value for "np_load_avg" because execd is in unknown state
| error: no value for "cpu" because execd is in unknown state
| error: no value for "mem_free" because execd is in unknown state
| alarm gf:tmp_free=100G load-threshold=200M
| alarm gf:available=1 load-threshold=0
| 
-
| short-sol@wolfsbane.toolserver B 0/10/12-NA- sol-amd64 au
| error: no value for "np_load_short" because execd is in unknown state
| error: no value for "np_load_avg" because execd is in unknown state
| error: no value for "cpu" because execd is in unknown state
| error: no value for "mem_free" because execd is in unknown state
| alarm gf:tmp_free=100G load-threshold=200M
| alarm gf:available=1 load-threshold=0
| 
-
| medium-sol@ortelius.toolserver B 0/0/4  -NA- sol-amd64 au
| error: no value for "np_load_short" because execd is in unknown state
| error: no value for "np_load_avg" because execd is in unknown state
| error: no value for "np_load_long" because execd is in unknown state
| error: no value for "cpu" because execd is in unknown state
| error: no value for "mem_free" because execd is in unknown state
| alarm gf:tmp_free=100G load-threshold=100M
| alarm gf:available=1 load-threshold=0
| 
-
| medium-sol@wolfsbane.toolserve B 0/3/4  -NA- sol-amd64 au
| error: no value for "np_load_short" because execd is in unknown state
| error: no value for "np_load_avg" because execd is in unknown state
| error: no value for "np_load_long" because execd is in unknown state
| error: no value for "cpu" because execd is in unknown state
| error: no value for "mem_free" because execd is in unknown state
| alarm gf:tmp_free=100G load-threshold=100M
| alarm gf:available=1 load-threshold=0
| 
-
| timl@wolfsbane:~$

Tim


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: Solaris Updates

[Marlen Caemmerer]

Hello,

I will update the solaris user and web servers as well as the head nodes on

Friday, 10th May after 1830 UTC.

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: Rebooting ortelius web server

[Marlen Caemmerer]

Hey,

I would like to reboot ortelius, one of the web servers at

tomorrow, Tuesday 1830 UTC

Cheers
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance of s3, s6 and s4

[Marlen Caemmerer]

Hello,

I will reboot all these instances to have the new IPv6 range used there on

Friday, 3rd May 1900 - 2100 UTC.


It will take  only a few minutes for the instances to come back online.

Cheers
Marlen /nosy

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance cassia s5-rr

[Marlen Caemmerer]

Hello,

I will move dewiki for cassia off the SAN back to the local storage.

This will happen on

Friday, 3rd May 1900-2100 UTC

I will take this copy of s5-rr offline but due to the other copy of s5-rr you 
will probably not experience downtime but slower answers.

Kind regards
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: more disk space for s7

[Marlen Caemmerer]

Hey, sorry wrong date for Wednesday - so its

 24th April 1900-2200 UTC

Kind regards
Marlen/nosy



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: more disk space for s7

[Marlen Caemmerer]

Hello,

I will add more disk space for s7 next Wednesday

23rd April 1900-2200 UTC

I suppose to have completed in 1.5 hours.

Kind regards
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: moving data of s1-user / rosemary

[Marlen Caemmerer]

Hello,

s1-user / rosemary will quite soon run out of space.
Thus I will move everything except enwiki itself onto a SAN partition.

This will happen next Friday

26st Apr 1900 - 2200 UTC

I suppose to have everything back online within one hour in this time frame.
Please not that s1-user will not be available during the move.

Kind regards,
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance for sql-s1-rr, sql-s2 and sql-s5-user

[DaB.]

Hello,

for a kernel-update I hereby announce downtime of sql-s1-rr-a, sql-s2 and sql-
s5-user for tomorrow

FRIDAY, 22:30 UTC.

The downtime of each host will be 20-40min. Not affected will be sql-s5-rr. 
sql-s1-rr will be switched to rosemary so no downtime there too, but sql-s1 
will be slower. See [1] for details.

Sincerely,
DaB.

[1] https://jira.toolserver.org/browse/MNT-1311

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 0x2d3ee2d42b255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: Move of s6

[Marlen Caemmerer]

Hallo,

afais the move was successful. I kept the old data in case something went wrong 
- please check if everything works as expected.

Kind regards
Marlen

On Fri, 7 Dec 2012, Marlen Caemmerer wrote:


Date: Fri, 7 Dec 2012 12:21:58
From: Marlen Caemmerer 
Reply-To: Wikimedia Toolserver 
To: toolserver-l@lists.wikimedia.org
Subject: [Toolserver-l] Maintenance: Move of s6

Hello,

I will move the s6 database instance to a SAN volume on

9th Dec 9pm UTC - 11pm UTC

It is quite well possible that the move vill take an hour or probably more.

Kind regards
Marlen

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette





___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: Move of s6

[Marlen Caemmerer]

Hello,

I will move the s6 database instance to a SAN volume on

9th Dec 9pm UTC - 11pm UTC

It is quite well possible that the move vill take an hour or probably more.

Kind regards
Marlen

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance of wolfsbane and thyme

[Marlen Caemmerer]

Hello,

the service processors of wolfsbane and thyme need to be updated.
They will be shutdown before the update.
This means enwiki-rr and a webserver and the user-store and osm-tiles will not 
be available for 15-30 minutes.
I will do this work starting at

Sun 11th November 20pm UTC until Sun 21pm UTC

Kind regards
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance of a Switch tomorrow

[Platonides]

On 25/10/12 14:59, Marlen Caemmerer wrote:
> Hello,
> 
> tomorrow a switch in one rack will be replaced. This means some downtime
> of about 30 min probably tat will occur between 9 am and 13 am utc.
> Sorry for not having a better time frame but the exact arrival of the
> onsite technician is not know to me.
> 
> Cheers
> nosy

Please send out a notice when it's done. It is planned to open the WLM
survey (and thus start advertising it) tomorrow at 15:00 UTC.
It would be sad that the technician came very late and the maintenance
took place just when lots of users are getting notified to go to the TS
to fill out the survey. :)

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance of a Switch tomorrow

[Marlen Caemmerer]

Hello,

tomorrow a switch in one rack will be replaced. This means some downtime of 
about 30 min probably tat will occur between 9 am and 13 am utc.
Sorry for not having a better time frame but the exact arrival of the onsite 
technician is not know to me.

Cheers
nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance s4-user

[Marlen Caemmerer]

Hello,

I will not get the dump tonight instead DaBPunkt and I will do a more general 
database maintenance when the new copy of s1 has arrived.

Cheers
nosy

On Wed, 24 Oct 2012, Marlen Caemmerer wrote:


Date: Wed, 24 Oct 2012 17:01:09
From: Marlen Caemmerer 
To: Wikimedia Toolserver 
Cc: toolserver-annou...@lists.wikimedia.org
Subject: Maintenance s4-user

Hello,

I will stop the replication on s4-user tonight at 11 PM UTC to get a dump of 
the commons-DB.
This will take probably one or two days. In the meantime please use s2-user 
or s1-user.



Cheers,
nosy




___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance s4-user

[Marlen Caemmerer]

Hello,

I will stop the replication on s4-user tonight at 11 PM UTC to get a dump of 
the commons-DB.
This will take probably one or two days. In the meantime please use s2-user or 
s1-user.


Cheers,
nosy

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance sql-s1-user /rosemary 12th October

[Marlen Caemmerer]

Hello,

I will add more disk space to rosemary / sql-s1-user on

12th October 19:00-22:00 UTC

The user databases for s1 will not be accessible for about two hours.
sql-s1-rr (without user tables) will stay available during the maintenance.

Cheers
nosy

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance sql-user / host adenia 10th October

[Marlen Caemmerer]

Hello,

I will add more disk space to adenia / sql-user on

10th October 19:00-21:00 UTC

The user databases will not be accessible for about one hour.

Cheers
nosy

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance of s2 and s5 Monday, 1st October

[Marlen Caemmerer]

Hello,

the maintenance has been finished successfully.

Cheers
nosy

On Sun, 30 Sep 2012, Marlen Caemmerer wrote:


Date: Sun, 30 Sep 2012 20:36:46
From: Marlen Caemmerer 
To: toolserver-l@lists.wikimedia.org
Cc: toolserver-annou...@lists.wikimedia.org
Subject: Maintenance of s2 and s5 Monday, 1st October 


Hello,


as tomorrow is maintenance window anyway I will add more disk space to s2 and 
s5.

In the time of the work the databases s2 and s5 will not be available.
This will take about 1-1.5 hours and I will do it when DaB checks the hemlock 
& web server interaction

at 20 - 22 UTC.

Cheers
nosy




___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance of s2 and s5 Monday, 1st October

[Marlen Caemmerer]

Hello,


as tomorrow is maintenance window anyway I will add more disk space to s2 and 
s5.
In the time of the work the databases s2 and s5 will not be available.
This will take about 1-1.5 hours and I will do it when DaB checks the hemlock & 
web server interaction
at 20 - 22 UTC.

Cheers
nosy

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance-window for webservers Monday 20:00-22:00 UTC

[DaB.]

Hello all,

like announced on last Sunday I hereby announce a maintenance-window for

Monday, 20:00-22:00 UTC for the web-servers.

I will reboot hemlock a few times to try to find out why the web-servers are 
not working if hemlock is away (and if I find it, I will fix it). All web-tools 
will failing in times when hemlock is (re-)booting, other sub-systems (like 
SGE) should working normal.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance at Thursday, 28.06.2012

[DaB.]

Hello,
At Thursday 28 June 2012 15:47:25 DaB. wrote:
> We 
> will reboot the Solaris-boxes after the updates are done – this INCLUDES 
> willow so please ensure that you have no open files anywhere on the
> cluster.  The reboots will be announced on the server 15mins before they
> happen, so you will have a warning.

the installation of the updates takes longer than we thought and so there will 
be no reboots today. The reboots will happens tomorrow

Friday, between 10:30 and 12:30 UTC.

Sorry for any inconveniences.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance at Thursday, 28.06.2012

[DaB.]

Hello again,
At Thursday 21 June 2012 17:43:03 DaB. wrote:
> at Thursday, 26th June,

28th of course, sorry.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance at Thursday, 28.06.2012

[DaB.]

Hello all,

at Thursday, 26th June, between 11:30 and 16:30 UTC we will have a general
maintenance-window.
The main-reason for the maintenance-window is to install Solaris-updates. We 
will reboot the Solaris-boxes after the updates are done – this INCLUDES 
willow so please ensure that you have no open files anywhere on the cluster. 
The reboots will be announced on the server 15mins before they happen, so you 
will have a warning. In the past some reboot-cron-scripts were not executed 
after a reboot so you should check that when the maintenance-window is over.
Another topic will be the update of JIRA and fisheye, so these services will be 
away for some time during the maintenance-window.

Sincerely,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance on Friday

[Marlen Caemmerer]

Hello,

in parallel to DaBPunkts SGE update maintenance I will do some database host 
maintenance.
hyacinth which holds s3, s4, s6 and s7 will be rebooted and afterwards more 
space will be added to cassia which holds s2 and s5.
I will start my work at 8 pm UTC.


Regards
Marlen/nosy


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance at Wednesday

[DaB.]

Hello again,
At Friday 16 March 2012 13:02:00 DaB. wrote:
> sql-s1-user will be read-only for the next 11h while the user-databases
> are  importing and I sleep.

this morning is was discovered that not all databases were imported. I am now 
importing the missing ones. To not overwrite already new-created data, I do 
import only if there is not already a database with that name. If you need 
only some tables from the old server and have already created the database on 
the new host yourself, please create a ticket in JIRA (TS-queue) and I will 
import them.

Sorry for the trouble, I should have check double at the end.

Sincerley,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance at Wednesday

[DaB.]

Hello all,

todays maintenance is done now.

What worked:
*Moving commons on rosemary to SAN
*Dumping of user-databases on thyme
*Requesting a fresh dump of s1 at the WMF

What not worked:
*SGE-update (we successfully restored the pre-maintenance-version).

What is still running:
*Importing of user-databases on rosemary.

sql-s1-user will be read-only for the next 11h while the user-databases are 
importing and I sleep.

Thanks to Nosy and Merlissimo for the help!

Sincerly,
DaB.


-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance at Wednesday

[DaB.]

Hello all,

at Wednesday, 14th March, between 19:00 and 23:59 UTC we will have a 
maintenance-window.
The most important change is the update of SGE, which will stop all planed and 
running SGE-jobs during the update.
We will also try to use the new SAN-system for the first time and we will move 
the commons-database on rosemary to the SAN (for that we have to stop 
rosemary's MySQL). If this is successfull, I will dump the user-databases on 
thyme (for that I will switch thyme to read-only) and than import them into 
rosemary – as a preparation of the re-import of sql-s1 on thyme when the wmf 
provide us with a fresh dump.
If we have enough time, we will extend the disc-size of z-dat-s4-a, which will 
cause a (short) downtime of sql-s4-user (sql-s4-rr will stay online).
No other userland-software will be updated during the window, but we may 
install solaris-patches for the OS and system-services if we find the time.

Sincerely,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance on web servers

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

Either today or tomorrow I will be reinstalling the two web servers 
(wolfsbane and ortelius).  This should not have any effect on users,
and crontabs will be backed up and restored afterwards.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (SunOS)

iEYEARECAAYFAk37lngACgkQIXd7fCuc5vLK+ACgp1nGvciXLPNgbn5M3R9Zl4As
b4gAn1tJaeFegx7JDO8MGFC1WuuwmYTL
=Azzf
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: JIRA, FishEye: Saturday 30th April

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

Tonight (UTC) we will upgrade JIRA and FishEye to the latest version.  
This will involve around 15 minutes downtime for each service.

Start time: Saturday, 30 April 2011, h UTC
http://time.tcx.org.uk/utc/2011-04-30/00:00

End time: Saturday, 30 April 2011, 0100h UTC
http://time.tcx.org.uk/utc/2011-04-30/01:00

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (SunOS)

iEYEARECAAYFAk2616EACgkQIXd7fCuc5vICXQCfWdhs8DjcqZJ1a2exNODKdB5j
BnIAnjopZFef9aJyWzOdqccRrecRynZ0
=h0Vs
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance tonight: mail service

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

River Tarnell:
> Tonight I will implement the mail forwarding changes described here: 
> .

This is now done.  Please check everything works as you expect, and file 
any problems in JIRA.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (NetBSD)

iEYEARECAAYFAk10MbEACgkQIXd7fCuc5vIS7QCfVmKcARn/NX1yeePVaHWqXtWz
sMMAnjQagfEffogHL0KlK1ui3UtspCCD
=BjHE
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance tonight: mail service

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

Tonight I will implement the mail forwarding changes described here: 
.

There should be no interruption in service, except that mail to 
u...@toolserver.org might be delayed during the maintenance.

Start time: Monday, 7th March h UTC
http://time.tcx.org.uk/utc/2011-03-07/00:00

End time: Monday, 7th Match 0100h UTC
http://time.tcx.org.uk/utc/2011-03-07/01:00

Sorry for the short notice.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (NetBSD)

iEYEARECAAYFAk1z3dgACgkQIXd7fCuc5vJtSwCgiZO5Mu3pMIOJrhcuYUekOHvw
awQAni555uAR0bEORIUV869VqSlS1hT/
=kRiq
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance notice: Tuesday, March 1

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

River Tarnell:
> user-store will be unavailable until then.

user-store is now available again and the maintenance is complete.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (NetBSD)

iEYEARECAAYFAk1ubDIACgkQIXd7fCuc5vJK1wCfX8y/8+sXjfrbEjkCNqgfm07Z
imkAnRD01YyUYt8zUHw80MqAReffJpfp
=2SiZ
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance notice: Tuesday, March 1

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

River Tarnell:
> On the morning (UTC) of March 1 we will install some new hardware at the 
> Toolserver.  Services will be affected as follows:
> 
>  Service | Expected impact
>  +
>  Databases: s3, s4, s6, s7   | User databases unavailable for
>  |  < 10 minutes.
>  user-store filesystem   | Unavailable for < 10 minutes.

This maintenance has been postponed until tomorrow due to the 
unexpectedly long time it took to rack the new hardware.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (NetBSD)

iEYEARECAAYFAk1tMxEACgkQIXd7fCuc5vKXSgCeMehGP8eAxJQfS4y31co4ycBL
j+MAoIFyQkwjwUsWPaN9Og7RP96EMwmW
=Y8B1
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance notice: Tuesday, March 1

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

On the morning (UTC) of March 1 we will install some new hardware at the 
Toolserver.  Services will be affected as follows:

 Service | Expected impact
 +
 Databases: s3, s4, s6, s7   | User databases unavailable for
 |  < 10 minutes.
 user-store filesystem   | Unavailable for < 10 minutes.

Start time: Tuesday, 1st March, 1PM UTC (estimated)
http://time.tcx.org.uk/utc/2011/3/1/13/0

End time: Tuesday, 1st March, 4PM UTC (estimated)
http://time.tcx.org.uk/utc/2011/3/1/16/0

Details:

We will install new storage for databases and the user-store filesystem.  
This requires installing HBAs in three servers: hemlock, cassia, and 
hyacinth, which requires downtime.  We will try to stagger the 
installation of the two database servers so that those clusters 
remaining accessible during the maintenance, but user databases will be 
unavailable while hyacinth is down.

Before the maintenance on hemlock, we will forcibly unmount the 
user-store filesystem.  Any program accessing it at the time will 
receive an I/O error.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (NetBSD)

iEYEARECAAYFAk1ro3AACgkQIXd7fCuc5vLhsQCfbKKphnxKxXCM3VNCJC+YOsz+
E5sAn3EBKJjF1PeU4WZCT5W9KFNuqGqM
=TGse
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance for schema changes, now

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

In article ,
Tim Landscheidt   wrote:
> one obvious solution would be to treat the Toolserver database servers 
> as part of WMF's domain so they can use their SOPs (*1) to maintain 
> them instead of manually coordinating with the Toolserver admins (or 
> not).

I don't think that would be any easier.  Our database systems are 
completely different from theirs, so it would require all WMF admins to 
learn (and remember) a new procedure before they could change anything 
on their side.  Since they usually don't think to notify us of major 
changes in advance, I don't think they would be very happy with that.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (FreeBSD)

iEYEARECAAYFAk1RU9EACgkQIXd7fCuc5vIpCwCgsJoicthjjp4n3xNQxZ6UdKdk
BnAAn0EsQyZWlk11mIJxIZPFQAU/sH7u
=T5Rg
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance for schema changes, now

[Tim Landscheidt]

River Tarnell  wrote:

>> Given WMDE's recent fundraising changes which now allow sup-
>> porting WMF directly, are there any plans to blur the clear
>> distinction between WMF's farm and the Toolserver database
>> servers with the accompanying headaches in the near future?

> Not that I know of.  What sort of changes were you expecting?

I was expecting nothing :-). But as the Toolserver was miss-
ing on WMF's radar in the past several times, one obvious
solution would be to treat the Toolserver database servers
as part of WMF's domain so they can use their SOPs (*1) to
maintain them instead of manually coordinating with the
Toolserver admins (or not).

Tim

(*1)   With a twist for the user databases/access restric-
   tions, of course.


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance for schema changes, now

[River Tarnell]

In article ,
Tim Landscheidt   wrote:
> Given WMDE's recent fundraising changes which now allow sup-
> porting WMF directly, are there any plans to blur the clear
> distinction between WMF's farm and the Toolserver database
> servers with the accompanying headaches in the near future?

Not that I know of.  What sort of changes were you expecting?

- river.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance for schema changes, now

[Tim Landscheidt]

River Tarnell  wrote:

>> > This was not announced in advance since we only learnt about the changes
>> > about 10 minutes ago.  Sorry.
>> Is this something we can do about in the future?

> I've asked WMF (i.e., Tim) to let us know about schema changes in
> advance next time, so we can apply them with less service interruption.

Given WMDE's recent fundraising changes which now allow sup-
porting WMF directly, are there any plans to blur the clear
distinction between WMF's farm and the Toolserver database
servers with the accompanying headaches in the near future?

Tim


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance for schema changes, now

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Bryan Tong Minh:
> On Mon, Feb 7, 2011 at 7:43 AM, River Tarnell  wrote:
> > This was not announced in advance since we only learnt about the changes
> > about 10 minutes ago.  Sorry.
> Is this something we can do about in the future?

I've asked WMF (i.e., Tim) to let us know about schema changes in 
advance next time, so we can apply them with less service interruption.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (FreeBSD)

iEUEARECAAYFAk1QB8QACgkQIXd7fCuc5vKIoACgthUu5p73cQ4RSLoGzOTIEQlc
bO8AmJmM3RBX4bhyNeYBUVyiuG+Jwf0=
=RCsT
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance for schema changes, now

[Bryan Tong Minh]

On Mon, Feb 7, 2011 at 7:43 AM, River Tarnell  wrote:
> This was not announced in advance since we only learnt about the changes
> about 10 minutes ago.  Sorry.
Is this something we can do about in the future? If somebody notices
that WMF is planning schema changes or master switches or cluster
splits should they file a JIRA ticket, or poke you on IRC or
something?


Bryan

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance for schema changes, now

[River Tarnell]

Hi,

We're about to apply necessary schema changes for Wikimedia's MediaWiki
1.17 upgrade to the Toolserver databases.  We will apply the changes to
one server for each cluster at once; while the primary server is being
updated, user databases will be unavailable, but replication won't be
interrupted.

The exception is s2/s5, which currently only has one server.  Databases
on these clusters will not be replicated and might be partially
unavailable during the maintenance.

This was not announced in advance since we only learnt about the changes
about 10 minutes ago.  Sorry.

- river.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance

[River Tarnell]

Hi,

The previous announced maintenance has been completed successfully.  In 
case of problems, open an issue in the TS project in JIRA.

For problems relating to the conversion of nightshade to Solaris (e.g. 
missing software), open an issue in the TS project and include 
"[solaris]" at the start of the subject line.  Due to the disruptive 
nature of this maintenance, such requests will be given priority.  
(However, I'll be away for at least the next 12 hours, so I won't be 
able to resolve them immediately.)

- river.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance on web services

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

Web services (JIRA, FishEye, MediaWiki) are currently offline while we move the 
host machine (amaranth) to a different rack.  This should take less than an 
hour.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyrcBQACgkQIXd7fCuc5vK30QCZAWJK/32cfK8MFQpE93aZl7Vi
fjQAoJdRz7b56f54nXJ6W6LP9pYuloZ8
=HT0O
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance notice for Tuesday, 21st

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

This maintenance has been completed.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyZWOsACgkQIXd7fCuc5vI+aACfXnkEW3MEeZ5P8Z4aK2afpqHV
N90AnAhcnIwIEiI74VUujKrxCo8fh22R
=RH59
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance notice for Tuesday, 21st

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

This is a maintenance notice for today, Tuesday the 21st.

Service   | Expected impact
- --+-
ptolemy: OpenStreetMap| Complete outage for under 10 minutes
  PostgreSQL (sql-mapnik),|
  mod_tile, Tirex,|
  http://toolserver.org/tiles/|
All other services| No impact

Start time: Wednesday, 21st September, 12AM (h) UTC
End time: Wednesday, 21st September, 1AM (0100h) UTC

Details:

We will upgrade the OS on ptolemy, the OSM database and tile server, to Solaris 
10 Update 9.  This will require downtime for a reboot after the upgrade is 
completed.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyYrFYACgkQIXd7fCuc5vLObwCcClnsS0iHGXc5owmXlHNNJuBS
xdAAn2sd2HRT6OnRqIzKHh7s/EQ2GCIG
=J9wf
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: user-store; all database clusters tonight

[Jan Luca]

Much better.

Thank you River!

-Ursprüngliche Nachricht-
Von: toolserver-l-boun...@lists.wikimedia.org
[mailto:toolserver-l-boun...@lists.wikimedia.org] Im Auftrag von River
Tarnell
Gesendet: Samstag, 11. September 2010 17:27
An: Wikimedia Toolserver Announcements
Cc: Wikimedia Toolserver Discussion
Betreff: [Toolserver-l] Maintenance: user-store; all database clusters
tonight

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

(I have the impression that our maintenance notices are not always very
clear, 
since people are sometimes surprised when we carry out previously-announced 
maintenance.  So, here's a new and hopefully improved notification format.)

This is a maintenance notification for tonight (Saturday 11th) UTC. The 
following services will be affected:

Service | Expected impact
- +---
s1 cluster  | User databases unavailable for < 10
minutes
s2 cluster  | Entire cluster unavailable for < 10
minutes
s3 cluster  | User databases unavailable for < 10
minutes
s4 cluster  | User databases unavailable for < 10
minutes
s5 cluster  | Entire cluster unavailable for < 10
minutes
s6 cluster  | User databases unavailable for < 10
minutes
user databases (sql)| Unavailable for < 10 minutes
user-store filesystem   | Unavailable for < 20 minutes
NFS, LDAP, misc services:   | None expected, but at risk during
maintenance.
  SVN, phpMyAdmin, SGE, tsbot,  |
  mail forwarding, DNS, |
  sql-toolserver database   |
All other services  | No impact

Start time: Sunday, 12th September, 12AM UTC
End time:   Sunday, 12th September, 3AM UTC

Details:

Tonight we will complete the upgrade to Solaris 10 Update 9 on the remaining

servers.  This requires under 10 minutes downtime while each system reboots.


Since we will be upgrading the primary server in each cluster, which holds
user 
databases, these will be unavailable during the reboot.  Access to
replicated
databases will not be interrupted, since queries will be directed to the 
alternative server while one is rebooted.

The exception is s2/s5 and sql (user databases), which currently have only
one 
server.  They will therefore be unavailable during the reboot.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyLn7IACgkQIXd7fCuc5vLGIQCeOzuSSxfnVcwKaPz4JU4I15WL
864Ani/mUI0ed+8nfnocP3rVep+P64X6
=GEkv
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: user-store; all database clusters tonight

[Dr. Trigon]

I would agree too, the format looks more verbose! :)

Thanks River!


Am 11.09.2010 20:24, schrieb Krinkle:
> Thanks River,
>
> Though I personally have no problem with your previous announcement
> about the maintenance yesterday, but this table-like notice is much
> beter in my opinion.
>
> --Krinkle
>
> Op 11 sep 2010, om 17:26 heeft River Tarnell het volgende geschreven:
>
>> -BEGIN PGP SIGNED MESSAGE-
>> Hash: SHA1
>>
>> (I have the impression that our maintenance notices are not always
>> very clear,
>> since people are sometimes surprised when we carry out previously-
>> announced
>> maintenance.  So, here's a new and hopefully improved notification
>> format.)
>>
>> This is a maintenance notification for tonight (Saturday 11th) UTC.
>> The
>> following services will be affected:
>>
>> Service  | Expected impact
>> - +---
>> s1 cluster   | User databases unavailable for<  10 minutes
>> s2 cluster   | Entire cluster unavailable for<  10 minutes
>> s3 cluster   | User databases unavailable for<  10 minutes
>> s4 cluster   | User databases unavailable for<  10 minutes
>> s5 cluster   | Entire cluster unavailable for<  10 minutes
>> s6 cluster   | User databases unavailable for<  10 minutes
>> user databases (sql) | Unavailable for<  10 minutes
>> user-store filesystem| Unavailable for<  20 minutes
>> NFS, LDAP, misc services:| None expected, but at risk during
>> maintenance.
>>   SVN, phpMyAdmin, SGE, tsbot,   |
>>   mail forwarding, DNS,  |
>>   sql-toolserver database|
>> All other services   | No impact
>>
>> Start time:  Sunday, 12th September, 12AM UTC
>> End time:Sunday, 12th September, 3AM UTC
>>
>> Details:
>>
>> Tonight we will complete the upgrade to Solaris 10 Update 9 on the
>> remaining
>> servers.  This requires under 10 minutes downtime while each system
>> reboots.
>>
>> Since we will be upgrading the primary server in each cluster, which
>> holds user
>> databases, these will be unavailable during the reboot.  Access to
>> replicated
>> databases will not be interrupted, since queries will be directed to
>> the
>> alternative server while one is rebooted.
>>
>> The exception is s2/s5 and sql (user databases), which currently
>> have only one
>> server.  They will therefore be unavailable during the reboot.
>>
>>  - river.
>> -BEGIN PGP SIGNATURE-
>> Version: GnuPG v2.0.16 (FreeBSD)
>>
>> iEYEARECAAYFAkyLn7IACgkQIXd7fCuc5vLGIQCeOzuSSxfnVcwKaPz4JU4I15WL
>> 864Ani/mUI0ed+8nfnocP3rVep+P64X6
>> =GEkv
>> -END PGP SIGNATURE-
>>
>> ___
>> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
>> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
>> Posting guidelines for this list: 
>> https://wiki.toolserver.org/view/Mailing_list_etiquette
>
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list: 
> https://wiki.toolserver.org/view/Mailing_list_etiquette
>


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: user-store; all database clusters tonight

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

This maintenance has been completed successfully.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyMJlcACgkQIXd7fCuc5vJGBwCfVuuSE6jB8j8Gr7yq9mmotmzY
PTIAoJyWfKH9JAjoRqY5bNN8D+XO7l4P
=3KmV
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance: user-store; all database clusters tonight

[Krinkle]

Thanks River,

Though I personally have no problem with your previous announcement  
about the maintenance yesterday, but this table-like notice is much  
beter in my opinion.

--Krinkle

Op 11 sep 2010, om 17:26 heeft River Tarnell het volgende geschreven:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> (I have the impression that our maintenance notices are not always  
> very clear,
> since people are sometimes surprised when we carry out previously- 
> announced
> maintenance.  So, here's a new and hopefully improved notification  
> format.)
>
> This is a maintenance notification for tonight (Saturday 11th) UTC.  
> The
> following services will be affected:
>
> Service   | Expected impact
> - +---
> s1 cluster| User databases unavailable for < 10 minutes
> s2 cluster| Entire cluster unavailable for < 10 minutes
> s3 cluster| User databases unavailable for < 10 minutes
> s4 cluster| User databases unavailable for < 10 minutes
> s5 cluster| Entire cluster unavailable for < 10 minutes
> s6 cluster| User databases unavailable for < 10 minutes
> user databases (sql)  | Unavailable for < 10 minutes
> user-store filesystem | Unavailable for < 20 minutes
> NFS, LDAP, misc services: | None expected, but at risk during  
> maintenance.
>  SVN, phpMyAdmin, SGE, tsbot, |
>  mail forwarding, DNS,|
>  sql-toolserver database  |
> All other services| No impact
>
> Start time:   Sunday, 12th September, 12AM UTC
> End time: Sunday, 12th September, 3AM UTC
>
> Details:
>
> Tonight we will complete the upgrade to Solaris 10 Update 9 on the  
> remaining
> servers.  This requires under 10 minutes downtime while each system  
> reboots.
>
> Since we will be upgrading the primary server in each cluster, which  
> holds user
> databases, these will be unavailable during the reboot.  Access to  
> replicated
> databases will not be interrupted, since queries will be directed to  
> the
> alternative server while one is rebooted.
>
> The exception is s2/s5 and sql (user databases), which currently  
> have only one
> server.  They will therefore be unavailable during the reboot.
>
>   - river.
> -BEGIN PGP SIGNATURE-
> Version: GnuPG v2.0.16 (FreeBSD)
>
> iEYEARECAAYFAkyLn7IACgkQIXd7fCuc5vLGIQCeOzuSSxfnVcwKaPz4JU4I15WL
> 864Ani/mUI0ed+8nfnocP3rVep+P64X6
> =GEkv
> -END PGP SIGNATURE-
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list: 
> https://wiki.toolserver.org/view/Mailing_list_etiquette


___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance: user-store; all database clusters tonight

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

(I have the impression that our maintenance notices are not always very clear, 
since people are sometimes surprised when we carry out previously-announced 
maintenance.  So, here's a new and hopefully improved notification format.)

This is a maintenance notification for tonight (Saturday 11th) UTC. The 
following services will be affected:

Service | Expected impact
- +---
s1 cluster  | User databases unavailable for < 10 minutes
s2 cluster  | Entire cluster unavailable for < 10 minutes
s3 cluster  | User databases unavailable for < 10 minutes
s4 cluster  | User databases unavailable for < 10 minutes
s5 cluster  | Entire cluster unavailable for < 10 minutes
s6 cluster  | User databases unavailable for < 10 minutes
user databases (sql)| Unavailable for < 10 minutes
user-store filesystem   | Unavailable for < 20 minutes
NFS, LDAP, misc services:   | None expected, but at risk during maintenance.
  SVN, phpMyAdmin, SGE, tsbot,  |
  mail forwarding, DNS, |
  sql-toolserver database   |
All other services  | No impact

Start time: Sunday, 12th September, 12AM UTC
End time:   Sunday, 12th September, 3AM UTC

Details:

Tonight we will complete the upgrade to Solaris 10 Update 9 on the remaining 
servers.  This requires under 10 minutes downtime while each system reboots.  

Since we will be upgrading the primary server in each cluster, which holds user 
databases, these will be unavailable during the reboot.  Access to replicated
databases will not be interrupted, since queries will be directed to the 
alternative server while one is rebooted.

The exception is s2/s5 and sql (user databases), which currently have only one 
server.  They will therefore be unavailable during the reboot.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyLn7IACgkQIXd7fCuc5vLGIQCeOzuSSxfnVcwKaPz4JU4I15WL
864Ani/mUI0ed+8nfnocP3rVep+P64X6
=GEkv
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance on hyacinth (s3/s4/s6); login/web servers

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

This maintenance was completely successfully.  There was about 5 minutes 
downtime of the web server due to a software issue (which is now fixed).

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyK+xsACgkQIXd7fCuc5vIhjgCeJmEtYonZiMVl8w6hKOCBFvDs
BxMAn2JW8N/3LW0qT68vr7xHC/p/LOZ4
=8KWh
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance on hyacinth (s3/s4/s6); login/web servers

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

Slight change to this maintenance: we will first test the Solaris upgrade on 
rosemary, one of the s1 database servers, before upgrading willow.  This will 
push back the upgrade by about an hour, but will not impact users.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyKYJoACgkQIXd7fCuc5vJxlQCcCPQj7taAbe7sp0uO5asax2gW
o1MAn3O5/M/1E8NRLyo1NtS4qWSWC2tC
=s0gm
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance on hyacinth (s3/s4/s6); login/web servers

[Martijn Klijnstra]

No you don't. Why so sarcastic?

"Andrew Steinborn"  wrote:

>  On 9/10/2010 11:43 AM, River Tarnell wrote:
>> Andrew Steinborn:
>Yeah, I'm getting it.
>
>___
>Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
>https://lists.wikimedia.org/mailman/listinfo/toolserver-l
>Posting guidelines for this list: 
>https://wiki.toolserver.org/view/Mailing_list_etiquette

-- 
Sent from my Android phone with K-9 Mail. Please excuse my brevity.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance on hyacinth (s3/s4/s6); login/web servers

[Andrew Steinborn]

  On 9/10/2010 11:43 AM, River Tarnell wrote:
> Andrew Steinborn:
Yeah, I'm getting it.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance on hyacinth (s3/s4/s6); login/web servers

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Andrew Steinborn:
> Nice. Downtime for my bots.

Yes, there will be under 10 minutes' downtime while the system reboots after 
the upgrade.  This is unavoidable; the only other option is that we would 
never, ever upgrade the OS or even reboot the server, which seems like a 
clearly inferior option.

By the way:

willow% uptime
  3:42pm  up 249 day(s),  9:06,  6 users,  load average: 4.84, 4.71, 4.63

One reboot every 250 days doesn't seem like a imposition worthy of sarcastic 
comments...

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyKUhMACgkQIXd7fCuc5vIkNwCePz2J1901NyrePkz5jk5uNY2P
6VQAn31HwN+ZCWPylHpWO1kktQO/PX2V
=W7KZ
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] Maintenance on hyacinth (s3/s4/s6); login/web servers

[Andrew Steinborn]

  On 9/10/2010 11:35 AM, River Tarnell wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Hi,
>
> Later tonight we will upgrade the OS on hyacinth (s3/s4/s6 server).  This will
> involve ~30 minutes downtime, but should have no impact on users.
>
> We will also upgrade the OS on willow at the same time, which should require
> <10 minutes downtime.  If there are no problems with that upgrade, we will 
> also
> upgrade the web servers (wolfsbane&  ortelius); but the cluster software makes
> this upgrade more intricate, so it may not be completed tonight.  That will
> have no impact on users, since web requests will be served by the other server
> while one is being upgraded.
>
> This maintenance will take place around 12AM UTC on Saturday (11th).
>
>   - river.
> -BEGIN PGP SIGNATURE-
> Version: GnuPG v2.0.16 (FreeBSD)
>
> iEYEARECAAYFAkyKUDkACgkQIXd7fCuc5vIJ3QCfWbdwQ+I/pzof66ffUZwklkwa
> SUYAoLyp7quTM0LCLlTw9vqIQLyhwTnI
> =/o9r
> -END PGP SIGNATURE-
>
> ___
> Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list: 
> https://wiki.toolserver.org/view/Mailing_list_etiquette
Nice. Downtime for my bots.

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance on hyacinth (s3/s4/s6); login/web servers

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

Later tonight we will upgrade the OS on hyacinth (s3/s4/s6 server).  This will 
involve ~30 minutes downtime, but should have no impact on users.

We will also upgrade the OS on willow at the same time, which should require
<10 minutes downtime.  If there are no problems with that upgrade, we will also
upgrade the web servers (wolfsbane & ortelius); but the cluster software makes 
this upgrade more intricate, so it may not be completed tonight.  That will 
have no impact on users, since web requests will be served by the other server 
while one is being upgraded.

This maintenance will take place around 12AM UTC on Saturday (11th).

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkyKUDkACgkQIXd7fCuc5vIJ3QCfWbdwQ+I/pzof66ffUZwklkwa
SUYAoLyp7quTM0LCLlTw9vqIQLyhwTnI
=/o9r
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance on hyacinth

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

I am about to remove hyacinth (sql-s[346]-fast) from rotation for some internal 
testing.  It will return to service in the testing configuration in a day or 
two.

In the mean time, cassia (the non-fast server) will continue to serve these 
clusters, but there will be no redundancy in case of failure.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.15 (FreeBSD)

iEYEARECAAYFAkxFj5IACgkQIXd7fCuc5vLWtQCgi5ZiDRYTCPWqsl286rujvRCX
jesAn2TKWnlxucp0OZt4Xbt4VGomXNke
=9zLT
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance on user databases, now

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

I am about to move user databases (sql) from zedler to adenia.  This
will involve a few hours read-ony time while the data is copied.

Sorry for the short notice for this maintenance.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (HP-UX)

iEYEARECAAYFAkviE7EACgkQIXd7fCuc5vL0XACfQL14ccrxavqft8WFBPk+d3GV
08IAn12eeuL8bTRtkflRxX+K5HZSDQWC
=tFCr
-END PGP SIGNATURE-

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance later today on amaranth

[River Tarnell]

Hi,

amaranth will be rebooted later today to upgrade its operating system.  This 
will result in about 5 minutes downtime of the web applications (JIRA, wiki, 
etc).

 - river.


smime.p7s
Description: S/MIME Cryptographic Signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

[Toolserver-l] Maintenance, Monday 4th

[River Tarnell]

Hi,

In addition to the previously announced maintenance, we will perform the 
following additional maintenance on Monday, 4th January depending on whether 
there is enough time:

* willow will be upgraded to Solaris 10 Update 8.  (Downtime: 5 minutes)
* We will add some patches to the NFS/LDAP cluster.  (Downtime: about 15 
  seconds)

  - river


smime.p7s
Description: S/MIME Cryptographic Signature
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] maintenance 28th to 31st Dec: all servers

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

> Wikimedia will performance maintenance at the knams hosting facility, where
> the Toolserver is hosted. [...] the total outage period will be several
> hours.

this maintenance will be taking place on the 28th, i.e. today.

- river.
-BEGIN PGP SIGNATURE-

iD4DBQFJVt5hIXd7fCuc5vIRAme+AJUaRg2PWQcjV6VExzCDjRUmm4ahAJ0a2Hxp
6fJQ85pkLqeRME8jkk4PAQ==
=caaY
-END PGP SIGNATURE-

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l

[Toolserver-l] maintenance 28th to 31st Dec: all servers

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

at some point between these two dates (exact date isn't yet known), Wikimedia
will performance maintenance at the knams hosting facility, where the
Toolserver is hosted.  this will involve downtime for all servers as we will be
moving to a new rack.

i will combine this maintenance with the next Toolserver quarterly maintenance,
which was previously scheduled for January 5th.

the total outage period will be several hours.

- river.
-BEGIN PGP SIGNATURE-

iD8DBQFJS08dIXd7fCuc5vIRAiVUAKCEKhl4a/K1J0gyoRHoZbocgtfGqgCeP4L5
P5rCTBWgi6D0nU4m7aWglE8=
=dsYJ
-END PGP SIGNATURE-

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l

[Toolserver-l] maintenance Monday October 6th: willow (stable), zedler, yarrow, vandale

[River Tarnell]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

hi,

maintenance will be done on the above servers on Monday, 6th October between
5-7AM UTC.  each server will be unavailable for the duration of the
maintenance, which should be less than one hour in total.

- river.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.8 (SunOS)

iEYEARECAAYFAkji4BMACgkQIXd7fCuc5vJiqACeLlLm0+MQ2xs5jvVt1I0u3CS/
TfIAn1bQol7tcDyRZOnNvYt3SflFr4wU
=oN6Z
-END PGP SIGNATURE-

___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l

[Toolserver-l] maintenance at knams Tuesday morning

[River Tarnell]

hello,

there will be network maintenance at knams on Tuesday morning (UTC).
connectivity to the toolserver will probably be sporadic during this time.

- river.



signature.asc
Description: OpenPGP digital signature
___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
http://lists.wikimedia.org/mailman/listinfo/toolserver-l

Re: [Toolserver-l] maintenance notice: user databases

[River Tarnell]

River Tarnell:
> user databases will become read only tonight UTC while they are migrated to
> a different server.

this is now finished.

- river.


pgpTU6u4h0I75.pgp
Description: PGP signature
___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
http://lists.wikimedia.org/mailman/listinfo/toolserver-l

[Toolserver-l] maintenance notice: user databases

[River Tarnell]

hello,

user databases will become read only tonight UTC while they are migrated to a 
different server.

- river.


pgp7jtGtcpRqQ.pgp
Description: PGP signature
___
Toolserver-l mailing list
Toolserver-l@lists.wikimedia.org
http://lists.wikimedia.org/mailman/listinfo/toolserver-l