Re: [Wikitech-l] mediawiki maintenance scripts have moved
On Tue, Sep 15, 2015 at 10:21 PM, Florian Schmidt < florian.schmidt.wel...@t-online.de> wrote: > Maybe you can put "puppet" or something else into the title of the e-mail > next time, to make the scope of the e-mail clear? :P Oh, i will do that next time. Sorry about that. From my point of view Mediawiki maintenance scripts always meant the scripts and cron jobs in puppet because that's what ops deals with. It's kind of the same name for different things. -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] mediawiki maintenance scripts have moved
Mediawiki maintenance scripts have moved. The old "misc/maintenance.pp" that had all cronjobs and scripts in one huge file is gone. Now you find all the maintenance scripts in separate files, one per job, and inside the mediawiki module. So if you look for anything please see ./puppet/modules/mediawiki/manifests/maintenance now. Each job has its own .pp file now, which should make it easier to use and changes easier to review. It also got rid of another large file in the manifests/misc/ structure which we want to remove entirely and contains it with other mediawiki setup. refs: https://gerrit.wikimedia.org/r/#/c/178873/ https://phabricator.wikimedia.org/T88597 http://puppet-compiler.wmflabs.org/891/terbium.eqiad.wmnet/ -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] mailman upgrade next week - Sep 9th 1400 UTC
There will be another scheduled maintenance window for this upgrade at: Friday, September 18, 2015 at 2:00:00 PM UTC (Friday, September 18, 2015 at 7:00:00 AM PDT) for 3 hour mails to lists will not be delivered and i will follow-up once this is over. Thank you, ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] mailman upgrade next week - Sep 9th 1400 UTC
re: mailman upgrade Unfortunately not all things worked as planned during today's migration attempt. Some rsync/import scripts took longer than anticipated. We were trying to do it in 2 steps; one rsync from server to server and another local one in an import script. The tests we had run focused on the server-server transfer. To speed things up we stopped the ongoing local rsync to replace it with an "mv". Due to human error and a trailing slash in a script, things were moved around the wrong way. While trying to fix this we eventually ran out of time to stay within the scheduled window so we reverted to sodium. For right now everything is as it was before. Sorry for that, will try again, likely next week. Will follow-up with a new date and better strategy for copying. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] mailman upgrade next week - Sep 9th 1400 UTC
Hi, We have scheduled an upgrade of mailman (https://lists.wikimedia.org) for: Wednesday, September 9, 2015 at 2:00:00 PM UTC ( 7:00 AM PDT, 16:00 CEST) The scheduled mainteance window is 4 hours (or less). During this time please expect all the mailing lists (web interface and email) to be down. We will shut down the old server, then sync all pending mail to the new server and bring it back up there. The upgrade includes mailman from 2.1.13 to 2.1.18 and the server OS will become a Debian jessie server and will be virtualized. More things we expect to be fixed by this (excerpts): "DMARC improvements solve issues users have with Yahoo and Outlook regarding mail." "Password reminder link is now on the roster page (private archives)." "Emails can be automatically accepted to private lists if a poster password is used" "Cookies now set the secure flag when over HTTPS" "Emails are validated more accurately. Spam prevention." "Sessions can be invalidated through logouts on administrator and moderation interfaces." refs: https://wikitech.wikimedia.org/wiki/Mailman , https://phabricator.wikimedia.org/T105756 , Will follow-up with another mail once it's done. -- Daniel Zahn <dz...@wikimedia.org> Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] sshd config: using newer ciphers and protocols
[x-post from labs-l to make sure all ssh users receive it] Hi all, recently we have been making some changes to global sshd config for enhanced security. Since there have been questions and user reports about this on IRC, let me list them all in detail: a) optimized symmetric cipher list: https://gerrit.wikimedia.org/r/#/c/185325/ We prefer the better Chacha20-poly1305,AES-CGM ciphers here now where possible. This has been merged on 04-27 already and the only problem report we had was from a user of a really outdated putty version and that could be solved by upgrading. b) set Message Authentication Code ciphers https://gerrit.wikimedia.org/r/#/c/185329/ (see commit message for more details) We stop using MD5 or SHA1 because they are insecure and use Encrypt-then-MAC. This has been merged today and we have had 1 report on IRC so far from a user who got no matching MAC found but apparently was able to fix it by adjusting the client config. c) don't use NIST key exchange protocols https://gerrit.wikimedia.org/r/#/c/185321/(see commit message for more details) This has also been merged today. We stopped using NIST protocols here because they can't be trusted, see commit message for details why. We have had 2 users so far report on IRC getting a no acceptable hex algorithm error. Both were users of MySQL workbench. There is a related bug at https://bugs.mysql.com/bug.php?id=74658 About the reasoning for these 3 changes in detail, also see: http://stribika.github.io/2015/01/04/secure-secure-shell.html. Many quotes on the commit messages are from that source. d) disable root logins, disable agent forwarding https://gerrit.wikimedia.org/r/#/c/160628/ https://gerrit.wikimedia.org/r/#/c/199936/ These both exist in code review but are _NOT_ merged and are still being discussed. There is no immediate plan to merge them soon. Finding the right balance between security and supporting older clients can sometimes be tough, so sorry for any possible inconvience caused and let us know if any other issues that can't be solved by upgrading clients. Best regards, Daniel -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] retiring service: contacts.wikimedia.org
Hello, The service: https://contacts.wikimedia.org/ used to be a CiviCRM [1] (but _not_ the fundraising CiviCRM@) formerly used for donor contacts. It was an old ersion, running on a really outdated version of Drupal [2], and I have asked around and couldn't find any active users of it. Former users are either with the WikiEdu Foundation now or switched to Asana. [3] So i disabled the service but did not delete it yet for a grace period. This is the formal notification about retiring service. If you are an (unexpected) user of it or think you want a dump file, please speak up soon via the bug [4] or contact me. [5] Thank you, [1] https://en.wikipedia.org/wiki/CiviCRM [2] https://en.wikipedia.org/wiki/Drupal [3] https://phabricator.wikimedia.org/T90679#1102380 [4] https://phabricator.wikimedia.org/T90679 [5] https://phabricator.wikimedia.org/p/Dzahn/ -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Phabricator update
On Thu, Sep 18, 2014 at 1:47 AM, Christopher Johnson
christopher.john...@wikimedia.de wrote:
What would it take to get this into the test instance https://phab
-01.wmflabs.org/ ? Is this labs test puppet cloning a development repo?
It uses git::install within puppet.
so for example: git::install { 'phabricator/phabricator':
git::install itself is in modules/git
modules/git/manifests/install.pp:# git::install { 'project/name/on/gerrit':
so it clones from our gerrit installation at
https://gerrit.wikimedia.org/r/#/q/project:phabricator/phabricator,n,z
so what would it take:
- new project/repo created on gerrit
- import code into that repo
- add puppet code that uses git:install to clone from it, copied
from how it does it for the other existing repos
Also, how will core and library code changes to phabricator be deployed to
the production instance?
puppet will make it exec {git_update... .. command = '/usr/bin/git
remote update',
from our gerrit repo. i'm not 100% sure about the sync between
upstream and our gerrit repo, but Chase would know
Where shall we put this phabricator-sprint code so that we can work on it
with the intention of having it reviewed and deployed in production as soon
as possible?
probably into modules/phabricator in repo operations/puppet and
suggest it as a change by uploading into gerrit.
first you could just modify the role::phabricator::labs and after
testing it would be addedi to role::phabricator::main
Chase, correct me if i'm wrong
--
Daniel Zahn dz...@wikimedia.org
Operations Engineer
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Phabricator update
* We have a test instance at https://phab-01.wmflabs.org/ where you can play as much as you want. This instance is the puppetized test instance running on the labs puppet master. It is supposed to be as much like production as possible to allow actual testing before making changes in prod. Changes here should be made by uploading puppet changes to the role::phabricator::labs. I would not recommend playing manually with it or soon it will have manual hacks that need to be synced with prod again. It's easy though to spin up phab-02 and how many we like (and there already existed phabricator-test project) where alpha testing can be done manually. you can simply fire up any number of new instances and apply the role, we added it to the wikitech puppet groups list you get when configuring an instance. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Abandoning -1 code reviews automatically?
Please don't do this for operations/puppet. We've had patches sitting there for way longer than this that still got improved and merged eventually. On Thu, Apr 10, 2014 at 1:26 AM, Christian Aistleitner christ...@quelltextlich.at wrote: Hi, On Wed, Apr 09, 2014 at 09:19:59AM -0700, Chad wrote: No. I've thought the OpenStack policy is rude to contributors. Me too. I'd also prefer we do not automatically abandon changes. Best regards, Christian -- quelltextlich e.U. \\ Christian Aistleitner Companies' registry: 360296y in Linz Christian Aistleitner Gruendbergstrasze 65aEmail: christ...@quelltextlich.at 4040 Linz, Austria Phone: +43 732 / 26 95 63 Fax:+43 732 / 26 95 63 Homepage: http://quelltextlich.at/ --- ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [Engineering] Update on HHVM
This sounds all exiciting but let me remind you that if we want to get out of Tampa we need to move the current _Apache_ deployment. Sync scripts,-gracefull all etc away from fenari to something in eqiad. Is there anyone working on this? Just making sure that we don't fall into the usual trap - everybody wants to build new stuff - nobody wants to migrate old boring stuff. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Review request for patches on database maintenance (Fwd: Re: GSoC Proposal : Simultaneous Modification of Multiple Pages with Semantic Forms)
On Thu, Mar 13, 2014 at 12:35 PM, Stephan Gambke s7ep...@gmail.com wrote: Could a core developer with a database background please have a look at Pawan's patches: Added Sean Pringle, our DBA, can't guarantee you he has the time for it though. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Bugzilla Weekly Report
On Sun, Feb 16, 2014 at 7:23 PM, Alex Monk kren...@gmail.com wrote: Filed as https://bugzilla.wikimedia.org/show_bug.cgi?id=61453 On 17 February 2014 03:00, reporter repor...@kaulen.wikimedia.org wrote: MediaWiki Bugzilla Report for February 10, 2014 - February 17, 2014 Wikimedia Bugzilla report (FAILED), DB connection failure FAILED sorry, fixed: see here for the missed report i sent manually now: http://lists.wikimedia.org/pipermail/wikitech-l/2014-February/074555.html see Bug for details -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Non-Violent Communication
summary: don't reply in a hurry or when you're pissed. Try not to piss off others and don't assume they just mean bad. Don't waste time. Stay on topic. Humans are still humans. Be nice. Try to do better tomorrow. Kthx. News? ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Non-Violent Communication
and yes I see the paradox that I also just wrote that in a hurry and was a little frustrated because it honestly seemed to me like those things weren't new. But that doesn't mean they shouldn't be discussed. I'm just personally like: 'would rather do technical stuff.. too busy..'.. finding a balance between hostile environment and an overly regulated one without any kind of snark seems appropriate to me. On Feb 18, 2014 9:38 AM, Daniel Zahn dz...@wikimedia.org wrote: summary: don't reply in a hurry or when you're pissed. Try not to piss off others and don't assume they just mean bad. Don't waste time. Stay on topic. Humans are still humans. Be nice. Try to do better tomorrow. Kthx. News? ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Wikimedia Bugzilla upgraded to 4.4.1
On Thu, Feb 13, 2014 at 12:21 AM, Petr Bena benap...@gmail.com wrote: Right now I see just bugzilla is down :/ can't confirm. it was just down during the scheduled maintenance. we used almost the maxium time but stayed in the announced window right after the switch people on IRC were happily using it again and it's being used all this time, as can be seen on IRC the TTL had also been lowered to 5 minutes for minimal downtime also, the message is down was never shown anywhere, there was a banner about it being in maintenance mode, so i'm unclear where you saw that and how -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Wikimedia Bugzilla upgraded to 4.4.1
On Thu, Feb 13, 2014 at 6:36 AM, Petr Bena benap...@gmail.com wrote: Yes now it's up here as well, maybe DNS? I am from EU... Ok, thanks for confirming. Maybe yea, even though I tried to keep that minimal by reducing TTL to 5 minutes over an hour before the switch and setting it back to 1H while after it. That said, not all DNS servers listen to that .. or browser cache. btw, this wasn't just the Bugzilla version, we also switched away from Tampa, to a new server _and_ new database backend. So you are being served from zirconium now in eqiad, using db1001 instead of db 9 ad a Tampa downtime doesnt affect it anymore. also it's using the puppet module now at https://doc.wikimedia.org/puppet/classes/bugzilla.html as opposed to the old misc/bugzilla.pp file ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Bingle/Bugello broken post-Bugzilla upgrade
Arthur, i think i know the issue here. zirconium is indeed a shared host, so it runs several misc. web services using https on a single IP, so we rely on clients speaking SNI to get the correct virtual host. java 6 and IE on XP are among the few clients who don't. I think your applications are java and don't speak SNI, so they are getting the first virtual host, which is planet. this can be fixed by either: use Java 7 which should support SNI .. see f.e. http://stackoverflow.com/questions/12361090/server-name-indication-sni-on-java quote on Java 7 use new URL(https://cmbntr.sni.velox.ch/;).openStream() until HTTPCLIENT-1119 is fixed or i can cheat by changing the order Apache loads the site configs, f.e. i could make it sites-enabled/001-Bugzilla , ./002-Planet etc. Then those clients who don't speak SNI get Bugzilla (but the Planet users don't get their planet, but Bugzilla seems more important. or we would have to get an extra IP address just for Bugzilla ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Bingle/Bugello broken post-Bugzilla upgrade
Either way it's probable not bad to change the order of loading Apache sites to make Bugzilla the default now. If somebody doesn't get what they want, at least they get the Bugtracker ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Let's improve our password policy
On Tue, Feb 4, 2014 at 1:33 AM, Petr Bena benap...@gmail.com wrote: Now just remember that password. I think that issue has been solved quite a while ago, you don't remember passwords, you keep them in password stores. you may have a master password to remember but you don't have the same on all services and you don't remember the individual ones, you copy/paste, so i don't care at all how long it is -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Bingle/Bugello broken post-Bugzilla upgrade
On Thu, Feb 13, 2014 at 1:13 PM, Arthur Richards aricha...@wikimedia.orgwrote: things Just Work but changing the load order of the Apache sites sounds like a smart thing to do regardless. Do we need an RT ticket for that? should be fixed by this: https://gerrit.wikimedia.org/r/#/c/113265/1 try again ? -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] wikitech/labs outage
Hi all, we had an outage of Wikitech and Labsconsole / Labs. Apache on virt0 was broken. It was reported by S Page on IRC, the symptons were wikitech and labsconsole being down via HTTP(S) but pingable. We also had Icinga monitoring telling us about it. I went to virt0 and saw Apache running, shortly after restarted it and that fixed the issue. The root cause i found to be a bug in Phusion Passenger module that is used on virt0, as opposed to cluster Apache. from /usr/lib/phusion_passenger/passenger-spawn-server:61 *** Exception Errno::EPIPE in Passenger RequestHandler (Broken pipe) (process 23592): I made a copy of the full log and for now it is on virt0 in /root/apache2_error_log_20131219.log if you would like to see it all. So far i just blame https://www.phusionpassenger.com/ respectively libapache2-mod-passenger and didn't take any further action. I did tell the labs IRC channel but did not post on labs-l. Daniel -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [Engineering] Deployment highlights - week of November 25th
If you're bored about no changes. mw1.22.0rc3 has been uploaded to dumps today. On Nov 22, 2013 2:21 PM, Tomasz Finc tf...@wikimedia.org wrote: On Fri, Nov 22, 2013 at 2:07 PM, Greg Grossmeier g...@wikimedia.org wrote: Next week there will be no planned deployments as it is Thanksgiving in the US. All hail the lack of change and status quo. --tomasz ___ Engineering mailing list engineer...@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/engineering ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Redirects from Commons to wikimediafoundation
Hi, here's a more detailed report: As part of an ongoing effort to simplify, cleanup and reduce code lines of the Apache cluster config, we we're planning to unify a lot of document roots for the www-portals into a single docroot, like here: https://gerrit.wikimedia.org/r/#/c/90669/ looking at that we saw that the www.wikimedia.org portal wasn't handled by this, unlike the other portals, so to further unify this we merged: https://gerrit.wikimedia.org/r/#/c/91195/ which just moved the existing config for www.wikimedia.org to the wwwportals.conf file. But because this had an old ServerAlias *.wikimedia.org in it, which now changed in the order Apache goes through the config, it caused *.wikimedia.org URLs to redirect to wikimediafoundation.org .. ServerAlias *.wikimedia.org .. RewriteRule ^/wiki/(.*)$ http://wikimediafoundation.org/wiki/$1 [R=301,L] We reverted both of the recent changes after just a few minutes and synced Apache config and restarted them. Users still reported problems though due to caching. So we started some Squid purging and Mark banned php content-type in varnish. Additionally it turned out several Apaches didn't get restarted properly by apache-graceful-all, and using apache-fast-test with the pybal option we found some more that needed manual restarts a little while later. For futher fixes Brandon banned by object size: did bblack !log varnish: banned 'obj.http.content-length == 33518' on text varnishes everywhere (extract2.php leakage). .. Reedy already prepared new patches to fix the root cause ..and apache-fast-test should check eqiad now instead of Tampa: https://gerrit.wikimedia.org/r/#/c/91270/ Sorry for breakage! Thank you for help! -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] retired services / Tampa cleanup
Hi, as part of our ongoing efforts to remove all unused, non-cluster remnants services from Tampa, all of the following services have been permanently retired. (This means removed from DNS, backup docroots and configs, then nuked. Almost all of them had been temp. disabled in the past so it's not like they were reachable for the public until yesterday) -- former websites on singer. (Tampa misc host for off-cluster sites) -- communicate.wikimedia.org outreachcivi.wikimedia.org ocs.wikimania2009.wikimedia.org url.wikimedia.org wm08reg.wikimedia.org wm09schols.wikimedia.org wm10schols.wikimedia.org -- pre-labs things -- prototype.wikimedia.org en.prototype.wikimedia.org de.prototype.wikimedia.org tesla.usability.wikimedia.org tesla.wikimedia.org -- misc-- internproxy.wikimedia.org volunteer.wikimedia.org (this was already commented out in the past) survery.wikimedia.org argon.wikimedia.org wikitech-old.wikimedia.org (we got rid of the Linode instance) -- kept for backwards compatibiliy -- voip.wikimedia.org(but if your client uses that, please update to voip.corp.wikimedia.org) -- kept for historic reasons -- long live .. coffee.wikimedia.org :) -- backed up docroots from singer on tridge -- blog.tar.gzbugzilla.tar.gz outreachcivi.tar.gz svn_blog.tar.gz techblog.tar.gz wm09schols_info.txt.gz wm10reg.tar.gz bugzilla.older.tar.gz bzapi.tar.gz survey.tar.gz svn_techblog.tar.gz wikimania2009.tar.gz wm09schols.tar.gz wm10schols.tar.gz .. and more -- about to be moved -- contacts.wikimedia.org racktables.wikimedia.org -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] retired services / Tampa cleanup
as of right now singer just has 2 services left: contacts.wikimedia.org (going to rsync over to magnesium) RT-5018 (and it has been upgraded thanks to Jeff) and secure.wikimedia.org -- here's my attempt to move to (Apache) cluster: https://gerrit.wikimedia.org/r/#/c/60934/ everything else has been backed up and nuked or isn't needed anymore (/home/, /opt/, /root, /srv, ...) also all other occurences of singer in DNS have been removed ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] RFC: Alternative domains for Commons
fyi, we have all these:
DNS:
root@sockpuppet:~/pdns-templates# ls -l | grep commons
lrwxrwxrwx 1 root root 13 Jun 7 2012 wikimediacommons.co.uk -
wikimedia.com
lrwxrwxrwx 1 root root 13 Jun 7 2012 wikimediacommons.eu - wikimedia.com
lrwxrwxrwx 1 root root 13 Jun 7 2012 wikimediacommons.info -
wikimedia.com
lrwxrwxrwx 1 root root 13 Jul 19 2012 wikimediacommons.jp.net -
wikimedia.com
lrwxrwxrwx 1 root root 13 Jul 19 2012 wikimediacommons.mobi -
wikimedia.com
lrwxrwxrwx 1 root root 13 Jun 7 2012 wikimediacommons.net - wikimedia.com
lrwxrwxrwx 1 root root 13 Jun 7 2012 wikimediacommons.org - wikimedia.com
Apache:
/apache-config$ grep commons redirects.conf
wikimediacommons.co.uk *.wikimediacommons.co.uk \
wikimediacommons.eu *.wikimediacommons.eu \
wikimediacommons.info *.wikimediacommons.info \
wikimediacommons.jp.net *.wikimediacommons.jp.net \
wikimediacommons.mobi *.wikimediacommons.mobi \
wikimediacommons.net *.wikimediacommons.net \
wikimediacommons.org *.wikimediacommons.org \
wikisource.com *.wikisource.com commons.wikipedia.org \
www.commons.wikipedia.org www.commons.wikimedia.org \
RewriteRule ^/welcometowikipedia$
http://commons.wikimedia.org/wiki/File:Welcome_to_Wikipedia_brochure_EN.pdf
[R=301,L]
RewriteRule ^/instructorbasics$
http://commons.wikimedia.org/wiki/File:Instructor_Basics_How_to_Use_Wikipedia_as_a_Teaching_Tool.pdf
[R=301,L]
RewriteCond %{HTTP_HOST}
(^|\.)wikimediacommons.(net|info|mobi|eu|org|jp\.net)$
RewriteRule ^(.*)$ http://commons.wikimedia.org$1 [R=301,L,NE]
RewriteCond %{HTTP_HOST} (^|\.)wikimediacommons.co.uk$
RewriteRule ^(.*)$ http://commons.wikimedia.org$1 [R=301,L]
RewriteCond %{HTTP_HOST} =commons.wikipedia.org [OR]
RewriteCond %{HTTP_HOST} =www.commons.wikimedia.org
RewriteRule ^(.*)$ http://commons.wikimedia.org$1 [R=301,L,NE]
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] en.planet updates stuck - need Python help (upstream problem)
Thank you. Meanwhile fixed planet updates via live hack. See ticket for details. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] en.planet updates stuck - need Python help (upstream problem)
Hi,
unfortunately en.planet updates are still being stuck.
https://bugzilla.wikimedia.org/show_bug.cgi?id=45806
The issue is in feedparser.py
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 32:
ordinal not in range(128)
I would really appreciate help on this from somebody more familiar
with Python/Django template/parsing feeds/ unicode problems.
Thanks
---
INFO:planet.runner:Loading cached data
Traceback (most recent call last):
File /usr/bin/planet, line 138, in module
splice.apply(doc.toxml('utf-8'))
File /usr/lib/pymodules/python2.7/planet/splice.py, line 118, in apply
output_file = shell.run(template_file, doc)
File /usr/lib/pymodules/python2.7/planet/shell/__init__.py, line 66, in run
module.run(template_resolved, doc, output_file, options)
File /usr/lib/pymodules/python2.7/planet/shell/tmpl.py, line 254, in run
for key,value in template_info(doc).items():
File /usr/lib/pymodules/python2.7/planet/shell/tmpl.py, line 193, in
template_info
data=feedparser.parse(source)
File /usr/lib/pymodules/python2.7/planet/vendor/feedparser.py, line 3525,
in parse
feedparser.feed(data)
File /usr/lib/pymodules/python2.7/planet/vendor/feedparser.py, line 1662,
in feed
sgmllib.SGMLParser.feed(self, data)
File /usr/lib/python2.7/sgmllib.py, line 104, in feed
self.goahead(0)
File /usr/lib/python2.7/sgmllib.py, line 143, in goahead
k = self.parse_endtag(i)
File /usr/lib/python2.7/sgmllib.py, line 320, in parse_endtag
self.finish_endtag(tag)
File /usr/lib/python2.7/sgmllib.py, line 360, in finish_endtag
self.unknown_endtag(tag)
File /usr/lib/pymodules/python2.7/planet/vendor/feedparser.py, line 569, in
unknown_endtag
method()
File /usr/lib/pymodules/python2.7/planet/vendor/feedparser.py, line 1512,
in _end_content
value = self.popContent('content')
File /usr/lib/pymodules/python2.7/planet/vendor/feedparser.py, line 849, in
popContent
value = self.pop(tag)
File /usr/lib/pymodules/python2.7/planet/vendor/feedparser.py, line 764, in
pop
mfresults = _parseMicroformats(output, self.baseuri, self.encoding)
File /usr/lib/pymodules/python2.7/planet/vendor/feedparser.py, line 2219,
in _parseMicroformats
p.vcard = p.findVCards(p.document)
File /usr/lib/pymodules/python2.7/planet/vendor/feedparser.py, line 2161,
in findVCards
sVCards += '\n'.join(arLines) + '\n'
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 32:
ordinal not in range(128)
--
Daniel Zahn dz...@wikimedia.org
Operations Engineer
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] en.planet updates stuck - need Python help (upstream problem)
note: this did not happen from the beginning and does not apply to other languages (or at least not all of them), so it depends which feeds you subscribe to and their (current) content. It is not that easy though to identify which feed causes it, since the update goes through all of them, writes to cache directory, and in the very end tries to assemble HTML from cached data, not telling you where exactly it got stuck. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] switched planet to new software (finally)
Hi, last night i finally made the switch to the new planet software. http://wikitech.wikimedia.org/view/Planet.wikimedia.org == What is planet? == An RSS feed aggregator. See [[meta:Planet_Wikimedia]] for details. == How do i access it? == http://en.planet.wikimedia.org/ and several other languages, *.planet.wikimedia.org. == New planet (planet-venus) == On Jan,23rd 2013 we switched from the [http://wikitech.wikimedia.org/index.php?title=Planet.wikimedia.orgoldid=25640 old planet] (http://www.planetplanet.org/) to the new planet-venus (http://www.intertwingly.net/code/venus/) === What's better about the new planet? === #It's packaged in Ubuntu. ([http://packages.ubuntu.com/km/lucid/python/planet-venus planet-venus]), the old planet was not packaged. #It's fully [https://gerrit.wikimedia.org/r/#/q/project:operations/puppet+topic:planet+status:merged,n,z puppetized], the old planet was all manual. #It uses [[git]]. People adding feed URLs can just send [[Gerrit]] patchsets. The old planet used SVN. #It's a complete rewrite of the old code in Python. It uses more modern technology like html5lib, Atom, XSLT and templates. #.. == What may not be better about the new planet (yet)? == #The gmq planet, which is a combo of Scandinavian languages does not have separate index pages in each language yet. #Some CSS/layout/design issues, like localized logo in Arabic or right-to-left alignment of thumbnails. (Arabic does already use a separate CSS file though and has the sidebar on the right hand side) #It does not include iframes (this might be considered a good thing though) == Where should i report issues? == On Bugzilla. == Where does it run? == On [[zirconium]] in [[eqiad]]. The old planet was on [[singer]]. == Where's the code? == In git, in the operations/puppet repo: #./manifests/role/planet.pp #./manifests/misc/planet.pp and #git clone https://github.com/rubys/venus.git == How do i add/remove feed URLs? == #[https://labsconsole.wikimedia.org/wiki/Git#Git.2FGerrit_and_the_repositories Clone] the operations/puppet git repository. #go to ./puppet/templates/planet/ and edit one of the language_config.erb files #submit to gerrit and have somebody merge it == How do i change HTML of the index pages? == #see above, edit ./puppet/templates/planet/index.html.tmpl.erb == How do i add/change translations in the index pages or add a new language? == #see above, edit ./puppet/manifests/role/planet.pp (find $planet_languages=...) == How do i request changes if i can't or don't want to submit a change set myself? == Ask on [[meta:Planet_Wikimedia#Requests_for_Update_or_Removal]] == Are there more general docs on planet-venus and it's architecture? == Sure, see [http://www.intertwingly.net/code/venus/docs/index.html docs] and [http://www.intertwingly.net/code/venus/docs/venus.svg venus.svg]. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] ganglia temporarily private
re-enabled the password protection on ganglia per request ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] wikivoyage.com
Hi, we just added this to our DNS this afternoon, before it was still pointing to the old servers. Must have cached it exactly between me adding it to DNS and right before adding the Apache config. It should work now. Hit shift + reload in your browser to make sure it is not locally cached. Addtionally i purged the URL from our Squid cache. Best regards, Daniel ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Welcome, Dan Andreescu!
Welcome Dan! Nice meeting you. See you on IRC and gerrit. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] scaled media (thumbs) as *temporary* files, not stored forever
Maybe we could have large,medium,small etc as aliases for standard/popular sizes to encourage using less of the non-standard ones? -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] scaled media (thumbs) as *temporary* files, not stored forever
Also wondering if there are any thumbnails that are larger than their actual images, and if yes to get rid of them. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [Wikimania-l] Looking for Wikimania Materials on Wikipedia Infrastructure
On Mon, Aug 27, 2012 at 4:47 AM, Federico Leva (Nemo) nemow...@gmail.com wrote: http://wikitech.wikimedia.org/ Which is completely useless for any kind of high-level information, in particular [[Server roles]] which is dead and has no replacement and https://meta.wikimedia.org/wiki/Wikimedia_servers is outdated. http://wikitech.wikimedia.org/view/Category:Servers http://noc.wikimedia.org/dbtree/ http://ganglia.wikimedia.org/latest/ -- Choose a source -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Appreciation thread
in random order: * To James Alexander for fixing a lot of Planet URLs. * To Ryan and Faidon for their replies on the mailing list archive issues * To Ben for advice on all the benefits package paperwork i was not familiar with * To Mark H. for still replying to my Bugzilla questions even though he is busy with non-wmf things ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Wikimedians are rightfully wary
fwiw, my experience today trying to tell a community about a change we made: we enabled WebFonts for my.wp: https://gerrit.wikimedia.org/r/#/c/20727/1/wmf-config/InitialiseSettings.php as requested in https://bugzilla.wikimedia.org/show_bug.cgi?id=34817 because it was assigned to me in Gerrit and looked like an easy change. So after merging and pushing out to cluster.. first i joined the IRC channel #wikipedia-my . It was empty. Then i checked for a mailing list. It did not exist. Then i went to the Wiki looking for the right place to drop a message. I do not speak their language, actually i don't even have the right fonts installed: http://my.wikipedia.org/wiki/Special:RecentChanges I just tried Village_Pump, http://my.wikipedia.org/wiki/Wikipedia:Village_Pump but it appears empty afaict. At this point i gave up and relied on the comment in Bugzilla being enough.. The last part took wy longer than the actual merge of course. If i could have a matrix with links please, one for every project in every language with just the right places to leave comments on, i would more often do this... ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Wikimedians are rightfully wary
On Fri, Aug 24, 2012 at 2:50 PM, Platonides platoni...@gmail.com wrote: http://meta.wikimedia.org/wiki/International_names_for_Village_Pump http://meta.wikimedia.org/wiki/Distribution_list Thanks, this is exactly what i was looking for. :) -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] replacing Planet software soon
Hi, i am planning to replace the current Planet Wikimedia software early next week. For those who might not even know planet: What is planet? -- http://meta.wikimedia.org/wiki/Planet_Wikimedia This is the current English planet as an example: -- http://en.planet.wikimedia.org/ The original planet software we have used up until now is unfortunately unmaintained and not available as a distribution package nor was it puppetized. First there was the original planet software (planetplanet.org), then development stopped and then later it was continued as Planet 2.0. Though there is also Planet Venus, a radical refactoring of Planet 2.0, and that is available as an Ubuntu package in universe :) -- http://intertwingly.net/code/venus/ , http://packages.ubuntu.com/da/precise/planet-venus --- quote from http://lwn.net/Articles/421348/: .. However, Planet's development seems to have slowed considerably — if not entirely stopped. The last updates in Jeff Waugh's repository are dated early 2007. Development seems to have carried on, somewhat quietly, with Planet Venus. It's not reflected on the Planet site at all, but digging through the mailing lists one finds development has continued under the name Venus or Planet Venus. Venus is a radical refactoring of Planet 2.0, and development discussions continue on the old Planet mailing lists --- Planet Venus uses html5lib, XSLT and Django templates to parse the feeds and create HTML. You can read more about it here: http://planet.wmflabs.org/html/ And here is a nice .svg showing the architecture is uses to parse feeds: http://planet.wmflabs.org/html/venus.svg I had this running in labs for a while at http://planet.wmflabs.org/ and puppetized it. You can find the puppet code in ./manifests/role/planet.pp and ./manifests/misc/planet.pp in the operations/puppet git repository. And recent changes can be found under topic branch planet. https://gerrit.wikimedia.org/r/gitweb?p=operations/puppet.git;a=blob;f=manifests/role/planet.pp;hb=HEAD https://gerrit.wikimedia.org/r/gitweb?p=operations/puppet.git;a=blob;f=manifests/misc/planet.pp;hb=HEAD Additionally, with the help of James Alexander (thanks!), we recently went through a major cleanup of feed URLs, fixing lots of redirected/moved feed URLs and removed broken feeds. This can be found here: http://meta.wikimedia.org/wiki/Planet_Wikimedia#Requests_for_Update_or_Removal which also links to gerrit. The new planet is already up here on a production host now: http://zirconium.wikimedia.org/planet/ The English planet looks like this: http://zirconium.wikimedia.org/planet/en/ That index.html page will disappear, it is just there to link to the different language planets for testing. So to get it live i will just switch DNS to point to the zirconium host and make the index redirect to the page on meta, as it does now. The feeds are currently all updated at 00:00 UTC via cron. If you see any issues with that, please speak up soon. And have a nice weekend, Daniel -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Lua deployed to www.mediawiki.org
On Wed, Aug 22, 2012 at 12:49 PM, Derric Atzrott datzr...@alizeepathology.com wrote: Most lay users likely won't be able to understand the discussions that take place on wikitech-l. But.. If that is true then how would they be able to know if they want Lua as a solution in the first place. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
First of all, thank you Ryan, Faidon, Brandon and others for the related thread. Indeed it feels like a rough environment sometimes, especially on lists, sometimes also on IRC and I really appreciated seeing colleagues step in for me in that way. On Fri, Aug 17, 2012 at 1:59 PM, MZMcBride z...@mzmcbride.com wrote: I've always found you to be incredibly helpful on IRC, on the mailing lists, and elsewhere and I've always appreciated having you around. I apologize if my initial message suggested otherwise. That said, also thank you for that, MZ. apology gladly accepted. I read your reply to Guillom's post as shit happens. And it most certainly does. But you said that the archives were last rebuilt two weeks ago, which is where the timeline kind of fell apart in my head. That's understandable. To me it sounded like he just walked away when most of the messages had been sent during the night in PST and i had just arrived at the office. Until Guillaume brought it up on the list I thought of it as a drawback of removing mails, which i had mentioned before and which makes us do as little removals as possible but we would have to live with as it had happened before. There was no communication to the list and its members and the archive being rebuilt two weeks ago and the consequences of doing so. One of the reasons for not sending any announcement for this to the list was that it was about removing private data, so i did not want to go Look, here is this private data i am now going to delete. Of course i could have still pointed out that archives are being rebuilt without giving the details. Ok, back to the technical issue: On Sat, Aug 18, 2012 at 1:19 AM, Guillaume Paumier gpaum...@wikimedia.org wrote: After April 2012: The link http://lists.wikimedia.org/pipermail/wikitech-l/2012-July/061691.html was posted on meta to reference a message of mine from July 2012. That ID (061691) had to be changed to 061614 after the rebuild from 2 weeks ago (i.e. a translation of -77). After yesterday's rebuild, it's now at ID 061621 (a translation of +7 consistent with the 7 empty messages you've reinserted). :( This is really unfortunate, but sorry, i don't have an explanation for the difference of -77 unless there has been another rebuild that i am not aware of or it actually was broken before my latest change...or it's a mailman bug..:/ So, it appears that the archives have been corrupted inconsistently besides the simple translations of -77 or -7. Someone can probably verify that with other links (e.g. from the Signpost pages). Is it really random or at least consistent -77 since after April 2012? Well, but as Ryan pointed out this whole issue has happened several times in the past, so i expect you could always find broken links somewhere depending on the time they have been created. the August 2012 archive page contains several No subject messages I don't know where these come from. Are they really new since this incident? I would really prefer to not delete anything at this point and break links once again. On Sat, Aug 18, 2012 at 11:35 AM, Platonides platoni...@gmail.com wrote: If I remember right, the issue of deleting old mails was not just that the ids moved the number of deleted mails, but that when rebuilding the archive, new versions rebuilt it differently. Thus the changed numeration. That would indeed explain inconsistencies in old links before April. I think though that we have rebuilt archives more than once with this current mailman version. Still would explain corruption from the past though. Can we restore the old files from backups? Again, really unfortunate, but we can't at this point. Backups are going back one week. I'm afraid the best i can do now is to help fixing external links. If somebody wants to point me to WP pages with broken links to mailman archives, i would gladly help to fix them in an edit sprint. Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
On Mon, Aug 20, 2012 at 11:29 AM, Derric Atzrott datzr...@alizeepathology.com wrote: Do our backups only go back a week? Or are backups only taken once a week? They are taken daily and go back one week. To be exact 6 Daily-slots exist in Amanda backup. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Invitation for Localisation team development demonstration 2012-08-21 15:00 UTC
On Mon, Aug 20, 2012 at 11:35 AM, Alolita Sharma asha...@wikimedia.org wrote: We use WMF's infrastructure which is WebEx. It is unfortunately not free software but I would love to have another alternative that scales for remote / distributed folks joining in and scaling for video, audio and screen sharing. Suggestions are always welcome :-) fwiw: http://www.webriti.com/index.php/open-source/apache-open-meeting-an-open-source-alternative-to-webex/ http://incubator.apache.org/openmeetings/ -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Can we make an acceptable behavior policy? (was: Re: Mailman archives broken?)
On Fri, Aug 17, 2012 at 4:05 AM, MZMcBride z...@mzmcbride.com wrote: that, I just don't happen to agree that such behavior (making a mess and then simply walking away) is acceptable in this case. - I already apologized for breaking links and yes, it was a mistake to not just replace ALL messages in that thread with XXXs - It's not like i just wanted to mess with archives for fun, there have been serious requests by others do remove stuff. - I warned about broken links myself before, there is a trail for this on RT - I did not simply walk away unless you are expecting me to work in the middle of the night. I just got to read all your replies and the suggestion to reinsert messages and i am looking at it right now. - I have never been declared the mailman-guy, i simply picked up tickets nobody else had taken trying to help. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
On Fri, Aug 17, 2012 at 8:00 AM, Tilman Bayer tba...@wikimedia.org wrote: Many historical Signpost articles are affected as well: https://en.wikipedia.org/w/index.php?title=Special%3ASearchsearch=pipermail+wikitech+prefix%3AWikipedia%3AWikipedia+Signpost%2F2 All messages i removed on August 2nd have been posted in April 2012 (9th and 10th). Since the message numbering is just counting up by date, i don't see how this would have influenced historical posts before that currently. (see the date view vs. thread view https://lists.wikimedia.org/mailman/private/wmfall/2012-April/date.html#start) -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
Currently you will get Private archive file not found when trying to look at the wikitech-l archives. This is because the rebuilding process is running. Currently it is working on the year 2010.. Also i made a backup of the .mbox file before editing of course. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
On Fri, Aug 17, 2012 at 3:38 AM, Federico Leva (Nemo) nemow...@gmail.com wrote: I doubt fixing this requires rewriting mailman. It only requires dummy messages to be reinserted where they've been deleted and the archives to be rebuilt after this, just as if the correct procedure had been followed from the start. 7 messages have been deleted. 4 have been between the messages Code review backlog.. by Jeroen and Daring to consider .. by Roan. 3 have been between Code review backlog .. by Daniel Friesen and Save to userspace.. by PetrB. I have inserted 7 fake messages in exactly these places, keeping the original message IDs, in-reply-to and timestamps. I am rebuilding the archives again right now but it takes a while. I really hope this fixes it now. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
On Fri, Aug 17, 2012 at 2:55 PM, Mark Holmquist mtrac...@member.fsf.org wrote: Maybe someone is rebuilding the archives? Could we have gotten notice about that? Ohh.. yes, absolutely, i sent messages about it, yet they did not arrive on the list until just now since the mailbox is locked during the rebuilding process :/ The rebuilding is now done. I inserted 7 messages you can see as from mailman root at wikimedia.org, like here: https://lists.wikimedia.org/mailman/private/wikitech-l/2012-April/059880.html -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
Alright, so inserted the exact number of messages i deleted on Aug. 2 in the same places/dates, that should bring message numbering and links back to the same state before i deleted that thread. As others have mentioned before there have been other inconsistencies in it before though, so you can most likely still find other issues but to the best of my knowledge they should be unrelated. Especially anything that is older than April 2012 should not have been affected by my recent change. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Meta: Inproper Line Breaks
This may help: http://www.fix-outlook-line-breaks.com/ ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
On Thu, Aug 16, 2012 at 2:00 AM, Guillaume Paumier gpaum...@wikimedia.org wrote: I was told yesterday that the mailman/pipermail archives were broken, in that permalinks were no longer linking to the messages they used to link to (therefore not being permalinks at all).\ Hi Guillaume, the last time we had to rebuild archives was about 2 weeks ago. Unfortunately this is a major drawback of removing messages from archives as you pointed out and we are aware of it. We had a thread there though that contained private information and we also did not want to refuse the request of the person affected to remove their data. A subsequent request that followed shortly after was actually rejected for this very reason. In the future such requests will more likely rejected and if unavoidable we will just XXX out information instead of removing complete threads to avoid this from happening again. Everybody on this list please be extra careful about posting private information to a public list you might regret in the future. Sorry for breaking links, we are aware URLs should never change if at all possible. reference ticket is RT-3281 -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Mailman archives broken?
On Thu, Aug 16, 2012 at 1:49 PM, Federico Leva (Nemo) nemow...@gmail.com wrote: Thanks Daniel. I don't understand, how can a message need to be removed completely? In this case the request was for a complete thread to be removed. Since many people reply with full quotes it usually repeats the information in almost every message. (TOFU-posting). But you are right, even in these cases we should, and will, just replace content of every message with a deleted message. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Design comments (and note about no-www)
On 14 August 2012 20:08, Mark Holmquist mtrac...@member.fsf.org wrote: For example, to get to Czech Wikipedia from www.wikipedia.org, I have to roll over the top right corner? That's absolutely unusable, I would never think of that. I don't get the part about roll over the top right corner. I see a direct link to Česky Wikipedia in the 100 000+ AND in the drop-down menu. -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Design comments (and note about no-www)
On Tue, Aug 14, 2012 at 3:20 PM, Petr Onderka gsv...@gmail.com wrote: But in the proposal from http://www.wikipediaredefined.com/, which is what I was replying to (but wasn't quoted in Mark's email), it is the way I described. Aha, thanks for clarifying. ..and found the other thread about the site now:) -- Daniel Zahn dz...@wikimedia.org Operations Engineer ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] [Wmfall] Announcement: Peter Youngmeister joins Wikimedia as Technical Operations Engineer
Awesome Peter, good timing! See you soon :) ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] IRC bots and notifications
On Fri, Jun 15, 2012 at 5:27 AM, Antoine Musso hashar+...@free.fr wrote: Bugzilla IRC notifications are handled by wikibugs. It is a perl script that process bugzilla email notifications merged the first version of wikibugs.pp https://gerrit.wikimedia.org/r/#/c/8339/ -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Commits IDs, change IDs, legacy change IDs, oh my!
On Wed, Apr 25, 2012 at 4:30 AM, Erik Moeller e...@wikimedia.org wrote: Take a look at http://wikitech.wikimedia.org/view/Server_admin_log to see an example of a mix wikitech has interwiki prefixes including: bugs or (bugzilla) and RT so when logging to SAL from IRC you can directly use something like [[RT:1234]] in your !log message. I did not see a gerrit one though. I just added it. mysql insert into mw_interwiki (iw_prefix,iw_url) values (gerrit,https://gerrit.wikimedia.org/r/#change,$1;); mutante !log test - added new gerrit interwiki prefix for SAL/wikitech - [[gerrit:6002]] and it creates working links in SAL -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Wikimedia and IPv6
On Thu, Mar 29, 2012 at 1:46 AM, Roan Kattouw roan.katt...@gmail.com wrote: it was something along the lines of: * Nova did not have IPv6 support when he set up labs * Newer versions of Nova support IPv6 but assume you create the IPv4 and IPv6 networks at the same time -- Therefore there is no reasonable way to add IPv6 support to an existing IPv4-only Nova setup Yeah, it looks like they are working on it but there is still a lot of TBD in there, see here: http://wiki.openstack.org/ipv6support https://blueprints.launchpad.net/nova/+spec/ipv6-support https://code.launchpad.net/~ntt-pf-lab/nova/ipv6-support -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] db22 failure causing CentralAuth problems
Hi, one of our database servers, db22, had a disk failure a little while ago, and while this failed disk was to be replaced another RAID problem appeared. This caused downtime of db22 and users started reporting problems at around 7 pm: 19:09 malafaya so, what's wrong? was even before: 19:19 +nagios-wm PROBLEM - Host db22 is DOWN: PING CRITICAL - Packet loss = 100% Since this affected CentralAuth, users kept getting error messages like: [db22: s4] 10.0.6.32 Database ops immediately started moving a database slave to be the new master, while the hardware issue on db22 is still being investigated. The current effect is that commons is read-only. The expected downtime was at 10 minutes when writing this. -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] db22 failure causing CentralAuth problems
By now everything _should_ be back to normal. Thanks for your patience. This is what happened on the technical side: 18:37 maplebed: pushed out new db.php setting s4 to read-write 18:37 logmsgbot: ben synchronized wmf-config/db.php 18:35 maplebed: db31 made read-write as the new master for s4 18:31 maplebed: old master for s4 log file db22-bin.000106 log pos 631618956 18:30 maplebed: new master for s4: db31, log file db31-bin.000213 log pos is 205612709 18:24 logmsgbot: asher synchronized wmf-config/db.php 'setting s4 to read only, preparing to make db31 master' 18:21 Reedy: Commons having db issues, db22 (s4 master) has a disk issue -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Access to the Deleted Archives
I'm not sure if we like it (in all cases?), but have to mention this exists as well: http://deletionpedia.dbatley.com -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] problem with singer - secure.wikimedia.org and others ..
we currently have a problem with host singer, which did not come back after upgrading it. :( The following services are not accessible :/ secure.wikimedia.org (SSL proxy), ocs.wikimania2009.wikimedia.org, contacts, outreachcivi, planet, racktables, secure, survey wm09schols, wm10reg, wm10schols. http://wikitech.wikimedia.org/view/Singer will send another update...we are still looking at it.. -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] problem with singer - secure.wikimedia.org and others ..
secure.wm (and outreachcivi and others) are reachable again :) It was a hardware (disk) failure, right before the dist-upgrade, really bad timing as it seems now. Thanks to the help of Rob we are back up, running on a single disk, and will have to replace the second disk asap. Thanks for your patience On Fri, Nov 25, 2011 at 5:33 PM, Daniel Zahn dz...@wikimedia.org wrote: we currently have a problem with host singer, which did not come back after upgrading it. :( The following services are not accessible :/ secure.wikimedia.org (SSL proxy), ocs.wikimania2009.wikimedia.org, contacts, outreachcivi, planet, racktables, secure, survey wm09schols, wm10reg, wm10schols. http://wikitech.wikimedia.org/view/Singer will send another update...we are still looking at it.. -- -- Daniel Zahn dz...@wikimedia.org -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Bugzilla vandalism
We are now getting mail to noc@ by users asking us to create accounts for them. I would have created one but don't have that permission on admin.cgi . Who does? Do we even want to do that manually now? Could also be a vandal asking for it, even though unlikely :p --- fromAnnaïg DENIS ade...@alliance-libre.org to n...@wikimedia.org cc Antoine MUSSO amu...@free.fr dateThu, Nov 24, 2011 at 2:46 PM subject Account for bugzilla mailed-by alliance-libre.org Important mainly because of the people in the conversation. hide details 2:46 PM (18 minutes ago) hi, I have a bug to report on wikimedia but I can't create an account on https://bugzilla.wikimedia.org/createaccount.cgi Could you tell me what to do? Thanks Regards Annaïg DENIS ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Bugzilla vandalism
On Thu, Nov 24, 2011 at 3:29 PM, K. Peachey p858sn...@gmail.com wrote: p858snake|l it doesn't send the emails to create it or lets you set the passwords, so you have useless accounts p858snake|l unless bz has actually fixed that function in the last version or two since i looked about it It's still like that :/ Bugzilla Guide - 4.0.2 Release (which we are running) -- 3.2.2.2.2. Accounts created by an administrator Adding a user this way will not send an email informing them of their username and password. While useful for creating dummy accounts (watchers which shuttle mail to another system, for instance, or email addresses which are a mailing list), in general it is preferable to log out and use the New Account button to create users, as it will pre-populate all the required fields and also notify the user of her account name and password. http://www.bugzilla.org/docs/4.0/en/html/useradmin.html -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Bugzilla vandalism
On Thu, Nov 24, 2011 at 8:15 PM, Rob Lanphier ro...@wikimedia.org wrote: So, here's the solution for now, and probably for a while: 1. New account creation has been re-enabled 2. All existing accounts have been explicitly given the editbugs permission 3. New accounts only get the ability to file bugs, comment on bugs, and mark bugs as confirmed Nice! Thanks apergos and robla. @Antoine:I have mailed Annaïg to try again now. -- -- Daniel Zahn dz...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] Please welcome Ben Hartshorne and Daniel Zahn
Thank you all for the nice welcome.:) I started to work with Mark this week and could already bring a couple Squid servers back up today. On Tue, Jul 26, 2011 at 3:00 AM, Arthur Richards aricha...@wikimedia.orgwrote: Welcome - I'm looking forward to working with you both! -- -- Daniel Zahn dz...@wikimedia.org m...@wikimedia.org ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
