Re: [Wikitech-l] #switch limits

2012-09-25 Thread S Page
Tim Starling tstarl...@wikimedia.org variously wrote: https://fr.wikipedia.org/w/index.php?title=Mod%C3%A8le:Donn%C3%A9es_PyrF1-2009action=edit That template alone uses 47MB for 37000 #switch cases I tried converting that template with 37000 switch cases to a Lua array. Lua used 6.5MB for

Re: [Wikitech-l] GLAMwiki Toolset Project : Request for Comments - Technical Architecture

2012-09-25 Thread dan entous
On 09/20/2012 04:34 PM, dan entous wrote: dear all, as some of you may already know, the GLAMwiki Toolset Project, http://outreach.wikimedia.org/wiki/GLAM/Toolset_project, is a collaboration between Wikimedia Nederland, Wikimedia UK, Wikimedia France and Europeana, with the goal of

[Wikitech-l] Can we kill DBO_TRX? It seems evil!

2012-09-25 Thread Daniel Kinzler
Hi all! Since https://gerrit.wikimedia.org/r/#/c/21584/ got merged, people have been complaining that they get tons of warnings. A great number of them seem to be caused by the fact the MediaWiki will, if the DBO_TRX flag is set, automatically start a transaction on the first call to

Re: [Wikitech-l] GLAMwiki Toolset Project : Request for Comments - Technical Architecture

2012-09-25 Thread Emmanuel Engelhart
On 09/25/2012 11:22 AM, dan entous wrote: On 09/20/2012 04:34 PM, dan entous wrote: dear all, as some of you may already know, the GLAMwiki Toolset Project, http://outreach.wikimedia.org/wiki/GLAM/Toolset_project, is a collaboration between Wikimedia Nederland, Wikimedia UK, Wikimedia France

Re: [Wikitech-l] GLAMwiki Toolset Project : Request for Comments - Technical Architecture

2012-09-25 Thread dan entous
On 09/20/2012 04:34 PM, dan entous wrote: dear all, as some of you may already know, the GLAMwiki Toolset Project, http://outreach.wikimedia.org/wiki/GLAM/Toolset_project, is a collaboration between Wikimedia Nederland, Wikimedia UK, Wikimedia France and Europeana, with the goal of

[Wikitech-l] New extension: Diff

2012-09-25 Thread Jeroen De Dauw
Hey, I'm happy to announce the first release of a new little extension I wrote called Diff. https://www.mediawiki.org/wiki/Extension:Diff It's a small utility library which might be of use to anyone creating a new extension :) Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't

Re: [Wikitech-l] Can we kill DBO_TRX? It seems evil!

2012-09-25 Thread Tim Starling
On 25/09/12 19:33, Daniel Kinzler wrote: So, can someone shed light on what DBO_TRX is intended to do, and how it is supposed to work? Maybe you should have asked that before you broke it with I8c0426e1. DBO_TRX provides the following benefits: * It provides improved consistency of write

Re: [Wikitech-l] shortened links (was Re: MediaWiki 1.20 release candidate (and triage announcement))

2012-09-25 Thread Jeremy Baron
On Sep 24, 2012 7:18 PM, Mark A. Hershberger m...@everybody.org wrote: On 09/23/2012 06:33 PM, K. Peachey wrote: On Mon, Sep 24, 2012 at 4:03 AM, Mark A. Hershberger m...@everybody.org wrote: On 09/23/2012 12:54 PM, Krinkle wrote: https://bugzilla.wikimedia.org/[...] Link shortened:

Re: [Wikitech-l] shortened links (was Re: MediaWiki 1.20 release candidate (and triage announcement))

2012-09-25 Thread Derric Atzrott
I personally agree it's annoying and wish you didn't. But maybe there's mangling examples I've not seen. IMHO, it should usually be enough to either wrap in angle brackets or put the URL in a footnote on it's own line with just the footnote number. Anyway, I do certainly think we have bigger

Re: [Wikitech-l] MediaWiki 1.20 release candidate (and triage announcement)

2012-09-25 Thread Krinkle
On Sep 23, 2012, at 8:03 PM, Mark A. Hershberger m...@everybody.org wrote: On 09/23/2012 12:54 PM, Krinkle wrote: Also, this bugzilla query should be empty before release as well (either by fixing bugs, or reviewing/merging pending commits that claim to fix stuff, or deferring the bug to

[Wikitech-l] shortened links (was Re: MediaWiki 1.20 release candidate (and triage announcement))

2012-09-25 Thread Mark A. Hershberger
On 09/25/2012 09:40 AM, Krinkle wrote: On Sep 23, 2012, at 8:03 PM, Mark A. Hershberger m...@everybody.org wrote: On 09/23/2012 12:54 PM, Krinkle wrote: https://bugzilla.wikimedia.org/buglist.cgi?query_format=advancedtarget_milestone=1.20.0%20releaseproduct=MediaWikiresolution=--- I can hold

[Wikitech-l] Content handler feature merge (Wikidata branch) scheduled early next week

2012-09-25 Thread Rob Lanphier
Hi everyone, Assuming no one finds any substantive issues, we plan on merging the ContentHandler feature (Wikidata branch) early next week, in time for 1.20wmf14 (assuming we're still calling this the 1.20 series then). The tracking bug for that is here:

Re: [Wikitech-l] Can we kill DBO_TRX? It seems evil!

2012-09-25 Thread Platonides
On 25/09/12 13:38, Tim Starling wrote: On 25/09/12 19:33, Daniel Kinzler wrote: So, can someone shed light on what DBO_TRX is intended to do, and how it is supposed to work? Maybe you should have asked that before you broke it with I8c0426e1. He did ask about the whole database transactions

[Wikitech-l] Indexing sha1 hashes in mysql

2012-09-25 Thread Asher Feldman
As we've increased our use of sha1 hashes to identify unique content over the past year, I occasionally see changesets or discussions about indexing sha1's in mysql. When indexing a text field, it's generally beneficial to define the smallest index that still uniquely matches a high percentage of

Re: [Wikitech-l] New extension: Diff

2012-09-25 Thread Tyler Romeo
This looks pretty interesting. Is there a reason we don't just put this in the core? *--* *Tyler Romeo* Stevens Institute of Technology, Class of 2015 Major in Computer Science www.whizkidztech.com | tylerro...@gmail.com On Tue, Sep 25, 2012 at 6:50 AM, Jeroen De Dauw

Re: [Wikitech-l] Indexing sha1 hashes in mysql

2012-09-25 Thread Tyler Romeo
I see no problem with this. SHA-1 has such a strong avalanche effect that even the chance of having two similar hashes is pretty low. *--* *Tyler Romeo* Stevens Institute of Technology, Class of 2015 Major in Computer Science www.whizkidztech.com | tylerro...@gmail.com On Tue, Sep 25, 2012 at

Re: [Wikitech-l] Proposal to add an API/Developer/Developer Hub link to the footer of Wikimedia wikis

2012-09-25 Thread S Page
On Mon, Sep 24, 2012 at 12:35 PM, Jon Robson jdlrob...@gmail.com wrote: I've knocked up a first version here: http://www.mediawiki.org/wiki/Developer_Hub ( I hope you were abusing Capitalized Title just to sit next to the current hub,

Re: [Wikitech-l] Indexing sha1 hashes in mysql

2012-09-25 Thread Artur Fijałkowski
tl;dr Where an index is desired on a mysql column of base36 encoded sha1 hashes, I recommend ADD INDEX (sha1column(10)). Shorter indexes will be sufficient in many cases, but this is still provides a 2/3 space savings while covering a huge (2^51.43) space. Isn't it better to store BIGINT

Re: [Wikitech-l] Indexing sha1 hashes in mysql

2012-09-25 Thread Tyler Romeo
It would be better, but I believe MediaWiki already uses this type of storage. Changing to binary would require a schema change. *--* *Tyler Romeo* Stevens Institute of Technology, Class of 2015 Major in Computer Science www.whizkidztech.com | tylerro...@gmail.com On Tue, Sep 25, 2012 at 2:20

Re: [Wikitech-l] Proposal to add an API/Developer/Developer Hub link to the footer of Wikimedia wikis

2012-09-25 Thread Quim Gil
Hi, On Mon, Sep 24, 2012 at 12:35 PM, Jon Robson jdlrob...@gmail.com wrote: The home page for the developer page should act like a personal appeal only with __developers__ as the writers. I'm not sure about the concept of personal appeal for APIs and open source projects. They should be

Re: [Wikitech-l] Proposal to add an API/Developer/Developer Hub link to the footer of Wikimedia wikis

2012-09-25 Thread Mark Holmquist
1) The mediawiki homepage puts ME off. This is mainly because I'm more interested in doing things with the data on wikipedia rather than the software that runs Wikipedia. I think this is the problem we are trying to solve - there are many different types of developers out there and we need

Re: [Wikitech-l] Proposal to add an API/Developer/Developer Hub link to the footer of Wikimedia wikis

2012-09-25 Thread Tomasz Finc
On Tue, Sep 25, 2012 at 11:59 AM, Quim Gil quim...@gmail.com wrote: Each entry could feature already in the Developer Hub the best showcases: - amazing apps using the API, - Wikipedia mobile, visual editor, article feedback. - amazing sites powered with MediaWiki. - amazing selection of

Re: [Wikitech-l] Content handler feature merge (Wikidata branch) scheduled early next week

2012-09-25 Thread IAlex
Hello, Would it be possible to have the whole changes as an changeset on Gerrit? This would make review and comments much easier than having to do this on this list. Cheers! Alexandre Emsenhuber (ialex) Le 25 sept. 2012 à 19:16, Rob Lanphier a écrit : Hi everyone, Assuming no one finds

Re: [Wikitech-l] Content handler feature merge (Wikidata branch) scheduled early next week

2012-09-25 Thread Jeremy Baron
On Tue, Sep 25, 2012 at 7:14 PM, IAlex ialex.w...@gmail.com wrote: Would it be possible to have the whole changes as an changeset on Gerrit? This would make review and comments much easier than having to do this on this list. is

Re: [Wikitech-l] Can we kill DBO_TRX? It seems evil!

2012-09-25 Thread Daniel Kinzler
Hi Tim Thanks for bringing some light into the DBO_TRX stuff. Seems like few knew it existed, and hardly anyone understood what it means or how it should be used. I'll give my thoughts inline and propose a solution at the bottom. On 25.09.2012 13:38, Tim Starling wrote: On 25/09/12 19:33,

Re: [Wikitech-l] Proposal to add an API/Developer/Developer Hub link to the footer of Wikimedia wikis

2012-09-25 Thread Sumana Harihareswara
On 09/25/2012 03:11 PM, Tomasz Finc wrote: On Tue, Sep 25, 2012 at 11:59 AM, Quim Gil quim...@gmail.com wrote: Each entry could feature already in the Developer Hub the best showcases: - amazing apps using the API, - Wikipedia mobile, visual editor, article feedback. - amazing sites powered

Re: [Wikitech-l] Content handler feature merge (Wikidata branch) scheduled early next week

2012-09-25 Thread Tyler Romeo
I think it would be nice to have a changeset in Gerrit showing the actual merge. I'm not sure how this would be possible with Gerrit, but it would definitely be useful as a final review (and for QA purposes). *--* *Tyler Romeo* Stevens Institute of Technology, Class of 2015 Major in Computer

Re: [Wikitech-l] Content handler feature merge (Wikidata branch) scheduled early next week

2012-09-25 Thread IAlex
Hello, Having to dispatch comments over hunderds of commits is probably not the best idea, since I'm sure some of them will get lost. I would prefer having a central to do this instead. Cheers! Alexandre Emsenhuber (ialex) Le 25 sept. 2012 à 21:20, Jeremy Baron a écrit : On Tue, Sep 25,

Re: [Wikitech-l] Flagged Reviews default by quality levels

2012-09-25 Thread Liquipedia
We recently noticed the loss of this functionality as well and it is quite unfortunate for us as we were using it to manage the content of several important pages, most notably our Main Page. Would it be possible to have this feature re-added as an option? Even if it is not enabled by default,

Re: [Wikitech-l] Indexing sha1 hashes in mysql

2012-09-25 Thread Asher Feldman
Base36 certainly isn't the most efficient way to store a sha1, but it's what is in use all over mediawiki. I think there was some discussion on this list of the tradeoffs of different methods when revision.rev_sha1 was added, and base36 was picked as a compromise. I don't know why base36 was

Re: [Wikitech-l] Proposal to add an API/Developer/Developer Hub link to the footer of Wikimedia wikis

2012-09-25 Thread Erik Moeller
On Tue, Sep 25, 2012 at 12:11 PM, Tomasz Finc tf...@wikimedia.org wrote: Does anyone have an issue broadening the topic base that we have on our tech hub? I don't. MediaWiki.org has evolved to serve multiple functions: - the primary hub for the development of MediaWiki, its APIs, extensions,

Re: [Wikitech-l] Indexing sha1 hashes in mysql

2012-09-25 Thread Platonides
On 25/09/12 23:12, Asher Feldman wrote: Base36 certainly isn't the most efficient way to store a sha1, but it's what is in use all over mediawiki. I think there was some discussion on this list of the tradeoffs of different methods when revision.rev_sha1 was added, and base36 was picked as a

[Wikitech-l] Skin pages on MW.org, and Skin repos in Gerrit

2012-09-25 Thread Daniel Friesen
Skin pages on MW.org (and repos in Gerrit) are now ready. MediaWiki.org is now ready for modern skins (ones NOT using old QuickTemplate and skins/Foo.php patterns) to have pages about them just like extensions do. Relevant links: https://www.mediawiki.org/wiki/Category:All_skins

Re: [Wikitech-l] Flagged Reviews default by quality levels

2012-09-25 Thread Aaron Schulz
So have 2+ quality levels and sometimes want quality versions to be the default over checked ones? I guess the closest thing to that would be to restrict who can review/autoreview certain pages via Special:Stabilization. -- View this message in context:

Re: [Wikitech-l] Can we kill DBO_TRX? It seems evil!

2012-09-25 Thread Aaron Schulz
I agree that begin()/commit() should do what they say (which they do now). I'd like to have another construct that behaves like how those two used to (back when there were immediate* functions). Callers would then have code like: $db-enterTransaction() ... atomic stuff ... $db-exitTransaction()

[Wikitech-l] Page Curation launch on English Wikipedia

2012-09-25 Thread Fabrice Florin
Hi folks, I am happy to announce that the Wikimedia Foundation has just launched Page Curation, a new suite of tools for reviewing articles on Wikipedia. Current page patrol tools like Special:NewPages and Twinkle can be hard to use quickly and accurately, and have led to frustration for some

Re: [Wikitech-l] Indexing sha1 hashes in mysql

2012-09-25 Thread Tim Starling
On 26/09/12 03:54, Asher Feldman wrote: tl;dr Where an index is desired on a mysql column of base36 encoded sha1 hashes, I recommend ADD INDEX (sha1column(10)). Shorter indexes will be sufficient in many cases, but this is still provides a 2/3 space savings while covering a huge (2^51.43)

Re: [Wikitech-l] New extension: Diff

2012-09-25 Thread Tim Starling
On 26/09/12 03:54, Tyler Romeo wrote: This looks pretty interesting. Is there a reason we don't just put this in the core? It has about 50 lines of useful code wrapped in 1600 lines of abstraction. I don't think it is the sort of style we want in the core. -- Tim Starling

[Wikitech-l] Question About wfUrlEncode

2012-09-25 Thread Tyler Romeo
Hey, So I'm working on https://gerrit.wikimedia.org/r/22167 (Uri class), and it's failing a unit test. I know the reason it's failing the unit test is because of wfUrlencode() (the failure only started occurring when I moved wfUrlencode() over to the Uri class). However, I cannot figure out why

Re: [Wikitech-l] Indexing sha1 hashes in mysql

2012-09-25 Thread Tim Starling
On 26/09/12 12:11, Tim Starling wrote: On 26/09/12 03:54, Asher Feldman wrote: tl;dr Where an index is desired on a mysql column of base36 encoded sha1 hashes, I recommend ADD INDEX (sha1column(10)). Shorter indexes will be sufficient in many cases, but this is still provides a 2/3 space