Re: [Wikitech-l] Extension:OpenID 3.00 - Security Release

2013-03-07 Thread Petr Bena
This is indeed a problem but given that rename permissions are granted by default to bureaucrats who are most trusted users, and on small wikis typically sysadmins with shell access, this shouldn't be very dangerous. Sysadmin with shell access will be able to steal your identity anyway. It's a pro

Re: [Wikitech-l] Redis with SSDs

2013-03-07 Thread George Herbert
On Thu, Mar 7, 2013 at 2:16 PM, Tyler Romeo wrote: > Interesting article I found about Redis and its poor performance with SSDs > as a swap medium. For whoever might be interested. > > http://antirez.com/news/52 This was not particularly insightful or useful; Redis swapping is known poor, and swa

[Wikitech-l] Extension:OpenID 3.00 - Security Release

2013-03-07 Thread Ryan Lane
*Marc-Andre Pelletier discovered a vulnerability in the MediaWiki OpenID extension for the case that MediaWiki is used as a “provider” and the wiki allows renaming of users. All previous versions of the OpenID extension used user-page URLs as identity URLs. On wikis that use the OpenID extension a

Re: [Wikitech-l] Identifying pages that are slow to render

2013-03-07 Thread bawolff
On 2013-03-07 4:06 PM, "Matthew Flaschen" wrote: > > On 03/07/2013 12:00 PM, Antoine Musso wrote: > > Le 06/03/13 23:58, Federico Leva (Nemo) a écrit : > >> There's slow-parse.log, but it's private unless a solution is found for > >> https://gerrit.wikimedia.org/r/#/c/49678/ > >> https://wikitech.

Re: [Wikitech-l] Query performance - run code faster, merge code faster :-)

2013-03-07 Thread Asher Feldman
On Thu, Mar 7, 2013 at 3:57 PM, Tim Starling wrote: > On 07/03/13 12:12, Asher Feldman wrote: > > Ori - I think this has been discussed but automated xhprof configuration > as > > part of the vagrant dev env setup would be amazing :) > > I don't think xhprof is the best technology for PHP profilin

Re: [Wikitech-l] Query performance - run code faster, merge code faster :-)

2013-03-07 Thread Tim Starling
On 07/03/13 12:12, Asher Feldman wrote: > Ori - I think this has been discussed but automated xhprof configuration as > part of the vagrant dev env setup would be amazing :) I don't think xhprof is the best technology for PHP profiling. I reported a bug a month ago which causes the times it report

Re: [Wikitech-l] Bug 1542 - Log spam blacklist hits

2013-03-07 Thread Chris Steipp
On Thu, Mar 7, 2013 at 1:34 PM, Platonides wrote: > On 07/03/13 21:03, anubhav agarwal wrote: >> Hey Chris >> >> I was exploring SpamBlaklist Extension. I have some doubts hope you could >> clear them. >> >> Is there any place I can get documentation of >> Class SpamBlacklist in the file SpamBlack

[Wikitech-l] Redis with SSDs

2013-03-07 Thread Tyler Romeo
Interesting article I found about Redis and its poor performance with SSDs as a swap medium. For whoever might be interested. http://antirez.com/news/52 *--* *Tyler Romeo* Stevens Institute of Technology, Class of 2015 Major in Computer Science www.whizkidztech.com | tylerro...@gmail.com _

Re: [Wikitech-l] Indexing non-text content in LuceneSearch

2013-03-07 Thread Munagala Ramanath
(1) seems like the right way to go to me too. There may be other ways but puppet/files/lucene/lucene.jobs.sh has a function called import-db() which creates a dump like this: php $MWinstall/common/multiversion/MWScript.php dumpBackup.php $dbname --current > $dumpfile Ram On Thu, Mar 7, 2013

Re: [Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Thomas Gries
Am 07.03.2013 21:09, schrieb Petr Bena: > ah ok I was confused by it being flagged stable > > Yes. It *is* stable, at least since I took over the maintenance a long time ago. This does not say, that it cannot be further improved. Currently I am very busy adding new necessary features to the user

Re: [Wikitech-l] Bug 1542 - Log spam blacklist hits

2013-03-07 Thread Platonides
On 07/03/13 21:03, anubhav agarwal wrote: > Hey Chris > > I was exploring SpamBlaklist Extension. I have some doubts hope you could > clear them. > > Is there any place I can get documentation of > Class SpamBlacklist in the file SpamBlacklist_body.php. ? > > In function filter what does the fol

Re: [Wikitech-l] Indexing non-text content in LuceneSearch

2013-03-07 Thread Daniel Kinzler
On 07.03.2013 20:58, Brion Vibber wrote: >> 3) The indexer code (without plugins) should not know about Wikibase, but it >> may >> have hard coded knowledge about JSON. It could have a special indexing mode >> for >> JSON, in which the structure is deserialized and traversed, and any values >> a

Re: [Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Ryan Lane
On Thu, Mar 7, 2013 at 12:10 PM, Tyler Romeo wrote: > On Thu, Mar 7, 2013 at 3:05 PM, Antoine Musso wrote: > > > We still have to figure out which account will be used, the URL, whether > > we want a dedicated wiki etc... > > > > Those discussions are unrelated to using OpenID as a client, thoug

Re: [Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Chad
Those tags are arbitrary :( -Chad On Mar 7, 2013 12:09 PM, "Petr Bena" wrote: > ah ok I was confused by it being flagged stable > > On Thu, Mar 7, 2013 at 8:35 PM, Tyler Romeo wrote: > > On Thu, Mar 7, 2013 at 2:32 PM, Petr Bena wrote: > > > >> I just discovered this: http://www.mediawiki.org/

Re: [Wikitech-l] Identifying pages that are slow to render

2013-03-07 Thread Jeremy Baron
On Thu, Mar 7, 2013 at 8:06 PM, Matthew Flaschen wrote: > Why would it be harmful for public wikis? Anyone can do this on an > article-by-article basis by copying the source their own MediaWiki > instances. That user would have to pick which articles to copy and test (or test them all). The log

Re: [Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Tyler Romeo
On Thu, Mar 7, 2013 at 3:05 PM, Antoine Musso wrote: > We still have to figure out which account will be used, the URL, whether > we want a dedicated wiki etc... > Those discussions are unrelated to using OpenID as a client, though. *--* *Tyler Romeo* Stevens Institute of Technology, Class of 2

Re: [Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Petr Bena
ah ok I was confused by it being flagged stable On Thu, Mar 7, 2013 at 8:35 PM, Tyler Romeo wrote: > On Thu, Mar 7, 2013 at 2:32 PM, Petr Bena wrote: > >> I just discovered this: http://www.mediawiki.org/wiki/Extension:OpenID >> >> >> why we don't have it on production? :) >> > > Just last week

Re: [Wikitech-l] Identifying pages that are slow to render

2013-03-07 Thread Matthew Flaschen
On 03/07/2013 12:00 PM, Antoine Musso wrote: > Le 06/03/13 23:58, Federico Leva (Nemo) a écrit : >> There's slow-parse.log, but it's private unless a solution is found for >> https://gerrit.wikimedia.org/r/#/c/49678/ >> https://wikitech.wikimedia.org/wiki/Logs > > And slow-parse.log is probably go

Re: [Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Antoine Musso
Le 07/03/13 11:32, Petr Bena wrote: > I just discovered this: http://www.mediawiki.org/wiki/Extension:OpenID > why we don't have it on production? :) As far as I know, that extension is pending a full review before it lands on the Wikimedia cluster. Ryan Lane wrote about it: http://lists.wikimed

Re: [Wikitech-l] Identifying pages that are slow to render

2013-03-07 Thread Antoine Musso
Le 06/03/13 22:05, Robert Rohde a écrit : > On enwiki we've already made Lua conversions with most of the string > templates, several formatting templates (e.g. {{rnd}}, {{precision}}), > {{coord}}, and a number of others. And there is work underway on a > number of the more complex overhauls (e.g

Re: [Wikitech-l] Bug 1542 - Log spam blacklist hits

2013-03-07 Thread anubhav agarwal
Hey Chris I was exploring SpamBlaklist Extension. I have some doubts hope you could clear them. Is there any place I can get documentation of Class SpamBlacklist in the file SpamBlacklist_body.php. ? In function filter what does the following variables represent ? $title $text $section $editpag

Re: [Wikitech-l] Identifying pages that are slow to render

2013-03-07 Thread Antoine Musso
Le 06/03/13 23:58, Federico Leva (Nemo) a écrit : > There's slow-parse.log, but it's private unless a solution is found for > https://gerrit.wikimedia.org/r/#/c/49678/ > https://wikitech.wikimedia.org/wiki/Logs And slow-parse.log is probably going to be kept private unless proven it is not harmful

Re: [Wikitech-l] Indexing non-text content in LuceneSearch

2013-03-07 Thread Brion Vibber
On Thu, Mar 7, 2013 at 11:45 AM, Daniel Kinzler wrote: > 1) create a specialized XML dump that contains the text generated by > getTextForSearchIndex() instead of actual page content. That probably makes the most sense; alternately, make a dump that includes both "raw" data and "text for search".

[Wikitech-l] Indexing non-text content in LuceneSearch

2013-03-07 Thread Daniel Kinzler
Hi all! I would like to ask for you input on the question how non-wikitext content can be indexed by LuceneSearch. Background is the fact that full text search (Special:Search) is nearly useless on wikidata.org at the moment, see . The reason

Re: [Wikitech-l] Replicating enwiki and dewiki for research purposes

2013-03-07 Thread MZMcBride
Andreas Nüßlein wrote: >so I need to set up a local instance of the dewiki- and enwiki-DB with all >revisions.. :-D > >I know it's rather a mammoth project so I was wondering if somebody could >give me some pointers? > >First of all, I would need to know what kind of hardware I should get. Is >it p

Re: [Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Tyler Romeo
On Thu, Mar 7, 2013 at 2:32 PM, Petr Bena wrote: > I just discovered this: http://www.mediawiki.org/wiki/Extension:OpenID > > > why we don't have it on production? :) > Just last week there was a thread about this. Extension:OpenID is under active development, but I think it could be ready for d

Re: [Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Petr Bena
I just discovered this: http://www.mediawiki.org/wiki/Extension:OpenID why we don't have it on production? :) On Thu, Mar 7, 2013 at 8:30 PM, Petr Bena wrote: > Hi, > > we discussed OAuth many times... but - what's the current status? > > Do we have working extensions which support using OpenID i

[Wikitech-l] Editing wikipedia using google, openID or facebook

2013-03-07 Thread Petr Bena
Hi, we discussed OAuth many times... but - what's the current status? Do we have working extensions which support using OpenID in order to login to mediawiki, or OAuth? So that you can login using your google account or such? I believe that WMF is working on this, so can we have some update? I k

Re: [Wikitech-l] Replicating enwiki and dewiki for research purposes

2013-03-07 Thread Andreas Nüßlein
Hey Quim, hey Maria, thank you for your replies! I actually knew where to find the XML-dumps but that pointer about the new XML-import tools is really helpful. So eventually, I was able to acquire a Xeon 8 core, 32GB RAM, 6TB SAS to start my experiments on :) Let's see what this baby can do * h

Re: [Wikitech-l] Query performance - run code faster, merge code faster :-)

2013-03-07 Thread Luke Welling WMF
The advice on https://wikitech.wikimedia.org/wiki/Query_profiling_for_features_developers sounds good. Is there more detail somewhere on how to do this part "Test your query against production slaves prior to full deployment"? Luke On Wed, Mar 6, 2013 at 8:14 PM, Matthew Flaschen wrote: > On 0

Re: [Wikitech-l] Query performance - run code faster, merge code faster :-)

2013-03-07 Thread Nischay Nahata
I found EXPLAIN (http://dev.mysql.com/doc/refman/5.0/en/using-explain.html) pretty useful during my project; rather than theories it shows the exact way the query is being resolved and if the indexes are being used rightly. On Thu, Mar 7, 2013 at 6:06 AM, Sumana Harihareswara wrote: > If you want

[Wikitech-l] Indexing structures for Wikidata

2013-03-07 Thread Denny Vrandečić
As you probably know, the search in Wikidata sucks big time. Until we have created a proper Solr-based search and deployed on that infrastructure, we would like to implement and set up a reasonable stopgap solution. The simplest and most obvious signal for sorting the items would be to 1) make a

[Wikitech-l] IRC office hour on Tue March 19th, 1700 UTC, about Bug management

2013-03-07 Thread Andre Klapper
Hi everybody, on Tuesday 19th 17:00 UTC[1], there will be an IRC Office Hour in #wikimedia-office about Wikimedia's issue tracker[2] and Bug management[3]. Add it to your calendar and come to ask how to better find information in Bugzilla that interests you, and to share ideas and criticism how

Re: [Wikitech-l] How do MS SQL users install MediaWiki?

2013-03-07 Thread Marcin Cieslak
>> Mark A. Hershberger wrote: > On 03/04/2013 01:34 AM, Chad wrote: >> However, we do >> have people who want/use MSSQL, so I think taking the effort to >> keep it working is worthwhile--if someone's willing to commit. > > Since Danny Bauch has been using MSSQL and modifying MW for his needs, > I'

Re: [Wikitech-l] Seemingly proprietary Javascript

2013-03-07 Thread Platonides
On 06/03/13 16:28, Jay Ashworth wrote: >>> To “convey” a work means any kind of propagation that enables other >>> parties to make or receive copies. Mere interaction with a user >>> through a computer network, with no transfer of a copy, is not >>> conveying. >> >> As javascript is executed in the