Re: [Wikitech-l] question regarding crawling wikipedia for information

2013-09-11 Thread MZMcBride
Wenqin Ye wrote: If we are creating an ai app that needs to get information , would we be allowed to crawl wikipedia for this information? The app would probably be a search query of some kind, that give information back to the user, one of the sites used is wikipedia. The app would use parts of

Re: [Wikitech-l] question regarding crawling wikipedia for information

2013-09-11 Thread Yury Katkov
IMHO, the time when you had to invest time into crawling wikipedia have long past. I'd recommend to use Dbpedia who have already crawled a lot of data from wikipedia. They also have a tool for altering and tuning their parsers, http://mappings.dbpedia.org . - Yury Katkov, WikiVote On Wed,

[Wikitech-l] question about wikimedia apache module mod_pagespeed

2013-09-11 Thread Luke Frank
Hello, it's possible to add the Google Page Speed module on the wikipedia apache ? For speed purpose. I want to discuss with you of this possibility. Thanks Luke ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org

Re: [Wikitech-l] question about wikimedia apache module mod_pagespeed

2013-09-11 Thread Paul Selitskas
Hi Luke, Max Semenik has already evaluated mod_pagespeed. You can see the report here: https://www.mediawiki.org/wiki/User:MaxSem/mod_pagespeed On Wed, Sep 11, 2013 at 2:25 PM, Luke Frank corte...@hotmail.it wrote: Hello, it's possible to add the Google Page Speed module on the wikipedia

Re: [Wikitech-l] question regarding crawling wikipedia for information

2013-09-11 Thread Gryllida
On Wed, 11 Sep 2013, at 12:42, Wenqin Ye wrote: If we are creating an ai app that needs to get information , would we be allowed to crawl wikipedia for this information? The app would probably be a search query of some kind, that give information back to the user, one of the sites used is

Re: [Wikitech-l] question about wikimedia apache module mod_pagespeed

2013-09-11 Thread Tyler Romeo
Note that Max's analysis is primarily centered around mobile and MobileFrontend. -- Tyler Romeo On Sep 11, 2013 6:15 AM, Paul Selitskas p.selits...@gmail.com wrote: Hi Luke, Max Semenik has already evaluated mod_pagespeed. You can see the report here:

Re: [Wikitech-l] paper cuts

2013-09-11 Thread Lydia Pintscher
On Wed, Aug 21, 2013 at 2:48 PM, Lydia Pintscher lydia.pintsc...@wikimedia.de wrote: Heya folks :) Quite a while ago Ubuntu did a paper cuts initiative (https://wiki.ubuntu.com/OneHundredPaperCuts). Basically it was about collecting and fixing small bugs/annoyances that were easy to fix but

Re: [Wikitech-l] question about wikimedia apache module mod_pagespeed

2013-09-11 Thread Brion Vibber
On Wed, Sep 11, 2013 at 4:45 AM, Tyler Romeo tylerro...@gmail.com wrote: Note that Max's analysis is primarily centered around mobile and MobileFrontend. I'd say the analysis applies equally to the 'regular' desktop view as well. Mobile and desktop both use ResourceLoader to batch and minify

Re: [Wikitech-l] [Labs-l] Wikimedia labs-tools

2013-09-11 Thread Petr Bena
Hi, can you please explain to me from where is this information: According to the people in charge of labs they dont care about ensuring stability and that if stuff breaks Oh well well get to it when we can. They say that tools is not a production service so we really don't give a , if it breaks

[Wikitech-l] Wikimedia labs-tools

2013-09-11 Thread John
tools.wmflabs.org is supposed to be the replacement for the toolserver which the wmf is basically forcefully shutting down. I started the migration several months ago but got fed up with the difficulties and stopped. In the last month I have moved most of my tools to labs, and I have discovered

Re: [Wikitech-l] question about wikimedia apache module mod_pagespeed

2013-09-11 Thread David Gerard
On 11 September 2013 15:26, Brion Vibber bvib...@wikimedia.org wrote: On Wed, Sep 11, 2013 at 4:45 AM, Tyler Romeo tylerro...@gmail.com wrote: Note that Max's analysis is primarily centered around mobile and MobileFrontend. I'd say the analysis applies equally to the 'regular' desktop view

Re: [Wikitech-l] [Labs-l] Wikimedia labs-tools

2013-09-11 Thread Magnus Manske
There was a recent mail saying that Labs is not considered production stability. Mainly a disagreement about how many 9s in the 99.9% that represents. On Wed, Sep 11, 2013 at 4:09 PM, Petr Bena benap...@gmail.com wrote: Hi, can you please explain to me from where is this information:

Re: [Wikitech-l] Wikimedia labs-tools

2013-09-11 Thread Petr Bena
Despite it's known bug (even Ryan was telling me it has something to do with nova) I could only find 1 bug so far... https://bugzilla.wikimedia.org/show_bug.cgi?id=45868 maybe some should be created, but people from ops know about this On Wed, Sep 11, 2013 at 6:49 PM, Andre Klapper

Re: [Wikitech-l] [Labs-l] Wikimedia labs-tools

2013-09-11 Thread Ryan Lane
On Wed, Sep 11, 2013 at 8:45 AM, Magnus Manske magnusman...@googlemail.comwrote: There was a recent mail saying that Labs is not considered production stability. Mainly a disagreement about how many 9s in the 99.9% that represents. Indeed. I don't want to get into the debate about this

Re: [Wikitech-l] Wikimedia labs-tools

2013-09-11 Thread Andre Klapper
On Wed, 2013-09-11 at 10:50 -0400, John wrote: One good example of this is that a tool cannot connect to tools.wmflabs.orgdue to a host configuration issue. This is a known bug Could you point out the corresponding ticket among

Re: [Wikitech-l] [Labs-l] Wikimedia labs-tools

2013-09-11 Thread Ryan Lane
On Wed, Sep 11, 2013 at 7:50 AM, John phoenixoverr...@gmail.com wrote: tools.wmflabs.org is supposed to be the replacement for the toolserver which the wmf is basically forcefully shutting down. I started the migration several months ago but got fed up with the difficulties and stopped. In

Re: [Wikitech-l] FirefoxOS - free dev phones for porting HTML5 apps

2013-09-11 Thread Tomasz Finc
And if your not sure where to start then take a look at our own FirefoxOS App. https://github.com/wikimedia/WikipediaMobileFirefoxOS --tomasz On Sun, Sep 8, 2013 at 4:48 PM, Sumana Harihareswara suma...@wikimedia.org wrote: https://hacks.mozilla.org/2013/09/calling-all-app-ports/ If you

Re: [Wikitech-l] Wikimedia labs-tools

2013-09-11 Thread MZMcBride
I'm not sure this needed to be broadcast to three lists... John wrote: The toolserver was a fairly stable environment. I checked my primary host I connect to and it has been up for 4 months with continuous operations. I can only assume fairly was a typo for rarely. :-) I love the German

Re: [Wikitech-l] FirefoxOS - free dev phones for porting HTML5 apps

2013-09-11 Thread Rodrigo Padula
Hello Guys, and for Firefox users, you can try FirefoxOS through the simulator extension. https://addons.mozilla.org/pt-br/firefox/addon/firefox-os-simulator/ ;-) -- *Rodrigo Padula Education Program Coordinator - Brazil **Consultant for the Brazilian Catalyst Program at Wikimedia