Re: [Wikitech-l] Tech Talk: The MediaWiki Content Translation Extension: November 3rd

2014-11-03 Thread Rachel Farrand
Reminder: this tech talk starts in 2 hours at 1800 UTC

.


On Mon, Oct 27, 2014 at 1:31 PM, Rachel Farrand 
wrote:

> Please join us for the following tech talk:
>
> *Tech Talk**:* The MediaWiki Content Translation Extension
> *Presenter:* Joel Sahleen, Software Engineer, Wikimedia Language
> Engineering
> *Date:* November 3rd
> *Time:* 1800 UTC
> 
> Link to live YouTube stream 
> *IRC channel for questions/discussion:* #wikimedia-office
> Google+ page
> ,
>  another
> place for questions
>
> *Talk description:*
> Wikipedia is the largest online encyclopedia in the world. With more than
> 32 million articles in over 280 languages, Wikipedia's network of
> language-specific MediaWiki sites has become an important global resource
> for the preservation and distribution of knowledge. If you look at how
> Wikipedia's content is distributed across these language-specific sites,
> however, you find that much of it is only available in a few “major”
> languages, with English having by far the most content. At the same time,
> there is also content found only in smaller Wikipedia language editions
> that really deserves a wider audience. In order for different language
> communities to be able to share content with each other, we need to provide
> their multilingual users with a quick and easy way to translate content
> found in one Wikipedia language edition and then publish the result in
> another Wikipedia language edition. This is where the MediaWiki Content
> Translation extension comes in.
>
> The MediaWiki Content Translation (CX) extension provides a community’s
> multilingual users with an array of translation tools they can use to
> bootstrap the creation of new articles in their target language from
> existing articles in related source languages. These tools are powered by a
> set of integrated translation services that are potentially adaptable to
> other Wikimedia projects. The extension is currently being made available
> as a beta feature for a limited set of test languages that includes
> Spanish, Catalan and Portuguese. More languages are planned to be added in
> the future based on community interest, impact and various technical
> criteria.
>
> This talk will give an overview of the MediaWiki Content Translation
> extension’s key features and describe its general architecture. The focus
> will be on identifying the problems Content Translation is meant to solve,
> explaining how we have attempted to solve these problems and discussing the
> value the extension can add to Wikipedia and other MediaWiki based projects.
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Tech Talk: The MediaWiki Content Translation Extension: November 3rd

2014-11-03 Thread Rachel Farrand
Thanks to everyone who watched live! If you would like to view the video at
any later point, here is the link!:
https://www.youtube.com/watch?v=x7f5Zfvit5E

On Mon, Nov 3, 2014 at 8:00 AM, Rachel Farrand 
wrote:

> Reminder: this tech talk starts in 2 hours at 1800 UTC
> 
> .
>
>
> On Mon, Oct 27, 2014 at 1:31 PM, Rachel Farrand 
> wrote:
>
>> Please join us for the following tech talk:
>>
>> *Tech Talk**:* The MediaWiki Content Translation Extension
>> *Presenter:* Joel Sahleen, Software Engineer, Wikimedia Language
>> Engineering
>> *Date:* November 3rd
>> *Time:* 1800 UTC
>> 
>> Link to live YouTube stream 
>> *IRC channel for questions/discussion:* #wikimedia-office
>> Google+ page
>> ,
>>  another
>> place for questions
>>
>> *Talk description:*
>> Wikipedia is the largest online encyclopedia in the world. With more than
>> 32 million articles in over 280 languages, Wikipedia's network of
>> language-specific MediaWiki sites has become an important global resource
>> for the preservation and distribution of knowledge. If you look at how
>> Wikipedia's content is distributed across these language-specific sites,
>> however, you find that much of it is only available in a few “major”
>> languages, with English having by far the most content. At the same time,
>> there is also content found only in smaller Wikipedia language editions
>> that really deserves a wider audience. In order for different language
>> communities to be able to share content with each other, we need to provide
>> their multilingual users with a quick and easy way to translate content
>> found in one Wikipedia language edition and then publish the result in
>> another Wikipedia language edition. This is where the MediaWiki Content
>> Translation extension comes in.
>>
>> The MediaWiki Content Translation (CX) extension provides a community’s
>> multilingual users with an array of translation tools they can use to
>> bootstrap the creation of new articles in their target language from
>> existing articles in related source languages. These tools are powered by a
>> set of integrated translation services that are potentially adaptable to
>> other Wikimedia projects. The extension is currently being made available
>> as a beta feature for a limited set of test languages that includes
>> Spanish, Catalan and Portuguese. More languages are planned to be added in
>> the future based on community interest, impact and various technical
>> criteria.
>>
>> This talk will give an overview of the MediaWiki Content Translation
>> extension’s key features and describe its general architecture. The focus
>> will be on identifying the problems Content Translation is meant to solve,
>> explaining how we have attempted to solve these problems and discussing the
>> value the extension can add to Wikipedia and other MediaWiki based projects.
>>
>
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wikitext-l] Google Code-In 2014: Become a mentor and add tasks!

2014-11-03 Thread James Forrester
[Redirecting conversation about VisualEditor to wikitech-l; wikitext-l is
for parser and Parsoid discussion.]

On 3 November 2014 05:18, Andre Klapper  wrote:

> Hi Parsoid & VisualEditor crew,
>
> Google Code-In (GCI) will soon take place again - a contest for 13-17
> year old students to contribute to free software projects.
>
> Wikimedia wants to take part again.
> Last year's GCI results were surprisingly good - see
> https://www.mediawiki.org/wiki/Google_Code-in_2013
>

​[Snip]​


> * Open VisualEditor tickets created in the last six months (if I got
> your products and components right):
>
> https://bugzilla.wikimedia.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=NEW&bug_status=REOPENED&chfield=[Bug%20creation]&chfieldfrom=-6m&keywords=easy&keywords_type=nowords&resolution=---&product=VisualEditor


Corrected link (in front-end we use ASSIGNED to mean "accepted"):​
https://bugzilla.wikimedia.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=NEW&bug_status=REOPENED&bug_status=ASSIGNED&chfield=%5BBug%20creation%5D&chfieldfrom=-6m&keywords=easy&keywords_type=nowords&list_id=356403&product=VisualEditor&resolution=---



> * Zero existing VisualEditor "easy" tickets (are they still valid? Are
> they really self-contained, non-controversial issues with a clear
> approach? Could some of them be GCI tasks that you would mentor? If so,
> please tag them as described above!):
>
> https://bugzilla.wikimedia.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=NEW&bug_status=REOPENED&keywords=easy&keywords_type=allwords&resolution=---&product=VisualEditor


​Corrected link, per above:
https://bugzilla.wikimedia.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&keywords=easy&keywords_type=allwords&list_id=356399&product=VisualEditor&query_format=advanced&resolution=---
—
but there are still no such bugs



> Could you imagine mentoring some of these tasks?
>

Unfortunately, I think the VisualEditor world is too complicated at this
point to break off simple bugs without a lot more documentation (and this
is reflected in the lack of bugs tagged as "easy"). We've talked about
writing up a "crash course" to explain how things work, updating
https://www.mediawiki.org/wiki/VisualEditor/Design/Software_overview and
the like, but we're too far from that to be able to commit to GCI for this
year, sorry.

J.
-- 
James D. Forrester
Product Manager, Editing
Wikimedia Foundation, Inc.

jforres...@wikimedia.org | @jdforrester
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] WikiGrok deployed

2014-11-03 Thread Max Semenik
Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia.
Along with it a first campaign[1] was deployed. Now database is being
slowly populated with suggestions:

MariaDB [enwiki_p]> select page_title, pp_value from page, page_props where
pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100;
+-+--+
| page_title  | pp_value
  |
+-+--+
| Richard_Branson |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Tina_Fey|
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Jon_Stewart |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Bill_Maher  |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Jeff_Foxworthy  |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Evadne_Price|
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Dominic_Guard   |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Dilsa_Demirbag_Sten |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| J._Douglas_MacMillan|
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Carol_Bowman|
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Lianella_Carell |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| G._K._Reddy |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Liù_Bosisio |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Matilde_Rodríguez_Cabo  |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
+-+--+
14 rows in set (0.42 sec)

Pages are getting updated when edited (null edit works, but not
action=purge). According to estimations made with WikiData Query[2], the
number of potentially affected pages is approximately 33,000. If really
needed, we could whip up a script to null-edit these pages from server side
in a controlled manner, but I would like to have more data on performance
and memory consumption first.

== Monitoring ==
* Graphite: MediaWiki -> WikiGrok
* Exceptions from WikiData: type:mobile in Logstash.

== Firefighting ==
Most of potentially performance-scary/error causing code with can be
disabled by commenting out $wgWikiGrokSlowCampaigns in
wmf-config/mobile.php. If shit hits fan really hard, whole extension can be
disabled through the usual means, with $wmgUseWikiGrok.

== Next steps ==
I'm working on DB storage for questions[3] which will allow us to avoid
abusing page_props and give features such as "find me pages that could use
this type of fixes" and "find me a random page to fix".



[0] https://www.mediawiki.org/wiki/Extension:WikiGrok
[1] https://gerrit.wikimedia.org/r/#/c/170453/
[2] http://wdq.wmflabs.org/
[3] https://gerrit.wikimedia.org/r/170263

-- 
Best regards,
Max Semenik ([[User:MaxSem]])
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] Andrew Garret joins the Wikimedia Foundation

2014-11-03 Thread Tomasz Finc
I am pleased to announce Andrew Garret joining the Wikimedia
Foundation as a full time Software Engineer

Andrew has been contracting with the Wikimedia Foundation for over six
years now and its only fitting to announce that now that he's done
with his studies he'll be going full time at the Wikimedia Foundation.

In the past six years, he's worked on a huge variety of projects,
ranging from user preferences and spam filtering to notifications and
two attempts to fix talk pages. He's passionate about making people’s
workflows and processes make sense, so in the coming months, he's
looking forward to having the time and energy to focus on software
that humanizes our projects, eliminates busy work, and makes life
easier for new and old contributors.

Right now Andrew is in the process of moving from Sydney to Maastricht
to be with his girlfriend
He'll be working from Maastricht; and from early next year, Prague.

So if you find yourself in one of those cities, you should let him know!

When not working, doing assignments, or packing bags, Andrew is busy
travelling or homebrewing.

He's currently supporting the Flow team and we're exploring where
he'll help next.

Please join me in celebrating Andrew going full time

--tomasz

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Andrew Garret joins the Wikimedia Foundation

2014-11-03 Thread Danese Cooper
About time :-). Yay for everybody involved!!

D


> On Nov 3, 2014, at 10:22 PM, Tomasz Finc  wrote:
> 
> I am pleased to announce Andrew Garret joining the Wikimedia
> Foundation as a full time Software Engineer
> 
> Andrew has been contracting with the Wikimedia Foundation for over six
> years now and its only fitting to announce that now that he's done
> with his studies he'll be going full time at the Wikimedia Foundation.
> 
> In the past six years, he's worked on a huge variety of projects,
> ranging from user preferences and spam filtering to notifications and
> two attempts to fix talk pages. He's passionate about making people’s
> workflows and processes make sense, so in the coming months, he's
> looking forward to having the time and energy to focus on software
> that humanizes our projects, eliminates busy work, and makes life
> easier for new and old contributors.
> 
> Right now Andrew is in the process of moving from Sydney to Maastricht
> to be with his girlfriend
> He'll be working from Maastricht; and from early next year, Prague.
> 
> So if you find yourself in one of those cities, you should let him know!
> 
> When not working, doing assignments, or packing bags, Andrew is busy
> travelling or homebrewing.
> 
> He's currently supporting the Flow team and we're exploring where
> he'll help next.
> 
> Please join me in celebrating Andrew going full time
> 
> --tomasz
> 
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wmfall] Andrew Garret joins the Wikimedia Foundation

2014-11-03 Thread James Forrester
On 3 November 2014 14:22, Tomasz Finc  wrote:

> I am pleased to announce Andrew Garret joining the Wikimedia
> Foundation as a full time Software Engineer
>

​Awesome!​ Congratulations Andrew, and more importantly, all of us. :-)

J.
-- 
James D. Forrester
Product Manager, Editing
Wikimedia Foundation, Inc.

jforres...@wikimedia.org | @jdforrester
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wmfall] Andrew Garret joins the Wikimedia Foundation

2014-11-03 Thread Heather Walls
Hurray! Andrew! So great to hear it!

On Mon, Nov 3, 2014 at 2:22 PM, Tomasz Finc  wrote:

> I am pleased to announce Andrew Garret joining the Wikimedia
> Foundation as a full time Software Engineer
>
> Andrew has been contracting with the Wikimedia Foundation for over six
> years now and its only fitting to announce that now that he's done
> with his studies he'll be going full time at the Wikimedia Foundation.
>
> In the past six years, he's worked on a huge variety of projects,
> ranging from user preferences and spam filtering to notifications and
> two attempts to fix talk pages. He's passionate about making people’s
> workflows and processes make sense, so in the coming months, he's
> looking forward to having the time and energy to focus on software
> that humanizes our projects, eliminates busy work, and makes life
> easier for new and old contributors.
>
> Right now Andrew is in the process of moving from Sydney to Maastricht
> to be with his girlfriend
> He'll be working from Maastricht; and from early next year, Prague.
>
> So if you find yourself in one of those cities, you should let him know!
>
> When not working, doing assignments, or packing bags, Andrew is busy
> travelling or homebrewing.
>
> He's currently supporting the Flow team and we're exploring where
> he'll help next.
>
> Please join me in celebrating Andrew going full time
>
> --tomasz
>
> ___
> Wmfall mailing list
> wmf...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wmfall
>



-- 
Heather Walls
Communications Design Manager
WikimediaFoundation.org
heat...@wikimedia.org
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [Wmfall] Andrew Garret joins the Wikimedia Foundation

2014-11-03 Thread Sherah Smith
Yay!

On Mon, Nov 3, 2014 at 2:29 PM, Heather Walls  wrote:

> Hurray! Andrew! So great to hear it!
>
> On Mon, Nov 3, 2014 at 2:22 PM, Tomasz Finc  wrote:
>
>> I am pleased to announce Andrew Garret joining the Wikimedia
>> Foundation as a full time Software Engineer
>>
>> Andrew has been contracting with the Wikimedia Foundation for over six
>> years now and its only fitting to announce that now that he's done
>> with his studies he'll be going full time at the Wikimedia Foundation.
>>
>> In the past six years, he's worked on a huge variety of projects,
>> ranging from user preferences and spam filtering to notifications and
>> two attempts to fix talk pages. He's passionate about making people’s
>> workflows and processes make sense, so in the coming months, he's
>> looking forward to having the time and energy to focus on software
>> that humanizes our projects, eliminates busy work, and makes life
>> easier for new and old contributors.
>>
>> Right now Andrew is in the process of moving from Sydney to Maastricht
>> to be with his girlfriend
>> He'll be working from Maastricht; and from early next year, Prague.
>>
>> So if you find yourself in one of those cities, you should let him know!
>>
>> When not working, doing assignments, or packing bags, Andrew is busy
>> travelling or homebrewing.
>>
>> He's currently supporting the Flow team and we're exploring where
>> he'll help next.
>>
>> Please join me in celebrating Andrew going full time
>>
>> --tomasz
>>
>> ___
>> Wmfall mailing list
>> wmf...@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wmfall
>>
>
>
>
> --
> Heather Walls
> Communications Design Manager
> WikimediaFoundation.org
> heat...@wikimedia.org
>
> ___
> Wmfall mailing list
> wmf...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wmfall
>
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [WikimediaMobile] WikiGrok deployed

2014-11-03 Thread Tomasz Finc
Congrats Max and team. Eager to see how our users interact with this.

On Mon, Nov 3, 2014 at 2:16 PM, Max Semenik  wrote:
> Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia.
> Along with it a first campaign[1] was deployed. Now database is being slowly
> populated with suggestions:
>
> MariaDB [enwiki_p]> select page_title, pp_value from page, page_props where
> pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100;
> +-+--+
> | page_title  | pp_value
> |
> +-+--+
> | Richard_Branson |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Tina_Fey|
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Jon_Stewart |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Bill_Maher  |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Jeff_Foxworthy  |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Evadne_Price|
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Dominic_Guard   |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Dilsa_Demirbag_Sten |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | J._Douglas_MacMillan|
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Carol_Bowman|
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Lianella_Carell |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | G._K._Reddy |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Liù_Bosisio |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Matilde_Rodríguez_Cabo  |
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> +-+--+
> 14 rows in set (0.42 sec)
>
> Pages are getting updated when edited (null edit works, but not
> action=purge). According to estimations made with WikiData Query[2], the
> number of potentially affected pages is approximately 33,000. If really
> needed, we could whip up a script to null-edit these pages from server side
> in a controlled manner, but I would like to have more data on performance
> and memory consumption first.
>
> == Monitoring ==
> * Graphite: MediaWiki -> WikiGrok
> * Exceptions from WikiData: type:mobile in Logstash.
>
> == Firefighting ==
> Most of potentially performance-scary/error causing code with can be
> disabled by commenting out $wgWikiGrokSlowCampaigns in
> wmf-config/mobile.php. If shit hits fan really hard, whole extension can be
> disabled through the usual means, with $wmgUseWikiGrok.
>
> == Next steps ==
> I'm working on DB storage for questions[3] which will allow us to avoid
> abusing page_props and give features such as "find me pages that could use
> this type of fixes" and "find me a random page to fix".
>
>
> 
> [0] https://www.mediawiki.org/wiki/Extension:WikiGrok
> [1] https://gerrit.wikimedia.org/r/#/c/170453/
> [2] http://wdq.wmflabs.org/
> [3] https://gerrit.wikimedia.org/r/170263
>
> --
> Best regards,
> Max Semenik ([[User:MaxSem]])
>
> ___
> Mobile-l mailing list
> mobil...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [WikimediaMobile] WikiGrok deployed

2014-11-03 Thread Luis Villa
This is terrific- congrats to everyone. I'm a little curious how/when this
is supposed to trigger- I went to a few pages with beta turned on and got
nothing. :/ Under what conditions *should* we be seeing it?

Luis

On Mon, Nov 3, 2014 at 3:52 PM, Tomasz Finc  wrote:

> Congrats Max and team. Eager to see how our users interact with this.
>
> On Mon, Nov 3, 2014 at 2:16 PM, Max Semenik  wrote:
> > Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia.
> > Along with it a first campaign[1] was deployed. Now database is being
> slowly
> > populated with suggestions:
> >
> > MariaDB [enwiki_p]> select page_title, pp_value from page, page_props
> where
> > pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100;
> >
> +-+--+
> > | page_title  | pp_value
> > |
> >
> +-+--+
> > | Richard_Branson |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Tina_Fey|
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Jon_Stewart |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Bill_Maher  |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Jeff_Foxworthy  |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Evadne_Price|
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Dominic_Guard   |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Dilsa_Demirbag_Sten |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | J._Douglas_MacMillan|
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Carol_Bowman|
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Lianella_Carell |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | G._K._Reddy |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Liù_Bosisio |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> > | Matilde_Rodríguez_Cabo  |
> >
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> > |
> >
> +-+--+
> > 14 rows in set (0.42 sec)
> >
> > Pages are getting updated when edited (null edit works, but not
> > action=purge). According to estimations made with WikiData Query[2], the
> > number of potentially affected pages is approximately 33,000. If really
> > needed, we could whip up a script to null-edit these pages from server
> side
> > in a controlled manner, but I would like to have more data on performance
> > and memory consumption first.
> >
> > == Monitoring ==
> > * Graphite: MediaWiki -> WikiGrok
> > * Exceptions from WikiData: type:mobile in Logstash.
> >
> > == Firefighting ==
> > Most of potentially performance-scary/error causing code with can be
> > disabled by commenting out $wgWikiGrokSlowCampaigns in
> > wmf-config/mobile.php. If shit hits fan really hard, whole extension can
> be
> > disabled through the usual means, with $wmgUseWikiGrok.
> >
> > == Next steps ==
> > I'm working on DB storage for questions[3] which will allow us to avoid
> > abusing page_props and give features such as "find me pages that could
> use
> > this type of fixes" and "find me a random page to fix".
> >
> >
> > 
> > [0] https://www.mediawiki.org/wiki/Extension:WikiGrok
> > [1] https://gerrit.wikimedia.org/r/#/c/170453/
> > [2] http://wdq.wmflabs.org/
> > [3] https://gerrit.wikimedia.org/r/170263
> >
> > --
> > Best regards,
> > Max Semenik ([[User:MaxSem]])
> >
> > ___
> > Mobile-l mailing list
> > mobil...@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/mobile-l
> >
>
> ___
> Mobile-l mailing list
> mobil...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>



-- 
Luis Villa
Deputy General Counsel
Wik

[Wikitech-l] RFC meeting this week

2014-11-03 Thread Tim Starling
In the next RFC meeting we would like to discuss RESTBase and related
RFCs:

* Content API


* Storage service


See also https://github.com/gwicke/restbase

The meeting will be on the IRC channel #wikimedia-office on
irc.freenode.org at the following time:

* UTC: Wednesday 22:00
* US PST: Wednesday 14:00
* Europe CET: Wednesday 23:00
* Australia AEDT: Thursday 09:00

Note that we are tracking the daylight savings time change in the US
for now. I think next week we may want to move it an hour earlier, so
that it's not so late in Europe.

-- Tim Starling


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] WikiGrok deployed

2014-11-03 Thread Gerard Meijssen
Hoi,
I do not get it. It says, it will eventually put this information into
Wikidata ... WHY NOT NOW ?
Thanks,
 GerardM

On 3 November 2014 23:16, Max Semenik  wrote:

> Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia.
> Along with it a first campaign[1] was deployed. Now database is being
> slowly populated with suggestions:
>
> MariaDB [enwiki_p]> select page_title, pp_value from page, page_props where
> pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100;
>
> +-+--+
> | page_title  | pp_value
>   |
>
> +-+--+
> | Richard_Branson |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Tina_Fey|
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Jon_Stewart |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Bill_Maher  |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Jeff_Foxworthy  |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Evadne_Price|
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Dominic_Guard   |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Dilsa_Demirbag_Sten |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | J._Douglas_MacMillan|
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Carol_Bowman|
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Lianella_Carell |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | G._K._Reddy |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Liù_Bosisio |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
> | Matilde_Rodríguez_Cabo  |
>
> a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
> |
>
> +-+--+
> 14 rows in set (0.42 sec)
>
> Pages are getting updated when edited (null edit works, but not
> action=purge). According to estimations made with WikiData Query[2], the
> number of potentially affected pages is approximately 33,000. If really
> needed, we could whip up a script to null-edit these pages from server side
> in a controlled manner, but I would like to have more data on performance
> and memory consumption first.
>
> == Monitoring ==
> * Graphite: MediaWiki -> WikiGrok
> * Exceptions from WikiData: type:mobile in Logstash.
>
> == Firefighting ==
> Most of potentially performance-scary/error causing code with can be
> disabled by commenting out $wgWikiGrokSlowCampaigns in
> wmf-config/mobile.php. If shit hits fan really hard, whole extension can be
> disabled through the usual means, with $wmgUseWikiGrok.
>
> == Next steps ==
> I'm working on DB storage for questions[3] which will allow us to avoid
> abusing page_props and give features such as "find me pages that could use
> this type of fixes" and "find me a random page to fix".
>
>
> 
> [0] https://www.mediawiki.org/wiki/Extension:WikiGrok
> [1] https://gerrit.wikimedia.org/r/#/c/170453/
> [2] http://wdq.wmflabs.org/
> [3] https://gerrit.wikimedia.org/r/170263
>
> --
> Best regards,
> Max Semenik ([[User:MaxSem]])
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l