Re: [Wikitech-l] Facebook's HHVM performance sprint retrospective highlights MediaWiki gains

[Strainu]

2015-06-12 18:47 GMT+03:00 Quim Gil :
> On Fri, Jun 12, 2015 at 12:59 PM, Gerard Meijssen > wrote:
>
>> Hoi,
>> And good news it is :)
>> Thanks Ori :) were people of the WMF involved in this ?
>>
>
> It's not that Ori learned about these news by reading Twitter.  ;) Tim
> Starling got dozens of patches merged in HHVM as well. Both are listed at
> https://github.com/facebook/hhvm/graphs/contributors, and you can learn
> about the rest of the team that has been working on this at
> https://www.mediawiki.org/wiki/HHVM
>
> See also
> https://blog.wikimedia.org/2014/12/29/how-we-made-editing-wikipedia-twice-as-fast/
>
>
>> A better question IMO is: have the FB engineers contributed any patches
> to MW?
>
> I'm not sure why is that a better question, considering that HHVM is
> running in Wikimedia servers and the numbers show the very tangible value
> it is providing to Wikimedia users.

Well, there are a number of reasons that made me consider their
contributions more important:
1. Downstream contributions are much less common than upstream ones
2. Intuitively, the number of developers FB has on HHVM is
significantly larger that the number of WMF enigineers working on the
subject. More eyes on our code is a good thing.
3. MW optimizations for HHVM will bring more to the WMF deployment
that generic HHVM optimizations (see the part from the blog where they
mention that some HHVM optimizations had to be reverted or reduced in
order to have other features work). This is a risky path for the open
source MediaWiki though, as sooner or later I expect some announcement
that MW will only work on HHVM, which would be a pity.

Strainu

> In any case, as Krenair has shown there
> are some patches indeed and, well, a Facebook engineer came to work to the
> WMF offices with Ori and friends during a month or so last Summer, so you
> see their willingness to help us.
>
> For what I have seen, so far this has been an exemplar free software
> collaboration with different orgs, timezones, and latitudes involved.
> Beyond the code, I bet we have learned something about how Facebook's free
> software developers work and vice versa.
>
> I wish Wikimedia is capable of attracting and engaging in similar free
> software partnerships, at this level and with these results!
>
> --
> Quim Gil
> Engineering Community Manager @ Wikimedia Foundation
> http://www.mediawiki.org/wiki/User:Qgil
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Facebook's HHVM performance sprint retrospective highlights MediaWiki gains

[James HK]

Hi,

> order to have other features work). This is a risky path for the open
> source MediaWiki though, as sooner or later I expect some announcement
> that MW will only work on HHVM, which would be a pity.

An interesting thought that may not be appreciated or shared by all
third-party users or developers.

[0] shows that at least a Hack only functionality was considered and
the question emerges about future development considering statements
like:

" ... 1.55 times faster than PHP 7 on a MediaWiki workload ... none of
these frameworks take advantage of the asynchronous I/O architecture
available in HHVM (i.e., async) ..." [1]

"... advantage of the async capabilities offered by Hack and HHVM, we
were able to examine the potential for performance gains through async
execution. ..." [1]

" ... able to validate the importance of both JIT compilation and
asynchronous execution for optimizing PHP performance ..." [1]

[0] https://phabricator.wikimedia.org/T99755

[1] http://hhvm.com/blog/9293/lockdown-results-and-hhvm-performance

Cheers

On 6/13/15, Strainu  wrote:
> 2015-06-12 18:47 GMT+03:00 Quim Gil :
>> On Fri, Jun 12, 2015 at 12:59 PM, Gerard Meijssen
>> >> wrote:
>>
>>> Hoi,
>>> And good news it is :)
>>> Thanks Ori :) were people of the WMF involved in this ?
>>>
>>
>> It's not that Ori learned about these news by reading Twitter.  ;) Tim
>> Starling got dozens of patches merged in HHVM as well. Both are listed at
>> https://github.com/facebook/hhvm/graphs/contributors, and you can learn
>> about the rest of the team that has been working on this at
>> https://www.mediawiki.org/wiki/HHVM
>>
>> See also
>> https://blog.wikimedia.org/2014/12/29/how-we-made-editing-wikipedia-twice-as-fast/
>>
>>
>>> A better question IMO is: have the FB engineers contributed any patches
>> to MW?
>>
>> I'm not sure why is that a better question, considering that HHVM is
>> running in Wikimedia servers and the numbers show the very tangible value
>> it is providing to Wikimedia users.
>
> Well, there are a number of reasons that made me consider their
> contributions more important:
> 1. Downstream contributions are much less common than upstream ones
> 2. Intuitively, the number of developers FB has on HHVM is
> significantly larger that the number of WMF enigineers working on the
> subject. More eyes on our code is a good thing.
> 3. MW optimizations for HHVM will bring more to the WMF deployment
> that generic HHVM optimizations (see the part from the blog where they
> mention that some HHVM optimizations had to be reverted or reduced in
> order to have other features work). This is a risky path for the open
> source MediaWiki though, as sooner or later I expect some announcement
> that MW will only work on HHVM, which would be a pity.
>
> Strainu
>
>> In any case, as Krenair has shown there
>> are some patches indeed and, well, a Facebook engineer came to work to the
>> WMF offices with Ori and friends during a month or so last Summer, so you
>> see their willingness to help us.
>>
>> For what I have seen, so far this has been an exemplar free software
>> collaboration with different orgs, timezones, and latitudes involved.
>> Beyond the code, I bet we have learned something about how Facebook's free
>> software developers work and vice versa.
>>
>> I wish Wikimedia is capable of attracting and engaging in similar free
>> software partnerships, at this level and with these results!
>>
>> --
>> Quim Gil
>> Engineering Community Manager @ Wikimedia Foundation
>> http://www.mediawiki.org/wiki/User:Qgil
>> ___
>> Wikitech-l mailing list
>> Wikitech-l@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Is non-SSL request still allowed?

[Max Vlasov]

Thanks, the date explains why I could not find any information, the change
is very recent indeed.

On Sat, Jun 13, 2015 at 2:21 AM, Derk-Jan Hartman <
d.j.hartman+wmf...@gmail.com> wrote:

> https://blog.wikimedia.org/2015/06/12/securing-wikimedia-sites-with-https/
>
> On Sat, Jun 13, 2015 at 12:27 AM, Max Vlasov  wrote:
>
> > Hi,
> >
> > I have a software using mediawiki api with Wikipedia. It uses general
> http
> > requests. Suddenly it stopped working several days ago (maybe a week, I
> > can't recall exactly). When I query a test query in a browsers, it
> > redirects to https, I see also that at the side sites that there's also
> 301
> > redirects. But I can not find any official information that http requests
> > no long work.
> >
> > Please, let me know whether I have an option to continue work with http
> > requests or SSL now is mandatory
> >
> > Thanks
> >
> > Max Vlasov
> > ___
> > Wikitech-l mailing list
> > Wikitech-l@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Read the VisualEditor process review

[Scott MacLeod]

Thanks, Greg, Joel and All,

Best,
Scott

Best, Scott
Hello everybody!

For the past couple months, Joel Aufrecht and I have been working on a
project to document and improve the VisualEditor team's processes; we just
published a draft of our report
 on
mediawiki.org. If you're interested, please read it over and, of course,
shout at us on the talk page if we wrote anything stupid.

In addition to the team's significant strengths, we identified three major
challenges we'd like to work on:

   - Consulting stakeholders like Analytics and Design Research often have
   trouble engaging with VE’s development.
   - The process for early-stage requirements and design decision-making is
   informal and incomplete.
   - The team has a high reporting load which may no longer be justified.

Next week, we'll start to expand the report with some proposed solutions
(suggestions welcome!)

Have a good weekend!
—
Neil P. Quinn ,
product analyst
Wikimedia Foundation
+1 (202) 656 3457
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

[Wikitech-l] [IRC] BotBot logs

[Petr Bena]

Hi,

Krinkle wanted to use BotBot.me log viewer as a frontend for wm-bot's
logs. It unfortunatelly uses slightly different database schemas, but
I managed to create some views in wm-bot's db that actually produces
similar columns and behold! It works:
http://botbot.wmflabs.org/freenode/15/

Well, to a point. Some features do not work yet, such as searching,
but I will look into it. Let me know if anything didn't work as
expected! Also, don't even bother unchecking hide join / part it will
not work. wm-bot stores irc commands as numerics while BotBot uses
text column here. I can create some procedure in SQL to convert this,
but it wouldn't work with indexes and that would totally kill the
performance of log viewer, so I am afraid these won't be available for
a while.

Have fun

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [IRC] BotBot logs

[Petr Bena]

I fixed slugs now, so every channel has perma links in format of
http://botbot.wmflabs.org/freenode/CHANNEL for example
http://botbot.wmflabs.org/freenode/wikimedia-labs/

On Sat, Jun 13, 2015 at 4:54 PM, Petr Bena  wrote:
> Hi,
>
> Krinkle wanted to use BotBot.me log viewer as a frontend for wm-bot's
> logs. It unfortunatelly uses slightly different database schemas, but
> I managed to create some views in wm-bot's db that actually produces
> similar columns and behold! It works:
> http://botbot.wmflabs.org/freenode/15/
>
> Well, to a point. Some features do not work yet, such as searching,
> but I will look into it. Let me know if anything didn't work as
> expected! Also, don't even bother unchecking hide join / part it will
> not work. wm-bot stores irc commands as numerics while BotBot uses
> text column here. I can create some procedure in SQL to convert this,
> but it wouldn't work with indexes and that would totally kill the
> performance of log viewer, so I am afraid these won't be available for
> a while.
>
> Have fun

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [IRC] BotBot logs

[Stephen Niedzielski]

This looks neat! The continuous stream[1] is a very nice alternative to
paging through the daily log files[2]. Thanks for sharing!


--stephen

[1] http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-mobile/
[2]
http://botbot.wmflabs.org/freenode/wikimedia-mobile/2015-06-08/?tz=America/Denver


On Sat, Jun 13, 2015 at 12:52 PM, Petr Bena  wrote:

> I fixed slugs now, so every channel has perma links in format of
> http://botbot.wmflabs.org/freenode/CHANNEL for example
> http://botbot.wmflabs.org/freenode/wikimedia-labs/
>
> On Sat, Jun 13, 2015 at 4:54 PM, Petr Bena  wrote:
> > Hi,
> >
> > Krinkle wanted to use BotBot.me log viewer as a frontend for wm-bot's
> > logs. It unfortunatelly uses slightly different database schemas, but
> > I managed to create some views in wm-bot's db that actually produces
> > similar columns and behold! It works:
> > http://botbot.wmflabs.org/freenode/15/
> >
> > Well, to a point. Some features do not work yet, such as searching,
> > but I will look into it. Let me know if anything didn't work as
> > expected! Also, don't even bother unchecking hide join / part it will
> > not work. wm-bot stores irc commands as numerics while BotBot uses
> > text column here. I can create some procedure in SQL to convert this,
> > but it wouldn't work with indexes and that would totally kill the
> > performance of log viewer, so I am afraid these won't be available for
> > a while.
> >
> > Have fun
>
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [IRC] BotBot logs

[Keegan Peterzell]

Very cool. Thank you, Petr.

-- 
Keegan Peterzell
Community Liaison, Product
Wikimedia Foundation
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] API BREAKING CHANGE: Default continuation mode for action=query will change at the end of this month

[Ricordisamoa]

Il 09/06/2015 11:32, Steinsplitter Wiki ha scritto:

Maybe someone with enough time and knowledge can fork compat and keep it 
alive...



Everyone is free to fork it, of course, but in this case it'd only bring 
more fragmentation to the ecosystem.

As John said, patches are always welcome.

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l