On 12.05.2013 1:18, Tyler Romeo wrote:
FWIW, here is what I have so far: http://pastebin.com/hUQ92DfB
I haven't tested it yet because my PHP environment is not behaving, and the
only class I haven't implemented fully is SplHeap.
Perhaps you should send the link to HipHop developers (or to
On Sun, May 12, 2013 at 10:56 AM, Dmitriy Sintsov ques...@rambler.ru wrote:
On 12.05.2013 1:18, Tyler Romeo wrote:
FWIW, here is what I have so far: http://pastebin.com/hUQ92DfB
Perhaps you should send the link to HipHop developers (or to their list, if
there's any).
Unfortunately, they
On Sun, May 12, 2013 at 1:56 PM, Dmitriy Sintsov ques...@rambler.ru wrote:
Perhaps you should send the link to HipHop developers (or to their list,
if there's any).
Once I finish it and it's working I plan on doing just that.
*-- *
*Tyler Romeo*
Stevens Institute of Technology, Class of 2015
On 10/05/13 22:05, Jeroen De Dauw wrote:
Question: Is it possible to use HipHop only for part of a codebase. For
instance, if there is some MW extension that depends on a third party
library we have no control over that makes uses of SPL, would this cause
problems?
It would be possible to
On 05/12/2013 06:24 PM, Rob Lanphier wrote:
On Sun, May 12, 2013 at 10:56 AM, Dmitriy Sintsov ques...@rambler.ru wrote:
On 12.05.2013 1:18, Tyler Romeo wrote:
FWIW, here is what I have so far: http://pastebin.com/hUQ92DfB
Perhaps you should send the link to HipHop developers (or to their
On Sun, May 12, 2013 at 8:02 PM, Matthew Flaschen
mflasc...@wikimedia.org wrote:
On 05/12/2013 06:24 PM, Rob Lanphier wrote:
On Sun, May 12, 2013 at 10:56 AM, Dmitriy Sintsov ques...@rambler.ru wrote:
On 12.05.2013 1:18, Tyler Romeo wrote:
FWIW, here is what I have so far:
On 10.05.2013 17:58, Chad wrote:
On Fri, May 10, 2013 at 8:05 AM, Jeroen De Dauw jeroended...@gmail.com wrote:
Hey,
I can see why SPL might require extra work in HipHop to support. At the
same time I find it somewhat unfortunate this means one cannot use the
Standard PHP Library.
Yeah, but I
On 10.05.2013 23:51, Antoine Musso wrote:
Le 10/05/13 03:10, Tim Starling a écrit :
There's a few other SPL features that we don't use at the moment and
we should avoid introducing if possible due to lack of support in HipHop:
snip: various SPL classes
I wish we actually used Spl :-] They
On Sat, May 11, 2013 at 3:31 AM, Dmitriy Sintsov ques...@rambler.ru wrote:
On 10.05.2013 17:58, Chad wrote:
On Fri, May 10, 2013 at 8:05 AM, Jeroen De Dauw jeroended...@gmail.com
wrote:
Hey,
I can see why SPL might require extra work in HipHop to support. At the
same time I find it
FWIW, here is what I have so far: http://pastebin.com/hUQ92DfB
I haven't tested it yet because my PHP environment is not behaving, and the
only class I haven't implemented fully is SplHeap.
*-- *
*Tyler Romeo*
Stevens Institute of Technology, Class of 2015
Major in Computer Science
Hey,
I can see why SPL might require extra work in HipHop to support. At the
same time I find it somewhat unfortunate this means one cannot use the
Standard PHP Library.
Question: Is it possible to use HipHop only for part of a codebase. For
instance, if there is some MW extension that depends
On 10.05.2013, 5:10 Tim wrote:
Several people from the HipHop team at Facebook just met with several
people from WMF. Also, in the last couple of days, I've been doing
some research into what it would take to make MediaWiki support HipHop
VM. The answer is: not very much.
There's two
On Fri, May 10, 2013 at 9:49 AM, Max Semenik maxsem.w...@gmail.com wrote:
On 10.05.2013, 5:10 Tim wrote:
Several people from the HipHop team at Facebook just met with several
people from WMF. Also, in the last couple of days, I've been doing
some research into what it would take to make
On Fri, May 10, 2013 at 8:05 AM, Jeroen De Dauw jeroended...@gmail.com wrote:
Hey,
I can see why SPL might require extra work in HipHop to support. At the
same time I find it somewhat unfortunate this means one cannot use the
Standard PHP Library.
Yeah, but I think it's a workable issue.
Le 10/05/13 03:10, Tim Starling a écrit :
So I'd like to suggest that we refuse new code submissions in Gerrit
that use these features, if they are targeted for WMF production,
This can be done using CodeSniffer. We can write a specific style
standard such as WikimediaProduction that will
Le 10/05/13 03:10, Tim Starling a écrit :
There's a few other SPL features that we don't use at the moment and
we should avoid introducing if possible due to lack of support in HipHop:
snip: various SPL classes
I wish we actually used Spl :-] They are nice classes providing all
kind of useful
Several people from the HipHop team at Facebook just met with several
people from WMF. Also, in the last couple of days, I've been doing
some research into what it would take to make MediaWiki support HipHop
VM. The answer is: not very much.
There's two features that we use, mostly in extensions,
On Thu, 09 May 2013 18:10:53 -0700, Tim Starling tstarl...@wikimedia.org
wrote:
* SplDoublyLinkedList
* SplFixedArray
* SplHeap
* SplMaxHeap
* SplMinHeap
* SplPriorityQueue
* SplQueue
* SplStack
It would be nice if HHVM would support these. I'm not sure what is so
complex about these that
On 10/05/13 11:28, Daniel Friesen wrote:
On Thu, 09 May 2013 18:10:53 -0700, Tim Starling
tstarl...@wikimedia.org wrote:
* SplDoublyLinkedList
* SplFixedArray
* SplHeap
* SplMaxHeap
* SplMinHeap
* SplPriorityQueue
* SplQueue
* SplStack
It would be nice if HHVM would support these.
On Thu, May 9, 2013 at 9:46 PM, Tim Starling tstarl...@wikimedia.orgwrote:
You can always implement the parts you need in pure PHP.
True. It might be worthwhile to make some sort of Spl compatibility library
that loads in PHP versions of those classes if they do not exists. That way
we can use
On 10/05/13 11:48, Tyler Romeo wrote:
On Thu, May 9, 2013 at 9:46 PM, Tim Starling tstarl...@wikimedia.orgwrote:
You can always implement the parts you need in pure PHP.
True. It might be worthwhile to make some sort of Spl compatibility library
that loads in PHP versions of those
On Thu, May 9, 2013 at 9:57 PM, Tim Starling tstarl...@wikimedia.orgwrote:
If you can write a complete and accurate compatibility class in pure
PHP, then it can be included in HipHop in the system/classes directory.
Interesting. I'll try and work on this.
*-- *
*Tyler Romeo*
Stevens
On 05/04/11 04:47, Tim Starling wrote:
Speaking of fast, I did a quick benchmark of the [[Barack Obama]]
article with templates pre-expanded. It took 22 seconds in HipHop and
112 seconds in Zend, which is not bad, for a first attempt. I reckon
it would do better if a few of the regular
On 04/05/2011 04:45 PM, Ashar Voultoiz wrote:
On 05/04/11 04:47, Tim Starling wrote:
Speaking of fast, I did a quick benchmark of the [[Barack Obama]]
article with templates pre-expanded. It took 22 seconds in HipHop and
112 seconds in Zend, which is not bad, for a first attempt. I
On 04/05/2011 05:47 AM, Tim Starling wrote:
Speaking of fast, I did a quick benchmark of the [[Barack Obama]]
article with templates pre-expanded. It took 22 seconds in HipHop and
112 seconds in Zend, which is not bad, for a first attempt. I reckon
it would do better if a few of the regular
On 04/05/2011 02:42 AM, Tim Starling wrote:
On 04/05/2011 07:31 AM, Platonides wrote:
Having to create a reflection class and look for exceptions just to
check for class existance is really ugly.
However, looking at https://github.com/facebook/hiphop-php/issues/314 it
seems to be a
On Tue, Apr 5, 2011 at 7:45 AM, Ashar Voultoiz hashar+...@free.fr wrote:
On 05/04/11 04:47, Tim Starling wrote:
Speaking of fast, I did a quick benchmark of the [[Barack Obama]]
article with templates pre-expanded. It took 22 seconds in HipHop and
112 seconds in Zend, which is not bad,
On Tue, Apr 5, 2011 at 12:58 AM, Tim Starling tstarl...@wikimedia.org wrote:
I need to get back to work on reviews and deployments and other such
strategic things. I hope the work I've done on HipHop support is
enough to get the project started.
Initial benchmarks are showing a 5x speedup for
2011/4/5 Magnus Manske magnusman...@googlemail.com:
For comparison: WYSIFTW parses [[Barak Obama]] in 3.5 sec on my iMac,
and in 4.4 sec on my MacBook (both Chrome 12).
Yes, it doesn't do template/variable replacing, and it's probably full
of corner cases that break; OTOH, it's JavaScript
On Tue, Apr 5, 2011 at 3:30 PM, Paul Copperman
paul.copper...@googlemail.com wrote:
2011/4/5 Magnus Manske magnusman...@googlemail.com:
For comparison: WYSIFTW parses [[Barak Obama]] in 3.5 sec on my iMac,
and in 4.4 sec on my MacBook (both Chrome 12).
Yes, it doesn't do template/variable
2011/4/5 Magnus Manske magnusman...@googlemail.com:
So is the time spent with the actual expansion (replacing variables),
or getting the wikitext for n-depth template recursion? Or is it the
parser functions?
Well, getting the wikitext shouldn't be very expensive as it is cached
in several
On Tue, Apr 5, 2011 at 9:02 AM, Magnus Manske
magnusman...@googlemail.com wrote:
Yes, it doesn't do template/variable replacing, and it's probably full
of corner cases that break; OTOH, it's JavaScript running in a
browser, which should make it much slower than a dedicated server
setup running
On 5 April 2011 21:29, Aryeh Gregor simetrical+wikil...@gmail.com wrote:
To the contrary, I'd expect JavaScript in the most recent version of
any browser (even IE) to be *much* faster than PHP, maybe ten times
faster on real-world tasks. All browsers now use JIT compilation for
JavaScript,
On Tue, Apr 5, 2011 at 10:07 PM, David Gerard dger...@gmail.com wrote:
On 5 April 2011 21:29, Aryeh Gregor simetrical+wikil...@gmail.com wrote:
To the contrary, I'd expect JavaScript in the most recent version of
any browser (even IE) to be *much* faster than PHP, maybe ten times
faster on
Hi Tim,
I have no problem running foo.php and test.php that you sent in hphpi, but
also it compiles and run without any problems with hphp. What command
exactly do you use to compile and then execute?
Inez
On Sun, Apr 3, 2011 at 5:38 PM, Tim Starling tstarl...@wikimedia.orgwrote:
On
On 03/30/2011 09:22 AM, Magnus Manske wrote:
Plus, free C++ MediaWiki parser ;-)
Seriously, there should be a way to turn the entire package into a
(huge) library; maybe transpile it and then replace the C++ code for
index.php with a manually written library interface?
HipHop has a library
I need to get back to work on reviews and deployments and other such
strategic things. I hope the work I've done on HipHop support is
enough to get the project started.
Initial benchmarks are showing a 5x speedup for article parsing, which
is better than we had hoped for. So there are big
On 03/29/2011 10:48 AM, Platonides wrote:
I was expecting this the week hip-hop hit. What would be required to
target hip-hop? How does that differ from working from Zend?
I've explored the issues and made some initial changes to my working
copy. I'm now waiting for it to compile, and once
On 04/04/2011 12:11 PM, Brion Vibber wrote:
Whee! So far it sounds like most of these are things we can work around
reasonably sensibly, so mostly good news. Any remaining issues with 'scary
reference stuff' like stub objects, or do those semantics actually already
work for us?
I'm not
Hello,
I'm working on migration to HipHop at Wikia (we run on MediaWiki
1.16.2 with tons of our custom extensions and skins).
At this point I'm testing and benchmarking all different use cases and
so far I didn't run into any serious problems - however there were
memory corruptions when using
On 03/30/2011 12:51 AM, Chad wrote:
For those of you on Ubuntu or other flavors of Debian, the guide at [0] wil
pretty much walk you through it pain-free. One little gotcha: you need a
libmemcached of at least 0.39, and the latest version in 10.04 and below
is 0.31, so you'll either need to do
On 3/30/11 12:26 AM, Tim Starling wrote:
On 03/30/2011 12:51 AM, Chad wrote:
For those of you on Ubuntu or other flavors of Debian, the guide at [0] wil
pretty much walk you through it pain-free. One little gotcha: you need a
libmemcached of at least 0.39, and the latest version in 10.04 and
On Sun, Mar 27, 2011 at 11:21 PM, Tim Starling tstarl...@wikimedia.org wrote:
Facebook now write their PHP code to target HipHop exclusively, so by
trying to write code that works on both platforms, we'll be in new
territory, to some degree. Maybe that's scary, but I think it can work.
Who's
On Mon, Mar 28, 2011 at 9:33 PM, Tim Starling tstarl...@wikimedia.org wrote:
Yes, that's true, and that's part of the reason I'm flagging this
change on the mailing list. Domas says that the HipHop team is working
on PHP 5.3 support, so maybe the issue won't come up. But yes, in
principle, I
On Tue, Mar 29, 2011 at 3:28 PM, Aryeh Gregor
simetrical+wikil...@gmail.com wrote:
On Mon, Mar 28, 2011 at 9:33 PM, Tim Starling tstarl...@wikimedia.org wrote:
Yes, that's true, and that's part of the reason I'm flagging this
change on the mailing list. Domas says that the HipHop team is
2011/3/28 Tim Starling tstarl...@wikimedia.org:
Who's with me?
I don't really have a good idea of what would need to change to
support HipHop, but if the changes aren't to intrusive I'm all for it.
If we decide to do this, we should also decide when to start and when
we want to have HPHP
Two things:
(i) I'd really hope that subclassing would be very rare here. I don't think
this will be much of an issue though.
(ii) Also, it would be nice if developers could all have hiphop running on
their test wikis, so that code that's broken on hiphop isn't committed in
ignorance. The only
On 28/03/11 17:36, Roan Kattouw wrote:
2011/3/28 Tim Starling tstarl...@wikimedia.org:
Who's with me?
I don't really have a good idea of what would need to change to
support HipHop, but if the changes aren't to intrusive I'm all for it.
If we decide to do this, we should also decide when
On Sun, Mar 27, 2011 at 11:21 PM, Tim Starling tstarl...@wikimedia.org wrote:
Facebook now write their PHP code to target HipHop exclusively, so by
trying to write code that works on both platforms, we'll be in new
territory, to some degree. Maybe that's scary, but I think it can work.
What
On Mar 28, 2011, at 5:28 PM, Aryeh Gregor wrote:
... and Facebook ignores that and adds what
it thinks would be useful?
Facebook already has features Zend does not:
https://github.com/facebook/hiphop-php/blob/master/doc/extension.new_functions
Stuff like:
* Parallel RPC - MySQL, HTTP, ..
*
On 29/03/11 01:28, Aryeh Gregor wrote:
What happens when the feature lists start diverging, because Zend adds
what it thinks would be useful and Facebook ignores that and adds what
it thinks would be useful? Then we can't use any new features from
either.
We can use features from both, using
On Mon, Mar 28, 2011 at 10:28 AM, Aryeh Gregor
simetrical+wikil...@gmail.com wrote:
On Mon, Mar 28, 2011 at 9:42 AM, Chad innocentkil...@gmail.com wrote:
I also don't know if they've actually merged the 32bit work into their
mainline yet--I know a volunteer was working on it. If they're lacking
On 11-03-28 12:44 AM, Tim Starling wrote:
On 28/03/11 17:36, Roan Kattouw wrote:
2011/3/28 Tim Starlingtstarl...@wikimedia.org:
Who's with me?
I don't really have a good idea of what would need to change to
support HipHop, but if the changes aren't to intrusive I'm all for it.
If we decide
On Mon, Mar 28, 2011 at 10:47 AM, Tim Starling tstarl...@wikimedia.org wrote:
We can use features from both, using function_exists(), like what we
do now with PHP modules.
Well, yes, if there's some reasonable fallback. It doesn't work for
features that are useless if you have to write a
Tim Starling wrote:
I think we should migrate MediaWiki to target HipHop [1] as its
primary high-performance platform. I think we should continue to
support Zend, for the benefit of small installations. But we should
additionally support HipHop, use it on Wikimedia, and optimise our
On 29/03/11 09:40, Aryeh Gregor wrote:
On Mon, Mar 28, 2011 at 10:47 AM, Tim Starling tstarl...@wikimedia.org
wrote:
We can use features from both, using function_exists(), like what we
do now with PHP modules.
Well, yes, if there's some reasonable fallback. It doesn't work for
features
I think we should migrate MediaWiki to target HipHop [1] as its
primary high-performance platform. I think we should continue to
support Zend, for the benefit of small installations. But we should
additionally support HipHop, use it on Wikimedia, and optimise our
algorithms for it.
In cases where
Thank you, Ævar. I've requested access as you suggested.
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Hello all.
For those of you who have tried to get mediawiki running under hiphop, I've
run into a block.
After applying the patches from Domas and converting a few e-flagged
preg_replace functions to preg_replace_callback, I have it running
successfully, hitting the database as many times as it
On Fri, Mar 26, 2010 at 20:00, Ryan Bies r...@yaauie.com wrote:
[...]
I don't know the answer to your question but can we please get this
hiphop work into SVN and out of various patchsets floating around?
Let's just create a hiphop branch for it so we can all experiment with
it.
It looks like
-Original Message-
From: wikitech-l-boun...@lists.wikimedia.org
[mailto:wikitech-l-boun...@lists.wikimedia.org] On Behalf Of
Domas Mituzas
Sent: 01 March 2010 10:11
To: Wikimedia developers
Subject: [Wikitech-l] hiphop progress
Howdy,
Most of the code in MediaWiki works
Jared,
assert(hash('adler32', 'foo', true) === mhash(MHASH_ADLER32, 'foo'));
Thanks! Would get to that eventually, I guess. Still, there's xdiff and few
other things.
Domas
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
Domas Mituzas wrote:
Jared,
assert(hash('adler32', 'foo', true) === mhash(MHASH_ADLER32, 'foo'));
Thanks! Would get to that eventually, I guess. Still, there's xdiff and few
other things.
xdiff is only needed for recompression. For page views, there is a
pure-PHP port of the patch part.
Howdy,
Most of the code in MediaWiki works just fine with it (since most of
it is mundane) but things like dynamically including certain files,
declaring classes, eval() and so on are all out.
There're two types of includes in MediaWiki, ones I fixed for AutoLoader and
ones I didn't - HPHP
Looks like a loot of fun :-)
On 1 March 2010 11:10, Domas Mituzas midom.li...@gmail.com wrote:
...
Even if it wasn't hotspots like the parser could still be compiled
with hiphop and turned into a PECL extension.
hiphop provides major boost for actual mediawiki initialization too - while
On Mon, Mar 1, 2010 at 10:10, Domas Mituzas midom.li...@gmail.com wrote:
Howdy,
Most of the code in MediaWiki works just fine with it (since most of
it is mundane) but things like dynamically including certain files,
declaring classes, eval() and so on are all out.
There're two types of
Howdy,
Looks like a loot of fun :-)
Fun enough to have my evenings and weekends on it :)
this smell like something that can benefict from metadata.
/* [return integer] */ function getApparatusId($obj){
//body
}
Indeed - type hints can be quite useful, though hiphop is smart enough to
On Mon, Mar 1, 2010 at 13:35, Domas Mituzas midom.li...@gmail.com wrote:
Still, the decision to merge certain changes into MediaWiki codebase (e.g.
relative includes, rather than $IP-based absolute ones) would be quite
invasive.
Also, we'd have to enforce stricter policy on how some of the
The point of $IP is that you can use multisite environments by just
having index.php and Localsettings.php (and skin crap) in the
per-vhost directory, and have extensions and other stuff centralized
so you can update the extension once and all the wikis automatically
have it.
However, the
Marco Schuster schrieb:
The point of $IP is that you can use multisite environments by just
having index.php and Localsettings.php (and skin crap) in the
per-vhost directory, and have extensions and other stuff centralized
so you can update the extension once and all the wikis automatically
-Original Message-
From: wikitech-l-boun...@lists.wikimedia.org
[mailto:wikitech-l-boun...@lists.wikimedia.org] On Behalf Of
Ævar Arnfjörð Bjarmason
Sent: 01 March 2010 13:34
To: Wikimedia developers
Subject: Re: [Wikitech-l] hiphop progress
On Mon, Mar 1, 2010 at 10:10
On Mon, Mar 1, 2010 at 3:26 PM, Daniel Kinzler dan...@brightbyte.de wrote:
Marco Schuster schrieb:
The point of $IP is that you can use multisite environments by just
having index.php and Localsettings.php (and skin crap) in the
per-vhost directory, and have extensions and other stuff
Nevertheless - a process isn't the same process when it's going at 10x
the speed. This'll be interesting.
not 10x. I did concurrent benchmarks for API requests (e.g. opensearch) on
modern boxes, and saw:
HipHop: Requests per second:1975.39 [#/sec] (mean)
Zend: Requests per second:
On 28 February 2010 21:33, Domas Mituzas midom.li...@gmail.com wrote:
these numbers seriously kick ass. I still can't believe I observe 2000
mediawiki requests/s from a single box ;-)
So ... how restricted is HipHop PHP, and what are the hotspots in
MediaWiki that would most benefit from it?
On Sun, Feb 28, 2010 at 4:33 PM, Domas Mituzas midom.li...@gmail.comwrote:
Nevertheless - a process isn't the same process when it's going at 10x
the speed. This'll be interesting.
not 10x. I did concurrent benchmarks for API requests (e.g. opensearch) on
modern boxes, and saw:
HipHop:
On 02/28/2010 01:33 PM, Domas Mituzas wrote:
not 10x. I did concurrent benchmarks for API requests (e.g. opensearch) on
modern boxes, and saw:
HipHop: Requests per second:1975.39 [#/sec] (mean)
Zend: Requests per second:371.29 [#/sec] (mean)
these numbers seriously kick ass. I
On Sun, Feb 28, 2010 at 21:33, Domas Mituzas midom.li...@gmail.com wrote:
Nevertheless - a process isn't the same process when it's going at 10x
the speed. This'll be interesting.
not 10x. I did concurrent benchmarks for API requests (e.g. opensearch) on
modern boxes, and saw:
HipHop:
On Sun, Feb 28, 2010 at 21:39, David Gerard dger...@gmail.com wrote:
On 28 February 2010 21:33, Domas Mituzas midom.li...@gmail.com wrote:
these numbers seriously kick ass. I still can't believe I observe 2000
mediawiki requests/s from a single box ;-)
So ... how restricted is HipHop PHP,
!-- Served in 0.003 secs. --
r...@flack:/hiphop/web/phase3/includes# ab -n 100 -c 1
'http://dom.as:8085/phase3/api.php?action=queryprop=infotitles=Main%20Page'
This is ApacheBench, Version 2.3 $Revision: 655654 $
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed
Hi!
For those of us not familiar with MediaWiki benchmarking, what kind of
times were you getting without hiphop?
Zend: !-- Served in 0.011 secs. --
Domas, how much hacking did you have to do to MediaWiki to get it to
compile in Hiphop?
Lots. I'm trying to get basic
2010/2/27 David Gerard dger...@gmail.com:
The parser typically takes 2-10 seconds on an uncached en:wp page, so
speeding that process up 1000x is, um, HOLY CRAP!
You're comparing apples with oranges. Domas was testing a simple API
page info query, which is much more lightweight than a
On 27 February 2010 16:41, David Gerard dger...@gmail.com wrote:
(I'm sure the complexity of templates will go up to compensate, unless
Tim's parser functions reaper is set down to match, muwahaha.)
Speeding up parsing will reveal a new bottleneck for the devs to fight
the enwiki community
82 matches
Mail list logo
