[mailto:wikitech-l-boun...@lists.wikimedia.org] On Behalf Of Markus Glaser
Sent: Friday, October 15, 2010 3:54 PM
To: Wikimedia developers
Subject: Re: [Wikitech-l] using parserTests code for selenium test framework
Hi,
I recently suggested some scheme for dynamically creating clean wikis for
Selenium tests
sts.wikimedia.org] Im Auftrag von Markus Glaser
Gesendet: Mittwoch, 29. September 2010 20:02
An: Wikimedia developers
Betreff: Re: [Wikitech-l] using parserTests code for selenium test framework
Hi,
since the wiki under test is not neccessarily the wiki running the test, it
might be useful to visual
Lane
Gesendet: Freitag, 24. September 2010 20:22
An: Wikimedia developers
Betreff: Re: [Wikitech-l] using parserTests code for selenium test framework
> Here is all that is required:
> * a single wildcard entry in Apache configuration
> * one or two lines in LocalSettings.php to pull a DB
> Here is all that is required:
> * a single wildcard entry in Apache configuration
> * one or two lines in LocalSettings.php to pull a DB name from the
> hostname/path/CLI parameters.
>
> As for cleaning up resources to keep the machine from getting clogged,
> it's very unlikely that your test wik
Dan, I think you're overestimating the difficulty of the basic wiki
family method.
Here is all that is required:
* a single wildcard entry in Apache configuration
* one or two lines in LocalSettings.php to pull a DB name from the
hostname/path/CLI parameters.
As for cleaning up resources to keep
2010/9/23 Brion Vibber :
> (If using memcached, be sure to clear those out, reinitialize, or otherwise
> do something that forces old values to be cleared or ignored.)
>
$wgCacheEpoch is a good one for this. The easiest way to change it is
to touch LocalSettings.php.
Roan Kattouw (Catrope)
__
On Thu, 23 Sep 2010 20:13:23 -0700, Brion Vibber wrote:
> On Thu, Sep 23, 2010 at 7:19 PM, Dan Nessett wrote:
>
>> I appreciate your recent help, so I am going to ignore the tone of your
>> last message and focus on issues. While a test run can set up, use and
>> then delete the temporary resour
On Thu, Sep 23, 2010 at 7:19 PM, Dan Nessett wrote:
> I appreciate your recent help, so I am going to ignore the tone of your
> last message and focus on issues. While a test run can set up, use and
> then delete the temporary resources it needs (i.e., db, images directory,
> etc.), you really ha
On Thu, 23 Sep 2010 18:10:37 -0700, Brion Vibber wrote:
> On Thu, Sep 23, 2010 at 4:03 PM, Dan Nessett wrote:
>
>> Thinking about this a bit, we seem to have come full circle. If we use
>> a URL per regression test run, then we need to multiplex wiki
>> resources. When you set up a wiki family,
On Thu, Sep 23, 2010 at 4:03 PM, Dan Nessett wrote:
> Thinking about this a bit, we seem to have come full circle. If we use a
> URL per regression test run, then we need to multiplex wiki resources.
> When you set up a wiki family, the resources are permanent. But, for a
> test run, you need to
On Thu, 23 Sep 2010 15:50:48 -0700, Brion Vibber wrote:
> On Thu, Sep 23, 2010 at 2:54 PM, Dan Nessett wrote:
>
>> On Thu, 23 Sep 2010 14:41:32 -0700, Brion Vibber wrote:
>> > There's no need to have a fixed set of URLs; just as with Wikimedia's
>> > public-hosted sites you can add individually-
On Thu, Sep 23, 2010 at 2:54 PM, Dan Nessett wrote:
> On Thu, 23 Sep 2010 14:41:32 -0700, Brion Vibber wrote:
> > There's no need to have a fixed set of URLs; just as with Wikimedia's
> > public-hosted sites you can add individually-addressable wikis
> > dynamically at whim without touching any A
On Thu, 23 Sep 2010 14:41:32 -0700, Brion Vibber wrote:
> On Thu, Sep 23, 2010 at 2:31 PM, Dan Nessett wrote:
>
>> Not sure I get this. Here is what I understand would happen when a
>> developer checks in a revision:
>>
>> + A script runs that manages the various regression tests run on the
>> r
On Thu, Sep 23, 2010 at 2:31 PM, Dan Nessett wrote:
> Not sure I get this. Here is what I understand would happen when a
> developer checks in a revision:
>
> + A script runs that manages the various regression tests run on the
> revision (e.g., parserTests, PHPUnit tests, the Selenium-based regr
On Thu, 23 Sep 2010 14:10:24 -0700, Brion Vibber wrote:
> + URLs identify test wikis. Only one regression test can run at time on
>> any one of these. How do you synchronize regression test initiation so
>> there is some sort of lock on a test wiki currently running a
>> regression test?
>>
>>
>
On Thu, Sep 23, 2010 at 1:04 PM, Dan Nessett wrote:
> After thinking about this some more I think you are right. We should at
> least start with something simple and only make it more complex (e.g.,
> wiki resource switching) if the simple approach has significant problems.
>
> There is already a
On Thu, 23 Sep 2010 10:29:58 -0700, Brion Vibber wrote:
> On Thu, Sep 23, 2010 at 9:46 AM, Dan Nessett wrote:
>
>> I am very much in favor of keeping it simple. I think the issue is
>> whether we will support more than one regression test (or individual
>> test associated with a regression test)
On Thu, Sep 23, 2010 at 9:46 AM, Dan Nessett wrote:
> I am very much in favor of keeping it simple. I think the issue is
> whether we will support more than one regression test (or individual test
> associated with a regression test) running concurrently on the same test
> wiki. If not, then I ag
Hi.
Other good test software is JMeter http://jakarta.apache.org/jmeter/
You could record and replay your http requests
--
Lcdo. Wilfredo Rafael RodrÃguez Hernández
msn,googletalk = wilfre...@gmail.com
cv = http://www.wilfredor.co.cc
blog
On Thu, 23 Sep 2010 09:24:18 -0700, Brion Vibber wrote:
> Given a test matrix with multiple OSes, this ain't something individual
> devs will be running in full over and over as they work. Assume
> automated batch runs, which can be distributed over as many databases
> and clients as you like.
>
Another trick that comes to mind is adding a little smarts to your
tests to prevent multiple runs from stomping on each other.
For StatusNet's remote subscription features, I have a client-side
test set which registers user accounts on two sites and confirms that
behavior is as expected posting me
Given a test matrix with multiple OSes, this ain't something
individual devs will be running in full over and over as they work.
Assume automated batch runs, which can be distributed over as many
databases and clients as you like.
For small test subsets that are being used during testing the equat
On Wed, 22 Sep 2010 12:30:35 -0700, Brion Vibber wrote:
> On Wed, Sep 22, 2010 at 11:09 AM, Dan Nessett
> wrote:
>
>> Some have mentioned the possibility of using the wiki family logic to
>> help achieve these objectives. Do you have any thoughts on this? If you
>> think it is a good idea, how d
On Wed, 22 Sep 2010 12:30:35 -0700, Brion Vibber wrote:
> On Wed, Sep 22, 2010 at 11:09 AM, Dan Nessett
> wrote:
>
>> Some have mentioned the possibility of using the wiki family logic to
>> help achieve these objectives. Do you have any thoughts on this? If you
>> think it is a good idea, how d
On Wed, Sep 22, 2010 at 11:09 AM, Dan Nessett wrote:
> Some have mentioned the possibility of using the wiki family logic to
> help achieve these objectives. Do you have any thoughts on this? If you
> think it is a good idea, how do we find out more about it?
>
I'd just treat it same as any othe
On Wed, 22 Sep 2010 11:00:53 -0700, Brion Vibber wrote:
> Hmm, I think you guys are overthinking the details on this; let's step
> back a level.
>
> When you're running tests, you have these tasks: * create a blank-slate
> wiki to run tests in * populate the empty wiki with known data * run
> tes
Hmm, I think you guys are overthinking the details on this; let's step back
a level.
When you're running tests, you have these tasks:
* create a blank-slate wiki to run tests in
* populate the empty wiki with known data
* run tests on this wiki in a known state
* clean up in some way
The parserTe
> I just looked at SqlBagOStuff. It already has entry expiration logic.
> So, it seems perfect for use by the switch-in/clean-up functionality.
I spoke too soon. Expired entries are deleted automatically when any
entry is referenced. Unfortunately, that means there is no opportunity to
reclaim t
On Wed, 22 Sep 2010 18:57:12 +0200, Bryan Tong Minh wrote:
> On Wed, Sep 22, 2010 at 6:47 PM, Dan Nessett wrote:
>>
>> I think the object cache and memcached are alternative ways of storing
>> persistent data. (I also am not an expert in this, so I could be
>> wrong). My understanding is memcache
On Wed, 22 Sep 2010 19:35:31 +0200, Roan Kattouw wrote:
> 2010/9/22 Dan Nessett :
>> How does memcached fit into this? When I looked at BagOStuff, I didn't
>> find a MemcacheBagOStuff class. Is it defined elsewhere?
>>
> Either memcached.php, MemCached.php or MWMemcached.php, I forget. The
> class
2010/9/22 Dan Nessett :
> How does memcached fit into this? When I looked at BagOStuff, I didn't
> find a MemcacheBagOStuff class. Is it defined elsewhere?
>
Either memcached.php, MemCached.php or MWMemcached.php, I forget. The
class name is MWMemcached.
Roan Kattouw (Catrope)
___
On Wed, 22 Sep 2010 18:57:12 +0200, Bryan Tong Minh wrote:
> On Wed, Sep 22, 2010 at 6:47 PM, Dan Nessett wrote:
>>
>> I think the object cache and memcached are alternative ways of storing
>> persistent data. (I also am not an expert in this, so I could be
>> wrong). My understanding is memcache
On Wed, Sep 22, 2010 at 6:47 PM, Dan Nessett wrote:
>
> I think the object cache and memcached are alternative ways of storing
> persistent data. (I also am not an expert in this, so I could be wrong).
> My understanding is memcached uses the memcached daemon (http://
> memcached.org/), while the
On Wed, 22 Sep 2010 15:49:40 +0200, Markus Glaser wrote:
> Hi,
>
> here are my thoughts about phpunit and selenium testing.
>
>> The wiki under test is set up with a master database consisting of a
>> single objectcache table. The entries of this table specify a test run
>> identifier as primary
Hi,
here are my thoughts about phpunit and selenium testing.
> The wiki under test is set up with a master database consisting of a single
> objectcache table.
> The entries of this table specify a test run identifier as primary key
> and temporary resource identifiers as dependent fields.
If I
On Mon, 20 Sep 2010 22:32:24 +0200, Platonides wrote:
> Dan Nessett wrote:
>> On Sun, 19 Sep 2010 23:42:08 +0200, Platonides wrote:
>>> You load originaldb.objectcache, retrieve the specific configuration,
>>> and switch into it.
>>> For supporting many sumyltaneous configurations, the keyname cou
Dan Nessett wrote:
> On Sun, 19 Sep 2010 23:42:08 +0200, Platonides wrote:
>> You load originaldb.objectcache, retrieve the specific configuration,
>> and switch into it.
>> For supporting many sumyltaneous configurations, the keyname could have
>> the instance (whatever that cookie is set to) appe
On Sun, 19 Sep 2010 23:42:08 +0200, Platonides wrote:
> Dan Nessett wrote:
>> Platonides wrote:
>>> Dan Nessett wrote:
> What about memcached?
> (that would be a key based on the original db name)
The storage has to be persistent to accommodate wiki crashes (e.g.,
httpd cras
Dan Nessett wrote:
> Platonides wrote:
>> Dan Nessett wrote:
What about memcached?
(that would be a key based on the original db name)
>>>
>>> The storage has to be persistent to accommodate wiki crashes (e.g.,
>>> httpd crash, server OS crash, power outage). It might be possible to
>>> u
On Sun, 19 Sep 2010 02:47:00 +0200, Platonides wrote:
> Dan Nessett wrote:
>>> What about memcached?
>>> (that would be a key based on the original db name)
>>
>> The storage has to be persistent to accommodate wiki crashes (e.g.,
>> httpd crash, server OS crash, power outage). It might be possib
On Fri, 17 Sep 2010 19:13:33 +, Dan Nessett wrote:
> On Fri, 17 Sep 2010 18:40:53 +, Dan Nessett wrote:
>
>> I have been tasked to evaluate whether we can use the parserTests db
>> code for the selenium framework. I just looked it over and have serious
>> reservations. I would appreciate
Dan Nessett wrote:
>> What about memcached?
>> (that would be a key based on the original db name)
>
> The storage has to be persistent to accommodate wiki crashes (e.g., httpd
> crash, server OS crash, power outage). It might be possible to use
> memcachedb, but as far as I am aware that requir
On Sun, 19 Sep 2010 00:28:42 +0200, Platonides wrote:
>> Where to store the data is an open question, one that requires
>> consultation with others. However, here are some thoughts:
>>
>> + The data must be persistent. If the wiki crashes for some reason,
>> there may be cloned dbs and test-speci
Dan Nessett wrote:
> On Sat, 18 Sep 2010 00:53:04 +0200, Platonides wrote:
>
>>
>>> + Switch the wiki to use this db and return a cookie or some other
>>> state information that identifies this test run configuration.
>>
>> I think you mean for remote petitions, not just for internal queries,
>> w
On Sat, 18 Sep 2010 00:53:04 +0200, Platonides wrote:
>
>> + Switch the wiki to use this db and return a cookie or some other
>> state information that identifies this test run configuration.
>
> I think you mean for remote petitions, not just for internal queries,
> where do you expect to store
Dan Nessett wrote:
> After reflection, here are some other problems.
>
> + Some tests assume the existence of data in the db. For example, the
> PagedTiffHandler tests assume the image Multipage.tiff is already loaded.
> However, this requires an entry in the image table. You could modify the
>
On Fri, 17 Sep 2010 21:05:12 +0200, Platonides wrote:
> Dan Nessett wrote:
>> Given this background, consider the following (and feel free to comment
>> on it):
>>
>> parserTests temporary table code:
>>
>> A fixed set of tables are specified in the code. parserTests creates
>> temporary tables
On Fri, 17 Sep 2010 18:40:53 +, Dan Nessett wrote:
> I have been tasked to evaluate whether we can use the parserTests db
> code for the selenium framework. I just looked it over and have serious
> reservations. I would appreciate any comments on the following analysis.
>
> The environment fo
Dan Nessett wrote:
> Given this background, consider the following (and feel free to comment
> on it):
>
> parserTests temporary table code:
>
> A fixed set of tables are specified in the code. parserTests creates
> temporary tables with the same name, but using a different static prefix.
> Th
I have been tasked to evaluate whether we can use the parserTests db code
for the selenium framework. I just looked it over and have serious
reservations. I would appreciate any comments on the following analysis.
The environment for selenium tests is different than that for
parserTests. It is
50 matches
Mail list logo