[jira] [Resolved] (LUCENE-5916) Static scope test components should be consistent between tests (and test iterations)

2014-09-01 Thread Erick Erickson (JIRA)
ent between tests (and test > iterations) > - > > Key: LUCENE-5916 > URL: https://issues.apache.org/jira/browse/LUCENE-5916 > Project: Lucene - Core >

[jira] [Commented] (LUCENE-5916) Static scope test components should be consistent between tests (and test iterations)

2014-09-01 Thread ASF subversion and git services (JIRA)
5916: - Commit 1621892 from [~erickoerickson] in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1621892 ] LUCENE-5916: Static scope test components should be consistent between tests (and test iterations) > Static scope test components should be consistent between tests (and t

[jira] [Updated] (LUCENE-5916) Static scope test components should be consistent between tests (and test iterations)

2014-09-01 Thread Erick Erickson (JIRA)
ope test components should be consistent between tests (and test > iterations) > - > > Key: LUCENE-5916 > URL: https://issues.apache.org/jira/browse/LUCENE-5916 >

[jira] [Commented] (LUCENE-5916) Static scope test components should be consistent between tests (and test iterations)

2014-09-01 Thread ASF subversion and git services (JIRA)
5916: - Commit 1621889 from [~erickoerickson] in branch 'dev/trunk' [ https://svn.apache.org/r1621889 ] LUCENE-5916: Static scope test components should be consistent between tests (and test iterations) > Static scope test components should be consistent between tests (and t

[jira] [Updated] (LUCENE-5916) Static scope test components should be consistent between tests (and test iterations)

2014-09-01 Thread Dawid Weiss (JIRA)
nts should be consistent between tests (and test > iterations) > - > > Key: LUCENE-5916 > URL: https://issues.apache.org/jira/browse/LUCENE-5916 > P

[jira] [Created] (LUCENE-5916) Static scope test components should be consistent between tests (and test iterations)

2014-09-01 Thread Dawid Weiss (JIRA)
Dawid Weiss created LUCENE-5916: --- Summary: Static scope test components should be consistent between tests (and test iterations) Key: LUCENE-5916 URL: https://issues.apache.org/jira/browse/LUCENE-5916

RE: Test iterations

2014-08-09 Thread Uwe Schindler
8 PM > To: dev@lucene.apache.org > Subject: RE: Test iterations > > Slightly improved patch: > forbidding tests.iters is not needed. It still makes sense to beast 20 rounds > and each test repeated (with same static class seed) 20 times, too -> 400 > reps. Also more groovy-like

RE: Test iterations

2014-08-09 Thread Uwe Schindler
.de eMail: u...@thetaphi.de > -Original Message- > From: Uwe Schindler [mailto:u...@thetaphi.de] > Sent: Saturday, August 09, 2014 8:08 PM > To: dev@lucene.apache.org > Subject: RE: Test iterations > > Hi, > > attached you will find the beaster: > > - O

RE: Test iterations

2014-08-09 Thread Uwe Schindler
hi.de] > Sent: Friday, August 08, 2014 8:13 PM > To: dev@lucene.apache.org > Subject: RE: Test iterations > > Hi, > > I will look into that as a Groovy Skript: The main problem is: You cannot > simply > use in a loop, because this would also execute the dependenci

Re: Test iterations

2014-08-08 Thread Dawid Weiss
Mail: u...@thetaphi.de > > >> -Original Message- >> From: Ryan Ernst [mailto:r...@iernst.net] >> Sent: Friday, August 08, 2014 5:08 PM >> To: dev@lucene.apache.org >> Subject: Re: Test iterations >> >> Thanks for the extremely thorough ans

RE: Test iterations

2014-08-08 Thread Uwe Schindler
, 2014 5:08 PM > To: dev@lucene.apache.org > Subject: Re: Test iterations > > Thanks for the extremely thorough answer, Dawid! Entertaining as always. :) > > > Should we provide this "beaster" in common-build? > > I would use it! It sounds like there is

Re: Test iterations

2014-08-08 Thread Ryan Ernst
ers - >> and comes embedded... >> >> Uwe >> >> - >> Uwe Schindler >> H.-H.-Meier-Allee 63, D-28213 Bremen >> http://www.thetaphi.de >> eMail: u...@thetaphi.de >> >> >>> -Original Message- >>> Fro

Re: Test iterations

2014-08-08 Thread Michael McCandless
akes it easier to use for the python haters - and > comes embedded... > > Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > >> -Original Message- >> From: Michael McCandless [mailto

RE: Test iterations

2014-08-08 Thread Uwe Schindler
Original Message- > From: Michael McCandless [mailto:luc...@mikemccandless.com] > Sent: Friday, August 08, 2014 3:48 PM > To: Lucene/Solr dev > Subject: Re: Test iterations > > On Fri, Aug 8, 2014 at 9:35 AM, Uwe Schindler wrote: > > Hi Dawid, > > > > Thanks for

Re: Test iterations

2014-08-08 Thread Michael McCandless
On Fri, Aug 8, 2014 at 9:35 AM, Uwe Schindler wrote: > Hi Dawid, > > Thanks for the very good explanation! Indeed the main problem with > tests.iters is the static initializers. Maybe put that explanation into the > Wiki! I sometimes also need to remember it, so it should be documented. > > One

RE: Test iterations

2014-08-08 Thread Uwe Schindler
@lucene.apache.org > Subject: Re: Test iterations > > Hi Ryan, > > So. I discussed this a while ago, but here it comes again. Let me first clear > a > few things from what you said. > > > Only in the last month or so did I learn that -Dtests.iters doesn't really

Re: Test iterations

2014-08-08 Thread Dawid Weiss
Hi Ryan, So. I discussed this a while ago, but here it comes again. Let me first clear a few things from what you said. > Only in the last month or so did I learn that -Dtests.iters doesn't really > "work". What I mean is in regards to randomization. This is not true. It works (as I will expla

Re: Test iterations

2014-08-07 Thread Dawid Weiss
It is a longer story, Ryan. And *not* a trivial change to the runner. I will reply tomorrow. I am at a pub right now. To you, cheers :) On Aug 7, 2014 11:36 PM, "Ryan Ernst" wrote: > Only in the last month or so did I learn that -Dtests.iters doesn't > really "work". What I mean is in regards to

Test iterations

2014-08-07 Thread Ryan Ernst
Only in the last month or so did I learn that -Dtests.iters doesn't really "work". What I mean is in regards to randomization. Each iteration currently is *exactly* the same as far as randomization (each iteration uses the same master seed). And because of this, I understand that different peopl