On Thu, Aug 16, 2012 at 2:39 PM, Justin Dolske <dol...@mozilla.com> wrote:
> On 8/16/12 8:10 AM, Ehsan Akhgari wrote: > > I think it makes sense for us if we can start this effort on the reftest >> framework, since that has a much lower barrier to entry, and ultimately >> this effort would be valuable only if other browser engines start to use >> our tests (and hopefully share theirs with us as well). >> > > Is there a concrete plan for getting other browsers to run these shared > tests? > > The basic idea here sounds worthy, but one concern is that our own tests > are often unreliable in our own browser -- and I'd expect that to only get > worse as other browsers and their tests enter the picture. I'd therefore > suggest that a successful cross-browser test effort should prioritize > getting stuff running (even with just a handful of tests)... That way fun > problems like reliability have a chance to be found/fixed over time, > instead of having a megatestsuite suddenly appear that's unappealing to get > working. That's not really true. Most of our mochitests and reftests are pretty solid. I don't think reliability will be a huge issue, and reliability problems due to bad tests can be fixed quite easily. - Kyle _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
