Generally, we don't run fuzz testing suites with the rest of the regression
tests due to the length of time they take to run, but rather run them
periodically (for instance, before releases), fixing any issues they that
show up. Fuzz tests tend to cover much more ground at the cost of a longer
run time.
-Sam
On Sun, Dec 6, 2009 at 3:00 PM, Dirk Schulze wrote:
> Hi Maciej and Darin,
>
> you both suggested to add fuzz tests for SVG Filters. I looked at the
> fuzz test LayoutTest/svg/dom/fuzz-path-parser.html. As an analogy to
> this test, I would suggest an array with the effects to test, it's
> number of inputs and attributes, that can't be randomly set.
> But the basic question is, what should the fuzz test test?
> The combination of different effects? Should every filter effect have
> it's own fuzz test with a default input? Different sizes of effects?
> We need to keep in mind, that LayoutTests will slow down, as more
> comlpex the fuzz tests get.
>
> Regards,
> Dirk
>
> Am Freitag, den 04.12.2009, 11:06 -0800 schrieb Maciej Stachowiak:
> > On Dec 4, 2009, at 11:02 AM, Dirk Schulze wrote:
> >
> > >> What kinds of tests do we have for the code already? Do we have
> > >> code that tries to exercise edge cases? Do we have a fuzzer of some
> > >> sort?
> > >>
> > >>-- Darin
> > >
> > > Every effect that was implemented has at least one test. They are
> > > mostly
> > > simple test cases that just test one effect at once but there are also
> > > more complex tests, to see the behavior on combining different
> > > effects.
> > > I try to address the different edge cases of every filter effect and
> > > add
> > > more tests if necessary.
> > > Mainly effects with pixel manipulation already have more than one test
> > > to target different edge cases.
> >
> > I think the feature is ready to be enabled by default.
> >
> > One thing that would strongly increase my confidence in actually
> > shipping it would be some form of fuzz testing. Design review by
> > security experts would also help, but that is hard to arrange. Whereas
> > anyone can write a fuzz tester.
> >
> > Regards,
> > Maciej
>
>
> ___
> webkit-dev mailing list
> webkit-dev@lists.webkit.org
> http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev
>
___
webkit-dev mailing list
webkit-dev@lists.webkit.org
http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev