I just came across 2 more :/ I'm also in favor of tracking these with JIRA. How about "test-stability" for a label?
-V. On 21 August 2015 at 12:47, Matthias J. Sax <mj...@informatik.hu-berlin.de> wrote: > I like the idea with the special label. Otherwise, it will be difficult > to find the correct tickets. > > -Matthias > > On 08/21/2015 12:15 PM, Till Rohrmann wrote: > > I'm also in favor of JIRA, because I fear that nobody will keep the wiki > > page in sync. Maybe we can assign a special label for test stability to > > these JIRA issues. Then we can quickly find all currently instable test > > cases. > > > > On Fri, Aug 21, 2015 at 11:02 AM, Robert Metzger <rmetz...@apache.org> > > wrote: > > > >> I agree that we should look for a solution other than opening a lot of > >> small discussion threads on the mailing list. > >> > >> When I have a test failure, I usually search my gmail inbox to see > whether > >> somebody else wrote something about the error already. > >> Creating a JIRA for each failing test might be a better approach. > Because > >> that's what bugtrackers are made for ;) (And the issues still pop up > when > >> doing a gmail search) > >> > >> On Thu, Aug 20, 2015 at 10:16 PM, Matthias J. Sax < > >> mj...@informatik.hu-berlin.de> wrote: > >> > >>> Thanks for the info. > >>> > >>> Over the weeks I lost track which errors/failing/instable tests are > know > >>> an which not. Should we start a wiki page or similar to collect know > >>> errors? If a test fails on a know error, it can just be ignored. This > >>> would avoid "spam" on the mailing list. > >>> > >>> Any thoughts about this? > >>> > >>> -Matthias > >>> > >>> On 08/20/2015 10:08 PM, Robert Metzger wrote: > >>>> Sachin saw the error as well, as reported here: > >>>> https://issues.apache.org/jira/browse/FLINK-2468 > >>>> I also see it from time to time.I have a wip branch where I relaxed > the > >>>> constraints for the test to pass a bit. > >>>> > >>>> On Thu, Aug 20, 2015 at 10:05 PM, Matthias J. Sax < > >>>> mj...@informatik.hu-berlin.de> wrote: > >>>> > >>>>> Error message is: > >>>>> > >>>>>> Failed tests: > >>>>>> > >>>>> > >>> > >> > StateCheckpoinedITCase>StreamFaultToleranceTestBase.runCheckpointedProgram:103->postSubmit:98 > >>>>> Test inconclusive: failure occurred before first checkpoint > >>>>> > >>>>> See: https://travis-ci.org/mjsax/flink/jobs/76483093 > >>>>> > >>>>> > >>>>> -Matthias > >>>>> > >>>>> > >>>> > >>> > >>> > >> > > > >
