#20647: Tor and Chutney CI improvements -------------------------------------------------+------------------------- Reporter: chelseakomlo | Owner: (none) Type: enhancement | Status: | assigned Priority: High | Milestone: Tor: | 0.4.2.x-final Component: Core Tor/Tor | Version: Severity: Normal | Resolution: Keywords: test, chutney, consistency, | Actual Points: jenkins, integration-testing, continuous- | integration, postfreeze-ok, teor- | unreached-2019-03-08, tor-ci, | 041-deferred-20190530, 042-can | Parent ID: | Points: Reviewer: weasel | Sponsor: -------------------------------------------------+-------------------------
Old description: > It would be nice for chutney tests to be run on every build. > > However, because chutney tests cannot be entirely deterministic (although > we can do more work to get them closer), this probably should not block > the build if tests fail (at least for the short term & we eliminate as > much flakiness as possible). New description: We currently run chutney tests on every Tor and Chutney branch and pull request. We deal with non-determinism by allowing a small number of chutney failures, before reporting an overall test failure. But sometimes failures are hard to diagnose. This ticket is a parent ticket for improvements that help us diagnose chutney failures. -- Comment (by teor): Update description. -- Ticket URL: <https://trac.torproject.org/projects/tor/ticket/20647#comment:24> Tor Bug Tracker & Wiki <https://trac.torproject.org/> The Tor Project: anonymity online
_______________________________________________ tor-bugs mailing list tor-bugs@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs