On Wed, Sep 26, 2012 at 8:53 PM, Matt Corallo <bitcoin-l...@bluematt.me> wrote: > Jenkins currently just runs the test script after each new commit to > bitcoin (and provides binaries to anyone who wants them), so its pretty > basic (though jenkins has way more features than we use). The bitcoin > one lives at http://jenkins.bluematt.me/
Jenkins is excellent at cycling through tests, while additional external tools may bring some value they're not required. It's also essential to automate all tests that we really care are run— with our small active development group and volunteer contributors the only tests we can count on being run are the automated ones. Automated tests included with the software— or at least the source— are also the only way to have a good chance of catching gnarly platform interactions. I think more than talking about testing I think we need is actual testing. Code coverage from the current tests (e.g. bitcoin-test and a testnet sync) is very unimpressive, and while coverage isn't some magical silver bullet and does not, by itself, mean the tests are good flaws in uncovered code can't be detected by the tests. We also lack simple testing cycle documentation for people interested in testing manually to walk through, etc. I think all the meta discussion is not very useful until we actually have more substance to put into it. Otherwise I fear we're just building an airport by painting stripes and waiting for the planes to land... If someone wants to help and would like a list of some of the testing I think would be useful, ping me off-list and I can blast some suggestions. But I assume that anyone who actually wants to work on this isn't short of ideas, and at this point "work on what interests you, report what interesting thing you accomplish or discover" is probably a perfectly fine level of coordination. ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://ad.doubleclick.net/clk;258768047;13503038;j? http://info.appdynamics.com/FreeJavaPerformanceDownload.html _______________________________________________ Bitcoin-development mailing list Bitcoin-development@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bitcoin-development
