Re: [openssl-dev] Regression testing?

2015-06-15 Thread Salz, Rich
> Thanks, very helpful! Is there a "minimum" number of systems/OSes this is > run on before a release goes out? Some linux distro. If there are vms- or windows-specific changes in the release that the team things are of concern, we try to test those as well. > Or is it always just "best effort

Re: [openssl-dev] Regression testing?

2015-06-15 Thread Valerie Fenwick
On 6/13/2015 7:11 AM, Salz, Rich wrote: I was wondering if there is a document anywhere describing what type of testing you do before releasing a new version of OpenSSL? Matt already gave some answers. Our biggest regression test is "make test" at the top-level. We've recently gotten muc

Re: [openssl-dev] Regression testing?

2015-06-14 Thread Krzysztof Kwiatkowski
Hi, It's pretty easy to run cppcheck. It also integrates quite well with jenkins, as there is cppcheck plugin available. You can find mine configuration right here if interested: http://amongbits.com:8090/job/openssl/ (guest/guest for login/pass) I don't have much experience with Coverity, b

Re: [openssl-dev] Regression testing?

2015-06-13 Thread Salz, Rich
> I was wondering if there is a document anywhere describing what type of > testing you do before releasing a new version of OpenSSL? Matt already gave some answers. Our biggest regression test is "make test" at the top-level. We've recently gotten much better at adding more tests... Any help

Re: [openssl-dev] Regression testing?

2015-06-13 Thread Salz, Rich
> Nice to see this continues build. Have you guys thought about creating one > build for static code analysis (f.e. integrating cppcheck)? So the FB folks seem to be interested in helping with infer, which is neat (see RT 3903). We periodically look at Coverity. What's involved in doing cppche

Re: [openssl-dev] Regression testing?

2015-06-12 Thread Krzysztof Kwiatkowski
Hey, Nice to see this continues build. Have you guys thought about creating one build for static code analysis (f.e. integrating cppcheck)? Kris On 06/13/2015 12:32 AM, Matt Caswell wrote: On 12/06/15 18:53, Valerie Fenwick wrote: Hi Folks - I was wondering if there is a document anywhere

Re: [openssl-dev] Regression testing?

2015-06-12 Thread Matt Caswell
On 12/06/15 18:53, Valerie Fenwick wrote: > Hi Folks - > > I was wondering if there is a document anywhere describing what type of > testing you do before releasing a new version of OpenSSL? I'm guessing > you don't test on every potential hardware platform, on every potential > operating system

[openssl-dev] Regression testing?

2015-06-12 Thread Valerie Fenwick
Hi Folks - I was wondering if there is a document anywhere describing what type of testing you do before releasing a new version of OpenSSL? I'm guessing you don't test on every potential hardware platform, on every potential operating system that OpenSSL is used on, but rather a subset. Is t