Re: [PATCH v2 1/8] evmtest: Regression testing integrity subsystem

2019-03-22 Thread Petr Vorel
Hi David, > $ evmtest runtest example_test -e /bin/bash > [*] Starting test: example_test > [*] TEST: PASSED > Example 1a: successful verbose example test output > $ evmtest runtest example_test -e /bin/bash -v ... > Changelog: ... > * checkbashishms compliant Not yet :). I noticed using source

[PATCH v2 1/8] evmtest: Regression testing integrity subsystem

2019-03-22 Thread djacobs7
From: David Jacobson As the Linux integrity subsystem matures and new features are added, the number of kernel configuration options (Kconfig) and methods for loading policies have increased. Regression testing of new and existing features is needed to ensure correct behavior. The Linux Test

Re: [PATCH 1/7] evmtest: Regression testing Integrity Subsystem

2018-08-22 Thread Dmitry Kasatkin
Hi, I will have a look to patches. Thanks, Dmitry On Tue, Aug 14, 2018 at 9:34 PM James Morris wrote: > > On Tue, 14 Aug 2018, David Jacobson wrote: > > > This patchset introduces evmtest — a stand alone tool for regression > > testing IMA. > > Nice! > > I usu

Re: [PATCH 1/7] evmtest: Regression testing Integrity Subsystem

2018-08-14 Thread James Morris
On Tue, 14 Aug 2018, David Jacobson wrote: > This patchset introduces evmtest — a stand alone tool for regression > testing IMA. Nice! I usually run the SELinux testsuite as a general sanity check of LSM before pushing to Linus, and I'll also run this once it's merged. -- James Morris

[PATCH 1/7] evmtest: Regression testing Integrity Subsystem

2018-08-14 Thread David Jacobson
regression testing IMA. evmtest can be used to validate individual behaviors by exercising execve, kexec, module load, and other LSM hooks. evmtest uses a combination of invalid signatures, invalid hashes, and unsigned files to check that IMA-Appraisal catches all cases a running policy has set

Re: [PATCH blktests v2] loop/002: Regression testing for loop device flush

2017-08-18 Thread James Wang
No problem thank you sir 发自我的 iPhone > 在 2017年8月18日,16:11,Omar Sandoval 写道: > >> On Tue, Jun 27, 2017 at 12:01:47PM +0800, James Wang wrote: >> Add a regression testing for loop device. when an unbound device >> be close that take too long time. kernel will consu

Re: [PATCH blktests v2] loop/002: Regression testing for loop device flush

2017-08-18 Thread Omar Sandoval
On Tue, Jun 27, 2017 at 12:01:47PM +0800, James Wang wrote: > Add a regression testing for loop device. when an unbound device > be close that take too long time. kernel will consume serveral orders > of magnitude more wall time than it does for a mounted device. James, sorry I forgot a

[PATCH blktests v2] loop/002: Regression testing for loop device flush

2017-06-26 Thread James Wang
Add a regression testing for loop device. when an unbound device be close that take too long time. kernel will consume serveral orders of magnitude more wall time than it does for a mounted device. Signed-off-by: James Wang --- tests/loop/002 | 63

Re: [PATCH blktests] loop/002: Regression testing for loop device flush

2017-06-26 Thread James Wang
On 06/27/2017 02:58 AM, Omar Sandoval wrote: > Hi, James, thanks for sending this in. Sorry for the delay, I've been > out of the office for a couple of weeks. A few comments below. > > On Thu, Jun 08, 2017 at 08:28:12PM +0800, James Wang wrote: >> Add a regression testin

Re: [PATCH blktests] loop/002: Regression testing for loop device flush

2017-06-26 Thread Omar Sandoval
Hi, James, thanks for sending this in. Sorry for the delay, I've been out of the office for a couple of weeks. A few comments below. On Thu, Jun 08, 2017 at 08:28:12PM +0800, James Wang wrote: > Add a regression testing for loop device. when an unbound device > be close that take to

Re: [PATCH blktests] loop/002: Regression testing for loop device flush

2017-06-08 Thread Jens Axboe
On 06/08/2017 06:28 AM, James Wang wrote: > Add a regression testing for loop device. when an unbound device > be close that take too long time. kernel will consume serveral orders > of magnitude more wall time than it does for a mounted device. Thanks a lot for taking the time to turn

[PATCH blktests] loop/002: Regression testing for loop device flush

2017-06-08 Thread James Wang
Add a regression testing for loop device. when an unbound device be close that take too long time. kernel will consume serveral orders of magnitude more wall time than it does for a mounted device. Signed-off-by: James Wang --- tests/loop/002 | 77

[RFC] Add Debugger Test to Typical Regression Testing

2016-01-21 Thread Jeff Merkey
Based on recent bugs I have seen in Linux, I recommend to those involved in regression testing of linux build tree to add a debugger test to regression for kgdb, kdb, and mdb as a part of your standard tests to flush out bugs in various drivers and subsystems. The test is simple. Load one of the

[PATCH 2/3] selftests:vm: Point to libhugetlbfs for regression testing

2015-07-30 Thread Mike Kravetz
The hugetlb selftests provide minimal coverage. Have run script point people at libhugetlbfs for better regression testing. Signed-off-by: Mike Kravetz --- tools/testing/selftests/vm/run_vmtests | 4 1 file changed, 4 insertions(+) diff --git a/tools/testing/selftests/vm/run_vmtests b

Re: perf tools regression testing was Re: [PATCH v3 1/9] perf hists: Move hists_init() from util/evsel.c to util/hist.c

2012-09-25 Thread Arnaldo Carvalho de Melo
Em Tue, Sep 25, 2012 at 10:47:48PM +0900, Namhyung Kim escreveu: > 2012-09-25 (화), 10:30 -0300, Arnaldo Carvalho de Melo: > > Em Tue, Sep 25, 2012 at 09:59:02PM +0900, Namhyung Kim escreveu: > > > Now I'm thinking of making it build-time test so that it can be executed > > > by make when specific a

Re: perf tools regression testing was Re: [PATCH v3 1/9] perf hists: Move hists_init() from util/evsel.c to util/hist.c

2012-09-25 Thread Namhyung Kim
2012-09-25 (화), 10:30 -0300, Arnaldo Carvalho de Melo: > Em Tue, Sep 25, 2012 at 09:59:02PM +0900, Namhyung Kim escreveu: > > Now I'm thinking of making it build-time test so that it can be executed > > by make when specific argument is given - e.g. make C=1 ? > > I think there is room for a 'make

perf tools regression testing was Re: [PATCH v3 1/9] perf hists: Move hists_init() from util/evsel.c to util/hist.c

2012-09-25 Thread Arnaldo Carvalho de Melo
Em Tue, Sep 25, 2012 at 09:59:02PM +0900, Namhyung Kim escreveu: > 2012-09-25 (화), 08:05 -0300, Arnaldo Carvalho de Melo: > > Em Tue, Sep 25, 2012 at 10:25:13AM +0900, Namhyung Kim escreveu: > > > On Mon, 24 Sep 2012 13:02:39 -0300, Arnaldo Carvalho de Melo wrote: > > > > Em Mon, Sep 24, 2012 at 11

Re: regression testing

2001-03-26 Thread Werner Almesberger
Eric W. Biederman wrote: > Yes user-mode linux > could help here (you could stress test the core kernel without worry > that when it crashes your machine will crash as well). A similar approach can be used for very detailed tests of specific subsystems. E.g. that's what we've started doing, kin

Re: regression testing

2001-03-23 Thread Rik van Riel
On Fri, 23 Mar 2001, Horst von Brand wrote: > Jonathan Morton <[EMAIL PROTECTED]> said: > > >- automated heavy stress testing > > > This would be an interesting one to me, from a benchmarking POV. I'd like > > to know what my hardware can really do, for one thing - it's all very well > > saying

Re: regression testing

2001-03-23 Thread Horst von Brand
Jonathan Morton <[EMAIL PROTECTED]> said: > >- automated heavy stress testing > This would be an interesting one to me, from a benchmarking POV. I'd like > to know what my hardware can really do, for one thing - it's all very well > saying this box can do X Whetstones and has a 100Mbit NIC, but

Re: regression testing

2001-03-23 Thread Eric W. Biederman
[EMAIL PROTECTED] writes: > Hi. I was wondering if there has been any discussion of kernel > regression testing. Wouldn't it be great if we didn't have to depend > on human testers to verify every change didn't break something? There is a some truth to this. Howeve

RE: regression testing

2001-03-22 Thread Torrey Hoffman
thousands of new machines on board for continuous testing, keeping it a community effort. Not that the testing work of IBM, SGI, Red Hat, et. al. is unappreciated, but a distributed, open, regression testing package sort of fits the Linux philosophy and model... Torrey Hoffman - To un

Re: regression testing

2001-03-22 Thread Jonathan Morton
>- automated heavy stress testing This would be an interesting one to me, from a benchmarking POV. I'd like to know what my hardware can really do, for one thing - it's all very well saying this box can do X Whetstones and has a 100Mbit NIC, but it's a much more solid thing to be able to say "my

Re: regression testing

2001-03-22 Thread Cort Dougan
} On 22 Mar 2001 [EMAIL PROTECTED] wrote: } } > Hi. I was wondering if there has been any discussion of kernel } > regression testing. Wouldn't it be great if we didn't have to depend } > on human testers to verify every change didn't break something? } > } >

Re: regression testing

2001-03-22 Thread Cort Dougan
We have a start for PPC. It has the title "Regression Tester" but is actually a "compiles and boots tester". The aim is a automated regression test. Take a look at http://altus.drgw.net/ It pulls directly from our BitKeeper archive every time we push a change and goes through the build targete

Re: regression testing

2001-03-22 Thread Nathan Dabney
usand square feet of space, and a good budget.... > > Any takers? > > SGI is working on regression testing for Linux. We have released some > of our tests and utilities under the Linux Test Project. IMHO, a few > hundred tests aren't enough. I need to make another big push wit

Re: regression testing

2001-03-22 Thread Rik van Riel
On 22 Mar 2001 [EMAIL PROTECTED] wrote: > Hi. I was wondering if there has been any discussion of kernel > regression testing. Wouldn't it be great if we didn't have to depend > on human testers to verify every change didn't break something? This is definately a great

Re: regression testing

2001-03-22 Thread Nathan Straz
On Thu, Mar 22, 2001 at 10:13:04AM -0500, Wade Hampton wrote: > [EMAIL PROTECTED] wrote: > > Hi. I was wondering if there has been any discussion of kernel > > regression testing. Wouldn't it be great if we didn't have to depend > > on human testers to verify ever

Re: regression testing

2001-03-22 Thread Wade Hampton
[EMAIL PROTECTED] wrote: > > Hi. I was wondering if there has been any discussion of kernel > regression testing. Wouldn't it be great if we didn't have to depend > on human testers to verify every change didn't break something? IMHO, much of the strength of Linux i

Re: regression testing

2001-03-22 Thread Alan Cox
> Regression testing __is__ what happens when 10,000 testers independently > try to break the software! Nope. Thats stress testing and a limited amount of coverage testing. > Canned so-called "regression-test" schemes will fail to test at least > 90 percent of the code p

Re: regression testing

2001-03-22 Thread Richard B. Johnson
On Thu, 22 Mar 2001, Alan Cox wrote: > > Regression testing __is__ what happens when 10,000 testers independently > > try to break the software! > > Nope. Thats stress testing and a limited amount of coverage testing. > > > Canned so-called "regression-test&quo

Re: regression testing

2001-03-22 Thread nbecker
>>>>> "Richard" == Richard B Johnson <[EMAIL PROTECTED]> writes: Richard> On 22 Mar 2001 [EMAIL PROTECTED] wrote: >> Hi. I was wondering if there has been any discussion of kernel >> regression testing. Wouldn't it be great if

Re: regression testing

2001-03-22 Thread Richard B. Johnson
On 22 Mar 2001 [EMAIL PROTECTED] wrote: > Hi. I was wondering if there has been any discussion of kernel > regression testing. Wouldn't it be great if we didn't have to depend > on human testers to verify every change didn't break something? > > OK, I'll

regression testing

2001-03-22 Thread nbecker
Hi. I was wondering if there has been any discussion of kernel regression testing. Wouldn't it be great if we didn't have to depend on human testers to verify every change didn't break something? OK, I'll admit I haven't given this a lot of thought. What I'm wond