In order to fix make it possible to throw test errors in certain special
conditions, yet executing dependent tests,introduced a new public job API
and modified kvm_utils.run_tests logic.
Also modified preprocessing code to provide a feature asked for a long time:
make tests with dependencies failed to execute, but to throw a TestNA exception,
so our developers are not fooled with a high PASS rate on a job that had
a central dependency (such as KVM build) failed.
More info on the commit messages. John, I would like you to review only
the first patch, as it touches a very visible autotest API, so it is high
risk.
Lucas Meneghel Rodrigues (4):
client job: Introduce a run_test_detail method
KVM test: Fail a test right away if 'dependency_fail = yes' is on
params
KVM test: Refine image_check function
KVM test: Modify kvm_utils.run_tests to include non fatal failures
client/bin/job.py | 54 ++++++++++++++++++++++++++++++--
client/tests/kvm/kvm.py | 5 +++
client/tests/kvm/kvm_preprocessing.py | 1 -
client/tests/kvm/kvm_utils.py | 17 ++++++++--
client/tests/kvm/kvm_vm.py | 27 ++++++++++++++--
5 files changed, 92 insertions(+), 12 deletions(-)
--
1.7.4.2
_______________________________________________
Autotest mailing list
[email protected]
http://test.kernel.org/cgi-bin/mailman/listinfo/autotest
