Hi Team,

I ran a few test cases related to vppinfra and noticed that some of them
returned the value as '0' while some returns a non-zero value.

Looking into the code it looks like, the return value is 0 when the test
case is a success and is non-zero for a failure.

I have observed that the below test cases return a non-zero output -
1. test_bihash_template
2. test_random fails with the following output
                test_random_main:72: known sequence check passes
                test_random_main:92: 1000 iterations, seed 7147
                0x00000000 iterations 0 repeats
                Aborted (core dumped)

Also, there are some test cases which pass (returns 0) with some warnings,
for example:
1. test_phash passes with the following output
                8-byte key 8 byte value test
                test_pfhash_main:121: key 0 bucket 1 lookup FAIL
                test_pfhash_main:121: key 1 bucket 1 lookup FAIL
                test_pfhash_main:121: key 2 bucket 1 lookup FAIL
                test_pfhash_main:121: key 3 bucket 1 lookup FAIL
                test_pfhash_main:139: key 0 bucket 1 lookup FAIL
                test_pfhash_main:139: key 1 bucket 1 lookup FAIL
                test_pfhash_main:139: key 2 bucket 1 lookup FAIL
                test_pfhash_main:139: key 3 bucket 1 lookup FAIL
                16-byte key test
                8-byte key test
                4-byte key test

2. test_timing_wheel passes with the following output
            test_timing_wheel_main:161: iter 10, events 100, seed 1, level
0: 3.4483e-10 - 8.8276e-8 secs, 2^0 - 2^8 clocks
            test_timing_wheel_main:308: 20 iter done 276 expired; ave.
error 2.3738e-11 +- 8.7304e-11, range 0.0000e0 3.4483e-10
            Error max      Fraction          Total      Count
            0.0000e0       93.1159%          93.1159%   257
            3.4483e-10     6.8841%           100.0000%  19
            test_timing_wheel_main:339: level 0: 3.4483e-10 - 8.8276e-8
secs, 2^0 - 2^8 clocks
                            time base advances 0, every 7.4051e-1 secs
                            level 0: refills 0

All I wanted to confirm is whether these test cases are sufficient evidence
for the functional testing of the "vppinfra" component.

Do I need to look further?

All your comments are more than welcome.

Thanks,
Ayush
_______________________________________________
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Reply via email to