Re: [yocto] oeqa: test cases at the end of the test suite

2021-01-04 Thread Ross Burton
On Mon, 4 Jan 2021 at 10:50, Konrad Weihmann  wrote:
> I have a few oeqa test cases, which always should run last in a test
> suite (log and file collectors for instance).

Those are not test cases then, surely.  If you want to run actions
after test cases to collect log files then I'd implement that as a
decorator on the test cases.

Ross

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#51877): https://lists.yoctoproject.org/g/yocto/message/51877
Mute This Topic: https://lists.yoctoproject.org/mt/79421525/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [yocto] oeqa: test cases at the end of the test suite

2021-01-04 Thread Alexander Kanavin
I'd say improving the actual test ordering function is the way to go, yes.
Not sure how the ordering 'hint' should be like, but maybe setting an
integer priority via a decorator would work:
@OETestPriority(1) ---> runs first, no guarantees about relative order of
other tests with priority 1.
@OETestPriority(99) ---> runs last, ditto.
Default priority: 50 or similar.

Alex

On Mon, 4 Jan 2021 at 11:51, Konrad Weihmann  wrote:

> Hi all,
>
> I have a few oeqa test cases, which always should run last in a test
> suite (log and file collectors for instance).
> Due to the ordering of the test case discovery I had to name all those
> tests like "zzz_" to move them to the end of the computed list.
>
> Unfortunately this is very error prone, as the OETestDepends tag does
> have major influence on the ordering (just a single misplaced tag in any
> test case can make it past those "zzz" cases).
> Also it makes things hard to read IMO.
>
> That brings me to my question, is there any way to ensure that test
> cases are run at the end of the complete list of test suites?
>
> If not does anyone have an idea how to create such a feature (maybe a
> new decorator or something like that)?
>
> Regards
> Konrad
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#51876): https://lists.yoctoproject.org/g/yocto/message/51876
Mute This Topic: https://lists.yoctoproject.org/mt/79421525/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-