There has to be some distinction between nightly and regular runs --
for jenkins, we pass tests.nightly anyway to make this distinction
clear. You'd have to configure an appropriate filter for your jenkins
job.
> Is it possible to ignore specified tests as BadApples or AwaitsFix but only
> for nightly runs?
You can do it manually by adding @BeforeClass
assumeTrue(!"true".equals(System.getProperty("tests.nightly")))?
Dawid
On Wed, Jun 10, 2015 at 9:40 PM, Mark Miller <[email protected]> wrote:
> Hmm...is there any way to get this behavior somehow via just annotations
> though? It doesn't really work for my use case if it has to be specified
> from the command line.
>
> On Tue, Jun 9, 2015 at 2:46 PM Mark Miller <[email protected]> wrote:
>>
>> Thanks!
>>
>> On Tue, Jun 9, 2015 at 2:28 PM Dawid Weiss <[email protected]> wrote:
>>>
>>> > don't have such persistent issues on non nightly runs. Is it possible
>>> > to
>>> > ignore specified tests as BadApples or AwaitsFix but only for nightly
>>> > runs?
>>>
>>> Sure, that's what test group filtering was added for. It's interesting
>>> that test-help doesn't show anything... ES has a more verbose info:
>>>
>>> You can also filter tests by certain annotations ie:
>>>
>>> * `@Slow` - tests that are know to take a long time to execute
>>> * `@Nightly` - tests that only run in nightly builds (disabled by
>>> default)
>>> * `@Integration` - integration tests
>>> * `@Backwards` - backwards compatibility tests (disabled by default)
>>> * `@AwaitsFix` - tests that are waiting for a bugfix (disabled by
>>> default)
>>> * `@BadApple` - tests that are known to fail randomly (disabled by
>>> default)
>>>
>>> Those annotation names can be combined into a filter expression like:
>>>
>>> ------------------------------------------------
>>> mvn test -Dtests.filter="@nightly and not @slow"
>>> ------------------------------------------------
>>>
>>> to run all nightly test but not the ones that are slow. `tests.filter`
>>> supports
>>> the boolean operators `and, or, not` and grouping ie:
>>>
>>> ---------------------------------------------------------------
>>> mvn test -Dtests.filter="@nightly and not(@slow or @backwards)"
>>> ---------------------------------------------------------------
>>>
>>> The same works for Lucene (-Dtests.filter=...), try it.
>>>
>>> Dawid
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: [email protected]
>>> For additional commands, e-mail: [email protected]
>>>
>> --
>> - Mark
>> about.me/markrmiller
>
> --
> - Mark
> about.me/markrmiller
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
