[
https://issues.apache.org/jira/browse/HBASE-21319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653069#comment-16653069
]
Sean Busbey commented on HBASE-21319:
-------------------------------------
I am talking about the nightly job. the nightly job does not run flakey tests.
there's a different job that runs more frequently to run tests labeled as flaky.
blanks means that test didn't run. in general shortly after a red box on
nightly you should start seeing blanks for that test, presuming the job to find
flaky tests is still running.
one big gap on the current dashboard is that tests that have no failures aren't
shown. tests that fail in nightly start showing blanks there once they're in
the list, as we expect. but if they then don't fail at all in the job that just
runs the flakey list you won't see them lower on the page where we have the
results of the flakey job.
for example, TestHBaseTestingUtility. You can see it in the dashboard in the
nightly list the one time it fails, but it isn't in the flaky job results on
the dashboad.
if you go to the test result analyzer for the "run flaky tests" job:
https://builds.apache.org/job/HBase-Flaky-Tests/job/master/test_results_analyzer/
and search for "TestHBaseTestingUtility" you'll see that it's running and
passing consistently.
> The nightly jobs should run 'mvn test' with '-fn'
> -------------------------------------------------
>
> Key: HBASE-21319
> URL: https://issues.apache.org/jira/browse/HBASE-21319
> Project: HBase
> Issue Type: Improvement
> Components: test
> Reporter: Duo Zhang
> Priority: Major
>
> For now, it will fail in the middle if there are failures. I think for a
> nightly job we should run all the UTs.
> The nightly pipeline is complicated and uses yetus so I'm not sure how to fix
> it...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
