Anoop Sharma created TRAFODION-3027:
---------------------------------------

             Summary: Enhance jenkins check tests to include more tests
                 Key: TRAFODION-3027
                 URL: https://issues.apache.org/jira/browse/TRAFODION-3027
             Project: Apache Trafodion
          Issue Type: Improvement
            Reporter: Anoop Sharma
            Assignee: Anoop Sharma


Jenkins runs regress/core and regress/seabase tests during committer 
deliveries.  Those tests are called the checktests. It is done to validate that 
the change does not break some of the basic tests.

The enhancement in this Jira extends checktests to include more tests from 
other directories besides core and seabase. That increases code/test coverage 
and the probability of detecting if the change has broken something.

List of tests that will be run is maintained in regress/tools directory. The 
checktest list can be modified as needed but the actual test will remain in 
original directory. Any changes to test/expected/filter, etc need to be made in 
the original dir. This makes it easy to include or remove particular tests that 
should be run.

There will be 2 test run dirs.: checktest1 and checktest2. Contents as well as 
output of checktest1/checktest2 run is shown below.

It shows the specific dir/test that were run, duration of that test and the 
total time taken. Rerunning tests or subset of tests will show the correct 
duration whenever that tests were run.

 

checktest1:


{{dir/TEST StartTime Duration Status }}
{{========= ========== ========= ======= }}

{{core/TEST000 2018-04-17 22:19:25 00:00:38 ### PASS ###}}
{{core/TEST001 2018-04-17 22:20:04 00:01:03 ### PASS ###}}
{{core/TEST002 2018-04-17 22:21:08 00:02:49 ### PASS ###}}
{{core/TEST005 2018-04-17 22:23:57 00:06:27 ### PASS ###}}
{{core/TEST032 2018-04-17 22:30:25 00:03:42 ### PASS ###}}
{{core/TEST056 2018-04-17 22:34:08 00:16:57 ### PASS ###}}
{{core/TEST116 2018-04-17 22:51:06 00:09:10 ### PASS ###}}
{{core/TESTRTS 2018-04-17 23:00:16 00:04:48 ### PASS ###}}
{{compGeneral/TEST006 2018-04-17 23:05:05 00:05:34 ### PASS ###}}
{{compGeneral/TEST015 2018-04-17 23:10:40 00:14:05 ### PASS ###}}
{{compGeneral/TEST042 2018-04-17 23:24:46 00:01:59 ### PASS ###}}
{{compGeneral/TESTTOK 2018-04-17 23:26:46 00:00:11 ### PASS ###}}
{{charsets/TEST001 2018-04-17 23:26:57 00:00:44 ### PASS ###}}
{{charsets/TEST311 2018-04-17 23:27:41 00:10:21 ### PASS ###}}
{{executor/TEST013 2018-04-17 23:38:03 00:26:46 ### PASS ###}}
{{executor/TEST015 2018-04-18 00:04:49 00:12:43 ### PASS ###}}
{{executor/TEST022 2018-04-18 00:17:33 00:12:27 ### PASS ###}}
{{executor/TEST107 2018-04-18 00:30:02 00:02:23 ### PASS ###}}
{{fullstack2/TEST062 2018-04-18 00:32:28 00:00:20 ### PASS ###}}

{{TotalDuration: 02:13:07}}

 

Checktest2:

{{dir/TEST StartTime Duration Status }}
{{========= ========== ========= ======= }}

{{hive/TEST001 2018-04-18 00:32:54 00:00:27 ### PASS ###}}
{{hive/TEST005 2018-04-18 00:33:22 00:08:46 ### PASS ###}}
{{hive/TEST009 2018-04-18 00:42:08 00:07:49 ### PASS ###}}
{{hive/TEST015 2018-04-18 00:49:58 00:08:41 ### PASS ###}}
{{hive/TEST017 2018-04-18 00:58:39 00:08:38 ### PASS ###}}
{{hive/TEST021 2018-04-18 01:07:17 00:04:53 ### PASS ###}}
{{seabase/TEST002 2018-04-18 14:47:38 00:03:37 ### PASS ###}}
{{seabase/TEST003 2018-04-18 01:14:56 00:07:25 ### PASS (known diffs) ###}}
{{seabase/TEST010 2018-04-18 01:22:22 00:07:41 ### PASS ###}}
{{seabase/TEST011 2018-04-18 01:30:05 00:03:52 ### PASS ###}}
{{seabase/TEST022 2018-04-18 01:33:58 00:05:40 ### PASS ###}}
{{seabase/TEST025 2018-04-18 01:39:38 00:17:52 ### PASS ###}}
{{seabase/TEST030 2018-04-18 01:57:30 00:00:19 ### PASS ###}}
{{seabase/TEST031 2018-04-18 01:57:50 00:13:06 ### PASS ###}}
{{privs1/TEST120 2018-04-18 02:10:56 00:09:04 ### PASS ###}}
{{privs1/TEST137 2018-04-18 02:20:00 00:07:29 ### PASS ###}}
{{udr/TEST002 2018-04-18 16:29:03 00:09:54 ### PASS ###}}

{{TotalDuration: 02:05:13}}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to