[ 
https://issues.apache.org/jira/browse/HADOOP-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646233#action_12646233
 ] 

Steve Loughran commented on HADOOP-4605:
----------------------------------------

given how many unit tests are in the same package as the internals, a lot of 
tests will fail and someone would need to go through the results to determine 
which were false positives. 

I would prefer to have a separate set of tests, the compatibility tests, that
* are in different packages: 
* external APIs only
* exist not to break the program's functions but test its compatibility 
directly. That is, rather than send in bad values and expect failures, they'd 
send in good operations and verify that everything behaved as expected.
* focus on the main operations of hadoop, the ones you want to optimise
* Timings of these operations could be used to detect slow downs in the main 
operations.

They would become the defacto API specification, and would have a far slower 
rate of change than the rest of the system, and could be used for 
performance/regression testing. 

> should run old version of unit tests to check back-compatibility
> ----------------------------------------------------------------
>
>                 Key: HADOOP-4605
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4605
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: test
>            Reporter: Doug Cutting
>
> We should test back-compatibility by running unit tests from a prior release.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to