[
https://issues.apache.org/jira/browse/HADOOP-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12472527
]
Owen O'Malley commented on HADOOP-333:
--------------------------------------
Another reasonable check would be to join the input and output directories:
input dir: key, value -> (key,value), 1
output dir: key, value -> (key, value), 2
and ensure that you always have an equal number of 1's and 2's for each
key,value pair.
> we should have some checks that the sort benchmark generates correct outputs
> ----------------------------------------------------------------------------
>
> Key: HADOOP-333
> URL: https://issues.apache.org/jira/browse/HADOOP-333
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Reporter: Owen O'Malley
> Assigned To: Owen O'Malley
>
> We should implement some checks of the input versus output of the sort
> benchmark to get some correctness guarantees:
> 1. the number of records
> 2. the number of bytes
> 3. the output records are in fact sorted
> 4. the xor of the md5 of each record's key/value pair
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
