[
https://issues.apache.org/jira/browse/MAHOUT-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lance Norskog updated MAHOUT-559:
---------------------------------
Description:
The existing RecommenderEvaluator
(AverageAbsoluteDifferenceRecommenderEvaluator.java) has a very limited API. It
evaluates a Recommender's performance on a training v.s. test scenario. It does
not allow comparing the outputs of different recommenders against the same data
model. Also, I could not figure out how its comparison criteria.
OrderBasedRecommenderEvaluator compares the output of two recommenders. It only
checks the order of the items in the recommendations, ignoring the returned
preference values.
was:
OrderBasedRecommenderEvaluator compares the output of two recommenders. It only
checks the order of the recommended items, ignoring the returned preferences.
Purpose: the existing RecommenderEvaluator has a very limited use model. It
does not allow comparing the outputs of different recommenders against the same
data model. Also, I could not figure out how its comparison criteria.
OrderBasedRecommenderEvaluator gets a recommendation of N samples for each user
available from the datamodel, from both recommenders. It finds the common items
in the two recommendations, and performs various statistical tests comparing
the order of these common items. It does not evaluate the items unique to one
recommendation.
> Compare Recommender output by order of recommendations.
> -------------------------------------------------------
>
> Key: MAHOUT-559
> URL: https://issues.apache.org/jira/browse/MAHOUT-559
> Project: Mahout
> Issue Type: New Feature
> Components: Collaborative Filtering
> Reporter: Lance Norskog
>
> The existing RecommenderEvaluator
> (AverageAbsoluteDifferenceRecommenderEvaluator.java) has a very limited API.
> It evaluates a Recommender's performance on a training v.s. test scenario. It
> does not allow comparing the outputs of different recommenders against the
> same data model. Also, I could not figure out how its comparison criteria.
> OrderBasedRecommenderEvaluator compares the output of two recommenders. It
> only checks the order of the items in the recommendations, ignoring the
> returned preference values.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
