Mechanical Turk has built in tasks for evaluating search relevance
Seed queries could start with the AOL search logs or wikipedia traffic logs?
Pete Sent from my iPhoneOn Jul 31, 2009, at 7:01 PM, Grant Ingersoll <[email protected]> wrote:
OK, so how do we get this started? Seems like there are a lot of collections out there we could use. Also, we can crawl. Seems the tricky part is getting judgments.Thoughts? -Grant
