Dear Nenad, We have thought about benchmarking the crawling phase. Although, the current Web Search benchmark concentrates on query serving, it's up to the user to benchmark the crawling phase as well. The user is required to create the index, so as to be able to benchmark the query serving. Therefore, no additional effort is required.
In the future, we might include a detailed and rigorous procedure how to benchmark the crawling phase. Regards, -Stavros. ________________________________________ From: Caklovic, Nenad [[email protected]] Sent: Wednesday, April 11, 2012 2:12 AM To: [email protected] Subject: Web Search benchmark Hi, Great work on this benchmark. I think that this will be a great tool for people in the cloud space. I have a couple of questions. If I am seeing things correctly, the Web Search part is benchmarking the query capabilities of the search engine. Have you thought about benchmarking the indexing part, the index creation process? Do you have any plans for the future work on this? Updating, newer Hadoop releases and so on. Thanks, Nenad
