Dear all, I am very interested in Solr and would like to deploy Solr for distributed indexing and searching. I hope you are the right Solr expert who can help me out. However, I have concerns about the scalability and management overhead of Solr. I am wondering if anyone could give me some guidance on Solr.
Basically, I have the following questions, For indexing 1. How does Solr handle the distributed indexing? It seems Solr generates index on a single box. What if the index is huge and can't sit on one box? 2. Is it possible for Solr to generate index in HDFS? For searching 3. Solr provides Master/Slave framework. How does the Solr distribute the search? Does Solr know which index/shard to deliver the query to? Or does it have to do a multicast query to all the nodes? For fault tolerance 4. Does Solr handle the management overhead automatically? suppose master goes down, how does Solr recover the master in order to get the latest index updates? Do we have to code ourselves to handle this? 5. Suppose master goes down immediately after the index updates, while the updates haven't been replicated to the slaves, data loss seems to happen. Does Solr have any mechanism to deal with that? Performance of real-time index updating 6. How is the performance of this realtime index updating? Suppose we are updating a million records for a huge index with billions of records frequently. Can Solr provides a reasonable performance and low latency on that? (Probably it is related to Lucene library) I would be very appreciated if you can give us some guidance. Best, edward