I have just begun using Solr. I see that we have to insert documents by posting XMLs to solr/update
I would like to know how Solr is used as a search engine in enterprises. How do you do the crawling of your intranet and passing the information as XML to solr/update. Isn't this going to be slow? To put all content in the index via a HTTP POST request requiring network sockets to be opened? Isn't there any direct way to to do the same thing without resorting to HTTP?