sigram opened a new pull request #1568: URL: https://github.com/apache/lucene-solr/pull/1568
Details in Jira. Initial changes here implement the "double buffering" approach to increase the throughput - an additional thread is created to fill in a buffer while the main thread writes out the documents from the other buffer. Lucene TermEnum-s and DocValues are not multi-thread safe, that's why this change required the documents to be fully materialized in the buffer before handing it over to the other thread for writing. I think this is an acceptable tradeoff between reasonable amount of memory in the buffer and speed. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
