So, you are reading 100 million records from somewhere and are writing
each record to one of 1 million indexes? Really 1 million, with an
average of 100 docs in each? 17 hours doesn't sound too bad to me.
Before worrying about lucene performance you should double check
everything else - in general
I am running over a 100 million row nosql set and unfortunately building 1
million indexes. Each row I get may or may not be for the index I just wrote
too so I can't keep IndexWriter open very long. I am currently simulating how
long it would take me to build all the indexes and it looks like
