I've got a project where I need to create DVD sized collections of indexed data. Each disc will contain and index folder and a data folder. Contents should be obvious. My question is how can I monitor the index size as I'm adding data so I can determine when the size of the data plus the size of the index crosses a pre-determined threshold and I can close out the disc and move on to the next?
At the moment I'm looping through the index folder and just sizing the files. But it appears that Lucene is processing, as well, and sometimes I try to get the size of a file that is no longer there. Any advice on how to approach this without having to completely close the index after each document? Thanks. J
