On Thu, Dec 26, 2013 at 12:28:18AM -0800, Suneel Marthi wrote: > Its when you increase the no. of documents and the size of each > document (add more dimensions) that you start seeing performance issues > which are: > a)The Mappers take long to complete and its either the searcher.remove() or > searcher.searchFirst() calls (will check again in my next attempt) that seems > to be the bottleneck. > b) Once the Mappers complete (after several hours) the Reducer dies with an > OOM exception (despite having set -Xmx2G).
Given that there seem to be a couple of people experiencing issues I think it makes sense to create a JIRA issue here to track progress - either code improvements or better documentation on how to run this implementation. @Suneel: Does it make sense to push code freeze to after fixing this or should this be communicated as a known defect in the release notes? Isabel
