I solved the problem by using commitWithinMs property, solr server now does not commit everytime I post the document, but it will commit in batch.
In implementation using SorlJ, I change public UpdateResponse addBeans(Collection<?> beans) /* */ throws SolrServerException, IOException to public UpdateResponse addBeans(Collection<?> beans, int commitWithinMs) /* */ throws SolrServerException, IOException On Sat, Dec 31, 2011 at 8:21 AM, Chris Hostetter-3 [via Lucene] < [email protected]> wrote: > > : I using sorlj to export object to solr, it get data from csv file, load > it > : into objects and exports to solr server. It works perfectly in solr 3.2 > but > : it misses a lots of records in 3.5. > : If I manually export one by one, it works. Solr 3.5 could not handle too > : many insert requests, I think. > : Could anyone please point me out why? > > You haven't relaly provided enough details for anyone to guess what your > specific problem might be... > > https://wiki.apache.org/solr/UsingMailingLists > > you need to provide actual examples of code/configs/logs showing the > problem you are seeing ... is your code multithreaded? are you running > embedded solr or using a servlet container? are you using the same configs > in Solr 3.2 as in 3.5? what do the solr update log messages look like? > (they should give you a count of the number of docs added in each request) > which does are missing? (ie: are they all from "the end" of your process, > or scattered from the middle?) > > Off the top of perhaps you were using autocommit in your 3.2 configs, > but not with 3.5? > > Please re-forumlate your question and send it to the solr-user@lucene > mailing list where a greater number of people who can offer you assistance > are subscribed (general@lucene is primarily for broad discussions about > the project, and inquires from people who aren't sure how to even get > started with questions about lucene/solr/pylucene/etc... > > > > > -Hoss > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://lucene.472066.n3.nabble.com/Solr-3-5-miss-data-because-too-many-insert-requests-tp3582098p3621902.html > To unsubscribe from Solr 3.5 miss data because too many insert requests, > click > here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=3582098&code=ZG9ob2FuZ25AZ21haWwuY29tfDM1ODIwOTh8MzE4MDAyODIx> > . > NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.InstantMailNamespace&breadcrumbs=instant+emails%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- Best regard, Tom Nguyen -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-3-5-miss-data-because-too-many-insert-requests-tp3582098p3622146.html Sent from the Lucene - General mailing list archive at Nabble.com.
