Thank you all for your suggestions.
Now I changed my import strategy to ensure that the same document will
be updated eventually by different "batches",
in this way I need a single programmatic softcommit at the end of each
batch.
Configuration-side I enabled autoCommit with opensearcher=false and
maxtime=60000 (1 minute)
Hope this will do it.
Another question, is softCommit sufficient to ensure visibility or
should I call a commit to ensure a new searcher will be opened?
softCommit automatically opens a new searcher?
Thanks
Danilo
On 24/10/19 17:06, Erick Erickson wrote:
"For every document processed, a soft commit is performed to make the update
visible to other concurrent update processes.”
Please do not do this! First, Real Time Get will always return the current doc,
whether you’ve opened a new reader or not. Second, this is an anti-pattern. I
agree with Paras, set your defaults in solrconfig and forget about it.
I’d also set the hard commits to something like 15 seconds
(openSearcher=false). Or, if you can stand 15 second latency, set
openSearcher=true and leave the soft commit set to -1.
Opening a searcher is a heavyweight operation. doing it after _every_ document
is a poor choice. If you absolutely _must_, at least batch your updates up in
groups of, say, 1,000 and open a new searcher after that.
Best,
Erick
On Oct 24, 2019, at 3:52 AM, Danilo Tomasoni <tomas...@cosbi.eu> wrote:
For every document processed, a soft commit is performed to make the update
visible to other concurrent update processes.
--
Danilo Tomasoni
Fondazione The Microsoft Research - University of Trento Centre for
Computational and Systems Biology (COSBI)
Piazza Manifattura 1, 38068 Rovereto (TN), Italy
tomas...@cosbi.eu
http://www.cosbi.eu
As for the European General Data Protection Regulation 2016/679 on the protection of natural persons with regard to the processing of personal data, we inform you that all the data we possess are object of treatment in the respect of the normative provided for by the cited GDPR.
It is your right to be informed on which of your data are used and how; you may
ask for their correction, cancellation or you may oppose to their use by
written request sent by recorded delivery to The Microsoft Research –
University of Trento Centre for Computational and Systems Biology Scarl, Piazza
Manifattura 1, 38068 Rovereto (TN), Italy.
P Please don't print this e-mail unless you really need to
