Hello, I recently found out weird behavior while using the DIH with the Solr 5.2. I am using extended line entity processor which can also delete documents based on some special conditions (delete by query).
The problem is that the DIH is incredibly slow compared to Solr 4.3. I have noticed in the logs that after every delete statement a new searcher is opened. I checked the solrconfig.xml and autoCommit is set for 15 seconds and openSearcher is set to false, softAutoCommit section is commented out. I have also tried to comment out autoCommit section but the behavior is the same. This is the relevant part of the log: INFO - 2015-06-23 06:07:33.510; [ test_core] org.apache.solr.handler.dataimport.SolrWriter; Deleting documents from Solr with query: (KNUMH:"0084655650")AND(KSCHL:"ZKA0") INFO - 2015-06-23 06:07:33.519; [ test_core] org.apache.solr.search.SolrIndexSearcher; Opening Searcher@60060afc[test_core] realtime INFO - 2015-06-23 06:07:33.520; [ test_core] org.apache.solr.handler.dataimport.SolrWriter; Deleting documents from Solr with query: (KNUMH:"0084655651")AND(KSCHL:"ZKA0") INFO - 2015-06-23 06:07:33.523; [ test_core] org.apache.solr.search.SolrIndexSearcher; Opening Searcher@73d2a715[test_core] realtime INFO - 2015-06-23 06:07:33.523; [ test_core] org.apache.solr.handler.dataimport.SolrWriter; Deleting documents from Solr with query: (KNUMH:"0084655652")AND(KSCHL:"ZKA0") INFO - 2015-06-23 06:07:33.534; [ test_core] org.apache.solr.search.SolrIndexSearcher; Opening Searcher@b52e1e9[test_core] realtime INFO - 2015-06-23 06:07:33.534; [ test_core] org.apache.solr.handler.dataimport.SolrWriter; Deleting documents from Solr with query: (KNUMH:"0084655653")AND(KSCHL:"ZKA0") INFO - 2015-06-23 06:07:33.537; [ test_core] org.apache.solr.search.SolrIndexSearcher; Opening Searcher@d8f211f[test_core] realtime INFO - 2015-06-23 06:07:33.537; [ test_core] org.apache.solr.handler.dataimport.SolrWriter; Deleting documents from Solr with query: (KNUMH:"0084655654")AND(KSCHL:"ZKA0") Is this behavior normal ?? How can I prevent opening new searcher after every delete statement ? It is sufficient for me when the changes are visible when the DIH finishes its job. Thank you -- Rudolf Grigeľ
