Yonik,
Is it ok to see soft committed records after server restart, too? If it is,
there is no problem left at all.
I added changing files and 1 sec of log at the end of the e-mail. One
significant line says softCommit=true, so Solr recognizes our softCommit
request.
INFO: start
commit(optimize=false,waitSearcher=true,expungeDeletes=false,softCommit=true)
I want to fix just a little typo from my last e-mail.
"... autosoftcommit to 10 seconds and bashscript to sleep 10 sec, index
files are ..."
should be "... autosoftcommit to 10 seconds and bashscript to sleep *1 sec*,
index files are ..."
Jak
___________________________________________________________________________
jak@jak:/usr/java/solr4/data$ ls index/
_11_0.frq _11.nrm _14.fdx _16_0.tip _1b_0.prx _1b.per _1c.fnm
_1d.fdt _1e_0.tim _1f.fdt _l.fdt _r_0.tim segments_2 _t.fdx
_11_0.prx _11.per _14.fnm _16.fdt _1b_0.tim _1c_0.frq _1c.nrm
_1d.fdx _1e_0.tip _1f.fdx _l.fdx _r_0.tip segments.gen _t.fnm
_11_0.tim _14_0.frq _14.nrm _16.fdx _1b_0.tip _1c_0.prx _1c.per
_1d.fnm _1e.fdt _1.fnx _l.fnm _r.fdt _t_0.frq _t.nrm
_11_0.tip _14_0.prx _14.per _16.fnm _1b.fdt _1c_0.tim _1d_0.frq
_1d.nrm _1e.fdx _l_0.frq _l.nrm _r.fdx _t_0.prx _t.per
_11.fdt _14_0.tim _16_0.frq _16.nrm _1b.fdx _1c_0.tip _1d_0.prx
_1d.per _1e.fnm _l_0.prx _l.per _r.fnm _t_0.tim
write.lock
_11.fdx _14_0.tip _16_0.prx _16.per _1b.fnm _1c.fdt _1d_0.tim
_1e_0.frq _1e.nrm _l_0.tim _r_0.frq _r.nrm _t_0.tip
_11.fnm _14.fdt _16_0.tim _1b_0.frq _1b.nrm _1c.fdx _1d_0.tip
_1e_0.prx _1e.per _l_0.tip _r_0.prx _r.per _t.fdt
jak@jak:/usr/java/solr4/data$ ls index/
_11_0.frq _11.nrm _14.fdx _16_0.tip _1b_0.prx _1b.per _1c.fnm
_1d.fdt _1e_0.tim _1f_0.frq _1f.nrm _l.fdt _r_0.tim segments_2
_t.fdx
_11_0.prx _11.per _14.fnm _16.fdt _1b_0.tim _1c_0.frq _1c.nrm
_1d.fdx _1e_0.tip _1f_0.prx _1.fnx _l.fdx _r_0.tip
segments.gen _t.fnm
_11_0.tim _14_0.frq _14.nrm _16.fdx _1b_0.tip _1c_0.prx _1c.per
_1d.fnm _1e.fdt _1f_0.tim _1f.per _l.fnm _r.fdt _t_0.frq
_t.nrm
_11_0.tip _14_0.prx _14.per _16.fnm _1b.fdt _1c_0.tim _1d_0.frq
_1d.nrm _1e.fdx _1f_0.tip _l_0.frq _l.nrm _r.fdx _t_0.prx
_t.per
_11.fdt _14_0.tim _16_0.frq _16.nrm _1b.fdx _1c_0.tip _1d_0.prx
_1d.per _1e.fnm _1f.fdt _l_0.prx _l.per _r.fnm _t_0.tim
write.lock
_11.fdx _14_0.tip _16_0.prx _16.per _1b.fnm _1c.fdt _1d_0.tim
_1e_0.frq _1e.nrm _1f.fdx _l_0.tim _r_0.frq _r.nrm _t_0.tip
_11.fnm _14.fdt _16_0.tim _1b_0.frq _1b.nrm _1c.fdx _1d_0.tip
_1e_0.prx _1e.per _1f.fnm _l_0.tip _r_0.prx _r.per _t.fdt
___________________________________________________________________________
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DataImporter
doDeltaImport
INFO: Starting Delta Import
Nov 17, 2011 2:55:17 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr-jak path=/dataimport
params={commit=false&command=delta-import} status=0 QTime=0
Nov 17, 2011 2:55:17 PM
org.apache.solr.handler.dataimport.SimplePropertiesWriter
readIndexerProperties
INFO: Read dataimport.properties
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DocBuilder
doDelta
INFO: Starting delta collection.
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Running ModifiedRowKey() for Entity: movie
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.JdbcDataSource$1
call
INFO: Creating a connection for entity movie with URL:
jdbc:mysql://localhost/imdb
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.JdbcDataSource$1
call
INFO: Time taken for getConnection(): 8
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed ModifiedRowKey for Entity: movie rows obtained : 147
Nov 17, 2011 2:55:17 PM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start
commit(optimize=false,waitSearcher=true,expungeDeletes=false,softCommit=true)
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed DeletedRowKey for Entity: movie rows obtained : 0
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed parentDeltaQuery for Entity: movie
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher <init>
INFO: Opening Searcher@1520a8e main
Nov 17, 2011 2:55:17 PM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: end_commit_flush
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)} from
Searcher@2b6170main{DirectoryReader(segments_2:1321559475022:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151)}
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)}
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)} from
Searcher@2b6170main{DirectoryReader(segments_2:1321559475022:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151)}
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)}
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)} from
Searcher@2b6170main{DirectoryReader(segments_2:1321559475022:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151)}
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=3,cumulative_hits=1,cumulative_hitratio=0.33,cumulative_inserts=2,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)}
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=3,cumulative_hits=1,cumulative_hitratio=0.33,cumulative_inserts=2,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)} from
Searcher@2b6170main{DirectoryReader(segments_2:1321559475022:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151)}
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=10,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=10,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)}
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=10,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=10,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.core.QuerySenderListener newSearcher
INFO: QuerySenderListener sending requests to
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)}
Nov 17, 2011 2:55:17 PM org.apache.solr.core.QuerySenderListener newSearcher
INFO: QuerySenderListener done.
Nov 17, 2011 2:55:17 PM org.apache.solr.core.SolrCore registerSearcher
INFO: [] Registered new searcher
Searcher@1520a8emain{DirectoryReader(segments_2:1321559475026:nrt
_k(4.0):C388607
_50(4.0):C526/132 _3q(4.0):C444/141 _43(4.0):C450/126 _4r(4.0):C470/125
_4e(4.0):C456/135 _3f(4.0):C428/133 _51(4.0):C132/126 _52(4.0):C151/131
_53(4.0):C137)}
Nov 17, 2011 2:55:17 PM org.apache.solr.search.SolrIndexSearcher close
INFO: Closing Searcher@2b6170 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=3,cumulative_hits=1,cumulative_hitratio=0.33,cumulative_inserts=2,cumulative_evictions=0}
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=10,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=10,cumulative_evictions=0}
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DocBuilder
doDelta
INFO: Delta Import completed successfully
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DocBuilder finish
INFO: Import completed successfully
Nov 17, 2011 2:55:17 PM
org.apache.solr.handler.dataimport.SimplePropertiesWriter
readIndexerProperties
INFO: Read dataimport.properties
Nov 17, 2011 2:55:17 PM
org.apache.solr.handler.dataimport.SimplePropertiesWriter persist
INFO: Wrote last indexed time to dataimport.properties
Nov 17, 2011 2:55:17 PM org.apache.solr.handler.dataimport.DocBuilder
execute
INFO: Time taken = 0:0:0.414
Nov 17, 2011 2:55:17 PM org.apache.solr.update.processor.LogUpdateProcessor
finish
INFO: {add=[475169, 475168, 475171, 475170, 475173, 475172, 475175, 475174,
... (147 adds)]} 0 0
