Re: Solr warming when using master/slave replication
"Will traffic be served with a non "warmed" index searcher at any point" No. That's what auto-warming is all about. More correctly, it depends on how you configure things in your config file. There are entries like "firstSearcher", "newSearcher" and various "autowarm" counts, all of which you set and the various actions specified are carried out before the switch is made to the new searcher after replication. There's also "useColdSearchers" if you want to specifically NOT wait for warmup. As I said, it depends on how you configure things. In fact, this will lead to a temporary increase in memory use, since the old and new caches will both be in memory for a short time. Best Erick On Mon, Aug 29, 2011 at 5:54 PM, Mike Austin wrote: > Correction: Will traffic be served with a non "warmed" index searcher at any > point? > > Thanks, > Mike > > On Mon, Aug 29, 2011 at 4:52 PM, Mike Austin wrote: > >> "Distribution/Replication gives you a 'new' index on the slave. When Solr >> is told to use the new index, the old caches have to be discarded along with >> the old Index Searcher. That's when autowarming occurs. If the current >> Index Searcher is serving requests and when a new searcher is opened, the >> new one is 'warmed' while the current one is serving external requests. When >> the new one is ready, it is registered so it can serve any new requests >> while the original one first finishes the requests it is handling. " >> >> So if warming is configured, the new index will warm before going live? >> How does that work with the copying to the new directory? Does it get warmed >> while in the temp directory before copied over? My question is basically, >> will traffic be served with a non indexed searcher at any point? >> >> Thanks, >> Mike >> >> >> On Mon, Aug 29, 2011 at 4:45 PM, Rob Casson wrote: >> >>> it's always been my understanding that the caches are discarded, then >>> rebuilt/warmed: >>> >>> >>> http://wiki.apache.org/solr/SolrCaching#Caching_and_Distribution.2BAC8-Replication >>> >>> hth, >>> rob >>> >>> On Mon, Aug 29, 2011 at 5:30 PM, Mike Austin >>> wrote: >>> > How does warming work when a collection is being distributed to a slave. >>> I >>> > understand that a temp directory is created and it is eventually copied >>> to >>> > the live folder, but what happens to the cache that was built in with >>> the >>> > old index? Does the cache get rebuilt, can we warm it before it becomes >>> > live, or can we keep the old cache? >>> > >>> > Thanks, >>> > Mike >>> > >>> >> >> >
Re: Solr warming when using master/slave replication
Correction: Will traffic be served with a non "warmed" index searcher at any point? Thanks, Mike On Mon, Aug 29, 2011 at 4:52 PM, Mike Austin wrote: > "Distribution/Replication gives you a 'new' index on the slave. When Solr > is told to use the new index, the old caches have to be discarded along with > the old Index Searcher. That's when autowarming occurs. If the current > Index Searcher is serving requests and when a new searcher is opened, the > new one is 'warmed' while the current one is serving external requests. When > the new one is ready, it is registered so it can serve any new requests > while the original one first finishes the requests it is handling. " > > So if warming is configured, the new index will warm before going live? > How does that work with the copying to the new directory? Does it get warmed > while in the temp directory before copied over? My question is basically, > will traffic be served with a non indexed searcher at any point? > > Thanks, > Mike > > > On Mon, Aug 29, 2011 at 4:45 PM, Rob Casson wrote: > >> it's always been my understanding that the caches are discarded, then >> rebuilt/warmed: >> >> >> http://wiki.apache.org/solr/SolrCaching#Caching_and_Distribution.2BAC8-Replication >> >> hth, >> rob >> >> On Mon, Aug 29, 2011 at 5:30 PM, Mike Austin >> wrote: >> > How does warming work when a collection is being distributed to a slave. >> I >> > understand that a temp directory is created and it is eventually copied >> to >> > the live folder, but what happens to the cache that was built in with >> the >> > old index? Does the cache get rebuilt, can we warm it before it becomes >> > live, or can we keep the old cache? >> > >> > Thanks, >> > Mike >> > >> > >
Re: Solr warming when using master/slave replication
"Distribution/Replication gives you a 'new' index on the slave. When Solr is told to use the new index, the old caches have to be discarded along with the old Index Searcher. That's when autowarming occurs. If the current Index Searcher is serving requests and when a new searcher is opened, the new one is 'warmed' while the current one is serving external requests. When the new one is ready, it is registered so it can serve any new requests while the original one first finishes the requests it is handling. " So if warming is configured, the new index will warm before going live? How does that work with the copying to the new directory? Does it get warmed while in the temp directory before copied over? My question is basically, will traffic be served with a non indexed searcher at any point? Thanks, Mike On Mon, Aug 29, 2011 at 4:45 PM, Rob Casson wrote: > it's always been my understanding that the caches are discarded, then > rebuilt/warmed: > > > http://wiki.apache.org/solr/SolrCaching#Caching_and_Distribution.2BAC8-Replication > > hth, > rob > > On Mon, Aug 29, 2011 at 5:30 PM, Mike Austin > wrote: > > How does warming work when a collection is being distributed to a slave. > I > > understand that a temp directory is created and it is eventually copied > to > > the live folder, but what happens to the cache that was built in with the > > old index? Does the cache get rebuilt, can we warm it before it becomes > > live, or can we keep the old cache? > > > > Thanks, > > Mike > > >
Re: Solr warming when using master/slave replication
it's always been my understanding that the caches are discarded, then rebuilt/warmed: http://wiki.apache.org/solr/SolrCaching#Caching_and_Distribution.2BAC8-Replication hth, rob On Mon, Aug 29, 2011 at 5:30 PM, Mike Austin wrote: > How does warming work when a collection is being distributed to a slave. I > understand that a temp directory is created and it is eventually copied to > the live folder, but what happens to the cache that was built in with the > old index? Does the cache get rebuilt, can we warm it before it becomes > live, or can we keep the old cache? > > Thanks, > Mike >
