bq: For example, what if the leader could give a list of queries/filters currently in the cache which could then be executed on the replica?
How is the better than each replica firing off its own warming queries for its caches etc? Each replica may well fire different autowarm queries since there's no guarantee that their first autowarmcount queries in the caches is the same, but that would also be true of getting the autowarm queries from the leader. Any firstSearcher and newSearcher queries will be identical anyway since solrconfig.xml is identical, so that's not a problem. So I remain to be convinced that this would buy us anything, but I've been wrong more than once :).... Best, Erick On Sat, Nov 23, 2013 at 1:31 PM, Shawn Heisey <s...@elyograg.org> wrote: > On 11/23/2013 4:20 AM, Shalin Shekhar Mangar wrote: > > As you said, loading caches from the caches of another server is not > > feasible but there is some merit in warming with the queries of the > > leader. For example, what if the leader could give a list of > > queries/filters currently in the cache which could then be executed on > > the replica? That'd be useful I think. > > That is an interesting idea. > > Thoughts, conjured with only surface understanding of the internals > involved: > > One question is whether this would be done via the zookeeper queue or > with direct inter-server communication. My only worry with doing it in > zookeeper is the potential for it to put a major load on low-end > zookeeper machines. We often tell people that their ZK nodes do not > need much in the way of resources. If the user has high-end machines, > even if they are doing double duty as SolrCloud and Zookeeper, that > would not really be a worry. > > Would we want to control the max number of forwarded keys via the > existing autowarmCount setting, or have a new per-cache setting with a > relatively low default? If it's a new setting, I would recommend that > it not be included in the example solrconfig.xml file, to discourage > people from shooting themselves in the foot accidentally. It should be > well documented in the wiki and ref guide as an expert setting. > > Thanks, > Shawn > >
