Steve, Sorry must have omitted it from a past response.
Here is what came back from the response. <response> <lst name="responseHeader"><int name="status">400</int><int name="QTime">91</int></lst><str name="Operation create caused exception:">org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Could not identify nodes matching the rules [{ "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ1"}, { "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ2"}, { "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ3"}] tag values{ "10.157.112.223:10002_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.120.207:10003_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.121.165:10002_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.190:10002_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.121.165:10003_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.190:10001_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.115.30:10003_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.121.165:10001_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.201:10002_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.120.207:10001_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.112.223:10003_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.115.30:10001_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.116.190:10003_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.112.223:10001_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.120.207:10002_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.201:10003_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.116.201:10001_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.115.30:10002_solr":{"sysprop.AWSAZ":"AZ1"}}</str><lst name="exception"><str name="msg">Could not identify nodes matching the rules [{ "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ1"}, { "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ2"}, { "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ3"}] tag values{ "10.157.112.223:10002_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.120.207:10003_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.121.165:10002_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.190:10002_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.121.165:10003_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.190:10001_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.115.30:10003_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.121.165:10001_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.201:10002_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.120.207:10001_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.112.223:10003_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.115.30:10001_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.116.190:10003_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.112.223:10001_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.120.207:10002_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.201:10003_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.116.201:10001_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.115.30:10002_solr":{"sysprop.AWSAZ":"AZ1"}}</str><int name="rspCode">400</int></lst><lst name="error"><lst name="metadata"><str name="error-class">org.apache.solr.common.SolrException</str><str name="root-error-class">org.apache.solr.common.SolrException</str></lst><str name="msg">Could not identify nodes matching the rules [{ "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ1"}, { "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ2"}, { "shard":"*", "replica":"1", "sysprop.AWSAZ":"AZ3"}] tag values{ "10.157.112.223:10002_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.120.207:10003_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.121.165:10002_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.190:10002_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.121.165:10003_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.190:10001_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.115.30:10003_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.121.165:10001_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.201:10002_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.120.207:10001_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.112.223:10003_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.115.30:10001_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.116.190:10003_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.112.223:10001_solr":{"sysprop.AWSAZ":"AZ1"}, "10.157.120.207:10002_solr":{"sysprop.AWSAZ":"AZ3"}, "10.157.116.201:10003_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.116.201:10001_solr":{"sysprop.AWSAZ":"AZ2"}, "10.157.115.30:10002_solr":{"sysprop.AWSAZ":"AZ1"}}</str><int name="code">400</int></lst> </response> On 9/25/18, 11:33 AM, "Steve Rowe" <sar...@gmail.com> wrote: Chuck, see my responses inline below: > On Sep 25, 2018, at 12:50 PM, Chuck Reynolds <creyno...@ancestry.com> wrote: > The bottom line is I guess I'm confused by the documentation and the reference to replicas. Normally when referring to replicas in the documentation it is referring to the number of times you want the data replicated. As in replication factor. That's where the confusion was for me. We can always use help improving Solr’s documentation, and your perspective is valuable. Please see https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.apache.org_solr_HowToContribute&d=DwIFaQ&c=kKqjBR9KKWaWpMhASkPbOg&r=J-2s3b-3-OTA0o6bGDhJXAQlB5Y3s4rOUxlh_78DJl0&m=_ZWThlXl48Sa2f_pVyPzwxiCmVnOtDdddq8wfK6CVqM&s=XR2tqAPyyNaSPvrlnjhqm81DZj3WP3v7s8iEciH1xss&e= and open JIRA issues with the problems you find, and ideally with patches against the ref guide sources. From the Solr 6.4 ref guide’s “Solr Glossary”: Replica: A Core that acts as a physical copy of a Shard in a SolrCloud Collection. As ^^ indicates, a “replica” is not a replication factor. (Though “replica:1” in a rule-based replica placement rule is a condition on replica *count*, so I can see where that could be confusing.) > If I want to create a rule that insures that my replication factor of three correctly shards the data across three AZ so if I was to lose one or even two AZ's in AWS Solr would still have 1 - 2 copies of the data. How would that rule work? I thought I already answered that exact question: > If you mean “exactly one Solr instance in an AZ must host exactly one replica of each shard of the collection”, then yes, that makes sense :). > > Okay, one more try :) - here are the rules that should do the trick for you (i.e., what I wrote in the previous sentence): > > ----- > rule=shard:*,replica:1,sysprop.AWSAZ:AZ1 > &rule=shard:*,replica:1,sysprop.AWSAZ:AZ2 > &rule=shard:*,replica:1,sysprop.AWSAZ:AZ3 > ----- Have you tried ^^ ? -- Steve https://urldefense.proofpoint.com/v2/url?u=http-3A__www.lucidworks.com&d=DwIFaQ&c=kKqjBR9KKWaWpMhASkPbOg&r=J-2s3b-3-OTA0o6bGDhJXAQlB5Y3s4rOUxlh_78DJl0&m=_ZWThlXl48Sa2f_pVyPzwxiCmVnOtDdddq8wfK6CVqM&s=0npMKzqmYyK1N3r08vl6qYeDyiOMVsr_iXcvW5nNUqk&e=