Thanks. If the given ZK snapshot was the end state, then two nodes are marked as down. Generally that happens because replication failed - if you have not, I'd check the logs for those two nodes.
- Mark On Fri, Feb 10, 2012 at 7:35 PM, Jamie Johnson <jej2...@gmail.com> wrote: > nothing seems that different. In regards to the states of each I'll > try to verify tonight. > > This was using a version I pulled from SVN trunk yesterday morning > > On Fri, Feb 10, 2012 at 6:22 PM, Mark Miller <markrmil...@gmail.com> > wrote: > > Also, it will help if you can mention the exact version of solrcloud you > are talking about in each issue - I know you have one from the old branch, > and I assume a version off trunk you are playing with - so a heads up on > which and if trunk, what rev or day will help in the case that I'm trying > to dupe issues that have been addressed. > > > > - Mark > > > > On Feb 10, 2012, at 6:09 PM, Mark Miller wrote: > > > >> I'm trying, but so far I don't see anything. I'll have to try and mimic > your setup closer it seems. > >> > >> I tried starting up 6 solr instances on different ports as 2 shards, > each with a replication factor of 3. > >> > >> Then I indexed 20k documents to the cluster and verified doc counts. > >> > >> Then I shutdown all the replicas so that only one instance served each > shard. > >> > >> Then I indexed 20k documents to the cluster. > >> > >> Then I started the downed nodes and verified that they where in a > recovery state. > >> > >> After enough time went by I checked and verified document counts on > each instance - they where as expected. > >> > >> I guess next I can try a similar experiment using multiple cores, but > if you notice anything that stands out that is largely different in what > you are doing, let me know. > >> > >> The cores that are behind, does it say they are down, recovering, or > active in zookeeper? > >> > >> On Feb 10, 2012, at 4:48 PM, Jamie Johnson wrote: > >> > >>> Sorry for pinging this again, is more information needed on this? I > >>> can provide more details but am not sure what to provide. > >>> > >>> On Fri, Feb 10, 2012 at 10:26 AM, Jamie Johnson <jej2...@gmail.com> > wrote: > >>>> Sorry, I shut down the full solr instance. > >>>> > >>>> On Fri, Feb 10, 2012 at 9:42 AM, Mark Miller <markrmil...@gmail.com> > wrote: > >>>>> Can you explain a little more how you doing this? How are you > bringing the cores down and then back up? Shutting down a full solr > instance, unloading the core? > >>>>> > >>>>> On Feb 10, 2012, at 9:33 AM, Jamie Johnson wrote: > >>>>> > >>>>>> I know that the latest Solr Cloud doesn't use standard replication > but > >>>>>> I have a question about how it appears to be working. I currently > >>>>>> have the following cluster state > >>>>>> > >>>>>> {"collection1":{ > >>>>>> "slice1":{ > >>>>>> "JamiesMac.local:8501_solr_slice1_shard1":{ > >>>>>> "shard_id":"slice1", > >>>>>> "state":"active", > >>>>>> "core":"slice1_shard1", > >>>>>> "collection":"collection1", > >>>>>> "node_name":"JamiesMac.local:8501_solr", > >>>>>> "base_url":"http://JamiesMac.local:8501/solr"}, > >>>>>> "JamiesMac.local:8502_solr_slice1_shard2":{ > >>>>>> "shard_id":"slice1", > >>>>>> "state":"active", > >>>>>> "core":"slice1_shard2", > >>>>>> "collection":"collection1", > >>>>>> "node_name":"JamiesMac.local:8502_solr", > >>>>>> "base_url":"http://JamiesMac.local:8502/solr"}, > >>>>>> "jamiesmac:8501_solr_slice1_shard1":{ > >>>>>> "shard_id":"slice1", > >>>>>> "state":"down", > >>>>>> "core":"slice1_shard1", > >>>>>> "collection":"collection1", > >>>>>> "node_name":"jamiesmac:8501_solr", > >>>>>> "base_url":"http://jamiesmac:8501/solr"}, > >>>>>> "jamiesmac:8502_solr_slice1_shard2":{ > >>>>>> "shard_id":"slice1", > >>>>>> "leader":"true", > >>>>>> "state":"active", > >>>>>> "core":"slice1_shard2", > >>>>>> "collection":"collection1", > >>>>>> "node_name":"jamiesmac:8502_solr", > >>>>>> "base_url":"http://jamiesmac:8502/solr"}}, > >>>>>> "slice2":{ > >>>>>> "JamiesMac.local:8501_solr_slice2_shard2":{ > >>>>>> "shard_id":"slice2", > >>>>>> "state":"active", > >>>>>> "core":"slice2_shard2", > >>>>>> "collection":"collection1", > >>>>>> "node_name":"JamiesMac.local:8501_solr", > >>>>>> "base_url":"http://JamiesMac.local:8501/solr"}, > >>>>>> "JamiesMac.local:8502_solr_slice2_shard1":{ > >>>>>> "shard_id":"slice2", > >>>>>> "state":"active", > >>>>>> "core":"slice2_shard1", > >>>>>> "collection":"collection1", > >>>>>> "node_name":"JamiesMac.local:8502_solr", > >>>>>> "base_url":"http://JamiesMac.local:8502/solr"}, > >>>>>> "jamiesmac:8501_solr_slice2_shard2":{ > >>>>>> "shard_id":"slice2", > >>>>>> "state":"down", > >>>>>> "core":"slice2_shard2", > >>>>>> "collection":"collection1", > >>>>>> "node_name":"jamiesmac:8501_solr", > >>>>>> "base_url":"http://jamiesmac:8501/solr"}, > >>>>>> "jamiesmac:8502_solr_slice2_shard1":{ > >>>>>> "shard_id":"slice2", > >>>>>> "leader":"true", > >>>>>> "state":"active", > >>>>>> "core":"slice2_shard1", > >>>>>> "collection":"collection1", > >>>>>> "node_name":"jamiesmac:8502_solr", > >>>>>> "base_url":"http://jamiesmac:8502/solr"}}}} > >>>>>> > >>>>>> I then added some docs to the following shards using SolrJ > >>>>>> http://localhost:8502/solr/slice2_shard1 > >>>>>> http://localhost:8502/solr/slice1_shard2 > >>>>>> > >>>>>> I then bring back up the other cores and I don't see replication > >>>>>> happening. Looking at the stats for each core I see that on the > 8501 > >>>>>> instance (the instance that was off) the number of docs is 0, so > I've > >>>>>> clearly set something up incorrectly. Any help on this would be > >>>>>> greatly appreciated. > >>>>> > >>>>> - Mark Miller > >>>>> lucidimagination.com > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >> > >> - Mark Miller > >> lucidimagination.com > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > > > > - Mark Miller > > lucidimagination.com > > > > > > > > > > > > > > > > > > > > > > > -- - Mark http://www.lucidimagination.com