[ https://issues.apache.org/jira/browse/CASSANDRA-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arya Goudarzi updated CASSANDRA-1341: ------------------------------------- Description: When bringing a cluster of 3 nodes up, if user does not boot up the nodes serially and wait for bootstrap to finish on each before restarting the next one, the cluster may end up having duplicate nodes showing on the ring. Steps to Reproduce: 1. Configure a cluster of 3 from clean slate of trunc; 2. Start the first node; 3. Start the second node; 4. As soon as the second node starts ans says Finished Hinted Handoff to node 1, start node 3; 5. Load the schema from YAML using JMX or use Thrift to define some schema so that we could use nodetool (CASSANDRA-1286) I ended up with a strange ring configuration: [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.132 ring Address Status State Load Token 162149197822681929203296559575110871861 10.50.26.133 Up Normal 41.61 KB 34543310227330005404531081788197792565 10.50.26.132 Up Normal 41.61 KB 77078606092447313337452907717168818997 10.50.26.132 Up Normal 41.61 KB 162149197822681929203296559575110871861 [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.133 ring Address Status State Load Token 162149197822681929203296559575110871861 10.50.26.133 Up Normal 41.61 KB 34543310227330005404531081788197792565 10.50.26.132 Up Normal 41.61 KB 77078606092447313337452907717168818997 10.50.26.132 Up Normal 41.61 KB 162149197822681929203296559575110871861 [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.134 ring Address Status State Load Token 162149197822681929203296559575110871861 10.50.26.133 Up Normal 41.61 KB 34543310227330005404531081788197792565 10.50.26.132 Up Normal 41.61 KB 77078606092447313337452907717168818997 10.50.26.132 Up Normal 41.61 KB 162149197822681929203296559575110871861 In my case 10.50.26.132 = node 1 10.50.26.133 = node 2 10.50.26.134 = node 3 As you see node2 is repeated Twice. Node 3 is running however does not show up in the ring! Now, if in step 4 if I wait for bootstrap of node 2 to kick in and finish, I won't have this problem. was: When bringing a cluster of 3 nodes up, if user does not boot up the nodes serially and wait for bootstrap to finish on each before restarting the next one, the cluster may end of having duplication nodes showing on the ring. Steps to Reproduce: 1. Configure a cluster of 3 from clean slate of trunc; 2. Start the first node; 3. Start the second node; 4. As soon as the second node starts ans says Finished Hinted Handoff to node 1, start node 3; 5. Load the schema from YAML using JMX or use Thrift to define some schema so that we could use nodetool (CASSANDRA-1286) I ended up with a strange ring configuration: [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.132 ring Address Status State Load Token 162149197822681929203296559575110871861 10.50.26.133 Up Normal 41.61 KB 34543310227330005404531081788197792565 10.50.26.132 Up Normal 41.61 KB 77078606092447313337452907717168818997 10.50.26.132 Up Normal 41.61 KB 162149197822681929203296559575110871861 [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.133 ring Address Status State Load Token 162149197822681929203296559575110871861 10.50.26.133 Up Normal 41.61 KB 34543310227330005404531081788197792565 10.50.26.132 Up Normal 41.61 KB 77078606092447313337452907717168818997 10.50.26.132 Up Normal 41.61 KB 162149197822681929203296559575110871861 [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.134 ring Address Status State Load Token 162149197822681929203296559575110871861 10.50.26.133 Up Normal 41.61 KB 34543310227330005404531081788197792565 10.50.26.132 Up Normal 41.61 KB 77078606092447313337452907717168818997 10.50.26.132 Up Normal 41.61 KB 162149197822681929203296559575110871861 In my case 10.50.26.132 = node 1 10.50.26.133 = node 2 10.50.26.134 = node 3 As you see node2 is repeated Twice. Node 3 is running however does not show up in the ring! Now, if in step 4 if I wait for bootstrap of node 2 to kick in and finish, I won't have this problem. > Duplicate nodes showing on the ring when starting 3 nodes on empty cluster > -------------------------------------------------------------------------- > > Key: CASSANDRA-1341 > URL: https://issues.apache.org/jira/browse/CASSANDRA-1341 > Project: Cassandra > Issue Type: Bug > Components: Core > Affects Versions: 0.7 beta 1 > Environment: CentOS 5.2 > Trunk > Reporter: Arya Goudarzi > > When bringing a cluster of 3 nodes up, if user does not boot up the nodes > serially and wait for bootstrap to finish on each before restarting the next > one, the cluster may end up having duplicate nodes showing on the ring. > Steps to Reproduce: > 1. Configure a cluster of 3 from clean slate of trunc; > 2. Start the first node; > 3. Start the second node; > 4. As soon as the second node starts ans says Finished Hinted Handoff to node > 1, start node 3; > 5. Load the schema from YAML using JMX or use Thrift to define some schema so > that we could use nodetool (CASSANDRA-1286) > I ended up with a strange ring configuration: > [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.132 ring > Address Status State Load Token > > > 162149197822681929203296559575110871861 > 10.50.26.133 Up Normal 41.61 KB > 34543310227330005404531081788197792565 > 10.50.26.132 Up Normal 41.61 KB > 77078606092447313337452907717168818997 > 10.50.26.132 Up Normal 41.61 KB > 162149197822681929203296559575110871861 > [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.133 ring > Address Status State Load Token > > > 162149197822681929203296559575110871861 > 10.50.26.133 Up Normal 41.61 KB > 34543310227330005404531081788197792565 > 10.50.26.132 Up Normal 41.61 KB > 77078606092447313337452907717168818997 > 10.50.26.132 Up Normal 41.61 KB > 162149197822681929203296559575110871861 > [agouda...@cas-test1 ~]$ nodetool --host=10.50.26.134 ring > Address Status State Load Token > > > 162149197822681929203296559575110871861 > 10.50.26.133 Up Normal 41.61 KB > 34543310227330005404531081788197792565 > 10.50.26.132 Up Normal 41.61 KB > 77078606092447313337452907717168818997 > 10.50.26.132 Up Normal 41.61 KB > 162149197822681929203296559575110871861 > In my case > 10.50.26.132 = node 1 > 10.50.26.133 = node 2 > 10.50.26.134 = node 3 > As you see node2 is repeated Twice. Node 3 is running however does not show > up in the ring! > Now, if in step 4 if I wait for bootstrap of node 2 to kick in and finish, I > won't have this problem. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.