[ https://issues.apache.org/jira/browse/CASSANDRA-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13099254#comment-13099254 ]
Mck SembWever edited comment on CASSANDRA-3150 at 9/7/11 7:43 PM: ------------------------------------------------------------------ What about the case where tokens of different length exist. Could get_range_slices be busted there? I don't know if this is actually possible but from {noformat} Address Status State Load Owns Token Token(bytes[76118303760208547436305468318170713656]) 152.90.241.22 Up Normal 270.46 GB 33.33% Token(bytes[30303030303031333131313739353337303038d4e7f72db2ed11e09d7c68b59973a5d8]) 152.90.241.24 Up Normal 247.89 GB 33.33% Token(bytes[303030303030313331323631393735313231381778518cc00711e0acb968b59973a5d8]) 152.90.241.23 Up Normal 1.1 TB 33.33% Token(bytes[76118303760208547436305468318170713656]) {noformat} you see the real tokens are very long compared to the initial_tokens the cluster was configured with. (The two long tokens have been moved off their initial_tokens, and to note the load on .23 never decreased to ~300GB as it should have...). was (Author: michaelsembwever): What about the case where tokens of different length exist. I don't know if this is actually possible but from {noformat} Address Status State Load Owns Token Token(bytes[76118303760208547436305468318170713656]) 152.90.241.22 Up Normal 270.46 GB 33.33% Token(bytes[30303030303031333131313739353337303038d4e7f72db2ed11e09d7c68b59973a5d8]) 152.90.241.24 Up Normal 247.89 GB 33.33% Token(bytes[303030303030313331323631393735313231381778518cc00711e0acb968b59973a5d8]) 152.90.241.23 Up Normal 1.1 TB 33.33% Token(bytes[76118303760208547436305468318170713656]) {noformat} you see the real tokens are very long compared to the initial_tokens the cluster was configured with. (The two long tokens have been moved off their initial_tokens, and to note the load on .23 never decreased to ~300GB as it should have...). > ColumnFormatRecordReader loops forever > -------------------------------------- > > Key: CASSANDRA-3150 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3150 > Project: Cassandra > Issue Type: Bug > Components: Hadoop > Affects Versions: 0.8.4 > Reporter: Mck SembWever > Assignee: Mck SembWever > Priority: Critical > Attachments: CASSANDRA-3150.patch > > > From http://thread.gmane.org/gmane.comp.db.cassandra.user/20039 > {quote} > bq. Cassandra-0.8.4 w/ ByteOrderedPartitioner > bq. CFIF's inputSplitSize=196608 > bq. 3 map tasks (from 4013) is still running after read 25 million rows. > bq. Can this be a bug in StorageService.getSplits(..) ? > getSplits looks pretty foolproof to me but I guess we'd need to add > more debug logging to rule out a bug there for sure. > I guess the main alternative would be a bug in the recordreader paging. > {quote} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira