[ https://issues.apache.org/jira/browse/CASSANDRA-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026819#comment-15026819 ]
Sam Tunnicliffe commented on CASSANDRA-10738: --------------------------------------------- The post-upgrade sstables for {{system_schema.keyspaces}} you have are definitely corrupted, I added some additional debug logging to the code that tries to load the schema at startup and there's a load of junk in there. The good(ish) news is I've run the same upgrade several times using your pre-upgrade {{system.schema_keyspaces}} tables and have been unable to reproduce the corruption. My suggestion then is to force the migration code that converts from the old to new tables at startup to run again & see if you get usable tables this time around. To do that, remove all the corrupt tables from {{data/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/}} and restore the pre-upgrade tables (the ones in the zip you attached) to {{data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/}}. When you restart the node, it should redo the conversion of the keyspaces table, leaving in place the other system tables that were already converted. It's possible there may be other corrupted sstables in the system keyspace, in which case you should see a similar error as before. If that happens, can you attach the debug.log, and we'll see where to go from there. It the node does start up cleanly, you can verify the schema is correct, data accessible and so forth. Of course, the bad news is that this tells us nothing about how those sstables came to be corrupted in the first place. > upgrading to v3.0.0 nodes crashes with > "org.apache.cassandra.serializers.MarshalException: Unexpected extraneous > bytes after map value" > --------------------------------------------------------------------------------------------------------------------------------------- > > Key: CASSANDRA-10738 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10738 > Project: Cassandra > Issue Type: Bug > Environment: ubuntu14, java8 > Reporter: Christian Sherwood > Assignee: Sam Tunnicliffe > Attachments: 1447894738468-upgrade-2.2.3-3.0.0.zip, cassv3.txt, > keyspaces-abac5682dea631c5b535b3d6cffd0fb6.zip, system_schemas.txt > > > upgrading from v.2.2.3 to v3.0.0 > restarting after upgrade crashes with either > ERROR [main] 2015-11-19 20:21:26,511 CassandraDaemon.java:702 - Exception > encountered during startup > org.apache.cassandra.serializers.MarshalException: Unexpected extraneous > bytes after map value > OR > ERROR [main] 2015-11-19 20:01:13,945 CassandraDaemon.java:702 - Exception > encountered during startup > java.lang.IllegalArgumentException: null > see attached debug and schema -- This message was sent by Atlassian JIRA (v6.3.4#6332)