[ 
https://issues.apache.org/jira/browse/CASSANDRA-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026819#comment-15026819
 ] 

Sam Tunnicliffe commented on CASSANDRA-10738:
---------------------------------------------

The post-upgrade sstables for {{system_schema.keyspaces}} you have are 
definitely corrupted, I added some additional debug logging to the code that 
tries to load the schema at startup and there's a load of junk in there. The 
good(ish) news is I've run the same upgrade several times using your 
pre-upgrade {{system.schema_keyspaces}} tables and have been unable to 
reproduce the corruption. My suggestion then is to force the migration code 
that converts from the old to new tables at startup to run again & see if you 
get usable tables this time around. 

To do that, remove all the corrupt tables from 
{{data/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/}} and restore 
the pre-upgrade tables (the ones in the zip you attached) to 
{{data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/}}. When you 
restart the node, it should redo the conversion of the keyspaces table, leaving 
in place the other system tables that were already converted. It's possible 
there may be other corrupted sstables in the system keyspace, in which case you 
should see a similar error as before. If that happens, can you attach the 
debug.log, and we'll see where to go from there. It the node does start up 
cleanly, you can verify the schema is correct, data accessible and so forth. 

Of course, the bad news is that this tells us nothing about how those sstables 
came to be corrupted in the first place.


> upgrading to v3.0.0 nodes crashes with 
> "org.apache.cassandra.serializers.MarshalException: Unexpected extraneous 
> bytes after map value"
> ---------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-10738
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-10738
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: ubuntu14, java8
>            Reporter: Christian Sherwood
>            Assignee: Sam Tunnicliffe
>         Attachments: 1447894738468-upgrade-2.2.3-3.0.0.zip, cassv3.txt, 
> keyspaces-abac5682dea631c5b535b3d6cffd0fb6.zip, system_schemas.txt
>
>
> upgrading from v.2.2.3 to v3.0.0
> restarting after upgrade crashes with either
> ERROR [main] 2015-11-19 20:21:26,511 CassandraDaemon.java:702 - Exception 
> encountered during startup
> org.apache.cassandra.serializers.MarshalException: Unexpected extraneous 
> bytes after map value
> OR 
> ERROR [main] 2015-11-19 20:01:13,945 CassandraDaemon.java:702 - Exception 
> encountered during startup
> java.lang.IllegalArgumentException: null
> see attached debug and schema



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to