[
https://issues.apache.org/jira/browse/CASSANDRA-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362410#comment-15362410
]
Sylvain Lebresne commented on CASSANDRA-11943:
----------------------------------------------
This is actually meant to be a follow up of CASSANDRA-11882. We probably
validate that value > 64K are rejected for clustering values (since
CASSANDRA-11882), but the fact we have this limitation in the first place (for
3.x) is only that we write the min/max clustering values in the sstable
metadata and use the old serialization for that which limit values to 64K. So
the goal of this ticket is to lift that limitation by rewriting the sstable
metadata component without that limitation backed in. This is thus a 4.0 ticket
which will require a sstable major version bump.
> Allow value > 64K for clustering columns
> ----------------------------------------
>
> Key: CASSANDRA-11943
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11943
> Project: Cassandra
> Issue Type: Bug
> Components: Local Write-Read Paths
> Reporter: Lerh Chuan Low
> Assignee: Sylvain Lebresne
> Fix For: 4.x
>
>
> Setup:
> I set this up with a 2 node cluster, but I think with a 1 node cluster it
> would encounter the same issue. Use Cassandra 3.
> {code}
> CREATE KEYSPACE Blues WITH REPLICATION = { 'class' : 'SimpleStrategy',
> 'replication_factor' : 2};
> CREATE TABLE test (a text, b text, PRIMARY KEY ((a), b))
> {code}
> Do the following insert:
> {code}
> CONSISTENCY ALL;
> "INSERT INTO %s (a, b) VALUES ('foo', ?)", '<something that is bigger than
> 64k>')
> {code}
> Everything is fine and you can still run queries and so on, C* looks normal.
> But if we restart C*, it never succeeds in starting up:
> {code}
> java.lang.RuntimeException: java.util.concurrent.ExecutionException:
> java.lang.AssertionError: Attempted serializing to buffer exceeded maximum of
> 65535 bytes: 131082
> at org.apache.cassandra.utils.Throwables.maybeFail(Throwables.java:50)
> ~[main/:na]
> at
> org.apache.cassandra.utils.FBUtilities.waitOnFutures(FBUtilities.java:372)
> ~[main/:na]
> at
> org.apache.cassandra.db.commitlog.CommitLogReplayer.blockForWrites(CommitLogReplayer.java:257)
> ~[main/:na]
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:189)
> ~[main/:na]
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:168)
> ~[main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:312)
> [main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:583)
> [main/:na]
> at
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:712)
> [main/:na]
> Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError:
> Attempted serializing to buffer exceeded maximum of 65535 bytes: 131082
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> ~[na:1.8.0_40]
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> ~[na:1.8.0_40]
> at
> org.apache.cassandra.utils.FBUtilities.waitOnFutures(FBUtilities.java:365)
> ~[main/:na]
> ... 6 common frames omitted
> Caused by: java.lang.AssertionError: Attempted serializing to buffer exceeded
> maximum of 65535 bytes: 131082
> at
> org.apache.cassandra.utils.ByteBufferUtil.writeWithShortLength(ByteBufferUtil.java:309)
> ~[main/:na]
> at
> org.apache.cassandra.io.sstable.metadata.StatsMetadata$StatsMetadataSerializer.serialize(StatsMetadata.java:286)
> ~[main/:na]
> at
> org.apache.cassandra.io.sstable.metadata.StatsMetadata$StatsMetadataSerializer.serialize(StatsMetadata.java:235)
> ~[main/:na]
> at
> org.apache.cassandra.io.sstable.metadata.MetadataSerializer.serialize(MetadataSerializer.java:75)
> ~[main/:na]
> at
> org.apache.cassandra.io.sstable.format.big.BigTableWriter.writeMetadata(BigTableWriter.java:378)
> ~[main/:na]
> at
> org.apache.cassandra.io.sstable.format.big.BigTableWriter.access$300(BigTableWriter.java:51)
> ~[main/:na]
> at
> org.apache.cassandra.io.sstable.format.big.BigTableWriter$TransactionalProxy.doPrepare(BigTableWriter.java:342)
> ~[main/:na]
> at
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.prepareToCommit(Transactional.java:173)
> ~[main/:na]
> at
> org.apache.cassandra.io.sstable.format.SSTableWriter.prepareToCommit(SSTableWriter.java:280)
> ~[main/:na]
> at
> org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.prepareToCommit(SimpleSSTableMultiWriter.java:101)
> ~[main/:na]
> at
> org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1145)
> ~[main/:na]
> at
> org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1095)
> ~[main/:na]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> ~[na:1.8.0_40]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> ~[na:1.8.0_40]
> at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_40]
> {code}
> The same error as before can be reproduced if instead of restarting C* we
> call {{nodetool flush}} after the insert, it looks like while flushing
> Memtables and attempting to serialize {{SSTableMetadata}} it still expects
> CKeys less than 64k.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
