[ https://issues.apache.org/jira/browse/CASSANDRA-674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989108#comment-12989108 ]
Stu Hood edited comment on CASSANDRA-674 at 2/1/11 9:17 AM: ------------------------------------------------------------ Attaching a snapshot of the work on this new design for the file format. There are a few important blockers not implemented, as evidenced by failing tests, but I feel confident that serialization and format themselves are solid. Please carefully note the caveats listed under {{v2}} on the design doc: http://wiki.apache.org/cassandra/FileFormatDesignDoc#v2 In particular, we will barely see the benefits of compression with this implementation, because only Spans are storing at most 1 row. Storing more than one row in a span will require an index change, and I'd feel much better doing it once this is in trunk. EDIT: Also, this necessarily applies atop CASSANDRA-2062. was (Author: stuhood): Attaching a snapshot of the work on this new design for the file format. There are a few important blockers not implemented, as evidenced by failing tests, but I feel confident that serialization and format themselves are solid. Please carefully note the caveats listed under {{v2}} on the design doc: http://wiki.apache.org/cassandra/FileFormatDesignDoc#v2 In particular, we will barely see the benefits of compression with this implementation, because only Spans are storing at most 1 row. Storing more than one row in a span will require an index change, and I'd feel much better doing it once this is in trunk. > New SSTable Format > ------------------ > > Key: CASSANDRA-674 > URL: https://issues.apache.org/jira/browse/CASSANDRA-674 > Project: Cassandra > Issue Type: Improvement > Components: Core > Reporter: Stu Hood > Fix For: 0.8 > > Attachments: 674-v1.diff, 674-v2.tgz, perf-674-v1.txt, > perf-trunk-2f3d2c0e4845faf62e33c191d152cb1b3fa62806.txt > > > Various tickets exist due to limitations in the SSTable file format, > including #16, #47 and #328. Attached is a proposed design/implementation of > a new file format for SSTables that addresses a few of these limitations. > This v2 implementation is not ready for serious use: see comments for > remaining issues. It is roughly the format described here: > http://wiki.apache.org/cassandra/FileFormatDesignDoc -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira