[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-4937: -- Fix Version/s: (was: 1.2.4) 2.0 Reverted from 1.2, kept in trunk as planned above. > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Labels: core > Fix For: 2.0 > > Attachments: 4937-v3.txt, CASSANDRA-4937.patch, > CASSANDRA-4937-trunk.patch, CASSANDRA-4937-v4.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Yaskevich updated CASSANDRA-4937: --- Attachment: CASSANDRA-4937-v4.patch Re-attached v4 with key cache population fix and KeyCacheTest changed to use assertEquals instead of 'assert'. > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Labels: core > Fix For: 1.2.4 > > Attachments: 4937-v3.txt, CASSANDRA-4937.patch, > CASSANDRA-4937-trunk.patch, CASSANDRA-4937-v4.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Yaskevich updated CASSANDRA-4937: --- Attachment: (was: CASSANDRA-4937-v4.patch) > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Labels: core > Fix For: 1.2.4 > > Attachments: 4937-v3.txt, CASSANDRA-4937.patch, > CASSANDRA-4937-trunk.patch, CASSANDRA-4937-v4.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Yaskevich updated CASSANDRA-4937: --- Attachment: CASSANDRA-4937-v4.patch Ok, attaching v4 with a config option (disabled by default). > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Labels: core > Fix For: 1.2.4 > > Attachments: 4937-v3.txt, CASSANDRA-4937.patch, > CASSANDRA-4937-trunk.patch, CASSANDRA-4937-v4.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-4937: -- Reviewer: yukim (was: jbellis) > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Labels: core > Fix For: 1.2.3 > > Attachments: 4937-v3.txt, CASSANDRA-4937.patch, > CASSANDRA-4937-trunk.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Lebresne updated CASSANDRA-4937: Fix Version/s: (was: 1.2.2) 1.2.3 > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Labels: core > Fix For: 1.2.3 > > Attachments: 4937-v3.txt, CASSANDRA-4937.patch, > CASSANDRA-4937-trunk.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-4937: -- Attachment: 4937-v3.txt > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Labels: core > Fix For: 1.2.2 > > Attachments: 4937-v3.txt, CASSANDRA-4937.patch, > CASSANDRA-4937-trunk.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Yaskevich updated CASSANDRA-4937: --- Attachment: CASSANDRA-4937-trunk.patch Patch (based on trunk) removes skip cache from readers and adds advice on SSTableReader last dereference and preheating if key cache was enabled. > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Fix For: 1.2.2 > > Attachments: CASSANDRA-4937.patch, CASSANDRA-4937-trunk.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-4937: -- Priority: Major (was: Minor) Affects Version/s: (was: 1.1.6) Fix Version/s: (was: 1.1.7) 1.2.1 > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Fix For: 1.2.1 > > Attachments: CASSANDRA-4937.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Yaskevich updated CASSANDRA-4937: --- Attachment: CASSANDRA-4937.patch updated the patch with missing CRAR metadata.close() > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Affects Versions: 1.1.6 >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich >Priority: Minor > Fix For: 1.1.7 > > Attachments: CASSANDRA-4937.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Yaskevich updated CASSANDRA-4937: --- Attachment: (was: CASSANDRA-4937.patch) > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Affects Versions: 1.1.6 >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich >Priority: Minor > Fix For: 1.1.7 > > Attachments: CASSANDRA-4937.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Yaskevich updated CASSANDRA-4937: --- Attachment: CASSANDRA-4937.patch > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Bug >Affects Versions: 1.1.6 >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich > Fix For: 1.1.7 > > Attachments: CASSANDRA-4937.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4937) CRAR improvements (object cache + CompressionMetadata chunk offset storage moved off-heap).
[ https://issues.apache.org/jira/browse/CASSANDRA-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Yaskevich updated CASSANDRA-4937: --- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > CRAR improvements (object cache + CompressionMetadata chunk offset storage > moved off-heap). > --- > > Key: CASSANDRA-4937 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4937 > Project: Cassandra > Issue Type: Improvement >Affects Versions: 1.1.6 >Reporter: Pavel Yaskevich >Assignee: Pavel Yaskevich >Priority: Minor > Fix For: 1.1.7 > > Attachments: CASSANDRA-4937.patch > > > After good amount of testing on one of the clusters it was found that in > order to improve read latency we need to minimize allocation rate that > compression involves, that minimizes GC (as well as heap usage) and > substantially decreases latency on read heavy workloads. > I have also discovered that RAR skip cache harms performance in situation > when reads are done in parallel with compaction working with relatively big > SSTable files (few GB and more). The attached patch removes possibility to > skip cache from compressed files (I can also add changes to RAR to remove > skip cache functionality as a separate patch). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
