[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Fix Version/s: (was: 0.8.2) 1.0 Reverted from 0.8 b/c of CASSANDRA-2818. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Jonathan Ellis > Fix For: 1.0 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt, > 2280-v4.txt, 2280-v5.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Lebresne updated CASSANDRA-2280: Fix Version/s: (was: 0.8.1) 0.8.2 > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Jonathan Ellis > Fix For: 0.8.2 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt, > 2280-v4.txt, 2280-v5.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Attachment: (was: 2280-versioning.txt) > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Jonathan Ellis > Fix For: 0.8.1 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt, > 2280-v4.txt, 2280-v5.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Attachment: 2280-versioning.txt patch to remove "thou shalt not stream across version changes" special case in IncomingTcpConnection > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Jonathan Ellis > Fix For: 0.8.1 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt, > 2280-v4.txt, 2280-v5.txt, 2280-versioning.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Attachment: 2280-v5.txt bq. what about having the list of CFs only in StreamRequestMessage and add the list of cfs to use as an argument to StreamOut.transferRanges() Good idea. Done in v5. Also some refactoring so the different transferRanges methods share the same code. (The one for SRVH wasn't actually ever calling session.close which apparently we don't rely on yet, but it was a bug waiting to happen.) bq. In StreamRequestMessage, we should write the operation type even if version is VERSION_080 Ah... Now I understand what you meant last time. Fixed. bq. Nitpick: and couldn't we use the cf ids instead of the names ? Done. bq. In StreamRequestMessage, the field is a Collection but we're still using Iterables.size() inside Fixed. bq. I suppose the bump of MessagingService from 2 to 81 was on purpose ? (I don't mind, just pointing out to make sure) My thought was that way we'll have VERSION_081=81 next, but I don't care a great deal either. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Jonathan Ellis > Fix For: 0.8.1 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt, > 2280-v4.txt, 2280-v5.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Attachment: 2280-v4.txt bq. We must bump the version for 0.8 Done in v4. bq. In StreamHeader and StreamRequestMessage, Iterables.size() is used Pretty sure we are passing in an Iterables.concat result, which is not a Collection. (If not, no reason not to leave that as an option. Yes, Iterables.size does call .size() on Collection objects.) bq. Why are we sending the cfs in StreamHeader at all? Removed in v4. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Jonathan Ellis > Fix For: 0.8.1 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt, > 2280-v4.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Reviewer: slebresne (was: amorton) Assignee: Jonathan Ellis (was: Stu Hood) > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Jonathan Ellis > Fix For: 0.8.1 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Fix Version/s: (was: 0.8.0) 0.8.1 This is a big enough change that I don't want to sneak it into 0.8 RC. Tagging 0.8.1, meaning, commit to trunk for now and backport after 0.8.0. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Stu Hood > Fix For: 0.8.1 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Attachment: 2280-v3.txt bq. StreamInSession (the session created by the requesting node) doesn't record any of the information about the request That's what I was missing. Thanks for clarifying. v3 rebases and removes special casing of empty CF list. As expected, this improves encapsulation of special cases (only streaming code needs to care, instead of leaking to anything that might touch a list of CF names). Also converted to passing CFS objects around instead of strings, resulting in a minor improvement on the amount of manual looping that gets done. Note that passing table is redundant (CFS objects know their table) and I think the entire "single file" stream mode is unused too, but I've left these alone for now. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Stu Hood > Fix For: 0.8.0 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, 2280-v3.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu Hood updated CASSANDRA-2280: Attachment: 0001-Allow-specific-column-families-to-be-requested-for-str.txt Rebased for trunk. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Stu Hood > Fix For: 0.8 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0001-Allow-specific-column-families-to-be-requested-for-str.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2280: -- Comment: was deleted (was: you're right. added a default for when RS=SimpleStrategy in r1092435) > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Stu Hood > Fix For: 0.8 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu Hood updated CASSANDRA-2280: Attachment: 0001-Allow-specific-column-families-to-be-requested-for-str.txt The reason for special casing the empty list is that it is backwards compatible with older MessagingService versions: otherwise we'd have to perform a lookup during deserialization to build the list for localhost. I think the code delta is about equal either way. Renamed cfs -> columnFamilies and squashed to one patch. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Stu Hood > Fix For: 0.8 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu Hood updated CASSANDRA-2280: Attachment: (was: 0002-Only-flush-matching-CFS.txt) > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Stu Hood > Fix For: 0.8 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu Hood updated CASSANDRA-2280: Attachment: (was: 0001-Allow-specific-column-families-to-be-requested-for-str.txt) > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood >Assignee: Stu Hood > Fix For: 0.8 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu Hood updated CASSANDRA-2280: Attachment: 0002-Only-flush-matching-CFS.txt Adding 0002 to only flush matching CFS. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood > Fix For: 0.8 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt, > 0002-Only-flush-matching-CFS.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (CASSANDRA-2280) Request specific column families using StreamIn
[ https://issues.apache.org/jira/browse/CASSANDRA-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu Hood updated CASSANDRA-2280: Attachment: 0001-Allow-specific-column-families-to-be-requested-for-str.txt Attaching a patch that modifies a few streaming messages to (optionally) specify the CFs to repair. Only AES actually uses this feature. > Request specific column families using StreamIn > --- > > Key: CASSANDRA-2280 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2280 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: Stu Hood > Fix For: 0.8 > > Attachments: > 0001-Allow-specific-column-families-to-be-requested-for-str.txt > > > StreamIn.requestRanges only specifies a keyspace, meaning that requesting a > range will request it for all column families: if you have a large number of > CFs, this can cause quite a headache. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira