[
https://issues.apache.org/jira/browse/CASSANDRA-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573901#comment-17573901
]
Caleb Rackliffe commented on CASSANDRA-17781:
---------------------------------------------
+1
> Secondary index building should not block compaction progress
> -------------------------------------------------------------
>
> Key: CASSANDRA-17781
> URL: https://issues.apache.org/jira/browse/CASSANDRA-17781
> Project: Cassandra
> Issue Type: Improvement
> Components: Feature/2i Index
> Reporter: Josh McKenzie
> Assignee: Josh McKenzie
> Priority: Normal
>
> While CASSANDRA-11218 should also address this same problem, that ticket's a
> pretty big beautiful hammer and there's a fairly surgical modification we can
> make to the 2i building process to mitigate 2i building's ability to block
> compaction.
> While 11218 approaches this from a "lots of compactions can starve 2i build
> and things never finish", what I'd like to address here is the inverse that
> building multiple secondary indices in parallel can occupy all available
> compactors to a point where we don't have any left to do actual compactions.
> Completing 2i build can take several hours and the backlog of compactions
> from that time may result in too many uncompacted sstables left to catch up.
> A fairly simple fix is to break 2i building out to its own threadpool w/a hot
> proppable param you can use to change the # of threads for that build in the
> extreme cases where the default of 2 is indufficient.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org
