[
https://issues.apache.org/jira/browse/CASSANDRA-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168010#comment-13168010
]
Sylvain Lebresne commented on CASSANDRA-3589:
---------------------------------------------
For the generation first, the problem is CASSANDRA-3618, but I've opened a
separate ticket with a more accurate description and because this doesn't only
affect the sstable generator. Note that in simple tests, I saw up to a ~2x
difference between 0.8 and 1.0, but never a 3-4x. That could be because what
you do for the sstable generation exacerbate the problem more than my tests,
but it would still be great if you could try the patch on CASSANDRA-3618 and if
it fully solve the sstable generation problem for you.
I have yet to check for the sstable loading performance problem, but a quick
question first: do you have secondary indexes on the column family you're
loading data in?
> Degraded performance of sstable-generator api and sstable-loader utility in
> cassandra 1.0.x
> -------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3589
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3589
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
> Affects Versions: 1.0.0
> Reporter: Samarth Gahire
> Assignee: Sylvain Lebresne
> Priority: Minor
>
> we are using Sstable-Generation API and Sstable-Loader utility.As soon as
> newer version of cassandra releases I test them for sstable generation and
> loading for time taken by both the processes.Till cassandra 0.8.7 there is no
> significant change in time taken.But in all cassandra-1.0.x i have seen 3-4
> times degraded performance in generation and 2 times degraded performance in
> loading.Because of this we are not upgrading the cassandra to latest version
> as we are processing some TeraBytes of data everyday time taken is very
> important.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
