[
https://issues.apache.org/jira/browse/CASSANDRA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuki Morishita updated CASSANDRA-3668:
--------------------------------------
Attachment: 3688-reply_before_closing_writer.txt
So far I found one place that can improve throughput.
Right now, node that receive streaming replies finished after finalizing
sstable, but that takes some time (few hundred msec / per data file), so sender
has to wait that amount of time before transferring next file.
Attached patch modifies this behavior so that node can send reply as soon as
receiving whole data file and sender can proceed immediately to send next file.
Manish, could you try this patch and see how it improves? It can be applied on
cassandra 1.0.6 as well as the latest cassandra-1.0 branch.
I'm still investigating other improvements especially buffering. If I find
anything, I will post them here.
> Performance of sstableloader is affected in 1.0.x
> -------------------------------------------------
>
> Key: CASSANDRA-3668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3668
> Project: Cassandra
> Issue Type: Bug
> Components: API
> Affects Versions: 1.0.7
> Reporter: Manish Zope
> Assignee: Yuki Morishita
> Fix For: 1.0.8
>
> Attachments: 3688-reply_before_closing_writer.txt, sstable-loader
> performance.txt
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> One of my colleague had reported the bug regarding the degraded performance
> of the sstable generator and sstable loader.
> ISSUE :- https://issues.apache.org/jira/browse/CASSANDRA-3589
> As stated in above issue generator performance is rectified but performance
> of the sstableloader is still an issue.
> 3589 is marked as duplicate of 3618.Both issues shows resolved status.But the
> problem with sstableloader still exists.
> So opening other issue so that sstbleloader problem should not go unnoticed.
> FYI : We have tested the generator part with the patch given in 3589.Its
> Working fine.
> Please let us know if you guys require further inputs from our side.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
