[
https://issues.apache.org/jira/browse/CASSANDRA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966872#comment-13966872
]
Joshua McKenzie commented on CASSANDRA-3668:
--------------------------------------------
Have a stabilized version again 2.0.6. We have some other issues on trunk
right now on the streaming path so I'll wait until we have that ironed out to
rebase to trunk, re-test, and post patch. Some performance #'s against a
single node locally:
{code:title=single_node}
Summary statistics:
Connections per host: : 1
Total files transferred: : 76
Total bytes transferred: : 2037105326
Total duration (ms): : 43382
Average transfer rate (MB/s): : 22
Peak transfer rate (MB/s): : 25
Summary statistics:
Connections per host: : 2
Total files transferred: : 76
Total bytes transferred: : 2037105326
Total duration (ms): : 25794
Average transfer rate (MB/s): : 38
Peak transfer rate (MB/s): : 45
Summary statistics:
Connections per host: : 4
Total files transferred: : 76
Total bytes transferred: : 2037105326
Total duration (ms): : 20063
Average transfer rate (MB/s): : 48
Peak transfer rate (MB/s): : 60
Summary statistics:
Connections per host: : 6
Total files transferred: : 76
Total bytes transferred: : 2037105326
Total duration (ms): : 19350
Average transfer rate (MB/s): : 50
Peak transfer rate (MB/s): : 66
{code}
With 3 nodes hosted locally on ccm and 6 connections per host, I'm pushing a
comparable 65MB/s peak and 44MB/s average.
I'll update once we get trunk sorted out and I rebase to it.
> Parallel streaming for sstableloader
> ------------------------------------
>
> Key: CASSANDRA-3668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3668
> Project: Cassandra
> Issue Type: Improvement
> Components: API
> Reporter: Manish Zope
> Assignee: Joshua McKenzie
> Priority: Minor
> Labels: streaming
> Fix For: 2.1 beta2
>
> Attachments: 3668-1.1-v2.txt, 3668-1.1.txt,
> 3688-reply_before_closing_writer.txt, sstable-loader performance.txt
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> One of my colleague had reported the bug regarding the degraded performance
> of the sstable generator and sstable loader.
> ISSUE :- https://issues.apache.org/jira/browse/CASSANDRA-3589
> As stated in above issue generator performance is rectified but performance
> of the sstableloader is still an issue.
> 3589 is marked as duplicate of 3618.Both issues shows resolved status.But the
> problem with sstableloader still exists.
> So opening other issue so that sstbleloader problem should not go unnoticed.
> FYI : We have tested the generator part with the patch given in 3589.Its
> Working fine.
> Please let us know if you guys require further inputs from our side.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
