[ https://issues.apache.org/jira/browse/CASSANDRA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13960435#comment-13960435 ]
Joshua McKenzie edited comment on CASSANDRA-3668 at 4/4/14 9:26 PM: -------------------------------------------------------------------- (edit) We're good with the multiple StreamSessions per peer, I just need to iron out a socket-connection race on startup of streams. Prelim parallelized stream testing is peaking at ~ 55MB/s on 5 connections-per-host vs. 49MB/s on 4 connections - diminishing returns as we get higher. Compared to the 24MB/s I'm benchmarking on a single connection it's still a respectable increase. was (Author: joshuamckenzie): (edit) Scratch what I wrote previously - we're good with the multiple StreamSessions per peer, I just need to iron out a socket-connection race on startup of streams. Prelim parallelized stream testing is peaking at ~ 55MB/s on 5 connections-per-host vs. 49MB/s on 4 connections - diminishing returns as we get higher. Compared to the 24MB/s I'm benchmarking on a single connection it's still a respectable increase. > Parallel streaming for sstableloader > ------------------------------------ > > Key: CASSANDRA-3668 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3668 > Project: Cassandra > Issue Type: Improvement > Components: API > Reporter: Manish Zope > Assignee: Joshua McKenzie > Priority: Minor > Labels: streaming > Fix For: 2.1 beta2 > > Attachments: 3668-1.1-v2.txt, 3668-1.1.txt, > 3688-reply_before_closing_writer.txt, sstable-loader performance.txt > > Original Estimate: 48h > Remaining Estimate: 48h > > One of my colleague had reported the bug regarding the degraded performance > of the sstable generator and sstable loader. > ISSUE :- https://issues.apache.org/jira/browse/CASSANDRA-3589 > As stated in above issue generator performance is rectified but performance > of the sstableloader is still an issue. > 3589 is marked as duplicate of 3618.Both issues shows resolved status.But the > problem with sstableloader still exists. > So opening other issue so that sstbleloader problem should not go unnoticed. > FYI : We have tested the generator part with the patch given in 3589.Its > Working fine. > Please let us know if you guys require further inputs from our side. -- This message was sent by Atlassian JIRA (v6.2#6252)