[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738081#comment-14738081 ] Stefania commented on CASSANDRA-8630: - bq. Can we impose the limit we have for thr

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737800#comment-14737800 ] Benedict commented on CASSANDRA-8630: - So, looking at the code as I was about to c

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737469#comment-14737469 ] Benedict commented on CASSANDRA-8630: - Sure, sorry - this slipped out of my workfl

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733944#comment-14733944 ] Ariel Weisberg commented on CASSANDRA-8630: --- Since the work is already done

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733463#comment-14733463 ] Stefania commented on CASSANDRA-8630: - {{FB.NS_DANGEROUS_NON_SHORT_CIRCUIT}} I do

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733448#comment-14733448 ] Benedict commented on CASSANDRA-8630: - Neither of them are actually bugs. I don't

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733187#comment-14733187 ] Stefania commented on CASSANDRA-8630: - The following Coverity defects were reporte

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14730685#comment-14730685 ] Benedict commented on CASSANDRA-8630: - Thanks. Committed as ce63ccc842dc6e71297653

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14730241#comment-14730241 ] Stefania commented on CASSANDRA-8630: - CI looks fine to me, on both Linux and Wind

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728305#comment-14728305 ] Stefania commented on CASSANDRA-8630: - Looking at the first read operation, 8630 i

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728053#comment-14728053 ] Benedict commented on CASSANDRA-8630: - Well, I don't know if it's random chance or

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727634#comment-14727634 ] Philip Thompson commented on CASSANDRA-8630: Windows CI: Dtest http://cas

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727483#comment-14727483 ] Joshua McKenzie commented on CASSANDRA-8630: In regards to the interrelati

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727049#comment-14727049 ] Stefania commented on CASSANDRA-8630: - Rebased all 3 branches to current 3.0 and l

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727031#comment-14727031 ] Benedict commented on CASSANDRA-8630: - Perhaps we should ensure all three are reba

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726651#comment-14726651 ] Stefania commented on CASSANDRA-8630: - The latest cperf test has completed. These

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726545#comment-14726545 ] Stefania commented on CASSANDRA-8630: - Fixed a small problem that was causing CI i

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725118#comment-14725118 ] Stefania commented on CASSANDRA-8630: - Thanks. I've launched another [cperf test|

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724898#comment-14724898 ] Benedict commented on CASSANDRA-8630: - I must admit that I thought, from Ariel's c

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724871#comment-14724871 ] Stefania commented on CASSANDRA-8630: - Here is a cperf result: http://cstar.datas

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724615#comment-14724615 ] Stefania commented on CASSANDRA-8630: - Thanks [~benedict] and [~JoshuaMcKenzie].

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724092#comment-14724092 ] Benedict commented on CASSANDRA-8630: - I've pushed a version with a few suggestion

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723526#comment-14723526 ] Joshua McKenzie commented on CASSANDRA-8630: While I don't expect this to

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723274#comment-14723274 ] Stefania commented on CASSANDRA-8630: - Thanks! > Faster sequential IO (on compact

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723248#comment-14723248 ] Benedict commented on CASSANDRA-8630: - Sure. Since it's a big patch, I'm just givi

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14721790#comment-14721790 ] Stefania commented on CASSANDRA-8630: - I rebase on 3.0 quite regularly, I rebased

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720302#comment-14720302 ] Ariel Weisberg commented on CASSANDRA-8630: --- The pig tests don't work everyw

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14719961#comment-14719961 ] Ariel Weisberg commented on CASSANDRA-8630: --- +1 on the code. I reviewed the

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717832#comment-14717832 ] Stefania commented on CASSANDRA-8630: - Thanks. sharedCopy must be implemented be

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716863#comment-14716863 ] Ariel Weisberg commented on CASSANDRA-8630: --- snapshot() and sharedCopy() are

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715899#comment-14715899 ] Stefania commented on CASSANDRA-8630: - I've removed the array deep copy and added

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715228#comment-14715228 ] Ariel Weisberg commented on CASSANDRA-8630: --- bq. It works for me both from I

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712805#comment-14712805 ] Stefania commented on CASSANDRA-8630: - bq. We could consider changing this for com

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711632#comment-14711632 ] Ariel Weisberg commented on CASSANDRA-8630: --- bq. We could consider changing

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710938#comment-14710938 ] Benedict commented on CASSANDRA-8630: - bq. Buffer sizes can vary with the statisti

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710918#comment-14710918 ] Stefania commented on CASSANDRA-8630: - bq. DataInputBuffer line 25, NIODataInputSt

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710183#comment-14710183 ] Ariel Weisberg commented on CASSANDRA-8630: --- DataInputBuffer line 25, NIODat

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708687#comment-14708687 ] Stefania commented on CASSANDRA-8630: - I've fixed {{ChecksummedDataInput}} so that

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706806#comment-14706806 ] Stefania commented on CASSANDRA-8630: - Yes that might work I will try it out, than

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706791#comment-14706791 ] Benedict commented on CASSANDRA-8630: - OK. How about adapting it to just have a {{

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706777#comment-14706777 ] Stefania commented on CASSANDRA-8630: - Thanks for your comments. bq. For Checksum

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706537#comment-14706537 ] Benedict commented on CASSANDRA-8630: - A few random comments (not performing revie

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706492#comment-14706492 ] Stefania commented on CASSANDRA-8630: - I completed the move of segments to the bui

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704570#comment-14704570 ] Benedict commented on CASSANDRA-8630: - If you're going with an array of {{Region}}

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704551#comment-14704551 ] Stefania commented on CASSANDRA-8630: - I've rebased to 3.0 and renamed the branch

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704048#comment-14704048 ] Ariel Weisberg commented on CASSANDRA-8630: --- bq. You would think so. But tak

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703958#comment-14703958 ] Benedict commented on CASSANDRA-8630: - bq. I don't see how an array of pairs can b

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703606#comment-14703606 ] Benedict commented on CASSANDRA-8630: - bq. In what scenario would we not want to m

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703597#comment-14703597 ] Ariel Weisberg commented on CASSANDRA-8630: --- Yes you should rebase to 3.0. W

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702906#comment-14702906 ] Benedict commented on CASSANDRA-8630: - bq. I don't think we serialize the version.

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702774#comment-14702774 ] Stefania commented on CASSANDRA-8630: - bq. Right, but we'll need to deserialize th

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702755#comment-14702755 ] Benedict commented on CASSANDRA-8630: - bq. They are serialized in the summary but

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702744#comment-14702744 ] Stefania commented on CASSANDRA-8630: - The boundaries are gone. They are serialize

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702720#comment-14702720 ] Benedict commented on CASSANDRA-8630: - bq. He also added Constructor is private, m

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702714#comment-14702714 ] Stefania commented on CASSANDRA-8630: - bq. I think Ariel was suggesting a new clas

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702681#comment-14702681 ] Benedict commented on CASSANDRA-8630: - bq. RateLimiter is not a final class. I t

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702662#comment-14702662 ] Stefania commented on CASSANDRA-8630: - Thank you for the quick review and all the

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702017#comment-14702017 ] Ariel Weisberg commented on CASSANDRA-8630: --- Some more things I noticed * R

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701858#comment-14701858 ] Ariel Weisberg commented on CASSANDRA-8630: --- Doing code review now * In Reb

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701626#comment-14701626 ] Ariel Weisberg commented on CASSANDRA-8630: --- OK, I won't get too involved in

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701566#comment-14701566 ] Benedict commented on CASSANDRA-8630: - I guess it depends on what we're trying to

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701532#comment-14701532 ] Ariel Weisberg commented on CASSANDRA-8630: --- So your saying that in practice

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701519#comment-14701519 ] Benedict commented on CASSANDRA-8630: - Bear in mind you're performing a 100 way co

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701515#comment-14701515 ] Ariel Weisberg commented on CASSANDRA-8630: --- I guess I mixed up compressed a

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700970#comment-14700970 ] Benedict commented on CASSANDRA-8630: - Probably due to the burst-limit of the rate

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700948#comment-14700948 ] Stefania commented on CASSANDRA-8630: - The slowness with the uncompressed mmaped s

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700684#comment-14700684 ] Stefania commented on CASSANDRA-8630: - Thanks for your analysis. I repeated the t

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700433#comment-14700433 ] Ariel Weisberg commented on CASSANDRA-8630: --- Flight recording of 8630 with c

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700401#comment-14700401 ] Ariel Weisberg commented on CASSANDRA-8630: --- ||Version|Time 1|Time 2|Time 3|

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700234#comment-14700234 ] Ariel Weisberg commented on CASSANDRA-8630: --- I have an empty box I can run i

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699287#comment-14699287 ] Benedict commented on CASSANDRA-8630: - Given it is about the same with compression

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699282#comment-14699282 ] Stefania commented on CASSANDRA-8630: - bq. Hmm. The patch is slower in both runs w

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699202#comment-14699202 ] Benedict commented on CASSANDRA-8630: - Hmm. The patch is slower in both runs witho

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699151#comment-14699151 ] Stefania commented on CASSANDRA-8630: - [~benedict] I would appreciate some feedbac

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698039#comment-14698039 ] Stefania commented on CASSANDRA-8630: - Great news, thank you so much for confirmin

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697108#comment-14697108 ] Ariel Weisberg commented on CASSANDRA-8630: --- You are right it's the wrong ti

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696455#comment-14696455 ] Stefania commented on CASSANDRA-8630: - I don't see any changes to NIODataInputStre

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679819#comment-14679819 ] Stefania commented on CASSANDRA-8630: - I'm still getting little-endian buffers in

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661625#comment-14661625 ] Stefania commented on CASSANDRA-8630: - Thank you! :) > Faster sequential IO (on c

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661615#comment-14661615 ] Robert Stupp commented on CASSANDRA-8630: - Here you go :) ohc 0.4.1 has Java b

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661569#comment-14661569 ] Stefania commented on CASSANDRA-8630: - I see, let's stick to big-endian for now. M

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661567#comment-14661567 ] Robert Stupp commented on CASSANDRA-8630: - I'm also +1 on option 1 (stick with

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661560#comment-14661560 ] Benedict commented on CASSANDRA-8630: - It would be better, from that perspective t

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661554#comment-14661554 ] Robert Stupp commented on CASSANDRA-8630: - OHC forces native byte order to pre

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661541#comment-14661541 ] Stefania commented on CASSANDRA-8630: - About byte ordering, it seems OHC insists o

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14655149#comment-14655149 ] Benedict commented on CASSANDRA-8630: - bq. For the fast path, the built-in BB meth

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14655129#comment-14655129 ] Stefania commented on CASSANDRA-8630: - Much nicer thanks. Do we care about littl

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654962#comment-14654962 ] Benedict commented on CASSANDRA-8630: - I think we can do something much simpler, w

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654789#comment-14654789 ] Stefania commented on CASSANDRA-8630: - Thanks for the heads up on 9500. I basical

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653738#comment-14653738 ] Benedict commented on CASSANDRA-8630: - My expectation was that we would extract th

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653716#comment-14653716 ] Ariel Weisberg commented on CASSANDRA-8630: --- Ah, so we would enhance readNex

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653678#comment-14653678 ] Benedict commented on CASSANDRA-8630: - We already have a branch in every case? Thi

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653676#comment-14653676 ] Benedict commented on CASSANDRA-8630: - We already have a branch in every case? Thi

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653630#comment-14653630 ] Ariel Weisberg commented on CASSANDRA-8630: --- You might want to avoid creatin

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653263#comment-14653263 ] Benedict commented on CASSANDRA-8630: - Yes, spot on (at a high level - specifics m

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653224#comment-14653224 ] Stefania commented on CASSANDRA-8630: - [~benedict], sorry for the delay, I finally

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14642564#comment-14642564 ] Stefania commented on CASSANDRA-8630: - Thank you, no need to attach your sstables,

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14642495#comment-14642495 ] Oleg Anastasyev commented on CASSANDRA-8630: The test was compacting 1.2G

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14642479#comment-14642479 ] Benedict commented on CASSANDRA-8630: - I think we can avoid static methods by maki

[jira] [Commented] (CASSANDRA-8630) Faster sequential IO (on compaction, streaming, etc)

[ https://issues.apache.org/jira/browse/CASSANDRA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14642387#comment-14642387 ] Stefania commented on CASSANDRA-8630: - I've attached some flight recorder files ge

  1   2   >