[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12974955#action_12974955 ] Hudson commented on CASSANDRA-1470: --- Integrated in Cassandra-0.7 #116 (See

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-17 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12972502#action_12972502 ] Jonathan Ellis commented on CASSANDRA-1470: --- bq. fadvise approach showed a

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-17 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12972507#action_12972507 ] T Jake Luciani commented on CASSANDRA-1470: --- stock 0.7. DirectIO is out IMO

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-16 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12972178#action_12972178 ] T Jake Luciani commented on CASSANDRA-1470: --- @Chris I re-ran the benchmarks

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-15 Thread Hiram Chirino (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12971713#action_12971713 ] Hiram Chirino commented on CASSANDRA-1470: -- BTW.. if you guys want to avoid

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-14 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12971556#action_12971556 ] Chris Goffinet commented on CASSANDRA-1470: --- Do we have any more benchmarks?

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-13 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970974#action_12970974 ] Jonathan Ellis commented on CASSANDRA-1470: --- so we dropped the direct i/o on

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-13 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970980#action_12970980 ] T Jake Luciani commented on CASSANDRA-1470: --- Pavel, It looks like it worked

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-13 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970982#action_12970982 ] Pavel Yaskevich commented on CASSANDRA-1470: Yes. Direct I/O write

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-13 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970987#action_12970987 ] T Jake Luciani commented on CASSANDRA-1470: --- oh sorry was looking at the

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread Peter Schuller (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970102#action_12970102 ] Peter Schuller commented on CASSANDRA-1470: --- Just to clarify then; as jbellis

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread Oleg Anastasyev (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970103#action_12970103 ] Oleg Anastasyev commented on CASSANDRA-1470: Guys, may be I misunderstand

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970225#action_12970225 ] T Jake Luciani commented on CASSANDRA-1470: --- .bq see

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970230#action_12970230 ] Jonathan Ellis commented on CASSANDRA-1470: --- bq. This article is talking

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread Peter Schuller (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970232#action_12970232 ] Peter Schuller commented on CASSANDRA-1470: --- @jake: Pretty good idea to

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970240#action_12970240 ] T Jake Luciani commented on CASSANDRA-1470: --- @peter re (1) in the v12 patch

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread Peter Schuller (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970249#action_12970249 ] Peter Schuller commented on CASSANDRA-1470: --- (1) - great (2) - i'm pretty

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread Peter Schuller (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970253#action_12970253 ] Peter Schuller commented on CASSANDRA-1470: --- Oh, and one more thing: Just to

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970254#action_12970254 ] T Jake Luciani commented on CASSANDRA-1470: --- re (2) just following the code

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-10 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970256#action_12970256 ] T Jake Luciani commented on CASSANDRA-1470: --- bq. Oh, and one more thing:

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-09 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969969#action_12969969 ] Jonathan Ellis commented on CASSANDRA-1470: --- bq. see

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-09 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969973#action_12969973 ] Jonathan Ellis commented on CASSANDRA-1470: --- Also: sounds like we should have

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-09 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969979#action_12969979 ] Pavel Yaskevich commented on CASSANDRA-1470: I have tried to play with

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-09 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969998#action_12969998 ] Jonathan Ellis commented on CASSANDRA-1470: --- bq. Using separate thread for

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-09 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1296#action_1296 ] Pavel Yaskevich commented on CASSANDRA-1470: Agree, it will be possible is

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-09 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970004#action_12970004 ] Jonathan Ellis commented on CASSANDRA-1470: --- bq. the region in the file which

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-09 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970006#action_12970006 ] Pavel Yaskevich commented on CASSANDRA-1470: Yeah, you are correct about

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-12-08 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969328#action_12969328 ] Jonathan Ellis commented on CASSANDRA-1470: --- does that mean we need to do a

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-29 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12964991#action_12964991 ] Chris Goffinet commented on CASSANDRA-1470: --- I am backporting this work to

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-29 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12964992#action_12964992 ] Jonathan Ellis commented on CASSANDRA-1470: --- Chris, are you seeing results

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-29 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12965069#action_12965069 ] Chris Goffinet commented on CASSANDRA-1470: --- It will only help 50% of the

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-22 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12934452#action_12934452 ] Pavel Yaskevich commented on CASSANDRA-1470: Another possible option here

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-22 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12934479#action_12934479 ] Jonathan Ellis commented on CASSANDRA-1470: --- what is being swapped in your

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-22 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12934482#action_12934482 ] Pavel Yaskevich commented on CASSANDRA-1470: I run the same benchmark tests

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-18 Thread Peter Schuller (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933488#action_12933488 ] Peter Schuller commented on CASSANDRA-1470: --- An interesting question btw is

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933190#action_12933190 ] Jonathan Ellis commented on CASSANDRA-1470: --- just to clarify: you are waiting

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933202#action_12933202 ] Pavel Yaskevich commented on CASSANDRA-1470: Jake: So problem with JNA

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933212#action_12933212 ] T Jake Luciani commented on CASSANDRA-1470: --- Johnathan: Yeah, I edited the

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933215#action_12933215 ] Pavel Yaskevich commented on CASSANDRA-1470: If you and Jonathan agree on

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933263#action_12933263 ] Pavel Yaskevich commented on CASSANDRA-1470: Ok, gotcha. will continue with

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933269#action_12933269 ] T Jake Luciani commented on CASSANDRA-1470: --- It may actually help as-is. Just

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933279#action_12933279 ] Jonathan Ellis commented on CASSANDRA-1470: --- rcoli points out that commitlog

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933286#action_12933286 ] T Jake Luciani commented on CASSANDRA-1470: --- I like Peters suggestion of

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933322#action_12933322 ] Chris Goffinet commented on CASSANDRA-1470: --- If you are doing

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-17 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933324#action_12933324 ] Chris Goffinet commented on CASSANDRA-1470: --- *Sorry, won't help if commit

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932431#action_12932431 ] Jonathan Ellis commented on CASSANDRA-1470: --- +1 here for removing unnecessary

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932435#action_12932435 ] Pavel Yaskevich commented on CASSANDRA-1470: Ok, I will drop this.. why

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932437#action_12932437 ] Jonathan Ellis commented on CASSANDRA-1470: --- bq. because it triggers the

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932436#action_12932436 ] Pavel Yaskevich commented on CASSANDRA-1470: And sorry - I actually missed

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932439#action_12932439 ] Pavel Yaskevich commented on CASSANDRA-1470: It triggers compation of the

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932526#action_12932526 ] T Jake Luciani commented on CASSANDRA-1470: --- Another minor issue is I can no

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932527#action_12932527 ] Pavel Yaskevich commented on CASSANDRA-1470: Thanks Jake! And yes can you

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread T Jake Luciani (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932548#action_12932548 ] T Jake Luciani commented on CASSANDRA-1470: --- Well just the JAR. It comes in

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-16 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12932560#action_12932560 ] Jonathan Ellis commented on CASSANDRA-1470: --- the reason we haven't made jna a

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-05 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928707#action_12928707 ] Jonathan Ellis commented on CASSANDRA-1470: --- Let's use exceptions rather than

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-05 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928758#action_12928758 ] Pavel Yaskevich commented on CASSANDRA-1470: Yes, I understand, thanks!

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-04 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928349#action_12928349 ] Jonathan Ellis commented on CASSANDRA-1470: --- I think you could use Lucene's

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-04 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928350#action_12928350 ] Jonathan Ellis commented on CASSANDRA-1470: --- ... that's in

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-04 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928353#action_12928353 ] Chris Goffinet commented on CASSANDRA-1470: --- This is the approach I took.

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-04 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928365#action_12928365 ] Chris Goffinet commented on CASSANDRA-1470: --- I think write is needed, for the

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-04 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928362#action_12928362 ] Pavel Yaskevich commented on CASSANDRA-1470: Thanks for helping guys! I'm

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-04 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928393#action_12928393 ] Jonathan Ellis commented on CASSANDRA-1470: --- Let's start with reading and do

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-04 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928397#action_12928397 ] Pavel Yaskevich commented on CASSANDRA-1470: Jonathan: I agree about

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-04 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928471#action_12928471 ] Jonathan Ellis commented on CASSANDRA-1470: --- The advantage of allocateDirect

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-03 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927787#action_12927787 ] Pavel Yaskevich commented on CASSANDRA-1470: Got you point. I will start

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-02 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927319#action_12927319 ] Jonathan Ellis commented on CASSANDRA-1470: --- can you rebase now that

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-02 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927681#action_12927681 ] Chris Goffinet commented on CASSANDRA-1470: --- Pavel: Does this actually work

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-02 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927685#action_12927685 ] Chris Goffinet commented on CASSANDRA-1470: --- Also, please correct me if I am

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-02 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927701#action_12927701 ] Pavel Yaskevich commented on CASSANDRA-1470: I will check that up again,

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-02 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927707#action_12927707 ] Jonathan Ellis commented on CASSANDRA-1470: --- Do you need direct io on writes

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-02 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927712#action_12927712 ] Chris Goffinet commented on CASSANDRA-1470: --- You need Direct I/O on writes.

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-11-01 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927030#action_12927030 ] Jonathan Ellis commented on CASSANDRA-1470: --- also, can you add a tryFcntl

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-10-13 Thread Robert Coli (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12920714#action_12920714 ] Robert Coli commented on CASSANDRA-1470: Was looking over this patch and

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-10-13 Thread Kelvin Kakugawa (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12920722#action_12920722 ] Kelvin Kakugawa commented on CASSANDRA-1470: We just tried to test the v2

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-10-13 Thread Chris Goffinet (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12920726#action_12920726 ] Chris Goffinet commented on CASSANDRA-1470: --- Kelvin, Let me know what errors

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-10-13 Thread Peter Schuller (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12920728#action_12920728 ] Peter Schuller commented on CASSANDRA-1470: --- On the commit log direct I/O:

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-09-17 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910833#action_12910833 ] Jonathan Ellis commented on CASSANDRA-1470: --- It looks like O_DIRECT is the

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-09-05 Thread Peter Schuller (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906330#action_12906330 ] Peter Schuller commented on CASSANDRA-1470: --- I do believe posix_fadvise()

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-09-05 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906360#action_12906360 ] Jonathan Ellis commented on CASSANDRA-1470: --- Can you elaborate? It looks to

[jira] Commented: (CASSANDRA-1470) use direct io for compaction

2010-09-04 Thread Jonathan Ellis (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906316#action_12906316 ] Jonathan Ellis commented on CASSANDRA-1470: --- The best option looks like using