[jira] [Commented] (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-04-14 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13019803#comment-13019803 ] Simon Willnauer commented on LUCENE-2324: - guys I opened LUCENE-3023 to land on

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-03-11 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005631#comment-13005631 ] Jason Rutherglen commented on LUCENE-2324: -- bq. I think making a different data

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-03-11 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005642#comment-13005642 ] Michael McCandless commented on LUCENE-2324: The slowdown could have been due

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-03-11 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005651#comment-13005651 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}Ie, if a given term X occurrs

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-03-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005155#comment-13005155 ] Michael McCandless commented on LUCENE-2324: One nice side effect of DWPT is

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-03-10 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005159#comment-13005159 ] Jason Rutherglen commented on LUCENE-2324: -- Is the max optimal DWPT size related

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-03-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005172#comment-13005172 ] Michael McCandless commented on LUCENE-2324: bq. Is the max optimal DWPT size

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-03-10 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005177#comment-13005177 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}Because 1) the RAM efficiency

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-03-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005188#comment-13005188 ] Michael McCandless commented on LUCENE-2324: Concurrency today is similar to

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-02-25 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12999518#comment-12999518 ] Simon Willnauer commented on LUCENE-2324: - bq. Outstanding issues are to fix the

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-02-24 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12998873#comment-12998873 ] Simon Willnauer commented on LUCENE-2324: - Can anyone gimme a quick statement

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-02-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12999244#comment-12999244 ] Michael Busch commented on LUCENE-2324: --- {quote} Somehow, we have to let each DWPT

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-02-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12999247#comment-12999247 ] Michael Busch commented on LUCENE-2324: --- {quote} Can anyone gimme a quick statement

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-29 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988457#action_12988457 ] Michael McCandless commented on LUCENE-2324: Actually, instead of buffering

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-29 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988460#action_12988460 ] Michael McCandless commented on LUCENE-2324: bq. Alternatively, we could keep

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-29 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988462#action_12988462 ] Michael McCandless commented on LUCENE-2324: OK, I opened LUCENE-2897. Per

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-29 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988463#action_12988463 ] Jason Rutherglen commented on LUCENE-2324: -- I had to read this a few times, yes

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-28 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988043#action_12988043 ] Michael McCandless commented on LUCENE-2324: Ahh, I see the problem now --

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-28 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988079#action_12988079 ] Jason Rutherglen commented on LUCENE-2324: -- bq. Jason I don't think special

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-28 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988082#action_12988082 ] Michael McCandless commented on LUCENE-2324: bq. Where are we gaining flush

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-28 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988090#action_12988090 ] Jason Rutherglen commented on LUCENE-2324: -- bq. Even if we do full stop for

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-27 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987827#action_12987827 ] Jason Rutherglen commented on LUCENE-2324: -- I think we have a logical issue with

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-25 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986556#action_12986556 ] Jason Rutherglen commented on LUCENE-2324: -- The compilation errors are gone,

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-23 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985395#action_12985395 ] Michael McCandless commented on LUCENE-2324: One problem I realized in

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-23 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985468#action_12985468 ] Michael McCandless commented on LUCENE-2324: I'm getting compilation errors

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-23 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985547#action_12985547 ] Simon Willnauer commented on LUCENE-2324: - {quote} Somehow, we have to let each

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-22 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985089#action_12985089 ] Michael McCandless commented on LUCENE-2324: bq. Right, it'll eat into the RAM

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-21 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984738#action_12984738 ] Michael McCandless commented on LUCENE-2324: bq. If we implemented sequence-id

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984780#action_12984780 ] Jason Rutherglen commented on LUCENE-2324: -- bq. How would we handle wraparound

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984784#action_12984784 ] Jason Rutherglen commented on LUCENE-2324: -- Sorry, pre-coffee math, a short is 2

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-20 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984285#action_12984285 ] Michael McCandless commented on LUCENE-2324: OK I think Michael's example can

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-20 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984291#action_12984291 ] Jason Rutherglen commented on LUCENE-2324: -- bq. When a delete arrives, we should

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-20 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984343#action_12984343 ] Michael McCandless commented on LUCENE-2324: bq. In fact, with shared

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-20 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12984379#action_12984379 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}We could/should go do it right

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-19 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983613#action_12983613 ] Michael Busch commented on LUCENE-2324: --- So I'm wondering about the following

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983720#action_12983720 ] Michael McCandless commented on LUCENE-2324: I like the grocery store analogy!

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-19 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983756#action_12983756 ] Jason Rutherglen commented on LUCENE-2324: -- bq. we are wanting to allow

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-18 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983154#action_12983154 ] Michael McCandless commented on LUCENE-2324: I ran a quick perf test here: I

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-18 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983209#action_12983209 ] Jason Rutherglen commented on LUCENE-2324: -- bq. I can't test flush by RAM -

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-18 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983246#action_12983246 ] Michael Busch commented on LUCENE-2324: --- {quote} I ran a quick perf test here: I

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-18 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983316#action_12983316 ] Michael McCandless commented on LUCENE-2324: The branch is looking very

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-18 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12983346#action_12983346 ] Michael Busch commented on LUCENE-2324: --- bq. Why does DW.anyDeletions need to be

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982900#action_12982900 ] Michael Busch commented on LUCENE-2324: --- My last commit yesterday made almost all

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-17 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982926#action_12982926 ] Jason Rutherglen commented on LUCENE-2324: -- Looks like TestNRTThreads is still

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-16 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982364#action_12982364 ] Jason Rutherglen commented on LUCENE-2324: -- I just noticed this. I think this

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-16 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982367#action_12982367 ] Jason Rutherglen commented on LUCENE-2324: -- Maybe getAndLock should accept a

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-16 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982374#action_12982374 ] Jason Rutherglen commented on LUCENE-2324: -- Here's a potential plan for the

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-15 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982200#action_12982200 ] Michael Busch commented on LUCENE-2324: --- I just committed fixes for some failing

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982205#action_12982205 ] Jason Rutherglen commented on LUCENE-2324: -- The TestStressIndexing2 errors remind

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982213#action_12982213 ] Jason Rutherglen commented on LUCENE-2324: -- In DW.flushAllThreads we're accessing

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982220#action_12982220 ] Jason Rutherglen commented on LUCENE-2324: -- DW.deleteTerms iterates on DWPTs

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-14 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981827#action_12981827 ] Jason Rutherglen commented on LUCENE-2324: -- I'm taking a guess here, however the

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-14 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981830#action_12981830 ] Jason Rutherglen commented on LUCENE-2324: -- Also multiple threads can call

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-14 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981832#action_12981832 ] Michael Busch commented on LUCENE-2324: --- bq. as we're iterating on ThreadStates and

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-14 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981839#action_12981839 ] Jason Rutherglen commented on LUCENE-2324: -- bq. The threadBindings hashmap is a

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-14 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981895#action_12981895 ] Jason Rutherglen commented on LUCENE-2324: -- Also, why are we always (well,

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-13 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981192#action_12981192 ] Michael Busch commented on LUCENE-2324: --- I made some progress with the concurrency

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-13 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981305#action_12981305 ] Jason Rutherglen commented on LUCENE-2324: --

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-13 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981380#action_12981380 ] Michael Busch commented on LUCENE-2324: --- bq. Really? That makes synchronized seem

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-13 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981388#action_12981388 ] Earwin Burrfoot commented on LUCENE-2324: - Maan, this comment list is infinite.

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-13 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981390#action_12981390 ] Michael Busch commented on LUCENE-2324: --- bq. How do I currently get the ..er..

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-13 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981519#action_12981519 ] Jason Rutherglen commented on LUCENE-2324: -- bq. look at

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-13 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12981548#action_12981548 ] Michael Busch commented on LUCENE-2324: --- bq. DWPT.perDocAllocator and freeLevel can

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979558#action_12979558 ] Michael McCandless commented on LUCENE-2324: I think on commit if we hit an

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-10 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979625#action_12979625 ] Jason Rutherglen commented on LUCENE-2324: -- bq. Any segs already flushed remain

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-10 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979649#action_12979649 ] Michael Busch commented on LUCENE-2324: --- bq. Longer term c) would be great, or, if

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-10 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979654#action_12979654 ] Michael Busch commented on LUCENE-2324: --- bq. I think aborting a flush should only

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-10 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979655#action_12979655 ] Jason Rutherglen commented on LUCENE-2324: -- bq. Lost in abbreviations - Can you

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-10 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979671#action_12979671 ] Michael Busch commented on LUCENE-2324: --- {quote} Mainly that we could have DWPT(s)

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979713#action_12979713 ] Michael McCandless commented on LUCENE-2324: {quote} bq. Lost in abbreviations

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-09 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979308#action_12979308 ] Michael McCandless commented on LUCENE-2324: {quote} I think with B we're

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-09 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979382#action_12979382 ] Jason Rutherglen commented on LUCENE-2324: -- bq. Once flush is triggered, the

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979129#action_12979129 ] Michael McCandless commented on LUCENE-2324: bq. I guess we don't really need

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979138#action_12979138 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}So all that's guaranteed after

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979139#action_12979139 ] Jason Rutherglen commented on LUCENE-2324: -- Also, don't we need the global lock

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979146#action_12979146 ] Michael McCandless commented on LUCENE-2324: {quote} What if the user wants a

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979149#action_12979149 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}As soon as a DWPT is pulled

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979162#action_12979162 ] Jason Rutherglen commented on LUCENE-2324: -- And there's the case of the thread

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979190#action_12979190 ] Michael McCandless commented on LUCENE-2324: {quote} And there's the case of

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979189#action_12979189 ] Michael McCandless commented on LUCENE-2324: bq. The proposed change is simply

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979229#action_12979229 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}the flush the world case? (Ie

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979243#action_12979243 ] Jason Rutherglen commented on LUCENE-2324: -- To further clarify, we also no longer

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979247#action_12979247 ] Michael Busch commented on LUCENE-2324: --- bq. I think the risk is a new DWPT likely

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979248#action_12979248 ] Michael Busch commented on LUCENE-2324: --- {quote} I think start simple - the

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979252#action_12979252 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}I think segment 1 shouldn't be

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-06 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978401#action_12978401 ] Michael McCandless commented on LUCENE-2324: {quote} We're going to great

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-06 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978403#action_12978403 ] Michael McCandless commented on LUCENE-2324: {quote} Right if the DWPT's

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-06 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978466#action_12978466 ] Michael Busch commented on LUCENE-2324: --- {quote} I believe we can drop the delete in

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-06 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978504#action_12978504 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}actually what should be

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-06 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978516#action_12978516 ] Jason Rutherglen commented on LUCENE-2324: -- When we're OOMing the ram used

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-05 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12977833#action_12977833 ] Jason Rutherglen commented on LUCENE-2324: -- Perhaps it's best to place the RAM

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-05 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12977892#action_12977892 ] Jason Rutherglen commented on LUCENE-2324: -- Another model we could implement is a

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-05 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978060#action_12978060 ] Michael McCandless commented on LUCENE-2324: {queue} Another model we could

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-05 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978059#action_12978059 ] Michael McCandless commented on LUCENE-2324: {quote} Taking a step back, I'm

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-05 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978065#action_12978065 ] Jason Rutherglen commented on LUCENE-2324: -- We're going to great lengths it seems

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-05 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978075#action_12978075 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}I believe we can drop the

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-04 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12977443#action_12977443 ] Jason Rutherglen commented on LUCENE-2324: -- Looks like the problem with

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-04 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12977465#action_12977465 ] Jason Rutherglen commented on LUCENE-2324: -- Also I think the deadlock is

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-04 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12977560#action_12977560 ] Jason Rutherglen commented on LUCENE-2324: -- Taking a step back, I'm not sure

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2011-01-04 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12977585#action_12977585 ] Jason Rutherglen commented on LUCENE-2324: -- I think we can get DWPTs working sans

  1   2   3   >