[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch In trying to implement the per-segment deletes I encounter

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934381#action_12934381 ] Jason Rutherglen commented on LUCENE-2680: -- Running TestStressIndexing2 500 times

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934384#action_12934384 ] Jason Rutherglen commented on LUCENE-2680: -- The above isn't on trunk, I misread t

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934388#action_12934388 ] Jason Rutherglen commented on LUCENE-2680: -- I've isolated the mismatch in num doc

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934390#action_12934390 ] Jason Rutherglen commented on LUCENE-2680: -- A test to see if the problem is the d

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch * I added pushDeletesLastSegment to doc writer * Deletes

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch I made the changes listed above, ie, docids and deletesInR

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12964606#action_12964606 ] Jason Rutherglen commented on LUCENE-2680: -- I guess you think the sync on doc wri

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12964610#action_12964610 ] Jason Rutherglen commented on LUCENE-2680: -- I started on taking the approach of m

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12964938#action_12964938 ] Jason Rutherglen commented on LUCENE-2680: -- bq. The waitReady(null) is there so t

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch This patch separates out most of the deletes storage and p

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch Now we're returning the DocumentsWriterThreadState to IW t

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12965468#action_12965468 ] Jason Rutherglen commented on LUCENE-2680: -- Here's a random guess, I think becaus

[jira] Commented: (LUCENE-2792) Add a simple FST impl to Lucene

[ https://issues.apache.org/jira/browse/LUCENE-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12966597#action_12966597 ] Jason Rutherglen commented on LUCENE-2792: -- Can the FST be made concurrent for us

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969504#action_12969504 ] Jason Rutherglen commented on LUCENE-2680: -- When patching there are errors on Ind

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969754#action_12969754 ] Jason Rutherglen commented on LUCENE-2680: -- We're close, I think SegmentDeletes i

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969799#action_12969799 ] Jason Rutherglen commented on LUCENE-2680: -- The patch applied. Ok, a likely caus

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969822#action_12969822 ] Jason Rutherglen commented on LUCENE-2680: -- All tests pass. > Improve how IndexW

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969836#action_12969836 ] Jason Rutherglen commented on LUCENE-2324: -- Now that LUCENE-2680 is implemented w

[jira] Resolved: (LUCENE-2655) Get deletes working in the realtime branch

[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen resolved LUCENE-2655. -- Resolution: Won't Fix Per-segment deletes were implemented as a part of LUCENE-2680.

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969856#action_12969856 ] Jason Rutherglen commented on LUCENE-2324: -- > and then merge realtime back into t

[jira] Commented: (LUCENE-2792) Add a simple FST impl to Lucene

[ https://issues.apache.org/jira/browse/LUCENE-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970251#action_12970251 ] Jason Rutherglen commented on LUCENE-2792: -- {quote}Just an idea, maybe you could

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970262#action_12970262 ] Jason Rutherglen commented on LUCENE-2324: -- Michael, I don't have commit access

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970341#action_12970341 ] Jason Rutherglen commented on LUCENE-2324: -- bq. The merge is rather hard, as you

[jira] Commented: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970530#action_12970530 ] Jason Rutherglen commented on LUCENE-2793: -- Perhaps we can add the ability to thr

[jira] Commented: (LUCENE-2814) stop writing shared doc stores across segments

[ https://issues.apache.org/jira/browse/LUCENE-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12972531#action_12972531 ] Jason Rutherglen commented on LUCENE-2814: -- bq. I think we've got DWPT down to ab

[jira] Commented: (LUCENE-2814) stop writing shared doc stores across segments

[ https://issues.apache.org/jira/browse/LUCENE-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12972541#action_12972541 ] Jason Rutherglen commented on LUCENE-2814: -- Steven, is that on a wiki page? The

[jira] Commented: (SOLR-2290) the termsInfosDivisor for readers opened by indexWriter should be configurable in Solr

[ https://issues.apache.org/jira/browse/SOLR-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12972847#action_12972847 ] Jason Rutherglen commented on SOLR-2290: Tom, I think this can be generified to use

[jira] Commented: (LUCENE-2814) stop writing shared doc stores across segments

[ https://issues.apache.org/jira/browse/LUCENE-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12972850#action_12972850 ] Jason Rutherglen commented on LUCENE-2814: -- bq. backporting to 3.x... Out of cu

[jira] Commented: (LUCENE-2500) A Linux-specific Directory impl that bypasses the buffer cache

[ https://issues.apache.org/jira/browse/LUCENE-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12972855#action_12972855 ] Jason Rutherglen commented on LUCENE-2500: -- DirectIOLinuxDirectory is in trunk an

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973024#action_12973024 ] Jason Rutherglen commented on LUCENE-2312: -- I think this can be implemented on th

[jira] Commented: (LUCENE-2814) stop writing shared doc stores across segments

[ https://issues.apache.org/jira/browse/LUCENE-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973025#action_12973025 ] Jason Rutherglen commented on LUCENE-2814: -- bq. And I think we should backport DW

[jira] Updated: (LUCENE-2575) Concurrent byte and int block implementations

[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2575: - Attachment: LUCENE-2575.patch The same as the last patch updated to trunk. > Concurrent

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973060#action_12973060 ] Jason Rutherglen commented on LUCENE-2312: -- I thought about opening a separate is

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973092#action_12973092 ] Jason Rutherglen commented on LUCENE-2312: -- After further thought, there really i

[jira] Updated: (LUCENE-2575) Concurrent byte and int block implementations

[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2575: - Attachment: LUCENE-2575.patch A few things in BBP needed to be public. > Concurrent byt

[jira] Commented: (LUCENE-2825) FSDirectory.open should return MMap on 64-bit Solaris

[ https://issues.apache.org/jira/browse/LUCENE-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973210#action_12973210 ] Jason Rutherglen commented on LUCENE-2825: -- bq. some queries were actually faster

[jira] Updated: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2312: - Attachment: LUCENE-2312-FC.patch Simple patch that's added a new CachedArray setValue me

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973396#action_12973396 ] Jason Rutherglen commented on LUCENE-2312: -- For TermOrdValComparator we'll have a

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973696#action_12973696 ] Jason Rutherglen commented on LUCENE-2312: -- bq. how will we incrementally update

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973732#action_12973732 ] Jason Rutherglen commented on LUCENE-2312: -- bq. Maybe we add a supportsOrd() to t

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973734#action_12973734 ] Jason Rutherglen commented on LUCENE-2324: -- As per Michael B's email, I'll start

[jira] Commented: (SOLR-2290) the termsInfosDivisor for readers opened by indexWriter should be configurable in Solr

[ https://issues.apache.org/jira/browse/SOLR-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974224#action_12974224 ] Jason Rutherglen commented on SOLR-2290: I think it'll require creating a new sub-el

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974247#action_12974247 ] Jason Rutherglen commented on LUCENE-2312: -- bq. Obtaining a normal fieldcache ent

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974264#action_12974264 ] Jason Rutherglen commented on LUCENE-2312: -- bq. DocValues == column stride fields

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974484#action_12974484 ] Jason Rutherglen commented on LUCENE-2324: -- Also, it'd be great if we could summa

[jira] Updated: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2324: - Attachment: test.out Here's ant test-core output. Looks like it's deadlocking in TestIn

[jira] Updated: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2324: - Attachment: LUCENE-2324-SMALL.patch Small patch fixing the num deletes test null pointer

[jira] Commented: (LUCENE-2841) CommonGramsFilter improvements

[ https://issues.apache.org/jira/browse/LUCENE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12976341#action_12976341 ] Jason Rutherglen commented on LUCENE-2841: -- bq. you still aren't ever removing an

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977443#action_12977443 ] Jason Rutherglen commented on LUCENE-2324: -- Looks like the problem with TestIndex

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977465#action_12977465 ] Jason Rutherglen commented on LUCENE-2324: -- Also I think the deadlock is happenin

[jira] Updated: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2324: - Attachment: LUCENE-2324-SMALL.patch I added an assertion showing the lack of DWPTs when

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977560#action_12977560 ] Jason Rutherglen commented on LUCENE-2324: -- Taking a step back, I'm not sure flus

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977585#action_12977585 ] Jason Rutherglen commented on LUCENE-2324: -- I think we can get DWPTs working sans

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977833#action_12977833 ] Jason Rutherglen commented on LUCENE-2324: -- Perhaps it's best to place the RAM tr

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977892#action_12977892 ] Jason Rutherglen commented on LUCENE-2324: -- Another model we could implement is a

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12978065#action_12978065 ] Jason Rutherglen commented on LUCENE-2324: -- We're going to great lengths it seems

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12978075#action_12978075 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}I believe we can drop the dele

[jira] Updated: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2324: - Attachment: LUCENE-2324-SMALL.patch Same as the last patch, however default deletes is a

[jira] Updated: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2324: - Attachment: test.out Here's a new test.out, I'll look at TestCheckIndex which should pro

[jira] Updated: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2324: - Attachment: LUCENE-2324-SMALL.patch I added a FlushPolicy class, deletes record the ram

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12978504#action_12978504 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}actually what should be happen

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12978516#action_12978516 ] Jason Rutherglen commented on LUCENE-2324: -- When we're OOMing the ram used report

[jira] Updated: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2324: - Attachment: LUCENE-2324-SMALL.patch RAM accounting is slightly improved, we had two vari

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979138#action_12979138 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}So all that's guaranteed after

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979139#action_12979139 ] Jason Rutherglen commented on LUCENE-2324: -- Also, don't we need the global lock f

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979149#action_12979149 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}As soon as a DWPT is pulled fr

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979162#action_12979162 ] Jason Rutherglen commented on LUCENE-2324: -- And there's the case of the thread ca

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979229#action_12979229 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}the "flush the world" case? (I

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979243#action_12979243 ] Jason Rutherglen commented on LUCENE-2324: -- To further clarify, we also no longer

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979252#action_12979252 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}I think segment 1 shouldn't be

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979382#action_12979382 ] Jason Rutherglen commented on LUCENE-2324: -- bq. Once flush is triggered, the thre

[jira] Commented: (LUCENE-2186) First cut at column-stride fields (index values storage)

[ https://issues.apache.org/jira/browse/LUCENE-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979395#action_12979395 ] Jason Rutherglen commented on LUCENE-2186: -- Out of curiosity, re: LUCENE-2312, ar

[jira] Commented: (LUCENE-2186) First cut at column-stride fields (index values storage)

[ https://issues.apache.org/jira/browse/LUCENE-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979407#action_12979407 ] Jason Rutherglen commented on LUCENE-2186: -- bq. we are very close - to land on tr

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979625#action_12979625 ] Jason Rutherglen commented on LUCENE-2324: -- bq. Any segs already flushed remain f

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979631#action_12979631 ] Jason Rutherglen commented on LUCENE-2312: -- {quote}Is that right that future RT r

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979646#action_12979646 ] Jason Rutherglen commented on LUCENE-2312: -- {quote}The one exception to point-in-

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979655#action_12979655 ] Jason Rutherglen commented on LUCENE-2324: -- bq. Lost in abbreviations - Can you

[jira] Commented: (LUCENE-2474) Allow to plug in a Cache Eviction Listener to IndexReader to eagerly clean custom caches that use the IndexReader (getFieldCacheKey)

[ https://issues.apache.org/jira/browse/LUCENE-2474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979720#action_12979720 ] Jason Rutherglen commented on LUCENE-2474: -- {quote}make this a static method, eg

[jira] Commented: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979728#action_12979728 ] Jason Rutherglen commented on LUCENE-2793: -- Shall I take this one? With the plan

[jira] Commented: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979736#action_12979736 ] Jason Rutherglen commented on LUCENE-2793: -- {quote}this issue only adds the IOCon

[jira] Created: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

Create IndexWriter event listener, specifically for merges -- Key: LUCENE-2856 URL: https://issues.apache.org/jira/browse/LUCENE-2856 Project: Lucene - Java Issue Type: Improvement

[jira] Commented: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979740#action_12979740 ] Jason Rutherglen commented on LUCENE-2793: -- bq. Basically the IOContext needs to

[jira] Updated: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2793: - Attachment: LUCENE-2793.patch Ok, I created an IOFactory class that generates input and

[jira] Commented: (LUCENE-2859) Move Multi* and SlowMultiReaderWrapper to contrib

[ https://issues.apache.org/jira/browse/LUCENE-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980309#action_12980309 ] Jason Rutherglen commented on LUCENE-2859: -- bq. Merging of segments needs Multi*

[jira] Updated: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

[ https://issues.apache.org/jira/browse/LUCENE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2856: - Attachment: LUCENE-2856.patch I added a SegmentListener class which is set on IWC. I st

[jira] Commented: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980435#action_12980435 ] Jason Rutherglen commented on LUCENE-2793: -- bq. You get IOFactory from Directory

[jira] Commented: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

[ https://issues.apache.org/jira/browse/LUCENE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980436#action_12980436 ] Jason Rutherglen commented on LUCENE-2856: -- bq. A CompositeSegmentListener niftil

[jira] Commented: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980533#action_12980533 ] Jason Rutherglen commented on LUCENE-2793: -- Ok, lets remove bufferSize. bq. it

[jira] Commented: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980546#action_12980546 ] Jason Rutherglen commented on LUCENE-2793: -- bq. The directory is the factory for

[jira] Commented: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

[ https://issues.apache.org/jira/browse/LUCENE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980553#action_12980553 ] Jason Rutherglen commented on LUCENE-2856: -- bq. I think start/endTime can be long

[jira] Commented: (LUCENE-2793) Directory createOutput and openInput should take an IOContext

[ https://issues.apache.org/jira/browse/LUCENE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980555#action_12980555 ] Jason Rutherglen commented on LUCENE-2793: -- In the patch the bufferSize is an int

[jira] Commented: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

[ https://issues.apache.org/jira/browse/LUCENE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980565#action_12980565 ] Jason Rutherglen commented on LUCENE-2856: -- bq. We could go with a -1 setting als

[jira] Commented: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

[ https://issues.apache.org/jira/browse/LUCENE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980803#action_12980803 ] Jason Rutherglen commented on LUCENE-2856: -- I'll added events for flush, open, cl

[jira] Updated: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

[ https://issues.apache.org/jira/browse/LUCENE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2856: - Attachment: LUCENE-2856.patch Here's a first cut including workarounds to avoid NPEs and

[jira] Updated: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

[ https://issues.apache.org/jira/browse/LUCENE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2856: - Attachment: LUCENE-2856.patch The aborted merge event is now generated and tested for.

[jira] Commented: (LUCENE-2856) Create IndexWriter event listener, specifically for merges

[ https://issues.apache.org/jira/browse/LUCENE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12981019#action_12981019 ] Jason Rutherglen commented on LUCENE-2856: -- I separated out a ReaderListener beca

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12981305#action_12981305 ] Jason Rutherglen commented on LUCENE-2324: -- {quote}DocumentsWriterPerThreadPool.T

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12981519#action_12981519 ] Jason Rutherglen commented on LUCENE-2324: -- bq. look at ThreadAffinityDocumentsWr

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12981563#action_12981563 ] Jason Rutherglen commented on LUCENE-2324: -- bq. I think there's something wrong w

<    1   2   3   4   5   6   >