[jira] Updated: (LUCENE-1492) Allow readOnly OpenReader task

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1492: --- Attachment: LUCENE-1492.patch Attached patch. I plan to commit soon. Allow

[jira] Created: (LUCENE-1492) Allow readOnly OpenReader task

2008-12-16 Thread Michael McCandless (JIRA)
Allow readOnly OpenReader task -- Key: LUCENE-1492 URL: https://issues.apache.org/jira/browse/LUCENE-1492 Project: Lucene - Java Issue Type: Improvement Components: contrib/* Reporter:

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657013#action_12657013 ] Mark Miller commented on LUCENE-1483: - bq. I too created the fallback version (just

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657019#action_12657019 ] Mark Miller commented on LUCENE-1483: - bq. This is very interesting and odd - I can't

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657024#action_12657024 ] Mark Miller commented on LUCENE-1483: - I guess I can't get away with my new index

[jira] Issue Comment Edited: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657024#action_12657024 ] markrmil...@gmail.com edited comment on LUCENE-1483 at 12/16/08 7:47 AM:

[jira] Issue Comment Edited: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657019#action_12657019 ] markrmil...@gmail.com edited comment on LUCENE-1483 at 12/16/08 7:47 AM:

[jira] Issue Comment Edited: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657019#action_12657019 ] markrmil...@gmail.com edited comment on LUCENE-1483 at 12/16/08 7:47 AM:

[jira] Updated: (LUCENE-1410) PFOR implementation

2008-12-16 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Elschot updated LUCENE-1410: - Attachment: LUCENE-1410e.patch The 1410e patch splits off a FrameOfRef class as the superclass

Re: [Fwd: Re: 2.9, 3.0 and deprecation]

2008-12-16 Thread patrick o'leary
Yes, typo.. long day yesterday Uwe Schindler wrote: I've only read through the jdoc of tier so far, but I'm guessing it's doing a dictionary search and splitting the the index readers position based on the result being less than or greater than upper / lower values. Which may be

[jira] Resolved: (LUCENE-1493) Enable setting hits queue size in Search*Task in contrib/benchmark

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-1493. Resolution: Fixed Committed revision 727063. Enable setting hits queue size in

Re: To clone or have a pluggable docidbitset for IndexReader

2008-12-16 Thread Michael McCandless
Jason, Is your need for IndexReader.clone entirely driven by needing a fast way to swap in your own deleted docs? Meaning, if you could plug in your own deleted docs to a reader (somehow), would you not use clone anymore? Mike Jason Rutherglen wrote: Hello, In trying to figure out

[jira] Created: (LUCENE-1493) Enable setting hits queue size in Search*Task in contrib/benchmark

2008-12-16 Thread Michael McCandless (JIRA)
Enable setting hits queue size in Search*Task in contrib/benchmark -- Key: LUCENE-1493 URL: https://issues.apache.org/jira/browse/LUCENE-1493 Project: Lucene - Java Issue Type:

[jira] Commented: (LUCENE-1484) Remove SegmentReader.document synchronization

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656928#action_12656928 ] Michael McCandless commented on LUCENE-1484: {quote} Found it ant test-core.

[jira] Resolved: (LUCENE-1492) Allow readOnly OpenReader task

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-1492. Resolution: Fixed Fix Version/s: (was: 2.4.1) Committed revision

Re: 2.9, 3.0 and deprecation

2008-12-16 Thread Jason Rutherglen
LUCENE-1483, LUCENE-831, LUCENE-1314 Helps for realtime. 5. Is there anything we would need to deprecate now if we were to take advantage of 1.5 concurrent packages? The contrib ParallelMultiSearcher On Sun, Dec 14, 2008 at 3:54 AM, Michael McCandless luc...@mikemccandless.com wrote:

[jira] Commented: (LUCENE-1410) PFOR implementation

2008-12-16 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656988#action_12656988 ] Paul Elschot commented on LUCENE-1410: -- I'd like to split off the performance test

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657000#action_12657000 ] Michael McCandless commented on LUCENE-1483: I tested the query 1, which gets

[jira] Commented: (LUCENE-1487) FieldCacheTermsFilter

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657007#action_12657007 ] Michael McCandless commented on LUCENE-1487: {quote} Perhaps it's enough that

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656997#action_12656997 ] Michael McCandless commented on LUCENE-1483: When I run MatchAllDocsQuery (2M

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656964#action_12656964 ] Michael McCandless commented on LUCENE-1483: Can you post your inefficient

[jira] Updated: (LUCENE-1493) Enable setting hits queue size in Search*Task in contrib/benchmark

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1493: --- Attachment: LUCENE-1493.patch Attached patch. It adds a search.num.hits config

[jira] Updated: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated LUCENE-1483: Attachment: LUCENE-1483.patch Okay, here is the super inefficient ords version.

Re: To clone or have a pluggable docidbitset for IndexReader

2008-12-16 Thread Jason Rutherglen
Mike, needing a fast way to swap in your own deleted docs? Yes, however it is necessary to have a new IndexReader as well from a reopened reader. So clone seems the best approach (unless there's a way I'm not seeing). The clone code is coming along, the norms test seems to pass. As long as

[jira] Commented: (LUCENE-1316) Avoidable synchronization bottleneck in MatchAlldocsQuery$MatchAllScorer

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656944#action_12656944 ] Michael McCandless commented on LUCENE-1316: Yonik is your patch here

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657135#action_12657135 ] Mark Miller commented on LUCENE-1483: - Or can it? Over int.max/2 unique ids and then

[jira] Issue Comment Edited: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657135#action_12657135 ] markrmil...@gmail.com edited comment on LUCENE-1483 at 12/16/08 11:59 AM:

[jira] Commented: (LUCENE-1438) StandardTokenizer splits host names with hyphens into multiple tokens

2008-12-16 Thread Greg Shackles (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657143#action_12657143 ] Greg Shackles commented on LUCENE-1438: --- I ran into this same problem. Some

[jira] Issue Comment Edited: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657135#action_12657135 ] markrmil...@gmail.com edited comment on LUCENE-1483 at 12/16/08 12:17 PM:

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657147#action_12657147 ] Michael McCandless commented on LUCENE-1483: {quote} I was testing with

[jira] Commented: (LUCENE-831) Complete overhaul of FieldCache API/Implementation

2008-12-16 Thread Robert Newson (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657151#action_12657151 ] Robert Newson commented on LUCENE-831: -- I was wondering if the next version of the

Re: Searching in same position across multiple fields

2008-12-16 Thread Chris Hostetter
: 1) Use a modified SpanNearQuery. If we assume that country + phone will always : be one token, we can rely on the fact that the positions of 'au' and '5678' in : Fred's document will be different. : :SpanQuery q1 = new SpanTermQuery(new Term(addresscountry, au)); :SpanQuery q2 = new

Re: To clone or have a pluggable docidbitset for IndexReader

2008-12-16 Thread Michael McCandless
So it seems like a cloned reader would share everything with the previous reader, but these rules would be enforced: * If the old reader had pending changes (held the write lock) when it was cloned, it 1) transfers the write lock to the clone, 2) refuses any further changes to itself

[jira] Commented: (LUCENE-1438) StandardTokenizer splits host names with hyphens into multiple tokens

2008-12-16 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657161#action_12657161 ] Shai Erera commented on LUCENE-1438: These two are not so simple to tackle. They are

Re: To clone or have a pluggable docidbitset for IndexReader

2008-12-16 Thread Jason Rutherglen
ie snapshot the previous reader without going through disk as intermediary, right? Yes. refuses any further changes to itself (freezes itself) Should I create a new variable for refuse updates/freeze or use readonly? If the variable is true then inside of doClose throw an exception? If

[jira] Updated: (LUCENE-1314) IndexReader.clone

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1314: --- Fix Version/s: 2.9 IndexReader.clone - Key:

Re: To clone or have a pluggable docidbitset for IndexReader

2008-12-16 Thread Michael McCandless
Jason Rutherglen wrote: ie snapshot the previous reader without going through disk as intermediary, right? Yes. refuses any further changes to itself (freezes itself) Should I create a new variable for refuse updates/freeze or use readonly? If the variable is true then inside of

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657205#action_12657205 ] Michael McCandless commented on LUCENE-1483: {quote} I guess I can't get

Re: To clone or have a pluggable docidbitset for IndexReader

2008-12-16 Thread Yonik Seeley
On Tue, Dec 16, 2008 at 10:00 AM, Michael McCandless luc...@mikemccandless.com wrote: Is your need for IndexReader.clone entirely driven by needing a fast way to swap in your own deleted docs? Could this be done with a FilteredIndexReader subclass that keeps track of additional deletions?

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657227#action_12657227 ] Mark Miller commented on LUCENE-1483: - bq. I think you can use an int for the ords?

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657237#action_12657237 ] Mark Miller commented on LUCENE-1483: - bq. Admittedly, this is a very small (tiny)

[jira] Issue Comment Edited: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657227#action_12657227 ] markrmil...@gmail.com edited comment on LUCENE-1483 at 12/16/08 4:30 PM:

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657243#action_12657243 ] Michael McCandless commented on LUCENE-1483: But, with this new approach

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657244#action_12657244 ] Michael McCandless commented on LUCENE-1483: {quote} Prob is 1 one then, and

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657245#action_12657245 ] Mark Miller commented on LUCENE-1483: - Okay, I guess thats fair enough. I was going to

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657247#action_12657247 ] Mark Miller commented on LUCENE-1483: - bq. I think the perf gains are very

[jira] Issue Comment Edited: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657245#action_12657245 ] markrmil...@gmail.com edited comment on LUCENE-1483 at 12/16/08 5:29 PM:

solr NumberUtils to lucene?

2008-12-16 Thread Ryan McKinley
I posted this same question for the same reasons a while back... http://markmail.org/message/mji7jnpa5xjfflmw I'm looking at local lucene and trying to figure out how it could go into lucene. As is, locallucene depends on solr since it needs NumberUtils. Any change of heart for moving it

Re: solr NumberUtils to lucene?

2008-12-16 Thread Erik Hatcher
My thoughts... bring over any simple functions like these are that are generally useful.At a quick glance, the functions in Solr's NumberUtils are generally useful and fit well in Lucene's NumberTools. What's the harm? Erik On Dec 16, 2008, at 9:14 PM, Ryan McKinley wrote:

[jira] Created: (LUCENE-1494) Additional features for searching for value across multiple fields (many-to-one style)

2008-12-16 Thread Paul Cowan (JIRA)
Additional features for searching for value across multiple fields (many-to-one style) -- Key: LUCENE-1494 URL: https://issues.apache.org/jira/browse/LUCENE-1494

[jira] Updated: (LUCENE-1494) Additional features for searching for value across multiple fields (many-to-one style)

2008-12-16 Thread Paul Cowan (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Cowan updated LUCENE-1494: --- Attachment: LUCENE-1494-multifield.patch Patch for part 1. Introduces a new sublcass of

[jira] Updated: (LUCENE-1494) Additional features for searching for value across multiple fields (many-to-one style)

2008-12-16 Thread Paul Cowan (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Cowan updated LUCENE-1494: --- Attachment: LUCENE-1494-positionincrement.patch Patch for part 2). This follows the my original

Re: Searching in same position across multiple fields

2008-12-16 Thread Paul Cowan
Hi Hoss, Thanks for the reply. I've created a JIRA issue to track this -- https://issues.apache.org/jira/browse/LUCENE-1494 the initial thought was that just removing the term1.field=term2.field assertion would allow something liek this to work, but i don't think anyone every tried creating

[jira] Commented: (LUCENE-1483) Change IndexSearcher to use MultiSearcher semantics for multiple subreaders

2008-12-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657281#action_12657281 ] Mark Miller commented on LUCENE-1483: - bq. and then seg 2 has just apple orange, then

[jira] Commented: (LUCENE-1494) Additional features for searching for value across multiple fields (many-to-one style)

2008-12-16 Thread Paul Cowan (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657295#action_12657295 ] Paul Cowan commented on LUCENE-1494: 2 things about those patches: 1) I did them