[jira] Commented: (LUCENE-1474) Incorrect SegmentInfo.delCount when IndexReader.flush() is used

2009-06-15 Thread Adrian Hempel (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719435#action_12719435 ] Adrian Hempel commented on LUCENE-1474: --- Hi Michael, The index that Erik was workin

Re: Build failed in Hudson: Lucene-trunk #859

2009-06-15 Thread Simon Willnauer
There is the wrong name in the pom.xml.template for contrib/remote Here is a diff with a patch: Index: contrib/remote/pom.xml.template === --- contrib/remote/pom.xml.template (revision 784550) +++ contrib/remote/pom.xml.template

[jira] Created: (LUCENE-1691) An index copied over another index can result in corruption

2009-06-15 Thread Adrian Hempel (JIRA)
An index copied over another index can result in corruption --- Key: LUCENE-1691 URL: https://issues.apache.org/jira/browse/LUCENE-1691 Project: Lucene - Java Issue Type: Improvement

Re: Build failed in Hudson: Lucene-trunk #859

2009-06-15 Thread Michael Busch
Thanks, Simon! I just committed the fix. Michael On 6/15/09 12:20 AM, Simon Willnauer wrote: There is the wrong name in the pom.xml.template for contrib/remote Here is a diff with a patch: Index: contrib/remote/pom.xml.template

RE: svn commit: r784540 - in /lucene/java/trunk: ./ contrib/remote/ contrib/remote/src/ contrib/remote/src/java/ contrib/remote/src/java/org/ contrib/remote/src/java/org/apache/ contrib/remote/src/jav

2009-06-15 Thread Uwe Schindler
Hi Mike, after adding a new contrib, I think we should also add this to the site docs and also the javadocs generation in the main build.xml. Should I prepare this? I have done this for spatial and trie in the past, too. Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.th

Re: svn commit: r784540 - in /lucene/java/trunk: ./ contrib/remote/ contrib/remote/src/ contrib/remote/src/java/ contrib/remote/src/java/org/ contrib/remote/src/java/org/apache/ contrib/remote/src/j

2009-06-15 Thread Michael McCandless
On Mon, Jun 15, 2009 at 3:41 AM, Uwe Schindler wrote: > Hi Mike, > > after adding a new contrib, I think we should also add this to the site docs > and also the javadocs generation in the main build.xml. Woops, you're right. > Should I prepare this? I have done this for spatial and trie in the pa

[jira] Commented: (LUCENE-1677) Remove GCJ IndexReader specializations

2009-06-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719491#action_12719491 ] Michael McCandless commented on LUCENE-1677: bq. I think test-core is broken t

[jira] Commented: (LUCENE-1677) Remove GCJ IndexReader specializations

2009-06-15 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719504#action_12719504 ] Shai Erera commented on LUCENE-1677: You're right. I updated build.xml, but the change

Re: Build failed in Hudson: Lucene-trunk #859

2009-06-15 Thread Grant Ingersoll
FYI, Simon, you are still a contrib committer ;-) On Jun 15, 2009, at 3:20 AM, Simon Willnauer wrote: There is the wrong name in the pom.xml.template for contrib/remote Here is a diff with a patch: Index: contrib/remote/pom.xml.template

Re: Build failed in Hudson: Lucene-trunk #859

2009-06-15 Thread Simon Willnauer
Uh! I didn't know that I can commit to all contribs Good to know but I have been inactive for a while so I want use my power with care! simon On Mon, Jun 15, 2009 at 12:34 PM, Grant Ingersoll wrote: > FYI, Simon, you are still a contrib committer ;-) > > > On Jun 15, 2009, at 3:20 AM, Simon

[jira] Commented: (LUCENE-1474) Incorrect SegmentInfo.delCount when IndexReader.flush() is used

2009-06-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719512#action_12719512 ] Michael McCandless commented on LUCENE-1474: OK that's good news: the bug is f

[jira] Commented: (LUCENE-1691) An index copied over another index can result in corruption

2009-06-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719513#action_12719513 ] Michael McCandless commented on LUCENE-1691: Copying over an existing index, w

[jira] Commented: (LUCENE-1691) An index copied over another index can result in corruption

2009-06-15 Thread Adrian Hempel (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719520#action_12719520 ] Adrian Hempel commented on LUCENE-1691: --- I realised that would probably be the case,

Re: [jira] Commented: (LUCENE-1691) An index copied over another index can result in corruption

2009-06-15 Thread Mark Miller
Adrian Hempel (JIRA) wrote: [ https://issues.apache.org/jira/browse/LUCENE-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719520#action_12719520 ] Adrian Hempel commented on LUCENE-1691: --- I realised that

[jira] Commented: (LUCENE-1630) Mating Collector and Scorer on doc Id orderness

2009-06-15 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719535#action_12719535 ] Shai Erera commented on LUCENE-1630: Ok I was just about to post the patch, when the S

[jira] Commented: (LUCENE-1630) Mating Collector and Scorer on doc Id orderness

2009-06-15 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719539#action_12719539 ] Earwin Burrfoot commented on LUCENE-1630: - I like the last option most. Creating d

[jira] Issue Comment Edited: (LUCENE-1630) Mating Collector and Scorer on doc Id orderness

2009-06-15 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719539#action_12719539 ] Earwin Burrfoot edited comment on LUCENE-1630 at 6/15/09 5:36 AM: --

RE: svn commit: r784540 - in /lucene/java/trunk: ./ contrib/remote/ contrib/remote/src/ contrib/remote/src/java/ contrib/remote/src/java/org/ contrib/remote/src/java/org/apache/ contrib/remote/src/jav

2009-06-15 Thread Uwe Schindler
Committed into general site docs (developer-resources) and into trunk's docs (large patch, because navigation changed). - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: [email protected] > -Original Message- > From: Michael McCandless [mailto:luc...@mi

Re: svn commit: r784758 - in /lucene/java/trunk: ./ docs/ docs/lucene-sandbox/ src/site/src/documentation/content/xdocs/

2009-06-15 Thread Simon Willnauer
Thanks, uwe! simon On Mon, Jun 15, 2009 at 2:45 PM, wrote: > Author: uschindler > Date: Mon Jun 15 12:45:05 2009 > New Revision: 784758 > > URL: http://svn.apache.org/viewvc?rev=784758&view=rev > Log: > LUCENE-1407: move RemoteSearchable out of core into contrib/remote (add > javadocs to develo

[jira] Updated: (LUCENE-1691) An index copied over another index can result in corruption

2009-06-15 Thread Adrian Hempel (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Hempel updated LUCENE-1691: -- Fix Version/s: (was: 2.4.1) Affects Version/s: 2.4.1 > An index copied over anothe

[jira] Updated: (LUCENE-1688) Deprecating StopAnalyzer ENGLISH_STOP_WORDS - General replacement with an immutable Set

2009-06-15 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Willnauer updated LUCENE-1688: Attachment: StopWords.patch Attached a patch that marks the ENGLISH_STOP_WORDS as deprecat

[jira] Commented: (LUCENE-1595) Split DocMaker into ContentSource and DocMaker

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719555#action_12719555 ] Mark Miller commented on LUCENE-1595: - Okay, how about something like this: we docume

[jira] Commented: (LUCENE-1518) Merge Query and Filter classes

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719558#action_12719558 ] Mark Miller commented on LUCENE-1518: - This issue is marked as part of LUCENE-1345, wh

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719560#action_12719560 ] Mark Miller commented on LUCENE-1606: - This is a cool issue, but it hasn't found an as

[jira] Commented: (LUCENE-1313) Realtime Search

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719561#action_12719561 ] Mark Miller commented on LUCENE-1313: - Whats the verdict on this one Mike? Got the imp

[jira] Commented: (LUCENE-1595) Split DocMaker into ContentSource and DocMaker

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719565#action_12719565 ] Mark Miller commented on LUCENE-1595: - bq. Does this make sense? Okay, sounds good.

[jira] Commented: (LUCENE-1518) Merge Query and Filter classes

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719567#action_12719567 ] Uwe Schindler commented on LUCENE-1518: --- Push to 3.1! -- Uwe > Merge Query and Filt

[jira] Assigned: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler reassigned LUCENE-1606: - Assignee: Uwe Schindler > Automaton Query/Filter (scalable regex) >

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719570#action_12719570 ] Uwe Schindler commented on LUCENE-1606: --- I take it, I think it is almost finished. T

[jira] Updated: (LUCENE-1518) Merge Query and Filter classes

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated LUCENE-1518: Fix Version/s: (was: 2.9) 3.1 > Merge Query and Filter classes > --

[jira] Commented: (LUCENE-1595) Split DocMaker into ContentSource and DocMaker

2009-06-15 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719563#action_12719563 ] Shai Erera commented on LUCENE-1595: ok I agree. I've already documented CHANGES. I'll

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719571#action_12719571 ] Mark Miller commented on LUCENE-1606: - I don't think there is a problem with BSD. I kn

[jira] Updated: (LUCENE-1595) Split DocMaker into ContentSource and DocMaker

2009-06-15 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shai Erera updated LUCENE-1595: --- Attachment: LUCENE-1595.patch Patch adds a checkObsoleteSettings to PerfTask to alert on the use of

[jira] Updated: (LUCENE-1313) Realtime Search

2009-06-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1313: --- Fix Version/s: (was: 2.9) 3.1 OK let's push it to 3.1. It's

Re: svn commit: r784540 - in /lucene/java/trunk: ./ contrib/remote/ contrib/remote/src/ contrib/remote/src/java/ contrib/remote/src/java/org/ contrib/remote/src/java/org/apache/ contrib/remote/src/j

2009-06-15 Thread Michael McCandless
Super, thanks Uwe! Mike On Mon, Jun 15, 2009 at 8:46 AM, Uwe Schindler wrote: > Committed into general site docs (developer-resources) and into trunk's docs > (large patch, because navigation changed). > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMa

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719602#action_12719602 ] Uwe Schindler commented on LUCENE-1606: --- Robert: I applied the patch locally, one te

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719605#action_12719605 ] Robert Muir commented on LUCENE-1606: - Uwe, you are correct, I just took a glance at t

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719606#action_12719606 ] Uwe Schindler commented on LUCENE-1606: --- Doesn't seem to work, I will check the sour

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719607#action_12719607 ] Uwe Schindler commented on LUCENE-1606: --- So I tend to move this to 3.0 or 3.1, becau

Core JDK 1.4 compatible.

2009-06-15 Thread Uwe Schindler
By the way: I compiled core and corresponding tests with an old JDK 1.4 version, I found locally on my machine. Works fine! Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: [email protected] > -Original Message- > From: Uwe Schindler (JIRA) [mailt

Re: Core JDK 1.4 compatible.

2009-06-15 Thread Michael McCandless
:) But those days are numbered! Mike On Mon, Jun 15, 2009 at 11:55 AM, Uwe Schindler wrote: > By the way: > I compiled core and corresponding tests with an old JDK 1.4 version, I found > locally on my machine. Works fine! > > Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen >

Re: Core JDK 1.4 compatible.

2009-06-15 Thread Shai Erera
It would help if we have a target date, then I'll know how many more X's I need to mark on the Calendar :) On Mon, Jun 15, 2009 at 6:56 PM, Michael McCandless < [email protected]> wrote: > :) > > But those days are numbered! > > Mike > > On Mon, Jun 15, 2009 at 11:55 AM, Uwe Schindler wro

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719612#action_12719612 ] Robert Muir commented on LUCENE-1606: - Uwe, sorry about this. I did just verify autom

[jira] Updated: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler updated LUCENE-1606: -- Fix Version/s: (was: 2.9) 3.0 I move this to 3.0 (and not 3.1), because

[jira] Commented: (LUCENE-1599) SpanRegexQuery and SpanNearQuery is not working with MultiSearcher

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719619#action_12719619 ] Mark Miller commented on LUCENE-1599: - Something is modifying the original query itsel

[jira] Assigned: (LUCENE-1599) SpanRegexQuery and SpanNearQuery is not working with MultiSearcher

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller reassigned LUCENE-1599: --- Assignee: Mark Miller > SpanRegexQuery and SpanNearQuery is not working with MultiSearcher >

[jira] Commented: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719623#action_12719623 ] Robert Muir commented on LUCENE-1606: - Uwe, ok. Not to try to complicate things, but

Re: [jira] Updated: (LUCENE-1606) Automaton Query/Filter (scalable regex)

2009-06-15 Thread Michael McCandless
Why do you hate 1.6 Uwe? Mike On Mon, Jun 15, 2009 at 12:10 PM, Uwe Schindler (JIRA) wrote: > >     [ > https://issues.apache.org/jira/browse/LUCENE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel > ] > > Uwe Schindler updated LUCENE-1606: > --

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Michael McCandless
I thought the primary goal of switching to AttributeSource (yes, the name is very generic...) was to allow extensibility to what's created per-Token, so that an app could add their own attrs without costly subclassing/casting per Token, independent of other other "things" adding their tokens, etc.

[jira] Assigned: (LUCENE-1650) Small fix in CustomScoreQuery JavaDoc

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller reassigned LUCENE-1650: --- Assignee: Mark Miller > Small fix in CustomScoreQuery JavaDoc >

[jira] Assigned: (LUCENE-1583) SpanOrQuery skipTo() doesn't always move forwards

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller reassigned LUCENE-1583: --- Assignee: Mark Miller I guess I'll do this one. You out there reading Paul Elschot? This lo

[jira] Commented: (LUCENE-1688) Deprecating StopAnalyzer ENGLISH_STOP_WORDS - General replacement with an immutable Set

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719630#action_12719630 ] Mark Miller commented on LUCENE-1688: - If no one else claims this for 2.9, I guess I'l

[jira] Commented: (LUCENE-973) Token of "" returns in CJKTokenizer + new TestCJKTokenizer

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719635#action_12719635 ] Mark Miller commented on LUCENE-973: You guys looking for this for 2.9? If so, any vol

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Grant Ingersoll
On Jun 15, 2009, at 12:19 PM, Michael McCandless wrote: I don't think anything was "held back" in this effort. Grant, are you referring to LUCENE-1458? That's "held back" simply because the only person working on it (me) got distracted by other things to work on. I'm sorry, I didn't mean to

[jira] Updated: (LUCENE-1630) Mating Collector and Scorer on doc Id orderness

2009-06-15 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shai Erera updated LUCENE-1630: --- Attachment: LUCENE-1630.patch ok - let's start iterating on the patch. Anyone volunteer to accept it

[jira] Commented: (LUCENE-1486) Wildcards, ORs etc inside Phrase queries

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719639#action_12719639 ] Mark Miller commented on LUCENE-1486: - Should this go in contrib rather than core? Tha

[jira] Updated: (LUCENE-1486) Wildcards, ORs etc inside Phrase queries

2009-06-15 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller updated LUCENE-1486: Attachment: LUCENE-1486.patch Reformatted to lucene formatting, removed author tag, removed a coup

[jira] Commented: (LUCENE-1690) Morelikethis queries are very slow compared to other search types

2009-06-15 Thread Richard Marr (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719653#action_12719653 ] Richard Marr commented on LUCENE-1690: -- Sounds reasonable although that'll take a lit

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Grant Ingersoll
On Jun 14, 2009, at 8:05 PM, Michael Busch wrote: I'm not sure why this (currently having to implement next() too) is such an issue for you. You brought it up at the Lucene meetup too. No user will ever have to implement both (the new API and the old) in their streams/filters. The only reas

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Yonik Seeley
The high-level description of the new API looks good (being able to add arbitrary properties to tokens), unfortunately, I've never had the time to try and use it and give any constructive feedback. As far as difficulty of use, I assume this only applies to implementing your own TokenFilter? It see

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Mark Miller
Yonik Seeley wrote: The high-level description of the new API looks good (being able to add arbitrary properties to tokens), unfortunately, I've never had the time to try and use it and give any constructive feedback. As far as difficulty of use, I assume this only applies to implementing your o

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Robert Muir
> > As Lucene's contrib hasn't been fully converted either (and its been quite > some time now), someone has probably heard that groan before. hope this doesn't sound like a complaint, but in my opinion this is because many do not have any tests. I converted a few of these and its just grunt work

[jira] Created: (LUCENE-1692) Contrib analyzers need tests

2009-06-15 Thread Robert Muir (JIRA)
Contrib analyzers need tests Key: LUCENE-1692 URL: https://issues.apache.org/jira/browse/LUCENE-1692 Project: Lucene - Java Issue Type: Test Components: contrib/analyzers Reporter: Robert Mu

[jira] Updated: (LUCENE-1313) Near Realtime Search

2009-06-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-1313: - Summary: Near Realtime Search (was: Realtime Search) > Near Realtime Search > -

[jira] Commented: (LUCENE-1313) Realtime Search

2009-06-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719665#action_12719665 ] Jason Rutherglen commented on LUCENE-1313: -- Just wanted to give an update on this

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Grant Ingersoll
On Jun 14, 2009, at 8:05 PM, Michael Busch wrote: I'd be happy to discuss other API proposals that anybody brings up here, that have the same advantages and are more intuitive. We could also beef up the documentation and give a better example about how to convert a stream/filter from the

[jira] Updated: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler updated LUCENE-1673: -- Attachment: LUCENE-1673.patch Updated patch: - now with extended JavaDocs - additional tests f

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Mark Miller
Robert Muir wrote: As Lucene's contrib hasn't been fully converted either (and its been quite some time now), someone has probably heard that groan before. hope this doesn't sound like a complaint, Complaints are fine in any case. Every now and then, it might cause a little rant from me o

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Robert Muir
Mark, I created an issue for this. I just think you know, converting an analyzer to the new api is really not that bad. reverse engineering what one of them does is not necessarily obvious, and is completely unrelated but necessary if they are to be migrated. I'd be willing to assist with some o

[jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719689#action_12719689 ] Michael McCandless commented on LUCENE-1673: bq. So one using new code must al

[jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719692#action_12719692 ] Michael McCandless commented on LUCENE-1673: bq. The only open point is the na

[jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719699#action_12719699 ] Yonik Seeley commented on LUCENE-1673: -- bq. This will apply to int/long/float/double

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Mark Miller
Robert Muir wrote: Mark, I created an issue for this. Thanks Robert, great idea. I just think you know, converting an analyzer to the new api is really not that bad. I don't either. I'm really just complaining about the initial readability. Once you know whats up, its not too much differ

RE: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Uwe Schindler
> Also, what about the case where one might have attributes that are meant > for downstream TokenFilters, but not necessarily for indexing? Offsets > and type come to mind. Is it the case now that those attributes are not > automatically added to the index? If they are ignored now, what if I

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Yonik Seeley
On Mon, Jun 15, 2009 at 3:00 PM, Uwe Schindler wrote: > There is a new Attribute called ShiftAttribute (or NumericShiftAttribute), > when trie range is moved to core. This attribute contains the shifted-away > bits from the prefix encoded value during trie indexing. I was wondering about this

[jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719726#action_12719726 ] Uwe Schindler commented on LUCENE-1673: --- {quote} bq. This will apply to int/long/flo

[jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719729#action_12719729 ] Uwe Schindler commented on LUCENE-1673: --- bq. Did you think about / decide against ma

RE: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Uwe Schindler
> On Mon, Jun 15, 2009 at 3:00 PM, Uwe Schindler wrote: > > There is a new Attribute called ShiftAttribute (or > NumericShiftAttribute), > > when trie range is moved to core. This attribute contains the shifted- > away > > bits from the prefix encoded value during trie indexing. > > I was wonderin

RE: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Uwe Schindler
> If you understood that, you'd be able to look > at the actual token value if you were interested in what shift was > used. So it's redundant, has a runtime cost, it's not currently used > anywhere, and it's not useful to fields other than Trie. Perhaps it > shouldn't exist (yet)? You are right

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Robert Muir
Mark, I'll see if I can get tests produced for some of those analyzers. as a new user of the new api myself, I think I can safely say the most confusing thing about it is having the old deprecated API mixed in the javadocs with it :) On Mon, Jun 15, 2009 at 2:53 PM, Mark Miller wrote: > Robert Mu

[jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719738#action_12719738 ] Uwe Schindler commented on LUCENE-1673: --- I think, I remove the ShiftAttribute in com

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Robert Muir
let me try some slightly more constructive feedback: new user looks at TokenStream javadocs: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/javadoc/org/apache/lucene/analysis/TokenStream.html immediately they see deprecated, text in red with the words "experimental", warnings in bold, the

RE: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Uwe Schindler
> there's also a stray bold tag gone haywire somewhere, possibly > .incrementToken() I fixed this. This was going me on my nerves the whole day when I wrote javadocs for NumericTokenStream... Uwe - To unsubscribe, e-mail: java-

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Mark Miller
Some great points - especially the decision between a deprecated API, and a new experimental one subject to change. Bit of a rock and a hard place for a new user. Perhaps we should add a little note with some guidance. - Mark Robert Muir wrote: let me try some slightly more constructive fee

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Michael Busch
This is excellent feedback, Robert! I agree this is confusing; especially having a deprecated API and only a experimental one that replaces the old one. We need to change that. And I don't like the *useNewAPI*() methods either. I spent a lot of time thinking about backwards compatibility for th

RE: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Uwe Schindler
By the way, there is an empty "de" subdir in SVN inside analysis. Can this be removed? And, in tests: test/o/a/l/index/store is somehow wrong placed. The class inside should be in test/o/a/l/store. Should I move? - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMai

RE: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Uwe Schindler
> And I don't like the *useNewAPI*() methods either. I spent a lot of time > thinking about backwards compatibility for this API. It's tricky to do > without sacrificing performance. In API patches I find myself spending > more time for backwards-compatibility than for the actual new feature! :(

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Robert Muir
Michael, again I am terrible with such things myself... Personally I am impressed that you have the back compat, even if you don't change any code at all I think some reformatting of javadocs might make the situation a lot friendlier. I just listed everything that came to my mind immediately. I g

[jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719761#action_12719761 ] Michael McCandless commented on LUCENE-1673: OK let's open a new issue for how

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Michael Busch
I have implemented most of that actually (the interface part and Token implementing all of them). The problem is a paradigm change with the new API: the assumption is that there is always only one single instance of an Attribute. With the old API, it is recommended to reuse the passed-in token

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Michael McCandless
On Mon, Jun 15, 2009 at 4:21 PM, Uwe Schindler wrote: > And, in tests: test/o/a/l/index/store is somehow wrong placed. The class > inside should be in test/o/a/l/store. Should I move? Please do! Mike - To unsubscribe, e-mail: j

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Michael Busch
I agree. It's my fault, the task of changing the contribs (LUCENE-1460) is assigned to me for a while now - I just haven't found the time to do it yet. It's great that you started the work on that! I'll try to review the patch in the next couple of days and help with fixing the remaining ones

Re: [jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Mark Miller
Michael McCandless (JIRA) wrote: We're forking off new 2.9 issues left and right here!! Evil :) You guys are like small team working against me. We still have 29+- issue to wrap up though, so probably plenty of time. I hope we can set a rough target date soon though - it really feels like

Re: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Robert Muir
Michael OK, I plan on adding some tests for the analyzers that don't have any. I didn't try to migrate things such as highlighter, which are definitely just as important, only because I'm not familiar with that territory. But I think I can figure out what the various language analyzers are trying

RE: New Token API was Re: Payloads and TrieRangeQuery

2009-06-15 Thread Uwe Schindler
Maybe change the deprecation wrapper around next() and next(Token) [the default impl of incrementToken()] to check, if the retrieved token is not identical to the attribute and then just copy the contents to the instance-Token? This would be a slowdown, but only be the case for very rare TokenStrea

[jira] Commented: (LUCENE-1541) Trie range - make trie range indexing more flexible

2009-06-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719766#action_12719766 ] Michael McCandless commented on LUCENE-1541: Uwe, what's the plan on this issu

Re: [jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Michael McCandless
On Mon, Jun 15, 2009 at 4:42 PM, Mark Miller wrote: > Remember the last time we started to push for 2.9 in Dec/Jan :) Yes this is very much on my mind too!! So maybe, it's a race between the trie* "group" of issues, and the other 28 ;) Mike -

[jira] Commented: (LUCENE-1313) Near Realtime Search

2009-06-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719767#action_12719767 ] Jason Rutherglen commented on LUCENE-1313: -- TestThreadedOptimize is throwing a en

[jira] Commented: (LUCENE-1541) Trie range - make trie range indexing more flexible

2009-06-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719769#action_12719769 ] Uwe Schindler commented on LUCENE-1541: --- I see no real use in it, it does not affect

RE: [jira] Commented: (LUCENE-1673) Move TrieRange to core

2009-06-15 Thread Uwe Schindler
Sorry, I think these new issues may also be in 3.1 (not all), but I want to have this trie stuff with a clean API before 2.9 and not deprecate parts of it again in 3.1, shortly after release :-( This issues are no hard changes, its just a little bit API cleanup you can do in your freetime :-] --

  1   2   >