RE: Contrib tests fail if core jar is not up to date

2010-03-19 Thread Uwe Schindler
Hi Shai, Good morning! (1)if you add the dependency to jar-core to the task, the jar is rebuild (everytime, as ANT has no idea if something changed, no need to delete). Jar-core depends also on compile-core, so the core compilation is always updates. (2)In this case we simply

RE: Contrib tests fail if core jar is not up to date

2010-03-19 Thread Uwe Schindler
Hi Shai again, the whole thing is more complicated, sorry; on the first insight it seemed simple, but: I had this problem, too. But I didn’t care as I simply did “ant clean” and all was fine. Adding “jar-core” to the build-contrib task would principally work, but only for build-contrib.

RE: Contrib tests fail if core jar is not up to date

2010-03-19 Thread Uwe Schindler
Hi Shai, attached is a patch hat fixes your issue, as described in the previous mail. It now does not do any “short-circuit” checks for the core.jar available, instead solely uses a property that is set by the parent. This works good, now always when you compile a contrib solely (inside

[jira] Commented: (LUCENE-2323) reorganize contrib modules

2010-03-19 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847269#action_12847269 ] Paul Elschot commented on LUCENE-2323: -- Would it be possible to move surround to the

RE: Contrib tests fail if core jar is not up to date

2010-03-19 Thread Uwe Schindler
I opened an issue: https://issues.apache.org/jira/browse/LUCENE-2333 - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de/ http://www.thetaphi.de eMail: u...@thetaphi.de From: Uwe Schindler [mailto:u...@thetaphi.de] Sent: Friday, March 19, 2010 9:19 AM

[jira] Created: (LUCENE-2333) Failures during contrib builds, when classes in core were changed without ant clean

2010-03-19 Thread Uwe Schindler (JIRA)
Failures during contrib builds, when classes in core were changed without ant clean --- Key: LUCENE-2333 URL: https://issues.apache.org/jira/browse/LUCENE-2333 Project:

[jira] Updated: (LUCENE-2333) Failures during contrib builds, when classes in core were changed without ant clean

2010-03-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler updated LUCENE-2333: -- Attachment: shai-compile-fix2.patch shai-compile-fix.patch Here 2 patches:

[jira] Updated: (LUCENE-2333) Failures during contrib builds, when classes in core were changed without ant clean

2010-03-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler updated LUCENE-2333: -- Attachment: shai-compile-fix2.patch Failures during contrib builds, when classes in core

[jira] Updated: (LUCENE-2333) Failures during contrib builds, when classes in core were changed without ant clean

2010-03-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler updated LUCENE-2333: -- Attachment: (was: shai-compile-fix2.patch) Failures during contrib builds, when classes

[jira] Commented: (LUCENE-2333) Failures during contrib builds, when classes in core were changed without ant clean

2010-03-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847309#action_12847309 ] Uwe Schindler commented on LUCENE-2333: --- I am working now on a third patch that also

[jira] Commented: (LUCENE-2323) reorganize contrib modules

2010-03-19 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847313#action_12847313 ] Robert Muir commented on LUCENE-2323: - bq. Would it be possible to move surround to

Latest version of spatial contrib

2010-03-19 Thread Alex
Hi all, I'm back to working and evaluating the spatial contrib and I see a lot has changed in past few months. I see there has been a couple of patches that were submitted. I just applied LUCENE-2139.patch and am trying to work with it right now. I think I am missing something as I see

Re: Latest version of spatial contrib

2010-03-19 Thread Chris Male
Hi Alex, The patches in 2139 have not been updated to trunk so if you are applying them to a checkout, you may get errors. Also, to make it easier for review, I broke the 2139 patch up into smaller patches, attached at the issues 2139 depends on. I would look into applying those patches instead

[jira] Commented: (LUCENE-2280) IndexWriter.optimize() throws NullPointerException

2010-03-19 Thread Ritesh Nigam (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847376#action_12847376 ] Ritesh Nigam commented on LUCENE-2280: -- I will further investigate it if it is a JRE

Re: Contrib tests fail if core jar is not up to date

2010-03-19 Thread Shai Erera
Sorry Uwe, I didn't have access to a computer all day :). I'll take a look at the patch later though (if you'll wait) as even now I have brief access to a computer, w/ no code on it :). Shai On Fri, Mar 19, 2010 at 12:25 PM, Uwe Schindler u...@thetaphi.de wrote: I opened an issue:

[jira] Created: (LUCENE-2334) IndexReader.close() should call IndexReader.decRef() unconditionally ??

2010-03-19 Thread Mike Hanafey (JIRA)
IndexReader.close() should call IndexReader.decRef() unconditionally ?? --- Key: LUCENE-2334 URL: https://issues.apache.org/jira/browse/LUCENE-2334 Project: Lucene - Java

Sorting with little memory: A suggestion

2010-03-19 Thread Toke Eskildsen
I've been tinkering with the SegmentReader and tried to make a sorter that keeps track of ordinals for terms instead of the terms themselves. I call it Exposed, as it exposes inner details. A detailed description of the idea can be found at

Re: Sorting with little memory: A suggestion

2010-03-19 Thread Robert Muir
On Fri, Mar 19, 2010 at 11:06 AM, Toke Eskildsen t...@statsbiblioteket.dk wrote: To me, the trade-offs seems to be new Sort(new SortField(field, locale)) Toke, only partially-on-topic here, is it possible to describe your use-case a little more where its preferable to use this Locale-based

[jira] Commented: (LUCENE-2091) Add BM25 Scoring to Lucene

2010-03-19 Thread Katja Hofmann (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847399#action_12847399 ] Katja Hofmann commented on LUCENE-2091: --- Hi Yuval, I was trying to apply the patch

[jira] Commented: (LUCENE-2334) IndexReader.close() should call IndexReader.decRef() unconditionally ??

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847404#action_12847404 ] Michael McCandless commented on LUCENE-2334: IndexReader.close() is guarding

[jira] Resolved: (LUCENE-2232) Use VShort to encode positions

2010-03-19 Thread Paul Elschot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Elschot resolved LUCENE-2232. -- Resolution: Not A Problem The main advantage of changing the index formats nowadays comes

[jira] Updated: (LUCENE-2333) Failures during contrib builds, when classes in core were changed without ant clean

2010-03-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler updated LUCENE-2333: -- Attachment: LUCENE-2333.patch Here the patch with the previous changes applied. It works like

[jira] Commented: (LUCENE-2333) Failures during contrib builds, when classes in core were changed without ant clean

2010-03-19 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847415#action_12847415 ] Shai Erera commented on LUCENE-2333: This up-to-date thingy looks really cool and

[jira] Commented: (LUCENE-2333) Failures during contrib builds, when classes in core were changed without ant clean

2010-03-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847418#action_12847418 ] Uwe Schindler commented on LUCENE-2333: --- bq. So I guess you'd compare the .jar date

[jira] Commented: (LUCENE-2328) IndexWriter.synced field accumulates data leading to a Memory Leak

2010-03-19 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847448#action_12847448 ] Shai Erera commented on LUCENE-2328: Earwin, I agree that sub-classing FSDir is not

Re: Sorting with little memory: A suggestion

2010-03-19 Thread Michael McCandless
If you build the ords per-segment, how do you compare results across segments? Ie, in the non-Collator case, Lucene stores ords but must also store the actual String so that the FieldComparator is able to compare results across segments Mike On Fri, Mar 19, 2010 at 10:06 AM, Toke Eskildsen

RE: Sorting with little memory: A suggestion

2010-03-19 Thread Toke Eskildsen
From: Robert Muir [rcm...@gmail.com]: Toke, only partially-on-topic here, is it possible to describe your use-case a little more where its preferable to use this Locale-based sort instead of indexing collation keys (e.g. you have to support so many locales this would be too much indexing

[jira] Commented: (LUCENE-2280) IndexWriter.optimize() throws NullPointerException

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847471#action_12847471 ] Michael McCandless commented on LUCENE-2280: bq. 1. To fix this issue if i

Re: Sorting with little memory: A suggestion

2010-03-19 Thread Robert Muir
On Fri, Mar 19, 2010 at 1:46 PM, Toke Eskildsen t...@statsbiblioteket.dk wrote: From: Robert Muir [rcm...@gmail.com]: Toke, only partially-on-topic here, is it possible to describe your use-case a little more where its preferable to use this Locale-based sort instead of indexing collation

[jira] Commented: (LUCENE-2328) IndexWriter.synced field accumulates data leading to a Memory Leak

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847492#action_12847492 ] Michael McCandless commented on LUCENE-2328: When it's opened, not closed,

[jira] Commented: (LUCENE-2328) IndexWriter.synced field accumulates data leading to a Memory Leak

2010-03-19 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847512#action_12847512 ] Earwin Burrfoot commented on LUCENE-2328: - I'll either jdoc this, or move

[jira] Commented: (LUCENE-2328) IndexWriter.synced field accumulates data leading to a Memory Leak

2010-03-19 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847515#action_12847515 ] Earwin Burrfoot commented on LUCENE-2328: - Thus, I think we should officially

Re: Latest version of spatial contrib

2010-03-19 Thread Grant Ingersoll
On Mar 19, 2010, at 12:04 PM, Chris Male wrote: Hi Alex, Its a direction that is still under heavy development but its definitely the direction I would like it go. I think once the code merge happens, I can easily bring in the updates I made too. For instance, I've added a fair number

[jira] Commented: (LUCENE-2334) IndexReader.close() should call IndexReader.decRef() unconditionally ??

2010-03-19 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847516#action_12847516 ] Earwin Burrfoot commented on LUCENE-2334: - I wholeheartedly agree this API is

Re: Latest version of spatial contrib

2010-03-19 Thread Chris Male
On Fri, Mar 19, 2010 at 7:59 PM, Grant Ingersoll gsing...@apache.orgwrote: On Mar 19, 2010, at 12:04 PM, Chris Male wrote: Hi Alex, Its a direction that is still under heavy development but its definitely the direction I would like it go. I think once the code merge happens, I can

[jira] Commented: (LUCENE-2328) IndexWriter.synced field accumulates data leading to a Memory Leak

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847536#action_12847536 ] Michael McCandless commented on LUCENE-2328: bq. If you allow sync()ing open

[jira] Commented: (LUCENE-2334) IndexReader.close() should call IndexReader.decRef() unconditionally ??

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847547#action_12847547 ] Michael McCandless commented on LUCENE-2334: Actually I think we should

Re: Sorting with little memory: A suggestion

2010-03-19 Thread Michael McCandless
On Fri, Mar 19, 2010 at 12:46 PM, Toke Eskildsen t...@statsbiblioteket.dk wrote: However, it is not set in stone that we will shift to using Exposed or similar: As many others we're pursuing real-time indexing and while Exposed sits at the segment-level and thus works well for re-open, big

[jira] Commented: (LUCENE-2328) IndexWriter.synced field accumulates data leading to a Memory Leak

2010-03-19 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847585#action_12847585 ] Shai Erera commented on LUCENE-2328: bq. Trying to sync a file that hasn't yet been

RE: Sorting with little memory: A suggestion

2010-03-19 Thread Toke Eskildsen
From: Robert Muir [rcm...@gmail.com]: [Toke: Indexing collation keys only helps with the speed problem] I don't really understand this measurement, collation keys are byte[]... (although its true we don't yet encode them this way in flex, I think we should) I sounds like I'm missing

Re: Sorting with little memory: A suggestion

2010-03-19 Thread Robert Muir
On Fri, Mar 19, 2010 at 5:42 PM, Toke Eskildsen t...@statsbiblioteket.dk wrote: I sounds like I'm missing something here... A quick check of running 2 random Strings of 30 characters from a-zA-Z0-1 + 20 different national characters through Java's Collator returned an average

RE: Sorting with little memory: A suggestion

2010-03-19 Thread Toke Eskildsen
From: Robert Muir [rcm...@gmail.com]: Right, JDK collation sucks, use the ICU for collation keys too: http://site.icu-project.org/charts/collation-icu4j-sun at 1.59 bytes/char, thats less than UTF-16 Ah... I should have seen that. I does not change the overall picture though: Althought the

Re: Sorting with little memory: A suggestion

2010-03-19 Thread Robert Muir
On Fri, Mar 19, 2010 at 6:07 PM, Toke Eskildsen t...@statsbiblioteket.dk wrote: Ah... I should have seen that. I does not change the overall picture though: Althought the ICU collation keys are impressively small, they still take up nearly as much space as the original Strings when they

[jira] Resolved: (LUCENE-2111) Wrapup flexible indexing

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-2111. Resolution: Fixed Thanks Shai! Wrapup flexible indexing

RE: [jira] Resolved: (LUCENE-2111) Wrapup flexible indexing

2010-03-19 Thread Uwe Schindler
Is this the right one? Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Michael McCandless (JIRA) [mailto:j...@apache.org] Sent: Friday, March 19, 2010 11:30 PM To: java-dev@lucene.apache.org

[jira] Reopened: (LUCENE-2111) Wrapup flexible indexing

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless reopened LUCENE-2111: Duh -- wrong issue! I only wish ;) Wrapup flexible indexing

[jira] Resolved: (LUCENE-2320) Add MergePolicy to IndexWriterConfig

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-2320. Resolution: Fixed Thanks Shai! Add MergePolicy to IndexWriterConfig

[jira] Created: (LUCENE-2335) optimization: when sorting by field, if index has one segment and field values are not needed, do not load String[] into field cache

2010-03-19 Thread Michael McCandless (JIRA)
optimization: when sorting by field, if index has one segment and field values are not needed, do not load String[] into field cache Key:

[jira] Updated: (LUCENE-2331) Add NoOpMergePolicy

2010-03-19 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shai Erera updated LUCENE-2331: --- Attachment: LUCENE-2331.patch Patch includes: * NoMergePolicy + TestNoMergePolicy *

[jira] Commented: (LUCENE-2328) IndexWriter.synced field accumulates data leading to a Memory Leak

2010-03-19 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847642#action_12847642 ] Michael McCandless commented on LUCENE-2328: bq. We can have close(), sync()

[jira] Commented: (LUCENE-2335) optimization: when sorting by field, if index has one segment and field values are not needed, do not load String[] into field cache

2010-03-19 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847647#action_12847647 ] Yonik Seeley commented on LUCENE-2335: -- This is also useful for MultiReader (or

[jira] Commented: (LUCENE-2335) optimization: when sorting by field, if index has one segment and field values are not needed, do not load String[] into field cache

2010-03-19 Thread Toke Eskildsen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847650#action_12847650 ] Toke Eskildsen commented on LUCENE-2335: I obviously have a share in this and

[jira] Created: (LUCENE-2336) off by one: DisjunctionSumScorer::advance

2010-03-19 Thread Gary Yngve (JIRA)
off by one: DisjunctionSumScorer::advance - Key: LUCENE-2336 URL: https://issues.apache.org/jira/browse/LUCENE-2336 Project: Lucene - Java Issue Type: Bug Components: Search

[jira] Commented: (LUCENE-2336) off by one: DisjunctionSumScorer::advance

2010-03-19 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847716#action_12847716 ] Shai Erera commented on LUCENE-2336: Hi Gary This has been discussed before (I'm not