[jira] Updated: (LUCENE-1709) Parallelize Tests

2010-04-07 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shai Erera updated LUCENE-1709: --- Attachment: LUCENE-1709-2.patch Since I had the changes on my local env. I thought it's best to

[jira] Commented: (LUCENE-2376) java.lang.OutOfMemoryError:Java heap space

2010-04-07 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854393#action_12854393 ] Earwin Burrfoot commented on LUCENE-2376: - That's the duplicate of LUCENE-2361. It

[jira] Commented: (LUCENE-2376) java.lang.OutOfMemoryError:Java heap space

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854396#action_12854396 ] Uwe Schindler commented on LUCENE-2376: --- You mean insane amount of fields with

[jira] Commented: (LUCENE-2376) java.lang.OutOfMemoryError:Java heap space

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854398#action_12854398 ] Michael McCandless commented on LUCENE-2376: Is this the same issue as

[jira] Commented: (LUCENE-2377) Enable the use of NoMergePolicy and NoMergeScheduler by Benchmark

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854401#action_12854401 ] Michael McCandless commented on LUCENE-2377: Patch looks good Shai! Enable

Re: Getting fsync out of the loop

2010-04-07 Thread Michael McCandless
On Tue, Apr 6, 2010 at 7:26 PM, Earwin Burrfoot ear...@gmail.com wrote: Running out of disk space with fsync disabled won't lead to corruption. Even kill -9 the JRE process with fsync disabled won't corrupt. In these cases index just falls back to last successful commit. It's only power loss

[jira] Commented: (LUCENE-2373) Change StandardTermsDictWriter to work with streaming and append-only filesystems

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854409#action_12854409 ] Michael McCandless commented on LUCENE-2373: I would love to make Lucene truly

[jira] Created: (LUCENE-2378) Cutover remaining usage of pre-flex APIs

2010-04-07 Thread Michael McCandless (JIRA)
Cutover remaining usage of pre-flex APIs Key: LUCENE-2378 URL: https://issues.apache.org/jira/browse/LUCENE-2378 Project: Lucene - Java Issue Type: Improvement Reporter: Michael

[jira] Resolved: (LUCENE-2377) Enable the use of NoMergePolicy and NoMergeScheduler by Benchmark

2010-04-07 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shai Erera resolved LUCENE-2377. Resolution: Fixed Committed revision 931502. Enable the use of NoMergePolicy and

Errors deleting index

2010-04-07 Thread it99
I create an IndexWriter, index and then close the IndexWriter. Then if I delte the index files it does this great. try { FSDirectory dir = FSDirectory.getDirectory(directory); for(String fileName : dir.list()) {

[jira] Commented: (LUCENE-2353) Config incorrectly handles Windows absolute pathnames

2010-04-07 Thread Tom Burton-West (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854566#action_12854566 ] Tom Burton-West commented on LUCENE-2353: - Shai, I am having the same issue with

[jira] Created: (LUCENE-2379) TermRangeQuery FieldCacheRangeFilter should accepts BytesRef

2010-04-07 Thread Michael McCandless (JIRA)
TermRangeQuery FieldCacheRangeFilter should accepts BytesRef -- Key: LUCENE-2379 URL: https://issues.apache.org/jira/browse/LUCENE-2379 Project: Lucene - Java Issue Type:

[jira] Commented: (LUCENE-2364) Add support for terms in BytesRef format to Term, TermQuery, TermRangeQuery Co.

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854575#action_12854575 ] Michael McCandless commented on LUCENE-2364: Also

[jira] Resolved: (LUCENE-2379) TermRangeQuery FieldCacheRangeFilter should accepts BytesRef

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-2379. Resolution: Duplicate Woops -- dup of LUCENE-2364. TermRangeQuery

[jira] Created: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Michael McCandless (JIRA)
Add FieldCache.getTermBytes, to load term data as byte[] Key: LUCENE-2380 URL: https://issues.apache.org/jira/browse/LUCENE-2380 Project: Lucene - Java Issue Type: Improvement

[jira] Created: (LUCENE-2381) Use packed ints for sort ords (in FieldCache.getStringIndex/.getTermBytesIndex)

2010-04-07 Thread Michael McCandless (JIRA)
Use packed ints for sort ords (in FieldCache.getStringIndex/.getTermBytesIndex) --- Key: LUCENE-2381 URL: https://issues.apache.org/jira/browse/LUCENE-2381 Project: Lucene -

[jira] Commented: (LUCENE-2353) Config incorrectly handles Windows absolute pathnames

2010-04-07 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854588#action_12854588 ] Shai Erera commented on LUCENE-2353: Actually, we've reopened LUCENE-1709 to track

[jira] Created: (LUCENE-2382) Merging implemented by codecs must catch aborted merges

2010-04-07 Thread Michael McCandless (JIRA)
Merging implemented by codecs must catch aborted merges --- Key: LUCENE-2382 URL: https://issues.apache.org/jira/browse/LUCENE-2382 Project: Lucene - Java Issue Type: Bug

[jira] Commented: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854594#action_12854594 ] Uwe Schindler commented on LUCENE-2380: --- The structure should look like String and

[jira] Commented: (LUCENE-1536) if a filter can support random access API, we should use it

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854612#action_12854612 ] Michael McCandless commented on LUCENE-1536: With flex, you can now get the

[jira] Commented: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854615#action_12854615 ] Michael McCandless commented on LUCENE-2380: We could also do shared byte[]

[jira] Commented: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854621#action_12854621 ] Yonik Seeley commented on LUCENE-2380: -- bq. We could also do shared byte[] blocks

[jira] Commented: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854639#action_12854639 ] Uwe Schindler commented on LUCENE-2380: --- This goes again in the direction of not

Re: Getting fsync out of the loop

2010-04-07 Thread Earwin Burrfoot
I don't have the system at hand now, but if I remember right fsync took like 100-200ms. 2010/4/7 Shai Erera ser...@gmail.com: Earwin - do you have some numbers to share on the running time of the indexing application? You've mentioned that if you take out fsync into a BG thread, the running

[jira] Created: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Michael McCandless (JIRA)
Some small fixes after the flex merge... Key: LUCENE-2383 URL: https://issues.apache.org/jira/browse/LUCENE-2383 Project: Lucene - Java Issue Type: Bug Reporter: Michael McCandless

[jira] Updated: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-2383: --- Attachment: LUCENE-2383.patch Some small fixes after the flex merge...

Re: Getting fsync out of the loop

2010-04-07 Thread Earwin Burrfoot
No, this doesn't make sense.  The OS detects a disk full on accepting the write into the write cache, not [later] on flushing the write cache to disk.  If the OS accepts the write, then disk is not full (ie flushing the cache will succeed, unless some other not-disk-full problem happens).

Re: Commit freeze in flex branch

2010-04-07 Thread Michael Busch
Uwe, thanks for doing all the svn work! Was a smooth transition! Michael On 4/6/10 12:27 PM, Uwe Schindler wrote: The freeze is over, we merged successfully. If you had a flex branch checked out: svn switch https://svn.apache.org/repos/asf/lucene/dev/trunk/lucene Uwe - Uwe Schindler

Re: Commit freeze in flex branch

2010-04-07 Thread Michael McCandless
Yes +1 to that -- thanks Uwe!! And thanks for the many other people who helped out on flex. It's a big and exciting improvement :) Mike On Wed, Apr 7, 2010 at 4:11 PM, Michael Busch busch...@gmail.com wrote: Uwe, thanks for doing all the svn work!  Was a smooth transition!  Michael On

[jira] Commented: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854681#action_12854681 ] Uwe Schindler commented on LUCENE-2383: --- FCRF looks ok, I would only change the

[jira] Commented: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854684#action_12854684 ] Michael McCandless commented on LUCENE-2383: Thanks Uwe, I agree that's

[jira] Issue Comment Edited: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854681#action_12854681 ] Uwe Schindler edited comment on LUCENE-2383 at 4/7/10 8:23 PM:

[jira] Issue Comment Edited: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854681#action_12854681 ] Uwe Schindler edited comment on LUCENE-2383 at 4/7/10 8:24 PM:

[jira] Resolved: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-2383. Resolution: Fixed Some small fixes after the flex merge...

RE: Commit freeze in flex branch

2010-04-07 Thread Uwe Schindler
Thanks for praise! And also thanks to Mike for scanning 20K patch lines :-) - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Michael McCandless [mailto:luc...@mikemccandless.com] Sent: Wednesday, April

[jira] Commented: (LUCENE-2364) Add support for terms in BytesRef format to Term, TermQuery, TermRangeQuery Co.

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854717#action_12854717 ] Michael McCandless commented on LUCENE-2364: Once we fix Term to take a

[jira] Commented: (LUCENE-2376) java.lang.OutOfMemoryError:Java heap space

2010-04-07 Thread Shivender Devarakonda (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12854749#action_12854749 ] Shivender Devarakonda commented on LUCENE-2376: --- Thanks for looking into