[jira] Commented: (LUCENE-2376) java.lang.OutOfMemoryError:Java heap space

2010-04-07 Thread Shivender Devarakonda (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854749#action_12854749 ] Shivender Devarakonda commented on LUCENE-2376: --- Thanks for looking into th

[jira] Commented: (LUCENE-2364) Add support for terms in BytesRef format to Term, TermQuery, TermRangeQuery & Co.

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854717#action_12854717 ] Michael McCandless commented on LUCENE-2364: Once we fix Term to take a BytesR

RE: Commit freeze in flex branch

2010-04-07 Thread Uwe Schindler
Thanks for praise! And also thanks to Mike for scanning 20K patch lines :-) - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Michael McCandless [mailto:luc...@mikemccandless.com] > Sent: Wednesday, April

[jira] Resolved: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-2383. Resolution: Fixed > Some small fixes after the flex merge... > ---

[jira] Issue Comment Edited: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854681#action_12854681 ] Uwe Schindler edited comment on LUCENE-2383 at 4/7/10 8:24 PM: -

[jira] Issue Comment Edited: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854681#action_12854681 ] Uwe Schindler edited comment on LUCENE-2383 at 4/7/10 8:23 PM: -

[jira] Commented: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854684#action_12854684 ] Michael McCandless commented on LUCENE-2383: Thanks Uwe, I agree that's cleane

[jira] Commented: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854681#action_12854681 ] Uwe Schindler commented on LUCENE-2383: --- FCRF looks ok, I would only change the next

Re: Commit freeze in flex branch

2010-04-07 Thread Michael McCandless
Yes +1 to that -- thanks Uwe!! And thanks for the many other people who helped out on flex. It's a big and exciting improvement :) Mike On Wed, Apr 7, 2010 at 4:11 PM, Michael Busch wrote: > Uwe, thanks for doing all the svn work!  Was a smooth transition! > >  Michael > > On 4/6/10 12:27 PM,

Re: Commit freeze in flex branch

2010-04-07 Thread Michael Busch
Uwe, thanks for doing all the svn work! Was a smooth transition! Michael On 4/6/10 12:27 PM, Uwe Schindler wrote: The freeze is over, we merged successfully. If you had a flex branch checked out: svn switch https://svn.apache.org/repos/asf/lucene/dev/trunk/lucene Uwe - Uwe Schindler

Re: Getting fsync out of the loop

2010-04-07 Thread Earwin Burrfoot
> No, this doesn't make sense.  The OS detects a disk full on accepting > the write into the write cache, not [later] on flushing the write > cache to disk.  If the OS accepts the write, then disk is not full (ie > flushing the cache will succeed, unless some other not-disk-full > problem happens).

[jira] Updated: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-2383: --- Attachment: LUCENE-2383.patch > Some small fixes after the flex merge... > -

[jira] Created: (LUCENE-2383) Some small fixes after the flex merge...

2010-04-07 Thread Michael McCandless (JIRA)
Some small fixes after the flex merge... Key: LUCENE-2383 URL: https://issues.apache.org/jira/browse/LUCENE-2383 Project: Lucene - Java Issue Type: Bug Reporter: Michael McCandless

Re: Getting fsync out of the loop

2010-04-07 Thread Earwin Burrfoot
I don't have the system at hand now, but if I remember right fsync took like 100-200ms. 2010/4/7 Shai Erera : > Earwin - do you have some numbers to share on the running time of the > indexing application? You've mentioned that if you take out fsync into a BG > thread, the running time improves, b

[jira] Commented: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854639#action_12854639 ] Uwe Schindler commented on LUCENE-2380: --- This goes again in the direction of not hav

[jira] Commented: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854621#action_12854621 ] Yonik Seeley commented on LUCENE-2380: -- bq. We could also do shared byte[] blocks (pr

[jira] Commented: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854615#action_12854615 ] Michael McCandless commented on LUCENE-2380: We could also do shared byte[] bl

[jira] Commented: (LUCENE-1536) if a filter can support random access API, we should use it

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854612#action_12854612 ] Michael McCandless commented on LUCENE-1536: With flex, you can now get the de

[jira] Commented: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854594#action_12854594 ] Uwe Schindler commented on LUCENE-2380: --- The structure should look like String and S

[jira] Created: (LUCENE-2382) Merging implemented by codecs must catch aborted merges

2010-04-07 Thread Michael McCandless (JIRA)
Merging implemented by codecs must catch aborted merges --- Key: LUCENE-2382 URL: https://issues.apache.org/jira/browse/LUCENE-2382 Project: Lucene - Java Issue Type: Bug Componen

[jira] Commented: (LUCENE-2353) Config incorrectly handles Windows absolute pathnames

2010-04-07 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854588#action_12854588 ] Shai Erera commented on LUCENE-2353: Actually, we've reopened LUCENE-1709 to track tha

[jira] Created: (LUCENE-2381) Use packed ints for sort ords (in FieldCache.getStringIndex/.getTermBytesIndex)

2010-04-07 Thread Michael McCandless (JIRA)
Use packed ints for sort ords (in FieldCache.getStringIndex/.getTermBytesIndex) --- Key: LUCENE-2381 URL: https://issues.apache.org/jira/browse/LUCENE-2381 Project: Lucene - J

[jira] Created: (LUCENE-2380) Add FieldCache.getTermBytes, to load term data as byte[]

2010-04-07 Thread Michael McCandless (JIRA)
Add FieldCache.getTermBytes, to load term data as byte[] Key: LUCENE-2380 URL: https://issues.apache.org/jira/browse/LUCENE-2380 Project: Lucene - Java Issue Type: Improvement

[jira] Resolved: (LUCENE-2379) TermRangeQuery & FieldCacheRangeFilter should accepts BytesRef

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-2379. Resolution: Duplicate Woops -- dup of LUCENE-2364. > TermRangeQuery & FieldCacheR

[jira] Commented: (LUCENE-2364) Add support for terms in BytesRef format to Term, TermQuery, TermRangeQuery & Co.

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854575#action_12854575 ] Michael McCandless commented on LUCENE-2364: Also FieldCacheRangeFilter.newStr

[jira] Created: (LUCENE-2379) TermRangeQuery & FieldCacheRangeFilter should accepts BytesRef

2010-04-07 Thread Michael McCandless (JIRA)
TermRangeQuery & FieldCacheRangeFilter should accepts BytesRef -- Key: LUCENE-2379 URL: https://issues.apache.org/jira/browse/LUCENE-2379 Project: Lucene - Java Issue Type: Improvem

[jira] Commented: (LUCENE-2353) Config incorrectly handles Windows absolute pathnames

2010-04-07 Thread Tom Burton-West (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854566#action_12854566 ] Tom Burton-West commented on LUCENE-2353: - Shai, I am having the same issue with

Errors deleting index

2010-04-07 Thread it99
I create an IndexWriter, index and then close the IndexWriter. Then if I delte the index files it does this great. try { FSDirectory dir = FSDirectory.getDirectory(directory); for(String fileName : dir.list()) { dir.deleteFile(f

[jira] Resolved: (LUCENE-2377) Enable the use of NoMergePolicy and NoMergeScheduler by Benchmark

2010-04-07 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shai Erera resolved LUCENE-2377. Resolution: Fixed Committed revision 931502. > Enable the use of NoMergePolicy and NoMergeSchedul

[jira] Created: (LUCENE-2378) Cutover remaining usage of pre-flex APIs

2010-04-07 Thread Michael McCandless (JIRA)
Cutover remaining usage of pre-flex APIs Key: LUCENE-2378 URL: https://issues.apache.org/jira/browse/LUCENE-2378 Project: Lucene - Java Issue Type: Improvement Reporter: Michael McCandless

[jira] Commented: (LUCENE-2373) Change StandardTermsDictWriter to work with streaming and append-only filesystems

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854409#action_12854409 ] Michael McCandless commented on LUCENE-2373: I would love to make Lucene truly

Re: Getting fsync out of the loop

2010-04-07 Thread Michael McCandless
On Tue, Apr 6, 2010 at 7:26 PM, Earwin Burrfoot wrote: >> Running out of disk space with fsync disabled won't lead to corruption. >> Even kill -9 the JRE process with fsync disabled won't corrupt. >> In these cases index just falls back to last successful commit. >> >> It's "only" power loss / OS

[jira] Commented: (LUCENE-2377) Enable the use of NoMergePolicy and NoMergeScheduler by Benchmark

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854401#action_12854401 ] Michael McCandless commented on LUCENE-2377: Patch looks good Shai! > Enable

[jira] Commented: (LUCENE-2376) java.lang.OutOfMemoryError:Java heap space

2010-04-07 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854398#action_12854398 ] Michael McCandless commented on LUCENE-2376: Is this the same issue as LUCENE-

[jira] Commented: (LUCENE-2376) java.lang.OutOfMemoryError:Java heap space

2010-04-07 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854396#action_12854396 ] Uwe Schindler commented on LUCENE-2376: --- You mean insane amount of fields with norms

[jira] Commented: (LUCENE-2376) java.lang.OutOfMemoryError:Java heap space

2010-04-07 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854393#action_12854393 ] Earwin Burrfoot commented on LUCENE-2376: - That's the duplicate of LUCENE-2361. It

[jira] Updated: (LUCENE-1709) Parallelize Tests

2010-04-07 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shai Erera updated LUCENE-1709: --- Attachment: LUCENE-1709-2.patch Since I had the changes on my local env. I thought it's best to gene