[jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547351 ] Doug Cutting commented on LUCENE-1044: -- > I think this means when we do a "soft commit" we should not in fact >

Re: Profiling tools

2007-11-30 Thread Michael Busch
Grant Ingersoll wrote: > Hmm, they (YourKit) gave me an O/S license... > Oh cool. I haven't contacted them yet, I just read on their page that they would ask for a link. OK, I'll try my luck... Thanks, -Michael - To unsubscribe

Re: Profiling tools

2007-11-30 Thread Grant Ingersoll
Hmm, they (YourKit) gave me an O/S license... -Grant On Nov 30, 2007, at 2:51 PM, Michael Busch wrote: Hi all, I was wondering which tools you guys are using to profile Lucene? I tried out YourKit (they offer 15-days evaluation licenses) and so far I like it. They offer a free open-source

Profiling tools

2007-11-30 Thread Michael Busch
Hi all, I was wondering which tools you guys are using to profile Lucene? I tried out YourKit (they offer 15-days evaluation licenses) and so far I like it. They offer a free open-source license (http://www.yourkit.com/purchase/index.jsp), however they ask to add a reference to their website to th

Re: [jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread Michael McCandless
Well, we could also switch to the "sync before close" option. It automatically bypasses all these tricky questions. Since we already have all these files open for writing, anyway, it makes sense to do the syncing with those descriptors? It's just that commit() is somewhat awkward in that case a

Re: [jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread robert engels
I would argue that implementation does not adhere to the published API... On Nov 30, 2007, at 12:48 PM, Yonik Seeley wrote: On Nov 30, 2007 1:18 PM, robert engels <[EMAIL PROTECTED]> wrote: I don't know, the Java guys are pretty good about making sure their API works consistently across all

Re: [jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread Yonik Seeley
On Nov 30, 2007 1:18 PM, robert engels <[EMAIL PROTECTED]> wrote: > I don't know, the Java guys are pretty good about making sure their > API works consistently across all platforms, or at least documenting > the cases where it wouldn't. One way to consistency is a lowest-common-denominator approa

Re: [jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread robert engels
I don't know, the Java guys are pretty good about making sure their API works consistently across all platforms, or at least documenting the cases where it wouldn't. I would start with a read only descriptor and get it into the field. You could always have a runtime property that controller

Re: [jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread Yonik Seeley
On Nov 30, 2007 12:42 PM, robert engels <[EMAIL PROTECTED]> wrote: > It is unclear if you need to open them for writing. The unix specs > clearly allow you do call fsync on ANY file descriptor. > > The Linux docs seem to imply that a file descriptor opened for write > is required. > > The Java spec

Re: [jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread robert engels
It is unclear if you need to open them for writing. The unix specs clearly allow you do call fsync on ANY file descriptor. The Linux docs seem to imply that a file descriptor opened for write is required. The Java specification allows it on ANY file descriptor as well - this should be the

[jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547217 ] Michael McCandless commented on LUCENE-1044: >From java-dev, Robert Engels wrote: {quote} My reading of

[jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547168 ] Michael McCandless commented on LUCENE-1044: Another nuance here is ... say we do a "soft commit" (write

Re: [jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread robert engels
Here is a relevant email on the subject (from a very long impassioned thread...) http://www.ussg.iu.edu/hypermail/linux/kernel/0207.1/1632.html On Nov 30, 2007, at 7:31 AM, robert engels wrote: My reading of the Unix specification shows it should work (the _commit under Windows is less clea

Re: [jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread robert engels
My reading of the Unix specification shows it should work (the _commit under Windows is less clear, and since Windows is not inode based, there may be different issues). http://www.opengroup.org/onlinepubs/007908799/xsh/fsync.html On Nov 30, 2007, at 7:10 AM, Michael McCandless (JIRA) wrote

[jira] Commented: (LUCENE-1044) Behavior on hard power shutdown

2007-11-30 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547122 ] Michael McCandless commented on LUCENE-1044: {quote} You could just queue the file names for sync, close

[jira] Resolved: (LUCENE-982) Create new method optimize(int maxNumSegments) in IndexWriter

2007-11-30 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless resolved LUCENE-982. --- Resolution: Fixed I just committed this. > Create new method optimize(int maxNumSegm

[jira] Updated: (LUCENE-1072) NullPointerException during indexing in DocumentsWriter$ThreadState$FieldData.addPosition

2007-11-30 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1072: --- Attachment: LUCENE-1072.patch Attached patch. I plan to commit in a day or two. I