Re: Bug In IndexWriter.addDocument?

2008-07-08 Thread Ajay Lakhani
Dear Digy, You cannot store the Filed value when using a TokenStream but can store the term vector For this you should create an instance of the Field in this manner: Field Field1 = new Field("Field1", DummyTokenStream1, TermVector.YES); Below is the code that should work. public class Main2Clas

[jira] Created: (LUCENE-1330) 0 position increment not properly supported for the first token

2008-07-08 Thread Moti Nisenson (JIRA)
0 position increment not properly supported for the first token --- Key: LUCENE-1330 URL: https://issues.apache.org/jira/browse/LUCENE-1330 Project: Lucene - Java Issue Type: Bug

Contributing towards the development of Lucene

2008-07-08 Thread Ajay Lakhani
Hi, I am interested in contributing towards the development of Lucene. Could anyone suggest a proper way to start or how can I assign a bug to my name to work on. Cheers AJ

Re: Contributing towards the development of Lucene

2008-07-08 Thread Erik Hatcher
On Jul 8, 2008, at 4:20 AM, Ajay Lakhani wrote: I am interested in contributing towards the development of Lucene. Could anyone suggest a proper way to start or how can I assign a bug to my name to work on. AJ - welcome! We have a wiki page set up to answer this question:

[jira] Commented: (LUCENE-1307) Remove Contributions page

2008-07-08 Thread Ajay Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611496#action_12611496 ] Ajay Lakhani commented on LUCENE-1307: -- I agree > Remove Contributions page > --

[jira] Commented: (LUCENE-1237) Developers Resources Documentation

2008-07-08 Thread Ajay Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611500#action_12611500 ] Ajay Lakhani commented on LUCENE-1237: -- Hi Grant, I've checked the developers resou

Re: ThreadLocal in SegmentReader

2008-07-08 Thread Michael McCandless
Well ... SegmentReader uses ThreadLocal to hold a thread-private instance of TermVectorsReader, to avoid synchronizing per-document when loading term vectors. Clearing this ThreadLocal value per call to SegmentReader's methods that load term vectors would defeat its purpose. Though, of

[jira] Commented: (LUCENE-1329) Remove synchronization in SegmentReader.isDeleted

2008-07-08 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611516#action_12611516 ] Michael McCandless commented on LUCENE-1329: Jason, have you run any scale tes

[jira] Commented: (LUCENE-794) Extend contrib Highlighter to properly support PhraseQuery, SpanQuery, ConstantScoreRangeQuery

2008-07-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611526#action_12611526 ] Mark Miller commented on LUCENE-794: Hey Tavi, Try passing null as the field. - Mark

[jira] Commented: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-08 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611556#action_12611556 ] Michael McCandless commented on LUCENE-1314: Jason, I had some problems with t

Re: ThreadLocal in SegmentReader

2008-07-08 Thread Jason Rutherglen
A custom thread local (synchronized hashmap with thread as the key) that uses a global static manager may work. The global manager can have a close method for explicit dereferencing. The thread local registers itself with the global thread local manager. The global manager is static and tied to

[jira] Commented: (LUCENE-1329) Remove synchronization in SegmentReader.isDeleted

2008-07-08 Thread Sanne Grinovero (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611572#action_12611572 ] Sanne Grinovero commented on LUCENE-1329: - Adding a readonly IndexReader would be

[jira] Commented: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611585#action_12611585 ] Jason Rutherglen commented on LUCENE-1314: -- I am seeing the error. It is not nor

[jira] Commented: (LUCENE-1329) Remove synchronization in SegmentReader.isDeleted

2008-07-08 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611598#action_12611598 ] Yonik Seeley commented on LUCENE-1329: -- bq. I think we should, at least in addition b

[jira] Commented: (LUCENE-1329) Remove synchronization in SegmentReader.isDeleted

2008-07-08 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611602#action_12611602 ] Yonik Seeley commented on LUCENE-1329: -- Once we have a read-only IndexReader, if we s

[jira] Created: (LUCENE-1331) FSDirectory doesn't detect double-close nor usage after close

2008-07-08 Thread Michael McCandless (JIRA)
FSDirectory doesn't detect double-close nor usage after close - Key: LUCENE-1331 URL: https://issues.apache.org/jira/browse/LUCENE-1331 Project: Lucene - Java Issue Type: Bug

[jira] Updated: (LUCENE-1331) FSDirectory doesn't detect double-close nor usage after close

2008-07-08 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1331: --- Attachment: LUCENE-1331.patch Attached patch. I plan to commit in a day or so. > F

[jira] Updated: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-1314: - Attachment: lucene-1314.patch lucene-1314.patch docStoreOffset is now cloned in FieldsR

[jira] Updated: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-1314: - Attachment: lucene-1314.patch lucene-1314.patch Same as previous, with TestIndexReaderC

Re: TokenStream#reset():boolean?

2008-07-08 Thread Karl Wettin
7 jul 2008 kl. 13.04 skrev Michael McCandless: If we make this change (migrate to "boolean TokenStream.reset()"), what would IndexWriter do if it calls reset and false is returned? I don't think the writer ever should call reset(), it is the consumer who is passing a stream to the writer

Re: [jira] Created: (LUCENE-1328) FileNotFoundException in

2008-07-08 Thread robert engels
On most system, /tmp is a link to /var/tmp, so it is cleared on reboot. On Jul 7, 2008, at 12:44 PM, Yajun wrote: My bad, we don't use /tmp explicitly. We use /var/tmp/ snapshot_timestamp which is not deleted by OS when reboot. --Yajun Robert Engels wrote: If your "automatic recycle" me

Re: ThreadLocal in SegmentReader

2008-07-08 Thread robert engels
Using synchronization is a poor/invalid substitute for thread locals in many cases. The point of the thread local in these referenced cases is too allow streaming reads on a file descriptor. if you use a shared file descriptor/buffer you are going to continually invalidate the buffer. On