Re: TrecContentSource and docname/iteration number

Shai, ok. I couldn't tell if it was round iterations (looked that way). I left the default as it was, for back compat. but now theres an obscure option content.source.excludeIteration you can use to disable it. I used content.source.* because i saw the other ContentSources seemed to do a similar

Re: TrecContentSource and docname/iteration number

I think the fix you've made makes sense. The iteration number is added in case you want to collect more than avail documents (such that it starts over with the first one). I don't think it has to do with the iterations option in Benchmark, although it could. Being able to configure it makes sense

Build failed in Hudson: Lucene-trunk #1007

See Changes: [rmuir] LUCENE-2059: allow TrecContentSource not to change the docname [rmuir] LUCENE-2058: specify trec_eval output file from commandline [markrmiller] update IndexReader javadoc concerning readonly [uschindler

[jira] Commented: (LUCENE-2047) IndexWriter should immediately resolve deleted docs to docID in near-real-time mode

[ https://issues.apache.org/jira/browse/LUCENE-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777325#action_12777325 ] Jason Rutherglen commented on LUCENE-2047: -- I think there's a fundamental design

[jira] Resolved: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

[ https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir resolved LUCENE-2059. - Resolution: Fixed Committed revision 835677. > benchmark pkg: allow TrecContentSource not to ch

[jira] Resolved: (LUCENE-2058) benchmark pkg: specify trec_eval submission output from the command line

[ https://issues.apache.org/jira/browse/LUCENE-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir resolved LUCENE-2058. - Resolution: Fixed I tested: same results with these two patches as my old hackish setup. Commit

Re: [jira] Commented: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

I don't know the benchmark pkg that well, but I don't want to slow Uwe down. however, I'd feel more comfortable if i can toss together this openrelevance crap tonight and actually have something working first. (the collections it downloads are huge and i'm having to do careful ant stuff to prevent

Re: [jira] Commented: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

I was gonna say - "release in a few hours?" - there are still 13 issues to deal with or push :) Uwe Schindler (JIRA) wrote: > [ > https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777280#action_12777280 >

[jira] Commented: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

[ https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777280#action_12777280 ] Uwe Schindler commented on LUCENE-2059: --- You have time. I will do some RM practise t

[jira] Commented: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

[ https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777274#action_12777274 ] Robert Muir commented on LUCENE-2059: - Uwe, ok thanks. is it ok if i commit these in a

[jira] Commented: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

[ https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777264#action_12777264 ] Uwe Schindler commented on LUCENE-2059: --- I see no problem with disabling the doc nam

[jira] Commented: (LUCENE-2058) benchmark pkg: specify trec_eval submission output from the command line

[ https://issues.apache.org/jira/browse/LUCENE-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777266#action_12777266 ] Uwe Schindler commented on LUCENE-2058: --- +1, the usage info is perfect, goes to stde

[jira] Commented: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

[ https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777256#action_12777256 ] Robert Muir commented on LUCENE-2059: - Thanks Uwe, I don't know much outside of the qu

[jira] Commented: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

[ https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777255#action_12777255 ] Uwe Schindler commented on LUCENE-2059: --- H... committing! I want to start the releas

[jira] Updated: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler updated LUCENE-1909: -- Fix Version/s: (was: 3.0) 3.1 Assignee: (was: Uwe Schindler

[jira] Commented: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

[ https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777236#action_12777236 ] Robert Muir commented on LUCENE-2059: - btw, if no one objects, I would like to commit

[jira] Updated: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

[ https://issues.apache.org/jira/browse/LUCENE-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir updated LUCENE-2059: Attachment: LUCENE-2059.patch > benchmark pkg: allow TrecContentSource not to change the docname >

[jira] Created: (LUCENE-2059) benchmark pkg: allow TrecContentSource not to change the docname

benchmark pkg: allow TrecContentSource not to change the docname Key: LUCENE-2059 URL: https://issues.apache.org/jira/browse/LUCENE-2059 Project: Lucene - Java Issue Type: Impr

[jira] Issue Comment Edited: (LUCENE-1558) Make IndexReader/Searcher ctors readOnly=true by default

[ https://issues.apache.org/jira/browse/LUCENE-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777162#action_12777162 ] Mark Miller edited comment on LUCENE-1558 at 11/12/09 8:26 PM: -

[jira] Commented: (LUCENE-1558) Make IndexReader/Searcher ctors readOnly=true by default

[ https://issues.apache.org/jira/browse/LUCENE-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777162#action_12777162 ] Mark Miller commented on LUCENE-1558: - Ah - didn't see this issue and assumed Uwe's ch

[jira] Commented: (LUCENE-2039) Regex support and beyond in JavaCC QueryParser

[ https://issues.apache.org/jira/browse/LUCENE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777159#action_12777159 ] Luis Alves commented on LUCENE-2039: Simon and Adriano, Can you comment on the example

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777136#action_12777136 ] Tim Smith commented on LUCENE-1909: --- bq. If you want to inherit the setting, use the cor

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777127#action_12777127 ] Mark Miller commented on LUCENE-1909: - If you want to inherit the setting, use the cor

[jira] Updated: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-1526: - Attachment: (was: LUCENE-1526.patch) > For near real-time search, use paged copy-on-

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777118#action_12777118 ] Tim Smith commented on LUCENE-1909: --- Only thing i would want the constant for is to know

[jira] Issue Comment Edited: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777116#action_12777116 ] Uwe Schindler edited comment on LUCENE-1909 at 11/12/09 6:54 PM: ---

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777116#action_12777116 ] Uwe Schindler commented on LUCENE-1909: --- By the way, if you use a final constant, wi

TrecContentSource and docname/iteration number

If I use TrecContentSource to index a collection, it puts the doc name into the docname field, just as I like. say i have a doc with DOCID0001 the problem is that concatenates the iteration number to this document name: name = name + "_" + iteration; this produces a docname of DOCID0001_0, which

[jira] Issue Comment Edited: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777112#action_12777112 ] Mark Miller edited comment on LUCENE-1909 at 11/12/09 6:47 PM: -

[jira] Issue Comment Edited: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777112#action_12777112 ] Mark Miller edited comment on LUCENE-1909 at 11/12/09 6:46 PM: -

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777112#action_12777112 ] Mark Miller commented on LUCENE-1909: - heh - well, if you want to be lazy with the adm

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777109#action_12777109 ] Tim Smith commented on LUCENE-1909: --- what you describe requires effectively 2 settings:

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777085#action_12777085 ] Mark Miller commented on LUCENE-1909: - A good admin UI should have this option off by

[jira] Commented: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777068#action_12777068 ] Jake Mannix commented on LUCENE-1526: - bq. OK. It's clear Zoie's design is optimized f

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777065#action_12777065 ] Yonik Seeley commented on LUCENE-1909: -- bq. My guess is this is a Solr need, right?

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777064#action_12777064 ] Tim Smith commented on LUCENE-1909: --- users can see the live setting via things like JMX/

[jira] Commented: (LUCENE-1990) Add unsigned packed int impls in oal.util

[ https://issues.apache.org/jira/browse/LUCENE-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777054#action_12777054 ] Fuad Efendi commented on LUCENE-1990: - Suttiwat sent me a link: http://blog.juma.me.uk

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777057#action_12777057 ] Mark Miller commented on LUCENE-1909: - Eh - still bugging me. If you are allowing user

[jira] Updated: (LUCENE-2058) benchmark pkg: specify trec_eval submission output from the command line

[ https://issues.apache.org/jira/browse/LUCENE-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir updated LUCENE-2058: Fix Version/s: 3.0 Assignee: Robert Muir if no one objects, I would like to commit this t

[jira] Commented: (LUCENE-2053) When thread is interrupted we should throw a clear exception

[ https://issues.apache.org/jira/browse/LUCENE-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777026#action_12777026 ] Michael McCandless commented on LUCENE-2053: OK I'll go with ThreadInterrupted

[jira] Commented: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777025#action_12777025 ] Michael McCandless commented on LUCENE-1526: bq. Due to the bloomfilter living

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777010#action_12777010 ] Mark Miller commented on LUCENE-1909: - Okay - fair enough - there is a use case I won'

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777008#action_12777008 ] Tim Smith commented on LUCENE-1909: --- I have the following use case: i have a configurat

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777006#action_12777006 ] Mark Miller commented on LUCENE-1909: - I know its not a big deal - but I have an abras

[jira] Issue Comment Edited: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776997#action_12776997 ] Grant Ingersoll edited comment on LUCENE-1909 at 11/12/09 1:49 PM: -

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776997#action_12776997 ] Grant Ingersoll commented on LUCENE-1909: - Boy, I had an awesome use case when I w

[jira] Commented: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776995#action_12776995 ] Michael McCandless commented on LUCENE-1526: {quote} bq. The fact that Zoie on

[jira] Commented: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776994#action_12776994 ] Michael McCandless commented on LUCENE-1526: {quote} So we re-ran some of our

[jira] Commented: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776992#action_12776992 ] Michael McCandless commented on LUCENE-1526: {quote} bq. Lucene NRT makes a cl

[jira] Commented: (LUCENE-2024) "ant dist" no longer generates md5's for the top-level artifacts

[ https://issues.apache.org/jira/browse/LUCENE-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776991#action_12776991 ] Uwe Schindler commented on LUCENE-2024: --- I looked into this and found no reason, why

[jira] Commented: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776990#action_12776990 ] Michael McCandless commented on LUCENE-1526: {quote} bq. if you're indexing 30

[jira] Commented: (LUCENE-2053) When thread is interrupted we should throw a clear exception

[ https://issues.apache.org/jira/browse/LUCENE-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776989#action_12776989 ] Uwe Schindler commented on LUCENE-2053: --- So I think we go with RuntimeException. -

[jira] Commented: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776985#action_12776985 ] Michael McCandless commented on LUCENE-1526: bq. 2) cpu and memory starvation

[jira] Commented: (LUCENE-1526) For near real-time search, use paged copy-on-write BitVector impl

[ https://issues.apache.org/jira/browse/LUCENE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776984#action_12776984 ] Michael McCandless commented on LUCENE-1526: bq. Correction: We are NOT using

[jira] Commented: (LUCENE-2053) When thread is interrupted we should throw a clear exception

[ https://issues.apache.org/jira/browse/LUCENE-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776982#action_12776982 ] Michael McCandless commented on LUCENE-2053: How about ThreadInterruptedExcept

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776981#action_12776981 ] Michael McCandless commented on LUCENE-1909: I sort of agree with Mark, now...

[jira] Commented: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776974#action_12776974 ] Uwe Schindler commented on LUCENE-1909: --- Hm, I only bought one 500 pills Aspirin pac

[jira] Assigned: (LUCENE-1909) Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public

[ https://issues.apache.org/jira/browse/LUCENE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler reassigned LUCENE-1909: - Assignee: Uwe Schindler > Make IndexReader.DEFAULT_TERMS_INDEX_DIVISOR public >

[jira] Commented: (LUCENE-2053) When thread is interrupted we should throw a clear exception

[ https://issues.apache.org/jira/browse/LUCENE-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776973#action_12776973 ] Uwe Schindler commented on LUCENE-2053: --- Here are some names for Exceptions: - Unex

[jira] Updated: (LUCENE-2055) Remove duplicate analysis functionality

[ https://issues.apache.org/jira/browse/LUCENE-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir updated LUCENE-2055: Fix Version/s: 3.1 setting to 3.1, because I would like to make use of simon's stopword-handling

[jira] Updated: (LUCENE-2058) benchmark pkg: specify trec_eval submission output from the command line

[ https://issues.apache.org/jira/browse/LUCENE-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Muir updated LUCENE-2058: Attachment: LUCENE-2058.patch > benchmark pkg: specify trec_eval submission output from the comman

[jira] Created: (LUCENE-2058) benchmark pkg: specify trec_eval submission output from the command line

benchmark pkg: specify trec_eval submission output from the command line Key: LUCENE-2058 URL: https://issues.apache.org/jira/browse/LUCENE-2058 Project: Lucene - Java

[jira] Commented: (LUCENE-1260) Norm codec strategy in Similarity

[ https://issues.apache.org/jira/browse/LUCENE-1260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776931#action_12776931 ] Michael McCandless commented on LUCENE-1260: bq. Would you like me to continue