[jira] Updated: (SOLR-243) Create a hook to allow custome code to create custome index readers
[
https://issues.apache.org/jira/browse/SOLR-243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Wang updated SOLR-243:
---
Description:
I have a customized IndexReader and I want to write a Solr plugin to use my
derived IndexReader implementation. Currently IndexReader instantiation is hard
coded to be:
IndexReader.open(path)
It would be really useful if this is done thru a plugable factory that can be
configured, e.g. IndexReaderFactory
interface IndexReaderFactory{
IndexReader newReader(String name,String path);
}
the default implementation would just return: IndexReader.open(path)
And in the newSearcher and getSearcher methods in SolrCore class can call the
current factory implementation to get the IndexReader instance and then build
the SolrIndexSearcher by passing in the reader.
It would be really nice to add this improvement soon (This seems to be a
trivial addition) as our project really depends on this.
Thanks
-John
was:
I have a customized IndexReader and I want to write a Solr plugin to use my
derived IndexReader implementation. Currently IndexReader instantiation is hard
coded to be:
> Create a hook to allow custome code to create custome index readers
> ---
>
> Key: SOLR-243
> URL: https://issues.apache.org/jira/browse/SOLR-243
> Project: Solr
> Issue Type: Improvement
> Components: search
>Affects Versions: 1.3
> Environment: Solr core
>Reporter: John Wang
> Fix For: 1.3
>
>
> I have a customized IndexReader and I want to write a Solr plugin to use my
> derived IndexReader implementation. Currently IndexReader instantiation is
> hard coded to be:
> IndexReader.open(path)
> It would be really useful if this is done thru a plugable factory that can be
> configured, e.g. IndexReaderFactory
> interface IndexReaderFactory{
> IndexReader newReader(String name,String path);
> }
> the default implementation would just return: IndexReader.open(path)
> And in the newSearcher and getSearcher methods in SolrCore class can call the
> current factory implementation to get the IndexReader instance and then build
> the SolrIndexSearcher by passing in the reader.
> It would be really nice to add this improvement soon (This seems to be a
> trivial addition) as our project really depends on this.
> Thanks
> -John
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Created: (SOLR-243) Create a hook to allow custome code to create custome index readers
Create a hook to allow custome code to create custome index readers --- Key: SOLR-243 URL: https://issues.apache.org/jira/browse/SOLR-243 Project: Solr Issue Type: Improvement Components: search Affects Versions: 1.3 Environment: Solr core Reporter: John Wang Fix For: 1.3 I have a customized IndexReader and I want to write a Solr plugin to use my derived IndexReader implementation. Currently IndexReader instantiation is hard coded to be: -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (SOLR-69) PATCH:MoreLikeThis support
[ https://issues.apache.org/jira/browse/SOLR-69?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12497312 ] Brian Whitman commented on SOLR-69: --- Also (sorry to keep commenting on this!) asking for fl=score doesn't work, I get this: java.lang.NullPointerException at org.apache.solr.search.DocSlice$1.score(DocSlice.java:117) at org.apache.solr.request.XMLWriter.writeDocList(XMLWriter.java:369) at org.apache.solr.request.XMLWriter.writeVal(XMLWriter.java:408) at org.apache.solr.request.XMLWriter.writeResponse(XMLWriter.java:126) at org.apache.solr.request.XMLResponseWriter.write(XMLResponseWriter.java:35) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:169) at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70) at com.caucho.server.webapp.WebAppFilterChain.doFilter(WebAppFilterChain.java:173) at com.caucho.server.dispatch.ServletInvocation.service(ServletInvocation.java:229) at com.caucho.server.http.HttpRequest.handleRequest(HttpRequest.java:274) at com.caucho.server.port.TcpConnection.run(TcpConnection.java:511) at com.caucho.util.ThreadPool.runTasks(ThreadPool.java:520) at com.caucho.util.ThreadPool.run(ThreadPool.java:442) at java.lang.Thread.run(Thread.java:619) if I do a query like /mlt?q=id:100&mlt.fl=content&fl=content,score If I take out the score from the fl it doesn't NPE. > PATCH:MoreLikeThis support > -- > > Key: SOLR-69 > URL: https://issues.apache.org/jira/browse/SOLR-69 > Project: Solr > Issue Type: Improvement > Components: search >Reporter: Bertrand Delacretaz >Priority: Minor > Attachments: lucene-queries-2.0.0.jar, lucene-queries-2.1.1-dev.jar, > SOLR-69-MoreLikeThisRequestHandler.patch, > SOLR-69-MoreLikeThisRequestHandler.patch, SOLR-69.patch, SOLR-69.patch, > SOLR-69.patch, SOLR-69.patch > > > Here's a patch that implements simple support of Lucene's MoreLikeThis class. > The MoreLikeThisHelper code is heavily based on (hmm..."lifted from" might be > more appropriate ;-) Erik Hatcher's example mentioned in > http://www.mail-archive.com/[EMAIL PROTECTED]/msg00878.html > To use it, add at least the following parameters to a standard or dismax > query: > mlt=true > mlt.fl=list,of,fields,which,define,similarity > See the MoreLikeThisHelper source code for more parameters. > Here are two URLs that work with the example config, after loading all > documents found in exampledocs in the index (just to show that it seems to > work - of course you need a larger corpus to make it interesting): > http://localhost:8983/solr/select/?stylesheet=&q=apache&qt=standard&mlt=true&mlt.fl=manu,cat&mlt.mindf=1&mlt.mindf=1&fl=id,score > http://localhost:8983/solr/select/?stylesheet=&q=apache&qt=dismax&mlt=true&mlt.fl=manu,cat&mlt.mindf=1&mlt.mindf=1&fl=id,score > Results are added to the output like this: > > ... > > > > 1.5293242 > SOLR1000 > > > > > 1.5293242 > UTF8TEST > > > > I haven't tested this extensively yet, will do in the next few days. But > comments are welcome of course. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (SOLR-69) PATCH:MoreLikeThis support
[ https://issues.apache.org/jira/browse/SOLR-69?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12497283 ] Brian Whitman commented on SOLR-69: --- The mlt.exclude is similar to what I'm looking for but an mlt.fq is generally more useful. Also, mlt.exclude does not seem to support more than a single term query, e.g. mlt.exclude=+type:AUTHOR +type:PUBLISHER still lets type:PUBLISHER through. > PATCH:MoreLikeThis support > -- > > Key: SOLR-69 > URL: https://issues.apache.org/jira/browse/SOLR-69 > Project: Solr > Issue Type: Improvement > Components: search >Reporter: Bertrand Delacretaz >Priority: Minor > Attachments: lucene-queries-2.0.0.jar, lucene-queries-2.1.1-dev.jar, > SOLR-69-MoreLikeThisRequestHandler.patch, > SOLR-69-MoreLikeThisRequestHandler.patch, SOLR-69.patch, SOLR-69.patch, > SOLR-69.patch, SOLR-69.patch > > > Here's a patch that implements simple support of Lucene's MoreLikeThis class. > The MoreLikeThisHelper code is heavily based on (hmm..."lifted from" might be > more appropriate ;-) Erik Hatcher's example mentioned in > http://www.mail-archive.com/[EMAIL PROTECTED]/msg00878.html > To use it, add at least the following parameters to a standard or dismax > query: > mlt=true > mlt.fl=list,of,fields,which,define,similarity > See the MoreLikeThisHelper source code for more parameters. > Here are two URLs that work with the example config, after loading all > documents found in exampledocs in the index (just to show that it seems to > work - of course you need a larger corpus to make it interesting): > http://localhost:8983/solr/select/?stylesheet=&q=apache&qt=standard&mlt=true&mlt.fl=manu,cat&mlt.mindf=1&mlt.mindf=1&fl=id,score > http://localhost:8983/solr/select/?stylesheet=&q=apache&qt=dismax&mlt=true&mlt.fl=manu,cat&mlt.mindf=1&mlt.mindf=1&fl=id,score > Results are added to the output like this: > > ... > > > > 1.5293242 > SOLR1000 > > > > > 1.5293242 > UTF8TEST > > > > I haven't tested this extensively yet, will do in the next few days. But > comments are welcome of course. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Re: update bundled lucene version?
On 5/20/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: FYI, I'm in the process of updating to the latest nightly of lucene now. I'm getting a test failure though... currently looking into it. OK, the issue was that the QueryParser grammar has some stricter checking. subword:http://www.yahoo.com Produced an error because of the ':' in the field value. Quoting the field value, or escaping the ':' works fine. Not a big deal IMO, prob just document in CHANGES.txt -Yonik
Re: update bundled lucene version?
FYI, I'm in the process of updating to the latest nightly of lucene now. I'm getting a test failure though... currently looking into it. -Yonik On 5/14/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 5/14/07, Mike Klaas <[EMAIL PROTECTED]> wrote: > On 14-May-07, at 1:01 PM, Yonik Seeley wrote: > > > I've audited the Lucene changes since 2.1, and don't see anything > > problematic, so perhaps we should upgrade to the latest lucene trunk > > to get: > > - file descriptor usage reduction (only one descriptor for all > > norms now) > > - leading + trailing wildcard fix > > - performance improvements (mainly lazy prox skipping) > > - QueryParser parsing + escaping fixes > > - minor sloppy phrase query fixes > > Sounds good to me. I recall for some reason that the payload patch > had been applied, but that either might be wrong or not a concern. It has been applied, but it's of minimal concern since there isn't currently a plan to utilize it in Solr, and if it's not used the file formats don't change. -Yonik
Solr nightly build failure
checkJunitPresence: compile: [mkdir] Created dir: /tmp/apache-solr-nightly/build [javac] Compiling 183 source files to /tmp/apache-solr-nightly/build [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. compileTests: [mkdir] Created dir: /tmp/apache-solr-nightly/build/tests [javac] Compiling 43 source files to /tmp/apache-solr-nightly/build/tests [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. junit: [mkdir] Created dir: /tmp/apache-solr-nightly/build/test-results [junit] Running org.apache.solr.BasicFunctionalityTest [junit] Tests run: 24, Failures: 0, Errors: 0, Time elapsed: 40.869 sec [junit] Running org.apache.solr.ConvertedLegacyTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 18.771 sec [junit] Running org.apache.solr.DisMaxRequestHandlerTest [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 18.92 sec [junit] Running org.apache.solr.EchoParamsTest [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 4.547 sec [junit] Running org.apache.solr.HighlighterTest [junit] Tests run: 10, Failures: 0, Errors: 0, Time elapsed: 31.667 sec [junit] Running org.apache.solr.OutputWriterTest [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 3.833 sec [junit] Running org.apache.solr.SampleTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.522 sec [junit] Running org.apache.solr.analysis.TestBufferedTokenStream [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.059 sec [junit] Running org.apache.solr.analysis.TestHyphenatedWordsFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.06 sec [junit] Running org.apache.solr.analysis.TestPatternReplaceFilter [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.058 sec [junit] Running org.apache.solr.analysis.TestPatternTokenizerFactory [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.144 sec [junit] Running org.apache.solr.analysis.TestPhoneticFilter [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.166 sec [junit] Running org.apache.solr.analysis.TestRemoveDuplicatesTokenFilter [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.066 sec [junit] Running org.apache.solr.analysis.TestSynonymFilter [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.088 sec [junit] Running org.apache.solr.analysis.TestTrimFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.081 sec [junit] Running org.apache.solr.analysis.TestWordDelimiterFilter [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 8.698 sec [junit] Running org.apache.solr.core.RequestHandlersTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 10.748 sec [junit] Running org.apache.solr.core.SolrCoreTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.879 sec [junit] Running org.apache.solr.core.TestBadConfig [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.16 sec [junit] Running org.apache.solr.core.TestConfig [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 6.534 sec [junit] Running org.apache.solr.handler.StandardRequestHandlerTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.342 sec [junit] Running org.apache.solr.handler.TestCSVLoader [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 10.939 sec [junit] Running org.apache.solr.handler.admin.SystemInfoHandlerTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.311 sec [junit] Running org.apache.solr.schema.BadIndexSchemaTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.961 sec [junit] Running org.apache.solr.schema.IndexSchemaTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 8.845 sec [junit] Running org.apache.solr.schema.NotRequiredUniqueKeyTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.472 sec [junit] Running org.apache.solr.schema.RequiredFieldsTest [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 7.781 sec [junit] Running org.apache.solr.search.TestDocSet [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.085 sec [junit] Running org.apache.solr.search.TestQueryUtils [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.21 sec [junit] Running org.apache.solr.servlet.DirectSolrConnectionTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.627 s
Build failed in Hudson: Solr-Nightly #87
See http://lucene.zones.apache.org:8080/hudson/job/Solr-Nightly/87/ -- started Checking out http://svn.apache.org/repos/asf/lucene/solr/trunk AUNOTICE.txt AULICENSE.txt A site AUsite/index.pdf AUsite/features.html AUsite/issue_tracking.pdf AUsite/features.pdf AUsite/version_control.html AUsite/doap.rdf AUsite/version_control.pdf AUsite/linkmap.html AUsite/who.html AUsite/mailing_lists.html AUsite/linkmap.pdf A site/skin AUsite/skin/menu.js AUsite/skin/getMenu.js AUsite/skin/skinconf.xsl AUsite/skin/profile.css.xslt A site/skin/translations AUsite/skin/print.css AUsite/skin/note.txt AUsite/skin/CommonMessages_de.xml AUsite/skin/profile.css A site/skin/scripts A site/skin/css AUsite/skin/getBlank.js AUsite/skin/forrest.css.xslt AUsite/skin/breadcrumbs.js A site/skin/images AUsite/skin/images/page.gif AUsite/skin/images/rc-t-l-5-1header-2tab-selected-3tab-selected.png AUsite/skin/images/label.gif AUsite/skin/images/rc-t-l-5-1header-2searchbox-3searchbox.png AUsite/skin/images/warning.png AUsite/skin/images/rc-t-r-5-1header-2tab-selected-3tab-selected.png AUsite/skin/images/rc-t-l-5-1header-2tab-unselected-3tab-unselected.png AUsite/skin/images/chapter.gif AUsite/skin/images/poddoc.png AUsite/skin/images/success.png AUsite/skin/images/rc-t-r-5-1header-2searchbox-3searchbox.png AUsite/skin/images/rc-t-r-5-1header-2tab-unselected-3tab-unselected.png AUsite/skin/images/update.jpg AUsite/skin/images/vcss.png AUsite/skin/images/pdfdoc.gif AUsite/skin/images/fix.jpg AUsite/skin/images/built-with-forrest-button.png AUsite/skin/images/rc-b-l-15-1body-2menu-3menu.png AUsite/skin/images/add.jpg AUsite/skin/images/valid-html401.png AUsite/skin/images/corner-imports.svg.xslt AUsite/skin/images/remove.jpg AUsite/skin/images/rc-b-r-15-1body-2menu-3menu.png AUsite/skin/images/dc.svg.xslt AUsite/skin/images/external-link.gif AUsite/skin/images/spacer.gif AUsite/skin/images/hack.jpg AUsite/skin/images/current.gif AUsite/skin/images/printer.gif AUsite/skin/images/txtdoc.png AUsite/skin/images/rss.png AUsite/skin/images/xmldoc.gif AUsite/skin/images/rc.svg.xslt AUsite/skin/images/txtdoc.svg.xslt AUsite/skin/images/rc-t-r-15-1body-2menu-3menu.png AUsite/skin/images/poddoc.svg.xslt AUsite/skin/images/header_white_line.gif AUsite/skin/images/rc-b-r-5-1header-2tab-selected-3tab-selected.png AUsite/skin/images/README.txt AUsite/skin/images/chapter_open.gif AUsite/skin/images/error.png AUsite/skin/images/forrest-credit-logo.png AUsite/skin/images/info.png AUsite/skin/images/instruction_arrow.png AUsite/skin/breadcrumbs-optimized.js AUsite/skin/CommonMessages_fr.xml AUsite/skin/CommonMessages_es.xml AUsite/skin/screen.css AUsite/skin/basic.css AUsite/skin/CommonMessages_en_US.xml AUsite/skin/fontsize.js A site/images AUsite/images/solr.png AUsite/images/lucene_green_150.gif AUsite/images/built-with-forrest-button.png AUsite/images/favicon.ico AUsite/images/instruction_arrow.png AUsite/who.pdf AUsite/tutorial.html AUsite/mailing_lists.pdf AUsite/index.html AUsite/tutorial.pdf AUsite/.htaccess AUsite/issue_tracking.html AUCHANGES.txt A lib AUlib/commons-codec-1.3.jar ERROR: Error in subversion org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default' svn: Protocol violation: Unexpected single newline character in chunk size at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:79) at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:510) at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:229) at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:217) at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219) at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211) at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:601) at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162) at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:322) at h
