Re: Calculating peaks - solrj support for facet.date?
As Erik said, you can just set the parameters yourself SolrQuery query = new SolrQuery(...); query.set(FacetParams.FACET_DATE, ...); etc. You'll find all facet-related parameters in the FacetParams interface, located in the org.apache.solr.common.params package. - Aleks On Fri, 07 Nov 2008 14:26:56 +0100, Erik Hatcher [EMAIL PROTECTED] wrote: On Nov 7, 2008, at 7:23 AM, [EMAIL PROTECTED] wrote: Sorry, but I have one more question. Does the java client solrj support facet.date? Yeah, but it doesn't have explicit setters for it. A SolrQuery is also a ModifiableSolrParams - so you can call the add/set methods on it using the same keys used with HTTP requests. Erik -- Aleksander M. Stensby Senior software developer Integrasco A/S
Re: Solr 1.3 stack overflow when accessing solr/admin page
hossman wrote: i don't have time to really dig into the code right now, but out of curiosity what happens when you hit http://localhost:7001/solr/admin/ and/or http://localhost:7001/solr/admin/index.jsp ? I get the same exception when going to both of those. -- View this message in context: http://www.nabble.com/Solr-1.3-stack-overflow-when-accessing-solr-admin-page-tp20157873p20476772.html Sent from the Solr - User mailing list archive at Nabble.com.
full-import with solrj (solr Java client)
Hello, I want to run a (DataImportHandler) full-import with solrj. I understand how to send queries with SolrQuery etc., but I don't know how to construct the dataimport?command=full-importcommit=true path. Which classes do I have to use? SolrRequest? It would be very nice if you could post some code examples. Thank you Gisto -- Feel free - 10 GB Mailbox, 100 FreeSMS/Monat ... Jetzt GMX TopMail testen: http://www.gmx.net/de/go/topmail
Re: full-import with solrj (solr Java client)
On Nov 13, 2008, at 6:20 AM, [EMAIL PROTECTED] wrote: I want to run a (DataImportHandler) full-import with solrj. I understand how to send queries with SolrQuery etc., but I don't know how to construct the dataimport?command=full-importcommit=true path. Which classes do I have to use? SolrRequest? It would be very nice if you could post some code examples. I've added an example here: http://wiki.apache.org/solr/SolJava Basically any request handler can be easily called from SolrJ, using ModifiableSolrParams, and making sure wt is set, along with the other parameters. Erik
Sorting is not taking place on the search results when query consists of qt parameter
Hi, I am trying to sort the search results on the basis of some fields of my XML document. SAMPLE RESULT XML document : result name=response numFound=6 start=0 doc str name=Index_Type_sproductIndex/str str name=URL_s5000/str arr name=all strproductIndex/str str799/str strbaraaa/str str5000/str str5000/str strsapient123/str strin Stock/str str4999/str strIn Search of the Shape of the Universe/str /arr str name=basePrice_s799/str str name=prdMainTitle_sbaraaa/str str name=productDescription_sIn Search of the Shape of the Universe/str str name=productPrice_s4999/str str name=productURL_ssapient123/str str name=statusName_sin Stock/str date name=timestamp2008-10-22T01:35:05.952Z/date /doc doc str name=Index_Type_sproductIndex/str str name=URL_s6000/str - arr name=all strproductIndex/str str799/str strcoffee/str str6000/str str6000/str strhttp://sapient1.com/str strin Stock/str str4999/str strObject/str /arr str name=basePrice_s799/str str name=prdMainTitle_scoffee/str str name=productDescription_sObject/str str name=productPrice_s4999/str str name=productURL_shttp://sapient1.com/str str name=statusName_sin Stock/str date name=timestamp2008-10-22T01:35:05.983Z/date /doc /result Sorting works fine when i give it simply like (index field used for sorting : prdMainTitle_s) : http://delpearsonwebapps:8080/apache-solr-1.3.0/core51043/select/?q=sapient;prdMainTitle_s%20asc Issue : As i provide the parameter qt within the query , search response result comes out to be none. Sample query with qt parameter : http://delpearsonwebapps:8080/apache-solr-1.3.0/core51043/select/?q=sapient;prdMainTitle_s%20ascqt=dismaxrequest requestHandler name=dismaxrequest class=solr.DisMaxRequestHandler has neen mentioned below within the solrConfig file content where all the fields which are indexed are mentioned within the str name =qf tag :: !-- requestHandler plugins... incoming queries will be dispatched to the correct handler based on the path or the qt (query type) param. Names starting with a '/' are accessed with the a path equal to the registered name. Names without a leading '/' are accessed with: http://host/app/select?qt=name If no qt is defined, the requestHandler that declares default=true will be used. -- requestHandler name=standard class=solr.SearchHandler default=true !-- default values for query parameters -- lst name=defaults str name=echoParamsexplicit/str !-- int name=rows10/int str name=fl*/str str name=version2.1/str -- /lst /requestHandler !-- DisMaxRequestHandler allows easy searching across multiple fields for simple user-entered phrases. It's implementation is now just the standard SearchHandler with a default query type of dismax. see http://wiki.apache.org/solr/DisMaxRequestHandler -- requestHandler name=dismaxrequest class=solr.DisMaxRequestHandler lst name=defaults str name=echoParamsexplicit/str float name=tie0.01/float str name=qf statusName_s^1.0 productId_s^1.0 iSBN10_s^1.0 iSBN13_s^1.0 prdMainTitle_s^1.0 prdKeywords_s^1.0 productDescription_s^1.0 prdMainSubTitle_s^1.0 contentTypeId_s^1.0 /str str name=pf /str str name=bqenglish^90 hindi^123 Glorious^2000 highlighting^1000 maths^100 ab^12 erer^4545/str str name=fl *,score /str /lst /requestHandler requestHandler name=dismax class=solr.SearchHandler lst name=defaults str name=defTypedismax/str str name=echoParamsexplicit/str float name=tie0.01/float str name=qf /str str name=pf /str str name=bf /str str name=fl /str str name=mm 2lt;-1 5lt;-2 6lt;90% /str int name=ps100/int str name=q.alt*:*/str !-- example highlighter config, enable per-query with hl=true -- str name=hl.fltext features name/str !-- for this field, we want no fragmenting, just highlighting -- str name=f.name.hl.fragsize0/str !-- instructs Solr to return the field itself if no query terms are found -- str name=f.name.hl.alternateFieldname/str str name=f.text.hl.fragmenterregex/str !-- defined below -- /lst /requestHandler Please let me know whether I need to provide some configuration changes in the solrConfig.XML for sorting related settings or Have to provide the indexed fields name in this file on which I want to perform sorting. Thanks in advance. -- View this message in context: http://www.nabble.com/Sorting-is-not-taking-place-on-the-search-results-when-query-consists-of-%22qt-%22-parameter-tp20481589p20481589.html Sent from the Solr - User mailing list archive at Nabble.com.
To associate sort criteria with the search query having fields of type String( required to be treated as numeric)
Hi, I m trying to apply sort on the search query which includes fields of type string, but i want some fields to be treated as of type float/integer by solr since the field basicly contains numeric value but have been defined as of type string in solrCofig.XML Currently sorting on these fileds occur on Lexicographical pattern whereby 3888 is considered to be smaller than 450 thus wrong results are getting displayed. Is there some way / syntax which can be given in the search query so that the string type field can be treated as numeric and the correct results can be displayed. Thanks in advance. -- View this message in context: http://www.nabble.com/To-associate-sort-criteria-with-the-search--query-having-fields-of-type-String%28-required-to-be-treated-as-numeric%29-tp20481627p20481627.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: To associate sort criteria with the search query having fields of type String( required to be treated as numeric)
Hi, I *think* you can't do this without reindexing that field as a proper type. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch From: payalsharma [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Thursday, November 13, 2008 9:40:10 AM Subject: To associate sort criteria with the search query having fields of type String( required to be treated as numeric) Hi, I m trying to apply sort on the search query which includes fields of type string, but i want some fields to be treated as of type float/integer by solr since the field basicly contains numeric value but have been defined as of type string in solrCofig.XML Currently sorting on these fileds occur on Lexicographical pattern whereby 3888 is considered to be smaller than 450 thus wrong results are getting displayed. Is there some way / syntax which can be given in the search query so that the string type field can be treated as numeric and the correct results can be displayed. Thanks in advance. -- View this message in context: http://www.nabble.com/To-associate-sort-criteria-with-the-search--query-having-fields-of-type-String%28-required-to-be-treated-as-numeric%29-tp20481627p20481627.html Sent from the Solr - User mailing list archive at Nabble.com.
DataImportHandler, custom properties
Hello, I need somehow to add some custom properties to an entity so they will appear with indexed datas. Something like this : entity field column=id name=id / custom name=prop1 value=val1 / /entity The point is that I don't have this property in the database so it can't be imported. Plus, I'm generating the data-source file from another database so I don't know fields' name in advance. Triky things I may have tried with the regex transfomers for example don't work because column name must be existing but not already used (or it will be replaced). field column=required name=prop1 regex=(.+) replaceWith=val1/ Any idea please ? -- View this message in context: http://www.nabble.com/DataImportHandler%2C-custom-properties-tp20482190p20482190.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: DataImportHandler, custom properties
I'm not very sure about what you are want to do but it seems that TemplateTransformer can help you. http://wiki.apache.org/solr/DataImportHandler#head-071ff018f44ecbdb1cf55afc4c2a857f44ea1ea4 On Thu, Nov 13, 2008 at 10:09 PM, DODMax [EMAIL PROTECTED] wrote: Hello, I need somehow to add some custom properties to an entity so they will appear with indexed datas. Something like this : entity field column=id name=id / custom name=prop1 value=val1 / /entity The point is that I don't have this property in the database so it can't be imported. Plus, I'm generating the data-source file from another database so I don't know fields' name in advance. Triky things I may have tried with the regex transfomers for example don't work because column name must be existing but not already used (or it will be replaced). field column=required name=prop1 regex=(.+) replaceWith=val1/ Any idea please ? -- View this message in context: http://www.nabble.com/DataImportHandler%2C-custom-properties-tp20482190p20482190.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Shalin Shekhar Mangar.
solr 1.3 Modification field in schema.xml
Hi everybody, I don't get really when do I have to re index datas or not. I did a full import but I realised I stored too many fields which I don't need. So I have to change some fields inedexed which are stored to not stored. And I don't know if I have to re index my datas or not and in which case really do I have to re index datas. Another question, I would like to know which field must be stored, I thought it was field which use function for boosting, but I just tried to boost one field indexed but not stored and it worked. Thanks a lot for putting some light on my questions, -- View this message in context: http://www.nabble.com/solr-1.3--Modification-field-in-schema.xml-tp20483691p20483691.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: solr 1.3 Modification field in schema.xml
I believe (someone correct me if I'm wrong) that the only fields you need to store are those fields which you wish returned from the query. In other words, if you will never put the field on the list of fields (fl) to return, there is no need to store it. It would be advantageous not to store more then you have to. It reduces disk access, index size, memory usage, etc. However, you have to balance this against future needs. If re-indexing is costly just to start storing 1 more field, it may be worth it to just leave it in. -Todd Feak -Original Message- From: sunnyfr [mailto:[EMAIL PROTECTED] Sent: Thursday, November 13, 2008 9:13 AM To: solr-user@lucene.apache.org Subject: solr 1.3 Modification field in schema.xml Hi everybody, I don't get really when do I have to re index datas or not. I did a full import but I realised I stored too many fields which I don't need. So I have to change some fields inedexed which are stored to not stored. And I don't know if I have to re index my datas or not and in which case really do I have to re index datas. Another question, I would like to know which field must be stored, I thought it was field which use function for boosting, but I just tried to boost one field indexed but not stored and it worked. Thanks a lot for putting some light on my questions, -- View this message in context: http://www.nabble.com/solr-1.3--Modification-field-in-schema.xml-tp20483 691p20483691.html Sent from the Solr - User mailing list archive at Nabble.com.
Reminder: LogoContest deadline in one week
Hey all, a quick reminder that hte submission deadline for the Solr Logo Contest ends a week from today. Full details on how to enter are on the wiki, feel free to email the list with any questions... http://wiki.apache.org/solr/LogoContest At the bottom of that page i've inlined all of the submissions recieved so far that seem to meet the criteria (notably they must contain both of the words Apache Solr) This is just for reference -- it's not a ballot, and adding images to this wiki page does not constitute a submission, please read the wiki for instructions on entering. -Hoss
maxCodeLen in the doublemetaphone solr analyzer
I want to change the maxCodeLen param that is in Solr 1.3's doublemetaphone plugin. Doc is here: http://commons.apache.org/codec/apidocs/org/apache/commons/codec/language/DoubleMetaphone.html Is this something I can do in solrconfig or do I need to change it and recompile?
RE: maxCodeLen in the doublemetaphone solr analyzer
There's a patch in to do that as a separate filter. See https://issues.apache.org/jira/browse/SOLR-813 You could just take the patch. It's the full filter and factory. -Todd Feak -Original Message- From: Brian Whitman [mailto:[EMAIL PROTECTED] Sent: Thursday, November 13, 2008 12:31 PM To: solr-user@lucene.apache.org Subject: maxCodeLen in the doublemetaphone solr analyzer I want to change the maxCodeLen param that is in Solr 1.3's doublemetaphone plugin. Doc is here: http://commons.apache.org/codec/apidocs/org/apache/commons/codec/languag e/DoubleMetaphone.html Is this something I can do in solrconfig or do I need to change it and recompile?
Re: maxCodeLen in the doublemetaphone solr analyzer
oh, thanks! I didn't see that patch. On Thu, Nov 13, 2008 at 3:40 PM, Feak, Todd [EMAIL PROTECTED] wrote: There's a patch in to do that as a separate filter. See https://issues.apache.org/jira/browse/SOLR-813
Re: full-import with solrj (solr Java client)
Erik, thanks a lot for this example. Now, all works fine :-) Original-Nachricht Datum: Thu, 13 Nov 2008 06:53:36 -0500 Von: Erik Hatcher [EMAIL PROTECTED] An: solr-user@lucene.apache.org Betreff: Re: full-import with solrj (solr Java client) On Nov 13, 2008, at 6:20 AM, [EMAIL PROTECTED] wrote: I want to run a (DataImportHandler) full-import with solrj. I understand how to send queries with SolrQuery etc., but I don't know how to construct the dataimport?command=full-importcommit=true path. Which classes do I have to use? SolrRequest? It would be very nice if you could post some code examples. I've added an example here: http://wiki.apache.org/solr/SolJava Basically any request handler can be easily called from SolrJ, using ModifiableSolrParams, and making sure wt is set, along with the other parameters. Erik -- Sensationsangebot nur bis 30.11: GMX FreeDSL - Telefonanschluss + DSL für nur 16,37 Euro/mtl.!* http://dsl.gmx.de/?ac=OM.AD.PD003K11308T4569a
solrj and CLOSE_WAIT's
Hi guys.
I'm running a little upload project that uploads documents into a solr
index. there is also a 2nd thread that runs a deleteby query and a
optimize every once and a while.
in an effort to reduce the probably of things being held onto I've made
everything local, but it is still collecting CLOSE_WAITs and FIN_WAIT2's
on the server side until it eventually runs out of file handles in a day
or two.
the following are the code snippets being used to call solr.
protected void doArchiveSolr() throws IOException, SolrServerException {
Calendar rightNow = Calendar.getInstance();
rightNow.add(Calendar.DATE, 31 * -1);
DateFormat f = new SimpleDateFormat(-MM-dd'T'HH:mm:ss.SSS'Z');
java.util.Date d = rightNow.getTime();
String s = publish_date:[1976-03-06T23:59:59.999Z/YEAR TO +
f.format(d) + ];
logger.info(Archiver: + s);
CommonsHttpSolrServer solrServer;
solrServer = new CommonsHttpSolrServer(solrURL);
solrServer.deleteByQuery(s);
solrServer.commit();
}
and this runs every X minutes.
it also has other local parts like
{
CommonsHttpSolrServer solrServer;
solrServer = new CommonsHttpSolrServer(solrURL);
solrServer.optimize();
}
and
{
CommonsHttpSolrServer solrServer;
UpdateResponse r;
solrServer = new CommonsHttpSolrServer(solrUrl);
solrServer.setSoTimeout(12); // socket read
timeout 2minutes
solrServer.setConnectionTimeout(100);
solrServer.setDefaultMaxConnectionsPerHost(100);
solrServer.setMaxTotalConnections(100);
solrServer.setFollowRedirects(false); //
defaults to false
solrServer.setAllowCompression(false);
r = solrServer.add(docs);
r = solrServer.commit();
docs.clear();
}
STATS functions ....
Hi, As I understand the STATS functions (Min, Max, Average, Standard Deviation etc.) would be available in Solr 1.4. Just wondering if they are already there in the latest trunk. Else can anyone suggest any other tool which can be used with Solr 1.3 to achieve this requirement ? Regards, Sourav CAUTION - Disclaimer * This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful. This e-mail may contain viruses. Infosys has taken every reasonable precaution to minimize this risk, but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. Infosys reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the Infosys e-mail system. ***INFOSYS End of Disclaimer INFOSYS***
Re: STATS functions ....
StatsComponent is in trunk now, committed after the 1.3 release. https://issues.apache.org/jira/browse/SOLR-680 - note the Status and the Subversion Commits stuff there (just trying to help folks help themselves track this stuff :). I suspect the code could be pulled from that issue and applied to 1.3 release, even JAR'ing it up separately, and tossing it in as a plugin. We probably should be creating all these sorts of goodies and independent modules of code that aren't core, but that gets fuzzy to say what's core and what isn't too. Erik On Nov 13, 2008, at 8:26 PM, souravm wrote: Hi, As I understand the STATS functions (Min, Max, Average, Standard Deviation etc.) would be available in Solr 1.4. Just wondering if they are already there in the latest trunk. Else can anyone suggest any other tool which can be used with Solr 1.3 to achieve this requirement ? Regards, Sourav CAUTION - Disclaimer * This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful. This e-mail may contain viruses. Infosys has taken every reasonable precaution to minimize this risk, but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. Infosys reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the Infosys e-mail system. ***INFOSYS End of Disclaimer INFOSYS***
XsltResponseWriter date handling
I've done exorcisms to eradicate what I once knew about XSL from my head, but now I find myself interested in playing some games with the XsltResponseWriter for pragmatic the desired output is straightforward XML reasons. I need to take a Solr date value in 2008-10-30T03:28:10.000Z format and output it as a GMT formatted date like Oct 30 2008 03:28:10 GMT-0600. Anyone got the incantation handy to make such a conversion in XSLT? Erik
Solrj queries
Hi, Can anybody let me know how to do logical searches using Solrj. I have indexed the data and now I want to do search based on fields using Solrj as I have to retrieve in the form of beans. For eg. I have two fields, First name and last name I have to retrieve only names which match both of the above fields. Thanks -Raghu
Re: solrj and CLOSE_WAIT's
not sure if it is something we can do better or part of HttpClient...
From:
http://www.nabble.com/CLOSE_WAIT-td19959428.html
it seems to suggest you may want to call:
con.closeIdleConnections(0L);
But if you are creating a new MultiThreadedHttpConnectionManager for
each request, is seems odd you would have to explicitly close the
connection for each request.
What happens if you try using a SimpleHttpConnectionManager rather
then a MultiThreadedHttpConnectionManager? You can explicitly pass in:
new HttpClient( new SimpleHttpConnectionManager() )
to:
public CommonsHttpSolrServer(URL baseURL, HttpClient client,
ResponseParser parser, boolean useMultiPartPost) {
if that fixes things, it is a bit disturbing, but something we should
look into.
ryan
On Nov 13, 2008, at 7:49 PM, Ian Holsman wrote:
Hi guys.
I'm running a little upload project that uploads documents into a
solr index. there is also a 2nd thread that runs a deleteby query
and a optimize every once and a while.
in an effort to reduce the probably of things being held onto I've
made everything local, but it is still collecting CLOSE_WAITs and
FIN_WAIT2's on the server side until it eventually runs out of file
handles in a day or two.
the following are the code snippets being used to call solr.
protected void doArchiveSolr() throws IOException,
SolrServerException {
Calendar rightNow = Calendar.getInstance();
rightNow.add(Calendar.DATE, 31 * -1);
DateFormat f = new SimpleDateFormat(-MM-
dd'T'HH:mm:ss.SSS'Z');
java.util.Date d = rightNow.getTime();
String s = publish_date:[1976-03-06T23:59:59.999Z/YEAR TO +
f.format(d) + ];
logger.info(Archiver: + s);
CommonsHttpSolrServer solrServer;
solrServer = new CommonsHttpSolrServer(solrURL);
solrServer.deleteByQuery(s);
solrServer.commit();
}
and this runs every X minutes.
it also has other local parts like
{
CommonsHttpSolrServer solrServer;
solrServer = new CommonsHttpSolrServer(solrURL);
solrServer.optimize();
}
and
{
CommonsHttpSolrServer solrServer;
UpdateResponse r;
solrServer = new CommonsHttpSolrServer(solrUrl);
solrServer.setSoTimeout(12); // socket
read timeout 2minutes
solrServer.setConnectionTimeout(100);
solrServer.setDefaultMaxConnectionsPerHost(100);
solrServer.setMaxTotalConnections(100);
solrServer.setFollowRedirects(false); //
defaults to false
solrServer.setAllowCompression(false);
r = solrServer.add(docs);
r = solrServer.commit();
docs.clear();
}
Re: Reminder: LogoContest deadline in one week
Note to people with blogs. It would be great if you could mention this on your blog, so more people are aware of the contest. I just did that on http://jroller.com/otis/ in hopes of attracting even more submissions. Thanks! Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch From: Chris Hostetter [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Thursday, November 13, 2008 2:34:48 PM Subject: Reminder: LogoContest deadline in one week Hey all, a quick reminder that hte submission deadline for the Solr Logo Contest ends a week from today. Full details on how to enter are on the wiki, feel free to email the list with any questions... http://wiki.apache.org/solr/LogoContest At the bottom of that page i've inlined all of the submissions recieved so far that seem to meet the criteria (notably they must contain both of the words Apache Solr) This is just for reference -- it's not a ballot, and adding images to this wiki page does not constitute a submission, please read the wiki for instructions on entering. -Hoss
