Re: Build Solr to run SolrJS
I just got the client-side demo on trunk to work (with a few tweaks to make it work with the example core Solr data). On trunk follow these steps: * root directory: ant example * separate console, index data: cd example/exampledocs; java -jar post.jar *.xml * open contrib/javascript/example/testClientside.html in your browser The serverSide.html example is still not quite wired together properly to be an easy-to-run-demo, as what's on trunk doesn't include the reuters data and the velocity stuff is not wired in with it yet either. We'll get this working better/cleaner as we go, so we appreciate your early adopter help ironing out this stuff. Erik On Nov 20, 2008, at 5:44 PM, JCodina wrote: I could not manage, yet to use it. :confused: My doubts are: - must I download solr from svn - trunk? - then, must I apply the patches of solrjs and velocity and unzip the files? or is this already in trunk? because trunk contains velocity and javascript in contrib. but does not find the velocity - How do I edit/activate SolrJs to adapt it to my data, the wiki page says how to deploy the sample, and I looked at the sample page from the sample site, but I don't find how to manually install it on a tomcat server. PD. If I get how to do it, I promise I will introduce that information in the solrjs wiki page =) . Matthias Epheser wrote: Erik Hatcher schrieb: On Nov 16, 2008, at 1:40 PM, Matthias Epheser wrote: Matthias and Ryan - let's get SolrJS integrated into contrib/velocity. Any objections/reservations? As SolrJS may be used without velocity at all (using eg. ClientSideWidgets), is it possible to put it into contrib/ javascript and create a dependency to contrib/velocity for ServerSideWidgets? Sure, contrib/javascript sounds perfect. If that's ok, I'll have a look at the directory structure and the current ant build.xml to make them fit into the common solr structure and build. Awesome, thanks! Just uploaded solrjs.zip to https://issues.apache.org/jira/browse/SOLR-868. It is intended to be extracted in contrib/javascript and supports the following ant targets: * ant dist - creates a single js file and a jar that holds velocity templates. * ant docs - creates js docs. test in browser: doc/index.html * ant example-init - (depends ant dist on solr root) copies the current built of solr.war and solr-velocity.jar to example/testsolr/.. * ant example-start - starts the testsolr server on port 8983 * ant example-import - imports 3000 test data rows (requires a started testserver) Erik -- View this message in context: http://www.nabble.com/Build-Solr-to-run-SolrJS-tp20526644p20611635.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Build Solr to run SolrJS
On Nov 22, 2008, at 4:26 AM, Erik Hatcher wrote: I just got the client-side demo on trunk to work (with a few tweaks to make it work with the example core Solr data). On trunk follow these steps: * root directory: ant example One extra step needed, for the pedantic... * launch Solr: cd example; java -jar start.jar * separate console, index data: cd example/exampledocs; java -jar post.jar *.xml * open contrib/javascript/example/testClientside.html in your browser The serverSide.html example is still not quite wired together properly to be an easy-to-run-demo, as what's on trunk doesn't include the reuters data and the velocity stuff is not wired in with it yet either. We'll get this working better/cleaner as we go, so we appreciate your early adopter help ironing out this stuff. Erik
Re: Build Solr to run SolrJS
Yesterday I got it running, I thouhght I had post it, but I should not push the post button. The problem I had to solve to run it with the Velocity was to copy by hand the velocity jar files to /lib. Erik Hatcher wrote: I just got the client-side demo on trunk to work (with a few tweaks to make it work with the example core Solr data). On trunk follow these steps: * root directory: ant example * separate console, index data: cd example/exampledocs; java -jar post.jar *.xml * open contrib/javascript/example/testClientside.html in your browser The serverSide.html example is still not quite wired together properly to be an easy-to-run-demo, as what's on trunk doesn't include the reuters data and the velocity stuff is not wired in with it yet either. We'll get this working better/cleaner as we go, so we appreciate your early adopter help ironing out this stuff. Erik On Nov 20, 2008, at 5:44 PM, JCodina wrote: I could not manage, yet to use it. :confused: My doubts are: - must I download solr from svn - trunk? - then, must I apply the patches of solrjs and velocity and unzip the files? or is this already in trunk? because trunk contains velocity and javascript in contrib. but does not find the velocity - How do I edit/activate SolrJs to adapt it to my data, the wiki page says how to deploy the sample, and I looked at the sample page from the sample site, but I don't find how to manually install it on a tomcat server. PD. If I get how to do it, I promise I will introduce that information in the solrjs wiki page =) . Matthias Epheser wrote: Erik Hatcher schrieb: On Nov 16, 2008, at 1:40 PM, Matthias Epheser wrote: Matthias and Ryan - let's get SolrJS integrated into contrib/velocity. Any objections/reservations? As SolrJS may be used without velocity at all (using eg. ClientSideWidgets), is it possible to put it into contrib/ javascript and create a dependency to contrib/velocity for ServerSideWidgets? Sure, contrib/javascript sounds perfect. If that's ok, I'll have a look at the directory structure and the current ant build.xml to make them fit into the common solr structure and build. Awesome, thanks! Just uploaded solrjs.zip to https://issues.apache.org/jira/browse/SOLR-868. It is intended to be extracted in contrib/javascript and supports the following ant targets: * ant dist - creates a single js file and a jar that holds velocity templates. * ant docs - creates js docs. test in browser: doc/index.html * ant example-init - (depends ant dist on solr root) copies the current built of solr.war and solr-velocity.jar to example/testsolr/.. * ant example-start - starts the testsolr server on port 8983 * ant example-import - imports 3000 test data rows (requires a started testserver) Erik -- View this message in context: http://www.nabble.com/Build-Solr-to-run-SolrJS-tp20526644p20611635.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Build-Solr-to-run-SolrJS-tp20526644p20634725.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Build Solr to run SolrJS
JCodina schrieb: Yesterday I got it running, I thouhght I had post it, but I should not push the post button. The problem I had to solve to run it with the Velocity was to copy by hand the velocity jar files to /lib. There is an ant task example-init in contrib/javascript/build.xml that should do this trick for you. It copies solr.war to example/webapps and all the contrib/velicity stuff to example/solr/lib. I'm just about to post a patch to integrate a small set of testdata automatically to the example, so your're tweaking with the core testdata can be avoided. I will update the wiki as soon as this is commited. After that, only a checkout and ant example-init ant example-start ant example-import will create working examples for you. matthias Erik Hatcher wrote: I just got the client-side demo on trunk to work (with a few tweaks to make it work with the example core Solr data). On trunk follow these steps: * root directory: ant example * separate console, index data: cd example/exampledocs; java -jar post.jar *.xml * open contrib/javascript/example/testClientside.html in your browser The serverSide.html example is still not quite wired together properly to be an easy-to-run-demo, as what's on trunk doesn't include the reuters data and the velocity stuff is not wired in with it yet either. We'll get this working better/cleaner as we go, so we appreciate your early adopter help ironing out this stuff. Erik On Nov 20, 2008, at 5:44 PM, JCodina wrote: I could not manage, yet to use it. :confused: My doubts are: - must I download solr from svn - trunk? - then, must I apply the patches of solrjs and velocity and unzip the files? or is this already in trunk? because trunk contains velocity and javascript in contrib. but does not find the velocity - How do I edit/activate SolrJs to adapt it to my data, the wiki page says how to deploy the sample, and I looked at the sample page from the sample site, but I don't find how to manually install it on a tomcat server. PD. If I get how to do it, I promise I will introduce that information in the solrjs wiki page =) . Matthias Epheser wrote: Erik Hatcher schrieb: On Nov 16, 2008, at 1:40 PM, Matthias Epheser wrote: Matthias and Ryan - let's get SolrJS integrated into contrib/velocity. Any objections/reservations? As SolrJS may be used without velocity at all (using eg. ClientSideWidgets), is it possible to put it into contrib/ javascript and create a dependency to contrib/velocity for ServerSideWidgets? Sure, contrib/javascript sounds perfect. If that's ok, I'll have a look at the directory structure and the current ant build.xml to make them fit into the common solr structure and build. Awesome, thanks! Just uploaded solrjs.zip to https://issues.apache.org/jira/browse/SOLR-868. It is intended to be extracted in contrib/javascript and supports the following ant targets: * ant dist - creates a single js file and a jar that holds velocity templates. * ant docs - creates js docs. test in browser: doc/index.html * ant example-init - (depends ant dist on solr root) copies the current built of solr.war and solr-velocity.jar to example/testsolr/.. * ant example-start - starts the testsolr server on port 8983 * ant example-import - imports 3000 test data rows (requires a started testserver) Erik -- View this message in context: http://www.nabble.com/Build-Solr-to-run-SolrJS-tp20526644p20611635.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Build Solr to run SolrJS
Erik Hatcher schrieb: It'd be nice to have SolrJS and VrW's examples, at least the default one, work off the built-in Solr example data. It's pretty minimal, and somewhat contrived, but it'll make it lots easier to document and demonstrate this stuff if it's cohesive that way. Certainly, though, it's not possible to show off all widgets this way (like country selection), but the more unified we make SolrJS and VrW, the easier it will be for folks to try and eventually adopt these cool technologies. Just posted the patch to SOLR-868, everything is done by ant as described, so you should be able to see meaningful examples within a minute. A script is attached that makes it possible to include 1+ more of testdata if you like, but you don't have to. No manual tweaking is necessary, I don't think it adds to much complexity, as for solrjs purpose, this testdata looks much more real life. matthias Erik On Nov 22, 2008, at 5:50 AM, Matthias Epheser wrote: JCodina schrieb: Yesterday I got it running, I thouhght I had post it, but I should not push the post button. The problem I had to solve to run it with the Velocity was to copy by hand the velocity jar files to /lib. There is an ant task example-init in contrib/javascript/build.xml that should do this trick for you. It copies solr.war to example/webapps and all the contrib/velicity stuff to example/solr/lib. I'm just about to post a patch to integrate a small set of testdata automatically to the example, so your're tweaking with the core testdata can be avoided. I will update the wiki as soon as this is commited. After that, only a checkout and ant example-init ant example-start ant example-import will create working examples for you. matthias Erik Hatcher wrote: I just got the client-side demo on trunk to work (with a few tweaks to make it work with the example core Solr data). On trunk follow these steps: * root directory: ant example * separate console, index data: cd example/exampledocs; java -jar post.jar *.xml * open contrib/javascript/example/testClientside.html in your browser The serverSide.html example is still not quite wired together properly to be an easy-to-run-demo, as what's on trunk doesn't include the reuters data and the velocity stuff is not wired in with it yet either. We'll get this working better/cleaner as we go, so we appreciate your early adopter help ironing out this stuff. Erik On Nov 20, 2008, at 5:44 PM, JCodina wrote: I could not manage, yet to use it. :confused: My doubts are: - must I download solr from svn - trunk? - then, must I apply the patches of solrjs and velocity and unzip the files? or is this already in trunk? because trunk contains velocity and javascript in contrib. but does not find the velocity - How do I edit/activate SolrJs to adapt it to my data, the wiki page says how to deploy the sample, and I looked at the sample page from the sample site, but I don't find how to manually install it on a tomcat server. PD. If I get how to do it, I promise I will introduce that information in the solrjs wiki page =) . Matthias Epheser wrote: Erik Hatcher schrieb: On Nov 16, 2008, at 1:40 PM, Matthias Epheser wrote: Matthias and Ryan - let's get SolrJS integrated into contrib/velocity. Any objections/reservations? As SolrJS may be used without velocity at all (using eg. ClientSideWidgets), is it possible to put it into contrib/ javascript and create a dependency to contrib/velocity for ServerSideWidgets? Sure, contrib/javascript sounds perfect. If that's ok, I'll have a look at the directory structure and the current ant build.xml to make them fit into the common solr structure and build. Awesome, thanks! Just uploaded solrjs.zip to https://issues.apache.org/jira/browse/SOLR-868. It is intended to be extracted in contrib/javascript and supports the following ant targets: * ant dist - creates a single js file and a jar that holds velocity templates. * ant docs - creates js docs. test in browser: doc/index.html * ant example-init - (depends ant dist on solr root) copies the current built of solr.war and solr-velocity.jar to example/testsolr/.. * ant example-start - starts the testsolr server on port 8983 * ant example-import - imports 3000 test data rows (requires a started testserver) Erik --View this message in context: http://www.nabble.com/Build-Solr-to-run-SolrJS-tp20526644p20611635.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: facet sort by ranking
Hi Sahlin, Thanks for reply. Actually we have some ranking associated to field on which we are faceting and we want to show only top 10 facet value now which is sort by count but we want to sort by it ranking. Regards, Amit -Original Message- From: Shalin Shekhar Mangar [mailto:[EMAIL PROTECTED] Sent: 22 November 2008 13:10 To: solr-user@lucene.apache.org Subject: Re: facet sort by ranking On Sat, Nov 22, 2008 at 12:31 PM, Amit [EMAIL PROTECTED] wrote: Is there any way to sort the facet values by other own ranking value instead of only count? Facets do not have a score associated with them of their own. Not sure what you mean exactly. -- Regards, Shalin Shekhar Mangar. No virus found in this incoming message. Checked by AVG. Version: 7.5.549 / Virus Database: 270.9.9/1804 - Release Date: 21-11-2008 18:24 No virus found in this outgoing message. Checked by AVG. Version: 7.5.549 / Virus Database: 270.9.9/1804 - Release Date: 21-11-2008 18:24
Re: facet sort by ranking
On Sat, Nov 22, 2008 at 12:05 PM, Amit [EMAIL PROTECTED] wrote: Actually we have some ranking associated to field on which we are faceting and we want to show only top 10 facet value now which is sort by count but we want to sort by it ranking. I think you're going to have to give some concrete examples of what your documents look like, and what results you want back. -Yonik
idea about faceting
Hey there, I am faceing a problem doing filed facets and I don't know if there exist any solution in Solr to solve my problem. I want to do facets with a field that is very small text. To do that I am using the KeywordTokenizerfactory to keep all the words of the text in just one token. I use LowerCaseFilterFactory not to miss cases that doesn't match due to uppercase and ISOLatin1AccentFilterFactory not to miss cases that doesn't match because of the accents. The problem apears here, I would like to show the facets with accents or uppercase. In my old Lucene system not using Solr I use to create my facet fields with accents but at searching time I removed the accents and uppercases manually with java. So, i did the search without accents and upper case but I was able to show them later. I have been playing with the facet solr source code but can't find the way to solve my problem... Does anyone have an idea about how could I reach this goal? Thanks in advance -- View this message in context: http://www.nabble.com/idea-about-faceting-tp20638850p20638850.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Build Solr to run SolrJS
Maybe another template idea ... I just started playing around w/ this plugin: http://malsup.com/jquery/taconite/ Would be pretty neat to have that as a response (or @ least the technique), not sure how well known it is or if there is something W3C- based in the pipeline that is similar. Pretty neat though. - Jon On Nov 22, 2008, at 4:26 AM, Erik Hatcher wrote: I just got the client-side demo on trunk to work (with a few tweaks to make it work with the example core Solr data). On trunk follow these steps: * root directory: ant example * separate console, index data: cd example/exampledocs; java -jar post.jar *.xml * open contrib/javascript/example/testClientside.html in your browser The serverSide.html example is still not quite wired together properly to be an easy-to-run-demo, as what's on trunk doesn't include the reuters data and the velocity stuff is not wired in with it yet either. We'll get this working better/cleaner as we go, so we appreciate your early adopter help ironing out this stuff. Erik On Nov 20, 2008, at 5:44 PM, JCodina wrote: I could not manage, yet to use it. :confused: My doubts are: - must I download solr from svn - trunk? - then, must I apply the patches of solrjs and velocity and unzip the files? or is this already in trunk? because trunk contains velocity and javascript in contrib. but does not find the velocity - How do I edit/activate SolrJs to adapt it to my data, the wiki page says how to deploy the sample, and I looked at the sample page from the sample site, but I don't find how to manually install it on a tomcat server. PD. If I get how to do it, I promise I will introduce that information in the solrjs wiki page =) . Matthias Epheser wrote: Erik Hatcher schrieb: On Nov 16, 2008, at 1:40 PM, Matthias Epheser wrote: Matthias and Ryan - let's get SolrJS integrated into contrib/velocity. Any objections/reservations? As SolrJS may be used without velocity at all (using eg. ClientSideWidgets), is it possible to put it into contrib/ javascript and create a dependency to contrib/velocity for ServerSideWidgets? Sure, contrib/javascript sounds perfect. If that's ok, I'll have a look at the directory structure and the current ant build.xml to make them fit into the common solr structure and build. Awesome, thanks! Just uploaded solrjs.zip to https://issues.apache.org/jira/browse/SOLR-868. It is intended to be extracted in contrib/javascript and supports the following ant targets: * ant dist - creates a single js file and a jar that holds velocity templates. * ant docs - creates js docs. test in browser: doc/index.html * ant example-init - (depends ant dist on solr root) copies the current built of solr.war and solr-velocity.jar to example/testsolr/.. * ant example-start - starts the testsolr server on port 8983 * ant example-import - imports 3000 test data rows (requires a started testserver) Erik -- View this message in context: http://www.nabble.com/Build-Solr-to-run-SolrJS-tp20526644p20611635.html Sent from the Solr - User mailing list archive at Nabble.com.
QueryElevationComponent
I have a question about QueryElevationComponent. I'm trying to use it but it seems it works properly if, and only if, the id field name in uniqueKey definition is '*id*'. so if I have uniqueKey*myid*/uniqueKey, it does not work. Could you please tell me what I'm doing wrong? thaks a lot Paolo - this is my elevate.xml elevate query text=cars doc id=77b81d932353a5d16880043bdb4fe22b/ /query /elevate - I added at the tail of solrconfig.xml file ... !-- a search component that enables you to configure the top results for a given query regardless of the normal lucene scoring.-- searchComponent name=elevator class=solr.QueryElevationComponent !-- pick a fieldType to analyze queries -- str name=queryFieldTypestring/str str name=config-fileelevate.xml/str /searchComponent !-- a request handler utilizing the elevator component -- requestHandler name=/elevate class=solr.SearchHandler startup=lazy lst name=defaults str name=echoParamsexplicit/str /lst arr name=last-components strelevator/str /arr /requestHandler /config - in my schema I have field name=md type=string indexed=true stored=true required=true / ... uniqueKeymyid/uniqueKey
RE: Newbie Question - getting search results from dataimport request handler
As part of the ETL effort, please consider how to integrate with these two open-source ETL systems. I'm not asking for an implementation, just suggesting that having a concrete context will help you in the architecture phase. http://kettle.pentaho.org/ http://www.talend.com/products-data-integration/talend-open-studio.php Thanks, Lance -Original Message- From: Noble Paul നോബിള് नोब्ळ् [mailto:[EMAIL PROTECTED] Sent: Friday, November 21, 2008 8:12 PM To: solr-user@lucene.apache.org Subject: Re: Newbie Question - getting search results from dataimport request handler On Sat, Nov 22, 2008 at 3:10 AM, Chris Hostetter [EMAIL PROTECTED] wrote: : it might be worth considering a new @attribute for fields to indicate : that they are going to be used purely as component fields (ie: your : first-name/last-name example) and then have DIH pass all non-component : fields along and error if undefined in the schema just like other updating : RequestHandlers do. : : either that, or require that people declaure indexed=false : stored=false fields in the schema for these intermediate component : fields so that we can properly warn then when DIH is getting data it : doesn't know what to do with -- protecting people from field name typos : and returning errors instead of silently ignoring unexpected input is : fairly important behavir -- especially for new users. : Actually it is done by DIH . When the dataconfig is loaded DIH reports : these information on the console. though it is limited , it helps to a : certain extent Hmmm. Logging an error and returning successfully (without adding any docs) is still inconsistent with the way all other RequestHandlers work: fail the request. I know DIH isn't a typical RequestHandler, but some things (like failing on failure) seem like they should be a given. SOLR-842 . DIH is an ETL tool pretending to be a RequestHandler. Originally it was built to run outside of Solr using SolrJ. For better integration and ease of use we changed it later. SOLR-853 aims to achieve the oroginal goal The goal of DIH is to become a full featured ETL tool. -Hoss -- --Noble Paul
RE: idea about faceting
Index two fields instead of one. One field has ISOLatin1Filter, LowerCase etc. and one does not. Search the processed, filter on the raw one. For more searching power, you can even index a third field with the Soundex/Metaphone phoneme translators. -Original Message- From: Marc Sturlese [mailto:[EMAIL PROTECTED] Sent: Saturday, November 22, 2008 9:43 AM To: solr-user@lucene.apache.org Subject: idea about faceting Hey there, I am faceing a problem doing filed facets and I don't know if there exist any solution in Solr to solve my problem. I want to do facets with a field that is very small text. To do that I am using the KeywordTokenizerfactory to keep all the words of the text in just one token. I use LowerCaseFilterFactory not to miss cases that doesn't match due to uppercase and ISOLatin1AccentFilterFactory not to miss cases that doesn't match because of the accents. The problem apears here, I would like to show the facets with accents or uppercase. In my old Lucene system not using Solr I use to create my facet fields with accents but at searching time I removed the accents and uppercases manually with java. So, i did the search without accents and upper case but I was able to show them later. I have been playing with the facet solr source code but can't find the way to solve my problem... Does anyone have an idea about how could I reach this goal? Thanks in advance -- View this message in context: http://www.nabble.com/idea-about-faceting-tp20638850p20638850.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: QueryElevationComponent
hymm -- that *should* not be the case. The id field in QueryElevationComponent uses the globally defined field: SchemaField sf = core.getSchema().getUniqueKeyField(); ... idField = sf.getName().intern(); The only thing that may be weird is that if you id field is named myid, your elevate.xml file still refers to id as the unique key. Is that what you are refering to? I have not tested this, so it may very well be broken. ryan On Nov 22, 2008, at 5:31 PM, Paolo Ruscitti wrote: I have a question about QueryElevationComponent. I'm trying to use it but it seems it works properly if, and only if, the id field name in uniqueKey definition is '*id*'. so if I have uniqueKey*myid*/uniqueKey, it does not work. Could you please tell me what I'm doing wrong? thaks a lot Paolo - this is my elevate.xml elevate query text=cars doc id=77b81d932353a5d16880043bdb4fe22b/ /query /elevate - I added at the tail of solrconfig.xml file ... !-- a search component that enables you to configure the top results for a given query regardless of the normal lucene scoring.-- searchComponent name=elevator class=solr.QueryElevationComponent !-- pick a fieldType to analyze queries -- str name=queryFieldTypestring/str str name=config-fileelevate.xml/str /searchComponent !-- a request handler utilizing the elevator component -- requestHandler name=/elevate class=solr.SearchHandler startup=lazy lst name=defaults str name=echoParamsexplicit/str /lst arr name=last-components strelevator/str /arr /requestHandler /config - in my schema I have field name=md type=string indexed=true stored=true required=true / ... uniqueKeymyid/uniqueKey
Question about Query Phrase Slop (qs) in dismax
From the solr wiki, it sounded like if qs is set to 5 for example, if the search term is 'child custody', only docs with 'child' 'custody' within 5 words of one another would be returned in results. Is this correct? If so, it doesn't seem to be working for me. I see docs with 'child' 'custody' more than 5 words of one another (excluding stop words) which is resulting in bad user experience as those docs are not so relevant. What more could i do to improve quality in the results? -- View this message in context: http://www.nabble.com/Question-about-Query-Phrase-Slop-%28qs%29-in-dismax-tp20643003p20643003.html Sent from the Solr - User mailing list archive at Nabble.com.
