RE: Query on the updation of synonym and stopword file.
I am using Solr1.3 version.. > Date: Wed, 8 Jul 2009 01:12:02 +0900 > From: k...@r.email.ne.jp > To: solr-user@lucene.apache.org > Subject: Re: Query on the updation of synonym and stopword file. > > Sagar, > > > I am facing a problem here that even after the core reload and > re-indexing > > the documents the new updated synonym or stop words are not loaded. > > Seems so the filters are not aware that these files are updated so > the solution > > to me is to restart the whole container in which I have embedded > > the Solr server; it is not feasible in production. > > I am not a multicore user, but I can see the synonyms.txt updated > after reloading the core (I verified it via analysis.jsp, not re-indexing), > wothout restarting solr server. I'm using 1.4. What version are you using? > > Koji > > > Sagar Khetkade wrote: > > Hello All, > > > > I was figuring out the issue with the synonym.txt and stopword.txt files > > being updated on regular interval. > > Here in my case I am updating the synonym.txt and stopword.txt files as the > > synonym and stop word dictionary is update. I am facing a problem here that > > even after the core reload and re-indexing the documents the new updated > > synonym or stop words are not loaded. Seems so the filters are not aware > > that these files are updated so the solution to me is to restart the whole > > container in which I have embedded the Solr server; it is not feasible in > > production. > > I came across the discussion with subject “ synonyms.txt file updated > > frequently” in which Grant had a view to write a new logic in > > SynonymFilterFactory which would take care of this issue. Is there any > > possible solution to this or is this the solution. > > Thanks in advance! > > > > Regards, > > Sagar Khetkade > > > > > > _ > > Missed any of the IPL matches ? Catch a recap of all the action on MSN > > Videos > > http://msnvideos.in/iplt20/msnvideoplayer.aspx > > > _ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/india/windows/windowslive/
Query on the updation of synonym and stopword file.
Hello All, I was figuring out the issue with the synonym.txt and stopword.txt files being updated on regular interval. Here in my case I am updating the synonym.txt and stopword.txt files as the synonym and stop word dictionary is update. I am facing a problem here that even after the core reload and re-indexing the documents the new updated synonym or stop words are not loaded. Seems so the filters are not aware that these files are updated so the solution to me is to restart the whole container in which I have embedded the Solr server; it is not feasible in production. I came across the discussion with subject “ synonyms.txt file updated frequently” in which Grant had a view to write a new logic in SynonymFilterFactory which would take care of this issue. Is there any possible solution to this or is this the solution. Thanks in advance! Regards, Sagar Khetkade _ Missed any of the IPL matches ? Catch a recap of all the action on MSN Videos http://msnvideos.in/iplt20/msnvideoplayer.aspx
RE: Boolean query in Solr
Hi Erik, This mail just got into my junk so left unread. Well after I made debug query on., and firing the same query I am getting some different vibs from it. Suppose the query is Content: xyz AND Ticket_Id: (123 OR 1234) and here the search query i.e “xyz” was in the stop word list even then the search results were retrieved. Expected was none of the document be retrieved. Here I am getting the documents where “xyz” is not at all there. The debug query was q=Content:xyz+AND+Ticket_Id:4 When I used SolrAdmin I got that the parsed query from solr was omitting the search field (Content) as it is marked as stop word but was taking the Ticket_Id and giving me the results. My question is whether it is possible in Solr to fire the query where I want to retrieve the document having the search field(Content) only in the selected Ticket_Id. Thanks in advance. ~ Sagar > From: e...@ehatchersolutions.com > To: solr-user@lucene.apache.org > Subject: Re: Boolean query in Solr > Date: Tue, 14 Apr 2009 09:33:27 -0400 > > > On Apr 14, 2009, at 5:38 AM, Sagar Khetkade wrote: > > > > > Hi, > > I am using SolrJ and firing the query on Solr indexes. The indexed > > contains three fields viz. > > 1. Document_id (type=integer required= true) > > 2. Ticket Id (type= integer) > > 3. Content (type=text) > > > > Here the query formulation is such that I am having query with “AND” > > clause. So the query, that I am firing on index files look like > > “Content: search query AND Ticket_id:123 Ticket_Id:789)”. > > That query is invalid query parser syntax, with an unopen paren first > of all. I assume that's a typo though. Be careful in how you > construct queries with field selectors. Saying: > > Content:search query > > does NOT necessarily mean that the term "query" is being searched in > the Content field, as that depends on your default field setting for > the query parser. This, however, does use the Content field for both > terms: > > Content:(search query) > > > > I know this type of query is easily fired on lucene indexes. But > > when I am firing the above query I am not getting the required > > result . The result contains the document which does not belongs to > > the ticket id mentioned in the query. > > Please can anyone help me out of this issue. > > What does the query parse to with &debugQuery output? That's mighty > informative info. > > Erik > _ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/india/windows/windowslive/
RE: Solr Loggin issue
In addition to earlier mail I have a particular scenario. For that I have to explain my application level logging in detail. I am using solr as embedded server. I am using solr with Solr-560-slf4j patch. I need logging information for solr. Right now my application is using log4j for logging and the log4j.properties files is in my WEB-INF. It is working fine. But the error, info and severe logs generated by solr are going to the stdout.log file of tomacat as it is using logging.properties file from the jre/lib folder and using the ConsolHandler I tried with n number of combination but cant configure to make the solr log releated information to go the application logger or the new logger specified in the FileHandler. I addition whether there is some other issue that I am unable to figure it out. Please help me out of this scenario. I am stuck up with this issue. ~Sagar > From: sagar.khetk...@hotmail.com > To: solr-user@lucene.apache.org > Subject: RE: Solr Loggin issue > Date: Wed, 13 May 2009 09:21:57 +0530 > > > > > I have only one log4j.properties file in classpath and even if i configure > for the particular package where the solr exception would come then also the > same issue. I had removed the logger for my application and using only for > solr logging. > > > > ~Sagar > > > > > > > Date: Tue, 12 May 2009 09:59:01 -0700 > > Subject: Re: Solr Loggin issue > > From: jayallenh...@gmail.com > > To: solr-user@lucene.apache.org > > > > Usually that means there is another log4j.properties or log4j.xml file in > > your classpath that is being found before the one you are intending to use. > > Check your classpath for other versions of these files. > > > > -Jay > > > > > > On Tue, May 12, 2009 at 3:38 AM, Sagar Khetkade > > wrote: > > > > > > > > Hi, > > > I have solr implemented in multi-core scenario and also implemented > > > solr-560-slf4j.patch for implementing the logging. But the problem I am > > > facing is that the logs are going to the stdout.log file not the log file > > > that I have mentioned in the log4j.properties file. Can anybody give me > > > work > > > round to make logs go into the logger mentioned in log4j.properties file. > > > Thanks in advance. > > > > > > Regards, > > > Sagar Khetkade > > > _ > > > Live Search extreme As India feels the heat of poll season, get all the > > > info you need on the MSN News Aggregator > > > http://news.in.msn.com/National/indiaelections2009/aggregator/default.aspx > > > > > _ > Live Search extreme As India feels the heat of poll season, get all the info > you need on the MSN News Aggregator > http://news.in.msn.com/National/indiaelections2009/aggregator/default.aspx _ Planning the weekend ? Here’s what is happening in your town. http://msn.asklaila.com/events/
RE: Solr Loggin issue
I have only one log4j.properties file in classpath and even if i configure for the particular package where the solr exception would come then also the same issue. I had removed the logger for my application and using only for solr logging. ~Sagar > Date: Tue, 12 May 2009 09:59:01 -0700 > Subject: Re: Solr Loggin issue > From: jayallenh...@gmail.com > To: solr-user@lucene.apache.org > > Usually that means there is another log4j.properties or log4j.xml file in > your classpath that is being found before the one you are intending to use. > Check your classpath for other versions of these files. > > -Jay > > > On Tue, May 12, 2009 at 3:38 AM, Sagar Khetkade > wrote: > > > > > Hi, > > I have solr implemented in multi-core scenario and also implemented > > solr-560-slf4j.patch for implementing the logging. But the problem I am > > facing is that the logs are going to the stdout.log file not the log file > > that I have mentioned in the log4j.properties file. Can anybody give me work > > round to make logs go into the logger mentioned in log4j.properties file. > > Thanks in advance. > > > > Regards, > > Sagar Khetkade > > _ > > Live Search extreme As India feels the heat of poll season, get all the > > info you need on the MSN News Aggregator > > http://news.in.msn.com/National/indiaelections2009/aggregator/default.aspx > > _ Live Search extreme As India feels the heat of poll season, get all the info you need on the MSN News Aggregator http://news.in.msn.com/National/indiaelections2009/aggregator/default.aspx
Solr Loggin issue
Hi, I have solr implemented in multi-core scenario and also implemented solr-560-slf4j.patch for implementing the logging. But the problem I am facing is that the logs are going to the stdout.log file not the log file that I have mentioned in the log4j.properties file. Can anybody give me work round to make logs go into the logger mentioned in log4j.properties file. Thanks in advance. Regards, Sagar Khetkade _ Live Search extreme As India feels the heat of poll season, get all the info you need on the MSN News Aggregator http://news.in.msn.com/National/indiaelections2009/aggregator/default.aspx
RE: Core Reload issue
>From my understanding re-indexing the documents is a different thing. If you >have the stop word filter for field type say "text" then after reloading the >core if i type in a query which is stop word only it would get parsed from >stop word filter which would eventually will not serach against the index. But in my case i am getting the results having the stop word; so the issue. ~Sagar > From: noble.p...@gmail.com > Date: Tue, 5 May 2009 10:09:29 +0530 > Subject: Re: Core Reload issue > To: solr-user@lucene.apache.org > > If you change the the conf files and if you reindex the documents it > must be reflected are you sure you re-indexed? > > On Tue, May 5, 2009 at 10:00 AM, Sagar Khetkade > wrote: > > > > Hi, > > > > I came across a strange problem while reloading the core in multicore > > scenario. In the config of one of the core I am making changes in the > > synonym and stopword files and then reloading the core. The core gets > > reloaded but the changes in stopword and synonym fiels does not get > > reflected when I query in. The filters for index and query are the same. I > > face this problem even if I reindex the documents. But when I restart the > > servlet container in which the solr is embedded I problem does not > > resurfaces. > > My ultimate goal is/was to reflect the changes made in the text files > > inside the config folder. > > Is this the expected behaviour or some problem at my side. Could anyone > > suggest me the possible work around? > > > > Thanks in advance! > > > > Regards, > > Sagar Khetkade > > _ > > More than messages–check out the rest of the Windows Live™. > > http://www.microsoft.com/india/windows/windowslive/ > > > > -- > - > Noble Paul | Principal Engineer| AOL | http://aol.com _ Planning the weekend ? Here’s what is happening in your town. http://msn.asklaila.com/events/
Core Reload issue
Hi, I came across a strange problem while reloading the core in multicore scenario. In the config of one of the core I am making changes in the synonym and stopword files and then reloading the core. The core gets reloaded but the changes in stopword and synonym fiels does not get reflected when I query in. The filters for index and query are the same. I face this problem even if I reindex the documents. But when I restart the servlet container in which the solr is embedded I problem does not resurfaces. My ultimate goal is/was to reflect the changes made in the text files inside the config folder. Is this the expected behaviour or some problem at my side. Could anyone suggest me the possible work around? Thanks in advance! Regards, Sagar Khetkade _ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/india/windows/windowslive/
Boolean query in Solr
Hi, I am using SolrJ and firing the query on Solr indexes. The indexed contains three fields viz. 1. Document_id (type=integer required= true) 2. Ticket Id (type= integer) 3. Content (type=text) Here the query formulation is such that I am having query with “AND” clause. So the query, that I am firing on index files look like “Content: search query AND Ticket_id:123 Ticket_Id:789)”. Here I am using the AND clause which make my job easy through which I retrieve the document having the query words in the “Content” field and the document is having Ticket_id field(123). I know this type of query is easily fired on lucene indexes. But when I am firing the above query I am not getting the required result . The result contains the document which does not belongs to the ticket id mentioned in the query. Please can anyone help me out of this issue. Thanks in advance. Regards, Sagar Khetkade _ Windows Live Messenger. Multitasking at its finest. http://www.microsoft.com/india/windows/windowslive/messenger.aspx
special characters in Solr search query.
Hi, There is a strange issue while querying on the Solr indexes. If my query contains the special characters like [ ] !<> etc. It is throwing the query parse exception. From my application interface I am able to handle the special characters but the issue is while the document which I am going to index contains any of these special characters it is throwing query parse exception. Can anyone give pointer over this? Thanks in advance. Regards, Sagar Khetkade _ The new Windows Live Messenger. You don’t want to miss this. http://www.microsoft.com/india/windows/windowslive/messenger.aspx
Distributed Search in multcore scenario.
Hi, I have multi-core scenario where the schemas are different and I have to search for these cores as per the use case. I am using distributed search approach here for getting the search results for the query from these cores. But there is an obstacle. I have used EmbbededSolrServer class of Solrj for getting the solr server. As I have to pass the shardes in the from of URL to the CommonHttpServer which I am unable to pass( as I am not using the HTTP approach). Instead I have tried shards as the server instance for the multi-core which I giving me error as “Invalid uri 'http:// core0/select': Invalid authority”. Can anybody suggest me the right approach having distributed search using multi-core scenario as well as the EmbedderSolrServer. Thanks and Regards, Sagar Khetkade _ How fun is this? IMing with Windows Live Messenger just got better. http://www.microsoft.com/india/windows/windowslive/messenger.aspx
Search in two core of solr with a single search query
Hi, I have a issue here as i want to search a query. That query would be fired in two core of solr having different indexes and would merge the result set. This was possible in Lucene using multisearcher and then merging the result. Please suggest me how can i do it in solr. Thanks, Sagar Khetakde _ Wish to Marry Now? Join MSN Matrimony FREE! http://www.in.msn.com/matrimony
RE: Updating the solr index
thanks a lot Noble. `Sagar > Date: Wed, 18 Feb 2009 14:45:13 +0530> Subject: Re: Updating the solr index> > From: noble.p...@gmail.com> To: solr-user@lucene.apache.org> > The patch > currently does not work . SOLR-828 is supposed to duplicate> this. But this > is a huge change and a patch is still not ready ,so it> is pushed to 1.5.> > > On Wed, Feb 18, 2009 at 2:32 PM, Sagar Khetkade> > wrote:> >> > Hi,> >> > The question is about the SOLR path 139 in jira. There > the issue is open and marked for SOLR 1.5 release. Is the patch available > updates the index file for the particular id for solr 1.3?> >> > Regards,> > > Sagar Khetkade> > > _> > For the > freshest Indian Jobs Visit MSN Jobs> > http://www.in.msn.com/jobs> > > > -- > > --Noble Paul _ Find a better job. We have plenty. Visit MSN Jobs http://www.in.msn.com/jobs
Dynamic fields in schema.xml file
Hi, I am trying out the dynamic field in schema.xml with its attribute as true. Right now I indexing 1 articles having five fields in which the two fields are explicitly mention as text field and others are the dynamic fields. But while search if the query is fired on the last of the dynamic field then the results are retrieved but not for the earlier dynamic fields. Eg: A, B, C, D and E are the fields. A and B are the explicitly mentioned fields with A fields having attribute as indexed=true and stored=true and B is having indexed=true. Here A field is unique so is a required fields. Other fields coming (C, D and E) are considered as dynamic fields with attribute indexed=true. So if search is made on E the results are retrieved but results are not coming while search on C and D. I have also cross verified with document frequency count. The document frequency count is coming for A, B and C field but not on C and D fields. I am stuck up on this issue. Is the schema ( my thinking ) is wrong or something else. Regards, Sagar Khetkade _ Plug in to the MSN Tech channel for a full update on the latest gizmos that made an impact. http://computing.in.msn.com/
Using Threading while Indexing.
Hi, I was trying to index three sets of document having 2000 articles using three threads of embedded solr server. But while indexing, giving me exception “org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: SingleInstanceLock: write.lock”. I know that this issue do persists with Lucene; is it the same with Solr? Thanks and Regards, Sagar Khetkade. _ For the freshest Indian Jobs Visit MSN Jobs http://www.in.msn.com/jobs
Wordnet look-up
Hi, Need some information about the Solr 1.3 look up for synonyms in the WordNet dictionary during search and indexing other than the approach i.e SynonymFilterFactory. Do Solr have such feature or we have to write our own plug-in(analyzer) for the same. Thanks in advance Regards, Sagar Khetkade _ For the freshest Indian Jobs Visit MSN Jobs http://www.in.msn.com/jobs
RE: Core load: reading config file (no class defination found ) error
Thanks a lot. Its working now. -Sagar > Date: Wed, 24 Dec 2008 14:37:00 +0530> From: shalinman...@gmail.com> To: > solr-user@lucene.apache.org> Subject: Re: Core load: reading config file (no > class defination found ) error> > You need to add the lucene-highlighter jar. > If you download the Solr> distribution, you can find all the dependencies in > the lib folder.> > On Wed, Dec 24, 2008 at 1:49 PM, Sagar Khetkade> > wrote:> > >> > Hi,> > When loading the solr core > in an web application I am using> > EmbeddedSolrServer class.> > When loading > the core directly through CoreContainer Class's constructor> > > CoreContainer(String instanceDir, File configFile) it is giving me error of> > > "java.lang.NoClassDefFoundError: > org/apache/lucene/search/highlight/Scorer"> > while reading the schema file.> > > I have tried using SolrCore class to get the single core but same error is> > > there.> > Interestingly Lucene 2.4 what I am using with Solr 1.3 doesn't > have the> > Scorer class in package as the core api does not have any > highlight> > package.> >> > The solr config file does not have any of the > score related configuration> > done inside. Can anybody help me out in this > matter. (Think so a silly> > config error at my side, can't find it out :- ( > )> > Thanks in advance.> >> > Regards,> > Sagar> > > _> > Drag n' > drop—Get easy photo sharing with Windows Live™ Photos.> >> > > http://www.microsoft.com/windows/windowslive/photos.aspx> > > > > -- > > Regards,> Shalin Shekhar Mangar. _ Find a better job. We have plenty. Visit MSN Jobs http://www.in.msn.com/jobs
Core load: reading config file (no class defination found ) error
Hi, When loading the solr core in an web application I am using EmbeddedSolrServer class. When loading the core directly through CoreContainer Class’s constructor CoreContainer(String instanceDir, File configFile) it is giving me error of “java.lang.NoClassDefFoundError: org/apache/lucene/search/highlight/Scorer” while reading the schema file. I have tried using SolrCore class to get the single core but same error is there. Interestingly Lucene 2.4 what I am using with Solr 1.3 doesn’t have the Scorer class in package as the core api does not have any highlight package. The solr config file does not have any of the score related configuration done inside. Can anybody help me out in this matter. (Think so a silly config error at my side, can't find it out :- ( ) Thanks in advance. Regards, Sagar _ Drag n’ drop—Get easy photo sharing with Windows Live™ Photos. http://www.microsoft.com/windows/windowslive/photos.aspx
RE: Change in config file (synonym.txt) requires container restart?
But i am using CommonsHttpSolrServer for Solr server configuation as it is accepts the url. So here how can i reload the core. -Sagar> Date: Thu, 18 Dec 2008 07:55:02 -0500> From: markrmil...@gmail.com> To: solr-user@lucene.apache.org> Subject: Re: Change in config file (synonym.txt) requires container restart?> > Sagar Khetkade wrote:> > Hi,> > > > I am using SolrJ client to connect to the Solr 1.3 server and the whole POC (doing a feasibility study ) reside in Tomcat web server. If any change I am making in the synonym.txt file to add the synonym in the file to make it reflect I have to restart the tomcat server. The synonym filter factory that I am using are in both in analyzers for type index and query in schema.xml. Please tell me whether this approach is good or any other way to make the change reflect while searching without restarting of tomcat server.> > > > Thanks and Regards,> > Sagar Khetkade> > _> > Chose your Life Partner? Join MSN Matrimony FREE> > http://in.msn.com/matrimony> > > You can also reload the core.> > - Mark _ Chose your Life Partner? Join MSN Matrimony FREE http://in.msn.com/matrimony
Change in config file (synonym.txt) requires container restart?
Hi, I am using SolrJ client to connect to the Solr 1.3 server and the whole POC (doing a feasibility study ) reside in Tomcat web server. If any change I am making in the synonym.txt file to add the synonym in the file to make it reflect I have to restart the tomcat server. The synonym filter factory that I am using are in both in analyzers for type index and query in schema.xml. Please tell me whether this approach is good or any other way to make the change reflect while searching without restarting of tomcat server. Thanks and Regards, Sagar Khetkade _ Chose your Life Partner? Join MSN Matrimony FREE http://in.msn.com/matrimony
chaching and indexes in Solr
Hello, I have a hands on both Lucene and Solr. The difference betweenthese two search engines are explained to some extend, still havingsome query on these. I am in need to know 1. The difference between caching of Lucene and Solr index files. 2. As Solr is built on Lucene, is the index file of Solr similar to that of Lucene. 3. Is there any provision in Solr to index the complete repository/directory as that of Lucene. Thanks in advance. _ Tried the new MSN Messenger? It’s cool! Download now. http://messenger.msn.com/Download/Default.aspx?mkt=en-in
help on caching and index files of Solr
Hello, I have a hands on both Lucene and Solr. The difference between these two search engines are explained to some extend, still having some query on these. I am in need to know why 1. Want some information on the difference between caching of Lucene and Solr index files. 2. As Solr is built on Lucene, is the index file of Solr similar to that of Lucene. 3. Is there any provision in Solr to index the complete repository/directory as that of Lucene. Thanks in advance. _ Technology : Catch up on updates on the latest Gadgets, Reviews, Gaming and Tips to use technology etc. http://computing.in.msn.com/
