Re: Configuring Replication
Hi Ahmet Same issue, one more thing i am using solr 1.4.1 with tomcat 7.0 Regards Ahsan From: Ahmet Arslan To: solr-user@lucene.apache.org; Ahson Iqbal Sent: Tuesday, December 27, 2011 2:51 PM Subject: Re: Configuring Replication > Thank you for your response > both of the following urls > > http://localhost:8983 > http://localhost:8983/solr > > are working > and also it is not a multi core setup. What happens when you use class="solr.ReplicationHandler" instead of class="org.apache.solr.ReplicationHandler" in your solrconfig.xml?
Re: Configuring Replication
Hi Ahmet Thank you for your response both of the following urls http://localhost:8983 http://localhost:8983/solr are working and also it is not a multi core setup. Regards Ahsan From: Ahmet Arslan To: solr-user@lucene.apache.org; Ahson Iqbal Sent: Tuesday, December 27, 2011 12:44 PM Subject: Re: Configuring Replication > I just configured the master server as it is specified in > solr replication wiki page, nothing is indexed yet on master > neither on slave, > And in solr replication wiki page they have mentioned that > after configuring master server if you hit the following url > in web browser > > http://localhost:8983/solr/replication > [http://localhost:8983/solr is master server's url ] > > you should get response OK > > but unfortunately, i am getting 404 Error with following > message > > HTTP Status 404 - /solr/replication May be you have multi-core set-up? Then you should add the coreName to your URL e.g. http://localhost:8983/coreName/replication What happens when you hit the following ULRs? http://localhost:8983 http://localhost:8983/solr
Re: Configuring Replication
Hi Erick Thanks a lot for your valued response, I just configured the master server as it is specified in solr replication wiki page, nothing is indexed yet on master neither on slave, And in solr replication wiki page they have mentioned that after configuring master server if you hit the following url in web browser http://localhost:8983/solr/replication [http://localhost:8983/solr is master server's url ] you should get response OK but unfortunately, i am getting 404 Error with following message HTTP Status 404 - /solr/replication here are the configurations i have done on master server startup commit optimize schema.xml,stopwords.txt,elevate.xml 00:00:10 now I want to know is there something wrong with the configurations Regards Ahsan From: Erick Erickson To: solr-user@lucene.apache.org; Ahson Iqbal Sent: Friday, December 23, 2011 8:43 PM Subject: Re: Configuring Replication We need some more details. It might help to review: http://wiki.apache.org/solr/UsingMailingLists I don't even know how to go about trying. Are you clicking on the master? Slave? Have you indexed any docs on the master? Details matter. But to your second point, yes this is a common (and recommended) configuration. Index on the master and search on the slaves. Best Erick On Fri, Dec 23, 2011 at 6:56 AM, Ahson Iqbal wrote: > Hi > > I want to setup replication, and have 2 question regarding it > > 1st i am having issue in configuring replication, I have done all as > mentioned http://wiki.apache.org/solr/SolrReplication at master server but > whenever I tried to open the url in browser > > http://localhost:8983/solr/replication > > I got this error > > HTTP Status 404 - /solr/replicationbut in tutorial it is mentioned i should > get OK status. > > 2ndly i have a plan that all indexing will be on master server and all > searches will be on slave server, am I doing it right. > > please help > > Regards > Ahsan
Configuring Replication
Hi I want to setup replication, and have 2 question regarding it 1st i am having issue in configuring replication, I have done all as mentioned http://wiki.apache.org/solr/SolrReplication at master server but whenever I tried to open the url in browser http://localhost:8983/solr/replication I got this error HTTP Status 404 - /solr/replicationbut in tutorial it is mentioned i should get OK status. 2ndly i have a plan that all indexing will be on master server and all searches will be on slave server, am I doing it right. please help Regards Ahsan
Multivalued Boolean Search
Hi I have a multivalued field say "MulField" in my index that have values in a document like 1 Auto Mobiles Toyota Corolla No let say I specified a search criteria as +MulField:Mobiles +MulField:Toyota now my question is it is possible that this document should not appear in the search results. Regards Ahsan
Re: Problem while getting more than 100 records from solr 1.4.1
Hi Pravesh I tried searching on local host but still same error appears. Regards Ahsan From: Pravesh To: solr-user@lucene.apache.org Sent: Wednesday, October 12, 2011 5:17 PM Subject: Re: Problem while getting more than 100 records from solr 1.4.1 Not necessarily related to SOLR. Is "75" the only upper limit for rows upto which is works(or might vary like 70/71/.78 etc)??? Can you check at your infrastructure level, if there is any limit bounded by sys-admin/network-admin. Or check your tomcat configurations You can try the /wget /or /curl / locally from your solr server for search with page size >100, to check it it works. Regds Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-while-getting-more-than-100-records-from-solr-1-4-1-tp3415443p3415541.html Sent from the Solr - User mailing list archive at Nabble.com.
Problem while getting more than 100 records from solr 1.4.1
Hi All When i query solr with page size less than equal 75 it works fine but as my page size increases let say 100 the following exception is generated An existing connection was forcibly closed by the remote host. but nothing is logged in tomcat logs I googled this issue but did not found any help, can any body guide how can I resolve this particular issue Regartds Ahsan
Re: Lucene 3.4.0 Merging
Hi Steve Thanks a lot for all the help,before reading your last response, I have created a new java application in net beans and add both the jars as library to the newly created application, and in the main method I have called IndexMergeTool.main and pass all command line arguments to this method, and this work fine. But this process start optimizing index after merging and that is taking a long time, can u tell me how can i control this procedure by some parameter, Regards Ahsan From: Steven A Rowe To: "solr-user@lucene.apache.org" Sent: Sunday, October 2, 2011 6:49 AM Subject: RE: Lucene 3.4.0 Merging Ahsan, Maybe one or both of the Lucene jar files are not where your classpath says they are? Try copying them into the current directory, then adjusting the classpath entries, like so: java -cp lucene-core-3.4.0.jar;lucene-misc-3.4.0.jar org/apache/lucene/misc/IndexMergeTool ./newindex ./app1/solr/data/index ./app2/solr/data/index If that doesn't work, tell us about your environment: operating system, java version and vendor. Steve > -Original Message----- > From: Ahson Iqbal [mailto:mianah...@yahoo.com] > Sent: Sunday, October 02, 2011 9:30 AM > To: solr-user@lucene.apache.org > Subject: Re: Lucene 3.4.0 Merging > > Hi Steve > > Still same problem > > Regards > Ahsan > > - Original Message - > > From: Steven A Rowe > To: "solr-user@lucene.apache.org" > Cc: > Sent: Sunday, October 2, 2011 1:06 AM > Subject: RE: Lucene 3.4.0 Merging > > Ahsan, > > You have one other problem: on windows, you should use ";" instead of ":" > to separate the classpath entries - also, it's good to be in the habit of > enclosing windows paths in quotation marks, in case one of the sub- > directories has a space in its name: > > java -cp "d:/lucene/lucene-core-3.4.0.jar;./contrib/misc/lucene-misc- > 3.4.0.jar" org/apache/lucene/misc/IndexMergeTool ./newindex > ./app1/solr/data/index ./app2/solr/data/index > > Steve > > > -Original Message- > > From: Ahson Iqbal [mailto:mianah...@yahoo.com] > > Sent: Saturday, October 01, 2011 12:51 PM > > To: solr-user@lucene.apache.org > > Subject: Re: Lucene 3.4.0 Merging > > > > Hi Steve > > > > Thank you very much for your valued response but adding space as you > have > > mentioned does not solve the problem. > > > > Regards > > Ahsan > > > > > > From: Steven A Rowe > > To: "solr-user@lucene.apache.org" > > Sent: Friday, September 30, 2011 10:56 AM > > Subject: RE: Lucene 3.4.0 Merging > > > > Hi Ahson, > > > > The wiki page you got your cmdline invocation from > > <http://wiki.apache.org/solr/MergingSolrIndexes> was missing a space > > character between the classpath and > > "org/apache/lucene/misc/IndexMergeTool". I've just updated that page. > > > > Steve > > > > > -Original Message- > > > From: Ahson Iqbal [mailto:mianah...@yahoo.com] > > > Sent: Friday, September 30, 2011 2:45 AM > > > To: Solr Send Mail > > > Subject: Lucene 3.4.0 Merging > > > > > > Hi > > > > > > I have 3 solr3.4.0 indexes i want to merge them, after searching on > web > > i > > > found that there are two ways to do it as > > > > > > 1. Using Lucene Merge tool. > > > 2. Merging through core admin > > > > > > i am using the 1st method for this i have downloaded lucene 3.4.0 and > > > unpack it and then run following command on command prompt > > > > > > > > > java -cp d:/lucene/lucene-core-3.4.0.jar:./contrib/misc/lucene-misc- > > > 3.4.0.jarorg/apache/lucene/misc/IndexMergeTool ./newindex > > > ./app1/solr/data/index ./app2/solr/data/indexbut unfortunately it > gives > > > me following exception > > > > > > Exception in thread "Main Thread" java.lang.NoClassDefFoundError: > > > > > > org/apache/lucene/misc/IndexMergeTool > > > > > > > > > can any body guide me about this > > > > > > Regards > > > Ahsan
Re: Lucene 3.4.0 Merging
Hi Steve Still same problem Regards Ahsan - Original Message - From: Steven A Rowe To: "solr-user@lucene.apache.org" Cc: Sent: Sunday, October 2, 2011 1:06 AM Subject: RE: Lucene 3.4.0 Merging Ahsan, You have one other problem: on windows, you should use ";" instead of ":" to separate the classpath entries - also, it's good to be in the habit of enclosing windows paths in quotation marks, in case one of the sub-directories has a space in its name: java -cp "d:/lucene/lucene-core-3.4.0.jar;./contrib/misc/lucene-misc-3.4.0.jar" org/apache/lucene/misc/IndexMergeTool ./newindex ./app1/solr/data/index ./app2/solr/data/index Steve > -Original Message- > From: Ahson Iqbal [mailto:mianah...@yahoo.com] > Sent: Saturday, October 01, 2011 12:51 PM > To: solr-user@lucene.apache.org > Subject: Re: Lucene 3.4.0 Merging > > Hi Steve > > Thank you very much for your valued response but adding space as you have > mentioned does not solve the problem. > > Regards > Ahsan > > > From: Steven A Rowe > To: "solr-user@lucene.apache.org" > Sent: Friday, September 30, 2011 10:56 AM > Subject: RE: Lucene 3.4.0 Merging > > Hi Ahson, > > The wiki page you got your cmdline invocation from > <http://wiki.apache.org/solr/MergingSolrIndexes> was missing a space > character between the classpath and > "org/apache/lucene/misc/IndexMergeTool". I've just updated that page. > > Steve > > > -Original Message- > > From: Ahson Iqbal [mailto:mianah...@yahoo.com] > > Sent: Friday, September 30, 2011 2:45 AM > > To: Solr Send Mail > > Subject: Lucene 3.4.0 Merging > > > > Hi > > > > I have 3 solr3.4.0 indexes i want to merge them, after searching on web > i > > found that there are two ways to do it as > > > > 1. Using Lucene Merge tool. > > 2. Merging through core admin > > > > i am using the 1st method for this i have downloaded lucene 3.4.0 and > > unpack it and then run following command on command prompt > > > > > > java -cp d:/lucene/lucene-core-3.4.0.jar:./contrib/misc/lucene-misc- > > 3.4.0.jarorg/apache/lucene/misc/IndexMergeTool ./newindex > > ./app1/solr/data/index ./app2/solr/data/indexbut unfortunately it gives > > me following exception > > > > Exception in thread "Main Thread" java.lang.NoClassDefFoundError: > > > > org/apache/lucene/misc/IndexMergeTool > > > > > > can any body guide me about this > > > > Regards > > Ahsan
Re: Lucene 3.4.0 Merging
Hi Steve Thank you very much for your valued response but adding space as you have mentioned does not solve the problem. Regards Ahsan From: Steven A Rowe To: "solr-user@lucene.apache.org" Sent: Friday, September 30, 2011 10:56 AM Subject: RE: Lucene 3.4.0 Merging Hi Ahson, The wiki page you got your cmdline invocation from <http://wiki.apache.org/solr/MergingSolrIndexes> was missing a space character between the classpath and "org/apache/lucene/misc/IndexMergeTool". I've just updated that page. Steve > -Original Message- > From: Ahson Iqbal [mailto:mianah...@yahoo.com] > Sent: Friday, September 30, 2011 2:45 AM > To: Solr Send Mail > Subject: Lucene 3.4.0 Merging > > Hi > > I have 3 solr3.4.0 indexes i want to merge them, after searching on web i > found that there are two ways to do it as > > 1. Using Lucene Merge tool. > 2. Merging through core admin > > i am using the 1st method for this i have downloaded lucene 3.4.0 and > unpack it and then run following command on command prompt > > > java -cp d:/lucene/lucene-core-3.4.0.jar:./contrib/misc/lucene-misc- > 3.4.0.jarorg/apache/lucene/misc/IndexMergeTool ./newindex > ./app1/solr/data/index ./app2/solr/data/indexbut unfortunately it gives > me following exception > > Exception in thread "Main Thread" java.lang.NoClassDefFoundError: > > org/apache/lucene/misc/IndexMergeTool > > > can any body guide me about this > > Regards > Ahsan
Lucene 3.4.0 Merging
Hi I have 3 solr3.4.0 indexes i want to merge them, after searching on web i found that there are two ways to do it as 1. Using Lucene Merge tool. 2. Merging through core admin i am using the 1st method for this i have downloaded lucene 3.4.0 and unpack it and then run following command on command prompt java -cp d:/lucene/lucene-core-3.4.0.jar:./contrib/misc/lucene-misc-3.4.0.jarorg/apache/lucene/misc/IndexMergeTool ./newindex ./app1/solr/data/index ./app2/solr/data/indexbut unfortunately it gives me following exception Exception in thread "Main Thread" java.lang.NoClassDefFoundError: org/apache/lucene/misc/IndexMergeTool can any body guide me about this Regards Ahsan
Solr 3.4 Problem with integrating Query Parser Plug In
Hi I have indexed some 1M documents, just for performance testing. I have written a query parser plug, when i add it in solr lib folder under tomcat wepapps folder. and try to load solr admin page it keeps on loading and when I delete jar file of query parser plugin from lib it works fine. but jar file works good with solr 3.3 and also with solr 1.4. please help. Regards Ahsan
How To perform SQL Like Join
Hi As we do join two or more tables in sql, can we join 2 or more indexes in solr as well. if yes than in which version. Regards Ahsan
Re: question about Field Collapsing/ grouping
Hi Jayendra Thanks a lot for your response, now i have two questions one that to get the count of groups is it must to apply the specified patch, if so can you help me a little how i can apply that patch in steps as i am new to solr/java. Regards Ahsan - Original Message - From: Jayendra Patil To: solr-user@lucene.apache.org; Ahson Iqbal Cc: Sent: Tuesday, September 13, 2011 10:55 AM Subject: Re: question about Field Collapsing/ grouping The time we implemented the feature, there was no straight forward solution. What we did is to facet on the grouped by field and counting the facets. This would give you the distinct count for the groups. You may also want to check the Patch @ https://issues.apache.org/jira/browse/SOLR-2242, which will return the facet counts and you need to count it by yourself. Regards, Jayendra On Tue, Sep 13, 2011 at 1:27 AM, Ahson Iqbal wrote: > Hi > > Is it possible to get number of groups that matched with specified query. > > like let say there are three fields in index > > DocumentID > Content > Industry > > > and now i want to query as +(Content:is Content:the) > group=true&group.field=industry > > now is it possible to get how many industries matched with specified query. > > Please help. > > Regards > Ahsan >
question about Field Collapsing/ grouping
Hi Is it possible to get number of groups that matched with specified query. like let say there are three fields in index DocumentID Content Industry and now i want to query as +(Content:is Content:the) group=true&group.field=industry now is it possible to get how many industries matched with specified query. Please help. Regards Ahsan
Question About Writing Custom Query Parser Plugin
Hi All I want to integrate lucene Surround Query Parser with solr 1.4.1, and for that I am writing Custom Query Parser Plugin, To accomplish this task I should write a sub class of "org.apache.solr.search.QParserPlugin" and implement its two methods public void init(NamedList nl) public QParser createParser(String string, SolrParams sp, SolrParams sp1, SolrQueryRequest sqr) now here createParser should return an object of a subclass of "org.apache.solr.search.QParser", but I need a parser of type "org.apache.lucene.queryParser.surround.parser.QueryParser" which is not a subclass of "org.apache.solr.search.QParser" Now my question is should I write a sub class of "org.apache.solr.search.QParser" and internally create an object of "org.apache.lucene.queryParser.surround.parser.QueryParser" and call its parse method? if so how the mapping "org.apache.lucene.queryParser.surround.query.SrndQuery" (that is returned "org.apache.lucene.queryParser.surround.parser.QueryParser" ) would be done with "org.apache.lucene.search.Query" (that should be returned from parse method of a query parser of type "org.apache.solr.search.QParser") Thanx Ahsan
Integrating Surround Query Parser
Hi All I want to integrate Surround Query Parser with solr, To do this i have downloaded jar file from the internet and and then pasting that jar file in web-inf/lib and configured query parser in solrconfig.xml as now when i load solr admin page following exception comes org.apache.solr.common.SolrException: Error Instantiating QParserPlugin, org.apache.lucene.queryParser.surround.parser.QueryParser is not a org.apache.solr.search.QParserPlugin what i think that i didnt get the right plugin, can any body guide me from where to get right plugin for surround query parser or how to accurately integrate this plugin with solr. thanx Ahsan
Re: Not storing, but highlighting from document sentences
Hi A simple solution to this could be, for all such searches (foo and bar), search them as it is from 1st(primary index) and while sending these queries to secondary index replace and with or. But in this particular scenario u could also have problem with proximity and phrase queries that is much difficult to tackle. Regards Ahsan From: Otis Gospodnetic To: solr-user@lucene.apache.org Sent: Tue, January 18, 2011 12:25:12 PM Subject: Re: Not storing, but highlighting from document sentences Hi Tarjei, :) Yeah, that is the solution we are going with, actually. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Tarjei Huse > To: solr-user@lucene.apache.org > Sent: Tue, January 18, 2011 1:33:44 AM > Subject: Re: Not storing, but highlighting from document sentences > > On 01/12/2011 12:02 PM, Otis Gospodnetic wrote: > > Hello, > > > > I'm indexing some content (articles) whose text I cannot store in its >original > > > form for copyright reason. So I can index the content, but cannot store >it. > > > However, I need snippets and search term highlighting. > > > > > > Any way to accomplish this elegantly? Or even not so elegantly? > > > > Here is one idea: > > > > * Create 2 indices: main index for indexing (but not storing) the original > > content, the secondary index for storing individual sentences from the >original > > > article. > How about storing the sentences in the same index in a separate field > but with random ordering, would that be ok? > > Tarjei > > * That is, before indexing an article, split it into sentences. Then > > index >the > > > article in the main index, and index+store each sentence in the secondary > > index. So for each doc in the main index there will be multiple docs in > > the > > > > secondary index with individual sentences. Each sentence doc includes an >ID of > > > the "parent" document. > > > > * Then run queries against the main index, and pull individual sentences >from > > > the secondary index for snippet+highlight purposes. > > > > > > The problem I see with this approach (and there may be other ones that I > > am >not > > > seeing yet) is with queries like foo AND bar. In this case "foo" may be a >match > > > from sentence #1, and "bar" may be a match from sentence #7. Or maybe >"foo" is > > > a match in sentence #1, and "bar" is a match in multiple sentences: #7 and >#10 > > > and #23. > > > > Regardless, when a query is run against the main index, you don't know > > where > >the > > > match was, so you don't know which sentences to go get from the secondary >index. > > > > Does anyone have any suggestions for how to handle this? > > > > Thanks, > > Otis > > > > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch > > Lucene ecosystem search :: http://search-lucene.com/ > > > > > -- > Regards / Med vennlig hilsen > Tarjei Huse > Mobil: 920 63 413 > >
Question related to phrase search in lucene/solr?
hi all I have question is it possible to perform a phrase search with wild cards in solr/lucene as if i have two queries both have exactly same results one is +Contents:"change market" and other is +Contents:"chnage* market" but i think the second should match "chages market" as well but it does not matches it. Any help would be appreciated Regards Ahsan
How to get Term Frequency
hi All I have a question that how could somebody get term frequency as we do get in lucene by the following method DocFreq(new Term("Field", "value")); using solr/solrnet.
Trouble with exception Document [Null] missing required field DocID
Hi All I m new to solr extract request handler, i want to index pdf documents but when i submit document to solr using curl i got following exception Document [Null] missing required field DocID my curl command is like curl "http://localhost:8983/solr1/update/extract?literal.DocID=123&fmap.content=Contents&commit=true"; -F "myfi...@d:/solr/apache-solr-1.4.0/docs/filename1.pdf" and here is my schema DocID please help me if i m missing something Regards Ahsan
Configuriguration of ExtractRequestHandler
Hi All I want to index a large number of pdf documents i have found a reference by searching on Google that it could be done by apache tika project, but unfortunately i didn't find any refernce stating how to configure apache tika with solr. Can any body state how I could do this i have downloaded apache tika 0.7 and have setup solr 1.4.1. Regards Ahsan
Question Related to sorting on Date
hi all I have a question related to sorting of date field i have Date field that is indexed like a string and look like "5/2/2008 4:33:30 PM" i want to do sorting on this field on the basis of date, time does not matters. any suggestion how i could ignore the time part from this field and just sort on the date?
Re: Solr Highlighting Issue
Hi Koji thank you very much it really works From: Koji Sekiguchi To: solr-user@lucene.apache.org Sent: Fri, September 17, 2010 7:11:31 PM Subject: Re: Solr Highlighting Issue (10/09/17 16:36), Ahson Iqbal wrote: > Hi All > > I have an issue in highlighting that if i query solr on more than one fields > like "+Contents:risk +Form:1" and even i specify the highlighting field is > "Contents" it still highlights risk as well as 1, because it is specified in >the > query.. now if i split the query as "+Contents:risk" is given as main query and > "+Form:1" as filter query and specify "Contents" as highlighting field, it >works > fine, can any body tell me the reason. > > > Regards > Ahsan > Hi Ahsan, Use hl.requireFieldMatch=true http://wiki.apache.org/solr/HighlightingParameters#hl.requireFieldMatch Koji -- http://www.rondhuit.com/en/
Solr Highlighting Issue
Hi All I have an issue in highlighting that if i query solr on more than one fields like "+Contents:risk +Form:1" and even i specify the highlighting field is "Contents" it still highlights risk as well as 1, because it is specified in the query.. now if i split the query as "+Contents:risk" is given as main query and "+Form:1" as filter query and specify "Contents" as highlighting field, it works fine, can any body tell me the reason. Regards Ahsan