Re: How to avoid hardcoding masterUrl in slave solrconfig.xml?

2009-11-30 Thread Noble Paul നോബിള്‍ नोब्ळ्
remove the section from your solrconfig. It should be fine On Tue, Dec 1, 2009 at 6:59 AM, William Pierce wrote: > Hi, Joe: > > I tried with the "fetchIndex" all lower-cased, and still the same result. > What do you specify for masterUrl in the solrconfig.xml on the slave?   it > seems to me tha

Re: HTML Stripping slower in Solr 1.4?

2009-11-30 Thread Koji Sekiguchi
Robin, Thank you for reporting this. Performance degradation of HTML Stripper could be in 1.4. I opened a ticket in Lucene: https://issues.apache.org/jira/browse/LUCENE-2098 Koji -- http://www.rondhuit.com/en/

Re: Phrase Query Issue

2009-11-30 Thread ravicv
Thanks Erick But their any way to get phrase search and normal search together. for Example if I search for "test" it should only give test result but not tests.. And if we search for tests it should give all results matching with tests(this should include stemmer results also) Please clarify me

HTML Stripping slower in Solr 1.4?

2009-11-30 Thread Robin Wojciki
Hello, Our schema in Sol 1.3 looked like: It takes 30s to index 1500 docs. When we run the same in Sol 1.4 it take 70s. I noticed that HTMLStripStandardTokenizerFactory was deprecated. So changed the schema to: It still takes 70s. Instead, if I use the schema: It takes 30s in both 1.3

Re: *:* Returning no results

2009-11-30 Thread Erik Hatcher
Are you sure you're hitting the same core? Did a commit? Are you possibly using the dismax query parser (where *:* is fairly meaningless)? Erik On Nov 30, 2009, at 3:54 PM, Giovanni Fernandez-Kincade wrote: Hi, I created a brand new core (on Solr 1.4), added a few documents and

Re: nested solr queries

2009-11-30 Thread Chris Hostetter
: thanks for your help so do you think I should execute solr queries twice ? : or is there any other workarounds http://people.apache.org/~hossman/#xyproblem XY Problem Your question appears to be an "XY Problem" ... that is: you are dealing with "X", you are assuming "Y" will help you, and you

Re: Sorting Facets by First Occurrence

2009-11-30 Thread Cory G Watson
On Nov 30, 2009, at 5:15 PM, Chris Hostetter wrote: > All of Solr's existing faceting code is based on the DocSet which is an > unordered set of all matching documents -- i suspect your existing > application only reordered the facets based on their appearance in the > first N docs (possibly ju

Re: How to avoid hardcoding masterUrl in slave solrconfig.xml?

2009-11-30 Thread William Pierce
Hi, Joe: I tried with the "fetchIndex" all lower-cased, and still the same result. What do you specify for masterUrl in the solrconfig.xml on the slave? it seems to me that if I remove the element, I get the exception I wrote about. If I set it to some dummy url, then I get an invalid ur

RE: How to avoid hardcoding masterUrl in slave solrconfig.xml?

2009-11-30 Thread Joe Kessel
I do something very similar and it works for me. I noticed on your URL that you have a mixed case fetchIndex, which the request handler is checking for fetchindex, all lowercase. If it is not that simple I can try to see the exact url my code is generating. Hope it helps, Joe > From: e

Re: Sorting Facets by First Occurrence

2009-11-30 Thread Chris Hostetter
: I'm working on replacing a custom, internal search implementation with : Solr. I'm having great success, with one small exception. ... : For example, if a search yielded 10 results, 1 - 10, and hit 1 is in : category 'Toys', hit 2 through 9 are in 'Sports' and the last is in : 'Househol

RE: schema-based Index-time field boosting

2009-11-30 Thread Chris Hostetter
: I am talking about field boosting rather than document boosting, ie. I : would like some fields (say eg. title) to be "louder" than others, : across ALL documents. I believe you are at least partially talking : about document boosting, which clearly applies on a per-document basis. index time

Re: schema-based Index-time field boosting

2009-11-30 Thread Chris Hostetter
: Coming in a bit late but I would like a variant that is not a No-OP. : Think of something like title:searchstring^10 OR catch_all:searchstring : Of course I can always add the boosting at query time but it would make : life easier if I could define a default boost in the schema so that my : quer

Re: $DeleteDocbyQuery in solr 1.4 is not working

2009-11-30 Thread cpmoser
Ok, I think I figured out what might be happening. It appears that the DataImporter issues the commit command without the expungeDeletes option set to true (default in 1.4 for a commit command is for expungeDeletes to be set to false). You can get around this by issuing the commit command manual

Re: How to avoid hardcoding masterUrl in slave solrconfig.xml?

2009-11-30 Thread William Pierce
Folks: Sorry for this repost! It looks like this email went out twice Thanks, - Bill -- From: "William Pierce" Sent: Monday, November 30, 2009 1:47 PM To: Subject: How to avoid hardcoding masterUrl in slave solrconfig.xml? Folks: I do n

How to avoid hardcoding masterUrl in slave solrconfig.xml?

2009-11-30 Thread William Pierce
Folks: I do not want to hardcode the masterUrl in the solrconfig.xml of my slave. If the masterUrl tag is missing from the config file, I am getting an exception in solr saying that the masterUrl is required. So I set it to some dummy value, comment out the poll interval element, and issue

Sorting Facets by First Occurrence

2009-11-30 Thread Cory Watson
I'm working on replacing a custom, internal search implementation with Solr. I'm having great success, with one small exception. When implementing our version of faceting, one of our facets had a peculiar sort order. It was dictated by the order in which the field occurred in the results. The f

Thought that masterUrl in slave solrconfig.xml is optional...

2009-11-30 Thread William Pierce
Folks: Reading the wiki, I saw the following statement: "Force a fetchindex on slave from master command : http://slave_host:port/solr/replication?command=fetchindex It is possible to pass on extra attribute 'masterUrl' or other attributes like 'compression' (or any other parameter which

RE: *:* Returning no results

2009-11-30 Thread Giovanni Fernandez-Kincade
Hmm. When I include debugQuery=on I get two results (which is accurate): Otherwise I get Why would you get different results with debugging on? Does anything look peculiar here? *:* *:* MatchAllDocsQuery(*:*) *:* 1.0 = (MATCH) MatchAllDocsQuery, product of: 1.0 = queryNorm

Re: *:* Returning no results

2009-11-30 Thread Smiley, David W.
Add debugQuery=on to give you clues. ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterprise-search-server/ On Nov 30, 2009, at 3:54 PM, Giovanni Fernandez-Kincade wrote: > Hi, > I created a brand new core (on Solr 1.4), added a few documents and then > searched for *:*, but got no

*:* Returning no results

2009-11-30 Thread Giovanni Fernandez-Kincade
Hi, I created a brand new core (on Solr 1.4), added a few documents and then searched for *:*, but got no results. Strangely enough, if I search for a specific document I know is in the index, like say "versionId:3", I get the expected result. Any ideas on why that might be? Thank, Gio.

Online article: Text Search, your Database or Solr

2009-11-30 Thread Smiley, David W.
Hey folks. I wrote a piece comparing Solr and database based text search. It's obviously pro-Solr ;-) Of course if you're reading this then you're already drinking the cool-aid, so to speak, but you may find this article interesting. http://www.packtpub.com/article/text-search-your-database-

Re: Fulltext crawler

2009-11-30 Thread Smiley, David W.
Start reading midway page 224. Additionally, you might want to get the online supplement available at packtpub.com. FYI my co-author Eric Pugh wrote the last 3 chapters which includes this. ~ David On Nov 30, 2009, at 1:37 PM, Jörg Agatz wrote: > book? i order "Solr 1.4" today, i see some exa

Re: Fulltext crawler

2009-11-30 Thread Jörg Agatz
book? i order "Solr 1.4" today, i see some examples in this book?

Re: Multi-Term Synonyms

2009-11-30 Thread brad anderson
Thanks a lot Patrick. I think your solution may work for my needs as well. -Brad 2009/11/26 Patrick Jungermann > Hi Brad, > > I was trying this, too, and there is a possibility how to get multi-term > synonyms to work properly. I wrote my solution already on this list. > > My solution was as fo

RE: SolrPlugin Guidance

2009-11-30 Thread Vauthrin, Laurent
Thanks for the response but I'm still confused. I don't see how a QParser will create multiple queries that need to be sent to shards sequentially. Here's a more detailed example of what we're doing: We're indexing documents in Solr that are somewhat equivalent to files. We want users to be a

Re: Fulltext crawler

2009-11-30 Thread Smiley, David W.
And of course Heritrix http://crawler.archive.org/ I think this one's quite cool. You'll see example usage in my book. ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterprise-search-server/ On Nov 26, 2009, at 5:01 AM, Shalin Shekhar Mangar wrote: > On Thu, Nov 26, 2009 at 1:54 PM,

Solr and Geoserver/Mapserver

2009-11-30 Thread gwk
Hello, While my current implementation of searching on a map works, rendering hundreds of markers in an embedded Google map tends to slow browsers on slower computers (or fast computers running internet explorer :\) down to a crawl. I'm looking into generating tiles with the markers rendered

Re: search on tomcat server

2009-11-30 Thread Shalin Shekhar Mangar
On Mon, Nov 30, 2009 at 9:55 PM, Jill Han wrote: > I got solr running on the tomcat server, > http://localhost:8080/solr/admin/ > > After I enter a search word, such as, solr, then hit Search button, it > will go to > > http://localhost:8080/solr/select/?q=solr&version=2.2&start=0&rows=10&in > de

search on tomcat server

2009-11-30 Thread Jill Han
I got solr running on the tomcat server, http://localhost:8080/solr/admin/ After I enter a search word, such as, solr, then hit Search button, it will go to http://localhost:8080/solr/select/?q=solr&version=2.2&start=0&rows=10&in dent=on and display -

Re: Status of Spelt integration

2009-11-30 Thread Toby Cole
Hi Andrew, We ended up abandoning the spelt integration as the built in solr spellchecking improved so much during our project. Also, if you did go the route of using spelt, I'd implement it as a spellcheck plugin (which didn't exist as a concept when we started trying to shoehorn spelt i

Solr plugin or something else for custom work?

2009-11-30 Thread javaxmlsoapdev
I have a requirement where I am indexing attachements. Attachements hang off of a database entity(table). I also need to include some meta-data info from the database table as part of the index. Trying to find best way to implement using custom handler or something? where custom handler gets all r

Re: Word Concat 0 Results

2009-11-30 Thread AHMET ARSLAN
> I have a quick question for anyone with an idea how to > solve this.  We have > times when our users don¹t put spaces between words.  > So for instance > ³airmax² returns 0 results but ³air max² has at least > 100 results.  Other > than adding to the synonyms file every time, is there a > more pr

RE: Child entity not getting index using DIH

2009-11-30 Thread Gupta, Saurabh
Shalin, Thanks for your suggestion. A few questions though: 1. Are Mutli-valued fields essential to denormalizing the database in indexes? 2. What is the role of tag in data-config xml file? 3. How does SolrJ or any other framework convert the returned results back into an object model? Thanks

Re: Batch file upload using solrJ API

2009-11-30 Thread javaxmlsoapdev
Any suggestion/pointers on this? javaxmlsoapdev wrote: > > Is there an API to upload files over one connection versus looping through > all the files and creating new ContentStreamUpdateRequest for each file. > This, as expected, doesn't work if there are large number of files and > quickly run

Re: Where to put ExternalRequestHandler and Tika jars

2009-11-30 Thread javaxmlsoapdev
Yes. code I posted in first thread does work. And I am able to retrieve data from the document index. did you include all required jars in deployed solr application's lib folder? what errors are you seeing? Juan Pedro Danculovic wrote: > > HI! does your example finally works? I index the data wi

Re: Maximum number of fields allowed in a Solr document

2009-11-30 Thread Alex Wang
Thanks Otis for the reply. Yes this will be pretty memory intensive. The size of the index is 5 cores with a maximum of 500K documents each core. I did search the archives before but did not find any definite answer. Thanks again! Alex On Nov 27, 2009, at 11:09 PM, Otis Gospodnetic wrote:

Word Concat 0 Results

2009-11-30 Thread Jeff Newburn
All, I have a quick question for anyone with an idea how to solve this. We have times when our users don¹t put spaces between words. So for instance ³airmax² returns 0 results but ³air max² has at least 100 results. Other than adding to the synonyms file every time, is there a more programmatic

Re: Phrase Query Issue

2009-11-30 Thread Erick Erickson
You didn't say what field you're searching on, but if it's any field with one of the stemmers involved, then this is expected behavior. That is, "test" and "tests" are both stemmed to "test". I do see SnowballPorterFilterFactory in your schema, so this is what I'd check first Think carefully a

RE: configure solr

2009-11-30 Thread Jill Han
I got it running. -Dsolr.solr.home=c:\web\solr is needed. Thanks all for the help, Jill -Original Message- From: dipti khullar [mailto:dipti.khul...@gmail.com] Sent: Thursday, November 26, 2009 11:01 AM To: solr-user@lucene.apache.org Subject: Re: configure solr X-HOSTLOC: alverno.edu/1

Re: Trouble Configuring WordDelimiterFilterFactory

2009-11-30 Thread Erick Erickson
I think the problem here is that underlying WordDelimiterFactory is StandardTokenizer, at least that's what I infer from here: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.WordDelimiterFilterFactory

Question regarding scoring/boosting

2009-11-30 Thread Oliver Beattie
Hey everyone, I'm what one would probably call a beginner with Solr. I have my data loaded in and I am getting the hang of querying things. However, I'm still rather unclear as to how the score can be affected by various parameters. I'm using the dismax request handler, and I just don't quite get

RE: nested solr queries

2009-11-30 Thread Smiley, David W.
Shameless plug here if you're having trouble grasping the schema and differences from relational databases then I think you'll find my book helpful (chapter 2). https://www.packtpub.com/solr-1-4-enterprise-search-server/book ~ David Smiley From: Mark

Status of Spelt integration

2009-11-30 Thread Andrey Klochkov
Hi all I searched through the mail-list archives and saw that sometime ago Toby Cole was going to integrate a spellchecker named Spelt into Solr. Does anyone now what's the status of this? Anyone tried to use it with Solr? Does it make sense to try it instead of standard spell checker? Some links

Re: Phrase Query Issue

2009-11-30 Thread ravicv
Hi I have a problem with phrase search. If I search test then tests is also coming in search result. Please help me ... My schema continues... " < type="index"> < a nalyzer type="query">

Re: nested solr queries

2009-11-30 Thread Shalin Shekhar Mangar
I don't know the use-case so I cannot suggest anything. Solr is different from relational databases and techniques which are taken for granted in the RDBMS world are usually not required or have bad performance characteristics. You shouldn't try to solve problems the same way in solr and databases.

Re: nested solr queries

2009-11-30 Thread Mark N
thanks for your help so do you think I should execute solr queries twice ? or is there any other workarounds On Mon, Nov 30, 2009 at 3:07 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Mon, Nov 30, 2009 at 2:26 PM, Mark N wrote: > > > field2="xyz" we dont know until we run qu

Re: nested solr queries

2009-11-30 Thread Shalin Shekhar Mangar
On Mon, Nov 30, 2009 at 2:26 PM, Mark N wrote: > field2="xyz" we dont know until we run query1 > > Ah, ok. I thought xyz was a literal that you wanted to search. > To simply i was actually trying to do some kind of JOIN similar to > following > SQL query > > > select * from table1 where *fi

Re: nested solr queries

2009-11-30 Thread Mark N
field2="xyz" we dont know until we run query1 To simply i was actually trying to do some kind of JOIN similar to following SQL query select * from table1 where *field2* in ( select *field2 *from dbo.concept_db where field1='ABC' ) if this is not possible then i will have to search inner

Re: nested solr queries

2009-11-30 Thread Shalin Shekhar Mangar
On Mon, Nov 30, 2009 at 2:02 PM, Mark N wrote: > hi shalin > > I am trying to achieve something like JOIN. Previously am doing this with > two queries on solr > > solr index = ( field1 ,field 2, field3) > > query1 = ( for example field1="ABC" ) > > suppose query1 returns results set1= { 1, 2 ,

Re: Intensive querying give odd results in search

2009-11-30 Thread Shalin Shekhar Mangar
On Thu, Nov 26, 2009 at 9:14 PM, jmsm wrote: > > Hi, All. > > I have a problem regarding intensive query requesting. > I'm using SolrJ client through http in the client side and Solr 1.4 and > tomcat 6.0.20 on the server side. > > My purpose is to execute 3 different queries for each word in a li

Re: nested solr queries

2009-11-30 Thread Mark N
hi shalin I am trying to achieve something like JOIN. Previously am doing this with two queries on solr solr index = ( field1 ,field 2, field3) query1 = ( for example field1="ABC" ) suppose query1 returns results set1= { 1, 2 ,3 ,4 } which matches query1 query2 = ( get all records having

Re: Wildcard searches within phrases to use proximity

2009-11-30 Thread Shalin Shekhar Mangar
On Fri, Nov 27, 2009 at 12:33 AM, AHMET ARSLAN wrote: > > That'd be great. Please open an issue in Jira and attach a > > patch. See > > http://wiki.apache.org/solr/HowToContribute > > > > Hi Shalin, > I opened an issue (SOLR-1604) and attached a patch as well as a maven > project to enable this f

Re: Multi index

2009-11-30 Thread Shalin Shekhar Mangar
On Sat, Nov 28, 2009 at 3:12 PM, Jörg Agatz wrote: > Hallo Users... > > At the Moment i test MultiCorae Solr, but i cant search in more than one > core direktly.. > > Exist a way to use multiindex, 3-5 Indizes in one core ans search direkty > in > all? ore only in one? > > > You can search on all

Re: nested solr queries

2009-11-30 Thread Shalin Shekhar Mangar
On Mon, Nov 30, 2009 at 1:19 PM, Mark N wrote: > Is it possible to write nested queries in Solr similar to sql like query > where I can take results of the first query and use one or more of its > fields as an argument in the second query. > > That sounds like a join. If so, the answer would be