Tagging Facet Queries -- Urgent Help Required

2010-05-28 Thread Ninad Raut
Hi All, I have a use case where I have to tag facet queries. Here is the code snippet for what I tried: query.addFilterQuery({!tag=NE}med:Blog AND slev:neutral); query.addFacetQuery({!tag=NE key=BLOG}med:Blog AND slev:neutral); query.addFilterQuery({!tag=P}med:Review AND slev:neutral);

Logs for Java Replication in Solr

2010-05-28 Thread Peter Karich
Hi, where can I find more information about a failure of a Java replication in Solr 1.4? (Dashboard does not seem to be the best place!?) Regards, Peter.

Applying collapse patch

2010-05-28 Thread Sophie M.
Hello ! I am trying to apply the solr-236 patch to the sources I got from svn. I downloaded the sources from path-to-repository/tags/release-1.4.0 I tried to apply this patch https://issues.apache.org/jira/secure/attachment/12444611/SOLR-236-trunk.patch and this one :

Re: Tagging Facet Queries -- Urgent Help Required

2010-05-28 Thread Erik Hatcher
You've tagged facet queries, but looks like you might want to use the exclude capability on your filter queries also. Filter queries are additive, constraining the results further for each one, and by default faceting is based off the search results. Use excl to have facets count outside

Solr spellchecker field

2010-05-28 Thread Dejan Noveski
Hi, Does the field that is used for spellchecker indexing need to be stored and/or indexed? These fields became fairly large in my index, and php wont parse/decode the documents returned. -- -- Dejan Noveski Web Developer dr.m...@gmail.com Twitter: http://twitter.com/dekomote | LinkedIn:

Re: Solr spellchecker field

2010-05-28 Thread Erik Hatcher
A field used to build a spellcheck index only needs to be indexed, not stored. But, your PHP issue could be alleviated anyway by simply customizing the fl parameter and excluding the large stored field. This is often desirable for large fields that are never needed fully in the UI, but

Re: Solr spellchecker field

2010-05-28 Thread Dejan Noveski
Thank you very much! On Fri, May 28, 2010 at 10:57 AM, Erik Hatcher erik.hatc...@gmail.comwrote: A field used to build a spellcheck index only needs to be indexed, not stored. But, your PHP issue could be alleviated anyway by simply customizing the fl parameter and excluding the large

Re: Applying collapse patch

2010-05-28 Thread Peter Karich
I had success with a previous version (~ 12/2009). Try to ask directly in the comments of the patch. I got immediately help there. Regards, Peter. Hello ! I am trying to apply the solr-236 patch to the sources I got from svn. I downloaded the sources from

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Erik Hatcher
Here's a slider example that narrows down how many tags/facets are displayed: http://www.nines.org/tags How about a tree map? See my slides from the prototyping preso at EuroCon last week: http://lucene-eurocon.org/sessions-track2-day2.html#4 Pie in the sky, how about pie charts? I

Re: Applying collapse patch

2010-05-28 Thread Sophie M.
Ok I will have a look on the comments and I will post if necessary. Thanks ^^ -- View this message in context: http://lucene.472066.n3.nabble.com/Applying-collapse-patch-tp851121p851170.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Tagging Facet Queries -- Urgent Help Required

2010-05-28 Thread Ninad Raut
Thanks Erick, On Fri, May 28, 2010 at 2:17 PM, Erik Hatcher erik.hatc...@gmail.comwrote: You've tagged facet queries, but looks like you might want to use the exclude capability on your filter queries also. Filter queries are additive, constraining the results further for each one, and by

SolrException: No such core

2010-05-28 Thread jfmnews
With embedded solr (1.3.0) sometime a SolrException happens. I don't understand why : I have not been able to find a scenario. org.apache.solr.common.SolrException: No such core: core0 at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:112) at

Re: Applying collapse patch

2010-05-28 Thread Martijn v Groningen
The trunk should work with the latest patch (SOLR-236-trunk.patch). Did patching go successful? What compilation errors you get? On 28 May 2010 11:10, Sophie M. sop...@beezik.com wrote: Ok I will have a look on the comments and I will post if necessary. Thanks ^^ -- View this message in

Re: Applying collapse patch

2010-05-28 Thread Sophie M.
Hi, I am getting the trunk, I try to apply the patch, to compile and I tell you what I get. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Applying-collapse-patch-tp851121p851222.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Applying collapse patch

2010-05-28 Thread Sophie M.
It is ok for applying the patch, thanks Martin. When I start Solr I get this logs in my console : C:\Users\Sophie\workspace\lucene-solr\lucene-solr\solr\solrjava -jar start.jar 2010-05-28 12:09:30.037:INFO::Logging to STDERR via org.mortbay.log.StdErrLog 2010-05-28

Re: Applying collapse patch

2010-05-28 Thread Martijn v Groningen
Have you executed: ant example after building? (Assuming that this is the example solr) On 28 May 2010 12:17, Sophie M. sop...@beezik.com wrote: It is ok for applying the patch, thanks Martin. When I start Solr I get this logs in my console :

AW: XSLT for JSON

2010-05-28 Thread Markus.Rietzler
ok,but is there an easy way to influence the format of json output? eg field order, names etc. maybe i want to group the result differently or add some infos -Ursprüngliche Nachricht- Von: Jon Baer [mailto:jonb...@gmail.com] Gesendet: Mittwoch, 26. Mai 2010 19:39 An:

Re: Applying collapse patch

2010-05-28 Thread Sophie M.
I don't know how, but it works now. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Applying-collapse-patch-tp851121p851502.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: highlighting broken for multivalued text fields?

2010-05-28 Thread Darren Govoni
Ah, ok. Well, the fieldType was text, untouched from the Solr default. hth, Darren On Thu, 2010-05-27 at 22:06 -0700, Chris Hostetter wrote: : Hi Koji, :Well, its quite simple. Here is the field returned from my query: : fox Actually what Koji was asking for was the fieldtype/

Re: Solr spellchecker field

2010-05-28 Thread Israel Ekpo
Dejan, How are you making the calls from PHP to Solr? I am curious to know why the documents could not be parsed On Fri, May 28, 2010 at 5:00 AM, Dejan Noveski dr.m...@gmail.com wrote: Thank you very much! On Fri, May 28, 2010 at 10:57 AM, Erik Hatcher erik.hatc...@gmail.com wrote: A

Custom sorting

2010-05-28 Thread Fornoville, Tom
Hello everyone, I'm new to Solr but have been asked to do an evaluation as an alternative for a commercial search engine. I have some experience with Lucene and a java background so I'm not afraid to dive into code :-) The application now has a very particular way of sorting results using

Sort by function workaround for Solr 1.4

2010-05-28 Thread Martynas Miliauskas
Hi, I need to sort query results by the output of some function which takes score and couple other fields as an input (50% of the total score comes from similarity score and 50% comes from document's popularity). Is there a workaround which does not involve installation of any patches. I have

strange results with query and hyphened words

2010-05-28 Thread Markus.Rietzler
i am wondering why a search term with hyphen doesn't match. my search term is prof-auskunft. in WordDelimiterFilterFactory i have catenateWords, so my understanding is that profi-auskunft would search for profiauskunft. when i use the analyse panel in solr admi i see that profi-auskunft matches a

Interleaving the results

2010-05-28 Thread NarasimhaRaju
Hi, how to achieve custom ordering of the documents when there is a general query? Usecase: Interleave documents from different customers one after the other. Example: Say i have 10 documents in the index belonging to 3 customers (customer_id field in the index ) and using query *:* so all the

Prefix-Search with Stopwords - no results?

2010-05-28 Thread Gert Brinkmann
Hello, I am having some problems with solr 1.4. I am indexing and querying data using the following fieldType: fieldType name=text_de_de class=solr.TextField positionIncrementGap=100 analyzer type=index tokenizer class=solr.WhitespaceTokenizerFactory/ filter

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Mark Bennett
Thanks Geert, Trip Advisor was interesting, I also see another sliders site was sent around. But I don't think all their Facets are binding. For example, to test no-results, I set it to 4 start hotels in SF with a max of $50 / night - obviously not reasonable. But it showed some hotels. At

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Mark Bennett
Hi Lukas, Displaying 2 numbers is an interesting variant. Not for a casual consumer site, but actually pretty cool for a site appealing to engineers. On the formatting front though, the (nn/mm) is a bit visually dense. Might I suggest some tweaks: 1: Drop the parenthesis, in favor of some

Changing schema without having to reindex

2010-05-28 Thread David
Hi, Can anyone tell me if it is possible to change the schema without having to reindex? I want to change the stored fields specifically. Any help would be appreciated, thanks.

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Mark Bennett
Haha! Important tooltips are now deprecated in Web Applications. This is nothing official, of course. But it's being advised to avoid important UI tasks that require cursor tracking, mouse-over, hovering, etc. in web applications. Why? Many touch-centric mobile devices don't support hover.

Storing different entities in Solr

2010-05-28 Thread Moazzam Khan
Hi Guys, Is there a way to store 2 types of things in Solr. We have a list of consultants and a list of consultation requests. and I want to store them as separate documents. Can I do this with one instance of Solr or do I have to have two instances? Thanks, MOazzam

RE: Storing different entities in Solr

2010-05-28 Thread Nagelberg, Kallin
Good read here: http://mysolr.com/tips/denormalized-data-structure/ . Are consultation requests unique to each consultant? In that case you could represent the request as a Json String and store it as a multi-valued string field for each consultant, though that makes querying against requests

Build query programmatically with lucene, but issue to solr?

2010-05-28 Thread Phillip Rhodes
Hi. I am building up a query with quite a bit of logic such as parentheses, plus signs, etc... and it's a little tedious dealing with it all at a string level. I was wondering if anyone has any thoughts on constructing the query in lucene and using the string representation of the query to send

Re: Storing different entities in Solr

2010-05-28 Thread Robert Zotter
Sounds like you'll want to use a multiple core setup. One core fore each type of document http://wiki.apache.org/solr/CoreAdmin -- View this message in context: http://lucene.472066.n3.nabble.com/Storing-different-entities-in-Solr-tp852299p852346.html Sent from the Solr - User mailing list

RE: Storing different entities in Solr

2010-05-28 Thread Nagelberg, Kallin
Multi-core is an option, but keep in mind if you go that route you will need to do two searches to correlate data between the two. -Kallin Nagelberg -Original Message- From: Robert Zotter [mailto:robertzot...@gmail.com] Sent: Friday, May 28, 2010 12:26 PM To:

Re: Build query programmatically with lucene, but issue to solr?

2010-05-28 Thread Sven Maurmann
Hi Pillip, could you give me some more information of your environment? A first idea that comes to my mind is to use the SearchComponents for the solution of your problem. You could either replace the whole QueryComponent (not re- commended) or write a (probably small) SearchComponent that

Re: Build query programmatically with lucene, but issue to solr?

2010-05-28 Thread Ryan McKinley
Interesting -- I don't think there is anything that does this. Though it seems like something the XML Query syntax should be able to do, but we would still need to add the ability to send the xml style query to solr. On Fri, May 28, 2010 at 12:23 PM, Phillip Rhodes rhodebumpl...@gmail.com

Re: Storing different entities in Solr

2010-05-28 Thread Bill Au
You can keep different type of documents in the same index. If each document has a type field. You can restrict your searches to specific type(s) of document by using a filter query, which is very fast and efficient. Bill On Fri, May 28, 2010 at 12:28 PM, Nagelberg, Kallin

SolrJ Unicode problem

2010-05-28 Thread Hugh Cayless
Hi, I'm a solr newbie, and I'm hoping someone can point me in the right direction. I'm trying to index a bunch of documents with Greek text in them. I can successfully index documents by generating add xml and using curl to send them to my server, but when I use solrj to create and send

Re: Build query programmatically with lucene, but issue to solr?

2010-05-28 Thread Ken Krugler
On May 28, 2010, at 9:23am, Phillip Rhodes wrote: Hi. I am building up a query with quite a bit of logic such as parentheses, plus signs, etc... and it's a little tedious dealing with it all at a string level. I was wondering if anyone has any thoughts on constructing the query in

Re: Sort by function workaround for Solr 1.4

2010-05-28 Thread Blargy
How would this be any different than simply using the function to alter the scoring of the final results and then sorting by score? -- View this message in context: http://lucene.472066.n3.nabble.com/Sort-by-function-workaround-for-Solr-1-4-tp851922p852471.html Sent from the Solr - User

Re: Storing different entities in Solr

2010-05-28 Thread Moazzam Khan
Thanks for all your answers guys. Requests and consultants have a many to many relationship so I can't store request info in a document with advisorID as the primary key. Bill's solution and multicore solutions might be what I am looking for. Bill, will I be able to have 2 primary keys (so I can

Re: Sort by function workaround for Solr 1.4

2010-05-28 Thread Martynas Miliauskas
The problem with using query functions is that I don't know how to equally scale similarity score and output of the function. What I mean is that query output would be in the range from 0..1 and function output would be in the range from 0..1. Well I think I do know how to scale function output to

Re: Storing different entities in Solr

2010-05-28 Thread David Stuart
Hi, So for your use case are you wanting to search for a consultant then look at all of his or her request or pull both at the same time? In both cases one index should suffice. In you define a primary key field and use it for both doc types it shouldn't be an issue. Unless your dataset

Re: Prefix-Search with Stopwords - no results?

2010-05-28 Thread Erick Erickson
Hmmm, I don't really see the problem here. I'll have to use English examples... Searching on the* (assuming the is a stopword) will search on (them OR theory OR thespian) assuming those three words are in your index. It will NOT search on the. So I think you're OK, or are you seeing anomalous

Re: Changing schema without having to reindex

2010-05-28 Thread Erick Erickson
No. You can add new documents which will reflect the new schema, but you can't retroactively update your index. In your specific example, it's not possible to losslessly recreate the data to store from the indexed fields. Consider stopword removal, or lowercasing. HTH Erick On Fri, May 28, 2010

Re: AW: XSLT for JSON

2010-05-28 Thread Chris Hostetter
: ok,but is there an easy way to influence the format of json output? : eg field order, names etc. maybe i want to group the result differently or add some infos Wouldn't that be easier to do on the cliend side once you have the json structure? if not: then using the velocity writer to

Re: Storing different entities in Solr

2010-05-28 Thread Erick Erickson
You most certainly *can* store the many-many relationship, you are just denormalizing your data. I know it goes against the grain of any good database admin, but it's very often a good solution for a search application. You've gotta forget almost everything you learned about how data *should* be

RE: Storing different entities in Solr

2010-05-28 Thread Nagelberg, Kallin
I agree with Erick, Could you show us what these two entities look like, and the total count of each? That might shed some light on the appropriate approach. -Kallin Nagelberg -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Friday, May 28, 2010 2:36 PM

Re: NoSuchFieldError: submap

2010-05-28 Thread Chris Hostetter
: Hi, I'm trying to build from source to apply the field collapsing patch. : 'Ant dist' runs just fine, no errors, but at startup I get a : NoSuchFieldError: submap exception (stack trace: : http://pastebin.com/NXsf0KJS ). This is before sending any requests. I don't : have any 'submap' field

Rebuild an index

2010-05-28 Thread Sai . Thumuluri
Hi, We use Drupal as the CMS and Solr for our search engine needs and are planning to have Solr Master-Slave replication setup across the data centers. I am in the process of testing my replication - what is the best means to delete the index on the Solr slave and then replicate a fresh copy from

Re: Changing schema without having to reindex

2010-05-28 Thread Chris Hostetter
: No. You can add new documents which will reflect the new schema, but : you can't retroactively update your index. : : In your specific example, it's not possible to losslessly recreate the data : to store from the indexed fields. Consider stopword removal, or lowercasing. To put it another

RE: SolrJ Unicode problem

2010-05-28 Thread Tim Gilbert
I had a similar problem a few days ago and I found that the documents where not being loaded correctly as UTF-8 into Solr. In my case, the loader program was a Java.jar I was executing from a cron job. There I added this: java -Dfile.encoding=UTF-8 -jar /home/tim/solr/bin/loadSiteSearch.jar

Re: SolrJ Unicode problem

2010-05-28 Thread Hugh Cayless
Yeah, I just figured out that if I set export JAVA_TOOL_OPTIONS=-Dfile.encoding=UTF8 Everything works. The OutputStreamWriter used by StreamingUpdateSolrServer uses the default encoding. UTF-8 might be better, but maybe there are reasons not to hard-code it. Thanks, Hugh On May 28, 2010,

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Chris Hostetter
: Perhaps you could show the 'nr of items left' as a tooltip of sorts when the : user actually drags the slider. Years ago, when we were first working on building Solr, a coworker of mind suggested using double bar sliders (ie: pick a range using a min and a max) for all numeric facets and

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Lukas Kahwe Smith
On 28.05.2010, at 21:31, Chris Hostetter wrote: : Perhaps you could show the 'nr of items left' as a tooltip of sorts when the : user actually drags the slider. Years ago, when we were first working on building Solr, a coworker of mind suggested using double bar sliders (ie: pick a

Re: Does SOLR Allow q= (A or B) AND (C or D)?

2010-05-28 Thread Ahmet Arslan
--- On Fri, 5/28/10, efr...@gmail.com efr...@gmail.com wrote: From: efr...@gmail.com efr...@gmail.com Subject: Re: Does SOLR Allow q= (A or B) AND (C or D)? To: solr-user@lucene.apache.org Date: Friday, May 28, 2010, 4:42 AM Hi Ahmet, Thanks again for the feedback. We will be searching

Re: 'Minimum Should Match' on subquery level

2010-05-28 Thread Chris Hostetter
: I need to use Lucene's `minimum number should match` option of BooleanQuery : on Solr. unfortunately, the Lucene QueryParser doesn't support any way of manipulating the minNumberSHouldMatch property of BooleanQueries specified in that syntax. I'm not sure of anyway to do what you're

Re: Full Import failed

2010-05-28 Thread Chris Hostetter
: I am just using the sor.war file that came with the Solr 1.4 download on : weblogic. : did not add any jar or remove any jar i'm not sure what to tell you then -- somehow you have another copy of some classes in your classpath. did you copy the solr.war on top of an older solr.war? is it

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Chris Hostetter
: Years ago, when we were first working on building Solr, a coworker of mind : suggested using double bar sliders (ie: pick a range using a min and a : max) for all numeric facets and putting sparklines above them to give : the user a visual indication of the spread of documents across the

Re: SolrJ Unicode problem

2010-05-28 Thread Chris Hostetter
: Everything works. The OutputStreamWriter used by : StreamingUpdateSolrServer uses the default encoding. UTF-8 might be : better, but maybe there are reasons not to hard-code it. no, this was a big thta's been fixed in svn... https://issues.apache.org/jira/browse/SOLR-1595 ...it

Re: Prefix-Search with Stopwords - no results?

2010-05-28 Thread Chris Hostetter
: Searching on the* (assuming the is a stopword) will search on : (them OR theory OR thespian) assuming those three words are in : your index. It will NOT search on the. So I think you're OK, or are : you seeing anomalous results? i think the missing pieces to hte puzzle here are: 1) wildcard

Re: solr.solr.home

2010-05-28 Thread Chris Hostetter
: Hi to everyone, I'm really sorry for the s3tupid question I'm doing, but I : didn't understand how to set the java system property solr.solr.home to my : solr home. first off: you don't neccessarily *have* to set the solr.solr.home system property -- there are two other ways of telling Solr

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Lukáš Vlček
On Fri, May 28, 2010 at 9:49 PM, Chris Hostetter hossman_luc...@fucit.orgwrote: : Years ago, when we were first working on building Solr, a coworker of mind : suggested using double bar sliders (ie: pick a range using a min and a : max) for all numeric facets and putting sparklines above

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Lukáš Vlček
On Fri, May 28, 2010 at 11:39 PM, Lukáš Vlček lukas.vl...@gmail.com wrote: On Fri, May 28, 2010 at 9:49 PM, Chris Hostetter hossman_luc...@fucit.org wrote: : Years ago, when we were first working on building Solr, a coworker of mind : suggested using double bar sliders (ie: pick a

Re: Sites with Innovative Presentation of Tags and Facets

2010-05-28 Thread Chris Hostetter
: you mean something like the following? : http://hledani.rozhlas.cz/?query=jazzback=defaultNavigation=; : Also http://markmail.org has some nice chart Yeah ... those are close to what i mean -- but in both cases there is really one big visual graph of a single numeric value (ironicly it's a

Re: Sort by function workaround for Solr 1.4

2010-05-28 Thread Chris Hostetter
: I have found a user comment at this page : https://issues.apache.org/jira/browse/SOLR-1297 (Enable sorting by function : query) where he has mentioned that there is a workaround (main query)^0 : func(...) that can be used to sort results by function without having to : install SOLR-1297 patch.

Re: Help with query boosting syntax

2010-05-28 Thread Chris Hostetter
: When a person searches for keywords eg value1 value2 value3 we want to : apply boosting so that a document is boosted according to which of the : keywords it has. : eg of url : q=value1^4.0 OR value2^2.0 OR value3 ... : I have a requesthandler set up to just search on our Keyword

Re: Does SOLR Allow q= (A or B) AND (C or D)?

2010-05-28 Thread efr...@gmail.com
Hi Ahmad, Thanks for this. So do we need this:*defType=luceneq.op=ORfl=Title* at the end? Also, I'm guessing we will need to install EdgeNGramFilterFactory? Here are the analyzers / filters we currently are using (just the default stuff): *Index Analyzer:

Re: Help with PatternReplaceFilterFactory

2010-05-28 Thread Lance Norskog
You probably want to store these as numbers instead of text. The DataImportHandler allows you to take apart text blocks and save the parts in number fields. The text analysis stack inside basic indexing will not do this. On Thu, May 27, 2010 at 7:24 AM, Koji Sekiguchi k...@r.email.ne.jp wrote:

Re: Need guidance on schema type

2010-05-28 Thread Lance Norskog
Both use the same HTML stripper. The DIH lets you run multiple documents in parallel in one request if that helps. On Thu, May 27, 2010 at 9:32 AM, Blargy zman...@hotmail.com wrote: There will never be any need to search the actual HTML (tags, markup, etc) so as far as functionality goes it

Re: Solr trunk and Jetty threadpool implementation problem

2010-05-28 Thread Lance Norskog
Please file a JIRA. On Thu, May 27, 2010 at 2:43 PM, Smiley, David W. dsmi...@mitre.org wrote: I'd like to warn people about the default configuration of Jetty in the Solr trunk release (not present in Solr 1.4 and prior).  There is a difference in the jetty configuration which is for the

Re: Solr trunk and Jetty threadpool implementation problem

2010-05-28 Thread Yonik Seeley
Wow, thanks for the heads-up David! This probably got inadvertently changed when Jetty was upgraded... sounds like we should prob change back to BoundedThreadPool as a default! -Yonik http://www.lucidimagination.com On Thu, May 27, 2010 at 5:43 PM, Smiley, David W. dsmi...@mitre.org wrote: I'd

Re: Storing different entities in Solr

2010-05-28 Thread Lance Norskog
The size of the join table is the number of documents, if you denormalize the two tables. On Fri, May 28, 2010 at 11:38 AM, Nagelberg, Kallin knagelb...@globeandmail.com wrote: I agree with Erick, Could you show us what these two entities look like, and the total count of each? That might

Re: Solr trunk and Jetty threadpool implementation problem

2010-05-28 Thread Chris Hostetter
: Wow, thanks for the heads-up David! : This probably got inadvertently changed when Jetty was upgraded... : sounds like we should prob change back to BoundedThreadPool as a : default! it seems to have been a deliberate choice miler made, it was a distinct commit 20 minutes after the jetty