Re: Solr trunk and Jetty threadpool implementation problem

: Wow, thanks for the heads-up David! : This probably got inadvertently changed when Jetty was upgraded... : sounds like we should prob change back to BoundedThreadPool as a : default! it seems to have been a deliberate choice miler made, it was a distinct commit 20 minutes after the jetty upgra

Re: Storing different entities in Solr

The size of the join table is the number of documents, if you denormalize the two tables. On Fri, May 28, 2010 at 11:38 AM, Nagelberg, Kallin wrote: > I agree with Erick, > > Could you show us what these two entities look like, and the total count of > each? That might shed some light on the app

Re: Interleaving the results

There is no interleaving tool. There is a random number tool. You will have to achive this in your application. On Fri, May 28, 2010 at 8:23 AM, NarasimhaRaju wrote: > Hi, > how to achieve custom ordering of the documents when there is a general query? > > Usecase: > Interleave documents from dif

Re: Solr trunk and Jetty threadpool implementation problem

Wow, thanks for the heads-up David! This probably got inadvertently changed when Jetty was upgraded... sounds like we should prob change back to BoundedThreadPool as a default! -Yonik http://www.lucidimagination.com On Thu, May 27, 2010 at 5:43 PM, Smiley, David W. wrote: > I'd like to warn peop

Re: Solr trunk and Jetty threadpool implementation problem

Please file a JIRA. On Thu, May 27, 2010 at 2:43 PM, Smiley, David W. wrote: > I'd like to warn people about the default configuration of Jetty in the Solr > trunk release (not present in Solr 1.4 and prior).  There is a difference in > the jetty configuration which is for the latest Solr to us

Re: Need guidance on schema type

Both use the same HTML stripper. The DIH lets you run multiple documents in parallel in one request if that helps. On Thu, May 27, 2010 at 9:32 AM, Blargy wrote: > > There will never be any need to search the actual HTML (tags, markup, etc) so > as far as functionality goes it seems like the DIH

Re: Help with PatternReplaceFilterFactory

You probably want to store these as numbers instead of text. The DataImportHandler allows you to take apart text blocks and save the parts in number fields. The text analysis stack inside basic indexing will not do this. On Thu, May 27, 2010 at 7:24 AM, Koji Sekiguchi wrote: > >> Yes you are rig

Re: Does SOLR Allow q= (A or B) AND (C or D)?

Hi Ahmad, Thanks for this. So do we need this:"*&defType=lucene&q.op=OR&fl=Title* at the end? Also, I'm guessing we will need to install EdgeNGramFilterFactory? Here are the analyzers / filters we currently are using (just the default stuff): *Index Analyzer: *org.apache.solr.analysis.Tokenize

Re: Help with query boosting syntax

: > When a person searches for keywords eg value1 value2 value3 we want to : > apply boosting so that a document is boosted according to which of the : > keywords it has. : > eg of url : q=value1^4.0 OR value2^2.0 OR value3 ... : > I have a requesthandler set up to just search on our Keywo

Re: Sort by function workaround for Solr 1.4

: I have found a user comment at this page : https://issues.apache.org/jira/browse/SOLR-1297 (Enable sorting by function : query) where he has mentioned that there is a workaround "(main query)^0 : func(...)" that can be used to sort results by function without having to : install "SOLR-1297" patc

Re: Sites with Innovative Presentation of Tags and Facets

: > you mean something like the following? : > http://hledani.rozhlas.cz/?query=jazz&back=&defaultNavigation=&; : Also http://markmail.org has some nice chart Yeah ... those are close to what i mean -- but in both cases there is really one big visual graph of a single numeric value (ironicly it

Re: Sites with Innovative Presentation of Tags and Facets

On Fri, May 28, 2010 at 11:39 PM, Lukáš Vlček wrote: > > > On Fri, May 28, 2010 at 9:49 PM, Chris Hostetter > wrote: > >> >> : > Years ago, when we were first working on building Solr, a coworker of >> mind >> : > suggested using double bar sliders (ie: pick a range using a min and a >> : > max)

Re: Sites with Innovative Presentation of Tags and Facets

On Fri, May 28, 2010 at 9:49 PM, Chris Hostetter wrote: > > : > Years ago, when we were first working on building Solr, a coworker of > mind > : > suggested using double bar sliders (ie: pick a range using a min and a > : > max) for all numeric facets and putting "sparklines" above them to give >

Re: solr.solr.home

: Hi to everyone, I'm really sorry for the s3tupid question I'm doing, but I : didn't understand how to set the java system property solr.solr.home to my : solr home. first off: you don't neccessarily *have* to set the solr.solr.home system property -- there are two other ways of telling Solr wh

Re: Prefix-Search with Stopwords - no results?

: Searching on the* (assuming the is a stopword) will search on : (them OR theory OR thespian) assuming those three words are in : your index. It will NOT search on the. So I think you're OK, or are : you seeing anomalous results? i think the missing pieces to hte puzzle here are: 1) wildcard an

Re: SolrJ Unicode problem

: Everything works. The OutputStreamWriter used by : StreamingUpdateSolrServer uses the default encoding. UTF-8 might be : better, but maybe there are reasons not to hard-code it. no, this was a big thta's been fixed in svn... https://issues.apache.org/jira/browse/SOLR-1595 ...it wo

Re: Sites with Innovative Presentation of Tags and Facets

: > Years ago, when we were first working on building Solr, a coworker of mind : > suggested using double bar sliders (ie: pick a range using a min and a : > max) for all numeric facets and putting "sparklines" above them to give : > the user a visual indication of the "spread" of documents acr

Re: Full Import failed

: I am just using the sor.war file that came with the Solr 1.4 download on : weblogic. : did not add any jar or remove any jar i'm not sure what to tell you then -- somehow you have another copy of some classes in your classpath. did you copy the solr.war on top of an older solr.war? is it pos

Re: 'Minimum Should Match' on subquery level

: I need to use Lucene's `minimum number should match` option of BooleanQuery : on Solr. unfortunately, the Lucene QueryParser doesn't support any way of manipulating the minNumberSHouldMatch property of BooleanQueries specified in that syntax. I'm not sure of anyway to do what you're looking

Re: Does SOLR Allow q= (A or B) AND (C or D)?

--- On Fri, 5/28/10, efr...@gmail.com wrote: > From: efr...@gmail.com > Subject: Re: Does SOLR Allow q= (A or B) AND (C or D)? > To: solr-user@lucene.apache.org > Date: Friday, May 28, 2010, 4:42 AM > Hi Ahmet, > > Thanks again for the feedback. We will be searching several > fields of each >

Re: Sites with Innovative Presentation of Tags and Facets

On 28.05.2010, at 21:31, Chris Hostetter wrote: > > : Perhaps you could show the 'nr of items left' as a tooltip of sorts when the > : user actually drags the slider. > > Years ago, when we were first working on building Solr, a coworker of mind > suggested using double bar sliders (ie: pick a

Re: Sites with Innovative Presentation of Tags and Facets

: Perhaps you could show the 'nr of items left' as a tooltip of sorts when the : user actually drags the slider. Years ago, when we were first working on building Solr, a coworker of mind suggested using double bar sliders (ie: pick a range using a min and a max) for all numeric facets and putt

Re: SolrJ Unicode problem

Yeah, I just figured out that if I set export JAVA_TOOL_OPTIONS="-Dfile.encoding=UTF8" Everything works. The OutputStreamWriter used by StreamingUpdateSolrServer uses the default encoding. UTF-8 might be better, but maybe there are reasons not to hard-code it. Thanks, Hugh On May 28, 2010,

RE: SolrJ Unicode problem

I had a similar problem a few days ago and I found that the documents where not being loaded correctly as UTF-8 into Solr. In my case, the loader program was a Java.jar I was executing from a cron job. There I added this: java -Dfile.encoding=UTF-8 -jar /home/tim/solr/bin/loadSiteSearch.jar T

Re: Changing schema without having to reindex

: No. You can add new documents which will reflect the new schema, but : you can't retroactively update your index. : : In your specific example, it's not possible to losslessly recreate the data : to store from the indexed fields. Consider stopword removal, or lowercasing. To put it another way

Rebuild an index

Hi, We use Drupal as the CMS and Solr for our search engine needs and are planning to have Solr Master-Slave replication setup across the data centers. I am in the process of testing my replication - what is the best means to delete the index on the Solr slave and then replicate a fresh copy from

Re: NoSuchFieldError: submap

: Hi, I'm trying to build from source to apply the field collapsing patch. : 'Ant dist' runs just fine, no errors, but at startup I get a : "NoSuchFieldError: submap" exception (stack trace: : http://pastebin.com/NXsf0KJS ). This is before sending any requests. I don't : have any 'submap' field de

RE: Storing different entities in Solr

I agree with Erick, Could you show us what these two entities look like, and the total count of each? That might shed some light on the appropriate approach. -Kallin Nagelberg -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Friday, May 28, 2010 2:36 PM To

Re: Storing different entities in Solr

You most certainly *can* store the many<->many relationship, you are just denormalizing your data. I know it goes against the grain of any good database admin, but it's very often a good solution for a search application. You've gotta forget almost everything you learned about how data *should* be

Re: AW: XSLT for JSON

: ok,but is there an easy way to influence the format of json output? : eg field order, names etc. maybe i want to group the result differently or add some infos Wouldn't that be easier to do on the cliend side once you have the json structure? if not: then using the velocity writer to generat

Re: Changing schema without having to reindex

No. You can add new documents which will reflect the new schema, but you can't retroactively update your index. In your specific example, it's not possible to losslessly recreate the data to store from the indexed fields. Consider stopword removal, or lowercasing. HTH Erick On Fri, May 28, 2010

Re: Prefix-Search with Stopwords - no results?

Hmmm, I don't really see the problem here. I'll have to use English examples... Searching on the* (assuming the is a stopword) will search on (them OR theory OR thespian) assuming those three words are in your index. It will NOT search on the. So I think you're OK, or are you seeing anomalous resu

Re: Storing different entities in Solr

Hi, So for your use case are you wanting to search for a consultant then look at all of his or her request or pull both at the same time? In both cases one index should suffice. In you define a primary key field and use it for both doc types it shouldn't be an issue. Unless your dataset i

Re: Sort by function workaround for Solr 1.4

The problem with using query functions is that I don't know how to equally scale similarity score and output of the function. What I mean is that query output would be in the range from 0..1 and function output would be in the range from 0..1. Well I think I do know how to scale function output to

Re: Storing different entities in Solr

Thanks for all your answers guys. Requests and consultants have a many to many relationship so I can't store request info in a document with advisorID as the primary key. Bill's solution and multicore solutions might be what I am looking for. Bill, will I be able to have 2 primary keys (so I can u

Re: Sort by function workaround for Solr 1.4

How would this be any different than simply using the function to alter the scoring of the final results and then sorting by score? -- View this message in context: http://lucene.472066.n3.nabble.com/Sort-by-function-workaround-for-Solr-1-4-tp851922p852471.html Sent from the Solr - User mailin

Re: Build query programmatically with lucene, but issue to solr?

On May 28, 2010, at 9:23am, Phillip Rhodes wrote: Hi. I am building up a query with quite a bit of logic such as parentheses, plus signs, etc... and it's a little tedious dealing with it all at a string level. I was wondering if anyone has any thoughts on constructing the query in lucene

SolrJ Unicode problem

Hi, I'm a solr newbie, and I'm hoping someone can point me in the right direction. I'm trying to index a bunch of documents with Greek text in them. I can successfully index documents by generating add xml and using curl to send them to my server, but when I use solrj to create and send docume

Re: Storing different entities in Solr

You can keep different type of documents in the same index. If each document has a type field. You can restrict your searches to specific type(s) of document by using a filter query, which is very fast and efficient. Bill On Fri, May 28, 2010 at 12:28 PM, Nagelberg, Kallin < knagelb...@globeand

Re: Build query programmatically with lucene, but issue to solr?

Interesting -- I don't think there is anything that does this. Though it seems like something the XML Query syntax should be able to do, but we would still need to add the ability to send the xml style query to solr. On Fri, May 28, 2010 at 12:23 PM, Phillip Rhodes wrote: > Hi. > I am building

Re: Build query programmatically with lucene, but issue to solr?

Hi Pillip, could you give me some more information of your environment? A first idea that comes to my mind is to use the SearchComponents for the solution of your problem. You could either replace the whole QueryComponent (not re- commended) or write a (probably small) SearchComponent that create

RE: Storing different entities in Solr

Multi-core is an option, but keep in mind if you go that route you will need to do two searches to correlate data between the two. -Kallin Nagelberg -Original Message- From: Robert Zotter [mailto:robertzot...@gmail.com] Sent: Friday, May 28, 2010 12:26 PM To: solr-user@lucene.apache.or

Re: Storing different entities in Solr

Sounds like you'll want to use a multiple core setup. One core fore each type of "document" http://wiki.apache.org/solr/CoreAdmin -- View this message in context: http://lucene.472066.n3.nabble.com/Storing-different-entities-in-Solr-tp852299p852346.html Sent from the Solr - User mailing list ar

Build query programmatically with lucene, but issue to solr?

Hi. I am building up a query with quite a bit of logic such as parentheses, plus signs, etc... and it's a little tedious dealing with it all at a string level. I was wondering if anyone has any thoughts on constructing the query in lucene and using the string representation of the query to send to

RE: Storing different entities in Solr

Good read here: http://mysolr.com/tips/denormalized-data-structure/ . Are consultation requests unique to each consultant? In that case you could represent the request as a Json String and store it as a multi-valued string field for each consultant, though that makes querying against requests t

Storing different entities in Solr

Hi Guys, Is there a way to store 2 types of things in Solr. We have a list of consultants and a list of consultation requests. and I want to store them as separate documents. Can I do this with one instance of Solr or do I have to have two instances? Thanks, MOazzam

Re: Sites with Innovative Presentation of Tags and Facets

Haha! Important tooltips are now "deprecated" in Web Applications. This is nothing "official", of course. But it's being advised to avoid important UI tasks that require cursor tracking, mouse-over, hovering, etc. in web applications. Why? Many touch-centric mobile devices don't support "hover

Changing schema without having to reindex

Hi, Can anyone tell me if it is possible to change the schema without having to reindex? I want to change the stored fields specifically. Any help would be appreciated, thanks.

Re: Sites with Innovative Presentation of Tags and Facets

Hi Lukas, Displaying 2 numbers is an interesting variant. Not for a casual consumer site, but actually pretty cool for a site appealing to engineers. On the formatting front though, the (nn/mm) is a bit visually "dense". Might I suggest some tweaks: 1: Drop the parenthesis, in favor of some oth

Re: Sites with Innovative Presentation of Tags and Facets

Thanks Geert, Trip Advisor was interesting, I also see another "sliders" site was sent around. But I don't think all their Facets are "binding". For example, to test no-results, I set it to 4 start hotels in SF with a max of $50 / night - obviously not reasonable. But it showed some hotels. At

Prefix-Search with Stopwords - no results?

Hello, I am having some problems with solr 1.4. I am indexing and querying data using the following fieldType: The ap

Interleaving the results

Hi, how to achieve custom ordering of the documents when there is a general query? Usecase: Interleave documents from different customers one after the other. Example: Say i have 10 documents in the index belonging to 3 customers (customer_id field in the index ) and using query *:* so all the d

strange results with query and hyphened words

i am wondering why a search term with hyphen doesn't match. my search term is "prof-auskunft". in WordDelimiterFilterFactory i have catenateWords, so my understanding is that profi-auskunft would search for profiauskunft. when i use the analyse panel in solr admi i see that profi-auskunft matches

Sort by function workaround for Solr 1.4

Hi, I need to sort query results by the output of some function which takes "score" and couple other fields as an input (50% of the total score comes from similarity score and 50% comes from document's popularity). Is there a workaround which does not involve installation of any patches. I have f

Custom sorting

Hello everyone, I'm new to Solr but have been asked to do an evaluation as an alternative for a commercial search engine. I have some experience with Lucene and a java background so I'm not afraid to dive into code :-) The application now has a very particular way of sorting results using

Re: Solr spellchecker field

Dejan, How are you making the calls from PHP to Solr? I am curious to know why the documents could not be parsed On Fri, May 28, 2010 at 5:00 AM, Dejan Noveski wrote: > Thank you very much! > > On Fri, May 28, 2010 at 10:57 AM, Erik Hatcher >wrote: > > > A field used to build a spellcheck ind

Re: highlighting broken for multivalued text fields?

Ah, ok. Well, the fieldType was "text", untouched from the Solr default. hth, Darren On Thu, 2010-05-27 at 22:06 -0700, Chris Hostetter wrote: > : Hi Koji, > :Well, its quite simple. Here is the field returned from my query: > : "fox" > > Actually what Koji was asking for was the declarati

Re: Applying collapse patch

I don't know how, but it works now. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Applying-collapse-patch-tp851121p851502.html Sent from the Solr - User mailing list archive at Nabble.com.

AW: XSLT for JSON

ok,but is there an easy way to influence the format of json output? eg field order, names etc. maybe i want to group the result differently or add some infos > -Ursprüngliche Nachricht- > Von: Jon Baer [mailto:jonb...@gmail.com] > Gesendet: Mittwoch, 26. Mai 2010 19:39 > An: solr-user@lu

Re: Applying collapse patch

Have you executed: "ant example" after building? (Assuming that this is the example solr) On 28 May 2010 12:17, Sophie M. wrote: > > It is ok for applying the patch, thanks Martin. When I start Solr I get this > logs in my console : > > C:\Users\Sophie\workspace\lucene-solr\lucene-solr\solr\solr>

Re: Applying collapse patch

It is ok for applying the patch, thanks Martin. When I start Solr I get this logs in my console : C:\Users\Sophie\workspace\lucene-solr\lucene-solr\solr\solr>java -jar start.jar 2010-05-28 12:09:30.037:INFO::Logging to STDERR via org.mortbay.log.StdErrLog 2010-05-28 12:09:30.178:INFO::jetty-6.1.2

Re: Applying collapse patch

Hi, I am getting the trunk, I try to apply the patch, to compile and I tell you what I get. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Applying-collapse-patch-tp851121p851222.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Applying collapse patch

The trunk should work with the latest patch (SOLR-236-trunk.patch). Did patching go successful? What compilation errors you get? On 28 May 2010 11:10, Sophie M. wrote: > > Ok I will have a look on the comments and I will post if necessary. > > Thanks ^^ > -- > View this message in context: > htt

SolrException: No such core

With embedded solr (1.3.0) sometime a SolrException happens. I don't understand why : I have not been able to find a scenario. org.apache.solr.common.SolrException: No such core: core0 at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:112) at org.apac

Re: Tagging Facet Queries -- Urgent Help Required

Thanks Erick, On Fri, May 28, 2010 at 2:17 PM, Erik Hatcher wrote: > You've tagged facet queries, but looks like you might want to use the > "excl"ude capability on your filter queries also. Filter queries are > additive, constraining the results further for each one, and by default > faceting

Re: Applying collapse patch

Ok I will have a look on the comments and I will post if necessary. Thanks ^^ -- View this message in context: http://lucene.472066.n3.nabble.com/Applying-collapse-patch-tp851121p851170.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Sites with Innovative Presentation of Tags and Facets

Here's a slider example that narrows down how many tags/facets are displayed: How about a tree map? See my slides from the prototyping preso at EuroCon last week: Pie in the sky, how about pie charts? I

Re: Applying collapse patch

I had success with a previous version (~ 12/2009). Try to ask directly in the comments of the patch. I got immediately help there. Regards, Peter. > Hello ! > > I am trying to apply the solr-236 patch to the sources I got from svn. I > downloaded the sources from path-to-repository/tags/release-1

Re: Solr spellchecker field

Thank you very much! On Fri, May 28, 2010 at 10:57 AM, Erik Hatcher wrote: > A field used to build a spellcheck index only needs to be indexed, not > stored. > > But, your PHP issue could be alleviated anyway by simply customizing the fl > parameter and excluding the large stored field. This is

Re: Solr spellchecker field

A field used to build a spellcheck index only needs to be indexed, not stored. But, your PHP issue could be alleviated anyway by simply customizing the fl parameter and excluding the large stored field. This is often desirable for large fields that are never needed fully in the UI, but u

Solr spellchecker field

Hi, Does the field that is used for spellchecker indexing need to be stored and/or indexed? These fields became fairly large in my index, and php wont parse/decode the documents returned. -- -- Dejan Noveski Web Developer dr.m...@gmail.com Twitter: http://twitter.com/dekomote | LinkedIn: http://

Re: Tagging Facet Queries -- Urgent Help Required

You've tagged facet queries, but looks like you might want to use the "excl"ude capability on your filter queries also. Filter queries are additive, constraining the results further for each one, and by default faceting is based off the search results. Use excl to have facets count outsid

Applying collapse patch

Hello ! I am trying to apply the solr-236 patch to the sources I got from svn. I downloaded the sources from path-to-repository/tags/release-1.4.0 I tried to apply this patch https://issues.apache.org/jira/secure/attachment/12444611/SOLR-236-trunk.patch and this one : https://issues.apache.org/j

Logs for Java Replication in Solr

Hi, where can I find more information about a failure of a Java replication in Solr 1.4? (Dashboard does not seem to be the best place!?) Regards, Peter.

Tagging Facet Queries -- Urgent Help Required

Hi All, I have a use case where I have to tag facet queries. Here is the code snippet for what I tried: query.addFilterQuery("{!tag=NE}med:Blog AND slev:neutral"); query.addFacetQuery("{!tag=NE key=BLOG}med:Blog AND slev:neutral"); query.addFilterQuery("{!tag=P}med:Review AND slev:neutral"); query