Re: Delete from Solr index...

2010-01-29 Thread vnchoudhary
I am looking for following solution in C#, Please provide sample code if possible:- 1. Delete all the index using delete query. 2. Take backup of all the old index, before regenerate. 3. Try to write unlike query for a field to delete stale index. 4. How can use transaction under index generation

Re: Querying for multi-term phrases only . . .

2010-01-29 Thread Erik Hatcher
You can avoid one word terms by setting outputUnigrams="false" on the ShingleFilterFactory configuration. Erik On Jan 28, 2010, at 11:29 PM, Christopher Ball wrote: I am curious how I can query for multi-term phrases using the TermsComponent? The field I am searching has been shin

Re: Newbie Question on Custom Query Generation

2010-01-29 Thread Erik Hatcher
dismax won't quite give you the same query result. What you can do pretty easily, though, is create a QParser and QParserPlugin pair, register it solrconfig.xml and then use &defType=. Pretty straightforward. Have a look at Solr's various QParserPlugin implementations for details.

Aggregated facet value counts?

2010-01-29 Thread Peter S
Hi, I was wondering if anyone had come across this use case, and if this type of faceting is possible: The requirement is to build a query such that an aggregated facet count of common (and'ed) field values form the basis of each returned facet count. For example: Let's say I have a

Re: Aggregated facet value counts?

2010-01-29 Thread Erik Hatcher
When faced with this type of situation where the data is entirely available at index-time, simply create an aggregated field that glues the two pieces together, and facet on that. Erik On Jan 29, 2010, at 6:16 AM, Peter S wrote: Hi, I was wondering if anyone had come across thi

RE: Aggregated facet value counts?

2010-01-29 Thread Peter S
Hi Erik, Thanks for your reply. That's an interesting idea doing it at index-time, and a good idea for known field combinations. The only thing is How to handle arbitrary field combinations? - i.e. to allow the caller to specify any combination of fields at query-time? So, yes, th

loading an updateProcessorChain with multicore in trunk

2010-01-29 Thread Marc Sturlese
I am testing trunk and have seen a different behaviour when loading updateProcessors wich I don't know if it's normal (at least with multicore) Before I use to use an updateProcessorChain this way: myChain It does not work in current trunk. I have debuged th

Re: Aggregated facet value counts?

2010-01-29 Thread Erik Hatcher
Creating values for every possible combination is what you're asking Solr to do at query-time, and as far as I know there isn't really a way to accomplish that like you're asking. Is the need really to be arbitrary here? Erik On Jan 29, 2010, at 7:25 AM, Peter S wrote: Hi Erik

Re: loading an updateProcessorChain with multicore in trunk

2010-01-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess . default=true should not be necessary if there is only one updateRequestProcessorChain specified . Open an issue On Fri, Jan 29, 2010 at 6:06 PM, Marc Sturlese wrote: > > I am testing trunk and have seen a different behaviour when loading > updateProcessors wich I don't know if it's norm

RE: Aggregated facet value counts?

2010-01-29 Thread Peter S
Well, it wouldn't be 'every' combination - more of 'any' combination at query-time. The 'arbitrary' part of the requirement is because it's not practical to predict every combination a user might ask for, although generally users would tend to search for similar/the same query combinations (b

multi term, multi field, auto suggest

2010-01-29 Thread Lukas Kahwe Smith
Hi, So over the course of the last two weeks I have been trying to come up with an optimal solution for auto suggest in the project I am currently working on. In the application we have names from people and companies. The companies can have german, english, italian or french names. people have

Is optimizing always necessary?

2010-01-29 Thread Marcus Herou
If one only have additions do I then need to optimize the index at all ? I thought that only update/deletes created "holes" in the index. Or should the index be sorted on disk at all times, is that the reason ? Cheers //Marcus -- Marcus Herou CTO and co-founder Tailsweep AB +46702561312 marcus

Re: Aggregated facet value counts?

2010-01-29 Thread Erik Hatcher
Sounds like what you're asking for is tree faceting. A basic implementation is available in SOLR-792, but one that could also take facet.queries, numeric or date range buckets, to tree on would be a nice improvement. Still, the underlying implementation will simply enumerate all the poss

Re: Is optimizing always necessary?

2010-01-29 Thread Wangsheng Mei
In addition to destory the "holes" in the index, optimization is also used to merge multiple small indexes into a bigger one. Although I have not got specific performace data, I can imagine that this will lead to performace benifits. Supposing you have thousands of small indexes, open-close these

Re: Newbie Question on Custom Query Generation

2010-01-29 Thread Wangsheng Mei
What's the point of generating your own query? Are you sure that solr query syntax cannot satisfy your need? 2010/1/29 Abin Mathew > Hi I want to generate my own customized query from the input string entered > by the user. It should look something like this > > *Search field : Microsoft* > * >

Re: boosting unexpired documents

2010-01-29 Thread Wangsheng Mei
I think you can combine serveral solr supplied standard function query to achieve this. similar to: &bf=map(map(div(ms(NOW, expiration),8640),-1,0,0), 1,1,1) Furthermore, you would implement your own function and register it in solrconfig.xml using valueSourceParser tag. 2010/1/29 An

Solr duplicates detection!!

2010-01-29 Thread Wangsheng Mei
Document Duplication Detection [image: ] Solr1.4 目录 1. Document Duplication Detection <#Document_Duplication_Detection> 2. Overview <#Overview> 1. Goals <#Goals> 2. Design <#Design> 3. Notes <#Notes> 4. Configuration <#Configuration> 1. solrconfig.xml <#solrconfig.

Re: Solr duplicates detection!!

2010-01-29 Thread Wangsheng Mei
Sorry by sending wrong message, this should go to my own mail box :( 2010/1/30 Wangsheng Mei > Document Duplication Detection > > [image: ] Solr1.4 > > 目录 > >1. Document Duplication > Detection<#1267b655a97b48f5_Document_Duplication_Detection> >2. Overview <#1267b

Deleting spelll checker index

2010-01-29 Thread darniz
Hello all, We are using Index based spell checker. i was wondering with the help of any url parameters can we delete the spell check index directory. please let me know thans darniz -- View this message in context: http://old.nabble.com/Deleting-spelll-checker-index-tp27376823p27376823.html S

Auto Suggest with multiple space separated words

2010-01-29 Thread Nair, Manas
Hi Experts, I need an auto suggest functionality using SOLR which gives me the feel of using the fire fox browser. In short, if I type in a prefix, the results should drop down even if the prefix is not the starting of the drop down items. Example: If I search for Lin, then the results could

distributed search and failed core

2010-01-29 Thread Joe Calderon
hello *, in distributed search when a shard goes down, an error is returned and the search fails, is there a way to avoid the error and return the results from the shards that are still up? thx much --joe

Re: Basic questions about Solr cost in programming time

2010-01-29 Thread Sven Maurmann
Hi! Of course the answer depends (as usually) very much on the features you want to realize. But Solr can be set up very fast. When we created our first prototype, it took us about a week to get it running with spell phoneme search, spell checking, facetting - and even collapsing (using the famou

RE: Aggregated facet value counts?

2010-01-29 Thread Peter S
Tree faceting - that sounds very interesting indeed. I'll have a look into that and see how it fits, as well as any improvements for adding facet queries, cross-field aggregation, date range etc. There could be some very nice use-cases for such functionality. Just wondering how this would work

sort items by whether the user has viewed it or not

2010-01-29 Thread a8910b-solr
hi, i want to query for documents that have certain values but i want it first sorted by documents that this person has viewed in the past. i can't store each user's view information in the document so i want to pass that in to the search. is it possible to do something like this: http://sol

Re: loading an updateProcessorChain with multicore in trunk

2010-01-29 Thread Chris Hostetter
: I guess . default=true should not be necessary if there is only one : updateRequestProcessorChain specified . Open an issue No... that doesn't seem right. If you declare you're own chains, but you don't mark any of them as default="true" then it shouldn't matter how many of them you declare

Re: update doc success, but could not find the new value

2010-01-29 Thread Chris Hostetter
: Subject: update doc success, but could not find the new value : In-Reply-To: <449216.59315...@web56308.mail.re3.yahoo.com> : References: <27335403.p...@talk.nabble.com> : <449216.59315...@web56308.mail.re3.yahoo.com> http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailin

RE: Solr wiki link broken

2010-01-29 Thread Chris Hostetter
: Why don't we change the links to have "FrontPage" explicitly? : Wouldn't it be the easiest fix unless there are numerous : other pages that references the default page w/o "FrontPage"? I'm fairly confident that there are more links pointing to http://wiki.apache.org/solr/ then there are altern

Re: NullPointerException in ReplicationHandler.postCommit + question about compression

2010-01-29 Thread Chris Hostetter
: never keep a 0. : : It is better to leave not mention the deletionPolicy at all. The : defaults are usually fine. if setting the "keep" values to 0 results in NPEs we should do one (if not both) of the following... 1) change the init code to warn/fail if the values are 0 (not sure if there

RE: How to Implement SpanQuery in Solr . . ?

2010-01-29 Thread Chris Hostetter
: and Solr. I was hoping to start by getting a simple example working in SOLR : and then iterate towards the more complex, given this is my first attempt at : extending Solr. wise choice. : For my first iteration of SpanQuery in Solr I am thinking of starting with a : simple syntax to combine:

Re: Solr Cache Viewing/Browsing

2010-01-29 Thread Chris Hostetter
: used in a modified DisMaxHandler) and I was wondering if there is a way to : get at this data from the JSP pages? I then thought that it might be nice to : view more information about the respective caches like the current elements, : recently evicted etc to help debug performance issues. Has any

Re: replication setup

2010-01-29 Thread Chris Hostetter
: Subject: replication setup : In-Reply-To: <83ec2c9c1001260724t110d6595m5071e0a40e1b1...@mail.gmail.com> http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do not reply to an existing message, instead start

Re: Analysis tool vs search query

2010-01-29 Thread Chris Hostetter
: I've run into this issue that I have no way of resolving, since the analysis : tool doesn't show me there is an error. I copy the exact field value into : the analysis tool and i type in the exact query request i'm issuing and the : tool finds it a match. However running the query with that exac

Re: using bq with standard request handler

2010-01-29 Thread Chris Hostetter
: I am using a query like: : http://localhost:8080/solr/select?q=product_category:Grocery&fq=in_stock:true&debugQuery=true&; : sort=display_priority+desc,prop_l_price+asc ... : Is it possible to use display_priority/price fields in bq itself to acheive : the same result.. I tried forming

Re: Mail config

2010-01-29 Thread Chris Hostetter
: I do not want to receive all the emails from this mail list, I only want to : receive the answers to my questions, is this possible? That's not how mailing lists work. If you want to participate in teh community, you have to participate fully. : If I am not mistaken when I unsubscribed I sen

Re: Lock problems: Lock obtain timed out

2010-01-29 Thread Chris Hostetter
: Can anyone think of a reason why these locks would hang around for more than : 2 hours? : : I have been monitoring them and they look like they are very short lived. Typically the lock files are only left arround for more then a few seconds when there was a fatal crash of some kind ... an OOM

Re: scenario with FQ parameter

2010-01-29 Thread Chris Hostetter
:&qf=field1^10 field2^20 field^100&fq=*:9+OR+(field1:"xyz") ... : I know I can use copy field (say 'text') to copy all the fields and then ... : but doing so , the boost weights specified in the 'qf' field have no effect : on the score. An FQ never has any impact on th

Re: How can I boost bq in FieldQParserPlugin?

2010-01-29 Thread Chris Hostetter
: q=ipod&bq={!dismax qf=userId^0.5 v=$qq bq=}&qq=12345&qt=dismax&debugQuery=on : : I try to debug the above query, it turned out to be as: : +DisjunctionMaxQuery((content:ipod | title:ipod^4.0)~0.01) () : +DisjunctionMaxQuery((userId:12345^0.5)~0.01) ...hmmm, i'm not sure why that's happening, b

Re: Large Query Strings and performance

2010-01-29 Thread Chris Hostetter
: I am using Solr 1.4 with large query strings with 20+ terms and faceting on : a single multi-valued field in a 1 million record system. I am using Solr to : categorize text, that why the query strings are big. : : The performance get's worse the more search terms are used. Is there any can y

Re: request handler defaults

2010-01-29 Thread Chris Hostetter
: I have noticed that atm there doesnt seem to be a way to inherit request : handler definitions. This would be nice to be able to define some basic : requesthandlers (maybe even with the option of defining them "abstract") The idea has been discussed before... https://issues.apache.org/jir

Re: Master Read Timeout

2010-01-29 Thread Chris Hostetter
: Is there any way to increase the Slave's timeout value? Are there any http://wiki.apache.org/solr/SolrReplication?highlight=%28timeout%29 -Hoss

RE: matching exact/whole phrase

2010-01-29 Thread Chris Hostetter
: Is it safe to say in order to do exact matches the field should be a string. It depends on your definition of "exact" If you want exact matches, including unicode codepoints and leading/trailing whitespace, then StrField would probably make sense -- but you could equally use TextField with a

Re: Deleting spelll checker index

2010-01-29 Thread Chris Hostetter
: We are using Index based spell checker. : i was wondering with the help of any url parameters can we delete the spell : check index directory. I don't think so. You might be able to configure two differnet spell check components that point at the same directory -- one hat builds off of a real

DataImportHandler multivalued field Collection not working

2010-01-29 Thread Jason Rutherglen
DataImportHandler multivalued field Collection isn't working the way I'd expect, meaning not at all. I logged the collection is there, however the multivalue collection field just isn't being indexed (according to the DIH web UI and it's not in the index).

Re: DataImportHandler multivalued field Collection not working

2010-01-29 Thread Wangsheng Mei
Did you correctly set multiValue(not multivalue)="true" in schema.xml? 2010/1/30 Jason Rutherglen > DataImportHandler multivalued field Collection isn't > working the way I'd expect, meaning not at all. I logged the > collection is there, however the multivalue collection field > just isn't bein

Re: Newbie Question on Custom Query Generation

2010-01-29 Thread Abin Mathew
Hi, I realized the power of Dismax Query Handler recently and now I dont need to generate my own query since Dismax is giving better results.Thanks a lot 2010/1/29 Wangsheng Mei : > What's the point of generating your own query? > Are you sure that solr query syntax cannot satisfy your need? > > 2

Looking for a Solr volunteer for www.comics.org

2010-01-29 Thread Henry Andrews
Hi folks, I apologize if this isn't the right place to post this (alternate suggestions welcome alongside appropriate chastisement :-) I'm trying to recruit a volunteer to implement a Solr-based search system for the Grand Comic-Book Database (http://www.comics.org/). We're a non-profit, n

Re: Deleting spelll checker index

2010-01-29 Thread darniz
Then i assume the easiest way is to delete the directory itself. darniz hossman wrote: > > > : We are using Index based spell checker. > : i was wondering with the help of any url parameters can we delete the > spell > : check index directory. > > I don't think so. > > You might be able to