Re: New to Solr - Need advice on clustering

2013-11-25 Thread Sameer Maggon
Anders, Take a look at Solr Replication. Essentially, you'll treat one as a master & one as a slave. Both master & slave can be used to serve traffic. If one of them goes down, the other can be used as a master for the interim. http://wiki.apache.org/solr/SolrReplication Sameer. -- http://measur

Re: Please help me to understand debugQuery output

2013-11-25 Thread GaneshSe
You might want to look at the Solr Relavancy for the same. http://wiki.apache.org/solr/SolrRelevancyFAQ Also, it will even better if you look at the link above with outcome you want to get to, like "Want to know why this document is better than the

Re: Storing solr results in excel

2013-11-25 Thread Mikhail Khludnev
wt=csv ? On Tue, Nov 26, 2013 at 11:09 AM, kumar wrote: > Hi, > > i am getting two field values from excel and querying solr to give top 1 > results. But i need to store the results in another excel sheet. Anyone > help > me how to store solr results in excel file using solrj > > Regards, > Kum

Storing solr results in excel

2013-11-25 Thread kumar
Hi, i am getting two field values from excel and querying solr to give top 1 results. But i need to store the results in another excel sheet. Anyone help me how to store solr results in excel file using solrj Regards, Kumar. -- View this message in context: http://lucene.472066.n3.nabble.com/

Re: Setting solr.data.dir for SolrCloud instance

2013-11-25 Thread adfel70
Thanks for the reply, Erick. Actually, I didnt not think this through. I just thought it would be a good idea to separate the data from the application code. I guess I'll leave it without setting the datadir parameter and add a symlink. -- View this message in context: http://lucene.472066.n3.n

HttpSolrServer - Http Client Connection pooling issue

2013-11-25 Thread imgauravd
Hi, Hopefully I am mailing the correct mailid for solr issue. If not then please let me know accordingly. We are using Solr 4.3.1 and we are using HttpSolrServer for querying Solr. We are trying to do a load and stress test using Jmeter and we can see that after certain requests Solr responds

Re: New to Solr - Need advice on clustering

2013-11-25 Thread Anders Kåre Olsen
Hi Gora Thank you for your reply. We are planning on having a loadbalancer in front of our frontend servers. If I have two distinct solr indexes, how will I keep them synchronized? I expect that one of the frontend servers will have the task of updating the product repository on the e-commer

Re: building custom cache - using lucene docids

2013-11-25 Thread Roman Chyla
OK, I've spent some time reading the solr/lucene4x classes, and this is myunderstanding (feel free to correct me ;-)) DirectoryReader holds the opened segments -- each segment has its own reader, the BaseCompositeReader (or extended classes thereof) store the offsets per each segment; eg. [0, 5, 2

Re: a function query of time, frequency and score.

2013-11-25 Thread sling
Thanks, Erick. What I want to do is custom the sort by date, time, and number. I want to know is there some formula to tackle this. Thanks again! sling On Fri, Nov 22, 2013 at 9:11 PM, Erick Erickson [via Lucene] < ml-node+s472066n4102599...@n3.nabble.com> wrote: > Not quite sure what you're as

Please help me to understand debugQuery output

2013-11-25 Thread Amit Aggarwal
Hello All, Can any one help me in understanding "debugQuery" output like this. 0.6276088 = (MATCH) sum of: 0.6276088 = (MATCH) max of: 0.18323982 = (MATCH) sum of: 0.18323982 = (MATCH) weight(state_search:a in 327) [DefaultSimilarity], result of:

Re: In a functon query, I can't get the ValueSource when extend ValueSourceParser

2013-11-25 Thread sling
Thanks a lot for your reply, Chris. I was trying to sort the query result by the Datefunction, by passing q={!boost b=dateDeboost()}title:test to the /select request-handler. Before, my custom DateFunction is like this: public class DateFunction extends FieldCacheSource { private static f

Re: Solr 4.x : how to implement an update processor chain working for partial updates

2013-11-25 Thread Alexandre Rafalovitch
SOLR-5395 just out with 4.6 might have some relevance here (RunAlways marker interface for UpdateRequestProcessorFactory). Not sure how it affects partial updates though. Regards, Alex. Personal website: http://www.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch -

Re: New to Solr - Need advice on clustering

2013-11-25 Thread Gora Mohanty
On 26 November 2013 01:44, Anders Kåre Olsen wrote: > Hi Solr-users > > I’m trying to setup Solr for search and indexing on the project I’m working > on. > > My project is a e-commerce B2B solution. We are planning on setting up 2 > frontend servers for the website, and I was planning on install

Re: building custom cache - using lucene docids

2013-11-25 Thread Roman Chyla
On Mon, Nov 25, 2013 at 12:54 AM, Mikhail Khludnev < mkhlud...@griddynamics.com> wrote: > Roman, > > I don't fully understand your question. After segment is flushed it's never > changed, hence segment-local docids are always the same. Due to merge > segment can gone, its' docs become new ones in

Re: building custom cache - using lucene docids

2013-11-25 Thread Roman Chyla
On Sun, Nov 24, 2013 at 10:44 AM, Jack Krupansky wrote: > We should probably talk about "internal" Lucene document IDs and > "external" or "rebased" Lucene document IDs. The internal document IDs are > always "per-segment" and never, ever change for that closed segment. But... > the application wo

Re: building custom cache - using lucene docids

2013-11-25 Thread Roman Chyla
On Sun, Nov 24, 2013 at 8:31 AM, Erick Erickson wrote: > bq: Do i understand you correctly that when two segmets get merged, the > docids > (of the original segments) remain the same? > > The original segments are unchanged, segments are _never_ changed after > they're closed. But they'll be throw

POLL: Solr vs. SolrCloud usage

2013-11-25 Thread Otis Gospodnetic
Hi, It would be great to see what Solr people are using - Solr or SolrCloud: Vote ==> http://blog.sematext.com/2013/11/25/poll-solr-cloud-usage/ Here are a couple of old polls, if you are curious about this sort of stuff like I am: * http://blog.sematext.com/2013/02/25/poll-solr-cloud-or-not/ -

New to Solr - Need advice on clustering

2013-11-25 Thread Anders Kåre Olsen
Hi Solr-users I’m trying to setup Solr for search and indexing on the project I’m working on. My project is a e-commerce B2B solution. We are planning on setting up 2 frontend servers for the website, and I was planning on installing Solr on these servers. We are using Windows Server 2012 for t

Re: csv does not return custom fields (distance)

2013-11-25 Thread Chris Hostetter
It's a known issue, support for returning psuedo-fields in the CSV response writer was never implemented. Need someone to spend some time working up a patch to add it... https://issues.apache.org/jira/browse/SOLR-5423 : Date: Wed, 20 Nov 2013 20:55:53 -0800 (PST) : From: GaneshSe : Reply-To

Re: In a functon query, I can't get the ValueSource when extend ValueSourceParser

2013-11-25 Thread Chris Hostetter
I'm not sure i understand your question - largely because you've only provided a small sample of information aboutwhat you are doing, and not giving a full picture. what are you actually trying to accomplish? With your custom ValueSourceParser, what input are you sending to solr that generat

Re: Solr 4.x : how to implement an update processor chain working for partial updates

2013-11-25 Thread Chris Hostetter
: : Is there a way to have solr execute my ConditionalCopyProcessor on the : actual updated doc (the one resulting from solr retrieving all stored values : and merging with update request values), and not on the request doc ? Partial Updates, and loading the existing stored fields of a document

Revolution writeup

2013-11-25 Thread Michael Sokolov
I just posted a writeup of the Lucene/Solr Revolution Dublin conference. I've been waiting for videos to become available, but I got impatient. Slides are there, mostly though. Sorry if I missed your talk -- I'm hoping to catch up when the videos are posted... http://blog.safariflow.com/201

Re: ConcurrentModificationException from XMLResponseWriter

2013-11-25 Thread Shyamsunder R Mutcha
Shawn, We have custom search handlers that uses in built components - result and facet to generate the results. I see that our facet generation is using the LinkedHashMap. I will revisit my code. Thanks for the advise!!! We are migrating to Solr4 soon :) Thanks On Monday, November 25, 2013

Re: Cloning shards => cloning collections

2013-11-25 Thread Otis Gospodnetic
Hi, As a matter of fact, what about exposing a new Collection API CLONE command and having Solr simply copy all the needed shards and replicas at the FS level, would that work (or not because of different Directory implementations that may not all lend themselves to being simply copied)? Thanks,

Re: Trouble with manually routed collection after upgrade to 4.6

2013-11-25 Thread Brett Hoerner
Think I got it. For some reason this was in my clusterstate.json after the upgrade (note that I was using 4.5.X just fine previously...): "router": { "name": "compositeId" }, I stopped all my nodes and manually edited this to me "implicit" (is there a tool for this? I've always d

Re: How To Use Multivalued Field Payload at Boosting?

2013-11-25 Thread Furkan KAMACI
Is there any example for it? 2013/11/25 Markus Jelsma > Solr has no query parsers that support payloads. You would have make your > own query parser and also create a custom similarity implementing > scorePayload for it to work. > > -Original message- > > From:Furkan KAMACI > > Sent: S

Re: Trouble with manually routed collection after upgrade to 4.6

2013-11-25 Thread Brett Hoerner
Here's my clusterstate.json: https://gist.github.com/bretthoerner/a8120a8d89c93f773d70 On Mon, Nov 25, 2013 at 10:18 AM, Brett Hoerner wrote: > Hi, I've been using a collection on Solr 4.5.X for a few weeks and just > did an upgrade to 4.6 and am having some issues. > > First: this collection

Re: ConcurrentModificationException from XMLResponseWriter

2013-11-25 Thread Shawn Heisey
On 11/25/2013 8:43 AM, Shyamsunder R Mutcha wrote: > > > Following exception is found in solr logs. We are using Solr 3.2. As the > stack trace is not referring to any application classes, I couldn't figure > out the piece of code that throws this exception. Is there any way to debug > this is

RE: Multiple data/index.YYYYMMDD.... dirs == bug?

2013-11-25 Thread Markus Jelsma
-Original message- > From:Otis Gospodnetic > Sent: Wednesday 20th November 2013 16:40 > To: solr-user@lucene.apache.org > Subject: Multiple data/index.MMDD dirs == bug? > > Hi, > > When full index replication is happening via SnapPuller, a temporary > "timestamped" index di

Trouble with manually routed collection after upgrade to 4.6

2013-11-25 Thread Brett Hoerner
Hi, I've been using a collection on Solr 4.5.X for a few weeks and just did an upgrade to 4.6 and am having some issues. First: this collection is, I guess, implicitly routed. I do this for every document insert using SolrJ: document.addField("_route_", shardId) After upgrading the servers to

ConcurrentModificationException from XMLResponseWriter

2013-11-25 Thread Shyamsunder R Mutcha
Following exception is found in solr logs. We are using Solr 3.2. As the stack trace is not referring to any application classes, I couldn't figure out the piece of code that throws this exception. Is there any way to debug this issue? Is it related to the issue ConcurrentModificationException

Solr 4.x : how to implement an update processor chain working for partial updates

2013-11-25 Thread paule_lecuyer
In my solr schema I have the following fields defined : ... To fill in the language specific fields, I use a custom update processor chain, with a custom ConditionalCopyProcessor that copies "content" field into appropriate language field, depend

Re: Suggester - how to return exact match?

2013-11-25 Thread Mirko
Thanks! We solved this issue in the front-end now. I.e. we add the exact match to the list of suggestions there. Mirko 2013/11/22 Developer > Might not be a perfect solution but you can use edgengram filter and copy > all > your field data to that field and use it for suggestion. > > position

Re: Parse eDisMax queries for keywords

2013-11-25 Thread Mirko
Hi Jack, thanks for your reply. Ok in this case I agree that "enriching" the query in the application layer is a good idea. We are still a bit puzzled how the enriched query should look like. I'll post here when we found a solution. If somebody has suggestions, I'd be happy to hear them. Mirko 2

Re: Setting solr.data.dir for SolrCloud instance

2013-11-25 Thread Erick Erickson
The first thing I'd do is not send an absolute path. What happens if you just sent -Dsolr.data.dir=data? (no '/')? We had this discussion a while ago when we were working on auto-discovery, and it turns out that there _are_ legitimate cases in which more than one core/collection can point to the s

Setting solr.data.dir for SolrCloud instance

2013-11-25 Thread adfel70
I found something strange while trying to create more than one collection in SolrCloud: I am running every instance with -Dsolr.data.dir=/data If I look at Core Admin section, I can see that I have one core and its dataDir is set to this fixed location. Problem is, if I create a new collection, ano

syncronization between replicas

2013-11-25 Thread adfel70
Hi, We currently running tests on solr to find as many problems in our solr environment so we can be ready for these kind of problems in production, anyway we found an edge case and have few questions about it. We have one collection with two shards, each shard with replica factor 2. we are send

FYI real-time get handler is needed for Solr cloud recovery.

2013-11-25 Thread Daniel Collins
Just had an issue on our Solr cloud and wanted to point this out to the list at large. The real-time "/get" handler is used by Solr Cloud's sync/recovery mechanism, so *DO NOT* remove it from SolrConfig if you are using Solr Cloud! We did (because we weren't using real-time get ourselves and we w

RE: How To Use Multivalued Field Payload at Boosting?

2013-11-25 Thread Markus Jelsma
Solr has no query parsers that support payloads. You would have make your own query parser and also create a custom similarity implementing scorePayload for it to work. -Original message- > From:Furkan KAMACI > Sent: Sunday 24th November 2013 19:07 > To: solr-user@lucene.apache.org >

Re: distributed search is significantly slower than direct search

2013-11-25 Thread Manuel Le Normand
https://issues.apache.org/jira/browse/SOLR-5478 There it goes On Mon, Nov 18, 2013 at 5:44 PM, Manuel Le Normand < manuel.lenorm...@gmail.com> wrote: > Sure, I am out of office till end of week. I reply after i upload the patch >

In a functon query, I can't get the ValueSource when extend ValueSourceParser

2013-11-25 Thread sling
hi, I am working with solr4.1. When I don't parseValueSource, my function query works well. The code is like this: public class DateSourceParser extends ValueSourceParser { @Override public void init(NamedList namedList) { } @Override *public ValueSource pars

Solution for "MM ignored in edismax queries with operators" ?

2013-11-25 Thread Anca Kopetz
Hi, We found a possible solution for SOLR-2649 : MM ignored in edismax queries with operators. The details are here https://issues.apache.org/jira/browse/SOLR-2649?focusedCommentId=13822482&page=com.atlassian.jira.plugin.system.issuetabpanels:co

RE: Can I use boosting fields with edismax ?

2013-11-25 Thread Doug Turnbull
Amit its important to note that dismax/edismax isn't giving you a weighted average of these field score. Without the tie parameter one fields score is likely always "winning" the dismax contest. Field scores are relative, so 5 could be an amazing score for say "title" while 500 a terrible score for