Re: FieldFlags QueryComponent

2012-12-13 Thread nihed mbarek
Can any one help me ?? On Mon, Dec 10, 2012 at 10:07 AM, nihed mbarek nihe...@gmail.com wrote: Hi, What is the utility of FieldFlags on ResponseBuilder ?? I saw a set on QueryComponent and want to have more information about this attribute. Regards,

RE: Solr3 and solr4 side by side in tomcat on windows

2012-12-13 Thread Gian Maria Ricci
Thanks to everyone for the suggestions, :). Gian Maria -Original Message- From: Upayavira [mailto:u...@odoko.co.uk] Sent: mercoledì 12 dicembre 2012 14:49 To: solr-user@lucene.apache.org Subject: Re: Solr3 and solr4 side by side in tomcat on windows You will need to create a context

Re: score calculation

2012-12-13 Thread Aloke Ghoshal
Hi Tom, This is great. Should make it to the documentations. Regards, Aloke On Thu, Dec 13, 2012 at 1:23 PM, Burgmans, Tom tom.burgm...@wolterskluwer.com wrote: I am also busy with getting this clear. Here are my notes so far (by copying and writing myself): queryWeight = the impact

Re: fieldType custom search

2012-12-13 Thread Tomás Fernández Löbbe
What do you mean? Could you explain your use case? Tomás On Thu, Dec 13, 2012 at 9:36 AM, nihed mbarek nihe...@gmail.com wrote: Hello, Is it possible to define a custom search for a fieldType on a schema ? ? Regards, -- M'BAREK Med Nihed

Re: fieldType custom search

2012-12-13 Thread nihed mbarek
actually, I have as schema albums with artist / album_name / album_description When I made a search without query the result is (having the some score) : artist A artist A artist A artist B artist B artist B artist C artist C = depends on my indexing process what I want as result : artist A

Re: Update / replication of offline indexes

2012-12-13 Thread Alexandre Rafalovitch
Not sure I fully understood this and maybe you already cover that by 'merge', but if you know what you gave the client last time, you can just build a differential as a second core, then on client mount that second core and merge it into the first one (e.g. with DIH). Just a thought. Regards,

Re: fieldType custom search

2012-12-13 Thread Tomás Fernández Löbbe
If you want that exact circular result I think the only option is to have an extra field, pre calculated (according to these needs, for example, incrementing a value for each document for the same artist or something like that) and sort on that field. If what you need is to show the artists,

Strange data-loss problem on one of our cores

2012-12-13 Thread John Nielsen
Hi all, We are seeing a strange problem on our 2-node solr4 cluster. This problem has resultet in data loss. We have two servers, varnish01 and varnish02. Zookeeper is running on varnish02, but in a separate jvm. We index directly to varnish02 and we read from varnish01. Data is thus replicated

Re: Strange data-loss problem on one of our cores

2012-12-13 Thread Mark Miller
Couple things to start: By default SolrCloud distributes updates a doc at a time. So if you have 1 shard, whatever node you index too, it will send updates to the other. Replication is only used for recovery, not distributing data. So for some reason, there is an IOException when it tries to

Re: The shard called `properties`

2012-12-13 Thread Yonik Seeley
On Thu, Dec 6, 2012 at 12:03 PM, Mark Miller markrmil...@gmail.com wrote: Yeah, the main problem with it didn't really occur to me until I saw the properties shard in the cluster view. I started working on the UI to ignore it the other day and then never got there because I was getting all

Re: Can a field with defined synonym be searched without the synonym?

2012-12-13 Thread Walter Underwood
Perhaps you could use two indexed fields, one with synonym expansion and one without. wunder On Dec 12, 2012, at 11:33 PM, Burgmans, Tom wrote: In our case it's the opposite. For our clients it is very important that every synonym gets equal chances in the relevancy calculation. The fact

Re: score calculation

2012-12-13 Thread Chris Hostetter
: Can anyone explain or provide some links? https://wiki.apache.org/solr/SolrRelevancyFAQ#How_are_documents_scored -Hoss

How to configure termvectors to not store positions/offsets

2012-12-13 Thread Tom Burton-West
Hello, As I understand it, MoreLikeThis only requires term frequencies, not positions or offsets. So in order to save disk space I would like to store termvectors, but without positions and offsets. Is there documentation somewhere that 1) would confirm that MoreLikeThis only needs term

Re: Searching for phrase

2012-12-13 Thread Jack Krupansky
Try the Solr Admin Analyzer page to see how Solr is indexing that text. I suspect that the ShingleFilter is generating extra terms with positions so that PhraseQuery no longer sees the two terms from your quoted phrase as being adjacent. Your second query is simply generating a Boolean AND or

Re: Solrj connect to already running solr server

2012-12-13 Thread Chris Hostetter
: I am trying to use the EmbeddedSolrServer to connect to the general : core that is already running: that is not going to work. EmbeddedSolrServer is solely for running solr entirely contained inside your application, w/o using a servlet container -- it doesn't support any of the HTTP based

Re: SEVER error when stopping tomcat using solr webapp

2012-12-13 Thread davers
The only custom code I have are 3 custom transformers for my DIH. Here is the code. package org.build.com.solr; /** * Licensed to the Apache Software Foundation (ASF) under one or more * contributor license agreements. See the NOTICE file distributed with * this work for additional

Is replication an atomic operation?

2012-12-13 Thread Lan
In our current architecture, we use a staging core to perform full re-indexes while the live core continues to serve queries. After a full re-index we use the core admin to swap the live and stage index. Both the live and stage core are on the same solr instance. In our new architecture we want

Re: Is replication an atomic operation?

2012-12-13 Thread Otis Gospodnetic
As far as I know, if replication fails, the old index will still be used. There will be some performance impact during replication simply because of network and disk IO, and of course the JVM Solr is in will be doing more work. But I think you can throttle replication. or maybe not, I can't

Re: fieldType custom search

2012-12-13 Thread Otis Gospodnetic
Hi, We've done something very similar to this before. We implemented it as a custom SearchComponent with a pluggable hit (re)ordering mechanism. Otis -- SOLR Performance Monitoring - http://sematext.com/spm/index.html Search Analytics - http://sematext.com/search-analytics/index.html On

Re: SEVER error when stopping tomcat using solr webapp

2012-12-13 Thread Chris Hostetter
: SEVERE: The web application [/apache-solr-4.0.0] created a ThreadLocal with : key of type [org.apache.solr.schema.DateField.ThreadLocalDateFormat] (value It's a long standing issue... https://issues.apache.org/jira/browse/SOLR-2357 In practice it shouldn't really cause you any problems.

Re: Update / replication of offline indexes

2012-12-13 Thread Dikchant Sahi
Hi Alex, You got my point right. What I see is merge adds duplicate document. Is there a way to overwrite existing document in one core by another. Can merge operation lead to data corruption, say in case when the core on client had uncommitted changes. What would be a better solution for my

Re: Update / replication of offline indexes

2012-12-13 Thread Alexandre Rafalovitch
Do you have IDs defined? How do you expect Sold to know they are duplicate records? Maybe the issue is there somewhere. Regards, Alex On 13 Dec 2012 15:17, Dikchant Sahi contacts...@gmail.com wrote: Hi Alex, You got my point right. What I see is merge adds duplicate document. Is there a

if I only need exact search, does frequency/score matter?

2012-12-13 Thread Jie Sun
this is related to my previous post where I did not get any feedback yet... I am going through a practice to reduce the disk usage by solr index files. first step I took was to move some fields from stored to not stored. this reduced the size of .fdt by 30-60%. very promising... however I

Can a Solr (4.0.0) query return position details of matches within a text field

2012-12-13 Thread Michael Willekes
I am indexing documents with Solr 4.0 and also processing the text using a set of custom entity extractors (people, places, dates, times, etc). The text field in Solr has Term Vectors enabled as well as term positions and offsets, primarily so we can make use of Fast Vector Highlighting. So far,

solr faceting sum function

2012-12-13 Thread cmd.ares
lucene index structure: product_name type price --- iphone4s mobile 2000 iphone5 mobile 5000 S3 mobile 3000 intel i3 pc 1000 intel i5

Re: solr faceting sum function

2012-12-13 Thread Jack Krupansky
You could do it... if you wrote your own ValueSource that went out and did the sum of the named field for the selected documents end then you could use it in a function query in the fl field list. -- Jack Krupansky -Original Message- From: cmd.ares Sent: Thursday, December 13, 2012

Re: solr faceting sum function

2012-12-13 Thread Markus Mirsberger
Hi, You can add stats=truestats.field=type to your query. Then you get a stats section in your result which includes the sum of the choosen field. Cheers, Markus cmd.ares cmd.a...@gmail.com wrote: lucene index structure: product_name type price

Re: solr faceting sum function

2012-12-13 Thread Jack Krupansky
And add stats.facet=type - and then you would get a sum of price for each type. So, ?q=*:*stats=truestats.field=pricestats.facet=type -- Jack Krupansky -Original Message- From: Markus Mirsberger Sent: Thursday, December 13, 2012 11:41 PM To: solr-user@lucene.apache.org Subject:

facet count distinct and sum group by field

2012-12-13 Thread cmd.ares
lucene index structure: product_name type price --- iphone4s mobile 2000 iphone4s mobile 1500 iphone5 mobile 5000 iphone5 mobile 5000 S3

Re: Update / replication of offline indexes

2012-12-13 Thread Dikchant Sahi
Yes, we have an uniqueId defined but merge adds two documents with the same id. As per my understanding this is how Solr behaves. Correct me if am wrong. On Fri, Dec 14, 2012 at 2:25 AM, Alexandre Rafalovitch arafa...@gmail.comwrote: Do you have IDs defined? How do you expect Sold to know they

Re: score calculation

2012-12-13 Thread Sangeetha
Using Toms reply i have got most of the terms, The following is my understanding of a single doc score, 5.528805 = (MATCH) sum of: (sum of scores = 0.08775589 + 5.441049) 0.08775589 = (MATCH) weight(text:sachin in 286) [DefaultSimilarity], result of: 0.08775589 = score(doc=286,freq=2.0 =

Solr PHP client

2012-12-13 Thread Romita Saha
Hi, Can anyone please guide me to use SolrPhpClient? The documents available are not clear. As to where to place SolrPhpClient? I have downloaded SolrPhpClient and have changed the following lines, specifying the path (where the files are present in my computer)