Can we manipulate termfreq to count as 1 for multiple matches?

Hi All I am wondering if there is a way to alter term frequency of a certain field as 1, even if there are multiple matches in that document? Use Case is: Let's say that I have a document with 2 fields - Name and - Description And, there is a document with data like this Document_1 Name = Blu

Re: can we configure spellcheck to be invoked after request processing?

gram Content Group > (615) 213-4311 > > > -Original Message- > From: roz dev [mailto:rozde...@gmail.com] > Sent: Thursday, February 28, 2013 6:33 PM > To: solr-user@lucene.apache.org > Subject: can we configure spellcheck to be invoked after request > processing? >

Re: How to re-read the config files in Solr, on a commit

eally, if using > index-time synonyms. And if you're using search-time synonyms you have > multi-word synonym issue described on the Wiki. > > Otis > -- > Performance Monitoring - http://sematext.com/spm > On Nov 6, 2012 11:02 PM, "roz dev" wrote: > > > Eri

Re: How to re-read the config files in Solr, on a commit

ing > them on commit sounds like a way to make for a very confusing application! > > But if you really need to re-read all this info on a running system, > consider the core admin RELOAD command. > > Best > Erick > > > On Mon, Nov 5, 2012 at 8:43 PM, roz dev wrote:

Re: How to change the boost of fields in edismx at runtime

Thanks Hoss. Yes, that approach would work as I can change the query. Is there a way to extend the Edismax Handler to read a config file at startup and then use some events like commit to instruct edismax handler to re-read the config file. That way, I can ensure that my boost params are just on

Re: SolrJ - IOException

I have seen this happening We retry and that works. Is your solr server stalled? On Mon, Sep 24, 2012 at 4:50 PM, balaji.gandhi wrote: > Hi, > > I am encountering this error randomly (under load) when posting to Solr > using SolrJ. > > Has anyone encountered a similar error? > > org.apache.solr.

IndexDocValues in Solr

Changing the Subject Line to make it easier to understand the topic of the message is there any plan to expose IndexDocValues as part of Solr 4? Any thoughts? -Saroj On Thu, Aug 2, 2012 at 5:10 PM, roz dev wrote: > As we all know, FIeldCache can be costly if we have lots of documents

Re: Memory leak?? with CloseableThreadLocal with use of Snowball Filter

On Tue, Jul 31, 2012 at 2:34 PM, roz dev wrote: > > Hi All > > > > I am using Solr 4 from trunk and using it with Tomcat 6. I am noticing > that > > when we are indexing lots of data with 16 concurrent threads, Heap grows > > continuously. It remains high and

Re: solr/tomcat stops responding

You are referring to a very old thread Did you take any heap dump and thread dumo? They can help you get more insight. -Saroj On Tue, Jul 31, 2012 at 9:04 AM, Suneel wrote: > Hello Kevin, > > I am also facing same problem After few hours or few day my solr server > getting crash. > I try t

Memory leak?? with CloseableThreadLocal with use of Snowball Filter

Hi All I am using Solr 4 from trunk and using it with Tomcat 6. I am noticing that when we are indexing lots of data with 16 concurrent threads, Heap grows continuously. It remains high and ultimately most of the stuff ends up being moved to Old Gen. Eventually, Old Gen also fills up and we start

Re: too many instances of "org.tartarus.snowball.Among" in the heap

.html Any inputs are welcome -Saroj On Mon, Jul 30, 2012 at 4:39 PM, roz dev wrote: > I did take couple of thread dumps and they seem to be fine > > Heap dump is huge - close to 15GB > > I am having hard time to analyze that heap dump > > 2012-07-30 16:07:32 > Full thread

Re: too many instances of "org.tartarus.snowball.Among" in the heap

wnable synchronizers: - None On Fri, Jul 27, 2012 at 5:19 AM, Alexandre Rafalovitch wrote: > Try taking a couple of thread dumps and see where in the stack the > snowball classes show up. That might give you a clue. > > Did you customize the parameters to the stemmer? If so, may

too many instances of "org.tartarus.snowball.Among" in the heap

Hi All I am trying to find out the reason for very high memory use and ran JMAP -hist It is showing that i have too many instances of org.tartarus.snowball.Among Any ideas what is this for and why am I getting so many of them num #instances#bytes Class description ---

Re: leaks in solr

t; On Thu, Jul 26, 2012 at 6:15 PM, Karthick Duraisamy Soundararaj > wrote: > > Mark, > > We use solr 3.6.0 on freebsd 9. Over a period of time, it > > accumulates lots of space! > > > > On Thu, Jul 26, 2012 at 8:47 PM, roz dev wrote: > > > >

Re: leaks in solr

5:12 PM, Mark Miller wrote: > I'd take a look at this issue: > https://issues.apache.org/jira/browse/SOLR-3392 > > Fixed late April. > > On Jul 26, 2012, at 7:41 PM, roz dev wrote: > > > it was from 4/11/12 > > > > -Saroj > > > &g

Re: leaks in solr

it was from 4/11/12 -Saroj On Thu, Jul 26, 2012 at 4:21 PM, Mark Miller wrote: > > On Jul 26, 2012, at 3:18 PM, roz dev wrote: > > > Hi Guys > > > > I am also seeing this problem. > > > > I am using SOLR 4 from Trunk and seeing this issue repeat eve

Re: leaks in solr

Hi Guys I am also seeing this problem. I am using SOLR 4 from Trunk and seeing this issue repeat every day. Any inputs about how to resolve this would be great -Saroj On Thu, Jul 26, 2012 at 8:33 AM, Karthick Duraisamy Soundararaj < karthick.soundara...@gmail.com> wrote: > Did you find any m

Re: Issue with field collapsing in solr 4 while performing distributed search

I think that there is no way around doing custom logic in this case. If indexing process knows that documents have to be grouped then they better be together. -Saroj On Mon, Jun 11, 2012 at 6:37 AM, Nitesh Nandy wrote: > Martijn, > > How do we add a custom algorithm for distributing documents

Re: How to do custom sorting in Solr?

ubt very much given your > problem description. > > So with a corpus that size, I'd "just try it'. > > Best > Erick > > On Sun, Jun 10, 2012 at 7:12 PM, roz dev wrote: > > Thanks Erik for your quick feedback > > > > When Products are assigned to

Re: How to do custom sorting in Solr?

uot;products which are on markdown, are at > the bottom of the documents list" > > But in your examples, products on "markdown" are intermingled > > Best > Erick > > On Sun, Jun 10, 2012 at 3:36 AM, roz dev wrote: > > Hi All > > > >> &

Re: How to do custom sorting in Solr?

Hi All > > I have an index which contains a Catalog of Products and Categories, with > Solr 4.0 from trunk > > Data is organized like this: > > Category: Books > > Sub Category: Programming > > Products: > > Product # 1, Price: Regular Sort Order:1 > Product # 2, Price: Markdown, Sort Order:2 >

Is there any performance cost of using lots of OR in the solr query

Hi All, I am working on an application which makes few solr calls to get the data. On the high level, We have a requirement like this - Make first call to Solr, to get the list of products which are children of a given category - Make 2nd solr call to get product documents based on a l

Solr Cloud, Commits and Master/Slave configuration

Hi All, I am trying to understand features of Solr Cloud, regarding commits and scaling. - If I am using Solr Cloud then do I need to explicitly call commit (hard-commit)? Or, a soft commit is okay and Solr Cloud will do the job of writing to disk? - Do We still need to use Master

Re: hot deploy of newer version of solr schema in production

s huge and the reason for Solr upgrade or schema > change is to fix a bug, not to use new functionality. > > -- > Jan Høydahl, search solution architect > Cominvent AS - www.cominvent.com > Solr Training - www.solrtraining.com > > On 24. jan. 2012, at 01:51, roz dev wrote:

hot deploy of newer version of solr schema in production

Hi All, I need community's feedback about deploying newer versions of solr schema into production while existing (older) schema is in use by applications. How do people perform these things? What has been the learning of people about this. Any thoughts are welcome. Thanks Saroj

Index format difference between 4.0 and 3.4

Hi All, We are using Solr 1.4.1 in production and are considering an upgrade to newer version. It seems that Solr 3.x requires a complete rebuild of index as the format seems to have changed. Is Solr 4.0 index file format compatible with Solr 3.x format? Please advise. Thanks Saroj

Re: Production Issue: SolrJ client throwing this error even though field type is not defined in schema

t; > > > http://wiki.apache.org/solr/UsingMailingLists > > > > There's really not much to go on here. > > > > Best > > Erick > > > > On Wed, Sep 21, 2011 at 12:13 PM, roz dev wrote: > >> Hi All > >> > >> We are getting

Re: Production Issue: SolrJ client throwing - Element type must be followed by either attribute specifications, ">" or "/>".

Wanted to update the list with our finding. We reduced the number of documents which are being retrieved from Solr and this error did not appear again. Might be the case that due to high number of documents, solr is returning incomplete documents. -Saroj On Wed, Sep 21, 2011 at 12:13 PM, roz

Production Issue: SolrJ client throwing this error even though field type is not defined in schema

Hi All We are getting this error in our Production Solr Setup. Message: Element type "t_sort" must be followed by either attribute specifications, ">" or "/>". Solr version is 1.4.1 Stack trace indicates that solr is returning malformed document. Caused by: org.apache.solr.client.solrj.SolrSer

q and fq in solr 1.4.1

Hi All I am sure that q vs fq question has been answered several times. But, I still have a question which I would like to know the answers for: if we have a solr query like this q=*&fq=field_1:XYZ&fq=field_2:ABC&sortBy=field_3+asc How does SolrIndexSearcher fire query in 1.4.1 Will it fire q

cache invalidation in slaves

Hi All Solr has different types of caches such as filterCache, queryResultCache and document Cache . I know that if a commit is done then a new searcher is opened and new caches are built. And, this makes sense. What happens when commits are happening on master and slaves are pulling all the delt

what is the default value of omitNorms and termVectors in solr schema

Hi As per this document, http://wiki.apache.org/solr/FieldOptionsByUseCase, omitNorms and termVectors have to be "explicitly" specified in some cases. I am wondering what is the default value of these settings if solr schema definition does not state them. *Example:* In above case, will Solr

Re: Does Solr flush to disk even before ramBufferSizeMB is hit?

Thanks Shawn. If Solr writes this info to Disk as soon as possible (which is what I am seeing) then ramBuffer setting seems to be misleading. Anyone else has any thoughts on this? -Saroj On Mon, Aug 29, 2011 at 6:14 AM, Shawn Heisey wrote: > On 8/28/2011 11:18 PM, roz dev wrote: >

Does Solr flush to disk even before ramBufferSizeMB is hit?

Hi All, I am trying to tune ramBufferSizeMB and merge factor for my setup. So, i enabled Lucene Index Writer's log info stream and started monitoring Data folder where index files are created. I started my test with following Heap: 3GB Solr 1.4.1, Index Size = 20 GB, ramBufferSizeMB=856 Merge Fac

SolrJ Question about Bad Request Root cause error

Hi All We are using SolrJ client (v 1.4.1) to integrate with our solr search server. We notice that whenever SolrJ request does not match with Solr schema, we get Bad Request exception which makes sense. org.apache.solr.common.SolrException: Bad Request But, SolrJ Client does not provide any clu