Re: OR query with null value and non-null value(s)

2013-06-07 Thread Rahul R
Thank you for the Clarification Shawn. On Fri, Jun 7, 2013 at 7:34 PM, Jack Krupansky wrote: > Yes, it SHOULD! And in the LucidWorks Search query parser it does. Why > doesn't it in Solr? Ask Yonik to explain that! > > -- Jack Krupansky > > -Original Message---

Re: OR query with null value and non-null value(s)

2013-06-06 Thread Rahul R
Fri, Jun 7, 2013 at 12:07 AM, Shawn Heisey wrote: > On 6/6/2013 12:28 PM, Rahul R wrote: > >> I have recently enabled facet.missing=true in solrconfig.xml which gives >> null facet values also. As I understand it, the syntax to do a faceted >> search on a null value is

OR query with null value and non-null value(s)

2013-06-06 Thread Rahul R
I have recently enabled facet.missing=true in solrconfig.xml which gives null facet values also. As I understand it, the syntax to do a faceted search on a null value is something like this: &fq=-price:[* TO *] So when I want to search on a particular value (for example : 4) OR null value, I would

Re: facet.missing=true returns null records with zero count also

2013-06-05 Thread Rahul R
Hoss, We rely heavily on facet.mincount because once a user has selected a facet, it doesn't make sense for us to show that facet field to him and let him filter again with the same facet. Also, when a facet has only one value, it doesn't make sense to show it to the user, since searching with that

facet.missing=true returns null records with zero count also

2013-06-04 Thread Rahul R
All, We had a requirement in our solr powered application where customers want to see all the documents that have a blank value for a field. So when they facet on a field, if the field has null values, they should be able select that facet value and see all documents. I thought facet.missing=true w

Solr Caches

2012-05-15 Thread Rahul R
Hello, I am trying to understand how I can size the caches for my solr powered application. Some details on the index and application : Solr Version : 1.3 JDK : 1.5.0_14 32 bit OS : Solaris 10 App Server : Weblogic 10 MP1 Number of documents : 1 million Total number of fields : 1000 (750 strings, 2

Re: Lucene FieldCache - Out of memory exception

2012-05-08 Thread Rahul R
y I can improve faceting performance with all my fields as multiValued fields ? Appreciate any help on this. Thank you. - Rahul On Mon, May 7, 2012 at 7:23 PM, Rahul R wrote: > Jack, > Sorry for the delayed response: > Total memory allocated : 3GB > Free Memory on startup of appl

Re: Lucene FieldCache - Out of memory exception

2012-05-07 Thread Rahul R
ts.) Just to see how close you are to "the > edge" even before a volume of queries start coming in. > > > -- Jack Krupansky > > -Original Message- From: Rahul R > Sent: Thursday, May 03, 2012 1:28 AM > > To: solr-user@lucene.apache.org > Subject: Re:

Re: Lucene FieldCache - Out of memory exception

2012-05-02 Thread Rahul R
3 GB sounds like it might not be enough for such heavy use of faceting. It > is probably not the 50-70 number, but the 440 or accumulated number across > many queries that pushes the memory usage up. > > When you hit OOM, what does the Solr admin stats display say for > FieldCa

Re: Lucene FieldCache - Out of memory exception

2012-05-01 Thread Rahul R
facet.field=F_P1946367030&facet.field=S_P1406453569&facet.field=S_P2017662626&facet.field=S_P1406389978&facet.field=F_P1946367024 My primary question here is, can Solr handle this kind of queries with so many facet fields. I have tried using both enum and fc for facet.method and there i

Re: get a total count

2012-05-01 Thread Rahul R
Hello, A related question on this topic. How do I programmatically find the total number of documents across many shards ? For EmbeddedSolrServer, I use the following command to get the total count : solrSearcher.getStatistics().get("numDocs") With distributed search, how do i get the count of all

Lucene FieldCache - Out of memory exception

2012-04-30 Thread Rahul R
Hello, I am using solr 1.3 with jdk 1.5.0_14 and weblogic 10MP1 application server on Solaris. I use embedded solr server. More details : Number of docs in solr index : 1.4 million Physical size of index : 640MB Total number of fields in the index : 700 (99% of these are dynamic fields) Total numbe

License Info

2011-11-11 Thread Rahul R
Hello, Since Apache Solr is governed by Apache License 2.0 - does it mean that all jar files bundled within Solr are also governed by the same License ? Do I have to worry about checking the License information of all bundled jar files in my commercial Solr powered application ? Even if I use them

Re: IndexSearcher and Caches

2010-05-25 Thread Rahul R
Chris, I am using SolrIndexSearcher to get a handle to the total number of records in the index. I am doing it like this : int num = Integer.parseInt((String)solrSearcher.getStatistics().get("numDocs").toString()); Please let me know if there is a better way to do this. Mark, I can tell you what I

Re: IndexSearcher and Caches

2010-05-24 Thread Rahul R
Thank you I found the API to get the existing SolrIndexSearcher to be present in SolrCore: SolrCore.getSearcher().get() So if now the Index changes (a commit is done) in between, will I automatically get the new SolrIndexSearcher from this call ? Regards Rahul On Mon, May 24, 2010 at 11:25

Re: IndexSearcher and Caches

2010-05-24 Thread Rahul R
<> I have an application deployed on an application server (Weblogic). This application uses solr to query an index. Users (sessions) will log in to the application, query and then log out. This login and logout has nothing to do with solr but the application manages them separately. I am using Emb

Re: IndexSearcher and Caches

2010-05-23 Thread Rahul R
Mitch, Thank you for your response. A few follow up questions for clarification : <> In my case, I have an index which will not be modified after creation. Does this mean that in a multi-user scenario, I can have a static IndexSearcher object that can be shared by multiple users ? <> If the Index

IndexSearcher and Caches

2010-05-20 Thread Rahul R
Hello all, I have a few questions w.r.t the caches and the IndexSearcher available in solr. I am using solr 1.3. - The solr wiki states that the caches are per IndexSearcher object i.e if I set my filterCache size to 1000 it means that 1000 entries can be assigned for every IndexSearcher object. Is

Re: Trouble Configuring WordDelimiterFilterFactory

2009-11-29 Thread Rahul R
rds to "0", the way term texts are created for ".355" does not change. Thank you for your time. Regards Rahul On Sun, Nov 29, 2009 at 1:07 AM, Steven A Rowe wrote: > Hi Rahul, > > On 11/26/2009 at 12:53 AM, Rahul R wrote: > > Is there a way by which I can

Re: Trouble Configuring WordDelimiterFilterFactory

2009-11-25 Thread Rahul R
Hello, Would really appreciate any inputs/suggestions on this. Thank you. On Tue, Nov 24, 2009 at 10:59 PM, Rahul R wrote: > Hello, > In our application we have a catch-all field (the 'text' field) which is > cofigured as the default search field. Now this field will have

Trouble Configuring WordDelimiterFilterFactory

2009-11-24 Thread Rahul R
Hello, In our application we have a catch-all field (the 'text' field) which is cofigured as the default search field. Now this field will have a combination of numbers, alphabets, special characters etc. I have a requirement wherein the WordDelimiterFilterFactory does not work on numbers, especial

Re: Measuring timing with debugQuery=true

2009-09-29 Thread Rahul R
can look to improve accordingly. Thank you. Regards Rahul On Tue, Sep 29, 2009 at 7:12 PM, Rahul R wrote: > Sorry for the delayed response > ** > *How big are your documents?* > I have totally 1 million documents. I have totally 1950 fields in the > index. Every document woul

Re: Measuring timing with debugQuery=true

2009-09-29 Thread Rahul R
878&facet.field=S9156&facet.field=S0369&facet.field=S9926&facet.field=S1421&facet.field=S8990&facet.field=S6881&facet.field=S3552&debugQuery=true Other information Solr 1.3, JDK 1.5.0_14 regards Rahul On Mon, Sep 28, 2009 at 6:48 PM, Yonik Seeley wrote: > On Mon,

Re: Measuring timing with debugQuery=true

2009-09-28 Thread Rahul R
documents are you retrieving? Reading stored fields for > documents can be slow if they aren't cached by the OS since it's often > a disk seek per document read for a large index. > > -Yonik > http://www.lucidimagination.com > > > > On Sun, Sep 27, 2009 at 3:41

Measuring timing with debugQuery=true

2009-09-27 Thread Rahul R
Hello, I am trying to measure why some of my queries take a long time. I am using EmbeddedSolrServer and with logging statements before and after the EmbeddedSolrServer.query(SolrQuery) function, I have found the time to be around 16s. I added the debugQuery=true and the timing component for this r

Question on omitNorms definition

2009-09-18 Thread Rahul R
Hello, A rather trivial question on omitNorms parameter in schema.xml. The out-of-the-box schema.xml uses this parameter during both within the tag and tag and If we define the omitNorms during the fieldType definition, will it hold good for all fields that are defined using the same fieldType.

Re: Questions on copyField

2009-09-17 Thread Rahul R
Thank you Shalin. Regards Rahul On Thu, Sep 17, 2009 at 11:49 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Thu, Sep 17, 2009 at 11:19 AM, Rahul R wrote: > > > Shalin, > > Can you please elaborate a little more on the third response > > *You

Re: Questions on copyField

2009-09-16 Thread Rahul R
On Wed, Sep 16, 2009 at 1:56 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Mon, Sep 14, 2009 at 5:12 PM, Rahul R wrote: > > > Hello, > > I have a few questions regarding the copyField directive in schema.xml > > > > 1. Does the destination field store

Re: Questions on copyField

2009-09-15 Thread Rahul R
Would appreciate any help on this. Thanks Rahul On Mon, Sep 14, 2009 at 5:12 PM, Rahul R wrote: > Hello, > I have a few questions regarding the copyField directive in schema.xml > > 1. Does the destination field store a reference or the actual data ? > If I have soemthing like

Questions on copyField

2009-09-14 Thread Rahul R
Hello, I have a few questions regarding the copyField directive in schema.xml 1. Does the destination field store a reference or the actual data ? If I have soemthing like this then will the values in the 'name' field get copied into the 'text' field or will the 'text' field only store a referenc

Re: Monitoring split time for fq queries when filter cache is used

2009-09-01 Thread Rahul R
Thank you Martijn. On Tue, Sep 1, 2009 at 8:07 PM, Martijn v Groningen < martijn.is.h...@gmail.com> wrote: > Hi Rahul, > > Yes you are understanding is correct, but it is not possible to > monitor these actions separately with Solr. > > Martijn > > 2009/9/1 Rahul R

Monitoring split time for fq queries when filter cache is used

2009-08-31 Thread Rahul R
Hello, I am trying to measure the benefit that I am getting out of using the filter cache. As I understand, there are two major parts to an fq query. Please correct me if I am wrong : - doing full index queries of each of the fq params (if filter cache is used, this result will be retrieved from th

Re: Implementing a logout

2009-08-24 Thread Rahul R
*"release any SOLR resources" - no need.* My query is answered. Thank you. Regards Rahul On Mon, Aug 24, 2009 at 12:32 AM, Fuad Efendi wrote: > Truly correct: > > - SOLR does not create HttpSession for user access to Admin screens (do we > have any other screens of UI?) > - SolrCore is shared

Re: Implementing a logout

2009-08-23 Thread Rahul R
n one of many users (of > another > >> application) logs off? > >> > >> Usually one needs to clean up only user-session specific objects (such > as > >> non-persistent shopping cart)... > >> > >> > >> -Original Message- >

Implementing a logout

2009-08-20 Thread Rahul R
Hello, Can somebody give me some pointers on the Solr objects I need to clean up/release while doing a logout on a Solr Application. I find that only the SolrCore object has a close() method. I typically do a lot of faceting queries on a large dataset with my application. I am using Solr 1.3.0. Re

Re: JVM Heap utilization & Memory leaks with Solr

2009-08-20 Thread Rahul R
elds are empty for most of documents... > Applicable to non-tokenized single-valued non-boolean fields only, Lucene > internals, FieldCache... and it won't be GC-collected after user log-off... > prefer dedicated box for SOLR. > > -Fuad > > > -Original Message- > From

Re: JVM Heap utilization & Memory leaks with Solr

2009-08-19 Thread Rahul R
l catches "Throwable": > >} catch (Throwable e) { > SolrException.log(log,e); > sendErr(500, SolrException.toStr(e), request, response); >} finally { > > > > > > Rahul R wrote: > > > > Otis, > > Thank you for your response. I k

Re: JVM Heap utilization & Memory leaks with Solr

2009-08-16 Thread Rahul R
t least!) > > > I didn't notice any memory leaks after I started to use 16Gb RAM for SOLR > instance (almost a year without any restart!) > > > > > -Original Message- > From: Rahul R [mailto:rahul.s...@gmail.com] > Sent: August-13-09 1:25 AM > To: solr-u

Re: JVM Heap utilization & Memory leaks with Solr

2009-08-12 Thread Rahul R
s a try and see how it goes. Thanks for your input. Rahul On Wed, Aug 12, 2009 at 2:15 PM, Gunnar Wagenknecht wrote: > Rahul R schrieb: > > I tried using a profiling tool - Yourkit. The trial version was free for > 15 > > days. But I couldn't find anything of significanc

Re: JVM Heap utilization & Memory leaks with Solr

2009-08-04 Thread Rahul R
ng with the JVM here. :) > > Try jmap -histo:live PID-HERE | less and see what's using your memory. > > Otis > -- > Sematext is hiring -- http://sematext.com/about/jobs.html?mls > Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR > > > > -

Re: Rotating the primary shard in /solr/select

2009-08-04 Thread Rahul R
Shalin, thank you for the clarification. Philip, I just realized that I have diverted the original topic of the thread. My apologies. Regards Rahul On Tue, Aug 4, 2009 at 3:35 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Tue, Aug 4, 2009 at 2:37 PM, Rahul

Re: Rotating the primary shard in /solr/select

2009-08-04 Thread Rahul R
the request is first sent to the server (with which SolrServer is initialized) and from there it is sent to all the other shards ? Regards Rahul On Tue, Aug 4, 2009 at 2:29 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > On Tue, Aug 4, 2009 at 11:26 AM, Rahul R wrote: &g

Re: Rotating the primary shard in /solr/select

2009-08-03 Thread Rahul R
Philip, I cannot answer your question, but I do have a question for you. Does aggregation happen at the primary shard ? For eg : if I have three JVMs JVM 1 : My application powered by Solr JVM 2 : Shard 1 JVM 3 : Shard 2 I initialize my SolrServer like this SolrServer _solrServer = *new* CommonsHt

JVM Heap utilization & Memory leaks with Solr

2009-08-03 Thread Rahul R
I am trying to track memory utilization with my Application that uses Solr. Details of the setup : -3rd party Software : Solaris 10, Weblogic 10, jdk_150_14, Solr 1.3.0 - Hardware : 12 CPU, 24 GB RAM For testing during PSR I am using a smaller subset of the actual data that I want to work with. D

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Rahul R
;Erik > > > On Jul 31, 2009, at 10:00 AM, Rahul R wrote: > > In a production environment, having the caches enabled makes a lot of >> sense. >> And most definitely we will be enabling them. However, the primary idea of >> this exercise is to verify if lim

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Rahul R
to around 10 seconds. This really helped. Thanks a lot ! Regards Rahul On Fri, Jul 31, 2009 at 6:34 PM, Erik Hatcher wrote: > > On Jul 31, 2009, at 7:17 AM, Rahul R wrote: > > Erik, >> I understand that caching is going to improve performance. Infact we did a >> PSR run wi

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Rahul R
e: > > On Jul 31, 2009, at 2:35 AM, Rahul R wrote: > > Hello, >> We are trying to get Solr to work for a really huge parts database. >> Details >> of the database >> - 55 million parts >> - Totally 3700 properties (facets). But each record will not hav

Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-30 Thread Rahul R
Hello, We are trying to get Solr to work for a really huge parts database. Details of the database - 55 million parts - Totally 3700 properties (facets). But each record will not have value for all properties. - Most of these facets are defined as dynamic fields within the Solr Index We were getti