Re: How to change stateFomat to 2

2017-04-18 Thread Manohar Sripada
ROP (IIRC) > collections API call. You can also just delete the _data_ from > clusterstate.json. ASSUMING you're in format 2. > > If you're really in format 1, then see MIGRATESTATEFORMAT here: > https://cwiki.apache.org/confluence/display/solr/Collections+API# >

How to change stateFomat to 2

2017-04-18 Thread Manohar Sripada
After deleting a collection through Collection API, the data is not getting deleted from clusterstate.json. Based on this discussion , it seems clusterstate.json shouldn't be there for Solr 5.x (I am usi

Re: Solr node not found in ZK live_nodes

2016-12-06 Thread Manohar Sripada
h a JIRA? > > Erick > > On Tue, Dec 6, 2016 at 3:53 AM, Manohar Sripada > wrote: > > We have a 16 node cluster of Solr (5.2.1) and 5 node Zookeeper (3.4.6). > > > > All the Solr nodes were registered to Zookeeper (ls /live_nodes) when > setup > > was done

Solr node not found in ZK live_nodes

2016-12-06 Thread Manohar Sripada
We have a 16 node cluster of Solr (5.2.1) and 5 node Zookeeper (3.4.6). All the Solr nodes were registered to Zookeeper (ls /live_nodes) when setup was done 3 months back. Suddenly, few days back our search started failing because one of the solr node(consider s16) was not seen in Zookeeper, i.e.,

Re: Solr Suggester (AnalyzingInfix n BlendedInfix)

2016-09-28 Thread Manohar Sripada
> > I took a quick look at SOLR-7865 and it's a very simple fix, just > 3 lines of code change and the rest is test code. Could you > consider applying that patch to the 5.2.1 code base? and using that > rather than fully upgrading? > > Best, > Erick > > On

Solr Suggester (AnalyzingInfix n BlendedInfix)

2016-09-28 Thread Manohar Sripada
I am implementing auto suggestion on Business Name. I used BlendedInfixLookupFactory which worked in all my uses until I encountered into this bug (https://issues.apache.org/jira/browse/SOLR-7865), where suggest.count doesn't work in Solr 5.2.1. But, I can't upgrade anytime soon. :( I tried using

Zookeeper overseer queue clogging

2016-07-12 Thread Manohar Sripada
There are 16 Solr Nodes (Solr 5.2.1) & 5 Zookeeper Nodes (Zookeeper 3.4.6) in our production cluster. We had to restart Solr nodes for some reason and we are doing it after 3 months. To our surprise, none of the solr nodes came up. We can see the Solr process running the machine, but, the Solr Admi

Re: Multi-selected Faceting

2016-05-16 Thread Manohar Sripada
Thanks Eric! That worked. On Mon, May 16, 2016 at 3:11 PM, Erik Hatcher wrote: > Quick reply: Use a different tag/ex value for each field. > > > On May 16, 2016, at 04:42, Manohar Sripada wrote: > > > > We have a similar requirement as that of mentioned i

Multi-selected Faceting

2016-05-16 Thread Manohar Sripada
We have a similar requirement as that of mentioned in solr wiki - http://wiki.apache.org/solr/SimpleFacetParameters#Multi-Select_Faceting_and_LocalParams Here, the example given works when single facet is selected, where I can get the counts of other facet values. *q=*:*&start=0&rows=10&facet=tr

Re: Index BackUp using JDK 8 & Restore using JDK 7. Does this work?

2016-04-18 Thread Manohar Sripada
Thanks Shawn! :-) On Mon, Apr 18, 2016 at 6:42 PM, Shawn Heisey wrote: > On 4/18/2016 12:49 AM, Manohar Sripada wrote: > > We are using Solr 5.2.1 and JDK 7. We do create a static index in one > > cluster (solr cluster 1) and ship that index to another cluster (Solr > &

Index BackUp using JDK 8 & Restore using JDK 7. Does this work?

2016-04-17 Thread Manohar Sripada
We are using Solr 5.2.1 and JDK 7. We do create a static index in one cluster (solr cluster 1) and ship that index to another cluster (Solr cluster 2). Solr Cluster 2 is the one where queries will be fired. Due to some unavoidable reasons, we want to upgrade Solr Cluster 1 to JDK 8. But, we can't

Re: Issue with Auto Suggester Component

2016-03-16 Thread Manohar Sripada
followed by prefix part of any other string > It is not that clear, probably you mean all the rest. > Anyway an infix lookup algorithm with a boost for exact search should do > the trick. > > Please give us some more details ! > > Cheers > > On Tue, Mar 15, 2016 at 8:19 AM,

Issue with Auto Suggester Component

2016-03-15 Thread Manohar Sripada
Consider the below company names indexed. I want the below auto suggestions to be listed when searched for "abc". Basically, I want prefix search of entire keyword to be of high preference (#1 to #5 in the below example) followed by prefix part of any other string (the last 2 in the below example).

Re: Spatial Search on Postal Code

2016-03-07 Thread Manohar Sripada
_code) > > > 2. create zip to polygon lookup > > > 3. create code that will expand zip code polygon by some distance (you > > > can use JTS buffer api) > > > > > > On query time you get zip code and distance: > > > 1. find

Re: Spatial Search on Postal Code

2016-03-04 Thread Manohar Sripada
arameters to pass on to the main collection > > Straightforward, clean, and effective for the needs. > > — > Erik Hatcher, Senior Solutions Architect > http://www.lucidworks.com <http://www.lucidworks.com/> > > > > > On Mar 4, 2016, at 7:09 AM, Manohar Sripa

Re: Spatial Search on Postal Code

2016-03-04 Thread Manohar Sripada
use resulting polygon to find matches. > > HTH, > Emir > > On 04.03.2016 13:09, Manohar Sripada wrote: > >> Here's my requirement - User enters postal code and provides the radius. >> I >> need to find the records with in the radius from the provided postal c

Spatial Search on Postal Code

2016-03-04 Thread Manohar Sripada
Here's my requirement - User enters postal code and provides the radius. I need to find the records with in the radius from the provided postal code. There are few ways I thought through after going through the "Spatial Search" Solr wiki 1. As Latitude and Longitude positions are required for sp

Range Query on a language specific field

2015-11-24 Thread Manohar Sripada
I have a requirement where I need to be able to query on a field (say "salary"). This field contains data in Chinese. Is it possible in Solr to do a range query on this field? Is there any language specific Analyzer that I could use on this field to achieve range search?

Solr Query taking 50 sec

2015-07-30 Thread Manohar Sripada
Hi, We have Solr Cloud (version 4.7.2) setup on 64 shards spread across VMs. I see my queries to Solr taking exactly 50 sec intermittently (as someone said so :P). This happens once in 10 queries. I have enabled log level to TRACE on all the solr nodes. I didn't find any issue with the query time

How http connections are handled in Solr?

2015-06-03 Thread Manohar Sripada
Hi, I wanted to know in detail on how it is http connections are handled in Solr. 1. From my code, I am using CloudSolrServer of solrj client library to get the connection. From one of my previous discussion in this forum, I understood that Solr uses Apache's HttpClient for connections and the de

Copying index from one Solr cloud to other Solr cloud

2015-05-27 Thread Manohar Sripada
I am using Solr cloud 4.7.2. We have around 100 collections spread across 16 Solr nodes. Also, there are 5 dedicated servers for running Zookeeper. I want to move all these collections data (or collections) to a completely different solr cloud. How to achieve this? The Zookeeper servers for this S

Error while creating collection

2015-05-18 Thread Manohar Sripada
I am using 4.7.2 version of Solr. Cluster contains 16 VMs for Solr and 3 Zookeeper VMs. I am creating a bunch of collections (total 54) sequentially. I am getting the below error during one of the collection creation. This error is intermittent. *> Could not fully createcollection: * Here's the s

Re: QQ on segments during indexing.

2015-05-13 Thread Manohar Sripada
Thanks Shawn, In my case, the document size is small. So, for sure it will reach 50k docs first than 100MB buffer size. Thanks, Manohar On Thu, May 14, 2015 at 10:49 AM, Shawn Heisey wrote: > On 5/13/2015 10:01 PM, Manohar Sripada wrote: > > I have a question on segment creation on di

QQ on segments during indexing.

2015-05-13 Thread Manohar Sripada
I have a question on segment creation on disk during indexing. In my solrconfig.xml, I have commented maxBufferedDocs and ramBufferSizeMB. I am controlling the flushing of data to disk using autoCommit's maxDocs and maxTime. Here, maxDocs is set to 5 and will be hit first, so that commit of d

Re: Question on CloudSolrServer API

2015-02-23 Thread Manohar Sripada
at > connections can be pooled. > On 19-Feb-2015 1:44 pm, "Manohar Sripada" wrote: > > > Hi All, > > > > I am using CloudSolrServer API of SolrJ library from my application to > > query Solr. Here, I am creating a new connection to Solr for every search >

Question on CloudSolrServer API

2015-02-19 Thread Manohar Sripada
Hi All, I am using CloudSolrServer API of SolrJ library from my application to query Solr. Here, I am creating a new connection to Solr for every search that I am doing. Once I got the results I am closing the connection. Is this the correct way? How does Solr create connections internally? Does

Collection timeout error

2015-01-19 Thread Manohar Sripada
I am getting collection timeout error while creating collection on Solr Cloud. Below is the error. > org.apache.solr.common.SolrException: createcollection the collection time out:180s at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:252) at org.apache.s

Re: How to select the correct number of Shards in SolrCloud

2015-01-16 Thread Manohar Sripada
at is the size of the large cold shard? > Can you please suggest if any tool that you use for collecting the statistics? like the QTime's for the queries etc. Thanks, Manohar On Fri, Jan 16, 2015 at 3:23 PM, Shawn Heisey wrote: > On 1/15/2015 10:58 PM, Manohar Sripada wrote: > >

How to select the correct number of Shards in SolrCloud

2015-01-15 Thread Manohar Sripada
Hi All, My Setup is as follows. There are 16 nodes in my SolrCloud and 4 CPU cores on each Solr Node VM. Each having 64 GB of RAM, out of which I have allocated 32 GB to Solr. I have a collection which contains around 100 million Docs, which I created with 64 shards, replication factor 2, and 8 sh

Re: Loading data to FieldValueCache

2014-12-28 Thread Manohar Sripada
ut if the number of docs that > satisfy the fq is "small enough", > then just the internal Lucene doc IDs are stored rather than a bitset. > What exactly "small enough" is > I don't know off the top of my head. And I've got to assume looking > stuff up in

Re: Loading data to FieldValueCache

2014-12-26 Thread Manohar Sripada
Thanks Toke for the explanation, I will experiment with f.state.facet.method=enum Thanks, Manohar On Fri, Dec 26, 2014 at 4:09 PM, Toke Eskildsen wrote: > Manohar Sripada [manohar...@gmail.com] wrote: > > I have 100 million documents in my index. The maxDoc here is the maximum > &g

Re: Loading data to FieldValueCache

2014-12-26 Thread Manohar Sripada
ine. > > On Tue, Dec 23, 2014 at 11:12 PM, Manohar Sripada > wrote: > > Okay. Let me try like this, as mine is a read-only index. I will have > some > > queries in firstSearcher event listener > > 1) q=*:*&facet=true&facet.method=enum&facet.field=state

Re: Loading data to FieldValueCache

2014-12-23 Thread Manohar Sripada
es. It forms a filter (size roughly mixDoc/8 bytes) > for _every_ unique value in the field, i.e. if you have 10,000 unique > values it'll try to form 10,000 filterCache entries. Let the system > do this for you automatically if appropriate. > > Best, > Erick > > On Tu

Re: Loading data to FieldValueCache

2014-12-23 Thread Manohar Sripada
#x27;t have to wait while they're loaded. And with DocValues, > as Toke recommends, even that may be unimportant. > > Best, > Erick > > On Tue, Dec 23, 2014 at 1:03 AM, Toke Eskildsen > wrote: > > Manohar Sripada [manohar...@gmail.com] wrote: > >> From

Loading data to FieldValueCache

2014-12-23 Thread Manohar Sripada
Hello, >From the wiki, it states that http://wiki.apache.org/solr/SolrCaching#fieldValueCache is mostly used for faceting. Can someone please throw some light on how to load data to this cache. Like on what solrquery option does this consider the data to be loaded to this cache. My requirement i

Re: Clearing SolrCaches

2014-12-08 Thread Manohar Sripada
7:45 PM, Shawn Heisey wrote: > On 12/8/2014 3:02 AM, Manohar Sripada wrote: > > Can anyone please let me know on how to clear caches associated with an > > IndexSearcher explicitly? > > > > In my project, I am creating a collection (say collection_1) which holds &

Clearing SolrCaches

2014-12-08 Thread Manohar Sripada
Hi, Can anyone please let me know on how to clear caches associated with an IndexSearcher explicitly? In my project, I am creating a collection (say collection_1) which holds the data for my organizations dataset. I am using filterCache, queryResultCache and DocumentCache extensively and these ar

Re: Question on Solr Caching

2014-12-08 Thread Manohar Sripada
1/data/index; maxCacheMB=48.0 maxMergeSizeMB=4.0) What does maxCacheMB and maxMergeSizeMB indicate? How to control it? Thanks, Manohar On Fri, Dec 5, 2014 at 11:04 AM, Shawn Heisey wrote: > On 12/4/2014 10:06 PM, Manohar Sripada wrote: > > If you use MMapDirectory, Lucene will map the fi

Re: Question on Solr Caching

2014-12-04 Thread Manohar Sripada
Thanks Micheal for the response. If you use MMapDirectory, Lucene will map the files into memory off heap and the OS's disk cache will cache the files in memory for you. Don't use RAMDirectory, it's not better than MMapDirectory for any use I'm aware of. > Will that mean it will cache the Inverte

Question on Solr Caching

2014-12-04 Thread Manohar Sripada
Hi, I am working on implementing Solr in my product. I have a few questions on caching. 1. Does posting-list and term-list of the index reside in the memory? If not, how to load this to memory. I don't want to load entire data, like using DocumentCache. Either I want to use RAMDirectoryFactory as