Re: Solr server becomes non-responsive.

Modassar, How many items in the collection ? I mean how many documents per collection ? 1 million, 10 millions, …? How are configured cache in solrconfig.xml ? What are the size attribute value for each cache ? Can you provide a sample of the query ? Does it fail immediately after solrcloud star

Re: Loading data to FieldValueCache

Okay. Let me try like this, as mine is a read-only index. I will have some queries in firstSearcher event listener 1) q=*:*&facet=true&facet.method=enum&facet.field=state --> To load all the state related unique values to filterCache. > Will it use filterCache when I sent a query with filter,

Re: Solr Date Range not returning results for last 1 month

Thanks Erick. That works! Will check some other time as to why NOW/DAY does not work. Regards, Yavar On Wed, Dec 24, 2014 at 11:39 AM, Erick Erickson wrote: > Hmmm, not quite sure what's going on here, but try an end > time of NOW/MONTH+1MONTH with the usual escaping of the > plus sign... > >

Re: Solr Date Range not returning results for last 1 month

Hmmm, not quite sure what's going on here, but try an end time of NOW/MONTH+1MONTH with the usual escaping of the plus sign... Best, Erick On Tue, Dec 23, 2014 at 9:55 PM, Yavar Husain wrote: > So my Solr date range query is as follows: > > &facet.range=date&facet.range.start=NOW/DAY-36MONTH&fac

Re: Loading data to FieldValueCache

By and large, don't use the enum method unless there are _very_ few unique values. It forms a filter (size roughly mixDoc/8 bytes) for _every_ unique value in the field, i.e. if you have 10,000 unique values it'll try to form 10,000 filterCache entries. Let the system do this for you automatically

Solr Date Range not returning results for last 1 month

So my Solr date range query is as follows: &facet.range=date&facet.range.start=NOW/DAY-36MONTH&facet.range.end=NOW/DAY&facet.range.gap=%2B1MONTH I need facets for past 36 months or 3 year and everything is fine except for data not being returned for last 1 month, However the facets I am getting

Re: Loading data to FieldValueCache

Thanks Erick and Toke, Also, I read here that, filterCache can also be used for faceting with facet.method=enum. So, I am bit confused here on which one to use for faceting. One more thing here is I have different types of facets. (For exampl

Re: Solr server becomes non-responsive.

Thanks for your suggestions. I will look into the link provided. http://wiki.apache.org/solr/SolrPerformanceProblems#Java_Heap This is usually an anti-pattern. The very first thing I'd be doing is trying to not do this. See ngrams for infix queries, or shingles or ReverseWildcardFilterFactory or.

Re: Solr Cloud and relative paths in solrconfig.xml lib directives

You ought to be able to specify an environment var as well. S you have something like this in your solrocnfig.xml file: and define solr.install.dir as a system var when you invoke Solr. Best, Erick On Tue, Dec 23, 2014 at 2:05 PM, Shawn Heisey wrote: > On 12/23/2014 1:25 PM, Jens Ivar Jørdre

Re: Solr Cloud and relative paths in solrconfig.xml lib directives

On 12/23/2014 1:25 PM, Jens Ivar Jørdre wrote: > I seek some advice on the use of lib directives in solrconfig.xml in Solr > Cloud. My project has been tested with Solr 4.10.2 and run nicely on single > node with the included Jetty. The setup adds a DataImportHandler request > handler to solrcon

Re: Solr Cloud and relative paths in solrconfig.xml lib directives

I think you may be running into a bug which was reported an hour back. See https://issues.apache.org/jira/browse/SOLR-6887 On Tue, Dec 23, 2014 at 8:25 PM, Jens Ivar Jørdre wrote: > Hi all, > > I seek some advice on the use of lib directives in solrconfig.xml in Solr > Cloud. My project has been

Re: Solr Cloud and relative paths in solrconfig.xml lib directives

Hi, I use to put all dependency jar files (dih, adbc driver, …) in a lib directory in the solr home directory where your shard are created. something like this solr/ solr.xml cloudcollection1_shard2_replica2/ lib/ In solrconfig.xml, I remove all the directives except this one You

Re: Solr server becomes non-responsive.

Hi, I agree Erick it could be a good think to have more details about your configuration and collection. Your heap size is 32Gb. How many RAM on each servers ? By « 4 shard Solr cluster », you mean a 4 nodes Solr servers or a collection with 4 shards ? So, how many nodes in the cluster ? How ma

Solr Cloud and relative paths in solrconfig.xml lib directives

Hi all, I seek some advice on the use of lib directives in solrconfig.xml in Solr Cloud. My project has been tested with Solr 4.10.2 and run nicely on single node with the included Jetty. The setup adds a DataImportHandler request handler to solrconfig.xml. It also adds a lib directive to solco

Re: UI for Solr

Hi Alex, Thank you for prompt reply. I am not aware of Spring.io's Spring Data Solr. Regards Olivier 2014-12-23 16:50 GMT+01:00 Alexandre Rafalovitch : > You don't expose Solr directly to the user, it is not setup for > full-proof security out of the box. So you would need a client to talk > t

Re: How best to fork Solr for enhancement

I'm somewhat open to other suggestions, as I'm right at the beginning of the project. I know Angular, and like it. I've looked at a couple of others, but have found them to be more of a collection of disparate components and not as integrated as Angular. However, if folks want to have a discussion

Re: Solr Search Inconsistent result

This really sounds like you _think_ you have two shards in a single collection, but really you don't. I admit I'm not quite sure how it got that way, but... So try this: Add &distrib=false to the query and ping each of your servers separately. My bet is that you'll find they have wildly varying nu

Re: SolrCloud & Paging on large indexes

> Nobody will hit next 499 times, but a lot of our users skip to the last page > quite often. Maybe I should make *that* as hard as possible. Hmm Right. I'd actually argue that providing a "last page" link in this situation is 1) useless to the user, I mean what's the point? Curiosity? If it rea

Re: Solr server becomes non-responsive.

Second most important part of your message: "When executing a huge query with many wildcards inside it the server" This is usually an anti-pattern. The very first thing I'd be doing is trying to not do this. See ngrams for infix queries, or shingles or ReverseWildcardFilterFactory or. And if

Re: 'Illegal character in query' on Solr cloud 4.10.1

Hmmm, so you are you pinging the servers directly, right? Here's a couple of things to try: 1> add &distrib=false to the query and try each of the 6 servers. What I'm wondering is if this is happening on the sub-query sent out or on the primary server. Adding &distrib=false will just execute on the

Re: Loading data to FieldValueCache

Or just not worry about it. The cache will be filled up automatically as you query for facets etc., the benefit to trying to fill it up as Toke outlines is just that the first few user queries that call for faceting will be somewhat faster. But after the first few user queries have gone through, it

Re: Solr server becomes non-responsive.

On 12/23/2014 4:34 AM, Modassar Ather wrote: > Hi, > > I have a setup of 4 shard Solr cluster with embedded zookeeper on one of > them. The zkClient time out is set to 30 seconds, -Xms is 20g and -Xms is > 24g. > When executing a huge query with many wildcards inside it the server > crashes and bec

Re: Endless 100% CPU usage on searcherExecutor thread

On 12/23/2014 2:31 AM, heaven wrote: > We do not use dates here, at least not too often. Usually its something like > type:Profile (we do use it from the rails application so type describes > model names), opted_in:true, etc. Solr wasn't running too long though, so > this could not show the real st

Re: Solr Search Inconsistent result

Hi Ahmet, We are using the *java.util.UUID* to generate the unique id for each document. Thanks, Ankit Jain On Tue, Dec 23, 2014 at 1:32 PM, Ahmet Arslan wrote: > Hi Ankit, > > So you are using solr.UUIDUpdateProcessorFactory to pupolate unique keys? > > Ahmet > > On Tuesday, December 23, 2014

Re: UI for Solr

You don't expose Solr directly to the user, it is not setup for full-proof security out of the box. So you would need a client to talk to Solr. Something like Spring.io's Spring Data Solr could be one of the things to check. You can see an auto-complete example for it at: https://github.com/arafal

UI for Solr

Hi, I would like to build a User Interface on top of Solr for PC and mobile. I am wondering if there is a framework, best practice commonly used. I want Solr features such as suggestion, auto complete, facet to be available for UI. Any suggestion is welcome. Than you. Regards Olivier

Re: How best to fork Solr for enhancement

There is other options like Ember or Backbone, either way AngularJS is well adopted. Alexandre, your question is about the radical change between versions? In some way this shows progress and support to the framework. Other good reason is that AngularJS has a ton of components ready t

Re: How best to fork Solr for enhancement

Semi Off Topic, but is AngularJS the best next choice, given the version 2 being so different from version 1? Regards, Alex. Sign up for my Solr resources newsletter at http://www.solr-start.com/ On 23 December 2014 at 06:52, Upayavira wrote: > Hi, > > I've (hopefully) made some time to

RE: SolrCloud & Paging on large indexes

Bram Van Dam [bram.van...@intix.eu] wrote: [Solr cursors] > Oh thanks, that's a pretty interesting read. The scale we're > investigating is several orders of magnitude larger than what was tested > there, so I'm still a bit worried. The beauty of the cursor is that it is has little to no overhea

Re: what does this "write.lock does not exist" mean??

Haven't seen this particular problem before, but it sounds like it could be a problem with permissions or data size limits - it may be worth looking into. The "write.lock" file is used when an index is being modified - it is how lucene handles concurrent attempts to modify the index - a writer obt

Re: How best to fork Solr for enhancement

Perfect, thanks! On Tue, Dec 23, 2014, at 07:10 AM, Shalin Shekhar Mangar wrote: > You can make github play well with Apache Infra. See > https://wiki.apache.org/lucene-java/BensonMarguliesGitWorkflow > > On Tue, Dec 23, 2014 at 11:52 AM, Upayavira wrote: > > > Hi, > > > > I've (hopefully) made

Re: How best to fork Solr for enhancement

You can make github play well with Apache Infra. See https://wiki.apache.org/lucene-java/BensonMarguliesGitWorkflow On Tue, Dec 23, 2014 at 11:52 AM, Upayavira wrote: > Hi, > > I've (hopefully) made some time to do some work on the Solr Admin UI > (convert it to AngularJS). I plan to do it on a

How best to fork Solr for enhancement

Hi, I've (hopefully) made some time to do some work on the Solr Admin UI (convert it to AngularJS). I plan to do it on a clone of the lucene-solr project at GitHub. Before I dive too thoroughly into this, I wanted to see if there were any best practices that would make it easier to back-port thes

Re: Solr server becomes non-responsive.

To add to the details of above issue the query as soon it is executed, even before the OutOfMemory error causes the solr servers to become non-responsive. On Tue, Dec 23, 2014 at 5:04 PM, Modassar Ather wrote: > Hi, > > I have a setup of 4 shard Solr cluster with embedded zookeeper on one of > t

Solr server becomes non-responsive.

Hi, I have a setup of 4 shard Solr cluster with embedded zookeeper on one of them. The zkClient time out is set to 30 seconds, -Xms is 20g and -Xms is 24g. When executing a huge query with many wildcards inside it the server crashes and becomes non-responsive. Even the dashboard does not responds

'Illegal character in query' on Solr cloud 4.10.1

Hi All, I am using SolrCloud 4.10.1 and I have 3 shards with replication factor of 2 , i.e is 6 nodes altogether. When I query the server1 out of 6 nodes in the cluster with the below query , it works fine , but any other node in the cluster when queried with the same query results in a *HTTP Sta

Re: How to define Json list in schema in xml

A multiValued="true" string field is what you're after here. Erik > On Dec 22, 2014, at 23:19, Xin Cai wrote: > > hi guys > I am looking to parse a json file that contains fields that has a list of > schools > > So for example I would have > > > {"Schools":[ > name: "Seirra High School"

Re: SolrCloud & Paging on large indexes

On 12/22/2014 04:27 PM, Erick Erickson wrote: Have you read Hossman's blog here? https://lucidworks.com/blog/coming-soon-to-solr-efficient-cursor-based-iteration-of-large-result-sets/#referrer=solr.pl Oh thanks, that's a pretty interesting read. The scale we're investigating is several orders

Re: Endless 100% CPU usage on searcherExecutor thread

We do not use dates here, at least not too often. Usually its something like type:Profile (we do use it from the rails application so type describes model names), opted_in:true, etc. Solr wasn't running too long though, so this could not show the real state. Currently for the filter cache it shows

RE: Loading data to FieldValueCache

Manohar Sripada [manohar...@gmail.com] wrote: > From the wiki, it states that > http://wiki.apache.org/solr/SolrCaching#fieldValueCache is mostly used for > faceting. > Can someone please throw some light on how to load data to this cache. Like > on what solrquery option does this consider the dat

Loading data to FieldValueCache

Hello, >From the wiki, it states that http://wiki.apache.org/solr/SolrCaching#fieldValueCache is mostly used for faceting. Can someone please throw some light on how to load data to this cache. Like on what solrquery option does this consider the data to be loaded to this cache. My requirement i

Re: Solr Search Inconsistent result

Hi Ankit, So you are using solr.UUIDUpdateProcessorFactory to pupolate unique keys? Ahmet On Tuesday, December 23, 2014 7:13 AM, Ankit Jain wrote: Hi Ahmet, Thanks for the response. Document ID is unique because we are using *UUID* to generate the document ID. Thanks, Ankit On Tue, Dec 23,