Re: Solr Sharding Strategy

2016-04-11 Thread Bhaumik Joshi
Please note that all caches are disable in mentioned test. In 2 shards: Intended queries and updates = 10 per sec Actual queries per sec = 3.3 Actual updates per sec = 10 so for 302 queries avg query time is 2192ms. In 1 shard: Intended queries and updates = 10 per sec Actual queries per sec =

Specify relative path to current core conf folder when it's originally relative to solr home

2016-04-11 Thread scott.chu
I got a custom tokenizer. When configuring it, there's an attribute 'fileDir', whose value is a path relative to solr home. But I wish it can be relative to current core. Is there some system variable out-of-box, say {current_core}, that I can use in the value? For example, solr home =

Re: SolrCloud Config file

2016-04-11 Thread Erick Erickson
Do note by the way that as of Solr 5.5, the bin/solr script has an option for uploading and downloading configsets. Try typing bin/solr zk -help Best, Erick On Mon, Apr 11, 2016 at 6:30 PM, Shawn Heisey wrote: > On 4/11/2016 6:40 PM, Sam Xia wrote: >> Where is the path of

Re: SolrCloud Config file

2016-04-11 Thread Shawn Heisey
On 4/11/2016 6:40 PM, Sam Xia wrote: > Where is the path of topic collection zookeeper config file? Here is from > wiki (see below). But I was not able to find configs/topic anywhere in the > installation folder. The /configs/topic path is *inside the zookeeper database*. It is not a path on

Re: Indexing date data for facet search

2016-04-11 Thread Erick Erickson
You have two options for dates in this scenario, "tdate" or "dateRange". Probably in this case use dateRange, it should be more time and space efficient. Here's some background: https://lucidworks.com/blog/2016/02/13/solrs-daterangefield-perform/ Date types should be indexed as fully specified

Re: Limiting regex queries

2016-04-11 Thread Erick Erickson
There's some ability to time-limit queries so they stop after a specified time. That does not do any cost analysis ahead of time though. Periodically there's some interest in a way to short-circuit "expensive" queries through some kind of query plan, but nothing committed yet. Yeah, basically

Re: Solr 6 - AbstractSolrTestCase Error Unable to build KeyStore from file: null

2016-04-11 Thread Chris Hostetter
https://issues.apache.org/jira/browse/SOLR-8970 https://issues.apache.org/jira/browse/SOLR-8971 : Date: Mon, 11 Apr 2016 20:35:22 -0400 : From: Joe Lawson : Reply-To: solr-user@lucene.apache.org : To: solr-user@lucene.apache.org : Subject: Re: Solr 6 -

Re: SolrCloud Config file

2016-04-11 Thread Sam Xia
Thanks Shawn. Where is the path of topic collection zookeeper config file? Here is from wiki (see below). But I was not able to find configs/topic anywhere in the installation folder. "The create command will upload a copy of the data_driven_schema_configs configuration directory to

Re: Solr 6 - AbstractSolrTestCase Error Unable to build KeyStore from file: null

2016-04-11 Thread Joe Lawson
Thanks for the insight. I figured that it was something like that and perhaps I has thread contention on a resource that wasn't really thread safe. I'll give your suggestions a shot tomorrow. Regards, Joe Lawson On Apr 11, 2016 8:24 PM, "Chris Hostetter" wrote: > > :

Re: SolrCloud Config file

2016-04-11 Thread Shawn Heisey
On 4/11/2016 4:59 PM, Sam Xia wrote: > Solr is installed in /locm/solr-5.5.0/ folder > > 1) First I create a topic connection with the following command: > > bin/solr create -c topic -d topic_configs_ori > > But there is no folder name topc in > /locm/solr-5.5.0/server/solr/configsets/topic after

Re: Solr 6 - AbstractSolrTestCase Error Unable to build KeyStore from file: null

2016-04-11 Thread Chris Hostetter
: I'm upgrading a plugin and use the AbstractSolrTestCase for tests. My tests : work fine in 5.X but when I upgraded to 6.X the tests sometimes throw an : error during initialization. Basically it says, : "org.apache.solr.common.SolrException: Error instantiating : shardHandlerFactory class :

Re: SolrCloud Config file

2016-04-11 Thread Sam Xia
I tried solr-6.0 and was able to see the same issue. Please help. Thanks On 4/11/16, 3:59 PM, "Sam Xia" wrote: >Hi, > >I installed Solr 5.5 in my test server but was having issue updating the >solrconfig.xml. > >Solr is installed in /locm/solr-5.5.0/ folder > >1) First I

Solrj API for Managed Resources

2016-04-11 Thread iambest
Is there a solrj API to add synonyms or stop words using the Managed Resources API? I have to programmatically add them, what is the best way? -- View this message in context: http://lucene.472066.n3.nabble.com/Solrj-API-for-Managed-Resources-tp4269454.html Sent from the Solr - User mailing

SolrCloud Config file

2016-04-11 Thread Sam Xia
Hi, I installed Solr 5.5 in my test server but was having issue updating the solrconfig.xml. Solr is installed in /locm/solr-5.5.0/ folder 1) First I create a topic connection with the following command: bin/solr create -c topic -d topic_configs_ori But there is no folder name topc in

Indexing date data for facet search

2016-04-11 Thread Steven White
Hi everyone, I need to index data data into Solr and then use this field for facet search. My question is this, the date data in my DB is stored in the following format "2016-03-29 15:54:35.461": 1) What format I should be indexing this date + time stamp into Solr? 2) What Solr field type I

Re: How to set multivalued false, using SolrJ

2016-04-11 Thread Chris Hostetter
: Can you do me a favour, I use solrJ to index, but I get all the : Field is multivalued. How can I set my Field to not : multivalued, can you tell me how to setting use solrJ. If you are using a "Managed Schema" (which was explicitly configured in most Solr 5.x

Re: Range filters: inclusive?

2016-04-11 Thread Robert Brown
It's a string field, ean... http://paste.scsys.co.uk/510132 On 04/11/2016 06:00 PM, Yonik Seeley wrote: On Mon, Apr 11, 2016 at 12:52 PM, Robert Brown wrote: Hi, When I perform a range query of ['' TO *] to filter out docs where a particular field has a value, this

Re: Range filters: inclusive?

2016-04-11 Thread Chris Hostetter
: > When I perform a range query of ['' TO *] to filter out docs where a : > particular field has a value, this does what I want, but I thought using the : > square brackets was inclusive, so empty-string values should actually be : > included? : : They should be. Are you saying that zero length

Re: Range filters: inclusive?

2016-04-11 Thread Chris Hostetter
: When I perform a range query of ['' TO *] to filter out docs where a : particular field has a value, this does what I want, but I thought using the : square brackets was inclusive, so empty-string values should actually be : included? I'm not sure i understand your question ... if you are

Re: Range filters: inclusive?

2016-04-11 Thread Yonik Seeley
On Mon, Apr 11, 2016 at 12:52 PM, Robert Brown wrote: > Hi, > > When I perform a range query of ['' TO *] to filter out docs where a > particular field has a value, this does what I want, but I thought using the > square brackets was inclusive, so empty-string values should

Range filters: inclusive?

2016-04-11 Thread Robert Brown
Hi, When I perform a range query of ['' TO *] to filter out docs where a particular field has a value, this does what I want, but I thought using the square brackets was inclusive, so empty-string values should actually be included? The JSON I post to Solr has empty values, not

Re: EmbeddedSolr for unit tests in Solr 6

2016-04-11 Thread Joe Lawson
Check for example tests here too: https://github.com/apache/lucene-solr/tree/master/solr/core/src/test/org/apache/solr On Mon, Apr 11, 2016 at 12:24 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > Please use MiniSolrCloudCluster instead of EmbeddedSolrServer for > unit/integration

Solr 6 - AbstractSolrTestCase Error Unable to build KeyStore from file: null

2016-04-11 Thread Joe Lawson
I'm upgrading a plugin and use the AbstractSolrTestCase for tests. My tests work fine in 5.X but when I upgraded to 6.X the tests sometimes throw an error during initialization. Basically it says, "org.apache.solr.common.SolrException: Error instantiating shardHandlerFactory class

Re: EmbeddedSolr for unit tests in Solr 6

2016-04-11 Thread Shalin Shekhar Mangar
Please use MiniSolrCloudCluster instead of EmbeddedSolrServer for unit/integration tests. On Mon, Apr 11, 2016 at 2:26 PM, Rohana Rajapakse < rohana.rajapa...@gossinteractive.com> wrote: > Thanks Shawn, > > I am now pointing solrHomeFolder to lucene-solr-master\solr\server\solr > which contains

Problem with AbstractMethodError

2016-04-11 Thread João Gonçalo Guimarães Correia
Hi, Im trying to extract pdf data with solrnet client. I code is the following: using (MemoryStream stream = new MemoryStream((byte[])dataReader["file_stream"])) { var solr = ServiceLocator.Current.GetInstance();

Re: How to set multivalued false, using SolrJ

2016-04-11 Thread Shawn Heisey
On 4/11/2016 7:40 AM, Charles Sanders wrote: > Multivalued fields are controlled by the schema. You need to define your > field in the schema file as 'not' a multivalue field. Here are a couple of > examples of field definitions, one multivalued, the other not. > > multiValued="true"/> > />

Re: Solr Sharding Strategy

2016-04-11 Thread Daniel Collins
I'd also ask about your indexing times, what QTime do you see for indexing (in both scenarios), and what commit times are you using (which Toke already asked). Not entirely sure how to read your table, but looking at the indexing side of things, with 2 shards, there is inherently more work to do,

Re: Solr Sharding Strategy

2016-04-11 Thread Toke Eskildsen
On Mon, 2016-04-11 at 11:23 +, Bhaumik Joshi wrote: > We are using solr 5.2.0 and we have Index-heavy (100 index updates per > sec) and Query-heavy (100 queries per sec) scenario. > Index stats: 10 million documents and 16 GB index size > Which sharding strategy is best suited in above

Re: Cache problem

2016-04-11 Thread billnbell
You do need to optimize to get rid of the deleted docs probably... That is a lot of deleted docs Bill Bell Sent from mobile > On Apr 11, 2016, at 7:39 AM, Bastien Latard - MDPI AG > wrote: > > Dear Solr experts :), > > I read this very interesting post

Re: Soft commit does not affecting query performance

2016-04-11 Thread billnbell
Why do you think it would ? Bill Bell Sent from mobile > On Apr 11, 2016, at 7:48 AM, Bhaumik Joshi wrote: > > Hi All, > > We are doing query performance test with different soft commit intervals. In > the test with 1sec of soft commit interval and 1min of soft commit

Soft commit does not affecting query performance

2016-04-11 Thread Bhaumik Joshi
Hi All, We are doing query performance test with different soft commit intervals. In the test with 1sec of soft commit interval and 1min of soft commit interval we didn't notice any improvement in query timings. We did test with SolrMeter (Standalone java tool for stress tests with Solr)

Re: How to set multivalued false, using SolrJ

2016-04-11 Thread Charles Sanders
Hello, Multivalued fields are controlled by the schema. You need to define your field in the schema file as 'not' a multivalue field. Here are a couple of examples of field definitions, one multivalued, the other not. If you do not explicitly define your field, then solr will use default

Solr Sharding Strategy

2016-04-11 Thread Bhaumik Joshi
Hi, We are using solr 5.2.0 and we have Index-heavy (100 index updates per sec) and Query-heavy (100 queries per sec) scenario. Index stats: 10 million documents and 16 GB index size Which sharding strategy is best suited in above scenario? Please share reference resources which states

Re: Facet heatmaps: cluster coordinates based on average position of docs

2016-04-11 Thread Anton K.
Anyone? Or how can i contact with facet heatmaps creator? 2016-04-07 18:42 GMT+03:00 Anton K. : > I am working with new solr feature: facet heatmaps. It works great, i > create clusters on my map with counts. When user click on cluster i zoom in > that area and i might

How to set multivalued false, using SolrJ

2016-04-11 Thread 巩学超
Hello, Can you do me a favour, I use solrJ to index, but I get all the Field is multivalued. How can I set my Field to not multivalued, can you tell me how to setting use solrJ.

Solr Sharding Strategy

2016-04-11 Thread Bhaumik Joshi
Hi, We are using solr 5.2.0 and we have Index-heavy (100 index updates per sec) and Query-heavy (100 queries per sec) scenario. Index stats: 10 million documents and 16 GB index size Which sharding strategy is best suited in above scenario? Please share reference resources which states

Re: Solr JSON facet range out of memory exception

2016-04-11 Thread Toke Eskildsen
On Mon, 2016-04-11 at 13:31 +0430, Ali Nazemian wrote: > http: //10.102.1.5: 8983/solr/edgeIndex/select?q=*%3A*=stat_owner_id: > 122952=0=json=true=true=%7bresult: %7b > type: range, > field: stat_date, > start: 146027158386, > end: 1460271583864, > gap: 1 > %7d%7d

Re: Solr JSON facet range out of memory exception

2016-04-11 Thread Ali Nazemian
Dear Yonik, Hi, The entire index has 50k documents not the faceted one. It is just a test case right now! I used the JSON facet API, here is my query after encoding: http: //10.102.1.5: 8983/solr/edgeIndex/select?q=*%3A*=stat_owner_id: 122952=0=json=true=true=%7bresult: %7b type: range, field:

RE: EmbeddedSolr for unit tests in Solr 6

2016-04-11 Thread Rohana Rajapakse
Thanks Shawn, I am now pointing solrHomeFolder to lucene-solr-master\solr\server\solr which contains the correct solr.xml file. Tried the following two ways to create an EmbeddedSolrServer: 1. CoreContainer corecon = CoreContainer.createAndLoad(Paths.get(solrHomeFolder));

Re: Set Config API user properties with SolrJ

2016-04-11 Thread Georg Sorst
The issue is here: org.apache.solr.handler.SolrConfigHandler.handleRequestBody() This method will check the 'httpMethod' of the request. The set-user-property call will only be evaluated if the method is POST. Apparently, for non-HTTP requests this will never be true. I'll gladly write an issue

Re: Saving Solr filter query.

2016-04-11 Thread Pritam Kute
Thanks so much Erick and John for your inputs. This was surely helpful input for me. I tried using RDBMS and stored user specific queries into RDBMS. It is working for me. Thanks & Regards, -- *Pritam Kute* On Thu, Apr 7, 2016 at 3:01 AM, John Bickerstaff wrote: >