Count on Multivalued field using facet

2016-10-06 Thread Aswath Srinivasan (TMS)
Hello, I'm having a result set something like this, and query like below. The facet count for Line field is 1(1). That is, value Line's value 1 has numBucket = 1. However, I need to count the number of occurrence of each of the values in the LINE field. Is there a way to do this? Expecting

Month facet - possible bucket values are Jan, Feb, Mar,…. Nov, Dec

2016-09-20 Thread Aswath Srinivasan (TMS)
Hello, How to build a Month facet from a date field? The facet that I’m looking for should have a maximum of only 12 buckets. The possible bucket values are Jan, Feb, Mar,…. Nov, Dec.

SQL Joins in Parallel SQL Interface

2016-09-14 Thread Aswath Srinivasan (TMS)
Hello, I'm exploring the Parallel SQL. I don't see any SQL JOIN features available in the parallel SQL interface, in the documentation. Is it even possible to do SQL JOIN in the parallel SQL interface? Was looking at streaming expression but looks like facets are not possible with it. Not

facet.piovt on a join query, joining two different collections

2016-09-13 Thread Aswath Srinivasan (TMS)
Hello, We are trying to do a pivot on the facet on two fields which exists on two different collections. We are joining the two collections using a common filed. Below is the query I'm having right now and it doesn't seem to work. Any help would be much appreciated.

Collection going to recovery mode - Leader election issue?

2016-08-02 Thread Aswath Srinivasan (TMS)
Hi All, Solr verion 5.3.2 Zookeeper 3.6.2 SolrCloud - 2 shards, 4 replicas, 4 nodes Above is the set up. 3 of the shards (replicas) went to a recovery mode which the following ERROR in the logs. Anyone experienced this before? I had to restart the Solr server nodes to bring them all up. Looks

BinFileDataSource delta import

2016-03-28 Thread Aswath Srinivasan (TMS)
Hi fellow developers, We are using "BinFileDataSource" datasource in our DIH config file to index local file system files. It is able to index the files however, during the next cycle of indexing, files that were removed from source file system folder is not removed from index. I believe Solr

RE: PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2016-03-22 Thread Aswath Srinivasan (TMS)
o: solr-user@lucene.apache.org Subject: Re: PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/22/2016 11:32 AM, Aswath Srinivasan (TMS) wrote: > Thank you Shawn for taking time and responding. > > Unfortunately, this is not the case. My heap is not even going past > 50% and I ha

RE: PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2016-03-22 Thread Aswath Srinivasan (TMS)
MANCE WARNING: Overlapping onDeckSearchers=2 On 3/21/2016 6:49 PM, Aswath Srinivasan (TMS) wrote: >>> Thank you for the responses. Collection crashes as in, I'm unable to open >>> the core tab in Solr console. Search is not returning. None of the page >>> opens in so

RE: PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2016-03-21 Thread Aswath Srinivasan (TMS)
Subject: Re: PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/21/2016 12:52 PM, Aswath Srinivasan (TMS) wrote: > Fellow developers, > > PERFORMANCE WARNING: Overlapping onDeckSearchers=2 > > I'm seeing this warning often and whenever I see this, the collection > crashes. The only way t

RE: PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2016-03-21 Thread Aswath Srinivasan (TMS)
If you're seeing a crash, then that's a distinct problem from the WARN -- it might be related tothe warning, but it's not identical -- Solr doesn't always (or even normally) crash in the "Overlapping onDeckSearchers" situation That is what I hoped for. But I could see nothing else in the log.

RE: PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2016-03-21 Thread Aswath Srinivasan (TMS)
- From: Aswath Srinivasan (TMS) [mailto:aswath.sriniva...@toyota.com] Sent: Monday, March 21, 2016 11:52 AM To: solr-user@lucene.apache.org Subject: PERFORMANCE WARNING: Overlapping onDeckSearchers=2 Fellow developers, PERFORMANCE WARNING: Overlapping onDeckSearchers=2 I'm seeing this warning

PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2016-03-21 Thread Aswath Srinivasan (TMS)
Fellow developers, PERFORMANCE WARNING: Overlapping onDeckSearchers=2 I'm seeing this warning often and whenever I see this, the collection crashes. The only way to overcome this is by deleting the data folder and reindexing. In my observation, this WARN comes when I hit frequent hard commits

Zookeeper upconfig files to upload big config files

2016-02-17 Thread Aswath Srinivasan (TMS)
Hi fellow Solr developers, I'm tyring to upconfig my config files and my synonyms.txt file is about 2 MB. Whenever I try to do this, I get the following expection. It's either a "broken pipe" expection or the following expection. Any advice for me to fix it? If I remove most of the synonym

Taking Solr to production

2016-01-22 Thread Aswath Srinivasan (TMS)
If below is the situation, * 4 Virtual machines with 64 GB RAM - 64bit machines, 512 GB storage for each VM * Totally about 2.5 million documents to be indexed * Documents average size is 512 KB - pdfs and htmls * Expected QPS is 150 * Incremental

RE: Taking Solr to production

2016-01-22 Thread Aswath Srinivasan (TMS)
016 at 5:45 PM, Toke Eskildsen wrote: > Aswath Srinivasan (TMS) wrote: > > * Totally about 2.5 million documents to be indexed > > * Documents average size is 512 KB - pdfs and htmls > > > This being said I was thinking I would take the Solr to production with, > > * 2 sh

RE: Solrcloud for Java 1.6

2016-01-07 Thread Aswath Srinivasan (TMS)
:26 AM, <billnb...@gmail.com> wrote: > Run it on 2 separate boxes > > Bill Bell > Sent from mobile > > > > On Jan 7, 2016, at 3:11 PM, Aswath Srinivasan (TMS) < > aswath.sriniva...@toyota.com> wrote: > > > > Hi fellow developers, > > > &g

RE: Solrcloud for Java 1.6

2016-01-07 Thread Aswath Srinivasan (TMS)
Thanks for the responses guys. >> i have solrj5 client for 1.7 converted into 1.6 Can you please explain this part with little more details? Thank you, Aswath NS -Original Message- From: Aswath Srinivasan (TMS) [mailto:aswath.sriniva...@toyota.com] Sent: Thursday, January 07,

Solrcloud for Java 1.6

2016-01-07 Thread Aswath Srinivasan (TMS)
Hi fellow developers, I have a situation where the search front-end application is using java 1.6. Upgrading Java version is out of the question. Planning to use Solrcloud 5.x version for the search implementation. The show stopper here is, solrj for solrcloud needs atleast java1.7 What best

SolrCloud page is blank

2015-12-11 Thread Aswath Srinivasan (TMS)
Hi All, We have set up a solr 5.3.1. Now I realize that in the solr admin UI, the cloud page is blank. What could be the reason behind this? Following are the exceptions that I’m seeing in the logs 12/11/2015, 9:58:37 AM WARN null ClientCnxn Session 0x25111a5595ab885 for server null,​

Zookeeper connection refused error

2015-12-10 Thread Aswath Srinivasan (TMS)
Hi all, I tried to create a collection with 3 shards and it got created. Verified the same in SOLR Dashboard. But while creating the collection I'm seeing a "Connection Refused" when connecting to Zookeeper. Following is the expectation trace. Can somebody spot the mistake that is happening

Performance testing on SOLR cloud

2015-11-17 Thread Aswath Srinivasan (TMS)
Hi fellow developers, Please share your experience, on how you did performance testing on SOLR? What I'm trying to do is have SOLR cloud on 3 Linux servers with 16 GB RAM and index a total of 2.2 million. Yet to decide how many shards and replicas to have (Any hint on this is welcome too,

RE: tikaparser docx file fails with exception

2015-11-05 Thread Aswath Srinivasan (TMS)
d data is...bad data. You can experiment a bit with using Tika in Java, that might give you a better idea of what's really going on, here's a SolrJ example: https://lucidworks.com/blog/2012/02/14/indexing-with-solrj/ Best, Erick On Wed, Nov 4, 2015 at 3:49 PM, Aswath Srinivasan (TMS) <aswat

To update or change your SolrCloud configuration files

2015-11-04 Thread Aswath Srinivasan (TMS)
Hi fellow SOLR developers, https://cwiki.apache.org/confluence/display/solr/Using+ZooKeeper+to+Manage+Configuration+FilesThis link says the below To update or change your SolrCloud configuration files: 1. Download the latest configuration files from ZooKeeper, using the source control

RE: tikaparser docx file fails with exception

2015-11-04 Thread Aswath Srinivasan (TMS)
Trying to index a document. A docx file. Ending up with the below exception. Not sure why it is erroring out. When I opened the docx I was able to see lots of binary data like embedded pictures etc., Is there a possible solution to this or is it a bug? Only one such file fails. Rest of the