Re: Creating Solr cores dynamically with config files using solrj

2016-11-10 Thread Gimantha Bandara
Thank you very much Shawn! Will give it a try.. On Friday, November 11, 2016, Shawn Heisey wrote: > On 11/9/2016 11:04 PM, Gimantha Bandara wrote: > > I have requirement where multiple solr cores need to be created with > > different schema. Using CoreAdminAPI, I can create

Re: Wildcard searches with space in TextField/StrField

2016-11-10 Thread Sandeep Khanzode
Hi Erick, Reth, The 'a\ b*' as well as the q.op=AND approach worked (successfully) only for StrField for me. Any attempt at creating a 'a\ b*' for a TextField does not match any documents. The parsedQuery in debug mode does show 'field:a b*'. I am sure there are documents that should match.

Re: SolrCloud Configuration

2016-11-10 Thread Wunna Lwin
That is work on standalone cluster. and i think did not work in solrcloud mode. I created collection, name document but that actual collection doesn't exist. So, In the cloud mode, I am not sure where I have upload those lib. On Thu, Nov 10, 2016 at 4:10 PM, Wunna Lwin

Re: Parallelize Cursor approach

2016-11-10 Thread Joel Bernstein
Solr 5 was very early days for Streaming Expressions. Streaming Expressions and SQL use Java 8 so development switched to the 6.0 branch five months before the 6.0 release. So there was a very large jump in features and bug fixes from Solr 5 to Solr 6 in Streaming Expressions. Joel Bernstein

Re: Parallelize Cursor approach

2016-11-10 Thread Joel Bernstein
In Solr 5 the /export handler wasn't escaping json text fields, which would produce json parse exceptions. This was fixed in Solr 6.0. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Nov 8, 2016 at 6:17 PM, Erick Erickson wrote: > Hmm, that should work fine. Let

Re: Is there a way to tell if multivalued field actually contains multiple values?

2016-11-10 Thread Erick Erickson
I don't think so. Once things are indexed, they look just like a regular text field with odd offsets for some of the terms. Of course if you returned the stored form (assuming it's stored) it'd look different, but that's messy too. Best, Erick On Thu, Nov 10, 2016 at 6:08 PM, Alexandre

Re: FileDictionaryFactory : sourceLocation entry error

2016-11-10 Thread Erick Erickson
You have a double backslash in your definition between Project\\admin, although that may be a typo. Two things: 1> try forward slashes instead. Java likes those. 2> this looks like the Lucidworks app (fusion), you may have to ask on their forum. Best, Erick On Thu, Nov 10, 2016 at 6:11 PM,

FileDictionaryFactory : sourceLocation entry error

2016-11-10 Thread Amitesh Tiwari
Hi Team, I am implementing below suggester for some admin controlled suggested words. adminSuggester FuzzyLookupFactory FileDictionaryFactory C:\\Project\\adminAuto.txt , suggestXYZField false Problem is, what's the way to locate the file ?

error while using cdcr

2016-11-10 Thread Neeraj Bhatt
Hi All My source and target clusters (one shard/one replica) are not able to communicate , from target logs it seems there is some issue that counter which is used to keep source and target cluster in sync as below I am following the exact configuration and steps as given in wiki 48125 INFO

Is there a way to tell if multivalued field actually contains multiple values?

2016-11-10 Thread Alexandre Rafalovitch
Hello, Say I indexed a large dataset against a schemaless configuration. Now I have a bunch of multivalued fields. Is there any way to say which of these (text) fields have (for given data) only single values? I know I am supposed to look at the original data, and all that, but this is more for

Re: Creating Solr cores dynamically with config files using solrj

2016-11-10 Thread Shawn Heisey
On 11/9/2016 11:04 PM, Gimantha Bandara wrote: > I have requirement where multiple solr cores need to be created with > different schema. Using CoreAdminAPI, I can create a core dynamically > but, I have to create a folder and copy the schema.xml and > solrconfig.xml there before invoking the API.

Re: Sorl shards: very sensitive to swap space usage !?

2016-11-10 Thread Kevin Risden
Agreed with what Shawn and Erick said. If you don't see anything in the Solr logs and your servers are swapping a lot, this could mean the Linux OOM killer is killing the Solr process (and maybe others). There is usually a log of this depending on your Linux distribution. Kevin Risden On Thu,

Re: Sorl shards: very sensitive to swap space usage !?

2016-11-10 Thread Shawn Heisey
On 11/10/2016 3:20 PM, Chetas Joshi wrote: > I have a SolrCloud (Solr 5.5.0) of 50 nodes. The JVM heap memory usage > of my solr shards is never more than 50% of the total heap. However, > the hosts on which my solr shards are deployed often run into 99% swap > space issue. This causes the solr

Re: Sorl shards: very sensitive to swap space usage !?

2016-11-10 Thread Erick Erickson
Lots of data from the index is kept in MMapDirectory space, which is mapped to the OS's memory, see Uwe's excellent explanation here: http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html Best, Erick On Thu, Nov 10, 2016 at 2:20 PM, Chetas Joshi wrote:

Re: Wildcard searches with space in TextField/StrField

2016-11-10 Thread Erick Erickson
You can escape the space with a backslash as 'a\ b*' Best, Erick On Thu, Nov 10, 2016 at 2:37 PM, Reth RM wrote: > I don't think you can do wildcard on StrField. For text field, if your > query is "category:(test m*)" the parsed query will be "category:test OR >

Re: Wildcard searches with space in TextField/StrField

2016-11-10 Thread Reth RM
I don't think you can do wildcard on StrField. For text field, if your query is "category:(test m*)" the parsed query will be "category:test OR category:m*" You can add q.op=AND to make an AND between those terms. For phrase type wild card query support, as per docs, it is

Sorl shards: very sensitive to swap space usage !?

2016-11-10 Thread Chetas Joshi
Hi, I have a SolrCloud (Solr 5.5.0) of 50 nodes. The JVM heap memory usage of my solr shards is never more than 50% of the total heap. However, the hosts on which my solr shards are deployed often run into 99% swap space issue. This causes the solr shards go down. Why solr shards are so sensitive

CDCR: Help With Tlog Growth Issues

2016-11-10 Thread Thomas Tickle
I am having an issue with cdcr that I could use some assistance in resolving. I followed the instructions found here: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=62687462 The CDCR is setup with a single source to a single target. Both the source and target cluster are

Re: SolrCloud Configuration

2016-11-10 Thread Reth RM
The easiest way is to create a /lib directory under each solr node and place the custom jar in it. But I think it doesn't get distributed over cluster, so this approach requires jar to be placed manually on each node. IIRC, it was recommended that such custom jar to be on disc than uploaded to

Wildcard searches with space in TextField/StrField

2016-11-10 Thread Sandeep Khanzode
Hi, How does a search like abc* work in StrField. Since the entire thing is stored as a single token, is it a type of a trie structure that allows such wildcard matching?  How can searches with space like 'a b*' be executed for text fields (tokenized on whitespace)? If we specify this type of

Re: 5.5.3: fieldValueCache auto-warming error

2016-11-10 Thread Erick Erickson
Just facet on the text field yourself ;) Kidding aside, this should be in the clear from the logs, my guess is that the first time you see an OOM error in the logs the query will be in the file also. You could also fire up Solr with the OOM killer script (see solr/bin). Kind of harsh, but

Re: Filter nested index - remove empty parents

2016-11-10 Thread Erick Erickson
It looks like you're trying to just index tables from some DB and then search them in Solr as you would the DB. Solr join queries aren't like DB joins, especially you can't return _fields_ from the "from" table. The usual recommendation, if at all possible, is to flatten your data. This runs

Filter nested index - remove empty parents

2016-11-10 Thread Dragos Bogdan
Hello, I am new to SOLR and at the first glance, I can say this is a very good service. Very helpful and fast. I am trying to filter docs based on some criteria but I have few issues obtaining the final results.The main objective is to have one query that is able to offer a list of Persons with

How to attract attention to a patch?

2016-11-10 Thread Ere Maijala
I've posted a patch to fix core functionality in Solr MLT parsers (see https://issues.apache.org/jira/browse/SOLR-9644), but it or the associated pull request in GitHub don't seem to get any attention. The HowToContribute page says that "If no one responds to your patch after a few days,

Re: 5.5.3: fieldValueCache auto-warming error

2016-11-10 Thread Bram Van Dam
On 09/11/16 16:59, Erick Erickson wrote: > But my bet is that you _are_ doing something that uninverts the text > field (obviously inadvertently). If you restart Solr and monitor the > log until the first time you see this exception, what do the queries > show? My guess is that once you get some

SolrCloud Configuration

2016-11-10 Thread Wunna Lwin
Hi, I just using solrCloud version 6.2.1 and everything is find but I would like to add some additional custom plugin into solrCloud. So, I upload my custom lib using Blob api and create requestHandler and components using config api into .system collection. But config api didn't load my custom

Re: error while working solr 6.2 cdcr

2016-11-10 Thread Neeraj Bhatt
Hi Eric With one shard and one replica I am getting " 08976 ERROR (qtp110456297-13) [c:multi_dc_poc s:shard1 r:core_node1 x:multi_dc_poc_shard1_replica1] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Unknown action: null at