Creating Solr cores dynamically with config files using solrj

2016-11-09 Thread Gimantha Bandara
Hi all, I have requirement where multiple solr cores need to be created with different schema. Using CoreAdminAPI, I can create a core dynamically but, I have to create a folder and copy the schema.xml and solrconfig.xml there before invoking the API. Is there a way to create solr cores with some

Re: error while working solr 6.2 cdcr

2016-11-09 Thread Neeraj Bhatt
Hi Eric Source have only target zookeeper ensemble (only 3 ips) 192.169.35.53:2181,192.169.35.249:2181, 192.169.35.251:2181> , because of some mail formatting ip were repeated(see sent item attached image). Error in log files is Action LASTPROCESSEDVERSION sent to non-leader replica at org.a

Re: Basic Auth for Solr Streaming Expressions

2016-11-09 Thread Joel Bernstein
Thanks for digging into this, let's create a jira ticket for this. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Nov 9, 2016 at 6:23 PM, sandeep mukherjee < wiredcit...@yahoo.com.invalid> wrote: > I have more progress since my last mail. I figured out that in the > StreamContext object t

Re: Basic Auth for Solr Streaming Expressions

2016-11-09 Thread sandeep mukherjee
I have more progress since my last mail. I figured out that  in the StreamContext object there is a way to set the SolrClientCache object which keep reference to all the CloudSolrClient where I can set a reference to HttpClient which sets the Basic Auth header. However the problem is, inside the

Re: solrj Https problem

2016-11-09 Thread sandeep mukherjee
Thanks Bryan for the response. That seem to have solved it. On Monday, October 31, 2016 6:58 PM, Bryan Bende wrote: A possible problem might be that your certificate was generated for "localhost" which is why it works when you go to https://localhost:8985/solr in your browser, but when S

Re: Editing schema and solrconfig files

2016-11-09 Thread Erick Erickson
We had the bright idea of allowing editing of the config files through the UI... but the ability to upload arbitrary XML is a security vulnerability, so that idea was nixed. The solr/bin script has an upconfig and downconfig command that are (I hope) easier to use than zkcli, I think from 5.5. In

Re: Rolling backups of a collection

2016-11-09 Thread Mike Thomsen
Thanks. If we write such a process, I'll see if I can get permission to release it. It might be a moot point because I found out we're stuck on 4.10.3 for the time being. Haven't used that version in a while and forgot it didn't even have the collection backup API. On Wed, Nov 9, 2016 at 2:18 PM,

Re: Editing schema and solrconfig files

2016-11-09 Thread John Bickerstaff
I never found a way to do it through the UI... and ended up using "nano" on linux for simple things. For more complex stuff, I scp'd the file (or the whole conf directory) up to my dev box (a Mac in my case) and edited in a decent UI tool, then scp'd the whole thing back... I wrote a simple bash

Editing schema and solrconfig files

2016-11-09 Thread Reth RM
What are some easiest ways to edit/modify/add conf files, such as solrconfig.xml and schema.xml other than APIs end points or using zk commands to re-upload modified file? In other words, can we edit conf files through solr admin (GUI) interface(add new filed by click on button or add new request

Re: OOM Error

2016-11-09 Thread Susheel Kumar
Thanks, Shawn for looking into. Your summption is right, the end of graph is the OOM. I am trying to collect all the queries & ingestion numbers around 9:12 but one more observation and a question from today Observed that on 2-3 VM's out of 12, shows high usage of heap even though heavy ingestion

Basic Auth for Solr Streaming Expressions

2016-11-09 Thread sandeep mukherjee
Hello everyone, I trying to find the documentation for Basic Auth plugin for Solr Streaming expressions. But I'm not able to find it in the documentation anywhere. Could you please point me in right direction of how to enable Basic auth for Solr Streams? I'm creating StreamFactory as follows: I

Re: Rolling backups of a collection

2016-11-09 Thread Hrishikesh Gadre
Hi Mike, I filed SOLR-9744 to track this work. Please comment on this jira if you have any suggestions. Thanks Hrishikesh On Wed, Nov 9, 2016 at 11:07 AM, Hrishikesh Gadre wrote: > Hi Mike, > > Currently we don't have capability to take rollin

Re: Rolling backups of a collection

2016-11-09 Thread Hrishikesh Gadre
Hi Mike, Currently we don't have capability to take rolling backups for the Solr collections. I think it should be fairly straightforward to write a script that implements this functionality outside of Solr. If you post that script, may be we can even ship it as part of Solr itself (for the benefi

Rolling backups of a collection

2016-11-09 Thread Mike Thomsen
I read over the docs ( https://cwiki.apache.org/confluence/display/solr/Making+and+Restoring+Backups) and am not quite sure what route to take. My team is looking for a way to backup the entire index of a SolrCloud collection with regular rotation similar to the backup option available in a single

Re: 5.5.3: fieldValueCache auto-warming error

2016-11-09 Thread Erick Erickson
That is strange. If you turn off autowarming for fieldValueCache and this goes away that would be _really_ strange indeed. But my bet is that you _are_ doing something that uninverts the text field (obviously inadvertently). If you restart Solr and monitor the log until the first time you see this

Re: error while working solr 6.2 cdcr

2016-11-09 Thread Erick Erickson
Why do you have 6 zookeepers listed in the zkHost parameter? My guess is that you've listed the ZK addresses for both the source and target clusters. This should only be the ZK nodes for the target cluster and only present on the source. The source already knows its own ZK addresses, it needs to k

Re: OOM Error

2016-11-09 Thread Shawn Heisey
On 11/8/2016 12:49 PM, Susheel Kumar wrote: > Ran into OOM Error again right after two weeks. Below is the GC log > viewer graph. The first time we run into this was after 3 months and > then second time in two weeks. After first incident reduced the cache > size and increase heap from 8 to 10G. In

Re: SolrJ optimize method -- not returning immediately when the "wait" options are false

2016-11-09 Thread Shawn Heisey
On 11/8/2016 4:27 PM, Yonik Seeley wrote: > So no, you should not expect to see an immediate return with > waitSearcher=false since it only represents the > open-and-register-searcher part. That's too bad. I already have the SolrJ call happening in a separate thread, so it doesn't really affect m

error while working solr 6.2 cdcr

2016-11-09 Thread Neeraj Bhatt
Hello All I have a source cluster (3 nodes, 3 shards and 3 replica) and same for target cluster. On posting of documents to source I am getting below error in target solr log files when i turned log to debug level *6538 ERROR (qtp110456297-20) [c:multi_dc_poc s:shard1 r:core_node3 x:multi_dc_p

Re: CDCR (Solr6.x) does not start

2016-11-09 Thread neerajbhatt
Hi Uwe I am facing the same error as you , I am getting error 6538 ERROR (qtp110456297-20) [c:multi_dc_poc s:shard1 r:core_node3 x:multi_dc_poc_shard1_replica2] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Action LASTPROCESSEDVERSION sent to non-leader replica at org.ap

5.5.3: fieldValueCache auto-warming error

2016-11-09 Thread Bram Van Dam
Hey folks, I'm frequently getting the following error, which has me a little puzzled: Error during auto-warming of key:text:org.apache.solr.common.SolrException: java.lang.IllegalStateException: Too many values for UnInvertedField faceting on field text This is strange because the field in quest