Re: Delayed/waiting requests

2019-01-10 Thread Hullegård , Jimi
Could be caused by garbage collection in the jvm. https://wiki.apache.org/solr/SolrPerformanceProblems Go down to the segment called “GC pause problems” /Jimi Sent from my iPhone On 11 Jan 2019, at 05:05, Gael Jourdan-Weil mailto:gael.jourdan-w...@kelkoogroup.com>> wrote: Hello, We are exp

Re: how to recover state.json files

2019-01-10 Thread Yogendra Kumar Soni
Thanks Shawn and ErickI got the points * Solr does not stored every single piece of information of state.json but can be recreated. I think there is something not adding up << On 1/9/2019 4:25 AM, Yogendra Kumar Soni wrote: > > How to know attributes like shard name and hash ranges with associat

Re: how to recover state.json files

2019-01-10 Thread Shawn Heisey
On 1/9/2019 4:25 AM, Yogendra Kumar Soni wrote: How to know attributes like shard name and hash ranges with associated core names if we lost state.json file from zookeeper. core.properties only contains core level information but hash ranges are not stored there. Does solr stores collection info

Delayed/waiting requests

2019-01-10 Thread Gael Jourdan-Weil
Hello, We are experiencing some performance issues on a simple SolrCloud cluster of 3 replicas (1 core) but what we found during our analysis seems a bit odd, so we thought the community could have relevant ideas on this. Load: between 30 and 40 queries per second, constant over time of analysi

6.3 -> 6.4 Sorting responseWriter renamed

2019-01-10 Thread Raveendra Yerraguntla
Hello All, In 6.4 (Solr-9717)  SortingResponseWriter is renamed to ExportWriter and moved to a different package. For migrating to higher Solr (post 6.4) versions, I  need to help with compatible functionalities. Application is using  SortingResponseWriter in the searcher handlers inform method

Re: REBALANCELEADERS is not reliable

2019-01-10 Thread Erick Erickson
Bernd: Don't feel bad about missing it, I wrote the silly stuff and it took me some time to remember. Those are the rules. It's always humbling to look back at my own code and say "that idiot should have put some comments in here..." ;) yeah, I agree there are a lot of moving parts here. I

Re: how to recover state.json files

2019-01-10 Thread Erick Erickson
bq. Does solr stores shard and hash ranges somewhere similar to core.properties? no. But it's easy enough to get them, just create another dummy collection with the same number of shards and copy the hash ranges from the dummy collection to ZK. bq. also dataDir was inside zookeeper dir. What? A

SV: Single query to get the count for all individual collections

2019-01-10 Thread Hullegård , Jimi
Unless someone else has a cleaver solution, maybe one option could be to add a new field that simply contains the collection id. Then you could do a facet query on that field to get the count per collection. /Jimi -Ursprungligt meddelande- Från: Zheng Lin Edwin Yeo Skickat: den 10 janu

Re: Solr Cloud wiping all cores when restart without proper zookeeper directories

2019-01-10 Thread Yogendra Kumar Soni
Chris, These are the steps to reproduce the issue not actually deleting it. Solr is deleting data if it doesn't find collections folder in zookeeper. On Thu, Jan 10, 2019, 6:32 PM Chris Ulicny Out of curiosity, why are you manually deleting nodes in zookeeper? > > It's always seemed to me that th

Exception on log

2019-01-10 Thread ennio
I'm running SOLR 7.3.1 on a Windows Server 2016 with 16GB (Server is not dedicated to SOLR) and from time to time when I look at the log files I see the following error: 2019-01-10 13:06:18.136 INFO (qtp434091818-45) [ x:topics] o.a.s.s.HttpSolrCall Unable to write response, client closed conne

Re: Solr Cloud wiping all cores when restart without proper zookeeper directories

2019-01-10 Thread Chris Ulicny
Out of curiosity, why are you manually deleting nodes in zookeeper? It's always seemed to me that the majority (definitely not all) of modifications needed during normal operations can usually be done through Solr's APIs. Thanks, Chris On Thu, Jan 10, 2019 at 12:04 AM Yogendra Kumar Soni < yogen

Re: Single query to get the count for all individual collections

2019-01-10 Thread Jan Høydahl
Just to a series of cheap http://localhost:8983/solr/mycoll/select?q=*:*&rows=0 requests :) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 10. jan. 2019 kl. 04:40 skrev Zheng Lin Edwin Yeo : > > Hi, > > I would like to find out, is there any way that I can send a

Re: Web Server HTTP Header Internal IP Disclosure SOLR port

2019-01-10 Thread Jan Høydahl
Yea, it really won't work to tunnel Admin UI, it needs to see the actual IP/host names, so some kind of Socks or VPN would need to be used. Anyway, you can always set the HOST (-Djetty.host) property for each host to FQDN instead of IP, in which case those names will be used in clusterstate and als

Re: REBALANCELEADERS is not reliable

2019-01-10 Thread Bernd Fehling
Hi Erik, that is very valuable info I missed. Shouldn't that belong into an issue about rework at REBALANCELEADERS? With your explanation the use of a queue makes sense and now I see some of the logic behind. - there is the leader and the firstWatcher - if firstWatcher goes down or is inactive t

Re: how to recover state.json files

2019-01-10 Thread Yogendra Kumar Soni
It was a mistake that got zookeeper dir deleted also dataDir was inside zookeeper dir. We manually created zookeeper files taking reference from another solr instance, core.properties etc. SolrCloud is up and running and we are able to search.correct hash ranges for each shard is only missing pi