Re: How to determine why solr stops running?

2020-06-30 Thread Otis Gospodnetić
Hi, Maybe https://github.com/sematext/solr-diagnostics can be of use? Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ On Mon, Jun 29, 2020 at 3:46 PM Erick Erickson wrote: > Really look at your cache

Re: Is there a recommended open source GUI tool for monitoring 'zookeeper'?

2019-01-09 Thread Otis Gospodnetić
Hi, Sematext's monitoring agent with a ZooKeeper integration is open-source: https://github.com/sematext/sematext-agent-java The ZK integration is at https://github.com/sematext/sematext-agent-integrations/tree/master/zookeeper (Solr and SolrCloud integrations are in the same repo) If you can't

Re: jetty access logs for monitoring

2017-10-30 Thread Otis Gospodnetić
Hi, I think Logagent has support for Solr logs. Aha, yes, it does: https://github.com/sematext/logagent-js/blob/master/patterns.yml (search for Solr). But if you are looking for Solr metrics monitoring, see Solr monitoring

Re: Disadvantages of having many cores

2017-07-31 Thread Otis Gospodnetić
Hi, Core per day is not too bad. I assume you'll want to keep 7 days or maybe 30 or 60 or 180 days worth of logs. That won't result in too many cores, given adequate hardware. Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training -

Re: Poll: Master-Slave or SolrCloud?

2017-04-25 Thread Otis Gospodnetić
ose deals where _functionally_, it's OK to run > embedded ZK, but administratively it's suspect. > > Best, > Erick > > On Tue, Apr 25, 2017 at 10:49 AM, Rick Leir <rl...@leirtech.com> wrote: > > All, > > I read somewhere that you should run your own ZK externally,

Re: Poll: Master-Slave or SolrCloud?

2017-04-25 Thread Otis Gospodnetić
, Charlie Hull <char...@flax.co.uk> wrote: > On 24/04/2017 15:58, Otis Gospodnetić wrote: > >> Hi, >> >> I'm really really surprised here. Back in 2013 we did a poll to see how >> people were running Master-Slave (4.x back then) and SolrCloud was a bit >> more

Re: Poll: Master-Slave or SolrCloud?

2017-04-24 Thread Otis Gospodnetić
my > question is whether the same people are responding to the new survey > as the old one. "If it ain't broke" and all that. > > Erick > > On Mon, Apr 24, 2017 at 7:58 AM, Otis Gospodnetić > <otis.gospodne...@gmail.com> wrote: > > Hi, > > > > I'm

Poll: Master-Slave or SolrCloud?

2017-04-24 Thread Otis Gospodnetić
Hi, I'm really really surprised here. Back in 2013 we did a poll to see how people were running Master-Slave (4.x back then) and SolrCloud was a bit more popular than Master-Slave: https://sematext.com/blog/2013/02/25/poll-solr-cloud-or-not/ Here is a fresh new poll with pretty much the same

Re: What is the bottleneck for an optimise operation?

2017-03-02 Thread Otis Gospodnetić
Hi, It's simply expensive. You are rewriting your whole index. Why are you running optimize? Are you seeing performance problems you are trying to fix with optimize? Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training -

Re: What is the bottleneck for an optimise operation?

2017-03-02 Thread Otis Gospodnetić
Hi Matthew, I'm guessing it's the EBS. With EBS we've seen: * cpu.system going up in some kernels * low read/write speeds and maxed out IO at times Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ On

Re: [ANN] InvisibleQueriesRequestHandler

2016-12-09 Thread Otis Gospodnetić
Nice. Here is something similar: https://github.com/sematext/solr-researcher - hope others find it useful, too. Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ On Mon, Dec 5, 2016 at 4:18 AM, Andrea

Re: Writing Solr Custom Components

2016-10-06 Thread Otis Gospodnetić
John, if it helps, here are a few examples of custom Solr SearchComponents: https://github.com/sematext/query-segmenter https://github.com/sematext/solr-researcher https://github.com/sematext/solr-autocomplete I hope this helps. Otis -- Monitoring - Log Management - Alerting - Anomaly Detection

Re: Reset JMX counters for monitoring without restarting

2016-04-02 Thread Otis Gospodnetić
Hi Jeff, With info that Solr provides in JMX you have to keep track of things yourself, do subtractions and counting yourself. If you don't feel like reinventing that, see https://sematext.com/spm/integrations/solr-monitoring/ Otis -- Monitoring - Log Management - Alerting - Anomaly Detection

Re: High Cpu sys usage

2016-03-20 Thread Otis Gospodnetić
Hi, On Wed, Mar 16, 2016 at 10:59 AM, Patrick Plaatje wrote: > Hi, > > From the sar output you supplied, it looks like you might have a memory > issue on your hosts. The memory usage just before your crash seems to be > *very* close to 100%. Even the slightest increase (Solr

Re: High Cpu sys usage

2016-03-19 Thread Otis Gospodnetić
Hi, I looked at those metrics outputs, but nothing jumps out at me as problematic. How full are your JVM heap memory pools? If you are using SPM to monitor your Solr/Tomcat/Jetty/... look for a chart that looks like this: https://apps.sematext.com/spm-reports/s/zB3JcdZyRn If some of these

Re: Solr memory usage

2015-12-11 Thread Otis Gospodnetić
Hi Steve, Fluctuation is OK. 100% utilization for more than a moment is not :) Not sure what tool(s) you use for monitoring your Solr servers, but look under "JVM Pool Utilization" in SPM if you're using SPM. Or this live demo of a Solr system: * click on https://apps.sematext.com/demo to get

Re: Solr Log Analysis

2015-09-24 Thread Otis Gospodnetić
Hi Magesh, Here are 2 more solutions you could use: 1) Site Search Analytics -- this basically integrates into your search results via JS like Google Analytics and automatically captures a bunch of search and click data and gives you a number of

Re: Solr health check monitor for multiple cores

2015-09-13 Thread Otis Gospodnetić
Hi Daniel, Lots of organizations use our SPM to monitor Solr / SolrCloud (see http://sematext.com/spm/integrations/solr-monitoring.html ) . We're working on "Top Queries" type of reporting for Solr, which I'm very excited about. :) Otis -- Monitoring * Alerting * Anomaly Detection * Centralized

Re: solr training

2015-09-13 Thread Otis Gospodnetić
Hi Tim, A slightly delayed reply ;) We are running Solr training in NYC next month - http://sematext.com/training/solr-training.html - 2nd seat is 50% off. Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ On