Re: Solr Prometheus Exporter failing with "Connection pool shut down" on large cluster

2019-11-22 Thread Richard Goodman
Sorry, I meant to say, Hey Alex It's because this time around I did reply all, and Serj's name was highlighted in my email! On Fri, 22 Nov 2019 at 17:17, Richard Goodman wrote: > Hey Serj, > > So I've applied your patch, deployed the latest build of the > solr-prometheus exporter, and left it

Re: Solr Prometheus Exporter failing with "Connection pool shut down" on large cluster

2019-11-22 Thread Richard Goodman
Hey Serj, So I've applied your patch, deployed the latest build of the solr-prometheus exporter, and left it running for a little bit. It's had some interesting results. As I mentioned, I split up my config from 1 monolithic config to separate configs, and have an instance running for each one

Re: Solr Prometheus Exporter failing with "Connection pool shut down" on large cluster

2019-11-22 Thread Alex Jablonski
Hey Richard, I'd definitely love to hear whether this improves things for you. According to Guava's documentation, the cache can start evicting items when it gets close to the limit ( https://github.com/google/guava/wiki/CachesExplained#size-based-eviction), not just when it reaches it, so if

Re: Solr Prometheus Exporter failing with "Connection pool shut down" on large cluster

2019-11-22 Thread Richard Goodman
Hi Alex, This makes me really happy to see an email about this. I've been working on a little while about setting up the prometheus exporter for our clusters. Spent good amount of time setting up config, and started getting some really decent graphs in grafana on metrics we've never been able to

Re: Solr Prometheus Exporter failing with "Connection pool shut down" on large cluster

2019-11-20 Thread Alex Jablonski
Pull request is here: https://github.com/apache/lucene-solr/pull/1022/ Thanks! Alex Jablonski On Wed, Nov 20, 2019 at 1:36 PM Alex Jablonski wrote: > Hi there! > > My colleague and I have run into an issue that seems to appear when > running the Solr Prometheus exporter in SolrCloud mode

Solr Prometheus Exporter failing with "Connection pool shut down" on large cluster

2019-11-20 Thread Alex Jablonski
Hi there! My colleague and I have run into an issue that seems to appear when running the Solr Prometheus exporter in SolrCloud mode against a large (> 100 node) cluster. The symptoms we're observing are "connection pool shut down" exceptions in the logs and the inability to collect metrics from