Re: Solr - zoo with more than 1000 collections

2018-07-04 Thread Gus Heck
Hi Bertrand, Are you by any chance using the new Time Routed Aliases feature? You didn't mention it so I suspect not, but you might want to look... It's still pretty new, but it would be interesting to get your feedback on it if it looks like it would help. I'm wondering how you get to that many

Re: Solr - zoo with more than 1000 collections

2018-06-29 Thread Yago Riveiro
Solr doesn’t scale very well with ~2K collections, and yes de bottleneck is Zookeeper itself. Zookeeper doesn’t perform operation as quickly as expected with folders with a lot of children. In a scenario where you are in a recovery state (a node crash), this limitation will hurt a lot, the que

Solr - zoo with more than 1000 collections

2018-06-29 Thread Bertrand Mahé
Hi, In order to store timeseries data and perform deletion easily, we create a several collections per day and then use aliases. We are using SOLR 7.3 and we have 2 questions: Q1 : In order to access quickly the latest data would it be possible to load cores in descending chronological