Re: SIP-17: Solr Node Autoscaling on Kubernetes

2023-05-18 Thread Houston Putman
A further addendum to these points I replied to Radu about earlier: >1. These single node commands would be less disruptive than an overall >REBALANCESHARDS command. >They target a single node (or a list of nodes) instead of a whole >cluster, so we would likely see less movement u

Re: SIP-17: Solr Node Autoscaling on Kubernetes

2023-04-20 Thread Houston Putman
> > Do you think we'll need a way to mark the nodes as "vacating" or something > so that they don't receive new replicas (i.e. for newly concurrently > created collections) while the REPLACENODE is being processed? > Great question. This would be an awesome addition. Kind of similar to the "shutti

Re: SIP-17: Solr Node Autoscaling on Kubernetes

2023-04-20 Thread Tomás Fernández Löbbe
Thanks for working on this SIP Houston, I'm looking forward to use it! Do you think we'll need a way to mark the nodes as "vacating" or something so that they don't receive new replicas (i.e. for newly concurrently created collections) while the REPLACENODE is being processed? On Thu, Apr 20, 2023

Re: SIP-17: Solr Node Autoscaling on Kubernetes

2023-04-20 Thread Houston Putman
Hey, sorry for the delay y'all! *I'll first reply to Radu!* I think it tackles one of the three common use-cases that I've seen for > autoscaling I completely agree, this is just the beginning. I think the first use case would be amazing, and I see it as an extension of this feature. I have som

Re: SIP-17: Solr Node Autoscaling on Kubernetes

2023-04-11 Thread Jason Gerlowski
Hey Houston, Thanks for putting this together. It's a really cool direction for the operator. A few quick questions about the proposal: 1. Does this SIP include one or more OOTB implementations for the UtilizeSelectionRequest interface? What heuristics might those work off of? 2. What does "m

Re: SIP-17: Solr Node Autoscaling on Kubernetes

2023-04-05 Thread Radu Gheorghe
Hi Houston, Thanks a lot for putting this together! I'd like to help with Solr Operator. Though I have limited availability in the following two months, maybe I can still be useful with a few things. Some comments regarding the SIP: - I think that in general it sounds like a good plan. I don't wa

SIP-17: Solr Node Autoscaling on Kubernetes

2023-03-30 Thread Houston Putman
Hello everyone, This is kind of a long-time coming, but I've finally created a SIP for autoscaling Solr Nodes on Kubernetes using the Solr Operator. https://cwiki.apache.org/confluence/display/SOLR/SIP-17%3A+Node+Autoscaling+via+Kubernetes There are still some details that need to be ironed out,