We run HA etcd, apiserver and controllers. What has worked well so far: - keep etcd upgrades separate -- Follow the etcd docs for that -- never skip a minor version -- just rolling upgrade, once the last etcd is upgraded there is no way back
- for Kubernetes upgrades -- apiserver first --- be careful about etcdv3 vs. v2, if you're starting now probably not an issue (you're already on v3) --- just rolling upgrade, don't run different versions for too long -- next, scheduler and controller manager I wrote a handful of scripts that solve this for our specific case, you'll need to do the same. I my opinion, running HA apiservers and etcd is not for you if you want things to just work; it is possible but there is no ready made tooling for it because the benefits for most use cases are slim. /MR On Thu, Aug 24, 2017, 21:44 <petar.pet...@leanplum.com> wrote: > Hey, > > I want to setup a HA Kubernetes cluster in GCE. > So far what I've used is kube-up.sh and was able to setup a 3 master > cluster with masters (and workers) in different zones. > > Basically followed: > > https://kubernetes.io/docs/tasks/administer-cluster/highly-available-master/ > http://blog.kubernetes.io/2017/02/highly-available-kubernetes-clusters.html > > > My question is: How do I upgrade the cluster later without downtime? > > upgrade.sh ( > https://github.com/kubernetes/kubernetes/blob/master/cluster/gce/upgrade.sh) > then doesn't like that my master is replicated. > > So what's the expected workflow? Do I need to remove the replicas, upgrade > and then create the replicas again? > > Also how do I modify the system resources which are marked "reconcile"? > > Thanks! > > -- > You received this message because you are subscribed to the Google Groups > "Kubernetes user discussion and Q&A" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to kubernetes-users+unsubscr...@googlegroups.com. > To post to this group, send email to kubernetes-users@googlegroups.com. > Visit this group at https://groups.google.com/group/kubernetes-users. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Kubernetes user discussion and Q&A" group. To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-users+unsubscr...@googlegroups.com. To post to this group, send email to kubernetes-users@googlegroups.com. Visit this group at https://groups.google.com/group/kubernetes-users. For more options, visit https://groups.google.com/d/optout.
