RE: [ Proposal ] Managing CloudStack Load Balancer configuration
This looks great @Wei Zhou do you have a timeline for when you think a PR will appear? As probably a discussion thread for after this is in, do we think that there is mileage in allowing a user to upload their own haproxy config? There would have to be a binary 'cloudstack controlled config file' vs 'user controlled config file' switch somewhere, but then power users could tinker all they liked with the haproxy config, and CloudStack can stick to orchestrating relatively simple configurations ?? Kind regards Paul. paul.an...@shapeblue.com www.shapeblue.com 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK @shapeblue -Original Message- From: Wei ZHOU Sent: 06 May 2020 08:38 To: dev@cloudstack.apache.org Subject: Re: [ Proposal ] Managing CloudStack Load Balancer configuration cool, Thanks Liridon and Gregor. We will take them into consideration. -Wei On Tue, 5 May 2020 at 15:12, Ismaili, Liridon (SWISS TXT) < liridon.isma...@swisstxt.ch> wrote: > Hi Wei, > > That's some great improvements to the HAProxy! We couldn't realize > some projects because of the missing features on the HAProxy therefore > we are happy to hear that there will be some improvements. > As an addition to the proposal of you we would like to see the > possibility to separate timeout settings (client/server/connect/...) > as these timeout can be different. > We would also like to have the timeout settings available under the > LoadbalancerRule > > as a summary: > - Separate options for all timeout parameters > (client/server/connect/...) > - Timeouts also per LoadbalancerRule, not only Network > > We also thought about some "nice to have" additions: > - check customization: HTTP Check, Check Interval, etc. > - LoadbalancerRule: Custom Server string & Custom Listen string (only > Domain Admin) > - Network: Custom Defaults (only Domain Admin) > > Please let me know what you think about these additions. > > Best Regards > Liridon > > -Original Message- > From: "Riepl, Gregor (SWISS TXT)" %22Riepl,%20Gregor%20%28SWISS%20TXT%29%22%20%3cGregor.Riepl@swisstxt.c > h > %3e>> > Reply-To: dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org> > To: dev@cloudstack.apache.org 22...@cloudstack.apache.org%22%20%3c...@cloudstack.apache.org%3e>> > Subject: Re: [ Proposal ] Managing CloudStack Load Balancer > configuration > Date: Mon, 04 May 2020 10:22:39 + > > > Hi Wei, > > > Thank you for this proposal! > > We are also very much interested in this feature. > > > There's a few things we're not quite happy with, though - but we still > need to discuss this internally a bit. > > Liridon or myself will give some feedback soon. > > > Regards, > > Gregor > > > > From: Wei ZHOU < > > <mailto:ustcweiz...@gmail.com> > > ustcweiz...@gmail.com > > > > > Sent: 01 May 2020 08:01 > > To: > > <mailto:dev@cloudstack.apache.org> > > dev@cloudstack.apache.org > > < > > <mailto:dev@cloudstack.apache.org> > > dev@cloudstack.apache.org > > > > > Subject: [ Proposal ] Managing CloudStack Load Balancer configuration > > > Our improvements to cloudstack load balancer (implemented by HAproxy > in the > > VRs) allow cloudstack users to manage certain restricted configuration > > settings. With this feature, users can > > > * Change basic configuration of HAproxy (e.g. set the amount of > allowed > > connections), > > > * choose if load balancer is transparent, > > > * enable or disable the support for SSL offloading in isolated networks. > > > * choose if load balancer supports HTTP/2. > > > * more settings. > > > > > To make this possible to the user, we provide two forms on cloudstack > GUI > > (old GUI, will add changes on Primate) from which the settings can be > > managed and applied in virtual routers. > > > > > FS can be found at > > < > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+cust > omization+in+CloudStack > > > > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+cust > omization+in+CloudStack > > > > > Any suggestions ? > > > > > Kind regards, > > > *Wei Zhou* > > > Principal Cloud Engineer > > > Leaseweb Global B.V. >
Re: [ Proposal ] Managing CloudStack Load Balancer configuration
cool, Thanks Liridon and Gregor. We will take them into consideration. -Wei On Tue, 5 May 2020 at 15:12, Ismaili, Liridon (SWISS TXT) < liridon.isma...@swisstxt.ch> wrote: > Hi Wei, > > That's some great improvements to the HAProxy! We couldn't realize some > projects because of the missing features on the HAProxy therefore we are > happy to hear that there will be some improvements. > As an addition to the proposal of you we would like to see the possibility > to separate timeout settings (client/server/connect/...) as these timeout > can be different. > We would also like to have the timeout settings available under the > LoadbalancerRule > > as a summary: > - Separate options for all timeout parameters (client/server/connect/...) > - Timeouts also per LoadbalancerRule, not only Network > > We also thought about some "nice to have" additions: > - check customization: HTTP Check, Check Interval, etc. > - LoadbalancerRule: Custom Server string & Custom Listen string (only > Domain Admin) > - Network: Custom Defaults (only Domain Admin) > > Please let me know what you think about these additions. > > Best Regards > Liridon > > -Original Message- > From: "Riepl, Gregor (SWISS TXT)" %22Riepl,%20gregor%20%28swiss%20txt%29%22%20%3cgregor.ri...@swisstxt.ch > %3e>> > Reply-To: dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org> > To: dev@cloudstack.apache.org 22...@cloudstack.apache.org%22%20%3c...@cloudstack.apache.org%3e>> > Subject: Re: [ Proposal ] Managing CloudStack Load Balancer configuration > Date: Mon, 04 May 2020 10:22:39 + > > > Hi Wei, > > > Thank you for this proposal! > > We are also very much interested in this feature. > > > There's a few things we're not quite happy with, though - but we still > need to discuss this internally a bit. > > Liridon or myself will give some feedback soon. > > > Regards, > > Gregor > > > > From: Wei ZHOU < > > <mailto:ustcweiz...@gmail.com> > > ustcweiz...@gmail.com > > > > > Sent: 01 May 2020 08:01 > > To: > > <mailto:dev@cloudstack.apache.org> > > dev@cloudstack.apache.org > > < > > <mailto:dev@cloudstack.apache.org> > > dev@cloudstack.apache.org > > > > > Subject: [ Proposal ] Managing CloudStack Load Balancer configuration > > > Our improvements to cloudstack load balancer (implemented by HAproxy in the > > VRs) allow cloudstack users to manage certain restricted configuration > > settings. With this feature, users can > > > * Change basic configuration of HAproxy (e.g. set the amount of allowed > > connections), > > > * choose if load balancer is transparent, > > > * enable or disable the support for SSL offloading in isolated networks. > > > * choose if load balancer supports HTTP/2. > > > * more settings. > > > > > To make this possible to the user, we provide two forms on cloudstack GUI > > (old GUI, will add changes on Primate) from which the settings can be > > managed and applied in virtual routers. > > > > > FS can be found at > > < > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack > > > > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack > > > > > Any suggestions ? > > > > > Kind regards, > > > *Wei Zhou* > > > Principal Cloud Engineer > > > Leaseweb Global B.V. >
Re: [ Proposal ] Managing CloudStack Load Balancer configuration
Hi Wei, That's some great improvements to the HAProxy! We couldn't realize some projects because of the missing features on the HAProxy therefore we are happy to hear that there will be some improvements. As an addition to the proposal of you we would like to see the possibility to separate timeout settings (client/server/connect/...) as these timeout can be different. We would also like to have the timeout settings available under the LoadbalancerRule as a summary: - Separate options for all timeout parameters (client/server/connect/...) - Timeouts also per LoadbalancerRule, not only Network We also thought about some "nice to have" additions: - check customization: HTTP Check, Check Interval, etc. - LoadbalancerRule: Custom Server string & Custom Listen string (only Domain Admin) - Network: Custom Defaults (only Domain Admin) Please let me know what you think about these additions. Best Regards Liridon -Original Message- From: "Riepl, Gregor (SWISS TXT)" mailto:%22Riepl,%20gregor%20%28swiss%20txt%29%22%20%3cgregor.ri...@swisstxt.ch%3e>> Reply-To: dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org> To: dev@cloudstack.apache.org mailto:%22...@cloudstack.apache.org%22%20%3c...@cloudstack.apache.org%3e>> Subject: Re: [ Proposal ] Managing CloudStack Load Balancer configuration Date: Mon, 04 May 2020 10:22:39 + Hi Wei, Thank you for this proposal! We are also very much interested in this feature. There's a few things we're not quite happy with, though - but we still need to discuss this internally a bit. Liridon or myself will give some feedback soon. Regards, Gregor From: Wei ZHOU < <mailto:ustcweiz...@gmail.com> ustcweiz...@gmail.com > Sent: 01 May 2020 08:01 To: <mailto:dev@cloudstack.apache.org> dev@cloudstack.apache.org < <mailto:dev@cloudstack.apache.org> dev@cloudstack.apache.org > Subject: [ Proposal ] Managing CloudStack Load Balancer configuration Our improvements to cloudstack load balancer (implemented by HAproxy in the VRs) allow cloudstack users to manage certain restricted configuration settings. With this feature, users can * Change basic configuration of HAproxy (e.g. set the amount of allowed connections), * choose if load balancer is transparent, * enable or disable the support for SSL offloading in isolated networks. * choose if load balancer supports HTTP/2. * more settings. To make this possible to the user, we provide two forms on cloudstack GUI (old GUI, will add changes on Primate) from which the settings can be managed and applied in virtual routers. FS can be found at <https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack> https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack Any suggestions ? Kind regards, *Wei Zhou* Principal Cloud Engineer Leaseweb Global B.V.
Re: [ Proposal ] Managing CloudStack Load Balancer configuration
Hi Wei, Thank you for this proposal! We are also very much interested in this feature. There's a few things we're not quite happy with, though - but we still need to discuss this internally a bit. Liridon or myself will give some feedback soon. Regards, Gregor From: Wei ZHOU Sent: 01 May 2020 08:01 To: dev@cloudstack.apache.org Subject: [ Proposal ] Managing CloudStack Load Balancer configuration Our improvements to cloudstack load balancer (implemented by HAproxy in the VRs) allow cloudstack users to manage certain restricted configuration settings. With this feature, users can * Change basic configuration of HAproxy (e.g. set the amount of allowed connections), * choose if load balancer is transparent, * enable or disable the support for SSL offloading in isolated networks. * choose if load balancer supports HTTP/2. * more settings. To make this possible to the user, we provide two forms on cloudstack GUI (old GUI, will add changes on Primate) from which the settings can be managed and applied in virtual routers. FS can be found at https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack Any suggestions ? Kind regards, *Wei Zhou* Principal Cloud Engineer Leaseweb Global B.V.
Re: [ Proposal ] Managing CloudStack Load Balancer configuration
looks good Wei, I have minor questions about the implementation but please go ahead. I see you introduce a scope and also fields for network, vpc *and* loadbalancer UUIDs. Is this not redundant? scope and UUID would seem enough as the scope already defines the object type of the UUID, not? You create a 'created' field but not a 'removed' or 'updated'. For audit purposes these might be good to have as well, don't you think? In no way critique of your design, that ^^. Once a gain, looks good. On Fri, May 1, 2020 at 8:02 AM Wei ZHOU wrote: > Our improvements to cloudstack load balancer (implemented by HAproxy in the > VRs) allow cloudstack users to manage certain restricted configuration > settings. With this feature, users can > > * Change basic configuration of HAproxy (e.g. set the amount of allowed > connections), > > * choose if load balancer is transparent, > > * enable or disable the support for SSL offloading in isolated networks. > > * choose if load balancer supports HTTP/2. > > * more settings. > > > > To make this possible to the user, we provide two forms on cloudstack GUI > (old GUI, will add changes on Primate) from which the settings can be > managed and applied in virtual routers. > > > > FS can be found at > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack > > > Any suggestions ? > > > > Kind regards, > > *Wei Zhou* > > Principal Cloud Engineer > > Leaseweb Global B.V. > -- Daan
Re: [ Proposal ] Managing CloudStack Load Balancer configuration
Hi Wei, Check. Pictures now visible. Thanks :) __ Sven Vogel Lead Cloud Solution Architect EWERK DIGITAL GmbH Brühl 24, D-04109 Leipzig P +49 341 42649 - 99 F +49 341 42649 - 98 s.vo...@ewerk.com www.ewerk.com Geschäftsführer: Dr. Erik Wende, Hendrik Schubert, Tassilo Möschke Registergericht: Leipzig HRB 9065 Support: +49 341 42649 555 Zertifiziert nach: ISO/IEC 27001:2013 DIN EN ISO 9001:2015 DIN ISO/IEC 2-1:2011 ISAE 3402 Typ II Assessed EWERK-Blog<https://blog.ewerk.com/> | LinkedIn<https://www.linkedin.com/company/ewerk-group> | Xing<https://www.xing.com/company/ewerk> | Twitter<https://twitter.com/EWERK_Group> | Facebook<https://de-de.facebook.com/EWERK.IT/> Auskünfte und Angebote per Mail sind freibleibend und unverbindlich. Disclaimer Privacy: Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen Dank. The contents of this e-mail (including any attachments) are confidential and may be legally privileged. If you are not the intended recipient of this e-mail, any disclosure, copying, distribution or use of its contents is strictly prohibited, and you should please notify the sender immediately and then delete it (including any attachments) from your system. Thank you. Von: Wei ZHOU Gesendet: Freitag, Mai 1, 2020 1:46 PM An: dev@cloudstack.apache.org Betreff: Re: [ Proposal ] Managing CloudStack Load Balancer configuration Hi Andrija and Sven, Thanks for your feedback. I have updated the images. Are you able to see them now ? We are currently developing with old GUI. We will make changes in Primate. -Wei On Fri, 1 May 2020 at 10:57, Andrija Panic wrote: > +1 by all means. > > I've briefly gone through the FS, and this is most welcome, to make the LB > **actually** usable vs. what's currently there. > > Images are missing in FS, and kindly keep in mind, that all the changes we > do in GUI should be done in Primate and not the old GUI (i.e. based on what > we discussed back on the ML) - although it doesn't hurt if the old GUI also > has them. > > THx Wei > > On Fri, 1 May 2020 at 08:02, Wei ZHOU wrote: > > > Our improvements to cloudstack load balancer (implemented by HAproxy in > the > > VRs) allow cloudstack users to manage certain restricted configuration > > settings. With this feature, users can > > > > * Change basic configuration of HAproxy (e.g. set the amount of allowed > > connections), > > > > * choose if load balancer is transparent, > > > > * enable or disable the support for SSL offloading in isolated networks. > > > > * choose if load balancer supports HTTP/2. > > > > * more settings. > > > > > > > > To make this possible to the user, we provide two forms on cloudstack GUI > > (old GUI, will add changes on Primate) from which the settings can be > > managed and applied in virtual routers. > > > > > > > > FS can be found at > > > > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack > > > > > > Any suggestions ? > > > > > > > > Kind regards, > > > > *Wei Zhou* > > > > Principal Cloud Engineer > > > > Leaseweb Global B.V. > > > > > -- > > Andrija Panić >
Re: [ Proposal ] Managing CloudStack Load Balancer configuration
Hi Andrija and Sven, Thanks for your feedback. I have updated the images. Are you able to see them now ? We are currently developing with old GUI. We will make changes in Primate. -Wei On Fri, 1 May 2020 at 10:57, Andrija Panic wrote: > +1 by all means. > > I've briefly gone through the FS, and this is most welcome, to make the LB > **actually** usable vs. what's currently there. > > Images are missing in FS, and kindly keep in mind, that all the changes we > do in GUI should be done in Primate and not the old GUI (i.e. based on what > we discussed back on the ML) - although it doesn't hurt if the old GUI also > has them. > > THx Wei > > On Fri, 1 May 2020 at 08:02, Wei ZHOU wrote: > > > Our improvements to cloudstack load balancer (implemented by HAproxy in > the > > VRs) allow cloudstack users to manage certain restricted configuration > > settings. With this feature, users can > > > > * Change basic configuration of HAproxy (e.g. set the amount of allowed > > connections), > > > > * choose if load balancer is transparent, > > > > * enable or disable the support for SSL offloading in isolated networks. > > > > * choose if load balancer supports HTTP/2. > > > > * more settings. > > > > > > > > To make this possible to the user, we provide two forms on cloudstack GUI > > (old GUI, will add changes on Primate) from which the settings can be > > managed and applied in virtual routers. > > > > > > > > FS can be found at > > > > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack > > > > > > Any suggestions ? > > > > > > > > Kind regards, > > > > *Wei Zhou* > > > > Principal Cloud Engineer > > > > Leaseweb Global B.V. > > > > > -- > > Andrija Panić >
Re: [ Proposal ] Managing CloudStack Load Balancer configuration
Hi Wei, that are good improvements to the actually setup. I like this and thanks. Yes images are missing ... I saw this sometimes in different design documents. Specially ssl offloading Sound interesting. Go ahead. :) Cheers Sven __ Sven Vogel Lead Cloud Solution Architect EWERK DIGITAL GmbH Brühl 24, D-04109 Leipzig P +49 341 42649 - 99 F +49 341 42649 - 98 s.vo...@ewerk.com www.ewerk.com Geschäftsführer: Dr. Erik Wende, Hendrik Schubert, Tassilo Möschke Registergericht: Leipzig HRB 9065 Support: +49 341 42649 555 Zertifiziert nach: ISO/IEC 27001:2013 DIN EN ISO 9001:2015 DIN ISO/IEC 2-1:2011 ISAE 3402 Typ II Assessed EWERK-Blog<https://blog.ewerk.com/> | LinkedIn<https://www.linkedin.com/company/ewerk-group> | Xing<https://www.xing.com/company/ewerk> | Twitter<https://twitter.com/EWERK_Group> | Facebook<https://de-de.facebook.com/EWERK.IT/> Auskünfte und Angebote per Mail sind freibleibend und unverbindlich. Disclaimer Privacy: Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen Dank. The contents of this e-mail (including any attachments) are confidential and may be legally privileged. If you are not the intended recipient of this e-mail, any disclosure, copying, distribution or use of its contents is strictly prohibited, and you should please notify the sender immediately and then delete it (including any attachments) from your system. Thank you. Von: Andrija Panic Gesendet: Freitag, Mai 1, 2020 10:57 AM An: dev Betreff: Re: [ Proposal ] Managing CloudStack Load Balancer configuration +1 by all means. I've briefly gone through the FS, and this is most welcome, to make the LB **actually** usable vs. what's currently there. Images are missing in FS, and kindly keep in mind, that all the changes we do in GUI should be done in Primate and not the old GUI (i.e. based on what we discussed back on the ML) - although it doesn't hurt if the old GUI also has them. THx Wei On Fri, 1 May 2020 at 08:02, Wei ZHOU wrote: > Our improvements to cloudstack load balancer (implemented by HAproxy in the > VRs) allow cloudstack users to manage certain restricted configuration > settings. With this feature, users can > > * Change basic configuration of HAproxy (e.g. set the amount of allowed > connections), > > * choose if load balancer is transparent, > > * enable or disable the support for SSL offloading in isolated networks. > > * choose if load balancer supports HTTP/2. > > * more settings. > > > > To make this possible to the user, we provide two forms on cloudstack GUI > (old GUI, will add changes on Primate) from which the settings can be > managed and applied in virtual routers. > > > > FS can be found at > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack > > > Any suggestions ? > > > > Kind regards, > > *Wei Zhou* > > Principal Cloud Engineer > > Leaseweb Global B.V. > -- Andrija Panić
Re: [ Proposal ] Managing CloudStack Load Balancer configuration
+1 by all means. I've briefly gone through the FS, and this is most welcome, to make the LB **actually** usable vs. what's currently there. Images are missing in FS, and kindly keep in mind, that all the changes we do in GUI should be done in Primate and not the old GUI (i.e. based on what we discussed back on the ML) - although it doesn't hurt if the old GUI also has them. THx Wei On Fri, 1 May 2020 at 08:02, Wei ZHOU wrote: > Our improvements to cloudstack load balancer (implemented by HAproxy in the > VRs) allow cloudstack users to manage certain restricted configuration > settings. With this feature, users can > > * Change basic configuration of HAproxy (e.g. set the amount of allowed > connections), > > * choose if load balancer is transparent, > > * enable or disable the support for SSL offloading in isolated networks. > > * choose if load balancer supports HTTP/2. > > * more settings. > > > > To make this possible to the user, we provide two forms on cloudstack GUI > (old GUI, will add changes on Primate) from which the settings can be > managed and applied in virtual routers. > > > > FS can be found at > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack > > > Any suggestions ? > > > > Kind regards, > > *Wei Zhou* > > Principal Cloud Engineer > > Leaseweb Global B.V. > -- Andrija Panić
[ Proposal ] Managing CloudStack Load Balancer configuration
Our improvements to cloudstack load balancer (implemented by HAproxy in the VRs) allow cloudstack users to manage certain restricted configuration settings. With this feature, users can * Change basic configuration of HAproxy (e.g. set the amount of allowed connections), * choose if load balancer is transparent, * enable or disable the support for SSL offloading in isolated networks. * choose if load balancer supports HTTP/2. * more settings. To make this possible to the user, we provide two forms on cloudstack GUI (old GUI, will add changes on Primate) from which the settings can be managed and applied in virtual routers. FS can be found at https://cwiki.apache.org/confluence/display/CLOUDSTACK/VR+haproxy+customization+in+CloudStack Any suggestions ? Kind regards, *Wei Zhou* Principal Cloud Engineer Leaseweb Global B.V.
