Re: [PROPOSAL] Quota management service for cloudstack

[Marco Sinhoreli]

+1

It¹s great to control resources per department in private cloud approach.

Best regards,

Marco Sinhoreli
Consultant Manager

Phone: +55 21 2586 6390 | Fax: +55 21 2586 6002 | Mobile: +55 21 99159
4713 | Mobile: +55 21 98276 3636
Praia de Botafogo 501, bloco 1 - sala 101, Botafogo, Rio de Janeiro, RJ -
Brazil - CEP 22250-040
marco.sinhor...@shapeblue.com | www.shapeblue.com
 | Twitter:@shapeBlue



On 26/06/15 08:32, "Abhinandan Prateek" 
wrote:

>Team,
>
>   Would like to enhance usage server to provide quota management service
>to cloudstack.
>This will provide better control on resource usage; and a common
>denomination to measure resource usage.
>This will be an optional service that can be enabled or disabled as
>required by the operator.
>
>The detailed discussion is in functional specs here [2]. The
>corresponding jira ticket is [1].
>
>Please vote so that a decision to include it or not can be taken.
>
>[1] https://issues.apache.org/jira/browse/CLOUDSTACK-8592
>[2]
>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Quota+Service+-+FS
>
>
>Regards,
>-abhi
>Find out more about ShapeBlue and our range of CloudStack related services
>
>IaaS Cloud Design &
>Build
>CSForge - rapid IaaS deployment framework
>CloudStack Consulting
>CloudStack Software
>Engineering
>CloudStack Infrastructure
>Support
>CloudStack Bootcamp Training
>Courses
>
>This email and any attachments to it may be confidential and are intended
>solely for the use of the individual to whom it is addressed. Any views
>or opinions expressed are solely those of the author and do not
>necessarily represent those of Shape Blue Ltd or related companies. If
>you are not the intended recipient of this email, you must neither take
>any action based upon its contents, nor copy or show it to anyone. Please
>contact the sender if you believe you have received this email in error.
>Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>Services India LLP is a company incorporated in India and is operated
>under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is
>a company incorporated in Brasil and is operated under license from Shape
>Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of
>South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
>is a registered trademark.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [PROPOSAL] Quota management service for cloudstack

[sebgoa]

On Jun 26, 2015, at 1:32 PM, Abhinandan Prateek 
 wrote:

> Team,
> 
>   Would like to enhance usage server to provide quota management service to 
> cloudstack.
> This will provide better control on resource usage; and a common denomination 
> to measure resource usage.
> This will be an optional service that can be enabled or disabled as required 
> by the operator.
> 
> The detailed discussion is in functional specs here [2]. The corresponding 
> jira ticket is [1].
> 
> Please vote so that a decision to include it or not can be taken.
> 
> [1] https://issues.apache.org/jira/browse/CLOUDSTACK-8592
> [2] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Quota+Service+-+FS
> 

Can you add this to the roadmap wiki page…

thanks

> 
> Regards,
> -abhi
> Find out more about ShapeBlue and our range of CloudStack related services
> 
> IaaS Cloud Design & Build
> CSForge - rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software 
> Engineering
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
> 
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: [PROPOSAL] Quota management service for cloudstack

[Rajesh Battala]

+1 
Nice feature to have 

-Original Message-
From: Abhinandan Prateek [mailto:abhinandan.prat...@shapeblue.com] 
Sent: Friday, June 26, 2015 5:03 PM
To: CloudStack Dev
Subject: [PROPOSAL] Quota management service for cloudstack

Team,

   Would like to enhance usage server to provide quota management service to 
cloudstack.
This will provide better control on resource usage; and a common denomination 
to measure resource usage.
This will be an optional service that can be enabled or disabled as required by 
the operator.

The detailed discussion is in functional specs here [2]. The corresponding jira 
ticket is [1].

Please vote so that a decision to include it or not can be taken.

[1] https://issues.apache.org/jira/browse/CLOUDSTACK-8592
[2] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Quota+Service+-+FS


Regards,
-abhi
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge - rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [PROPOSAL] Quota management service for cloudstack

[Erik Weber]

On Fri, Jun 26, 2015 at 1:32 PM, Abhinandan Prateek <
abhinandan.prat...@shapeblue.com> wrote:

> Team,
>
>Would like to enhance usage server to provide quota management service
> to cloudstack.
> This will provide better control on resource usage; and a common
> denomination to measure resource usage.
> This will be an optional service that can be enabled or disabled as
> required by the operator.
>
> The detailed discussion is in functional specs here [2]. The corresponding
> jira ticket is [1].
>
> Please vote so that a decision to include it or not can be taken.
>
> [1] https://issues.apache.org/jira/browse/CLOUDSTACK-8592
> [2]
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Quota+Service+-+FS
>
>

I am a bit slow nowadays (vacation_mode = True), would you mind describing
how this differs from the current account/global limits?

-- 
Erik

Re: [PROPOSAL] Quota management service for cloudstack

[Rohit Yadav]

> On 01-Jul-2015, at 10:58 am, Erik Weber  wrote:
>
> I am a bit slow nowadays (vacation_mode = True), would you mind describing
> how this differs from the current account/global limits?

I think the global limits and quota are quite different,

Account/Global limits are per resource are to limit a user/account to 
run/deploy/use maximum amount of a resource, for example number of VMs a user 
can deploy.

Quota is to block new demands from a user/account once they exhaust their 
quota/credit.

For example, we can give some quota to a user which is giving them 1000 cloud 
coins (credit), each cloud resource such as ip address and VMs have a flat 
quota rate (for example, 10 points per IP); the user deploys bunch of VMs and 
consumes some public IPs etc, and finally the user exhausts the quota and the 
quota system blocks the user to demand any new resource.

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: [PROPOSAL] Quota management service for cloudstack

[Koushik Das]

I like the concept of quota. But I am thinking whether this should be a core 
part of CS or developed as a plugin. Cloud coins example given below may be a 
plugin, based on which decision to allow/disallow operation is made. Another 
plugin could be to allow/disallow operations based on VM count or say the 
current storage used in bytes. There should be flexibility to put in a 
condition of choice by the developer/user. If there are multiple such plugins, 
an option should be provided to decide the ordering of the plugins (similar to 
the various host investigators that are available).

-Koushik

-Original Message-
From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] 
Sent: Wednesday, 1 July 2015 14:48
To: dev@cloudstack.apache.org
Subject: Re: [PROPOSAL] Quota management service for cloudstack


> On 01-Jul-2015, at 10:58 am, Erik Weber  wrote:
>
> I am a bit slow nowadays (vacation_mode = True), would you mind 
> describing how this differs from the current account/global limits?

I think the global limits and quota are quite different,

Account/Global limits are per resource are to limit a user/account to 
run/deploy/use maximum amount of a resource, for example number of VMs a user 
can deploy.

Quota is to block new demands from a user/account once they exhaust their 
quota/credit.

For example, we can give some quota to a user which is giving them 1000 cloud 
coins (credit), each cloud resource such as ip address and VMs have a flat 
quota rate (for example, 10 points per IP); the user deploys bunch of VMs and 
consumes some public IPs etc, and finally the user exhausts the quota and the 
quota system blocks the user to demand any new resource.

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [PROPOSAL] Quota management service for cloudstack

[Rohit Yadav]

> On 01-Jul-2015, at 12:31 pm, Koushik Das  wrote:
>
> I like the concept of quota. But I am thinking whether this should be a core 
> part of CS or developed as a plugin.

It will be a separate plugin, not part of the core CS though we may need to 
refactor the core to allow configurability of features in the plugin.

> Cloud coins example given below may be a plugin, based on which decision to 
> allow/disallow operation is made. Another plugin could be to allow/disallow 
> operations based on VM count or say the current storage used in bytes. There 
> should be flexibility to put in a condition of choice by the developer/user. 
> If there are multiple such plugins, an option should be provided to decide 
> the ordering of the plugins (similar to the various host investigators that 
> are available).

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [PROPOSAL] Quota management service for cloudstack

[Abhinandan Prateek]

> On 01-Jul-2015, at 2:20 pm, sebgoa  wrote:
>
>
> On Jun 26, 2015, at 1:32 PM, Abhinandan Prateek 
>  wrote:
>
>> Team,
>>
>>  Would like to enhance usage server to provide quota management service to 
>> cloudstack.
>> This will provide better control on resource usage; and a common 
>> denomination to measure resource usage.
>> This will be an optional service that can be enabled or disabled as required 
>> by the operator.
>>
>> The detailed discussion is in functional specs here [2]. The corresponding 
>> jira ticket is [1].
>>
>> Please vote so that a decision to include it or not can be taken.
>>
>> [1] https://issues.apache.org/jira/browse/CLOUDSTACK-8592
>> [2] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Quota+Service+-+FS
>>
>
> Can you add this to the roadmap wiki page…
>

Yes, added in the roadmap.

-abhi


Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [PROPOSAL] Quota management service for cloudstack

[Koushik Das]

On 01-Jul-2015, at 4:44 PM, Rohit Yadav  wrote:

> 
>> On 01-Jul-2015, at 12:31 pm, Koushik Das  wrote:
>> 
>> I like the concept of quota. But I am thinking whether this should be a core 
>> part of CS or developed as a plugin.
> 
> It will be a separate plugin, not part of the core CS though we may need to 
> refactor the core to allow configurability of features in the plugin.

Please update the FS with the plugin interface and its interaction with the 
other components once it is finalized.

> 
>> Cloud coins example given below may be a plugin, based on which decision to 
>> allow/disallow operation is made. Another plugin could be to allow/disallow 
>> operations based on VM count or say the current storage used in bytes. There 
>> should be flexibility to put in a condition of choice by the developer/user. 
>> If there are multiple such plugins, an option should be provided to decide 
>> the ordering of the plugins (similar to the various host investigators that 
>> are available).
> 
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 88 262 30892 | rohit.ya...@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab
> 
> 
> 
> Find out more about ShapeBlue and our range of CloudStack related services
> 
> IaaS Cloud Design & Build
> CSForge – rapid IaaS deployment framework
> CloudStack Consulting
> CloudStack Software 
> Engineering
> CloudStack Infrastructure 
> Support
> CloudStack Bootcamp Training 
> Courses
> 
> This email and any attachments to it may be confidential and are intended 
> solely for the use of the individual to whom it is addressed. Any views or 
> opinions expressed are solely those of the author and do not necessarily 
> represent those of Shape Blue Ltd or related companies. If you are not the 
> intended recipient of this email, you must neither take any action based upon 
> its contents, nor copy or show it to anyone. Please contact the sender if you 
> believe you have received this email in error. Shape Blue Ltd is a company 
> incorporated in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue Ltd. 
> Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
> operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
> registered by The Republic of South Africa and is traded under license from 
> Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [PROPOSAL] Quota management service for cloudstack

[Abhinandan Prateek]

> On 02-Jul-2015, at 9:51 am, Koushik Das  wrote:
>
>
> On 01-Jul-2015, at 4:44 PM, Rohit Yadav  wrote:
>
>>
>>> On 01-Jul-2015, at 12:31 pm, Koushik Das  wrote:
>>>
>>> I like the concept of quota. But I am thinking whether this should be a 
>>> core part of CS or developed as a plugin.
>>
>> It will be a separate plugin, not part of the core CS though we may need to 
>> refactor the core to allow configurability of features in the plugin.
>
> Please update the FS with the plugin interface and its interaction with the 
> other components once it is finalized.
>
Updated:

The main quota plugin will be a DB plugin interacting with usage tables mainly 
and usage server. There will be a UI plugin too, to customise, to manage 
quotas, to generate reports and to customise email templates.
A new account state will be introduced to represent that the account has run 
out of the quota. If more granular control is required on resource changing 
APIs then we will need some kind of classification (annotation) to make the 
APIs as resource acquiring, resource releasing or query only. At this point we 
are not planning for such fine grained control but just to mark the account 
state as "no quota credit" if an account runs out of quota and quota service is 
enabled.


>>
>>> Cloud coins example given below may be a plugin, based on which decision to 
>>> allow/disallow operation is made. Another plugin could be to allow/disallow 
>>> operations based on VM count or say the current storage used in bytes. 
>>> There should be flexibility to put in a condition of choice by the 
>>> developer/user. If there are multiple such plugins, an option should be 
>>> provided to decide the ordering of the plugins (similar to the various host 
>>> investigators that are available).
>>
>> Regards,
>> Rohit Yadav
>> Software Architect, ShapeBlue
>> M. +91 88 262 30892 | rohit.ya...@shapeblue.com
>> Blog: bhaisaab.org | Twitter: @_bhaisaab
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build
>> CSForge – rapid IaaS deployment framework
>> CloudStack Consulting
>> CloudStack Software 
>> Engineering
>> CloudStack Infrastructure 
>> Support
>> CloudStack Bootcamp Training 
>> Courses
>>
>> This email and any attachments to it may be confidential and are intended 
>> solely for the use of the individual to whom it is addressed. Any views or 
>> opinions expressed are solely those of the author and do not necessarily 
>> represent those of Shape Blue Ltd or related companies. If you are not the 
>> intended recipient of this email, you must neither take any action based 
>> upon its contents, nor copy or show it to anyone. Please contact the sender 
>> if you believe you have received this email in error. Shape Blue Ltd is a 
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a 
>> company incorporated in India and is operated under license from Shape Blue 
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil 
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a 
>> company registered by The Republic of South Africa and is traded under 
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Afri