Fwd: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-17 Thread Alex Ough
All, Currently, under the environment of cloudstack with multiple regions, each region has its own management server running with a separate database. So if we want to support multiple regions and provide one point of entry for a customer, we need to duplicate domain/account/user information of th

RE: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-18 Thread Kishan Kavala
> -Original Message- > From: Alex Ough [mailto:alex.o...@sungard.com] > Sent: Thursday, 17 October 2013 11:25 PM > To: dev@cloudstack.apache.org; u...@cloudstack.apache.org > Subject: Fwd: [DISCUSS] Domain/Account/User Sync Up Among Multiple > Regions > > All, &

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-29 Thread Alex Ough
, Oct 18, 2013 at 9:30 AM, Kishan Kavala wrote: > > -Original Message- > > From: Alex Ough [mailto:alex.o...@sungard.com] > > Sent: Thursday, 17 October 2013 11:25 PM > > To: dev@cloudstack.apache.org; u...@cloudstack.apache.org > > Subject: Fwd: [DISCUSS

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-30 Thread Alex Ough
@cloudstack.apache.org; u...@cloudstack.apache.org >> > Subject: Fwd: [DISCUSS] Domain/Account/User Sync Up Among Multiple >> > Regions >> > >> > All, >> > >> > Currently, under the environment of cloudstack with multiple regions, >> each >

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Alex Ough
me this permission? >> >> If there is anything missing, let me know. >> Thanks >> Alex Ough >> >> >> On Fri, Oct 18, 2013 at 9:30 AM, Kishan Kavala >> wrote: >> >>> > -Original Message- >>> > From: Alex Ough [mail

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Chip Childers
an Kavala > > wrote: > > > >> > -Original Message- > >> > From: Alex Ough [mailto:alex.o...@sungard.com] > >> > Sent: Thursday, 17 October 2013 11:25 PM > >> > To: dev@cloudstack.apache.org; u...@cloudstack.apache.org > &

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Chip Childers
(dropping users@ - try not to cross post please) On Thu, Oct 31, 2013 at 12:13:18PM -0500, Alex Ough wrote: > All, > > While I'm waiting for the permissions, I'd like to bring up a discussion on > the overall architecture to support this feature. > > There can be 2 different approaches as below.

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Alex Ough
3 at 9:30 AM, Kishan Kavala < > kishan.kav...@citrix.com>wrote: > > > > > >> > -Original Message----- > > >> > From: Alex Ough [mailto:alex.o...@sungard.com] > > >> > Sent: Thursday, 17 October 2013 11:25 PM > > >> &g

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Daan Hoogland
yone give me this permission? >> > > >> > > If there is anything missing, let me know. >> > > Thanks >> > > Alex Ough >> > > >> > > >> > > On Fri, Oct 18, 2013 at 9:30 AM, Kishan Kavala < >> kishan.kav...@ci

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-10-31 Thread Alex Ough
ssion? > >> > > > >> > > If there is anything missing, let me know. > >> > > Thanks > >> > > Alex Ough > >> > > > >> > > > >> > > On Fri, Oct 18, 2013 at 9:30 AM, Kishan Kavala < > >&g

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-04 Thread Alex Ough
anyone give me this permission? >> >> > > >> >> > > If there is anything missing, let me know. >> >> > > Thanks >> >> > > Alex Ough >> >> > > >> >> > > >> >> > > On Fri, Oct 1

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-05 Thread Chip Childers
che.org/jira/browse/CLOUDSTACK-4992 >>> >> > > >>> >> > > But it doesn't allow for me to assign it to myself, so any >>> permission >>> >> do I >>> >> > > need for this? >>> >> > &

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-05 Thread Alex Ough
gt; > > > >>> >> > > https://issues.apache.org/jira/browse/CLOUDSTACK-4992 > >>> >> > > > >>> >> > > But it doesn't allow for me to assign it to myself, so any > >>> permission > >>> >> do

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-06 Thread Alex Ough
; >> > >> >>> >> > >> >>> >> > On Tue, Oct 29, 2013 at 3:38 PM, Alex Ough < >> alex.o...@sungard.com> >> >>> >> wrote: >> >>> >> > >> >>> >> > > I created a jira for this fe

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-07 Thread Daan Hoogland
> >>> >>> >> > My account in the wiki is alex.o...@sungard.com >>> >>> >> > >>> >>> >> > Thanks in advance. >>> >>> >> > Alex Ough >>> >>> >> > >>> >&g

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-07 Thread Alex Ough
Wed, Oct 30, 2013 at 12:19:23PM -0500, Alex Ough wrote: > >>> >>> >> > And I'd like to write the design document in the wiki page, > but I > >>> >>> don't > >>> >>> >> > seem to have a permission t

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-07 Thread Chiradeep Vittal
;>>> >> > > I created a jira for this feature. >>>> >> > > >>>> >> > > https://issues.apache.org/jira/browse/CLOUDSTACK-4992 >>>> >> > > >>>> >> > > But it doesn't allow for me t

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-07 Thread Chip Childers
On Thu, Nov 7, 2013 at 2:37 PM, Chiradeep Vittal wrote: > It may be an admin burden, but it has to be optional. There are other ways > to achieve global sync (e.g., LDAP/AD/Oauth). > A lot of service providers who run cloudstack have their own user database > / portal. In their implementations the

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-08 Thread Chiradeep Vittal
I'd also like to highlight that it isn't a trivial problem. Let's say there's 3 regions: this means there are 3 copies of the user database that are geographically separated by network links that fail quite often (orders of magnitude more than intra-DC networks). Here we run into the consequences

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-08 Thread Chip Childers
We are already (generally) AP for most infra changes really. I'd use that model. Eventual consistency is better in this scenario. > On Nov 8, 2013, at 6:49 PM, Chiradeep Vittal > wrote: > > I'd also like to highlight that it isn't a trivial problem. > Let's say there's 3 regions: this means t

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-09 Thread Daan Hoogland
H Guys, Can you shoot at my claims below, please? syncing being optional does not conflict with the code being in the core server. It seems that making a plugin for this is misuse of the plugin mechanism. To me it is more of an option to switch on or of with a global setting, having some extra co

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-11 Thread Alex Ough
All, I'm new to the cloudstack project, so there can be something I missed for consideration, but the current region support seems to be inadequate (I hope this does not offend anyone...) because even if a customer can have multiple regions, the resources in each region are totally separated like

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-12 Thread Chiradeep Vittal
Missed this one. In a single region, the CloudStack DB is the master for most operations. If the infra is not in the state the DB says it should be, generally the approach is to whack it and make it conform. For some exceptions (live migration/related use cases are exceptions) the DB is the slave -

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-11-12 Thread Alex Ough
Good point, Chiradeep, I'm not sure if you reviewed my design doc in the wiki, but my design is to just skip any actions for target resources that already took place by any means. But the issue is when conflict actions in the same resources (like create & delete the same users) are enqueued in rev

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2013-12-18 Thread Alex Ough
All, I updated the wiki after some logic changes, so please review them, especially "Full Scan", which is newly introduced. https://cwiki.apache.org/confluence/display/CLOUDSTACK/Domain-Account-User+Sync+Up+Among+Multiple+Regions And I implemented this functionality in Java and you can get the pu

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-01-08 Thread Alex Ough
All, A little bit of updates after a long vacation, I'm currently creating automated test scripts that randomly create/delete/update domain/account/user objects in random regions to trigger the sync-up and full scans regularly. Once they are completed, I'll post it in the github also and submit th

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-01-13 Thread Alex Ough
All, I'd like to have some suggestion about 2 things related with this. 1. The 'Full Scan' management Now, I set it running every time a user logs in to the UI, but I think it will be necessary to make it run with some interval also. But I'm not familiar with the config file, so can anyone give s

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-06 Thread Alex Ough
All, I just sent a review request, so please take a look at it and let me know if you have any comments/suggests. https://reviews.apache.org/r/17790/ Thanks Alex Ough On Mon, Jan 13, 2014 at 11:17 AM, Alex Ough wrote: > All, > > I'd like to have some suggestion about 2 things related with th

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-06 Thread Chiradeep Vittal
ilto:chiradeep.vit...@citrix.com>>, Kishan Kavala mailto:kishan.kav...@citrix.com>> Subject: Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions All, I just sent a review request, so please take a look at it and let me know if you have any comments/suggests. https://reviews.apache.org

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-06 Thread Alex Ough
ional. Yet it touches the most sensitive code in CloudStack. > > From: Alex Ough > Date: Thursday, February 6, 2014 6:29 AM > To: "dev@cloudstack.apache.org" > Cc: Chip Childers , Daan Hoogland < > daan.hoogl...@gmail.com>, Chiradeep Vittal , > Kishan Kavala

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-19 Thread David Grizzanti
ot; > Cc: Chip Childers , Daan Hoogland < > daan.hoogl...@gmail.com>, Chiradeep Vittal , > Kishan Kavala > Subject: Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions > > All, > > I just sent a review request, so please take a look a

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-19 Thread Alex Ough
> Date: Thursday, February 6, 2014 6:29 AM > > To: "dev@cloudstack.apache.org" > > Cc: Chip Childers , Daan Hoogland < > > daan.hoogl...@gmail.com>, Chiradeep Vittal , > > > Kishan Kavala > > Subject: Re: [DISCUSS] Domain/Account/User Sync U

Re: [DISCUSS] Domain/Account/User Sync Up Among Multiple Regions

2014-02-19 Thread David Grizzanti
s the most sensitive code in CloudStack. > > From: Alex Ough > Date: Thursday, February 6, 2014 6:29 AM > To: "dev@cloudstack.apache.org" > Cc: Chip Childers , Daan Hoogland < > daan.hoogl...@gmail.com>, Chiradeep Vittal , > Kishan Kavala > Subject: Re: [DISCU