On 04/17/2014 05:15 AM, Sumit Bose wrote:
On Wed, Apr 16, 2014 at 09:02:00PM -0400, Dmitri Pal wrote:
On 04/15/2014 05:13 AM, Sumit Bose wrote:
Hi,

I have started to write a design page for 'Migrating existing
environments to Trust'
http://www.freeipa.org/page/V3/Migrating_existing_environments_to_Trust
It shall cover https://fedorahosted.org/freeipa/ticket/3318 and
https://fedorahosted.org/freeipa/ticket/3979 .

I came across several questions which need answers so that more details
can be added to the design. Besides that comments and suggestions are
welcome as well.

For your convenience I added the test below as well.

bye,
Sumit

= Overview =

This page illustrates how existing solutions which make AD users
available to Linux hosts can be migrated to FreeIPA with Trusts. This
includes migrations from the FreeIPA WinSync feature or environments
where the AD users where correlated to NIS users.

The common problem here is that some if not all attributes needed by a
POSIX user or group must be overwritten or supplied by the IPA server.
The link to the related AD object is preferably the SID but if it is not
available on both sides the name of the object must be used. AD will
keep the responsibility for authentication and provide the AD
group-memberships of the object.

= Use Cases =
* Migration from the FreeIPA Sync solution to the FreeIPA Trust solution
** [https://fedorahosted.org/freeipa/ticket/3318 
https://fedorahosted.org/freeipa/ticket/3318]
* Migration/Consolidation of domains currently managed by other solutions, e.g. 
NIS
** [https://fedorahosted.org/freeipa/ticket/3979 
https://fedorahosted.org/freeipa/ticket/3979] (contains some ideas about a 
solution)
As I mentioned in the ticket not only that. Based on conversations
with different potential consumers of the trust functionality the
ability to use existing POSIX attributes and manage them in IPA
while user accounts come from AD is a crucial next step.
Thank you for your feedback, it was very helpful but I'm afraid it might
also caused some new questions.

= Design =
In Ticket [https://fedorahosted.org/freeipa/ticket/3979 
https://fedorahosted.org/freeipa/ticket/3979] two aspects of a design are 
already explained.
# Instead of just offering a single override option the introduction of
   views are suggested. A suitable client can ask for a specific view
   with override options different from the default override
   view.
Yes.

Questions:
#* Will the default view always be applied? I think it makes sense to
    always apply it to get a consistent default behavior. If there is a
    reason for a client to get the unmodified data a special view called
    e.g. NO_OVERRIDE can be used. This is e.g. needed for the extdom plugin
    to be able to send the raw data to the IPA client so that SSSD can use
    different views on the client which might be needed for docker/container
    use cases.
Sounds reasonable to have the default view and apply it always. If
the view does not contain posix attributes for the specific user we
should use dynamic mapping based on SIDs.
Quite some time ago we have decided to not mix algorithmic mapping and
manually managed POSIX IDs. E.g. think about the case where a view with
POSIX ID was added for an existing user which already has an algorithmic
ID assigned on some clients.

I think this is unfortunate but I can live with this though it is not best.
If there is a workaround to have two trusts or two ranges associated with the forest with different mapping properties I am fine but we need to have that be clearly explain on a page because people were asking about this and I unfortunately gave them the wrong answer becuase I was not aware of "the decision". IMO the decision seems contour intuitive to me. Here is the use cases that people explained to me: "I had to put and manage my posix attributes in AD using third party solution. But as soon as I migrate to IPA I want the AD side of the company to stop managing posix attributes." I was under wrong assumption that though we do not have views now they can do what we ask by allowing the algorithmic mapping to kick in for new users. Frankly I do not see a reason why we can't assign posix attributes using algorithmic method if the posix attributes are not explicitly set. I can argue that this can be an optional fall back but it should be possible.
I expect that there will be bugs filed about it as people try. We will see.


I think the admin has to decide what he wants.

He wants to use what he already has from AD but then use other mappings on top. Since we do not provide views yet the only expected option is to fall back to algorithmic mapping.

Below you mentioned a
migration use case where old users should keep their IDs but new users
will get algorithmically generated ones. I think this is bad practice
and technically is it next to impossible without additional admin
effort to decide if a given AD user is an old or a new user.

May be but IMO it is a deployment choice.
I do not see a reason why we would not assign posix attributes always.
Even if they are not needed or used.
This way we can always get them if user suddenly logs into an operating system rather than logging just over the web to the applications. In the current implementation the user would not be able to do it because before he can do it he has to contact admin and ask him to do something because he can't log into this VM that was setup for him.
I am not sure it is a ban practice. It is up to admin to decide.

By new users I mean users created after the migration point. It might be just a switch in a policy indicating that migration is complete and that would indicate that any users coming from AD without posix should be treated as new because for those ones that admins wanted the already set posix attributes in AD explicitly.

  The admin
either has to add special flags/attributes to the old AD user objects or
we have to keep an immutable list of old users in IPA. Please note that
this has to be done for groups as well. Imo it would be
easier and safer for the admin to either do a full migration to
algorithmically mapped IDs or manage all POSIX IDs manually on the IPA
side.

I think it is not possible in real life.
They can migrate people they care about and set posix for those but not for everyone else but now with trust you will have a fall back algorythmic option if any of the AD users has to access Linuxz operating system.


Additionally I think that in your use case there might be even the need
to manually manage POSIX IDs even for new user. E.g. in the case where a
larger amount of new users is added to AD which where managed by a
completely independent system before.

In this case they will add new users to AD and either set posix there or will use views. If they do not care about posix for merged users they will just not set anything letting the default algorithmic resolution to do the trick. If they do not like it then can not turn it on and be required to set UIDs manually.
#* Will views only be applied to users from other domains or to IPA
    users as well?
Design goal will be to allow them to be applied to all users.
Why, what is the use case to override attribute of IPA users which
cannot be solved by adding other attributes with the needed values to
the IPA user object directly?

It seems that I was not clear with the use case.
There are two use cases really:

a) I have scattered NIS and LDAP domain, I would eventually clean them up but right now I want to migrate to IdM and not use 3rd party solution. Can IPA support zones like the 3rd party solution does?
Right now no.
As you see there is no mention of AD here.
b) I want to do a) but I also want to use AD as authoritative source so I want to consolidate everything in IPA but use trusts. The simplified variant of the use case b) is: I have a single NIS or LDAP that I want to migrate to IPA from. In the past I was using ugly sync solutions from AD to NIS/LDAP that I want to replace with a trust. This means that I want to manage POSIX in IPA at least for the users that are migrated and I want to preserve what I had. For other users that are not migrated I will need a choice of managing posix in IPA myself or falling back to algorithmic if I do not want to set up POSIX myself any more. IPA creates new posix attributes for new IPA users it should act similarly for ad users without posix (if I told it to do so).

So if we generalize we see that view is really a way to assign different sets of posix attributes and primarily UID/GID to the same account and expose those to separate clients. May be it is all about compat views or CoS. This is implementation detail and for you to design.


Implementation goal will be to apply them to external users first.
Or I should say we need to figure out the procedure:
1) Pre migration: AD with no POSIX, LDAP/NIS with POSIX for some/same users.
2) Past migration: AD with no POSIX, no duplicate accounts in IdM,
POSIX attributes for AD users are migrated into a view.

How we do it is the question but we need to have a path. May be it
would require some kind of tool:
ipa create-view --check

This will go through all users in IPA and check them against
available trusted domains and would report which users will be
removed becuase they are found in a specific domain.
I think it should only report conflicts. The admin should decide how to
solve the conflict.

ipa create-view --create --except=<group list>

This will actually do the work but if there are special users that
need to be processed in some special way admin might temporarily put
them into a specific group and then exclude this group or groups
from cleanup.

Just a thought...

#* Do we want stackable views?
We want client oriented views. I.e. views should be attached to host groups.
For the legacy clients there should be a way to expose a view as a
separate base=DN so that one set of legacy clients can be pointed to
one DN and another to another.
I'm not sure if this will stretch the compat tree too much, I let
Alexander and Nalin decided.

Keep in mind that we can potentially have different trees and point different clients to different trees like we do with automount locations.

for example
ipa-client-install ... --zone=zone3
will point to the cn=zone3, cn=zones, cn=accounts,...
instead of the main tree.


If the host based views and DN based views do not have data for a
specific user the data should be fetched from a global default view.
I think we can use CoS for that in conjunction with the compat
plugin but I would leave this to experts to decide.

Bottom line: one global fallback view and then specific views for
host groups and for legacy clients.
I know I might be asking a lot ;-)
How shall this 'global default view' work? E.g. if there is an AD user
without a POSIX ID in AD and algorithmic mapping is not enabled for this
user.

How dows it work now? Based on what you said I assume user would fail to login because posix attributes are not set and I actually want him t succeeded by default. If I misunderstood you please explain.

  If there is no override object for this user in the current view
or if the override object does not contains a POSIX ID attribute where
should the ID come from?

be algorithmic of allowed or admin has to set it manually if he does not want to fall back to algorithmic.


Please note that it is a valid use-case that a user does not has a POSIX
ID e.g. web applications. I think it is not necessary to forcefully try
to assign some POSIX ID to a user.

Why not? What is the harm?

If the admin decides that the user
does not need one, why shall we try to create one?

Why would he not want to? What is the harm? Why he explicitly would care for us to not set the UID?



#* Do we want to override everything or shall there be immutable
    attributes like e.g. the SID or the user name?
I do not know why would overwrite the SID but I think that
overwriting the user name would give us an interesting aliasing
capability as a feature as a side effect.
But is there a use case for such a feature which is not solved better by
creating a new user with the given name? Please note the side effects,
e.g. with respect to the home-directory path. Typically the user name is
part of the of path. What if the original object has a home-directory
path shall we override it implicitly as well or keep it and who shall
decided? Or what about Kerberos principals, who shall user 'abc' know
that his name was overridden and his Kerberos principal is
'xyz@AD.REALM'?

I am not sure there is a use case so frankly I would start with just overwriting UIDs and GIDs in the views and see if we really need to extend it to any other posix attribute and why. But ability to potential overwrite user name sounds interesting though not sure how useful it is and how applicable. We will see.


#* Shall we allow different UIDs/GIDs in different views?
Yes.
I hope the admin knows what he does in this case. I think it's similar
like with the user name, is there really a user-case for this with
cannot be solved better by creating a new user with the given UID? Think
about what happens if a host is moved to a new host group e.g. to change
the HBAC rules but by chance has now a different view with different
UIDs?

>From the OS point of view a user with a different UID is a different
user, from the peoples point of view a user with a different name is a
different user. I think what we achieve with allowing different values
for user names and/or UIDs is to allow different users share the same
password, Kerberos credentials etc and I'm not sure we really want this.

This is need for historical reasons. I would not repeat Simo's answer it is pretty all inclusive.

#* I think overriding UIDs/GIDs should only be allowed for
    ipa-ad-trust-posix idranges, mixing override with algorithmic mapping
    does not make sense imo.
I think it does at least for the migration time. But it might not be
achievable.
The idea is that you really should be required to manage UID/GID for
the users manually via views if it is an old user.
If it is a new user that never was on the Linux side before the
algorithmic mapping might be preferred.
see above

But I also think that this should be controlled by a policy and
admin would have to decide whether the IPA should generate UIDs or
he would prefer to set the manually explicitly.
yes, this can already be controlled by the idrange type. But you have to
choose either algorithmic or manual mapping you cannot have both in a
given domain. What you can do is to create a domain in the AD forest for
the old users and one for the new users. Now you can use manual mapping
for the old-users-domain and algorithmic mapping for the
new-users-domain.

If this requires moving users between domains on AD side then this is a non starter.
The more I read it the more I think that decision is wrong and it is bug.



# The views will be stored in containers below
   cn=views,cn=accounts,$SUFFIX with containers for users and groups. The
   objectclasses will look similar to posixAccount and posixGroup
   objectclasses but with only optional (MAY) attributes. Questions:
#* Do we want to consider to allow to add arbitrary attributes to a view
    to cover requests like "We have this beautiful application which can get
    all user data via the SSSD D-BUS responder but our AD admin will not
    extend the AD LDAP schema to add the required attributes. Can IPA add
    them for users from trusted domains?"
Yes but probably not as phase 1. So it is a separate enhancement.

#* It was suggested to use a UUID to reference the original objects. For
    AD users and groups the SID would be a good choice because it is unique
    and already contains a reference to the original domain. I wonder if we
    should add  a type prefix like 'SID:' to be able to add other types like
    'IPAUUID:domref:ef2b7400-a3c4-11e3-82e7-525400de2951' where domref will
    be a reference to the other IPA domain. On the other hand a type can be
    added later and if the type is missing a SID is assumed.

On the SSSD side the views can be stored below the corresponding user or
group object in the cache and the SYSDB API has to be enhanced to return
merged results. The merging only happens in the responders (NSS, D-BUS)
before sending data to the clients.
Why SSSD should know about different views?
It should know raw and not raw but it always sees one merged view
from the server.
What am I missing?
You miss the docker/container use case where a central SSSD instance is
used by instances with different host names which might belong to
different host groups and hence require different views. So SSSD does
not only need to know all views but the host groups (we already have
them for HBAC) and their corresponding views as well.

True but i think that there SSSD would have to be configured in two different ways. For a simple case it can just be pointed to the zone view. In the case of the docker it might have to be pointed to the main tree and then read all the overlays and create the views on the fly for the clients on the system. But I would not go there yet. May be we would have SSSD in a service container and it would be easy to deploy another SSSD pointing to another view instead of re-implementing all the complexity of merging data to create views in SSSD again.


Although this use case is work-in-progress I think we should include it
from the start because the extra work to read all views quite small and
might be a larger effort when added later.

We need to keep it minds but IMO multiple SSSDs in different containers seems a better solution to me for this use case and much easier achievable.


bye,
Sumit

To manage the views a new set CLI tools/Web UI pages should be added.
Depending if we would like to allow to override IPA users as well or
only users from trusted domains the tools might get their own name
space, ipa override-*, or can be added below the trust name space, ipa
trust-override-*.  It has to be noted that changes of a view will only
be visible on the client after the related cached object is expired.
OK.

= Implementation =
See comments above. I hope they give enough hints for
implementation. At least for the first pass.

=Feature Management =
== UI ==
== CLI ==

= Major configuration options and enablement =
Any configuration options? Any commands to enable/disable the feature or
turn on/off its parts?

= Replication =
Any impact on replication?

= Updates and Upgrades =
Any impact on updates and upgrades?

= Dependencies =
Any new package and library dependencies.

= External Impact =
Impact on other development teams and components

= Backup and Restore =
Any files or configuration that needs to be taken care of in backup or
restore procedure.

= Test Plan =
Test scenarios that will be transformed to test cases for FreeIPA
Continuous Integration during implementation or review phase.

= RFE Author =
[[User:Sbose|Sumit Bose]]

_______________________________________________
Freeipa-devel mailing list
Freeipa-devel@redhat.com
https://www.redhat.com/mailman/listinfo/freeipa-devel

--
Thank you,
Dmitri Pal

Sr. Engineering Manager IdM portfolio
Red Hat, Inc.

_______________________________________________
Freeipa-devel mailing list
Freeipa-devel@redhat.com
https://www.redhat.com/mailman/listinfo/freeipa-devel
_______________________________________________
Freeipa-devel mailing list
Freeipa-devel@redhat.com
https://www.redhat.com/mailman/listinfo/freeipa-devel


--
Thank you,
Dmitri Pal

Sr. Engineering Manager IdM portfolio
Red Hat, Inc.

_______________________________________________
Freeipa-devel mailing list
Freeipa-devel@redhat.com
https://www.redhat.com/mailman/listinfo/freeipa-devel

Reply via email to