Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-30 Thread Petr Vobornik

On 11/26/2015 02:39 PM, Petr Vobornik wrote:

On 11/23/2015 06:51 PM, Oleg Fayans wrote:

Hi all,

Here is a draft of the Replica Promotion test plan
http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan




== Test case: Unprivileged users are not allowed to enroll and promote
clients ==
User credentials are passed there through -p $principal and -w $password
options. It is correct atm because it is required for connection check.
But end goal of replica promotion is the avoid it. See
https://fedorahosted.org/freeipa/ticket/5497 and
https://fedorahosted.org/freeipa/ticket/5498 for more information.

== Missing test cases ==
1. ipa-replica-install works on CA-less master with with both domain levels
2. ipa-server-install works with --setup-dns option with both domain levels
3. ipa-server-install works with externally signed CA cert with both
domain levels
4. ipa-replica-install with options(and their combination): --setup-ca
--setup-dns --setup-kra works with both domain levels

Note: Not sure if #2 and #3 belongs here, but should be tested. Maybe
tests for domain level 0 already exist.


One more thing: test plans covers only the domain topology 
suffix(currently 'realm', will be renamed'[1]) and its segments. 
Segments for 'ca' topology suffix needs to be tested as well, or in 
other words that CA replication agreements are also managed. Maybe it 
fits more into: 
http://www.freeipa.org/page/V4/Manage_replication_topology/Test_plan


[1] 
https://www.redhat.com/archives/freeipa-devel/2015-November/msg00485.html

--
Petr Vobornik

--
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-27 Thread Oleg Fayans

Hi Martin,

On 11/27/2015 03:05 PM, Martin Basti wrote:



On 26.11.2015 14:39, Petr Vobornik wrote:

On 11/23/2015 06:51 PM, Oleg Fayans wrote:

Hi all,

Here is a draft of the Replica Promotion test plan
http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan




== Test case: Unprivileged users are not allowed to enroll and promote
clients ==
User credentials are passed there through -p $principal and -w
$password options. It is correct atm because it is required for
connection check. But end goal of replica promotion is the avoid it.
See https://fedorahosted.org/freeipa/ticket/5497 and
https://fedorahosted.org/freeipa/ticket/5498 for more information.

== Missing test cases ==
1. ipa-replica-install works on CA-less master with with both domain
levels
2. ipa-server-install works with --setup-dns option with both domain
levels
3. ipa-server-install works with externally signed CA cert with both
domain levels
4. ipa-replica-install with options(and their combination): --setup-ca
--setup-dns --setup-kra works with both domain levels

Note: Not sure if #2 and #3 belongs here, but should be tested. Maybe
tests for domain level 0 already exist.


Many of them are already part of some tests.

I wanted to crate install tests in one place with all combination of
options, but I did not have time for it yet.
I have a proof of concept test plan I can share it if you want.


It would be really helpful. Thanks for all your suggestions!



Martin


--
Oleg Fayans
Quality Engineer
FreeIPA team
RedHat.

--
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-27 Thread Martin Basti



On 26.11.2015 14:39, Petr Vobornik wrote:

On 11/23/2015 06:51 PM, Oleg Fayans wrote:

Hi all,

Here is a draft of the Replica Promotion test plan
http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan




== Test case: Unprivileged users are not allowed to enroll and promote 
clients ==
User credentials are passed there through -p $principal and -w 
$password options. It is correct atm because it is required for 
connection check. But end goal of replica promotion is the avoid it. 
See https://fedorahosted.org/freeipa/ticket/5497 and 
https://fedorahosted.org/freeipa/ticket/5498 for more information.


== Missing test cases ==
1. ipa-replica-install works on CA-less master with with both domain 
levels
2. ipa-server-install works with --setup-dns option with both domain 
levels
3. ipa-server-install works with externally signed CA cert with both 
domain levels
4. ipa-replica-install with options(and their combination): --setup-ca 
--setup-dns --setup-kra works with both domain levels


Note: Not sure if #2 and #3 belongs here, but should be tested. Maybe 
tests for domain level 0 already exist.


Many of them are already part of some tests.

I wanted to crate install tests in one place with all combination of 
options, but I did not have time for it yet.

I have a proof of concept test plan I can share it if you want.

Martin

--
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-26 Thread Petr Vobornik

On 11/23/2015 06:51 PM, Oleg Fayans wrote:

Hi all,

Here is a draft of the Replica Promotion test plan
http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan




== Test case: Unprivileged users are not allowed to enroll and promote 
clients ==
User credentials are passed there through -p $principal and -w $password 
options. It is correct atm because it is required for connection check. 
But end goal of replica promotion is the avoid it. See 
https://fedorahosted.org/freeipa/ticket/5497 and 
https://fedorahosted.org/freeipa/ticket/5498 for more information.


== Missing test cases ==
1. ipa-replica-install works on CA-less master with with both domain levels
2. ipa-server-install works with --setup-dns option with both domain levels
3. ipa-server-install works with externally signed CA cert with both 
domain levels
4. ipa-replica-install with options(and their combination): --setup-ca 
--setup-dns --setup-kra works with both domain levels


Note: Not sure if #2 and #3 belongs here, but should be tested. Maybe 
tests for domain level 0 already exist.

--
Petr Vobornik

--
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-25 Thread Martin Basti



On 23.11.2015 18:51, Oleg Fayans wrote:

Hi all,

Here is a draft of the Replica Promotion test plan
http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan



Hello,

Test case: ipa-replica-manage is deprecated in domain level 1
I would be more specific in this test case, deprecated is only connect 
and disconnect subcommand


You have tests for replica manage, but as I wrote in different thread[1] 
on freeipa-devel, also ipa-csreplica-manage works different with domain 
level 1.


4)
ipa-csreplica-manage behaves differently with domain level 1
4a)
ipa-csreplica-manage connect should not work with domain level 1
4b)
ipa-csreplica-manage disconnect should not work with domain level 1
4c)
ipa-csreplica-manage del should not work with domain level 1

IMO we should have also tests for ipa-replica-manage and 
ipa-csreplica-manage with domain level 0, AFAIK we do not have any of 
them, and domain level 0 will be supported for very long time.


Test case: Replica created using old workflow is functional after domain 
upgrade
It is nice, but I would like to extend it to install another replica to 
existing topology after the domain level is raised.


Also we had IRC chat about ipa-ca-install. We found out that we do not 
have tests for standalone call of ipa-ca-install on replica.

So I miss these testcases, as I wrote before in original thread[1]:
1)
CA has been affected by replica promotion patches
1a)
test if ipa-ca-install works on replica with domain level 1
1b)
test if ipa-ca-install works on replica with domain level 0

Martin

[1] 
https://www.redhat.com/archives/freeipa-devel/2015-November/msg00106.html


--
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-24 Thread Jenny Severance


- Original Message -
> Hi Jenny,
> 
> We have numerous tests checking the functionality of replicas. The tests
> are adapted to the new replica installation workflow (promotion), which
> means that there is presumably no need to create any additional tests.
> Our goal is to test the bits that were directly affected by the feature,
> i.e., upgrades between domain levels, ipa-replica-manage, etc.

Thanks for the clarification Oleg.  So I presume that functional testing on the 
system after promotion will be handled by downstream QE and that's okay as long 
as we know what is tested and what we should cover.
~Jenny


> 
> On 11/24/2015 03:27 PM, Jenny Severance wrote:
> > Hi,
> > Is anyone providing feedback?  At first glance (quick read through), it
> > looks like it is just to see if commands work.  Is there any functional
> > followup testing after promotion to check if the replica is actually
> > working.  Object replication and authentication requests?  Certificate
> > functions, DNS etc ...
> >
> >
> > - Original Message -
> >> Hi all,
> >>
> >> Here is a draft of the Replica Promotion test plan
> >> http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan
> >>
> >>
> >> --
> >> Oleg Fayans
> >> Quality Engineer
> >> FreeIPA team
> >> RedHat.
> >>
> >>
> >
> 
> --
> Oleg Fayans
> Quality Engineer
> FreeIPA team
> RedHat.
> 
> 

-- 
Jenny Severance 
Manager, Quality Assurance

-- 
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-24 Thread Oleg Fayans

Hi Jenny,

We have numerous tests checking the functionality of replicas. The tests 
are adapted to the new replica installation workflow (promotion), which 
means that there is presumably no need to create any additional tests. 
Our goal is to test the bits that were directly affected by the feature, 
i.e., upgrades between domain levels, ipa-replica-manage, etc.


On 11/24/2015 03:27 PM, Jenny Severance wrote:

Hi,
Is anyone providing feedback?  At first glance (quick read through), it looks 
like it is just to see if commands work.  Is there any functional followup 
testing after promotion to check if the replica is actually working.  Object 
replication and authentication requests?  Certificate functions, DNS etc ...


- Original Message -

Hi all,

Here is a draft of the Replica Promotion test plan
http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan


--
Oleg Fayans
Quality Engineer
FreeIPA team
RedHat.






--
Oleg Fayans
Quality Engineer
FreeIPA team
RedHat.

--
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-24 Thread Namita Krishnan

> Hi,
> Is anyone providing feedback?  

Yes, it is on DQE's plate (and on freeipa devel) This was an outcome of the 
retrospective we had that DQE will be involved as UQE writes test plan, and the 
subject header is as proposed to catch the attn :) But currently, are busy with 
Update1 activities. So Oleg, hoping to get back to you next week.

> At first glance (quick read through), it looks
> like it is just to see if commands work.  Is there any functional followup
> testing after promotion to check if the replica is actually working.  Object
> replication and authentication requests?  Certificate functions, DNS etc ...

Thanks, Jenny for the initial feedback :)

> 
> 
> - Original Message -
> > Hi all,
> > 
> > Here is a draft of the Replica Promotion test plan
> > http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan
> > 
> > 
> > --
> > Oleg Fayans
> > Quality Engineer
> > FreeIPA team
> > RedHat.
> > 
> > 
> 
> --
> Jenny Severance 
> Manager, Quality Assurance
> 
> 

-- 
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


Re: [Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-24 Thread Jenny Severance
Hi, 
Is anyone providing feedback?  At first glance (quick read through), it looks 
like it is just to see if commands work.  Is there any functional followup 
testing after promotion to check if the replica is actually working.  Object 
replication and authentication requests?  Certificate functions, DNS etc ...


- Original Message -
> Hi all,
> 
> Here is a draft of the Replica Promotion test plan
> http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan
> 
> 
> --
> Oleg Fayans
> Quality Engineer
> FreeIPA team
> RedHat.
> 
> 

-- 
Jenny Severance 
Manager, Quality Assurance

-- 
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code


[Freeipa-devel] [IPAQE][REVIEW-REQUEST][TEST PLAN] Replica promotion

2015-11-23 Thread Oleg Fayans

Hi all,

Here is a draft of the Replica Promotion test plan
http://www.freeipa.org/page/V4/Replica_Promotion/Test_plan


--
Oleg Fayans
Quality Engineer
FreeIPA team
RedHat.

--
Manage your subscription for the Freeipa-devel mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-devel
Contribute to FreeIPA: http://www.freeipa.org/page/Contribute/Code