Re: [Mageia-dev] automated installer testing
Le vendredi 5 avril 2013 00:36:13 nicolas vigier a écrit : On Thu, 04 Apr 2013, Nicolas Lécureuil wrote: Le jeudi 28 mars 2013 13:57:11 Glen Ogilvie a écrit : Hi, Has anyone done, or thought about, setting up some automated testing of the Mageia installer? I am thinking something based on: https://wiki.mageia.org/en/Auto_inst, testing inside a VM, with a range of different installer configurations, like: * different languages * Free / non-free * package selections, minimal, full, custom * partitioning optons * LVM options * encryption options * filesystem types * software raid options * known error cases (too small / filesystem), /boot on something not supported * grub and grub2 * different CPUs, RAM, architectures. I am thinking that if we had an auto-inst, with maybe 50 or so different test cases, all of which would then be verified by an ssh script connecting to the VM, or something like that. I've found 3 bugs recently, all of which would have been able to be detected by something like what I am suggesting. Suggestions so far are: nicolas vigier: * For automatic testing it would be possible to use OS-autoinst : http://www.os-autoinst.org/ * What we need is someone to add support for Mageia installer : https://github.com/bmwiedemann/os-autoinst/tree/master/distri Pierre-Malo Deniélou: Great idea. Can you prototype it? We should use something like that for mageia 4. Anne Nicolas: I remember some people starting something about it Furthermore it could be interested to have some virtualization for basic tests once rebooted Regards Glen Ogilvie we should look to openQA too. ( https://github.com/bmwiedemann/openQA ) but seems it needs a huge work to adapt but i think t's worth it openQA is a web frontent for OS-autoinst. yes but w/o openQA you have errors when starting os-autoinst
Re: [Mageia-dev] automated installer testing
Le jeudi 28 mars 2013 13:57:11 Glen Ogilvie a écrit : Hi, Has anyone done, or thought about, setting up some automated testing of the Mageia installer? I am thinking something based on: https://wiki.mageia.org/en/Auto_inst, testing inside a VM, with a range of different installer configurations, like: * different languages * Free / non-free * package selections, minimal, full, custom * partitioning optons * LVM options * encryption options * filesystem types * software raid options * known error cases (too small / filesystem), /boot on something not supported * grub and grub2 * different CPUs, RAM, architectures. I am thinking that if we had an auto-inst, with maybe 50 or so different test cases, all of which would then be verified by an ssh script connecting to the VM, or something like that. I've found 3 bugs recently, all of which would have been able to be detected by something like what I am suggesting. Suggestions so far are: nicolas vigier: * For automatic testing it would be possible to use OS-autoinst : http://www.os-autoinst.org/ * What we need is someone to add support for Mageia installer : https://github.com/bmwiedemann/os-autoinst/tree/master/distri Pierre-Malo Deniélou: Great idea. Can you prototype it? We should use something like that for mageia 4. Anne Nicolas: I remember some people starting something about it Furthermore it could be interested to have some virtualization for basic tests once rebooted Regards Glen Ogilvie we should look to openQA too. ( https://github.com/bmwiedemann/openQA ) but seems it needs a huge work to adapt but i think t's worth it
Re: [Mageia-dev] automated installer testing
On Thu, 04 Apr 2013, Nicolas Lécureuil wrote: Le jeudi 28 mars 2013 13:57:11 Glen Ogilvie a écrit : Hi, Has anyone done, or thought about, setting up some automated testing of the Mageia installer? I am thinking something based on: https://wiki.mageia.org/en/Auto_inst, testing inside a VM, with a range of different installer configurations, like: * different languages * Free / non-free * package selections, minimal, full, custom * partitioning optons * LVM options * encryption options * filesystem types * software raid options * known error cases (too small / filesystem), /boot on something not supported * grub and grub2 * different CPUs, RAM, architectures. I am thinking that if we had an auto-inst, with maybe 50 or so different test cases, all of which would then be verified by an ssh script connecting to the VM, or something like that. I've found 3 bugs recently, all of which would have been able to be detected by something like what I am suggesting. Suggestions so far are: nicolas vigier: * For automatic testing it would be possible to use OS-autoinst : http://www.os-autoinst.org/ * What we need is someone to add support for Mageia installer : https://github.com/bmwiedemann/os-autoinst/tree/master/distri Pierre-Malo Deniélou: Great idea. Can you prototype it? We should use something like that for mageia 4. Anne Nicolas: I remember some people starting something about it Furthermore it could be interested to have some virtualization for basic tests once rebooted Regards Glen Ogilvie we should look to openQA too. ( https://github.com/bmwiedemann/openQA ) but seems it needs a huge work to adapt but i think t's worth it openQA is a web frontent for OS-autoinst.
Re: [Mageia-dev] automated installer testing
On 28 Mar 2013 00:57, Glen Ogilvie n...@linuxsolutions.co.nz wrote: Hi, Has anyone done, or thought about, setting up some automated testing of the Mageia installer? I am thinking something based on: https://wiki.mageia.org/en/Auto_inst, testing inside a VM, with a range of different installer configurations, like: * different languages * Free / non-free * package selections, minimal, full, custom * partitioning optons * LVM options * encryption options * filesystem types * software raid options * known error cases (too small / filesystem), /boot on something not supported * grub and grub2 * different CPUs, RAM, architectures. I am thinking that if we had an auto-inst, with maybe 50 or so different test cases, all of which would then be verified by an ssh script connecting to the VM, or something like that. I've found 3 bugs recently, all of which would have been able to be detected by something like what I am suggesting. Suggestions so far are: nicolas vigier: * For automatic testing it would be possible to use OS-autoinst : http://www.os-autoinst.org/ * What we need is someone to add support for Mageia installer : https://github.com/bmwiedemann/os-autoinst/tree/master/distri Pierre-Malo Deniélou: Great idea. Can you prototype it? We should use something like that for mageia 4. Anne Nicolas: I remember some people starting something about it Furthermore it could be interested to have some virtualization for basic tests once rebooted We had been talking about it at Mandriva times but I don't remember if something was done. Something like testing the install goes to the end + system starts with for example console on serial port in kvm to parse it for errors and check the dm comes up + maybe run run some automated test scripts.
[Mageia-dev] automated installer testing
Hi, Has anyone done, or thought about, setting up some automated testing of the Mageia installer? I am thinking something based on: https://wiki.mageia.org/en/Auto_inst, testing inside a VM, with a range of different installer configurations, like: * different languages * Free / non-free * package selections, minimal, full, custom * partitioning optons * LVM options * encryption options * filesystem types * software raid options * known error cases (too small / filesystem), /boot on something not supported * grub and grub2 * different CPUs, RAM, architectures. I am thinking that if we had an auto-inst, with maybe 50 or so different test cases, all of which would then be verified by an ssh script connecting to the VM, or something like that. I've found 3 bugs recently, all of which would have been able to be detected by something like what I am suggesting. Suggestions so far are: nicolas vigier: * For automatic testing it would be possible to use OS-autoinst : http://www.os-autoinst.org/ * What we need is someone to add support for Mageia installer : https://github.com/bmwiedemann/os-autoinst/tree/master/distri Pierre-Malo Deniélou: Great idea. Can you prototype it? We should use something like that for mageia 4. Anne Nicolas: I remember some people starting something about it Furthermore it could be interested to have some virtualization for basic tests once rebooted Regards Glen Ogilvie
