Hi Ken, The Quality improvement program currently on my plate only covers Emulator-x86-KK porting but not others like Gip/Gij, Mulet, Raptor… I am willing to share what I know for emulator-x86-kk but we definitely need more epms in different area in order to cover whole picture.
QA, gaye, Jonas had a discussion in August about issues we have in different test harness : https://etherpad-mozilla.org/MarionetteJSDiscussion <https://etherpad-mozilla.org/MarionetteJSDiscussion> Problem and issues I observed: 1. No clear owner for treeherder, taskcluster especially after James Lal left. 2. Emulator porting (arm or x86) should planned as one of release feature with dedicated team considering actual partner device launch. Currently we already have emulator-x86 running on production https://treeherder.mozilla.org/#/jobs?repo=try&revision=2415e8e93ae5 <https://treeherder.mozilla.org/#/jobs?repo=try&revision=2415e8e93ae5>. However we still need to fix all failed tests: https://bugzilla.mozilla.org/showdependencytree.cgi?id=1144970&hide_resolved=1 <https://bugzilla.mozilla.org/showdependencytree.cgi?id=1144970&hide_resolved=1> Cheers, ------------------------------------------------------- Josh Engineering Program Manager, Firefox OS > Ken Chang <[email protected]> 於 2015年10月6日 下午11:03 寫道： > > Since Marshmellow is released today, will we still use Android L for the > release in May 2016? If not, it seems that we don't get any benefit on doing > Emulator-x86-L for that. > Josh is the EPM of Quality improvement program, he has done a lot of > coordination for this program. Perhaps, he can keep helping this. > > Thanks, > Ken > > On Tue, Oct 6, 2015 at 8:54 PM, David Scravaglieri <[email protected] > <mailto:[email protected]>> wrote: > Hi, > > I put together all the conversation I had regarding quality improvements and > I'd like to know if it sounds good to you. > If so, we need an epm assigned and start executing. > > ▾ Continuous Integration plan > Goal : Every commit on Gecko and Gaia must trigger full test run, > failures and performance issues to be reported on Treeherder for backout > ▾ Automation > • Create a test matrix to define which tests are running > on which platform (Device, Mulet, Emulator) > ▾ Engineering > • Port Gip tests to Gij > QA to provide the list of tests to port and > create the related bugs in bugzilla > • Create new Gij tests from moztrap scenarios > QA to select the moztrap scenario that can be > valuable to automate and technically feasible > ▾ Device > • Replace Jenkins module by Treeherder for sending > jobs to Bitbar > • Marionette.js to run on device > • Gecko Unit tests an Gij tests to run on devices > • Add Aries devices to Bitbar (30 units - 15 KK and > 15 L) > • Mulet > Run Gaia Unit tests and Gij tests on Mulet > • Emulator-x86-KK > Activate emulator-x86-kk on Treeherder, run Gecko unit > tests and Gij tests > • Emulator-x86-L > Start porting emulator to L and activate it on > Treeherder > • Raptor > Integrate Raptor performance tests on Treeherder > > Thanks, > --- > David Scravaglieri > Mozilla - Firefox OS > > _______________________________________________ > dev-fxos mailing list > [email protected] <mailto:[email protected]> > https://lists.mozilla.org/listinfo/dev-fxos > <https://lists.mozilla.org/listinfo/dev-fxos> > > > _______________________________________________ > dev-fxos mailing list > [email protected] > https://lists.mozilla.org/listinfo/dev-fxos
_______________________________________________ dev-fxos mailing list [email protected] https://lists.mozilla.org/listinfo/dev-fxos
