On Fri, Feb 20, 2015 at 3:22 AM, Ara Pulido <[email protected]> wrote: > > > On 19/02/15 21:24, Jeffrey Lane wrote: >> I was reading the other bits of this and while I don't quite >> understand it ( wouldn't it be great if "cough cough" I could be at >> one of your sprints to sync with dev plans "cough cough" especially in >> Taipei) ;-P >> >> Seriously, what I do at least somewhat grok so far is the changes to >> remove whitelists and define those in Units. >> >> I looked over Sylvain's MP to do that for the client cert whitelist. >> I took the liberty of going ahead and adding a story card to do >> likewise for server, so I thought I'd ask if that is something we >> should look at soon, or put off for a bit? > > Where did you add the story?
Hahha, sorry, on The server cert board. I've just gotten used to calling it "the board" and referring to it generically. Not on yours... > Also, taking into account that this change won't break whitelists, maybe > it would be better for your team to transform the whitelist into a > testplan if interested? For the sake of learning :) Thats one of the reasons, yes. The other is that from looking at the update emails from zyga and reading Sylvain's MR (before finally reading in detail the CEP-8 file), I had a sense as to what it was about and wanted to be sure we could take advantage of it... > The idea of the change is that, in the reports (i.e. the HTML report) > you will have a break down of what tests that are certification blockers > fail, v.s. greylist. Yes, after reading the proposal in detail, I'm glad my imagination wasn't really running away with me. I also think having this sort of data in results would be great for outside testers too. I constantly have to re-assure testers in certain companies that "Yes, test Foo that failed is OK, because it's not a blocker, you don't have to spend a week debugging why it failed". Cheers, Jeff > > Cheers, > Ara. > >> >> Cheers >> Jeff >> >> P.S. Really, the sidebar above was meant mostly as a joke, but I am >> interested in keeping up with the dev roadmap and progress for >> plainbox/checkbox since we are a direct consumer of / contributor to >> that effort. >> >> On Thu, Feb 19, 2015 at 2:38 PM, Zygmunt Krynicki >> <[email protected]> wrote: >>> Hey. It's time for another CEP-8 update: >>> >>> - All of the parser related work is now finished. There's one unmerged >>> revision [1] but it was already past the initial review and I expect >>> it to land >>> - I've proposed a set of new APIs for working with data from test plan >>> units. I've specifically changed it from what I had earlier so that >>> working with multiple test plans is possible. This is the CDTS >>> use-case but I think it's okay to do it in general. The code is fairly >>> tested and readable [2] though I haven't tried using it for real >>> - I've started rebasing my earlier bulk and unitary method on top of >>> that, so that it is possible to work with multiple test plans. >>> - We now have test plans for CDTS and Certification [3], [4] that have >>> been reviewed by Ara and are both ready to land as soon as [2] lands. >>> >>> Next week I'll focus on gluing this to plainbox run so that we can >>> verify the test report format and contents and I'll work towards >>> making it possible to use in checkbox-gui. The one risk there is we >>> need to remember (know) which test plans were pre-selected but this >>> knowledge, AFAIK, so far only exists in checkbox-gui (ironically). It >>> can be re-constructed in plainbox so I'm not worried at all, it's just >>> a matter of getting that done. >>> >>> Thanks >>> ZK >>> >>> [1] http://bazaar.launchpad.net/~zkrynicki/checkbox/cep-8/revision/3587 >>> [2] https://code.launchpad.net/~zkrynicki/checkbox/cep-8/+merge/250288 >>> [3] >>> https://code.launchpad.net/~sylvain-pineau/checkbox/14.04-client-testplan/+merge/249272 >>> [4] >>> https://code.launchpad.net/~sylvain-pineau/cdts/cdts_testplans/+merge/250293 >>> >>> -- >>> Mailing list: https://launchpad.net/~checkbox-dev >>> Post to : [email protected] >>> Unsubscribe : https://launchpad.net/~checkbox-dev >>> More help : https://help.launchpad.net/ListHelp >> >> >> > > -- > Mailing list: https://launchpad.net/~checkbox-dev > Post to : [email protected] > Unsubscribe : https://launchpad.net/~checkbox-dev > More help : https://help.launchpad.net/ListHelp -- "Entropy isn't what it used to be." Jeff Lane - Server Certification Team Lead, Tools Developer, Warrior Poet, Lover of Pie Phone: 919-442-8649 Ubuntu Ham: W4KDH Freenode IRC: bladernr or bladernr_ gpg: 1024D/3A14B2DD 8C88 B076 0DD7 B404 1417 C466 4ABD 3635 3A14 B2DD -- Mailing list: https://launchpad.net/~checkbox-dev Post to : [email protected] Unsubscribe : https://launchpad.net/~checkbox-dev More help : https://help.launchpad.net/ListHelp
