[Meego-qa] how to install test-definition ?

test-definition in http://meego.gitorious.org/meego-quality-assurance/test-definition?page=1 ___ MeeGo-qa mailing list MeeGo-qa@lists.meego.com http://lists.meego.com/listinfo/meego-qa

[Meego-qa] Handset-IA-iCDK-Acceptance Test Report for 1.2:Testing-1.1.80.13.20110105.1

Quality Summary Improvements : Key Issues : * White screen occurs while launch lock application(Bug 12009 - [trunk:testing][REG]White screen occurs while launch lock application. (NEW)). * Black screen occurs wh

[Meego-qa] Core-IA-Netbook-Acceptance Test Report for Trunk:Testing - 1.1.80.13.20110105.1

Quality Summary Core netbook sanity pass ratio is 90%, compare with 1223's image pass ratio is downgrade(93%->90%), because of empathy doesn't work. In today's TT image build-in MIC and touchpad on Lenovo s10-3t can work. Improvement: * Build-in MIC of Lenovo s10-3t can work, bug(11003

[Meego-qa] Netbook-IA-Pinetrail-Acceptance Test Report for 1.2 Trunk:Testing - 1.1.80.13.20110105.1

Quality Summary Sanity Pass ratio is 75%, Whole quality of today's have keep stably. In today's image, 2 UI bugs fixed, but a new major regression bug(12011) submitted that is " Fail to login Gtalk/jabber/MSN by IM client". Top issues still exist ,s

[Meego-qa] Core-IA-IVI-Acceptance Test Report for Trunk:Testing - 1.1.80.13.20110105.1

Quality Summary --- Improvement: Ø N/A Key Issues: Ø IVI: failed to boot and install on Menlow(Russellville and Crown Beach) due to mrst_gfx module 9104 Ø Sample-media is not integrated into image 11670

Re: [Meego-qa] QA verdict rules.

Test case verdict rules vary in difference groups/organizations. There is no one set of rules can edge out others as the correct or best one. Promulgate simple clear rules for MeeGo QA, then rules are followed by both of QA engineers and community, and becomes the basis of reports explanation i

Re: [Meego-qa] On results from automated testing at qa-reports.meego.com

Thanks Ville. I see all the tests are failing. There are some issues with the test package. We will do the corrections, and check in the new package. Hope OTS is capable of executing Cucumber tests, as our tests are written Cucumber? I mean all the dependencies for Cucumber tests are closed in t

Re: [Meego-qa] meego-meeting-MeeGo Handset Ux Bug triage meeting minutes 20110105

heard at background. Br Srikanth From: meego-qa-boun...@lists.meego.com [mailto:meego-qa-boun...@lists.meego.com] On Behalf Of ext Ji, Jessica Sent: 5. tammikuuta 2011 9:53 To: meego-qa@lists.meego.com Subject: [Meego-qa] meego-meeting-MeeGo Handset Ux Bug triage meeting minutes 20110105 Hel

Re: [Meego-qa] QA verdict rules.

It seems to me that by the definitions that Jari just pointed out, a not implemented feature would be listed as blocked with the comment of "not implemented": "Blocked: This is special value required for the situations where verdict cannot be given due to failure in preconditions." This gives

[Meego-qa] Handset-ARM-N900-Acceptance Test Report for Trunk:Daily-1.1.80.13.20110104.1

Quality Summary Improvements: Not observed 9800 - [Trunk : Daily]USB (wall) charger does not work on N900. (REOPENED) Key Issues: 9848 - The music files are not displayed in Music application though they are u

Re: [Meego-qa] QA verdict rules.

To crystallize my thoughts. If you're working e.g. as program manager and want to know current release situation. Then you would be intressed to: - find out how much features compared to wanted feature set have been developed * in MeeGo: you would examine featurezilla metrics. How much fe

Re: [Meego-qa] QA verdict rules.

We were having discussion earlier around this and as a summary there were definitions written in: http://wiki.meego.com/Quality/Glossary#Test_case_verdict So you want to change these? Br, Jari -Original Message- From: meego-qa-boun...@lists.meego.com [mailto:meego-qa-boun...@lists.mee

Re: [Meego-qa] QA verdict rules.

Hi, My "understanding" on TC verdict is this: 'PASS' - When the test case passes 'FAIL' - When the test case fails, e.g. feature not working or feature not implemented 'N/A' - When QA cannot give a verdict, Are we agreeing on these? -jake- -Original Message- From: meego-qa-boun...@

Re: [Meego-qa] QA verdict rules.

Well, all complexity is of our own making. My 2 cents goes to: PASS - works FAIL - fails because not working or not implemented N/A - test cannot be run due to QA Sorry Anssi but referring to agile with "If we would mark not done features failed then we would easily give wrong picture about cu

Re: [Meego-qa] QA verdict rules.

Good strict comments. It starts to seem that this has two different perspectives: Core and UX. Core is developed based on detailed features (or is it?) and mostly tested by automation. UX on the other hand is changing constantly, features are described on high level, and testing is mostly done

Re: [Meego-qa] QA verdict rules.

Mark, I totally agree you on this. And good discussion, great. I hope everyone (including me) can "forget" how things have been previously done and concentrate the fact that what is QA mission and how things should be handled at MeeGo. I mean, we have more possibilities now when we have QA-Too

Re: [Meego-qa] QA verdict rules.

Hi I'd like to make some comments about this, both from a theoretical and from a practical point of view. To us, a specific version of MeeGo represents a set of features. Specifically, MeeGo 1.2 represents the features marked for 1.2 (and earlier) in bugs.meego.com. If a feature is supposed to be

Re: [Meego-qa] On results from automated testing at qa-reports.meego.com

On 01/05/2011 12:37 AM, Manikkoth Sajeev (Nokia-MS/Bangalore) wrote: Hi Ville, "First automated Handset UX test run was done today." Can we see the results of this execution? I mean the URL where this results are available? There you go http://qa-reports.meego.com/1.2/Core/Nightly%20-%20Auto

[Meego-qa] IVI-IA-Russellville-Basic Feature Test Report for Weekly 1.1.80.13.20110104.1 - blocked

Quality Summary --- * All tests are blocked by bug 11971 - [IVI]Weekly 20110104 image failed to boot and install Thanks Yanshuang Intel Corporation ___ MeeGo-qa mailing list

Re: [Meego-qa] QA verdict rules.

I agree with Anssi To keep it simple our proposal for test cases verdict :- Pass: work as expected Fail: if some this not working according to expected N/A : if feature is not implemented (comment in test cases "Not implemented") or test cases is blocked by known issue (In this cases N/A verdict

Re: [Meego-qa] QA verdict rules.

In our case it means Not Available, I think. Regards, Jakov, MHUX QA Team. From: Kunnari Jake (Nokia-MS/Helsinki) [mailto:jake.kunn...@nokia.com] Sent: Wednesday, January 05, 2011 10:43 AM To: Pronin Jakov (EXT-Ixonos/Estonia); Rantalainen Niko.M (Nokia-MS/Tampere); meego...@meego.com Subje

Re: [Meego-qa] QA verdict rules.

Totally agree with Ansii. Regards, Jakov, MHUX QA Team. From: Takku Anssi (Nokia-MS/Tampere) [mailto:anssi.ta...@nokia.com] Sent: Wednesday, January 05, 2011 11:12 AM To: Kunnari Jake (Nokia-MS/Helsinki); Pronin Jakov (EXT-Ixonos/Estonia); Rantalainen Niko.M (Nokia-MS/Tampere); meego...@me

Re: [Meego-qa] QA verdict rules.

I personally don't like the idea of marking not implemented features to failed. Why: -In agile development we actually don't know what are the features that will be implemented (ok, we have some wishlist of features for 1.2 but not all will be implemented that's for sure) -Agi

[Meego-qa] Core-ARM-N900-Acceptance Test Report forTrunk:Testing - 1.1.80.13.20110104.1

More detailed test summary is available at Quality Summary Pass rate of total & Pass rate of executed increase 2%. Improvement: Bootup time reduces. Key issues: 2 test cases are not suitable for N900. 5

Re: [Meego-qa] QA verdict rules.

And about N/A, in this case is it : Not Applicable or Not Available? http://en.wiktionary.org/wiki/n/a br Jake From: meego-qa-boun...@lists.meego.com [mailto:meego-qa-boun...@lists.meego.com] On Behalf Of Pronin Jakov (EXT-Ixonos/Estonia) Sent: 05 January, 2011 10:02 To: Rantalainen Niko.M (No

Re: [Meego-qa] QA verdict rules.

Hi, >From a testing point-of-view: When feature is not implemented = test is >failing and verdict should be Fail Br Jake From: meego-qa-boun...@lists.meego.com [mailto:meego-qa-boun...@lists.meego.com] On Behalf Of Pronin Jakov (EXT-Ixonos/Estonia) Sent: 05 January, 2011 10:02 To: Rantalaine

[Meego-qa] Handset-IA-nCDK-Acceptance Test Report for 1.2:Testing-1.1.80.13.20110104.1

Quality Summary Improvements : Key Issues : * Black screen occurs when launching an application(Bug 7728 - Black screen occurs when launching an application. (NEW)). * Screen becomes to black when minimizing and

Re: [Meego-qa] QA verdict rules.

Hi, We think it would be better to leave verdicts as they are: Pass = When QA can verify that tested feature works as expected. This is OK with us. Fail = When QA can verify that tested feature does not work as expected. (ex. feature is not implemented.) We propose: Fail = When QA can ver

[Meego-qa] Handset-IA-iCDK-Acceptance Test Report for 1.2:Testing-1.1.80.13.20110104.1

Quality Summary Improvements : Key Issues : * Black screen occurs when launching an application(Bug 7728 - Black screen occurs when launching an application. (NEW)) * Screen becomes to black when minimizing and m