Re: [Libreoffice-qa] A Query on a sudden increase in the bug dependency of LibreOffice

[Jan-Marek Glogowski]

Hi Hadi,

Am 26.04.21 um 21:16 schrieb Hadi Jahanshahi:

I have a question regarding bug dependency in LibreOffice.
While I was studying the blocking and blocked bugs, I found that in 
LibreOffice, after 2017, there is a sudden spike in the number of the 
found dependencies.


[snip]

May I ask what is the interpretation for that sudden increase? What 
happened that developers started to find these many bug dependencies?
Thank you for your help in advance. I hope that I contacted the correct 
list.


People at libreoffice-qa@lists.freedesktop.org probably have more 
insight. My guess is the following bugzilla query:


https://bugs.documentfoundation.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=NEEDINFO&columnlist=product%2Ccomponent%2Cshort_desc%2Cchangeddate%2Copendate&field0-0-0=short_desc&field0-0-1=status_whiteboard&limit=0&list_id=1298870&query_format=advanced&type0-0-0=substring&type0-0-1=substring&value0-0-0=meta%5D&value0-0-1=meta%5D

LO QA and devs use "[META]" bugs to group bugs by affected "feature" 
areas blocking on the meta bug. As you can see in the query, we had 78 
before 2016 and 214 before 2017. Currently we have 834 meta bugs (885, 
if you include closed ones), so even with 12322 open bugs [1], it's much 
more likely a bug blocks on one of the meta bugs. If you filter these, I 
would guess your graph will almost flatline ~0.


HTH

[1] https://bugs.documentfoundation.org/page.cgi?id=weekly-bug-summary.html
___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: https://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

[Libreoffice-qa] [A

[Yi Fan Jiang]

Dear community,

I am delighted to announce that we have enabled the new name of Moztrap:

http://manual-test.libreoffice.org

Notice: The old name vm12.documentfoundation.org may still visible but
no functional consistency is guaranteed.

Thanks for Florian, Petr, Klaus-jürgen, Sophie, Rimas etc. help out
everything! Any problem, please do not hesitate to report :-)

Also I want to take the opportunity to thanks all for your strong
support of Libreoffice QA, Litmus and Moztrap! I hope we will have
another harvest year in 2013 :)

Merry Christmas & Happy New Year!

Best wishes,
Yifan

-- 
  Yifan Jiang
  Libreoffice / SUSE
  Contact: yifan - irc.freenode.net/libreoffice
  =  
  http://www.libreoffice.org/
  http://www.documentfoundation.org/



___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] A little confused re: QA and help from users

[Yifan Jiang]

Hi there,

On Tue, Jun 19, 2012 at 02:53:39PM +0200, Nino Novak wrote:

> My personal thought is that we should try to better coordinate such
> "silent testing" as it might be the case that some functions get
> tested thousandfold and others not at all. My hope is that with
> Litmus/Moztrap a more/better coordintated/systematic testing can be
> achieved. But I don't know what the progress is as I've not been
> following the list for quite a while now.

Thanks for Nino's thoughts :) The following is some of the further comments of
Moztrap. As a replacement for Litmus
(https://wiki.documentfoundation.org/Litmus), Moztrap is promising for the
future of regression test
(https://wiki.documentfoundation.org/QA/Testing/Regression_Tests#Full_Regression_Test)
to go, currently we have a working Moztrap instance here:

http://vm12.documentfoundation.org/

Ideally the tool will make the individual "silent testing" visible for anyone
else, so that we will know which kind of tests have been done by other QA
people.

The Moztrap is in its experiments phase, we are now in the progress to
evaluate the system, gather information and feedback from people to see if
there are critical problems brought by the new tool. Please see the series of
announcement mails in libreoffice-qa mailing list titled with *[ANN] Moztrap
evaluation online - xx*.

Announcement:
http://article.gmane.org/gmane.comp.documentfoundation.libreoffice.qa/1513

Permission bits:
http://article.gmane.org/gmane.comp.documentfoundation.libreoffice.qa/1514

Code and bugs:
http://article.gmane.org/gmane.comp.documentfoundation.libreoffice.qa/1510

TODO:
http://article.gmane.org/gmane.comp.documentfoundation.libreoffice.qa/1511

As you can see from the TODO list, we are in an inital progress and please let
us know if you are excited to help out anything :)

Best wishes,
Yifan

-- 
  Yifan Jiang
  Libreoffice / SuSE
  Contact: yifan - irc.freenode.net/libreoffice
  =  
  http://www.libreoffice.org/
  http://www.documentfoundation.org/

___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] A little confused re: QA and help from users

[Nino Novak]

Not really an answer but rather some related questions/thoughts:

Am 19.06.2012 09:47, schrieb Marc Paré:

Like the title says, I am a little confused over QA and help from users.
Do people who are on this list participate in any QA?


Don't know if I understand your question - I'd assume that people 
subscribed to this (libo-qa) list are particularly interested in doing 
QA work plus organizing it.




For example, I usually download any LO Beta series on up. Is there
anything that I could do to help with QA? Testing? I cannot do very long
QA tests but even short tests? No sense in downloading the pre-releases
and not helping out when I can.


I'd assume that this is exactly what many people do: downloading a 
"young" version from time to time (or even regularly) and trying to 
perform some of their usual daily work with it. This might be called 
some kind of "silent QA", because nobody ever learns about the results 
of these attempts. However - hopefully - they'll report back to a list 
or to bugzilla if they encounter any blockers or strange behavior (at 
least I do).


My personal thought is that we should try to better coordinate such 
"silent testing" as it might be the case that some functions get tested 
thousandfold and others not at all. My hope is that with Litmus/Moztrap 
a more/better coordintated/systematic testing can be achieved. But I 
don't know what the progress is as I've not been following the list for 
quite a while now.




Do we need more help from users specifically for QA on this list? It
looks like the process is pretty much automated or am I wrong?


This question shows that the available info about this part of the QA is 
still incomplete (or not visible enough): What exactly is tested 
autmatically - and what needs (additional) manual testing?


However - personally I'd say that QA needs as many qualified people as 
possible, but that's not enough: the QA work needs better 
coordination/synchronization, too.


Nino
___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

[Libreoffice-qa] A little confused re: QA and help from users

[Marc Paré]

Like the title says, I am a little confused over QA and help from users. 
Do people who are on this list participate in any QA?


For example, I usually download any LO Beta series on up. Is there 
anything that I could do to help with QA? Testing? I cannot do very long 
QA tests but even short tests? No sense in downloading the pre-releases 
and not helping out when I can.


Do we need more help from users specifically for QA on this list? It 
looks like the process is pretty much automated or am I wrong?


Thanks for any info.

Cheers,

Marc

___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] [​A​N​N​]​ ​M​o​z​t​r​a​p​ ​e​v​a​l​u​a​t​i​o​n​ ​o​n​l​i​n​e​ - roles and permissions

[Petr Mladek]

Yifan Jiang píše v St 23. 05. 2012 v 10:53 +0800:
> At the moment, the test suites are divided into different priorities (P1, P2,
> P3, P4), accordingly we can create test runs based on the priority:
> 
> - For Full Regression Test of a major version is to include all priority
> of cases to a test run.
> 
> - For Regression Test of a bug fix minor version is to include high (P1
> and P2) priority of cases to a test run.
> 
> Those were what we did in Litmus era.

The proposal of what test scenario belongs to what priority is described
at
http://wiki.documentfoundation.org/QA/Testing/Test_Cases_Organization#Priority


Just to explain some more background :-)

Litmus allows to split test cases in two levels: "test group" and
"subgroup". We used "test groups" to split by component, e.g. Writer,
Calc. We used subgroup to split by priority, e.g. P1, P2.

Moztrap has only one level called "Test Suites". It allows to run only
the whole "test suite". We might want to run only "P1" and maybe "P2"
tests for bugfix releases => Yifan had the great idea to split test
suites by priorities.

Note that Moztrap allows to add any tag for each test case. We could use
the tags for marking component-specific bugs. It is easy. Test cases
authors just select from list of available tags that is provided by
administrator.


Best Regards,
Petr

___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] [​A​N​N​]​ ​M​o​z​t​r​a​p​ ​e​v​a​l​u​a​t​i​o​n​ ​o​n​l​i​n​e​ - roles and permissions

[Yifan Jiang]

Hi Nino,

On Tue, May 22, 2012 at 07:38:21PM +0200, Nino wrote:
> Hi again,
> 
> Could you please grant me a test creator role, I want to try out
> entering test cases.

Of course, done! If no special reasons, please add the cases to "Version 0",
it will automatically apply to later versions of the case if "And Later
Versions" checkbox is checked on. The creator only allows an increased
operation of the test base, but do not worry about messing up things when you
try to play them :)

> BTW: Do we have a higher level test plan or test strategy? Which
> e.g. states what has to be tested for which purpose / in which
> situation? I'm wondering if/how some kind of mapping could be
> achieved between a requirement/use case/spec, a (or several) program
> function(s), and a set of corresponding test cases.

Great question! It is about how we organize the testing. The full strategy and
planning is evolving and I don't think we have a definite tone here :) Though
we have some tenative thoughts.

The current plan, from Litmus experience, is to have a stable test case base,
which we put into different "test suites". Test suites are allowed to include
to a "test run". And the test run is what a tester usually see from the Run
Tests view.

At the moment, the test suites are divided into different priorities (P1, P2,
P3, P4), accordingly we can create test runs based on the priority:

- For Full Regression Test of a major version is to include all priority
of cases to a test run.

- For Regression Test of a bug fix minor version is to include high (P1
and P2) priority of cases to a test run.

Those were what we did in Litmus era. The good thing of Moztrap is the test
suite and case management is more clear and flexible, we can always create
special test suites on demand, including a particular set of test cases. Then
we can create a particular test run from those test suites.

BTW, you will need to setup a local moztrap instance, or to be a "Manager"
permission to play with all of these management stuff :)

-- 
  Yifan Jiang
  Libreoffice / SuSE
  Contact: yifan - irc.freenode.net/libreoffice
  =  
  http://www.libreoffice.org/
  http://www.documentfoundation.org/
___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] [​A​N​N​]​ ​M​o​z​t​r​a​p​ ​e​v​a​l​u​a​t​i​o​n​ ​o​n​l​i​n​e​ - roles and permissions

[Nino]

Hi again,

Could you please grant me a test creator role, I want to try out 
entering test cases.


BTW: Do we have a higher level test plan or test strategy? Which e.g. 
states what has to be tested for which purpose / in which situation? I'm 
wondering if/how some kind of mapping could be achieved between a 
requirement/use case/spec, a (or several) program function(s), and a set 
of corresponding test cases.


Nino
___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] [​A​N​N​]​ ​M​o​z​t​r​a​p​ ​e​v​a​l​u​a​t​i​o​n​ ​o​n​l​i​n​e​ - code and bugs

[Yifan Jiang]

Hi Rainer,

Thanks and the description of the subcomponent is done :) 

Best wishes,
Yifan

On Tue, May 22, 2012 at 11:50:50AM +0200, Rainer Bielefeld wrote:
> Hi,
> 
> I defined a Sub Component "MozTrap" on
> 
> 
> Can someone please leave a short description on
> ?
> 
> Thank you and best regards
> 
> Rainer

-- 
  Yifan Jiang
  Libreoffice / SuSE
  Contact: yifan - irc.freenode.net/libreoffice
  =  
  http://www.libreoffice.org/
  http://www.documentfoundation.org/

___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] [​A​N​N​]​ ​M​o​z​t​r​a​p​ ​e​v​a​l​u​a​t​i​o​n​ ​o​n​l​i​n​e​ - code and bugs

[Rainer Bielefeld]

Yi Fan Jiang schrieb:


If you want to file a bug or an enhancement, please report it to
freedesktop bugzilla with Product "Libreoffice", Component "WWW". More
details of howto report a bug is described here:

http://wiki.documentfoundation.org/BugReport#Reporting_a_bug_in_few_Steps


Hi,

I defined a Sub Component "MozTrap" on 



Can someone please leave a short description on
?

Thank you and best regards

Rainer
___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

[Libreoffice-qa] [​A​N​N​]​ ​M​o​z​t​r​a​p​ ​e​v​a​l​u​a​t​i​o​n​ ​o​n​l​i​n​e​ - roles and permissions

[Yi Fan Jiang]

Dear fellows,

This mail is part of the main thread of Moztrap evaluation online.

By default, Moztrap allows Guest touring of the system. Without any
registration, anyone can review testing result and how they organized. For
practical evaluation of the system, you should have either of the following
roles.

Tester role
===

Natively Moztrap supports either Mozilla Persona ID or traditional
registered way of log in. Since using and hacking to support those method
or OpenID solution is still pending, we only enabled the traditional way
at the moment. After a successful registration, you will be automatically
assigned as a tester, namely you could run test cases when the id is
born :)

Test creator role
=

If you have test cases on hand and want to contribute the test case base,
please do not hesitate to let me know :)

In addition, as the format of test case, I feel it would be convenient to
follow the Moztrap "Bulk test case" entry rule, that a text based test case
can be stored and exchanged conveniently. More details of how it works can 
be
found:


http://readthedocs.org/docs/moztrap/en/1.0.X/userguide/ui/import.html#bulk-test-case-entry-formats

Admin role
==

Admins could organize test runs, test cases organizations etc.

Litmus admins, please let me know when registered, I'll assign
corresponding admin permission for you.

If some one out of Litmus admin team who wants to try the test case
management tasks, please show off your previously proven contribution to
Libreoffice project. Admins would evaluate and decide the granting of
permission.

Best wishes,
Yifan


___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

[Libreoffice-qa] [​A​N​N​]​ ​M​o​z​t​r​a​p​ ​e​v​a​l​u​a​t​i​o​n​ ​o​n​l​i​n​e​ - todo, known issues and contacts

[Yi Fan Jiang]

Dear fellows,

This mail is part of the main thread of Moztrap evaluation online.

Known issues and TODO items
===

1. We need to update wiki pages

2. Decide the login method, Registration&login/Mozilla id/Openid?

3. Occasionally you may meet cross site verification failure when logging 
in:

Forbidden (403)

CSRF verification failed. Request aborted.

This is not expected but I didn't find out why it happens, possibly it
is an improper tuning of Moztrap or a bug. On my side, simply
refreshing times will get the page loaded successfully.

We will need to resolve this any way.

4. The running version is based on upstream 1.0.x branch, with slight
hacks:

The original system does not design for users sharing testing results
among each other, I revised a bit of the related code to allow testers
working as ONE that they will see/retest others' testing status if
they have the same test case and same environment settings to run.

So ideally our QA people will not run the same case in the same
environment again and again. Instead blindly test those cases already
executed, they can explicitly revise others' testing result when
necessary.

However currently the hacking has its limitation. Different testers
could modify results for a given test case and test environment, only
the last result is stored but the name of the first tester is
associated with it.

We will need to burnish the hack.

5. Look into i18n and l10n of Moztrap, we need translation system for both
test cases and Moztrap UI.

6. Handling locale independent and OS independent test cases. It makes
perfect sense to run those cases in any and an only locale or OS. In the
situation, testers should have a equal information of the results of those
test cases when they are testing in certain different environment
set. Mostly this is for saving our resources of testing.

Contact
=

Moztrap development interests could be sent to:

libreoff...@freedesktop.org

Moztrap enhancement and ideas could be sent to:

libreoffice...@freedesktop.org

In any case you can contact me via email:

yfji...@suse.com

Best wishes,
Yifan


___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

[Libreoffice-qa] [​A​N​N​]​ ​M​o​z​t​r​a​p​ ​e​v​a​l​u​a​t​i​o​n​ ​o​n​l​i​n​e​ - code and bugs

[Yi Fan Jiang]

Dear fellows,

This mail is part of the main thread of Moztrap evaluation online.

Bug, Code
=

If you want to file a bug or an enhancement, please report it to
freedesktop bugzilla with Product "Libreoffice", Component "WWW". More
details of howto report a bug is described here:


http://wiki.documentfoundation.org/BugReport#Reporting_a_bug_in_few_Steps

For developers, we deployed 1.0.x Moztrap on our server, the development
and deploy documentation can be found in:

http://readthedocs.org/docs/moztrap/en/1.0.X/index.html

It is valuable to tell that our deployment of Moztrap has merged several
hacks, which make it a bit diverse from the upstream one.

The current major change is that we allow testers to share testing
results. They work as one and do not need to repeat the same case in the
same test environment. If you want to dig more into this, please refer to
the TODO mail or let me know.

Patches, which are warmly welcome, can be sent directly to me and the
mailing list :)

Best wishes,
Yifan


___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/