Re: [Libreoffice-qa] db test VM

2011-11-03 Thread Stephan Bergmann 

On 10/31/2011 10:19 AM, Petr Mladek wrote:

What is your opinion, please?


Hard to tell without trying it out, I'd say.  Maybe pick some random 
test now done via testtool and see if it can be ported to 
subsequenttest's pure UNO approach and is better afterwards.



My feeling is that many people do not like testtool because it is:

+ gives random failures:
+ sleeps and waits everywhere in the test code


The root problem here probably is that in some cases appropriate 
notification channels are missing, so test code inserts little waits. 
Some other places are probably test didn't work first, inserted a 
sleep, test then worked, no idea why that should rather be analyzed fully.



+ hard to debug:
+ unclear error messaged
+ complex mapping between the elements in the testtool
   code and LO code (icons, dialogs)
+ need to run the test several times to understand what
   happens there =  quite time consuming
+ hard to maintain:
+ menu entries are accessed by the position in menu =
   new item breaks tests


On the other hand, this did find errors in the past.  ;)  (Some menus or 
drop-down lists maintained items in the order as provided by configmgr, 
relying on configmgr providing them in a specific order; after the 
configmgr rewrite, the items were in a different order, and the actions 
associated with the items no longer matched the items' text...)



IMHO, the best solution would be to involve developers into maintaining
the tests. We need some technology that they would like and accept.


Yep.  Ideally, such higher level tests should be understandable, 
writeable, and maintainable by both QA and Dev folks.  testtool is 
probably something that neither camp particularly likes.


Stephan
___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] db test VM

2011-10-24 Thread drew 
On Wed, 2011-10-19 at 20:39 +0200, Petr Mladek wrote:
 Bernhard M. Wiedemann píše v St 19. 10. 2011 v 16:04 +0200:
  during package install I got
  /opt/lo-dev/program/unopkg.bin: error while loading shared libraries:
  libpng12.so.0: cannot open shared object file: No such file or directory
 
 It is related to https://bugs.freedesktop.org/show_bug.cgi?id=36497#c2
 We need to disable the splash also in the daily build. I am going to
 investigate it.
 
  which I worked around with a
  sudo zypper -n in libpng12-0
 
 This is a good workaround. 
 
  Then some configs or dirs were needed which I got by pulling the
  losmoketest-0.2.tar.bz2 that I found by googling.
 
 I am sorry. I should have told you about it. This was described in
 http://cgit.freedesktop.org/libreoffice/core/tree/smoketestoo_native/losmoketest.readme
 It is still work in progress. We are going to package this stuff and
 make it more convenient to use.
 
  and then, everything runs.
  Though 22 seconds total time for test is surprisingly quick.
 
 It is just a basic test. For example, it checks that all applications,
 calc, writer, impress, can be started.
 
  if you want to test:
  curl http://openqa.opensuse.org/opensuse/qatests/qa_office.sh|sh
 
 Great work! Please, find attached slightly updated version. There are
 two changes:
 
   + use mktemp instead of the hardcoded temp dir name
   + use --headless option to do the test even without working
   X11; heh, you might want to remove it, if you have running
   X11 session in the openQA framework
 
 I hope that it helps.
 
 I am very interested how the DB testing will work in the end.
 
 

Howdy all,

Well, thought I'd let folks know what I've been up to with the
SuseSTUDIO service...errr stuff. 

Creating a VM with the daily build files turned out to be really
straightforward.

-  OK, so it's not automated for daily updates, but doing so by hand now
is really quite simple and fairly quick (3 clicks and ~10 minutes), and
not that big a deal for what I personally had in mind.

Here is the latest configuration setup:
http://susegallery.com/a/EvUJ20/lo-client-daily-libreoffice_master

That VM image includes yesterdays (10-23-2011) build from Master,
located at /opt/lo-dev

Currently there is no menu integration (should be there tomorrow :)

Anyway - I'll update the wiki page with more details this afternoon.

//drew


___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] db test VM

2011-10-19 Thread Bernhard M. Wiedemann 
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 10/18/2011 03:21 PM, Petr Mladek wrote:
 Hi,
 
 first, I am sorry with the late reply. I have attended the LO
 conference last week...
 
 Bernhard M. Wiedemann píše v St 12. 10. 2011 v 17:57 +0200:
 -BEGIN PGP SIGNED MESSAGE- On 10/10/2011 02:53 PM, Petr
 Mladek wrote:
 We might use Yi Fan's 
 http://cgit.freedesktop.org/libreoffice/core/tree/smoketestoo_native/losmoketest.py


 
I tried to run
 python losmoketest.py --force --type=daily_master but it kept
 looping+printing Checking new build.
 
 because this was missing: - --- losmoketest.py.orig 2011-10-12
 16:38:10.0 +0200 +++ losmoketest.py  2011-10-12
 17:31:12.0 +0200
 
 Thanks for the fix. I have pushed it as 
 http://cgit.freedesktop.org/libreoffice/core/commit/?id=45afb6635894a812701624ea092a9a812f048671

 
 and then cppunittester complained about missing
 libuno_sal.so.3 which can be workarounded with echo
 /opt/lo-dev/ure/lib  /etc/ld.so.conf.d/lo.conf ; ldconfig
 
 The script sets LD_LIBRARY_PATH but it used a wrong path. I have
 fixed it.
 
 and then an assertion failed in officeconnection.cxx:112... so
 not really working out-of-the box
 
 It used a wrong path to services.rdb. I have fixed it as well.
 
 I did many other changes that might be interesting for you, see 
 http://cgit.freedesktop.org/libreoffice/core/commit/?id=c55b2dcceed29c3e9df181b2775099d5b345a4e9

  So, please, try the last script from 
 http://cgit.freedesktop.org/libreoffice/core/plain/smoketestoo_native/losmoketest.py

  Feel free to report any problems. Me and Yi Fan will do our best
 to improve it for your needs.
 
 
 and I found that uninstalling the openSUSE libreoffice.rpm
 complains about missing /usr/sbin/unopkg-sync-bundled
 
 Just ignore these complains. I need to improve post install script 
 dependencies but it does not break anything.
 
 pulling daily builds from OBS could also be an option for us.
 
 It might take me few days to setup it because I havn't started to
 pack master for openSUSE yet. Anyway, we have wanted the daily repo
 for ages, so I could jump on it if you want. In the meantime, you
 could use packages from the LibreOffice:Unstable repo. It should be
 easy to switch to the new repo if needed.
 
 I am looking forward to see some testing results.
 
 
 Best Regards, Petr

Hi,

during package install I got
/opt/lo-dev/program/unopkg.bin: error while loading shared libraries:
libpng12.so.0: cannot open shared object file: No such file or directory

which I worked around with a
sudo zypper -n in libpng12-0

This hints toward missing dependencies.

Then some configs or dirs were needed which I got by pulling the
losmoketest-0.2.tar.bz2 that I found by googling.

and then, everything runs.
Though 22 seconds total time for test is surprisingly quick.

if you want to test:

curl http://openqa.opensuse.org/opensuse/qatests/qa_office.sh|sh

Ciao
Bernhard M.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.18 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk6e2N0ACgkQSTYLOx37oWQw/QCeM63x7hzA+dZ+v5bSmqDOM/4l
gDMAoKpusI+Ksp0moRsxd3h3FHhtT1rn
=zZhV
-END PGP SIGNATURE-
___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] db test VM

2011-10-12 Thread Bernhard M. Wiedemann 
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 10/10/2011 02:53 PM, Petr Mladek wrote:
 Michael Meeks píše v Po 10. 10. 2011 v 12:44 +0100:
 On Mon, 2011-10-10 at 12:36 +0200, Petr Mladek wrote:
 One possibility would be to use night builds from the plain
 build.
 
 Yep; I guess we could prolly openQA script their download / 
 install.
 
 We might use Yi Fan's 
 http://cgit.freedesktop.org/libreoffice/core/tree/smoketestoo_native/losmoketest.py

 
This script downloads and installs the last plain daily build and run a
 smoke test on it.
 
 
 Best Regards, Petr

I tried to run
python losmoketest.py --force --type=daily_master
but it kept looping+printing Checking new build.

because this was missing:
- --- losmoketest.py.orig 2011-10-12 16:38:10.0 +0200
+++ losmoketest.py  2011-10-12 17:31:12.0 +0200
@@ -202,7 +202,7 @@
 reg = re.compile('\a\
href=\(master\~\d.*LibO-Dev_.*x86_install-rpm_en-US.tar.gz)\.*(\d{2}\-[a-zA-Z]{3}\-\d{4}).*(\d{2}:\d{2}).*')
 elif pck == rpm and arc == x86_64:
 url = SERVER_URL + / + DAILY_MASTER_RPM_X86_64_PATH
- -reg = re.compile('^$') # No build yet
+reg = re.compile('reg = re.compile('\a\
href=\(master\~\d.*LibO-Dev_.*x86-64_install-rpm_en-US.tar.gz)\.*(\d{2}\-[a-zA-Z]{3}\-\d{4}).*(\d{2}:\d{2}).*')')
 elif pck == deb and arc == x86:
 url = SERVER_URL + / + DAILY_MASTER_DEB_X86_PATH
 reg = re.compile('\a\
href=\(master\~\d.*LibO-Dev_.*x86_install-deb_en-US.tar.gz)\.*(\d{2}\-[a-zA-Z]{3}\-\d{4}).*(\d{2}:\d{2}).*')



and then cppunittester complained about missing libuno_sal.so.3
which can be workarounded with
echo /opt/lo-dev/ure/lib  /etc/ld.so.conf.d/lo.conf ; ldconfig

and then an assertion failed in officeconnection.cxx:112...
so not really working out-of-the box


and I found that uninstalling the openSUSE libreoffice.rpm complains
about missing /usr/sbin/unopkg-sync-bundled


pulling daily builds from OBS could also be an option for us.

Ciao
Bernhard M.
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.18 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk6VuOoACgkQSTYLOx37oWRAZACgh6q6Z9NmxhLnHg41JfI0AckS
A1EAoNa/2HCcWkHzWYEhtNNqsTmZypPD
=4Lqc
-END PGP SIGNATURE-
___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/

Re: [Libreoffice-qa] db test VM (was: automated testing of Base)

2011-10-10 Thread Michael Meeks 

On Mon, 2011-10-10 at 12:36 +0200, Petr Mladek wrote:
 Is is supposed for testing of the openSUSE LO packages or
 the plain LO build?

The plain build I suggest.

 Is the testing automatic or manual?

Automatic via openQA (which is awesome but well hidden ;-)

 Also I wonder where to report bugs. I would prefer
 https://bugs.freedesktop.org/ if the bugs are in the plain
 build as well.

Sounds reasonable to me.

 One possibility would be to use night builds from the plain build.

Yep; I guess we could prolly openQA script their download / 
install.

Thanks !

Michael.

-- 
michael.me...@suse.com  , Pseudo Engineer, itinerant idiot

___
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa@lists.freedesktop.org
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/