Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
On Fri, 2011-10-07 at 13:28 -0400, drew wrote: > > Alright - so I did a little fiddling last night and this morning and > started putting together a test best image: > http://susestudio.org/a/EvUJ20/lo-sbs-libre-34x Interesting! I take it though that susestudio is not the the place to go for real use, for example to speed up gdb sessions where my own limited RAM leads to lots of swapping. For that, I need another service provider, right? Suggestions? Terry. ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
On Mon, 2011-10-10 at 14:53 +0200, Petr Mladek wrote: > Michael Meeks píše v Po 10. 10. 2011 v 12:44 +0100: > > On Mon, 2011-10-10 at 12:36 +0200, Petr Mladek wrote: > > > One possibility would be to use night builds from the plain build. > > > > Yep; I guess we could prolly openQA script their download / > > install. > > We might use Yi Fan's > http://cgit.freedesktop.org/libreoffice/core/tree/smoketestoo_native/losmoketest.py > This script downloads and installs the last plain daily build and run a > smoke test on it. Wonderful - grabbed it (I'll try working with it as is, and it looks like maybe a good starting point for building out for other test scenaios), thanks. BTW - timing wise, I've just moved into a new abode and at the moment have no broadband connection to the net - this won't be rectified till later this week, so for now can't really try any of this, just setting up for later..but by the weekend coming should be ready to hit it. Finally - if anyone is interested in having edit rights to the SuseStudio image configuration just let me know, I'm sure there is a way that can be done and I don't have any problem doing so. Best wishes, //drew ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
Michael Meeks píše v Po 10. 10. 2011 v 12:44 +0100: > On Mon, 2011-10-10 at 12:36 +0200, Petr Mladek wrote: > > One possibility would be to use night builds from the plain build. > > Yep; I guess we could prolly openQA script their download / > install. We might use Yi Fan's http://cgit.freedesktop.org/libreoffice/core/tree/smoketestoo_native/losmoketest.py This script downloads and installs the last plain daily build and run a smoke test on it. Best Regards, Petr ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
On Mon, 2011-10-10 at 12:36 +0200, Petr Mladek wrote: > Hi, > > I add Yi Fan into CC who actively works on LO QA. > > Michael Meeks píše v Pá 07. 10. 2011 v 20:49 +0100: > > Hi Drew, > > > > On Fri, 2011-10-07 at 13:28 -0400, drew wrote: > > > I read over some material regarding the opensuse.openQA goings on ... > > > > Wow, encouraging research there. > > > > > http://susestudio.org/a/EvUJ20/lo-sbs-libre-34x > > Looks pretty interesting. I have few questions: > > Is is supposed for testing of the openSUSE LO packages or the plain LO > build? *chuckling*...good question - it is currently carrying the Suse(ified) version of LibO. Vanilla (plain) LibO would make more sense and my preference. > Is the testing automatic or manual? It doesn't do any testing *yet* (I doubt [know, as the config script isn't written yet] it will even load properly today) - but when I first thought about something like this the plan was to have a set of automatic tests and then have it as a resource for manual testing. > > I wonder how to synchronize it with the other testing effort. Note that > test cases and test runs for the plain build are organized via Litmus, > see http://wiki.documentfoundation.org/QA#Function_test . Yes, I'm aware of that tool - read over the wiki pages, again, this weekend. It seemed to me that there would be a connection between the two, or to say that I would use the litmus system to document the test cases and the VM to execute them. Actually in the first incantation of thought I had planned on having a very pronounced split between a set of back end images and front end images so that one could build a testing system to cover multiple vendor releases of OO.o [1] - I did get to where I had a number of scripts working for some basic test, the scripts where all OOoBasic and exercised a set of OO.o API functions (though OpenSolaris proved bothersome and then I kind of lost my cool on the whole OO.o experience, but that is neither here nor there) - I still think this is a reasonable way to go, though I might change the scripting language from Basic to something else perhaps, in the end the API is the constant. - This API testing is IMO certainly useful but for GUI stuff I did not have a good solution. Sounds like the OpenQA system could step in here. I have some old experience with automated GUI testing tools and I have to say they never left a good taste in my mouth, primarily because of false positives, but that experience is old and hopefully much of that problem has been fixed by folks much smarter then me. > Test cases > for the openSUSE LO packages are in Testopia that is part of > https://bugzilla.novell.com. I am not sure if people outside SUSE have > access to it, though. > > Also I wonder where to report bugs. I would prefer > https://bugs.freedesktop.org/ if the bugs are in the plain build as > well. Where else? (so yes) > > > I wonder how we get the latest LibreOffice versions into there ? > > whether we build them, or install packages or something ? Bernhard > > and/or Petr - what is the easiest way to get say a nightly snapshot into > > an openSUSE virtual machine for automated / openQA testing ? > > One possibility would be to use night builds from the plain build. > Alternatively, I could try to produce nightly builds in BS. I already > have many useful scripts at hands. > so bottom line - I'm willing to put some time and effort into this - and open to suggestions on how best to integrate into what others are doing.. Best wishes, //drew [1] http://drewjensen.typepad.com/blog/2009/12/meet-sybil.html ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
On Mon, 2011-10-10 at 12:36 +0200, Petr Mladek wrote: > Is is supposed for testing of the openSUSE LO packages or > the plain LO build? The plain build I suggest. > Is the testing automatic or manual? Automatic via openQA (which is awesome but well hidden ;-) > Also I wonder where to report bugs. I would prefer > https://bugs.freedesktop.org/ if the bugs are in the plain > build as well. Sounds reasonable to me. > One possibility would be to use night builds from the plain build. Yep; I guess we could prolly openQA script their download / install. Thanks ! Michael. -- michael.me...@suse.com <><, Pseudo Engineer, itinerant idiot ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
On Mon, 2011-10-10 at 11:49 +0100, Caolán McNamara wrote: > On Fri, 2011-10-07 at 20:49 +0100, Michael Meeks wrote: > > Hi Drew, > > > > On Fri, 2011-10-07 at 13:28 -0400, drew wrote: > > > I read over some material regarding the opensuse.openQA goings on ... > > > > Wow, encouraging research there. > > > > > http://susestudio.org/a/EvUJ20/lo-sbs-libre-34x > > > > Cool :-) > > > > > -- Address book sources for mail-merge testing > > > --- Evolution > > > --- Thunderbird > > > > I suspect both of these are quite flaky; at least - the mail-merge > > stuff is pretty hideous wrt. blocking the UI and so on IIRC but good to > > make sure it gets no worse. > > Put "fakemail" onto that test VM as well, i.e. a data sink for email > mailmerging lots of emails without running them through a real mail > server. Ah, yes, excellent - grabbed the python 1.0 version from SourceForge and added it. Thanks //drew ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
On Fri, 2011-10-07 at 20:49 +0100, Michael Meeks wrote: > Hi Drew, > > On Fri, 2011-10-07 at 13:28 -0400, drew wrote: > > I read over some material regarding the opensuse.openQA goings on ... > > Wow, encouraging research there. > > > http://susestudio.org/a/EvUJ20/lo-sbs-libre-34x > > Cool :-) > > > -- Address book sources for mail-merge testing > > --- Evolution > > --- Thunderbird > > I suspect both of these are quite flaky; at least - the mail-merge > stuff is pretty hideous wrt. blocking the UI and so on IIRC but good to > make sure it gets no worse. Put "fakemail" onto that test VM as well, i.e. a data sink for email mailmerging lots of emails without running them through a real mail server. C. ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
Hi, I add Yi Fan into CC who actively works on LO QA. Michael Meeks píše v Pá 07. 10. 2011 v 20:49 +0100: > Hi Drew, > > On Fri, 2011-10-07 at 13:28 -0400, drew wrote: > > I read over some material regarding the opensuse.openQA goings on ... > > Wow, encouraging research there. > > > http://susestudio.org/a/EvUJ20/lo-sbs-libre-34x Looks pretty interesting. I have few questions: Is is supposed for testing of the openSUSE LO packages or the plain LO build? Is the testing automatic or manual? I wonder how to synchronize it with the other testing effort. Note that test cases and test runs for the plain build are organized via Litmus, see http://wiki.documentfoundation.org/QA#Function_test . Test cases for the openSUSE LO packages are in Testopia that is part of https://bugzilla.novell.com. I am not sure if people outside SUSE have access to it, though. Also I wonder where to report bugs. I would prefer https://bugs.freedesktop.org/ if the bugs are in the plain build as well. > I wonder how we get the latest LibreOffice versions into there ? > whether we build them, or install packages or something ? Bernhard > and/or Petr - what is the easiest way to get say a nightly snapshot into > an openSUSE virtual machine for automated / openQA testing ? One possibility would be to use night builds from the plain build. Alternatively, I could try to produce nightly builds in BS. I already have many useful scripts at hands. Best Regards, Petr ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Re: [Libreoffice-qa] db test VM (was: automated testing of Base)
Hi Drew, On Fri, 2011-10-07 at 13:28 -0400, drew wrote: > I read over some material regarding the opensuse.openQA goings on ... Wow, encouraging research there. > http://susestudio.org/a/EvUJ20/lo-sbs-libre-34x Cool :-) > -- Address book sources for mail-merge testing > --- Evolution > --- Thunderbird I suspect both of these are quite flaky; at least - the mail-merge stuff is pretty hideous wrt. blocking the UI and so on IIRC but good to make sure it gets no worse. > -- File based data sources > --- SQLite 3 > --- dBase > --- embedded ODB files Great, the rest seems really ideal. > *chuckle*...alright that likely just causes head scratching..but I'll > work on some test data today, update the image definition and do another > build and the wiki page as I do - hopefully doing a better job of > explaining what I'm thinking ... along with thoughts/questions I have > about test scripts, perhaps this can lead to something that would work > in the OpenQA environ, but it not that's ok..this is an itch that I;ve > had and time to scratch... I wonder how we get the latest LibreOffice versions into there ? whether we build them, or install packages or something ? Bernhard and/or Petr - what is the easiest way to get say a nightly snapshot into an openSUSE virtual machine for automated / openQA testing ? Thanks :-) Michael. -- michael.me...@suse.com <><, Pseudo Engineer, itinerant idiot ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
[Libreoffice-qa] db test VM (was: automated testing of Base)
On Thu, 2011-10-06 at 17:13 +0200, Alexander Thurgood wrote: > Hi Terry, > > Le 06/10/11 16:40, Terrence Enger a écrit : > > I can only speak from my perspective of an "enterprise" user, and thus > possibly biased ;-) > > > Do we have a feeling for what databases are most used "for real" with > > Base? Or how they are used? > ODBC is still used as an enterprise-wide solution in many places because > of its generally good performance, usually much better than the > corresponding JDBC drivers especially with regard to OOo/LibO. The whole > Java encapsulation thing always had performance issues that ODBC simply > did not. That being said, there seem to be far more actively maintained > JDBC drivers around these days than ODBC drivers, probably because it > fell under the "write once/run anywhere" (uh-huh) motto that was touted > for years with Java development. > > > Or what open bugs are most deserving of attention? > Too many to be reasonably approached by one person in a lifetime ;-) > Just kidding, but there are quite a few, as with the other modules, and > depending on who you ask, they _all_ deserve attention (grin). > > > > How much real use is through ODBC as compared to JDBC as compared to > > built-in drivers? > Hmm, like I said, from what I have seen being used in various companies, > JDBC would appear to come out tops in usage terms because of its > platform/OS agnosticity. > > The built-in "native" ones are however highly appreciated because they > appear seamless and don't depend on Java...and on the whole their > performance rocks, whereas JDBC performance within LO dives rapidly, > depending on the release version of Java, the driver itself, and the > poor memory management within Base where everything has to be loaded and > held in memory until you write out it all back out in the IOstream to > the file. > > I had always implemented ODBC enterprise wide in earlier versions of OOo > on Linux because (1) there were no native drivers at the time, and (2) > performance was excellent with ODBC, but many ODBC solutions for some db > engines are only available for one or two OSes (for example on Mac, it > is a rather large PITA no thanks to Apple), which obviously is a serious > slug in the chest when you have heterogenous environments. That is why > the native cross-platform driver is so appealing :-) > > Obviously, all of the above just represents my small window on the world > of DB connectivity that I've either experienced, implemented or come > across in the last 20 years. Howdy Alex, Terry, et al OK - well, how about I change the subject line but not the thrust of the conversation. I read over some material regarding the opensuse.openQA goings on, and watched a video file about same...so, I'm quite dumb still with specific regards to the openQA scripting environment/tools still but if I look at the idea of a test suite for connectivity and Base module functions that I could put to use, for myslef, right now then I figure the SuseStudio server might be useful. Plus I kind of figure there must be some kind of relationship between the tool chains..maybe. Alright - so I did a little fiddling last night and this morning and started putting together a test best image: http://susestudio.org/a/EvUJ20/lo-sbs-libre-34x So what I'm thinking to do with this image definition is: 1 - a common, known, environment: [at the moment this includes] -- Address book sources for mail-merge testing --- Evolution --- Thunderbird -- File based data sources --- SQLite 3 --- dBase --- embedded ODB files -- Server based data sources --- MySQL --- Postgres 2 - pre-configured data sources --- MySQL and Postgres dump files w/schema and test data --- SQLite db file and UnixODBC config.ini file --- Evolution and Thunderbird address book test data [_not_ finished] 3 - pre-built ODB files connecting to data sources [_not_ finished] 4 - test scripts --- actually, at this point I'll copy that to a wiki page and use that as a better way to discuss what is going into this as I go http://wiki.documentfoundation.org/User:Drew/baseQA_VM *chuckle*...alright that likely just causes head scratching..but I'll work on some test data today, update the image definition and do another build and the wiki page as I do - hopefully doing a better job of explaining what I'm thinking ... along with thoughts/questions I have about test scripts, perhaps this can lead to something that would work in the OpenQA environ, but it not that's ok..this is an itch that I;ve had and time to scratch... so - took the thread a bit OT perhaps :-/ //drew ___ List Name: Libreoffice-qa mailing list Mail address: Libreoffice-qa@lists.freedesktop.org Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive:
