Hi Nils,

-------- Original-Nachricht --------
> Von: Nils Fuhrmann <nils.fuhrm...@sun.com>

> Stephan Bergmann schrieb:
> > During FOSDEM, Mechtilde told me about a problem the QA community is 
> > experiencing, namely that buildbot builds (of CWSs) are quite different 
> > functionality-wise from the standard builds (of milestones and releases,
> > often done by Sun Hamburg Release Engineering).  Those differences are 
> > especially apparent in Base, Mechtilde told me.  This problem in some 
> > cases prevents easy testing of a CWS by the QA community, or even 
> > thorough testing of a CWS in real life by replacing a standard OOo build
> > with a buildbot CWS build in (semi-)production use.
> 
> I know that there were some issue regarding QA'ing buildbot builds in 
> past. To get an idea what the real problem is, we should collect those 
> issues in detail when they occur to find the root cause for them 

This is quite like going to the woods and look at each tree seperately to 
understand, what "the wood" is.

> (as we 
> always do). If those issues still are existent, I would await that this 
> list is already available somewhere (Mechtilde, do you have such list?).

There is no full list, as we would need to do several test runs on sun builds, 
compare those to testruns done on equivalent buildbot builds - identify the 
differencens ...

You will find differences due to:
- different configure settings (this is from my experience the biggest part, as 
complete functional areas might be missing)
- differnt compilers 
- different build environment
- different test environment

This would need to be done for at least all the major platforms and at least 
all cat0 tests. This is a total of some weeks for running, analyzing and 
comparing tests.


> 
> Really, we should investigate into the concrete list of issues before 
> thinking about any additional infrastructure. 

Sorry, this is the totally wrong way of thinking. 

the correct way was: How can we get more people helping in development (here 
QA) by using existing infrastructure.

We do not need *additional* infrastructure. We just want to use existing 
buildbots to help with cws testing. 
-- 
Jetzt 1 Monat kostenlos! GMX FreeDSL - Telefonanschluss + DSL 
für nur 17,95 Euro/mtl.!* http://dsl.gmx.de/?ac=OM.AD.PD003K11308T4569a

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@openoffice.org
For additional commands, e-mail: dev-h...@openoffice.org

Reply via email to