Re: [Zope-dev] KGS buildbot news (zope.server failure almost explained)
On Aug 15, 2008, at 10:46 , Christophe Combelles wrote: > Jens Vagelpohl a écrit : >> On Aug 15, 2008, at 02:35 , Christophe Combelles wrote: >>> We should also probably consider waiting a bit more for the new site >>> (new.zope.org) to come up, but I don't know when it will be >>> finished. It only >>> needs some content for zope2, grok, and some other pages. >> >> I don't see the connection here. The site has nothing to do with >> these >> specific issues. > > What I mean, is that releasing zope 3.4 along with a new web site is > much much > better than releasing it alone. Honestly, I don't see any gain for either the site or Zope 3.4, only more pain by having to coordinate this. jens ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] KGS buildbot news (zope.server failure almost explained)
Jens Vagelpohl a écrit : > On Aug 15, 2008, at 02:35 , Christophe Combelles wrote: >> We should also probably consider waiting a bit more for the new site >> (new.zope.org) to come up, but I don't know when it will be >> finished. It only >> needs some content for zope2, grok, and some other pages. > > I don't see the connection here. The site has nothing to do with these > specific issues. What I mean, is that releasing zope 3.4 along with a new web site is much much better than releasing it alone. > > jens > > > > ___ > Zope-Dev maillist - Zope-Dev@zope.org > http://mail.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope ) > > ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] KGS buildbot news (zope.server failure almost explained)
On Aug 15, 2008, at 02:35 , Christophe Combelles wrote: > We should also probably consider waiting a bit more for the new site > (new.zope.org) to come up, but I don't know when it will be > finished. It only > needs some content for zope2, grok, and some other pages. I don't see the connection here. The site has nothing to do with these specific issues. jens ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] KGS buildbot news (zope.server failure almost explained)
Marius Gedminas a écrit : > On Sat, Aug 09, 2008 at 01:50:33AM +0300, Marius Gedminas wrote: >> On Sat, Aug 09, 2008 at 12:57:48AM +0300, Marius Gedminas wrote: - zope.server tests fail horribly with invalid file descriptor errors. I cannot reproduce this error in isolation (bin/test -m zope.server), but I can reproduce it when I run all the tests together. Some previous test is mucking stuff up. >> 'bin/test -m ZEO -m zope.server' is enough to reproduce this error. > > Minimal test case: > > bin/test -pvc1 -m zope.server -t testAPPE -m ZEO -t insane > > The ZEO test that breaks zope.server.ftp is > > multiple_storages_invalidation_queue_is_not_insane (ZEO.tests.testZEO) > > For completeness, the full sequence of steps is > > check out zope.release branch 3.4 > bootstrap and run buildout > bin/generate-buildout > cd test > ../bin/buildout > bin/test -pvc1 -m zope.server -t testAPPE -m ZEO -t insane thanks for isolating it, I've found a way to prevent the failure to occur! The real problem comes from the ZEO tests, I've reported it here: https://bugs.launchpad.net/zodb/+bug/257954 The final explanation is that the testrunner imports every test modules. Some tests modules located in zope.server and zope.app.server also import zope.server.dualmodechannel, which creates a pipe (a global trigger). One of the ZEO tests close this pipe although it shouldn't. When the zope.server tests happen, the pipe is already closed and the tests fail. Now, We need to: --- - release a bugfix version of zope.server 3.4.3 - release a bugfix version of zope.app.server 3.4.2 - fix z3c.formdemo and z3c.formjs against z3c.form 1.8.2 (This should be straightforward) We can also: - release a bugfix version of zope.publisher 3.4.4 that fixes an old critical bug ( https://bugs.launchpad.net/zope3/+bug/98440 ) - release a bugfix version of zc.zope3recipes 0.6.2, which fixes some problem with unwanted upgrades during tests. (although this is not needed for the sandboxed tests of KGS in the buildbot to pass) We should probably: --- - wait for setuptools 0.6c9 that fixes a major problem with subversion 1.5 - wait for the final ZODB 3.8.1. It would be good to include some fix for LP 257954 After that we are ready for a release of zope 3.4. We should also probably consider waiting a bit more for the new site (new.zope.org) to come up, but I don't know when it will be finished. It only needs some content for zope2, grok, and some other pages. Christophe > > Marius Gedminas > > > > > ___ > Zope-Dev maillist - Zope-Dev@zope.org > http://mail.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] KGS buildbot news
On Sat, Aug 09, 2008 at 01:59:49AM +0200, Sebastien Douche wrote: > On Fri, Aug 8, 2008 at 18:26, Marius Gedminas <[EMAIL PROTECTED]> wrote: > > News about the KGS buildbot at http://zope3.pov.lt/buildbot/: > > Impressive, can you show your buildbot configuration ? I want running > the same here. http://zope3.pov.lt/master.cfg Extra requirement: virtualenv.py copied to /usr/local/bin on build slaves (I didn't feel comfortable checking it into zope.release SVN or trying to teach buildbot/bootstrap to use virtualenv and then re-exec itself with a sandboxed python interpreter). Marius Gedminas -- The *REAL* Y2K is the year 2048. signature.asc Description: Digital signature ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] KGS buildbot news (zope.server failure almost explained)
On Sat, Aug 09, 2008 at 01:50:33AM +0300, Marius Gedminas wrote: > On Sat, Aug 09, 2008 at 12:57:48AM +0300, Marius Gedminas wrote: > > > - zope.server tests fail horribly with invalid file descriptor > > > errors. I cannot reproduce this error in isolation (bin/test -m > > > zope.server), but I can reproduce it when I run all the tests > > > together. Some previous test is mucking stuff up. > > 'bin/test -m ZEO -m zope.server' is enough to reproduce this error. Minimal test case: bin/test -pvc1 -m zope.server -t testAPPE -m ZEO -t insane The ZEO test that breaks zope.server.ftp is multiple_storages_invalidation_queue_is_not_insane (ZEO.tests.testZEO) For completeness, the full sequence of steps is check out zope.release branch 3.4 bootstrap and run buildout bin/generate-buildout cd test ../bin/buildout bin/test -pvc1 -m zope.server -t testAPPE -m ZEO -t insane Marius Gedminas -- Hoping the problem magically goes away by ignoring it is the "microsoft approach to programming" and should never be allowed. -- Linus Torvalds signature.asc Description: Digital signature ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] KGS buildbot news
On Fri, Aug 8, 2008 at 18:26, Marius Gedminas <[EMAIL PROTECTED]> wrote: > News about the KGS buildbot at http://zope3.pov.lt/buildbot/: Impressive, can you show your buildbot configuration ? I want running the same here. -- Seb ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] KGS buildbot news
On Sat, Aug 09, 2008 at 12:57:48AM +0300, Marius Gedminas wrote: > > - zope.server tests fail horribly with invalid file descriptor > > errors. I cannot reproduce this error in isolation (bin/test -m > > zope.server), but I can reproduce it when I run all the tests > > together. Some previous test is mucking stuff up. 'bin/test -m ZEO -m zope.server' is enough to reproduce this error. Marius Gedminas -- Change is inevitable, except from a vending machine. signature.asc Description: Digital signature ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] KGS buildbot news
On Fri, Aug 08, 2008 at 07:26:08PM +0300, Marius Gedminas wrote: > Latest test results Now updated after * nuking buildbot slave directories that had some contamination from previous contacts with system python * disabling z3c.rml tests because of missing PIL and Reportlab eggs in PyPI * upgrading zope.security and zope.proxy in the KGS to fix issues with Python2.5 on 64-bit machines Many of the errors have gone away. I'm quoting only the remaining ones > * Python 2.4, 32-bit Linux: > > - zope.server tests fail horribly with invalid file descriptor > errors. I cannot reproduce this error in isolation (bin/test -m > zope.server), but I can reproduce it when I run all the tests > together. Some previous test is mucking stuff up. > > * Pytohn 2.4, 64-bit Linux: > > - same as Python 2.4 on 32-bit Linux > > * Python 2.5, 32-bit Linux: > > - same as Python 2.4 on 32-bit Linux, plus > - z3c.form expects a certain behaviour from Exception.__repr__, > which changed in Python 2.5 > > * Python 2.5, 64-bit Linux > - same as Python 2.5 on 32-bit Linux, plus - zc.zope3recipes gets unexpected test output about upgrading zc.buildout to version 1.1.1 The nondeterministic zdaemon test did not fail during *this* buildbot run. A reminder about what it is: > - one or two zdaemon tests fail nondeterministically (the "daemon" > process, usually sleep 10 or sleep 100, exits before the test can > invoke "zdaemon stop" I can reproduce it (nondeterministically) > on various machines. I do not understand how "sleep 100" can > terminate in under 18 seconds that it takes for the tests to fail. The reproduction is simply running bin/test -m zdaemon --repeat 10. Some of the iterations see one error, some see two, some are error-free. Having a busy machine helps. Hm, better change that "helps" to "is essential", since now I cannot reproduce the bug any more. Marius Gedminas -- Unix gives you enough rope to shoot yourself in the foot. signature.asc Description: Digital signature ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] KGS buildbot news
News about the KGS buildbot at http://zope3.pov.lt/buildbot/: * all builds are done in a virtualenv sandbox uncontaminated by system python packages * the waterfall display shows a brief summary (ntests/errors/failures) * there are short logs with summaries only (lists of tests that failed, had errors, or could not be imported) * there are bookmarkable links to the latest summaries (and logs) at http://zope3.pov.lt/ Latest test results * Python 2.4, 32-bit Linux: - zope.server tests fail horribly with invalid file descriptor errors. I cannot reproduce this error in isolation (bin/test -m zope.server), but I can reproduce it when I run all the tests together. Some previous test is mucking stuff up. - z3c.rml depends on PIL but doesn't express that in its setup.py. It also depends on Reportlab. Neither PIL not Reportlab can be installed as eggs from PyPI. There are working eggs for both PIL and Reportlab available on the Internet, AFAIK, but so far nobody worked with the respective upstreams to get those into PyPI. Since I don't use z3c.rml myself, and since repeated import errors for every test layer clutter the output a lot, I've disabled z3c.rml tests for now. * Pytohn 2.4, 64-bit Linux: - same as Python 2.4 on 32-bit Linux, plus - one or two zdaemon tests fail nondeterministically (the "daemon" process, usually sleep 10 or sleep 100, exits before the test can invoke "zdaemon stop" I can reproduce it (nondeterministically) on various machines. I do not understand how "sleep 100" can terminate in under 18 seconds that it takes for the tests to fail. - zope.app.apidoc, zope.app.renderer and zope.app.generations errors that end up as an ImportError: No module named roman inside a docutils. I suspect a problem in the environment and I'm tempted to rm -rf the buildout working dir and see if I can reproduce it starting from a clean state. * Python 2.5, 32-bit Linux: - same as Python 2.4 on 32-bit Linux, plus - z3c.form expects a certain behaviour from Exception.__repr__, which changed in Python 2.5 * Python 2.5, 64-bit Linux - a horrifying amount of errors (80 total), I'll retry after cleaning up the buildbot slave dir. Marius Gedminas -- C is a language that combines all the elegance and power of assembly language with all the readability and maintainability of assembly language. signature.asc Description: Digital signature ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
