[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 851 Blamelist: dobe,mj,rogerineichen,schwendinger,wichert BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 853 Blamelist: dobe,srichter BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 835 Blamelist: alecm,baijum,batlogg,darrylcousins,dobe,fdrake,jacobholm,jens,jim,jukart,mgedmin,mj,philikon,rafrombrc,rogerineichen,schwendinger,shh,srichter,timt,tseaver BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 836 Blamelist: jukart BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 709 Blamelist: dobe BUILD FAILED: failed svn sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 542 Blamelist: dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 543 Blamelist: dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 547 Blamelist: dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 551 Blamelist: dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 556 Blamelist: dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 557 Blamelist: andreasjung,dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 570 Blamelist: dobe,mj BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 571 Blamelist: baijum BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 576 Blamelist: dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 577 Blamelist: dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
[EMAIL PROTECTED] wrote: The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. This is caused by a ZODB test failure regarding blobs. zodb-dev has been alerted. -- Benji York Senior Software Engineer Zope Corporation ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 580 Blamelist: dobe BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 659 Blamelist: andreasjung,baijum,dobe,mj,srichter BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 8088 Blamelist: dobe,flox BUILD FAILED: failed svn sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7938 Blamelist: dobe,flox,jim BUILD FAILED: failed svn sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7911 Blamelist: faassen,romanofski BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7913 Blamelist: fdrake,romanofski,yusei BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7812 Blamelist: ctheune,wosc BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7718 Blamelist: fdrake BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7719 Blamelist: fdrake BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7720 Blamelist: fdrake BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7731 Blamelist: alecm,fdrake,jim,srichter BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7533 Blamelist: flox BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7534 Blamelist: flox BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7538 Blamelist: flox BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 7081 Blamelist: regebro BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 6930 Blamelist: batlogg,jukart,mkashkin,philikon BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 6817 Blamelist: efge,mj,tim_one BUILD FAILED: failed test_2 sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 6532 Blamelist: jim,philikon,tseaver BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 6312 Blamelist: hdima,jens BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
Tim Peters wrote at 2006-6-17 14:50 -0400: ... The problem arises because what _Python_ calls int is what C calls long, but the I-flavor BTree code stores C int, and C int doesn't correspond to any Python type (except by accident on 32-bit boxes). Why not simply change this, i.e. let BTree use what Python calls an int (i.e. a C long). Of course, we need to be a bit careful, when we load pickles. They might have been written by applications with a longer C long than we have. But, this problem we have anyway (independent of BTrees). -- Dieter ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
Hi, Tim Peters wrote: [Christian] Thanks for the clarification, Tim! You're welcome :-) Due to the possible future use of 64-bit BTrees, I'm inclined to go for the 2-character fix for now and possibly remove it once we hit 64-bit everywhere. Yupp. If we remember ... ;) The BTree bug and the intid bug are quite distinct. intid should be repaired regardless, and is easy to repair. The only reason the BTree bug got sucked into this is because an overly-elaborate way of repairing the intid bug bashed into the BTree bug (the elaborate initd fix reasonably assumed that Ix BTrees would complain if you tried to store a key they can't actually handle, but in fact they don't always complain). All the _simple_ ways of repairing intid avoid the BTree bug. Which is ok with me ... and is what I did. In a 64-bit-everywhere world, presumably intid will want to change to use an id range substantially larger than 31 bits anyway. BTW, note that the simple intid fixes are essentially untestable, and for the same reason you can't actually write a convincing test now that _shows_ that the current (pre-patch) intid is buggy. There are only 2 return values (out of 2**31+1 current possible outcomes) that create a problem, so it's a one-in-a-billion chance of screwing up. The simple fixes just remove (exactly) those two problem cases. It's trivial to prove that the current intid has that bug, and substantially harder to prove that the 2-character fix repairs it (but trivial to prove that my original suggestion repairs it), but it's very much harder to write a test showing either the bug or its absence. Right. The test that I wrote merely checks that the border case of 2**31-1 is applied correctly and assumes all smaller numbers to work fine. :) This finally works on 32- and 64-bit machines. Christian -- gocept gmbh co. kg - forsterstraße 29 - 06112 halle/saale - germany www.gocept.com - [EMAIL PROTECTED] - phone +49 345 122 9889 7 - fax +49 345 122 9889 1 - zope and plone consulting and development ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
[Christian Theune] Hah. Looks like BTrees can accept 2**31 on machines where maxint is a larger ... Note that accept in this case means silently loses the most-significant bits, and that's a BTree bug on platforms where sizeof(long) sizeof(int): http://www.zope.org/Collectors/Zope/1592 2**31 doesn't actually lose any bits when you store it, but it will probably misinterpret the high-order data bit as the sign bit when you fetch it again, magically changing it into -2**31. As we hardcoded the search space to 2**31, I made the test check whether btrees accept the number or not and differ in the expected results. Should work on that 64bit machine now too. Did you see my simpler suggestion for fixing the underlying bug (it was a one-liner change to the original code)? When you get tired of fighting the 64-bit BTree bug here (it will be a minor miracle if the test actually passes now on a 64-bit box, despite all you've tried ...), look that up ;-) ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
Hi, thanks Tim, for the partial enlightenment. :) Unfortunately my BTree/C-wisdom is much much smaller than yours, so I got to check a couple of assumptions over here. :) Tim Peters wrote: [Christian Theune] Hah. Looks like BTrees can accept 2**31 on machines where maxint is a larger ... Note that accept in this case means silently loses the most-significant bits, and that's a BTree bug on platforms where sizeof(long) sizeof(int): http://www.zope.org/Collectors/Zope/1592 I was able to reproduce this on an Intel 64-Bit machine (EM64T) running Linux and gcc. For one: I didn't see any compiler warnings. That sounds bad, right? 2**31 doesn't actually lose any bits when you store it, but it will probably misinterpret the high-order data bit as the sign bit when you fetch it again, magically changing it into -2**31. I can store 2**31 in the BTree, but the keys() method will tell you that it actually stored -2**31. As we hardcoded the search space to 2**31, I made the test check whether btrees accept the number or not and differ in the expected results. Should work on that 64bit machine now too. Did you see my simpler suggestion for fixing the underlying bug (it was a one-liner change to the original code)? When you get tired of fighting the 64-bit BTree bug here (it will be a minor miracle if the test actually passes now on a 64-bit box, despite all you've tried ...), look that up ;-) Nope, I didn't find your one-liner. :) Can you post it explicitly for my blind eyes? I think I could have made up something that made it work, but I started looking into making the BTree behave sanely. My idea was, to modify the BTree code in a way that it actually checks after the type cast whether the casted value is equal to the requested key, or alternatively try making the CHECK_KEY macro do an exact type match instead of allowing subclasses. But that wouldn't work either as 2**31 is still an int on those platforms. I'm a bit puzzled now. :) Christian -- gocept gmbh co. kg - forsterstraße 29 - 06112 halle/saale - germany www.gocept.com - [EMAIL PROTECTED] - phone +49 345 122 9889 7 - fax +49 345 122 9889 1 - zope and plone consulting and development ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
[Christian] thanks Tim, for the partial enlightenment. :) Unfortunately my BTree/C-wisdom is much much smaller than yours, so I got to check a couple of assumptions over here. :) Yup, it really helps if you have a 64-bit box to check them on. [Christian] Hah. Looks like BTrees can accept 2**31 on machines where maxint is a larger ... [Tim] Note that accept in this case means silently loses the most-significant bits, and that's a BTree bug on platforms where sizeof(long) sizeof(int): http://www.zope.org/Collectors/Zope/1592 I was able to reproduce this on an Intel 64-Bit machine (EM64T) running Linux and gcc. And I expect the same will happen on any 64-bit platform other than Win64 (which is unique, AFAICT, in leaving sizeof(long) == 4 instead of boosting it to 8). For one: I didn't see any compiler warnings. That sounds bad, right? The underlying BTree bug is assignments of the form (usually hidden in macro expansions): some_C_int = some_C_long; When sizeof(int) sizeof(long), that can silently lose information. I was really hoping that major compilers on boxes where sizeof(int) sizeof(long) would warn about that. Oh well. The problem arises because what _Python_ calls int is what C calls long, but the I-flavor BTree code stores C int, and C int doesn't correspond to any Python type (except by accident on 32-bit boxes). C int is 4 bytes on all known current 32- and 64-bit platforms, but the size of what Python calls int varies. The BTree code isn't aware of the possible mismatch, storing Python int (C long) into C int without any checking. 2**31 doesn't actually lose any bits when you store it, but it will probably misinterpret the high-order data bit as the sign bit when you fetch it again, magically changing it into -2**31. I can store 2**31 in the BTree, but the keys() method will tell you that it actually stored -2**31. Right. If it's not clear, this is because the _bit_ pattern 0x8000 is 2**31 when viewed as an 8-byte C long, but is -2**31 when viewed as a 4-byte C long. If you had, e.g., stored 2**32 instead, you would have gotten 0 back when you fetched it (the top 32 bits are simply thrown away). ... Did you see my simpler suggestion for fixing the underlying bug (it was a one-liner change to the original code)? When you get tired of fighting the 64-bit BTree bug here (it will be a minor miracle if the test actually passes now on a 64-bit box, despite all you've tried ...), look that up ;-) Nope, I didn't find your one-liner. :) Can you post it explicitly for my blind eyes? Here; it was a reply to one of the checkin messages: http://mail.zope.org/pipermail/checkins/2006-June/002395.html The key problem in the original intid code is that it used randint() instead of randrange(), theoretically allowing 2**31 to be a return value. It's _almost_ enough just to use randrange() instead. Unfortunately, that's not quite enough; see the msg for what is. It _could_ be fixed by adding 2 characters to the original, changing 2**31 to 2**31-2 (or to 0x7ffe), but that would leave it pretty mysterious ;-) I think I could have made up something that made it work, but I started looking into making the BTree behave sanely. My idea was, to modify the BTree code in a way that it actually checks after the type cast whether the casted value is equal to the requested key, or alternatively try making the CHECK_KEY macro do an exact type match instead of allowing subclasses. But that wouldn't work either as 2**31 is still an int on those platforms. I'm a bit puzzled now. :) There's potential silent information loss for both Ix-flavor BTree keys and xI-flavor BTree values. There are two robust ways to check (robust means that Python's C code has used these ways at various times for many years now without problems). Complain if: some_C_long INT_MIN || some_C_long INT_MAX or complain if (this sounds close to what you had in mind above, and is my favorite): (long)(int)some_C_long != some_C_long Because the problem is due to bogus assumptions about the relationship between C types, it's not going to help to examine Python's idea of type. Checking isn't needed (can't fail) if SIZEOF_INT == SIZEOF_LONG (Python.h supplies definitions for those macros), so there's some worth to skipping checks when that's not true. Unfortunately, C doesn't allow #if preprocessor statements _inside_ macro expansions, so the best way to do that isn't immediately clear. In short, irritiating little issues abound :-(. That's why I couldn't make time to fix it (relatively high cost with no benefit on most Zope platforms). Note that if ZODB moves to 64-bit Ix/xI BTrees on all boxes (IIRC, Jim and Fred were agitating in that direction, but suffered massive short-sighted ;-) opposition), the BTree problem would go away by magic (C int would no longer be the type of Ix keys or xI values). ___ Zope3-dev mailing list
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
Thanks for the clarification, Tim! Due to the possible future use of 64-bit BTrees, I'm inclined to go for the 2-character fix for now and possibly remove it once we hit 64-bit everywhere. Otherwise I'd agree on the fix using the comparison you mentioned: (long)(int)some_C_long != some_C_long (That would require me to activate my very rusty C-knowledge and to change and possibly break things in weird ways.) So, could somebody (Fred? Jim?) jump in here and tell me which fix they are fine to use? Christian Tim Peters wrote: [Christian] thanks Tim, for the partial enlightenment. :) Unfortunately my BTree/C-wisdom is much much smaller than yours, so I got to check a couple of assumptions over here. :) Yup, it really helps if you have a 64-bit box to check them on. [Christian] Hah. Looks like BTrees can accept 2**31 on machines where maxint is a larger ... [Tim] Note that accept in this case means silently loses the most-significant bits, and that's a BTree bug on platforms where sizeof(long) sizeof(int): http://www.zope.org/Collectors/Zope/1592 I was able to reproduce this on an Intel 64-Bit machine (EM64T) running Linux and gcc. And I expect the same will happen on any 64-bit platform other than Win64 (which is unique, AFAICT, in leaving sizeof(long) == 4 instead of boosting it to 8). For one: I didn't see any compiler warnings. That sounds bad, right? The underlying BTree bug is assignments of the form (usually hidden in macro expansions): some_C_int = some_C_long; When sizeof(int) sizeof(long), that can silently lose information. I was really hoping that major compilers on boxes where sizeof(int) sizeof(long) would warn about that. Oh well. The problem arises because what _Python_ calls int is what C calls long, but the I-flavor BTree code stores C int, and C int doesn't correspond to any Python type (except by accident on 32-bit boxes). C int is 4 bytes on all known current 32- and 64-bit platforms, but the size of what Python calls int varies. The BTree code isn't aware of the possible mismatch, storing Python int (C long) into C int without any checking. 2**31 doesn't actually lose any bits when you store it, but it will probably misinterpret the high-order data bit as the sign bit when you fetch it again, magically changing it into -2**31. I can store 2**31 in the BTree, but the keys() method will tell you that it actually stored -2**31. Right. If it's not clear, this is because the _bit_ pattern 0x8000 is 2**31 when viewed as an 8-byte C long, but is -2**31 when viewed as a 4-byte C long. If you had, e.g., stored 2**32 instead, you would have gotten 0 back when you fetched it (the top 32 bits are simply thrown away). ... Did you see my simpler suggestion for fixing the underlying bug (it was a one-liner change to the original code)? When you get tired of fighting the 64-bit BTree bug here (it will be a minor miracle if the test actually passes now on a 64-bit box, despite all you've tried ...), look that up ;-) Nope, I didn't find your one-liner. :) Can you post it explicitly for my blind eyes? Here; it was a reply to one of the checkin messages: http://mail.zope.org/pipermail/checkins/2006-June/002395.html The key problem in the original intid code is that it used randint() instead of randrange(), theoretically allowing 2**31 to be a return value. It's _almost_ enough just to use randrange() instead. Unfortunately, that's not quite enough; see the msg for what is. It _could_ be fixed by adding 2 characters to the original, changing 2**31 to 2**31-2 (or to 0x7ffe), but that would leave it pretty mysterious ;-) I think I could have made up something that made it work, but I started looking into making the BTree behave sanely. My idea was, to modify the BTree code in a way that it actually checks after the type cast whether the casted value is equal to the requested key, or alternatively try making the CHECK_KEY macro do an exact type match instead of allowing subclasses. But that wouldn't work either as 2**31 is still an int on those platforms. I'm a bit puzzled now. :) There's potential silent information loss for both Ix-flavor BTree keys and xI-flavor BTree values. There are two robust ways to check (robust means that Python's C code has used these ways at various times for many years now without problems). Complain if: some_C_long INT_MIN || some_C_long INT_MAX or complain if (this sounds close to what you had in mind above, and is my favorite): (long)(int)some_C_long != some_C_long Because the problem is due to bogus assumptions about the relationship between C types, it's not going to help to examine Python's idea of type. Checking isn't needed (can't fail) if SIZEOF_INT == SIZEOF_LONG (Python.h supplies definitions for those macros), so there's some worth to skipping checks when that's not true. Unfortunately, C doesn't allow #if preprocessor statements _inside_ macro expansions, so the
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
[Christian] Thanks for the clarification, Tim! You're welcome :-) Due to the possible future use of 64-bit BTrees, I'm inclined to go for the 2-character fix for now and possibly remove it once we hit 64-bit everywhere. The BTree bug and the intid bug are quite distinct. intid should be repaired regardless, and is easy to repair. The only reason the BTree bug got sucked into this is because an overly-elaborate way of repairing the intid bug bashed into the BTree bug (the elaborate initd fix reasonably assumed that Ix BTrees would complain if you tried to store a key they can't actually handle, but in fact they don't always complain). All the _simple_ ways of repairing intid avoid the BTree bug. In a 64-bit-everywhere world, presumably intid will want to change to use an id range substantially larger than 31 bits anyway. BTW, note that the simple intid fixes are essentially untestable, and for the same reason you can't actually write a convincing test now that _shows_ that the current (pre-patch) intid is buggy. There are only 2 return values (out of 2**31+1 current possible outcomes) that create a problem, so it's a one-in-a-billion chance of screwing up. The simple fixes just remove (exactly) those two problem cases. It's trivial to prove that the current intid has that bug, and substantially harder to prove that the 2-character fix repairs it (but trivial to prove that my original suggestion repairs it), but it's very much harder to write a test showing either the bug or its absence. ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 6187 Blamelist: ctheune BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
Re: [Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
[EMAIL PROTECTED] wrote: The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 6187 Blamelist: ctheune BUILD FAILED: failed test Hah. Looks like BTrees can accept 2**31 on machines where maxint is a larger ... As we hardcoded the search space to 2**31, I made the test check whether btrees accept the number or not and differ in the expected results. Should work on that 64bit machine now too. Christian -- gocept gmbh co. kg - forsterstraße 29 - 06112 halle/saale - germany www.gocept.com - [EMAIL PROTECTED] - phone +49 345 122 9889 7 - fax +49 345 122 9889 1 - zope and plone consulting and development ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 6189 Blamelist: ctheune BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
[Zope3-dev] buildbot failure in Zope3 trunk 2.4 FreeBSD tmiddleton
The Buildbot has detected a failed build of Zope3 trunk 2.4 FreeBSD tmiddleton. Buildbot URL: http://buildbot.zope.org/ Build Reason: changes Build Source Stamp: 6191 Blamelist: ctheune BUILD FAILED: failed test sincerely, -The Buildbot ___ Zope3-dev mailing list Zope3-dev@zope.org Unsub: http://mail.zope.org/mailman/options/zope3-dev/archive%40mail-archive.com
