Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-28 Thread Shane Hathaway
On 01/28/2011 02:21 AM, Chris Withers wrote: > Okay, so next up I restored the backup. > This time I set the batch running and *then* started the pack. > This eventually caused the POSKeyErrors to begin again. > > I'm going to have a go at knocking up a small batch script that you can > run to repr

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-28 Thread Chris Withers
On 27/01/2011 11:24, Shane Hathaway wrote: > On 01/27/2011 03:57 AM, Chris Withers wrote: >> It would also be *really* handy if zodbpack could run off a normal >> zope.conf for both logging and storage config (although, in my case, I'd >> then need to be able to specify which storage to pack, I wan

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-27 Thread Shane Hathaway
On 01/27/2011 03:57 AM, Chris Withers wrote: > It would also be *really* handy if zodbpack could run off a normal > zope.conf for both logging and storage config (although, in my case, I'd > then need to be able to specify which storage to pack, I want to avoid > packing one of them!) Please note

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-27 Thread Chris Withers
On 27/01/2011 10:47, Shane Hathaway wrote: - e2fsck -f >> >> Hmm, how do I e2fsck a mounted filesystem? > > You don't. Don't even try. :-) Yeah, I got that from the warning message it squealed when I tried ;-) I was more curious about how you'd do this if you needed to (how do you unmount /

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-27 Thread Shane Hathaway
On 01/27/2011 03:32 AM, Chris Withers wrote: > On 27/01/2011 03:15, Shane Hathaway wrote: >>> Okay, so I'll do: >>> >>> - e2fsck -f > > Hmm, how do I e2fsck a mounted filesystem? You don't. Don't even try. :-) > The MySQL filesystem could be unmounted (after I shut down MySQL!), so I > ran e2fsc

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-27 Thread Chris Withers
On 27/01/2011 10:40, Jürgen Herrmann wrote: > > i also had to up max_allowed_packet to 32M to make the tests work. Indeed, I upped to 32M and now I get no failures: Total: 420 tests, 0 failures, 0 errors in 59.173 seconds. cheers, Chris -- Simplistix - Content Management, Batch Processing & P

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-27 Thread Jürgen Herrmann
On Thu, 27 Jan 2011 10:32:09 +, Chris Withers wrote: > On 27/01/2011 03:15, Shane Hathaway wrote: >>> Okay, so I'll do: >>> >>> - e2fsck -f > > Hmm, how do I e2fsck a mounted filesystem? > > The MySQL filesystem could be unmounted (after I shut down MySQL!), > so I > ran e2fsck on it: > >

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-27 Thread Chris Withers
On 27/01/2011 03:15, Shane Hathaway wrote: >> Okay, so I'll do: >> >> - e2fsck -f Hmm, how do I e2fsck a mounted filesystem? The MySQL filesystem could be unmounted (after I shut down MySQL!), so I ran e2fsck on it: e2fsck -f /dev/sdb1 e2fsck 1.41.3 (12-Oct-2008) Pass 1: Checking inodes, blocks

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Shane Hathaway
On 01/26/2011 04:07 PM, Chris Withers wrote: > On 26/01/2011 22:38, Shane Hathaway wrote: >> The odd thing is I have seen no reports of pack issues for a long time. >> Why two at once? I still wonder if there might be no bug at all. > > I'm afraid my wondering is on the other side of that argument

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Laurence Rowe
On 26 January 2011 23:11, Chris Withers wrote: > On 26/01/2011 22:49, Laurence Rowe wrote: >> >> On 26 January 2011 21:57, Jürgen Herrmann >>  wrote: >>> >>>  is there a script or some example code to search for cross db >>>  references? >>>  i'm also eager to find out... for now i disabled my pac

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Chris Withers
On 26/01/2011 22:49, Laurence Rowe wrote: > On 26 January 2011 21:57, Jürgen Herrmann wrote: >> is there a script or some example code to search for cross db >> references? >> i'm also eager to find out... for now i disabled my packing cronjobs. > > Packing with garbage collection disabled (

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Laurence Rowe
On 26 January 2011 21:57, Jürgen Herrmann wrote: >  is there a script or some example code to search for cross db >  references? >  i'm also eager to find out... for now i disabled my packing cronjobs. Packing with garbage collection disabled (pack-gc = false) should definitely be safe. Laurence

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Shane Hathaway
On 01/26/2011 03:21 PM, Chris Withers wrote: >> Well, my case matches that case pretty exactly... >> >> MySQL 5.1, RelStorage 1.4.0... >> Anton, were you using a history-free storage? > > My guess is not. > > Shane, I went to try your suggestion: >> If you're sure you have found all of the corrupti

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Chris Withers
On 26/01/2011 21:54, Chris Withers wrote: > On 26/01/2011 21:05, Shane Hathaway wrote: >> On 01/26/2011 11:52 AM, Chris Withers wrote: >>> On 26/01/2011 14:08, Shane Hathaway wrote: I've checked in a fix in Subversion. Please try it out. I need to look at the possible pack issue recently

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Chris Withers
On 26/01/2011 21:57, Jürgen Herrmann wrote: > is there a script or some example code to search for cross db > references? > i'm also eager to find out... for now i disabled my packing cronjobs. Googling for "cross database references zodb" should give you all the necessary background. I do

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Jürgen Herrmann
On Wed, 26 Jan 2011 21:54:52 +, Chris Withers wrote: > On 26/01/2011 21:05, Shane Hathaway wrote: >> On 01/26/2011 11:52 AM, Chris Withers wrote: >>> On 26/01/2011 14:08, Shane Hathaway wrote: I've checked in a fix in Subversion. Please try it out. I need to look at the pos

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Chris Withers
On 26/01/2011 21:05, Shane Hathaway wrote: > On 01/26/2011 11:52 AM, Chris Withers wrote: >> On 26/01/2011 14:08, Shane Hathaway wrote: >>> I've checked in a fix in Subversion. Please try it out. I need to look >>> at the possible pack issue recently reported before we make a release. >> >> Where i

Re: [ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Shane Hathaway
On 01/26/2011 11:52 AM, Chris Withers wrote: > On 26/01/2011 14:08, Shane Hathaway wrote: >> I've checked in a fix in Subversion. Please try it out. I need to look >> at the possible pack issue recently reported before we make a release. > > Where is this pack issue documented/discussed? See the

[ZODB-Dev] RelStorage pack with history-free storage results in POSKeyErrors

2011-01-26 Thread Chris Withers
On 26/01/2011 14:08, Shane Hathaway wrote: > I've checked in a fix in Subversion. Please try it out. I need to look > at the possible pack issue recently reported before we make a release. Where is this pack issue documented/discussed? Also, does RelStorage have a bug tracker anywhere? I have a