[ZODB-Dev] Re: Memory Errors reading large ZODB

2007-08-12 Thread Jim Carroll
Gary Poster wrote: you can call cache minimize after a threshold.. maybe every 100 iterations. sounds good, assuming you know you are not writing. Fantastic! My scripts are running without fail now (I used to have to change them to pick up where they left off and re-run about four

Re: [ZODB-Dev] Re: Memory Errors reading large ZODB

2007-08-02 Thread Chris Withers
Gary Poster wrote: you can call cache minimize after a threshold.. maybe every 100 iterations. sounds good, assuming you know you are not writing. I've used this trick loads, especially for huge datastructure migrations where writing is happening. I wonder why I haven't bumped into

Re: [ZODB-Dev] Re: Memory Errors reading large ZODB

2007-08-02 Thread Jim Fulton
On Aug 2, 2007, at 7:51 AM, Chris Withers wrote: Gary Poster wrote: you can call cache minimize after a threshold.. maybe every 100 iterations. sounds good, assuming you know you are not writing. I've used this trick loads, especially for huge datastructure migrations where writing is

Re: [ZODB-Dev] Re: Memory Errors reading large ZODB

2007-08-02 Thread Gary Poster
On Aug 2, 2007, at 9:33 AM, Jim Fulton wrote: On Aug 2, 2007, at 7:51 AM, Chris Withers wrote: Gary Poster wrote: you can call cache minimize after a threshold.. maybe every 100 iterations. sounds good, assuming you know you are not writing. I've used this trick loads, especially for

Re: [ZODB-Dev] Re: Memory Errors reading large ZODB

2007-08-01 Thread Alan Runyan
snip... line 96, in __setstate__ Persistent.__setstate__(self, state) MemoryError means you have run out of memory. check your jail or how much memory you have allocated. you can call cache minimize after a threshold.. maybe every 100 iterations. there are finer grain mechanisms to do