On Jun 16, 1:08 am, [EMAIL PROTECTED] wrote: > On Jun 15, 3:16 am, John Machin <[EMAIL PROTECTED]> wrote: > > > But that change went into the svn trunk on 11-May-2008; perhaps the OP > > is using a production release which would have the previous version, > > which is merely "newsize = size + 1024;". > > > Do people really generate 32MB pyc files, or is stopping doubling at > > 32MB just a safety valve in case someone/something runs amok? > > Indeed. I (the OP) am using a production release which has the 1k > linear growth. > I am seeing the problems with ~5MB and ~10MB sizes. > Apparently this will be improved greatly in Python 2.6, at least up to > the 32MB limit.
Apparently you intend to resist good advice and persist [accidental pun!] with marshal -- how much slower is cPickle for various sizes of data? What kinds of objects are you persisting? -- http://mail.python.org/mailman/listinfo/python-list