[Zope] Re: Re: MemoryError exception when importing a zexp file

2007-06-04 Thread Ben Lobo

"Paul Winkler" <[EMAIL PROTECTED]> wrote in
message news:[EMAIL PROTECTED]
>
> I spent several hours recently to import a .zexp of a Plone 2.0 site.
> Got nowhere.
>
> One suggestion I got (which I wasn't able to follow) was the
> following.  If you have access to the original server, try this:
>
> 1) Make a full backup of the entire ZODB, eg. using repozo.py.
> 2) Set up a new Zope instance with all the same products installed,
> using your new backup copy of the ZODB.
> 3) Go into the ZMI for this new instance, and delete everythign EXCEPT
this
> plone site.
> 4) Pack the database to get rid of all the other stuff.  Or make a new
> clean backup.
>
> There. You now have a Data.fs that contains only your Plone site.
> Instead of importing the .zexp, just mount the database at the
> appropriate path.
>
> Disclaimer: I haven't tried this yet.

Thanks Paul. Someone else on another list also suggested this method and I
tried it and it seems to work well. To make it work, there are a couple of
additional bits that need to be followed:

...
5) Go back to the orignal Zope instance and delete the Plone site that you
want to set up the new file storage for (make a backup first)
6) Make sure that the new mount point has the same name as the original
Plone site in zope.conf

Then when you create the new ZODB mount point, it will appear in the root of
the ZMI as a Plone site just as before so there's not even any need to to
re-create the catalogue.

Cheers

Ben



___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


[Zope] Re: Re: MemoryError exception when importing a zexp file

2007-05-31 Thread Ben Lobo
> > I'm now considering exporting the Plone site (cos that's what it is) one
> > piece at a time and reimporting it into a clean Plone site. Any thoughts
on
> > whether or not this is a good idea?
>
> Not mentioning Plone in the first place is problematic. In fact *plone*
> is problematic. Did you verify with plohn people (e.g. on a Plone
> mailing list) that current plone versions can be imported/exported?
> (Because the last time I made the mistake to do a project with
> plone you couldn't import/export a plone site -- or rename it, move it
> to another instance or anything similar for that matter -- without major
> pain. It's been a while though, so things could have changed.)
> Summary: Go and ask the plone people, if you can't import anyway, the
> whole exercise is in vain.
>

I've happily moved, renamed, exported and imported Plone sites, both within
a single zope instance and between separate instances on many occasions so I
don't think Plone is the problem. The only difference in this case is the
size of the Plone site and the amount of RAM it seems to want to use.

I'm not much of an expert on diagnosing and managing memory problems so I'm
not sure how to check things like where the import failed other than by
looking at Windows task manager (it's Windows 2003 server). If there are any
OS limitations on memory usage, it's only what would normally be set up on a
standard Windows installation.

Someone in this thread asked why I'm doing this export in the first place: I
want to import it back into zope but into a separate storage file so that I
can back it up separately from the main storage. Someone suggested that I
might be able to do it by copying the entire Data.fs file to the new strage
location, restarting zope and then deleting the bits that I don't want
instead of exporting then importing.

I tried this but it didn't work unfortunately. The new mount point just
appeared in the zmi root with a broken icon and gave me an 'unsubscriptable
object type error when I tried to access it.

Any further tips would be gratefully welcomed.

Cheers

Ben



___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


[Zope] Re: MemoryError exception when importing a zexp file

2007-05-30 Thread Ben Lobo
Thanks for the tip. I tried increasing the swap file to 10GB but still got
the same memory error.

I'm now considering exporting the Plone site (cos that's what it is) one
piece at a time and reimporting it into a clean Plone site. Any thoughts on
whether or not this is a good idea?

Cheers

Ben


"Winterflood, Jonathan" wrote:
>Hi,
>
>Maybe you could try giving the machine more swap space (partition in Linux,
file in Windows)
>You'd probably have performance issues, but if the import is a one-timer,
it might be acceptable.
>
>Jonathan
>
>-Message d'origine-
>De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de
Jens Vagelpohl
>Envoyé : mardi 29 mai 2007 09:09
>À : zope list user
>Objet : Re: [Zope] MemoryError exception when importing a zexp file
>
>-BEGIN PGP SIGNED MESSAGE-
>Hash: SHA1
>
>
>On 29 May 2007, at 08:36, Ben Lobo wrote:
>
>> Hi,
>>
>> I'm trying to import a .zexp file that's 1.6GB but it continually
>> fails due
>> to a MemoryError exception. I guess that adding more RAM would
>> probably fix
>> this problem but does anyone know if there's any way of getting
>> around this
>> sort of problem without increasing the RAM?
>
>Short of increasing memory on that specific host you could also
>create a sandbox on a different machine with more RAM and then copy
>the database when it's done.
>
>jens





___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


[Zope] MemoryError exception when importing a zexp file

2007-05-28 Thread Ben Lobo
Hi,

I'm trying to import a .zexp file that's 1.6GB but it continually fails due
to a MemoryError exception. I guess that adding more RAM would probably fix
this problem but does anyone know if there's any way of getting around this
sort of problem without increasing the RAM?

This is the traceback:

 --
Site Error
An error was encountered while publishing this resource.

exceptions.MemoryError

Sorry, a site error occurred.

Traceback (innermost last):

  a.. Module ZPublisher.Publish, line 163, in publish_module_standard
  b.. Module Products.PlacelessTranslationService.PatchStringIO, line 51, in
new_publish
  c.. Module ZPublisher.Publish, line 108, in publish
  d.. Module Zope.App.startup, line 226, in abort
  e.. Module ZODB.Transaction, line 149, in abort
  f.. Module ZODB.Connection, line 474, in abort_sub
MemoryError
-- 

Thanks

Ben

-- 
Ben Lobo
Application Developer
Adaptive Technologies Ltd.
+44 (0)1273 728128
http://www.adaptivetechnologies.com




___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )