[ZODB-Dev] Splitting a large ZODB file storage - any light-weight approach?

2009-12-29 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi there,

we have some huge ZODB file storage (60-80 GB each) and we want
to split the storage into a number of smaller storage (easier
to handle for backup and packing). The storages themselves only
contain a few (Zope 2) folders  - let's say folders A, B, C -
within the root and we want to create seperate storages for A, B, C.

Is there some easier approach than using the Zope 2 CopyManager API
for moving data around. The ZODB storage iterator API comes to my mind...
is this a suitable approach or is there some other light-weight approach
(compared to using CopyManager API)?

Andreas
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAks7CCwACgkQCJIWIbr9KYxZTgCcDU2ouwg2/WJk5Zkre4u1C1ZJ
qzYAnRxtVYUsumoPdPowodwCqNNJpoBH
=50VP
-END PGP SIGNATURE-

<>___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zodb-dev


Re: [ZODB-Dev] Splitting a large ZODB file storage - any light-weight approach?

2009-12-30 Thread Alan Runyan
> we have some huge ZODB file storage (60-80 GB each) and we want
> to split the storage into a number of smaller storage (easier
> to handle for backup and packing). The storages themselves only
> contain a few (Zope 2) folders  - let's say folders A, B, C -
> within the root and we want to create seperate storages for A, B, C.
>
> Is there some easier approach than using the Zope 2 CopyManager API
> for moving data around. The ZODB storage iterator API comes to my mind...
> is this a suitable approach or is there some other light-weight approach
> (compared to using CopyManager API)?
>

ExportImport module?
http://svn.zope.org/ZODB/trunk/src/ZODB/ExportImport.py

At one point I suggested a feature for Zope 2 which would be "Export as
Mounted Storage".
Which could generate a database with your exported content in it.  So you
could simply
wire up the new storage in .conf file, delete the original and remount it
with ZMI.
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zodb-dev


Re: [ZODB-Dev] Splitting a large ZODB file storage - any light-weight approach?

2010-01-04 Thread Rafael Monnerat

You can take a loot into:

http://svn.erp5.org/erp5/trunk/utils/zodb-cutter/

Seems a tool for what you want to do.

Regards, 

Rafael Monnerat

Em Wed, 30 Dec 2009 08:58:36 +0100
Andreas Jung  escreveu:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
> 
> Hi there,
> 
> we have some huge ZODB file storage (60-80 GB each) and we want
> to split the storage into a number of smaller storage (easier
> to handle for backup and packing). The storages themselves only
> contain a few (Zope 2) folders  - let's say folders A, B, C -
> within the root and we want to create seperate storages for A, B, C.
> 
> Is there some easier approach than using the Zope 2 CopyManager API
> for moving data around. The ZODB storage iterator API comes to my
> mind... is this a suitable approach or is there some other
> light-weight approach (compared to using CopyManager API)?
> 
> Andreas
> -BEGIN PGP SIGNATURE-
> Version: GnuPG v1.4.10 (Darwin)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
> 
> iEYEARECAAYFAks7CCwACgkQCJIWIbr9KYxZTgCcDU2ouwg2/WJk5Zkre4u1C1ZJ
> qzYAnRxtVYUsumoPdPowodwCqNNJpoBH
> =50VP
> -END PGP SIGNATURE-
> 

___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zodb-dev