Re: [Zope] Removing old FileStorage backups from repozo

2005-06-27 Thread Felix Ulrich-Oltean 
On Mon, Jun 27, 2005 at 11:08:56AM -0400, Tim Peters wrote:
> [Felix Ulrich-Oltean]
> > I need to clear out old backups regularly, as there are several
> > storages which are packed every night, and so there are lots of ~2G
> > backups files around for every day.
> 
> Are you doing full backups every time?  It's surprising if you get 2GB
> of new files every day when doing incremental backups.

I used to do it weekly, but some of the storages grow to over 4G, so 
I've been doing it nightly, which keeps it around 1.8G - 2.5G during the 
course of the day.

> As Jens said, it should be safe to delete anything older than the most
> recent full backup.  Please try the patch in this collector issue:
> 
> http://www.zope.org/Collectors/Zope/1501
> 

OK, I'll give it a try.

Felix.



___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] Removing old FileStorage backups from repozo

2005-06-27 Thread Felix Ulrich-Oltean 

Hi

I'm using the repozo.py script to back up some large FileStorages, as
outlined in:

http://www.zope.org/Wikis/ZODB/FileStorageBackup

I need to clear out old backups regularly, as there are several
storages which are packed every night, and so there are lots of ~2G
backups files around for every day.

Can I just go in and delete files older than X days from the backup
directory, or will this upset repozo, which apparently keeps info
about its backup files in the .dat file?

Thanks,

Felix.

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] Re: ZODB error when trying to index object (Input/output error)

2005-06-22 Thread Felix Ulrich-Oltean 
Felix Ulrich-Oltean <[EMAIL PROTECTED]> writes:


Just to follow up on the original problem, in case someone else has
similar troubles.  It turned out that the physical disk was broken - I
couldn't even copy the files at the os level.

Felix.


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] Re: ZODB error when trying to index object (Input/output error)

2005-06-20 Thread Felix Ulrich-Oltean 
Felix Ulrich-Oltean <[EMAIL PROTECTED]> writes:

> Hi
>
> I get the following error when certain new objects are added into a
> plone site - when archetypes tries to set the UID, it asks the catalog
> for all unique values of the index "UID".  I;ve never had input/output
> errors before from the ZODB.  There's definitely enough space on the
> drive and objects are added fine - it's just that the UID is then not
> set, which breaks all sorts of Archetypes stuff.  Any ideas how I can
> hunt this one down?
>


Some further info:

I think I've found the culprits - there are 4 records which give errors like 
this:

portal.portal_catalog.uncatalog_object('/sites/cw/data/urbanr')
Traceback (most recent call last):
  File "", line 1, in ?
  File "/usr/local/zope/lib/python/Products/ZCatalog/ZCatalog.py", line 558, in 
uncatalog_object
self._catalog.uncatalogObject(uid)
  File "/usr/local/zope/lib/python/Products/ZCatalog/Catalog.py", line 411, in 
uncatalogObject
x.unindex_object(rid)
  File 
"/usr/local/zope/lib/python/Products/PluginIndexes/PathIndex/PathIndex.py", 
line 138, in unindex_object
self._index[comp][level].remove(docid)
  File "/usr/local/zope/lib/python/ZODB/Connection.py", line 597, in setstate
p, serial = self._storage.load(oid, self._version)
  File "/usr/local/zope/lib/python/ZODB/FileStorage.py", line 689, in load
return self._load(oid, version, self._index, self._file)
  File "/usr/local/zope/lib/python/ZODB/FileStorage.py", line 665, in _load
raise CorruptedDataError, h
ZODB.FileStorage.CorruptedDataError:

I'll try fsrecover on it.

Felix.


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] ZODB error when trying to index object (Input/output error)

2005-06-20 Thread Felix Ulrich-Oltean 
Hi

I get the following error when certain new objects are added into a
plone site - when archetypes tries to set the UID, it asks the catalog
for all unique values of the index "UID".  I;ve never had input/output
errors before from the ZODB.  There's definitely enough space on the
drive and objects are added fine - it's just that the UID is then not
set, which breaks all sorts of Archetypes stuff.  Any ideas how I can
hunt this one down?

Thanks,

Felix.


2005-06-20T13:15:26 ERROR(200) ZODB Couldn't load state for 0x111310
Traceback (most recent call last):
  File "/usr/local/zope/lib/python/ZODB/Connection.py", line 597, in setstate
p, serial = self._storage.load(oid, self._version)
  File "/usr/local/zope/lib/python/ZODB/FileStorage.py", line 689, in load
return self._load(oid, version, self._index, self._file)
  File "/usr/local/zope/lib/python/ZODB/FileStorage.py", line 662, in _load
h = read(DATA_HDR_LEN)
IOError: [Errno 5] Input/output error
--
2005-06-20T13:15:26 ERROR(200) Archetypes None
Traceback (most recent call last):
  File "/zope/global-products/Archetypes/Referenceable.py", line 69, in 
_register
cid = archetype_tool.registerContent(self)
  File "/zope/global-products/Archetypes/ArchetypeTool.py", line 681, in 
registerContent
cid = self._genId(object)
  File "/zope/global-products/Archetypes/ArchetypeTool.py", line 659, in _genId
keys = catalog.uniqueValuesFor('UID')
  File "/usr/local/zope/lib/python/Products/ZCatalog/ZCatalog.py", line 562, in 
uniqueValuesFor
return self._catalog.uniqueValuesFor(name)
  File "/usr/local/zope/lib/python/Products/ZCatalog/Catalog.py", line 425, in 
uniqueValuesFor
return self.getIndex(name).uniqueValues()
  File "/usr/local/zope/lib/python/Products/PluginIndexes/common/UnIndex.py", 
line 445, in uniqueValues
return tuple(self._index.keys())
  File "/usr/local/zope/lib/python/ZODB/Connection.py", line 597, in setstate
p, serial = self._storage.load(oid, self._version)
  File "/usr/local/zope/lib/python/ZODB/FileStorage.py", line 689, in load
return self._load(oid, version, self._index, self._file)
  File "/usr/local/zope/lib/python/ZODB/FileStorage.py", line 662, in _load
h = read(DATA_HDR_LEN)
IOError: [Errno 5] Input/output error

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )