Re: [Zope] [Formulator] Anyone fixed it for Zope 2.10/2.11?

[Andy Altepeter]

On Sunday 15 November 2009 11:24:19 pm Andreas Jung wrote:
> I ported an older internal Formulator version (can't remember the version)
> to Zope 2.11 which is now working in production.

AJ, Remy -

Infrae, the current maintainer of Formulator, has a version of Formulator for 
Zope 2.11, which is here:
https://svn.infrae.com/Formulator/tag/Formulator-1.11.6/

And, and unreleased version for 2.12:
https://svn.infrae.com/Formulator/trunk

Andy



> 
> -aj
> 
> Am 16.11.09 03:09, schrieb Remy Pinsonnault:
> > I have the same problem, anybody has Formulator working on modern Zope
> > version?
> >
> > On Fri, Jul 3, 2009 at 6:56 AM, Andreas Jung  > > wrote:
> >
> > We have a project where we are using Formulator under CMF 1.X +
> > Zope 2.8.
> > Unfortunately Formulator seems to horribly broken Zope 2.11.
> > Has anyone worked on making Formulator working with some modern
> > Zope/CMF
> > version?
> >
> > Andreas
> >
> > --
> > ZOPYX Ltd. & Co. KG - Charlottenstr. 37/1 - 72070 Tübingen - Germany
> > Web: www.zopyx.com  - Email: i...@zopyx.com
> >  - Phone +49 - 7071 - 793376
> > Registergericht: Amtsgericht Stuttgart, Handelsregister A 381535
> > Geschäftsführer/Gesellschafter: ZOPYX Limited, Birmingham, UK
> >
> > 
> > E-Publishing, Python, Zope & Plone development, Consulting
> >
> >
> >
> > ___
> > Zope maillist  -  Zope@zope.org 
> > http://mail.zope.org/mailman/listinfo/zope
> > **   No cross posts or HTML encoding!  **
> > (Related lists -
> >  http://mail.zope.org/mailman/listinfo/zope-announce
> >  http://mail.zope.org/mailman/listinfo/zope-dev )
> 
___
Zope maillist  -  Zope@zope.org
https://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] zope unresponsive

[Andy Altepeter]

Hey All,

I'm experiencing hanging issues with my Zope-2.8.6+zeo setup/ RHEL 4. The 
hanging isn't categorized by 100% cpu usage. Actually, I had the same issues 
using 2.8.5, but I've upgraded since then.  Here's the situation:

I have one zeo client connected to a zeo server on the same box.  Apache sits 
in front, using RewriteRules to request data from zope.

After some time (could be 2 minutes or an hour), the zeo client stops 
responding.  Apparently this is called a deadlock or a "spinning zope".

I've tried using gdb to attach to the zeo client pid, and use the recipe 
http://zopelabs.com/cookbook/1073504990 to print a traceback, but the call 
always aborted with SIGABORT. 

I've captured all of the requests sent to zope during an uptime window (via 
Z2.log), and using wget to "replay" the requests.  I've also pulled from 
apache's rewrite log all requests proxied to zope, thinking the Z2.log only 
writes finished requests.  I setup another zeo client (on the same box, 
different port) and used wget to replay these captures as well.  Just running 
these captures does not cause zope to hang.  In fact, I have not been able to 
cause zope to hang by replaying.  There doesn't seem to be any one url or 
sequence of urls that cause zope to hang.

I've tried reinstalling the zope instance, but that didn't help.

I've tried using requestprofiler.py to inspect the trace.log.  This shows a 
high number of "hangs", but not on a url that actually triggers a spinning 
zope.

Basically, that's where I'm stuck.  Is there anything else I can try?  Am I 
missing something?

Thanks for the help,
Andy
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] HTML to PDF.

[Andy Altepeter]

On Wednesday 16 November 2005 02:07 pm, Fernando Lujan wrote:
> Does Anyone has this product in a production environment?
>
> It's easy to configure and stuff? We currently are working with the
> reportlab, but it's painful to change the document... :(  I need a
> product which generates a PDF file on the fly. Any other application or
> suggestion will be welcome.

I know of Prince, which translates any xml+css document into a pdf.  Very 
nice, but it isn't free.  This isn't an ad, but we've demoed it, and I 
believe it very easy to integrate into Zope.  Here's the url:
http://www.princexml.com/

Andy

>
> Thanks,
>
> Fernando Lujan
>
>
> ___
> Zope maillist  -  Zope@zope.org
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] bad ZCatalog behavior

[Andy Altepeter]

On Wednesday 10 August 2005 04:32 pm, Dieter Maurer wrote:
> Andy Altepeter wrote at 2005-8-8 08:15 -0500:
> >There seems to be a problem with my ZCatalog, and it seems to be getting
> > worse as time goes by.
> > ...
> >  Module ZODB.Connection, line 562, in setstate
> >  Module ZODB.Connection, line 601, in _set_ghost_state
> >AttributeError: 'str' object has no attribute 'append'
>
> In fact, this looks like a broken pickle in your ZODB storage (and
> not like a ZCatalog problem).

I think I've fixed this issue, but for future reference, is there any way to 
remove a broken pickle?
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] fsrecover.py won't pack

[Andy Altepeter]

Hi Tim,

Thank you for your response.  fsrefs.py raised the same error I reported 
earlier about unpickling.  I ended up:
1) Creating a new instance_home using zope-2.5.0-final
2) using zopectl debug connected to the bad database, I exported all my 
objects.  For folders that couldn't be exported, I started 'drilling down' 
until I found the object that was causing problems.  There were about 5 such 
objects in my database.
 - Some objects (folderish) could be exported, but then would raise a POSKey 
error upon import, so I drilled down in those folders as well.
3) I imported each .zexp into the new database.

This process was time consuming, but it appears to have recreated the ZODB in 
a sane state.  I think it's time to look into using repozo for backups ;-)

Andy

On Monday 08 August 2005 05:45 pm, Tim Peters wrote:
> [Andy Altepeter]
>
> > I ran fsrecover.py on a copy of my Data.fs.  It found no errors, but then
> > when it attempted to pack the file, it raised an unpickleable error, with
> > this traceback:
>
> ...
>
> >  File "/export1/Zope-2.7.5-final/lib/python/ZODB/referencesf.py", line
> > 38, in referencesf
> >raise ValueError, 'Error unpickling, %s' % p
> > ValueError: Error unpickling, and the rest is presumably the pickle.
> >
> > I receive this same error when trying to pack using the ZMI.  Any idea
> > what's going on?
>
> It suggests data corruption in your Data.fs file (assuming you're
> using FileStorage).  Please read this for background info:
>
> http://zope.org/Wikis/ZODB/FileStorageBackup
>
> Because fsrecover.py completed without error, best guess is that
> fstest.py (described in the link above) would also complete without
> error.  However, neither of those can detect "higher-level" corruption
> inside serialized object state (see the link for more words).  Running
> fsrefs.py (see the link again) can identify most such corruption.  So
> run it and see what it says.  There is no wholly safe and automatic
> way to recover from frsrefs.py-level corruption (short of reverting to
> a good backup), so don't expect this to go easily.
>
> Note that better versions of these tools exist in more recent versions
> of ZODB (IIRC, you said you were running Zope-2.7.2, which corresponds
> to ZODB 3.2.3 -- ZODB 3.2.9 is the current production 3.2 release).
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] fsrecover.py won't pack

[Andy Altepeter]

follow-up from my post earlier today:

I ran fsrecover.py on a copy of my Data.fs.  It found no errors, but then when 
it attempted to pack the file, it raised an unpickleable error, with this 
traceback:

Traceback (most recent call last):
  File "fsrecover.py", line 374, in ?
main()
  File "fsrecover.py", line 243, in main
recover(inp, outp, verbose, partial, force, pack)
  File "fsrecover.py", line 369, in recover
ofs.pack(pack, referencesf)
  File "/export1/Zope-2.7.5-final/lib/python/ZODB/FileStorage.py", line 1582, 
in pack
opos = p.pack()
  File "/export1/Zope-2.7.5-final/lib/python/ZODB/fspack.py", line 700, in 
pack
self.gc.findReachable()
  File "/export1/Zope-2.7.5-final/lib/python/ZODB/fspack.py", line 456, in 
findReachable
self.findReachableAtPacktime([z64])
  File "/export1/Zope-2.7.5-final/lib/python/ZODB/fspack.py", line 531, in 
findReachableAtPacktime
todo.extend(self.findrefs(pos))
  File "/export1/Zope-2.7.5-final/lib/python/ZODB/fspack.py", line 604, in 
findrefs
return referencesf(self._file.read(dh.plen))
  File "/export1/Zope-2.7.5-final/lib/python/ZODB/referencesf.py", line 38, in 
referencesf
raise ValueError, 'Error unpickling, %s' % p
ValueError: Error unpickling, and the rest is presumably the pickle.

I receive this same error when trying to pack using the ZMI.  Any idea what's 
going on?

Thanks for the help,
Andy

On Monday 08 August 2005 08:15 am, Andy Altepeter wrote:
> Hi there,
>
> There seems to be a problem with my ZCatalog, and it seems to be getting
> worse as time goes by.  When my CatalogPathAware objects unindex
> themselves, sometimes I get an attribute error like:
>
> AttributeError: 'str' object has no attribute 'append'
>
> Traceback (innermost last):
>   Module ZPublisher.Publish, line 101, in publish
>   Module ZPublisher.mapply, line 88, in mapply
>   Module ZPublisher.Publish, line 39, in call_object
>   Module Products.FileSystemSite.FSPythonScript, line 104, in __call__
>   Module Shared.DC.Scripts.Bindings, line 306, in __call__
>   Module Shared.DC.Scripts.Bindings, line 343, in _bindAndExec
>   Module Products.FileSystemSite.FSPythonScript, line 160, in _exec
>   Module None, line 33, in tab_status_approve
>-  at /silva/service_views/Silva/edit/VersionedContent/tab_status_approve used
> for /silva/service_views/SilvaDocument/edit/VersionedContent/Document>
>- Line 33
>   Module Products.Silva.Versioning, line 125, in approve_version
>   Module Products.Silva.Versioning, line 512, in _update_publication_status
>   Module Products.Silva.VersionedContent, line 334, in _unindex_version
>   Module Products.Silva.Version, line 191, in unindex_object
>   Module Products.ZCatalog.ZCatalog, line 558, in uncatalog_object
>   Module Products.ZCatalog.Catalog, line 411, in uncatalogObject
>   Module Products.ZCTextIndex.ZCTextIndex, line 181, in unindex_object
>   Module Products.ZCTextIndex.OkapiIndex, line 68, in unindex_doc
>   Module Products.ZCTextIndex.BaseIndex, line 176, in unindex_doc
>   Module Products.ZCTextIndex.BaseIndex, line 303, in _del_wordinfo
>   Module ZODB.Connection, line 562, in setstate
>   Module ZODB.Connection, line 601, in _set_ghost_state
> AttributeError: 'str' object has no attribute 'append'
>
> In the logfile, the last line of code is shown in the traceback:
>   File "/export1/Zope-2.7.2-0/lib/python/ZODB/Connection.py", line 601, in
> _set_ghost_state
> state = unpickler.load()
>
> Perhaps this is a ZEO issue.  I'm using Zope-2.7.2-0 with ZEO.  Both the
> zeo server and the client are on the same box.  The zeo logfile reports no
> errors when this occurs.
>
> Any ideas why this may be happening?
> ___
> Zope maillist  -  Zope@zope.org
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] bad ZCatalog behavior

[Andy Altepeter]

Hi there,

There seems to be a problem with my ZCatalog, and it seems to be getting worse 
as time goes by.  When my CatalogPathAware objects unindex themselves, 
sometimes I get an attribute error like:

AttributeError: 'str' object has no attribute 'append' 

Traceback (innermost last):
  Module ZPublisher.Publish, line 101, in publish
  Module ZPublisher.mapply, line 88, in mapply
  Module ZPublisher.Publish, line 39, in call_object
  Module Products.FileSystemSite.FSPythonScript, line 104, in __call__
  Module Shared.DC.Scripts.Bindings, line 306, in __call__
  Module Shared.DC.Scripts.Bindings, line 343, in _bindAndExec
  Module Products.FileSystemSite.FSPythonScript, line 160, in _exec
  Module None, line 33, in tab_status_approve
   - 
   - Line 33
  Module Products.Silva.Versioning, line 125, in approve_version
  Module Products.Silva.Versioning, line 512, in _update_publication_status
  Module Products.Silva.VersionedContent, line 334, in _unindex_version
  Module Products.Silva.Version, line 191, in unindex_object
  Module Products.ZCatalog.ZCatalog, line 558, in uncatalog_object
  Module Products.ZCatalog.Catalog, line 411, in uncatalogObject
  Module Products.ZCTextIndex.ZCTextIndex, line 181, in unindex_object
  Module Products.ZCTextIndex.OkapiIndex, line 68, in unindex_doc
  Module Products.ZCTextIndex.BaseIndex, line 176, in unindex_doc
  Module Products.ZCTextIndex.BaseIndex, line 303, in _del_wordinfo
  Module ZODB.Connection, line 562, in setstate
  Module ZODB.Connection, line 601, in _set_ghost_state
AttributeError: 'str' object has no attribute 'append'

In the logfile, the last line of code is shown in the traceback:
  File "/export1/Zope-2.7.2-0/lib/python/ZODB/Connection.py", line 601, in 
_set_ghost_state
state = unpickler.load()

Perhaps this is a ZEO issue.  I'm using Zope-2.7.2-0 with ZEO.  Both the zeo 
server and the client are on the same box.  The zeo logfile reports no errors 
when this occurs.

Any ideas why this may be happening?
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )