[Zope-dev] Zope 2.12: mkzopeinstance, runzope and zopectl - a small proposal
Hi! SOFTWARE_HOME no longer exist in Zope 2.12, all the software is now somewhere on sys.path. So this no longer works in zopectl: ZDCTL="$SOFTWARE_HOME/Zope2/Startup/zopectl.py" exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@" Therefore mkzopeinstance now creates something like this: ZDCTL="/path/to/eggs/Zope2-2.12.0b3-py2.5-linux-i686.egg/Zope2/Startup/zopectl.py" exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@" Problem: - the code in mkzopeinstance.py that looks up the Zope2 path fails on some platforms - if the software is updated, you have to change the paths in runzope and zopectl of each instance Solution: - 1.) Add two new entry points in setup.py: runzope=Zope2.Startup.run:run zopectl=Zope2.Startup.zopectl:run If the software is installed, executable runzope and zopectl files are created in the bin directory. That should work with zc.buildout and with easy_install. 2.) Modify the runzope and zopectl files created by mkzopeinstance: The result should look like this: ZDCTL="/path/to/install/bin/zopectl" exec "$ZDCTL" -C "$CONFIG_FILE" "$@" mkzopeinstance would make the assumption that executable runzope and zopectl files exist in the same directory as mkzopeinstance itself. Risks: -- - mkzopeinstance has a --python option. The specified Python interpreter will no longer be used to execute runzope or zopectl. - uses cases might exist that no longer work after that change Any thoughts? Is the 2.12 branch still open for changes like that? Cheers, Yuppie ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope 2.12: mkzopeinstance, runzope and zopectl - a small proposal
On 7/23/09 12:10 PM, yuppie wrote: > Hi! > > > SOFTWARE_HOME no longer exist in Zope 2.12, all the software is now > somewhere on sys.path. > > So this no longer works in zopectl: > > ZDCTL="$SOFTWARE_HOME/Zope2/Startup/zopectl.py" > exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@" > > Therefore mkzopeinstance now creates something like this: > > ZDCTL="/path/to/eggs/Zope2-2.12.0b3-py2.5-linux-i686.egg/Zope2/Startup/zopectl.py" > exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@" > > > Problem: > > > - the code in mkzopeinstance.py that looks up the Zope2 path fails on > some platforms > > - if the software is updated, you have to change the paths in runzope > and zopectl of each instance > > > Solution: > - > > 1.) Add two new entry points in setup.py: > > runzope=Zope2.Startup.run:run > zopectl=Zope2.Startup.zopectl:run > > If the software is installed, executable runzope and zopectl files are > created in the bin directory. That should work with zc.buildout and with > easy_install. > > 2.) Modify the runzope and zopectl files created by mkzopeinstance: > > The result should look like this: > > ZDCTL="/path/to/install/bin/zopectl" > exec "$ZDCTL" -C "$CONFIG_FILE" "$@" > > mkzopeinstance would make the assumption that executable runzope and > zopectl files exist in the same directory as mkzopeinstance itself. > > > Risks: > -- > > - mkzopeinstance has a --python option. The specified Python interpreter > will no longer be used to execute runzope or zopectl. > > - uses cases might exist that no longer work after that change > > > > Any thoughts? Is the 2.12 branch still open for changes like that? +1 Wichert. ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] POSKeyError how to remove
Hi, Using Zope Debug Console, I used a part of the code fsrefs.py to find the oid's of POSKeyError: fs = FileStorage(path, read_only=1) undone = {} noload = {} for oid in fs._index.keys(): try: data, serial = fs.load(oid, "") except (KeyboardInterrupt, SystemExit): raise except POSKeyError: undone[oid] = 1 except: if VERBOSE: traceback.print_exc() noload[oid] = 1 This gave me one oid.Then I tried something like below : obj = app._p_jar[oid] But this gave me another POSKeyError instead :( Why does this happen? How can I delete this object. Thanks, Roopesh ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] POSKeyError how to remove
The object is already gone. It's odd that it is in the index. You can try deleting the object from the index and then saving the index. You might need to use ZODB 3.9 to do that, as I think __del__ was only recently added to file-storage indexes. Jim On Thu, Jul 23, 2009 at 6:57 AM, Rupesh P Raj wrote: > Hi, > > Using Zope Debug Console, I used a part of the code fsrefs.py to find the > oid's of POSKeyError: > > fs = FileStorage(path, read_only=1) > undone = {} > > noload = {} > > for oid in fs._index.keys(): > try: > data, serial = fs.load(oid, "") > except (KeyboardInterrupt, SystemExit): > raise > except POSKeyError: > undone[oid] = 1 > except: > if VERBOSE: > traceback.print_exc() > noload[oid] = 1 > > This gave me one oid.Then I tried something like below : > > obj = app._p_jar[oid] > > But this gave me another POSKeyError instead :( > > Why does this happen? How can I delete this object. > > Thanks, > Roopesh > ___ > Zope-Dev maillist - zope-...@zope.org > http://mail.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope ) > > -- Jim Fulton ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] POSKeyError how to remove
Hi Jim, But I am using ZODB 3.4.4 :( Are there any other options? How can I find where this invalid object is being referenced? Will something like packing resolve this? Thanks, Roopesh On Thu, Jul 23, 2009 at 4:45 PM, Jim Fulton wrote: > The object is already gone. It's odd that it is in the index. > You can try deleting the object from the index and then saving the > index. You might need to use ZODB 3.9 to do that, as I think __del__ > was only recently added to file-storage indexes. > > Jim > > On Thu, Jul 23, 2009 at 6:57 AM, Rupesh P Raj > wrote: > > Hi, > > > > Using Zope Debug Console, I used a part of the code fsrefs.py to find the > > oid's of POSKeyError: > > > > fs = FileStorage(path, read_only=1) > > undone = {} > > > > noload = {} > > > > for oid in fs._index.keys(): > > try: > > data, serial = fs.load(oid, "") > > except (KeyboardInterrupt, SystemExit): > > raise > > except POSKeyError: > > undone[oid] = 1 > > except: > > if VERBOSE: > > traceback.print_exc() > > noload[oid] = 1 > > > > This gave me one oid.Then I tried something like below : > > > > obj = app._p_jar[oid] > > > > But this gave me another POSKeyError instead :( > > > > Why does this happen? How can I delete this object. > > > > Thanks, > > Roopesh > > ___ > > Zope-Dev maillist - Zope-Dev@zope.org > > http://mail.zope.org/mailman/listinfo/zope-dev > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://mail.zope.org/mailman/listinfo/zope-announce > > http://mail.zope.org/mailman/listinfo/zope ) > > > > > > > > -- > Jim Fulton > ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Zope Tests: 3 OK, 5 Failed
Summary of messages to the zope-tests list. Period Wed Jul 22 12:00:00 2009 UTC to Thu Jul 23 12:00:00 2009 UTC. There were 8 messages: 8 from Zope Tests. Test failures - Subject: FAILED (failures=1) : Zope-2.12 Python-2.6.2 : Linux From: Zope Tests Date: Wed Jul 22 20:53:18 EDT 2009 URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012122.html Subject: FAILED (failures=1) : Zope-2.12-alltests Python-2.4.6 : Linux From: Zope Tests Date: Wed Jul 22 20:55:18 EDT 2009 URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012123.html Subject: FAILED (failures=7) : Zope-2.12-alltests Python-2.6.2 : Linux From: Zope Tests Date: Wed Jul 22 20:57:18 EDT 2009 URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012124.html Subject: FAILED (failures=1) : Zope-trunk Python-2.6.2 : Linux From: Zope Tests Date: Wed Jul 22 20:59:18 EDT 2009 URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012125.html Subject: FAILED (failures=7) : Zope-trunk-alltests Python-2.6.2 : Linux From: Zope Tests Date: Wed Jul 22 21:01:18 EDT 2009 URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012126.html Tests passed OK --- Subject: OK : Zope-2.10 Python-2.4.6 : Linux From: Zope Tests Date: Wed Jul 22 20:47:17 EDT 2009 URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012119.html Subject: OK : Zope-2.11 Python-2.4.6 : Linux From: Zope Tests Date: Wed Jul 22 20:49:18 EDT 2009 URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012120.html Subject: OK : Zope-2.12 Python-2.4.6 : Linux From: Zope Tests Date: Wed Jul 22 20:51:18 EDT 2009 URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012121.html ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] POSKeyError how to remove
http://spamsch.blogspot.com/2009/04/how-to-repair-broken-zodb-poskeyerror.html -aj On 23.07.09 12:57, Rupesh P Raj wrote: > Hi, > > Using Zope Debug Console, I used a part of the code fsrefs.py to find > the oid's of POSKeyError: > > fs = FileStorage(path, read_only=1) > undone = {} > > noload = {} > > for oid in fs._index.keys(): > try: > data, serial = fs.load(oid, "") > except (KeyboardInterrupt, SystemExit): > raise > except POSKeyError: > undone[oid] = 1 > except: > if VERBOSE: > traceback.print_exc() > noload[oid] = 1 > > This gave me one oid.Then I tried something like below : > > obj = app._p_jar[oid] > > But this gave me another POSKeyError instead :( > > Why does this happen? How can I delete this object. > > Thanks, > Roopesh > > > ___ > Zope-Dev maillist - Zope-Dev@zope.org > http://mail.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope ) > -- ZOPYX Ltd. & Co KG \ ZOPYX & Friends Charlottenstr. 37/1 \ The experts for your Python, Zope and D-72070 Tübingen \ Plone projects www.zopyx.com, i...@zopyx.com \ www.zopyx.de/friends, frie...@zopyx.de E-Publishing, Python, Zope & Plone development, Consulting begin:vcard fn:Andreas Jung n:Jung;Andreas org:ZOPYX Ltd. & Co. KG adr;quoted-printable:;;Charlottenstr. 37/1;T=C3=BCbingen;;72070;Germany email;internet:i...@zopyx.com title:CEO tel;work:+49-7071-793376 tel;fax:+49-7071-7936840 tel;home:+49-7071-793257 x-mozilla-html:FALSE url:www.zopyx.com version:2.1 end:vcard ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope 2.12: mkzopeinstance, runzope and zopectl - a small proposal
On 23.07.09 12:10, yuppie wrote: > Hi! > > > SOFTWARE_HOME no longer exist in Zope 2.12, all the software is now > somewhere on sys.path. > > So this no longer works in zopectl: > > ZDCTL="$SOFTWARE_HOME/Zope2/Startup/zopectl.py" > exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@" > > Therefore mkzopeinstance now creates something like this: > > ZDCTL="/path/to/eggs/Zope2-2.12.0b3-py2.5-linux-i686.egg/Zope2/Startup/zopectl.py" > exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@" > > > Problem: > > > - the code in mkzopeinstance.py that looks up the Zope2 path fails on > some platforms > > - if the software is updated, you have to change the paths in runzope > and zopectl of each instance > > > Solution: > - > > 1.) Add two new entry points in setup.py: > > runzope=Zope2.Startup.run:run > zopectl=Zope2.Startup.zopectl:run > > If the software is installed, executable runzope and zopectl files are > created in the bin directory. That should work with zc.buildout and with > easy_install. > > 2.) Modify the runzope and zopectl files created by mkzopeinstance: > > The result should look like this: > > ZDCTL="/path/to/install/bin/zopectl" > exec "$ZDCTL" -C "$CONFIG_FILE" "$@" > > mkzopeinstance would make the assumption that executable runzope and > zopectl files exist in the same directory as mkzopeinstance itself. > > > Risks: > -- > > - mkzopeinstance has a --python option. The specified Python interpreter > will no longer be used to execute runzope or zopectl. > > - uses cases might exist that no longer work after that change > > > > Any thoughts? Is the 2.12 branch still open for changes like that? Go ahead. I also had to fix a similar issue some days ago inside Zope startup code. Andreas begin:vcard fn:Andreas Jung n:Jung;Andreas org:ZOPYX Ltd. & Co. KG adr;quoted-printable:;;Charlottenstr. 37/1;T=C3=BCbingen;;72070;Germany email;internet:i...@zopyx.com title:CEO tel;work:+49-7071-793376 tel;fax:+49-7071-7936840 tel;home:+49-7071-793257 x-mozilla-html:FALSE url:www.zopyx.com version:2.1 end:vcard ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Linux x86_64 [Was: Zope Tests: 3 OK, 5 Failed]
I can reproduce the failures in ExtensionClass and also get some weird errors while trying to buildout the Acquisition package: aj...@blackmoon:/develop/repository/svn.zope.org/Acquisition/trunk> bin/buildout Develop: '/data/develop/repository/svn.zope.org/Acquisition/trunk/.' Unused options for buildout: 'download-directory'. Installing interpreter. While: Installing interpreter. An internal error occured due to a bug in either zc.buildout or in a recipe being used: Traceback (most recent call last): File "/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/buildout.py", line 1519, in main File "/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/buildout.py", line 473, in install File "/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/buildout.py", line 1101, in _call File "/home/ajung/.buildout/eggs/zc.recipe.egg-1.2.2-py2.6.egg/zc/recipe/egg/egg.py", line 169, in install relative_paths=self._relative_paths, File "/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/easy_install.py", line 964, in scripts File "/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/easy_install.py", line , in _pyscript IOError: [Errno 26] Text file busy: '/data/develop/repository/svn.zope.org/Acquisition/trunk/bin/python' Both issues are severe and are a blocker for the next release. Andreas On 18.07.09 14:08, Stefan H. Holek wrote: > All failures appear to be due to the new box running Linux x86_64. > Tests still pass fine on the Mac. > > Any experience with this? MemoryError in Acquisition? WTH? > > Stefan > > > On 18.07.2009, at 14:00, Zope Tests Summarizer wrote: > > >> Summary of messages to the zope-tests list. >> Period Fri Jul 17 12:00:00 2009 UTC to Sat Jul 18 12:00:00 2009 UTC. >> There were 8 messages: 8 from Zope Tests. >> >> >> Test failures >> - >> >> Subject: FAILED (failures=1) : Zope-2.12 Python-2.6.2 : Linux >> From: Zope Tests >> Date: Fri Jul 17 20:50:00 EDT 2009 >> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012082.html >> >> Subject: FAILED (failures=1) : Zope-2.12-alltests Python-2.4.6 : Linux >> From: Zope Tests >> Date: Fri Jul 17 20:52:00 EDT 2009 >> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012083.html >> >> Subject: FAILED (failures=7) : Zope-2.12-alltests Python-2.6.2 : Linux >> From: Zope Tests >> Date: Fri Jul 17 20:54:01 EDT 2009 >> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012084.html >> >> Subject: FAILED (failures=1) : Zope-trunk Python-2.6.2 : Linux >> From: Zope Tests >> Date: Fri Jul 17 20:56:01 EDT 2009 >> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012085.html >> >> Subject: FAILED (failures=7) : Zope-trunk-alltests Python-2.6.2 : >> Linux >> From: Zope Tests >> Date: Fri Jul 17 20:58:01 EDT 2009 >> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012086.html >> > > -- > Stefan H. Holek > ste...@epy.co.at > > > > > ___ > Zope-Dev maillist - Zope-Dev@zope.org > http://mail.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope ) > -- ZOPYX Ltd. & Co KG \ ZOPYX & Friends Charlottenstr. 37/1 \ The experts for your Python, Zope and D-72070 Tübingen \ Plone projects www.zopyx.com, i...@zopyx.com \ www.zopyx.de/friends, frie...@zopyx.de E-Publishing, Python, Zope & Plone development, Consulting begin:vcard fn:Andreas Jung n:Jung;Andreas org:ZOPYX Ltd. & Co. KG adr;quoted-printable:;;Charlottenstr. 37/1;T=C3=BCbingen;;72070;Germany email;internet:i...@zopyx.com title:CEO tel;work:+49-7071-793376 tel;fax:+49-7071-7936840 tel;home:+49-7071-793257 x-mozilla-html:FALSE url:www.zopyx.com version:2.1 end:vcard ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )