[Zope-dev] Zope 2.12: mkzopeinstance, runzope and zopectl - a small proposal

2009-07-23 Thread yuppie 
Hi!


SOFTWARE_HOME no longer exist in Zope 2.12, all the software is now 
somewhere on sys.path.

So this no longer works in zopectl:

ZDCTL="$SOFTWARE_HOME/Zope2/Startup/zopectl.py"
exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@"

Therefore mkzopeinstance now creates something like this:

ZDCTL="/path/to/eggs/Zope2-2.12.0b3-py2.5-linux-i686.egg/Zope2/Startup/zopectl.py"
exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@"


Problem:


- the code in mkzopeinstance.py that looks up the Zope2 path fails on 
some platforms

- if the software is updated, you have to change the paths in runzope 
and zopectl of each instance


Solution:
-

1.) Add two new entry points in setup.py:

 runzope=Zope2.Startup.run:run
 zopectl=Zope2.Startup.zopectl:run

If the software is installed, executable runzope and zopectl files are 
created in the bin directory. That should work with zc.buildout and with 
easy_install.

2.) Modify the runzope and zopectl files created by mkzopeinstance:

The result should look like this:

ZDCTL="/path/to/install/bin/zopectl"
exec "$ZDCTL" -C "$CONFIG_FILE" "$@"

mkzopeinstance would make the assumption that executable runzope and 
zopectl files exist in the same directory as mkzopeinstance itself.


Risks:
--

- mkzopeinstance has a --python option. The specified Python interpreter 
will no longer be used to execute runzope or zopectl.

- uses cases might exist that no longer work after that change



Any thoughts? Is the 2.12 branch still open for changes like that?


Cheers,

Yuppie

___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: [Zope-dev] Zope 2.12: mkzopeinstance, runzope and zopectl - a small proposal

2009-07-23 Thread Wichert Akkerman 
On 7/23/09 12:10 PM, yuppie wrote:
> Hi!
>
>
> SOFTWARE_HOME no longer exist in Zope 2.12, all the software is now
> somewhere on sys.path.
>
> So this no longer works in zopectl:
>
> ZDCTL="$SOFTWARE_HOME/Zope2/Startup/zopectl.py"
> exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@"
>
> Therefore mkzopeinstance now creates something like this:
>
> ZDCTL="/path/to/eggs/Zope2-2.12.0b3-py2.5-linux-i686.egg/Zope2/Startup/zopectl.py"
> exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@"
>
>
> Problem:
> 
>
> - the code in mkzopeinstance.py that looks up the Zope2 path fails on
> some platforms
>
> - if the software is updated, you have to change the paths in runzope
> and zopectl of each instance
>
>
> Solution:
> -
>
> 1.) Add two new entry points in setup.py:
>
>   runzope=Zope2.Startup.run:run
>   zopectl=Zope2.Startup.zopectl:run
>
> If the software is installed, executable runzope and zopectl files are
> created in the bin directory. That should work with zc.buildout and with
> easy_install.
>
> 2.) Modify the runzope and zopectl files created by mkzopeinstance:
>
> The result should look like this:
>
> ZDCTL="/path/to/install/bin/zopectl"
> exec "$ZDCTL" -C "$CONFIG_FILE" "$@"
>
> mkzopeinstance would make the assumption that executable runzope and
> zopectl files exist in the same directory as mkzopeinstance itself.
>
>
> Risks:
> --
>
> - mkzopeinstance has a --python option. The specified Python interpreter
> will no longer be used to execute runzope or zopectl.
>
> - uses cases might exist that no longer work after that change
>
>
>
> Any thoughts? Is the 2.12 branch still open for changes like that?

+1

Wichert.
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

[Zope-dev] POSKeyError how to remove

2009-07-23 Thread Rupesh P Raj 
Hi,

Using Zope Debug Console, I used a part of the code fsrefs.py to find the
oid's of POSKeyError:

fs = FileStorage(path, read_only=1)
undone = {}

noload = {}

for oid in fs._index.keys():
try:
data, serial = fs.load(oid, "")
except (KeyboardInterrupt, SystemExit):
raise
except POSKeyError:
undone[oid] = 1
except:
if VERBOSE:
traceback.print_exc()
noload[oid] = 1

This gave me one oid.Then I tried something like below :

obj = app._p_jar[oid]

But this gave me another POSKeyError instead :(

Why does this happen? How can I delete this object.

Thanks,
Roopesh
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: [Zope-dev] POSKeyError how to remove

2009-07-23 Thread Jim Fulton 
The object is already gone. It's odd that it is in the index.
You can try deleting the object from the index and then saving the
index.  You might need to use ZODB 3.9 to do that, as I think __del__
was only recently added to file-storage indexes.

Jim

On Thu, Jul 23, 2009 at 6:57 AM, Rupesh P Raj wrote:
> Hi,
>
> Using Zope Debug Console, I used a part of the code fsrefs.py to find the
> oid's of POSKeyError:
>
>     fs = FileStorage(path, read_only=1)
>     undone = {}
>
>     noload = {}
>
>     for oid in fs._index.keys():
>     try:
>     data, serial = fs.load(oid, "")
>     except (KeyboardInterrupt, SystemExit):
>     raise
>     except POSKeyError:
>     undone[oid] = 1
>     except:
>     if VERBOSE:
>     traceback.print_exc()
>     noload[oid] = 1
>
> This gave me one oid.Then I tried something like below :
>
> obj = app._p_jar[oid]
>
> But this gave me another POSKeyError instead :(
>
> Why does this happen? How can I delete this object.
>
> Thanks,
> Roopesh
> ___
> Zope-Dev maillist  -  zope-...@zope.org
> http://mail.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists -
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope )
>
>



-- 
Jim Fulton
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: [Zope-dev] POSKeyError how to remove

2009-07-23 Thread Rupesh P Raj 
Hi Jim,

But I am using ZODB 3.4.4 :( Are there any other options? How can I find
where this invalid object is being referenced?

Will something like packing resolve this?

Thanks,
Roopesh


On Thu, Jul 23, 2009 at 4:45 PM, Jim Fulton  wrote:

> The object is already gone. It's odd that it is in the index.
> You can try deleting the object from the index and then saving the
> index.  You might need to use ZODB 3.9 to do that, as I think __del__
> was only recently added to file-storage indexes.
>
> Jim
>
> On Thu, Jul 23, 2009 at 6:57 AM, Rupesh P Raj
> wrote:
> > Hi,
> >
> > Using Zope Debug Console, I used a part of the code fsrefs.py to find the
> > oid's of POSKeyError:
> >
> > fs = FileStorage(path, read_only=1)
> > undone = {}
> >
> > noload = {}
> >
> > for oid in fs._index.keys():
> > try:
> > data, serial = fs.load(oid, "")
> > except (KeyboardInterrupt, SystemExit):
> > raise
> > except POSKeyError:
> > undone[oid] = 1
> > except:
> > if VERBOSE:
> > traceback.print_exc()
> > noload[oid] = 1
> >
> > This gave me one oid.Then I tried something like below :
> >
> > obj = app._p_jar[oid]
> >
> > But this gave me another POSKeyError instead :(
> >
> > Why does this happen? How can I delete this object.
> >
> > Thanks,
> > Roopesh
> > ___
> > Zope-Dev maillist  -  Zope-Dev@zope.org
> > http://mail.zope.org/mailman/listinfo/zope-dev
> > **  No cross posts or HTML encoding!  **
> > (Related lists -
> >  http://mail.zope.org/mailman/listinfo/zope-announce
> >  http://mail.zope.org/mailman/listinfo/zope )
> >
> >
>
>
>
> --
> Jim Fulton
>
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

[Zope-dev] Zope Tests: 3 OK, 5 Failed

2009-07-23 Thread Zope Tests Summarizer 
Summary of messages to the zope-tests list.
Period Wed Jul 22 12:00:00 2009 UTC to Thu Jul 23 12:00:00 2009 UTC.
There were 8 messages: 8 from Zope Tests.


Test failures
-

Subject: FAILED (failures=1) : Zope-2.12 Python-2.6.2 : Linux
From: Zope Tests
Date: Wed Jul 22 20:53:18 EDT 2009
URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012122.html

Subject: FAILED (failures=1) : Zope-2.12-alltests Python-2.4.6 : Linux
From: Zope Tests
Date: Wed Jul 22 20:55:18 EDT 2009
URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012123.html

Subject: FAILED (failures=7) : Zope-2.12-alltests Python-2.6.2 : Linux
From: Zope Tests
Date: Wed Jul 22 20:57:18 EDT 2009
URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012124.html

Subject: FAILED (failures=1) : Zope-trunk Python-2.6.2 : Linux
From: Zope Tests
Date: Wed Jul 22 20:59:18 EDT 2009
URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012125.html

Subject: FAILED (failures=7) : Zope-trunk-alltests Python-2.6.2 : Linux
From: Zope Tests
Date: Wed Jul 22 21:01:18 EDT 2009
URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012126.html


Tests passed OK
---

Subject: OK : Zope-2.10 Python-2.4.6 : Linux
From: Zope Tests
Date: Wed Jul 22 20:47:17 EDT 2009
URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012119.html

Subject: OK : Zope-2.11 Python-2.4.6 : Linux
From: Zope Tests
Date: Wed Jul 22 20:49:18 EDT 2009
URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012120.html

Subject: OK : Zope-2.12 Python-2.4.6 : Linux
From: Zope Tests
Date: Wed Jul 22 20:51:18 EDT 2009
URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012121.html

___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: [Zope-dev] POSKeyError how to remove

2009-07-23 Thread Andreas Jung 
http://spamsch.blogspot.com/2009/04/how-to-repair-broken-zodb-poskeyerror.html

-aj

On 23.07.09 12:57, Rupesh P Raj wrote:
> Hi,
>
> Using Zope Debug Console, I used a part of the code fsrefs.py to find
> the oid's of POSKeyError:
>
> fs = FileStorage(path, read_only=1)
> undone = {}
>
> noload = {}
>
> for oid in fs._index.keys():
> try:
> data, serial = fs.load(oid, "")
> except (KeyboardInterrupt, SystemExit):
> raise
> except POSKeyError:
> undone[oid] = 1
> except:
> if VERBOSE:
> traceback.print_exc()
> noload[oid] = 1
>
> This gave me one oid.Then I tried something like below :
>
> obj = app._p_jar[oid]
>
> But this gave me another POSKeyError instead :(
>
> Why does this happen? How can I delete this object.
>
> Thanks,
> Roopesh
> 
>
> ___
> Zope-Dev maillist  -  Zope-Dev@zope.org
> http://mail.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists - 
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope )
>   


-- 
ZOPYX Ltd. & Co KG  \  ZOPYX & Friends
Charlottenstr. 37/1  \  The experts for your Python, Zope and
D-72070 Tübingen  \  Plone projects
www.zopyx.com, i...@zopyx.com  \  www.zopyx.de/friends, frie...@zopyx.de

E-Publishing, Python, Zope & Plone development, Consulting


begin:vcard
fn:Andreas Jung
n:Jung;Andreas
org:ZOPYX Ltd. & Co. KG
adr;quoted-printable:;;Charlottenstr. 37/1;T=C3=BCbingen;;72070;Germany
email;internet:i...@zopyx.com
title:CEO
tel;work:+49-7071-793376
tel;fax:+49-7071-7936840
tel;home:+49-7071-793257
x-mozilla-html:FALSE
url:www.zopyx.com
version:2.1
end:vcard

___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: [Zope-dev] Zope 2.12: mkzopeinstance, runzope and zopectl - a small proposal

2009-07-23 Thread Andreas Jung 
On 23.07.09 12:10, yuppie wrote:
> Hi!
>
>
> SOFTWARE_HOME no longer exist in Zope 2.12, all the software is now 
> somewhere on sys.path.
>
> So this no longer works in zopectl:
>
> ZDCTL="$SOFTWARE_HOME/Zope2/Startup/zopectl.py"
> exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@"
>
> Therefore mkzopeinstance now creates something like this:
>
> ZDCTL="/path/to/eggs/Zope2-2.12.0b3-py2.5-linux-i686.egg/Zope2/Startup/zopectl.py"
> exec "$PYTHON" "$ZDCTL" -C "$CONFIG_FILE" "$@"
>
>
> Problem:
> 
>
> - the code in mkzopeinstance.py that looks up the Zope2 path fails on 
> some platforms
>
> - if the software is updated, you have to change the paths in runzope 
> and zopectl of each instance
>
>
> Solution:
> -
>
> 1.) Add two new entry points in setup.py:
>
>  runzope=Zope2.Startup.run:run
>  zopectl=Zope2.Startup.zopectl:run
>
> If the software is installed, executable runzope and zopectl files are 
> created in the bin directory. That should work with zc.buildout and with 
> easy_install.
>
> 2.) Modify the runzope and zopectl files created by mkzopeinstance:
>
> The result should look like this:
>
> ZDCTL="/path/to/install/bin/zopectl"
> exec "$ZDCTL" -C "$CONFIG_FILE" "$@"
>
> mkzopeinstance would make the assumption that executable runzope and 
> zopectl files exist in the same directory as mkzopeinstance itself.
>
>
> Risks:
> --
>
> - mkzopeinstance has a --python option. The specified Python interpreter 
> will no longer be used to execute runzope or zopectl.
>
> - uses cases might exist that no longer work after that change
>
>
>
> Any thoughts? Is the 2.12 branch still open for changes like that?
Go ahead. I also had to fix a similar issue some days ago inside
Zope startup code.

Andreas
begin:vcard
fn:Andreas Jung
n:Jung;Andreas
org:ZOPYX Ltd. & Co. KG
adr;quoted-printable:;;Charlottenstr. 37/1;T=C3=BCbingen;;72070;Germany
email;internet:i...@zopyx.com
title:CEO
tel;work:+49-7071-793376
tel;fax:+49-7071-7936840
tel;home:+49-7071-793257
x-mozilla-html:FALSE
url:www.zopyx.com
version:2.1
end:vcard

___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: [Zope-dev] Linux x86_64 [Was: Zope Tests: 3 OK, 5 Failed]

2009-07-23 Thread Andreas Jung 
I can reproduce the failures in ExtensionClass and also get some weird
errors while trying to buildout the Acquisition package:

aj...@blackmoon:/develop/repository/svn.zope.org/Acquisition/trunk>
bin/buildout
Develop: '/data/develop/repository/svn.zope.org/Acquisition/trunk/.'
Unused options for buildout: 'download-directory'.
Installing interpreter.
While:
  Installing interpreter.

An internal error occured due to a bug in either zc.buildout or in a
recipe being used:
Traceback (most recent call last):
  File
"/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/buildout.py",
line 1519, in main
  File
"/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/buildout.py",
line 473, in install
  File
"/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/buildout.py",
line 1101, in _call
  File
"/home/ajung/.buildout/eggs/zc.recipe.egg-1.2.2-py2.6.egg/zc/recipe/egg/egg.py",
line 169, in install
relative_paths=self._relative_paths,
  File
"/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/easy_install.py", line
964, in scripts
  File
"/tmp/tmpt2EP2J/zc.buildout-1.3.0-py2.6.egg/zc/buildout/easy_install.py", line
, in _pyscript
IOError: [Errno 26] Text file busy:
'/data/develop/repository/svn.zope.org/Acquisition/trunk/bin/python'

Both issues are severe and are a blocker for the next release.

Andreas


On 18.07.09 14:08, Stefan H. Holek wrote:
> All failures appear to be due to the new box running Linux x86_64.  
> Tests still pass fine on the Mac.
>
> Any experience with this? MemoryError in Acquisition? WTH?
>
> Stefan
>
>
> On 18.07.2009, at 14:00, Zope Tests Summarizer wrote:
>
>   
>> Summary of messages to the zope-tests list.
>> Period Fri Jul 17 12:00:00 2009 UTC to Sat Jul 18 12:00:00 2009 UTC.
>> There were 8 messages: 8 from Zope Tests.
>>
>>
>> Test failures
>> -
>>
>> Subject: FAILED (failures=1) : Zope-2.12 Python-2.6.2 : Linux
>> From: Zope Tests
>> Date: Fri Jul 17 20:50:00 EDT 2009
>> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012082.html
>>
>> Subject: FAILED (failures=1) : Zope-2.12-alltests Python-2.4.6 : Linux
>> From: Zope Tests
>> Date: Fri Jul 17 20:52:00 EDT 2009
>> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012083.html
>>
>> Subject: FAILED (failures=7) : Zope-2.12-alltests Python-2.6.2 : Linux
>> From: Zope Tests
>> Date: Fri Jul 17 20:54:01 EDT 2009
>> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012084.html
>>
>> Subject: FAILED (failures=1) : Zope-trunk Python-2.6.2 : Linux
>> From: Zope Tests
>> Date: Fri Jul 17 20:56:01 EDT 2009
>> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012085.html
>>
>> Subject: FAILED (failures=7) : Zope-trunk-alltests Python-2.6.2 :  
>> Linux
>> From: Zope Tests
>> Date: Fri Jul 17 20:58:01 EDT 2009
>> URL: http://mail.zope.org/pipermail/zope-tests/2009-July/012086.html
>> 
>
> --
> Stefan H. Holek
> ste...@epy.co.at
>
>
>
>
> ___
> Zope-Dev maillist  -  Zope-Dev@zope.org
> http://mail.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists - 
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope )
>   


-- 
ZOPYX Ltd. & Co KG  \  ZOPYX & Friends
Charlottenstr. 37/1  \  The experts for your Python, Zope and
D-72070 Tübingen  \  Plone projects
www.zopyx.com, i...@zopyx.com  \  www.zopyx.de/friends, frie...@zopyx.de

E-Publishing, Python, Zope & Plone development, Consulting


begin:vcard
fn:Andreas Jung
n:Jung;Andreas
org:ZOPYX Ltd. & Co. KG
adr;quoted-printable:;;Charlottenstr. 37/1;T=C3=BCbingen;;72070;Germany
email;internet:i...@zopyx.com
title:CEO
tel;work:+49-7071-793376
tel;fax:+49-7071-7936840
tel;home:+49-7071-793257
x-mozilla-html:FALSE
url:www.zopyx.com
version:2.1
end:vcard

___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )