[Zope3-Users] Re: KGS Site Updated

2007-11-18 Thread Stephan Richter
On Sunday 18 November 2007, Philipp von Weitershausen wrote:
> > 5. There is now an introduction page called "intro.html" that lists all
> > versions and files. It also explains how to use the files. See:
> > http://download.zope.org/zope3.4/intro.html
>
> You have a typo there. The buildout option is called "extends", not
> "extend".

Hi Phillip,

I was actually hoping that you could provide me with a little blurb on how to 
best use the KGS with zopeproject. Actually, I think it would be really cool, 
if you could just have a command-line option specifying the KGS, like::

  --kgs=zope3.4

Of course, less specific choices would include something like this::

  --index=http://download.zope.org/zope3.4

On the other hand, I wonder whether Zope and zopeproject releases should be 
somewhat synced, so that a particular line of zopeproject releases uses a 
particular KGS by default

Regards,
Stephan
-- 
Stephan Richter
CBU Physics & Chemistry (B.S.) / Tufts Physics (Ph.D. student)
Web2k - Web Software Design, Development and Training
___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


[Zope3-Users] Re: [Zope-dev] KGS Site Updated

2007-11-18 Thread Stephan Richter
On Sunday 18 November 2007, Chris McDonough wrote:
> > I disagree. This is not what this means to me. I think a KGS can
> > receive bug
> > fix releases, which the Zope 3.4 KGS does. However, no new feature
> > releases
> > are allowed.
>
> In the Linux world, these purposes are served by separate indexes
> (e.g. Debian security releases are in their own index).  There's no
> problem with what you're saying, it's just not a source for repeatable
> installations, which is something that's required for many builds.

Yes, I agree. I accommodated those needs by having versioned links.html, 
versions.cfg, controlled-packages.cfg, and now minimal/ files and 
directories. Those will *never* change once released. (Of course there will 
be versions like "3.4.1dev" that change until "3.4.1" is released, simply so 
that I do not have to version every single little change to the KGS while 
testing. But maybe that is even desirable at some point. We will see.)

> Even if there are bugfixes available, you may not want them, or you
> may have fixed the bugs your own way already (though patches or what-
> have you).  Maybe the KGS isn't it, but there needs to be a way to get
> the very same packages, unfailingly, every time, no exceptions for
> bugfixes, etc.  I wish the KGS was this but it still isn't it.

Well, the versioned versions.cfg file will not change. In the buildout world, 
I think most people will end up using versions-*.cfg when pinning down 
versions plus specify their own version block in their buildout.cfg for 
packages that we do not control.

> >> The first is true for what we have now neither of the "minimal" set
> >> or
> >> the set you're calling the "KGS".
> >
> > Right. Note that versions-*.cfg and links-*cfg are frozen. I am
> > probably going
> > to freeze minimal/ as have minimal-*/ too.
>
> Will they will change for bugfixes?

Nope. That's the reason they are frozen. They are like tags in SVN.

> I have tried buildout, of course.  Massaging the index to meet some
> set of expectations developers have of the client they use to install
> the software is fine, you did a lot of work to do this, which is
> appreciated, and it's your index.   But I suggest that we don't
> discount the *really KGS* requirement, which is *absolutely repeatable
> builds* (today, tomorrow, two years from now), and we let people know
> that the KGS is not that.

Why? I have listened to the community very early on, reacting to the need 
having certain frozen output. A few weeks back I sent a mail to the zope-dev 
_[1] list outlining how I think the index can be used in buildout. Since 
then, functionality has only expanded and other combinations are possible 
now.

.. [1] http://mail.zope.org/pipermail/zope-dev/2007-November/030210.html

So if you go to http://download.zope.org/zope3.4/intro.html into the 
sub-section "Version 3.4.0b2" you see a bunch of links. With the exception of 
the "Index" link, all other links point to versioned file and directories, 
which will not change. Also, any of the versioned files and directories do 
not contain references to packages that are not controlled by the KGS.

Regards,
Stephan
-- 
Stephan Richter
CBU Physics & Chemistry (B.S.) / Tufts Physics (Ph.D. student)
Web2k - Web Software Design, Development and Training
___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


Re: [Zope3-Users] A question regarding zope generations

2007-11-18 Thread Shailesh Kumar
Thanks Bernd,

I am working around this issues as you have suggested.

- Shailesh



On Nov 17, 2007 5:31 PM, Bernd Dorn <[EMAIL PROTECTED]> wrote:

>
>  On 16.11.2007, at 13:56, Shailesh Kumar wrote:
>
>
> As of now, I am thinking of a following solution. For the current upgrade,
> I will have some code which will automatically evolve the existing
> installation during startup
> (i.e. DatabaseOpenedEvent) and actually assign a generation number in the
> root[generations_key]['product_name'] key.
>
> In the later upgrades, I will replace this with the regular schema
> manager.
>
> Comments from the zope 3 experts would be very useful.
>
>
> well this is a real flaw with generations ...
>
> in our projects we always add an initial .generations package to avoid
> such cases, you  can do this too, but it needs an intermediate version but
> no "dummy" schema manager.
>
> in generations/__init__.py you add
>
>  from zope.app.generations.generations import SchemaManager
>
> pkg = 'myapp'
>
> schemaManager = SchemaManager(
> minimum_generation=0,
> generation=0,
> package_name=pkg)
>
> and register the manager.
>
> make a realease, this will set the generation to 0
>
> then add your first "evolve1.py" to generations, the manager stays the
> same  - you only have to increase the generation number
>
> regards, bernd
>
>
>
>
>
>
___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


[Zope3-Users] Re: [Zope-dev] KGS Site Updated

2007-11-18 Thread Chris McDonough


On Nov 18, 2007, at 7:52 PM, Stephan Richter wrote:


On Sunday 18 November 2007, Chris McDonough wrote:

4. A new "minimal/" folder now contains an index just of the
controlled
packages. This minimal index can be used by compoze as one
contributing
index. (I have not tested this yet, can anyone try this and report
how it can
be done?)


Very cool, thank you!  I'll try this.


Great. I would love to get a little write-up on how to use it, so I  
can put it

on the intro page.


Compoze is not ready for prime time yet, I'm afraid.  You can use it  
to download all source packages from a working set and create an index  
from these.  But currently I think only Tres knows how to make it do  
it. ;-)


Note that if the KGS really wants to be a KGS (literally "known  
good",

it's a matter of semantics, not of technology):


I agree.


- An invariant must be met that only one version of each package
should be present in the index.


I disagree. This is not what this means to me. I think a KGS can  
receive bug
fix releases, which the Zope 3.4 KGS does. However, no new feature  
releases

are allowed.


In the Linux world, these purposes are served by separate indexes  
(e.g. Debian security releases are in their own index).  There's no  
problem with what you're saying, it's just not a source for repeatable  
installations, which is something that's required for many builds.   
Even if there are bugfixes available, you may not want them, or you  
may have fixed the bugs your own way already (though patches or what- 
have you).  Maybe the KGS isn't it, but there needs to be a way to get  
the very same packages, unfailingly, every time, no exceptions for  
bugfixes, etc.  I wish the KGS was this but it still isn't it.


The first is true for what we have now neither of the "minimal" set  
or

the set you're calling the "KGS".


Right. Note that versions-*.cfg and links-*cfg are frozen. I am  
probably going

to freeze minimal/ as have minimal-*/ too.


Will they will change for bugfixes?


The second I'm pretty sure is not
true of the thing you're calling the KGS (it still mirrors the
cheeseshop regularly), I'm not sure about the intent for the  
"minimal"

set.


Well, this is a limitation of the current setuptools system. In  
buildout I can
only specify one index, since setuptools can have only one index. So  
it is
necessary that I make all packages available in that index and this  
is what I
produce as download.zope.org/zope3.4. But I have explained this  
multiple
times before, so I am not going to repeat the argument any more.  
Please try

buildout and see for yourself.


I have tried buildout, of course.  Massaging the index to meet some  
set of expectations developers have of the client they use to install  
the software is fine, you did a lot of work to do this, which is  
appreciated, and it's your index.   But I suggest that we don't  
discount the *really KGS* requirement, which is *absolutely repeatable  
builds* (today, tomorrow, two years from now), and we let people know  
that the KGS is not that.


In any case, thanks a lot for the work!

- C

___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


[Zope3-Users] Re: [Zope-dev] KGS Site Updated

2007-11-18 Thread Stephan Richter
On Sunday 18 November 2007, Stephan Richter wrote:
> > The first is true for what we have now neither of the "minimal" set or
> > the set you're calling the "KGS".
>
> Right. Note that versions-*.cfg and links-*cfg are frozen. I am probably
> going to freeze minimal/ as have minimal-*/ too.

I have now changed the code to version the minimal index as well. It still 
contains multiple versions of packages that we know work together; however, 
for your purposes setuptools will only pick up the latest one anyways.

Regards,
Stephan
-- 
Stephan Richter
CBU Physics & Chemistry (B.S.) / Tufts Physics (Ph.D. student)
Web2k - Web Software Design, Development and Training
___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


[Zope3-Users] Re: [Zope-dev] KGS Site Updated

2007-11-18 Thread Stephan Richter
On Sunday 18 November 2007, Chris McDonough wrote:
> > 4. A new "minimal/" folder now contains an index just of the
> > controlled
> > packages. This minimal index can be used by compoze as one
> > contributing
> > index. (I have not tested this yet, can anyone try this and report
> > how it can
> > be done?)
>
> Very cool, thank you!  I'll try this.

Great. I would love to get a little write-up on how to use it, so I can put it 
on the intro page.

> Note that if the KGS really wants to be a KGS (literally "known good",
> it's a matter of semantics, not of technology):

I agree.

> - An invariant must be met that only one version of each package
> should be present in the index.

I disagree. This is not what this means to me. I think a KGS can receive bug 
fix releases, which the Zope 3.4 KGS does. However, no new feature releases 
are allowed.

> - The set is frozen (no packages will be added to or removed from or
> changed).

Yep, I agree. No packages will be added or removed for the Zope 3.4 version of 
the KGS. I will soon add a new Zope-Dev KGS, which is open to new feature 
releases.

> The first is true for what we have now neither of the "minimal" set or
> the set you're calling the "KGS".

Right. Note that versions-*.cfg and links-*cfg are frozen. I am probably going 
to freeze minimal/ as have minimal-*/ too. 

> The second I'm pretty sure is not 
> true of the thing you're calling the KGS (it still mirrors the
> cheeseshop regularly), I'm not sure about the intent for the "minimal"
> set.

Well, this is a limitation of the current setuptools system. In buildout I can 
only specify one index, since setuptools can have only one index. So it is 
necessary that I make all packages available in that index and this is what I 
produce as download.zope.org/zope3.4. But I have explained this multiple 
times before, so I am not going to repeat the argument any more. Please try 
buildout and see for yourself.

Regards,
Stephan
-- 
Stephan Richter
CBU Physics & Chemistry (B.S.) / Tufts Physics (Ph.D. student)
Web2k - Web Software Design, Development and Training
___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


[Zope3-Users] Re: [Zope-dev] Re: KGS Site Updated

2007-11-18 Thread Stephan Richter
On Sunday 18 November 2007, Philipp von Weitershausen wrote:
> > 3. A new "links.html" file now lists all packages in one URL, so that it
> > is suitable for the "find-links" option. (I have not tested this yet,
> > anyone?)
>
> That's quite useful when combining multiple KGSs

Yes, it actually does. However, this can be a little bit misleading. By 
default, when no index is specified, PyPI will be used as index and find 
links are only used to extend beyond PyPI. However, PyPI will provide more 
versions than the KGS find-links. So in order to use it properly, you have to 
specify a Null-Index. Please correct me, if I am wrong.

> You have a typo there. The buildout option is called "extends", not
> "extend".

Fixed.

Regards,
Stephan
-- 
Stephan Richter
CBU Physics & Chemistry (B.S.) / Tufts Physics (Ph.D. student)
Web2k - Web Software Design, Development and Training
___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


[Zope3-Users] Re: [Zope-dev] KGS Site Updated

2007-11-18 Thread Chris McDonough

On Nov 17, 2007, at 10:00 PM, Stephan Richter wrote:


Hi everyone,

I just updated the Zope 3.4 KGS with some new features.

1. You only need to upload the "controlled-packages.cfg" file now;  
all other

files are generated.

2. The "controlled-packages.cfg" file now supports a name and  
version option.
Thus, all generated files are versioned now. The unversioned version  
of the

files refers to the latest one.

3. A new "links.html" file now lists all packages in one URL, so  
that it is
suitable for the "find-links" option. (I have not tested this yet,  
anyone?)


Nice.




4. A new "minimal/" folder now contains an index just of the  
controlled
packages. This minimal index can be used by compoze as one  
contributing
index. (I have not tested this yet, can anyone try this and report  
how it can

be done?)


Very cool, thank you!  I'll try this.


5. There is now an introduction page called "intro.html" that lists  
all versions and files. It also explains how to use the files. See:

http://download.zope.org/zope3.4/intro.html

6. The KGS now supports extensions, meaning one KGS can build on  
another. You
simply specify the "extend" option in the "[KGS]" section of the  
controlled
packages configuration file. This should allow frameworks built on  
top of

Zoep 3, like grok, to build their own KGS without much effort.

That said, I would really like for people to test all the features  
and see

whether they work for them.

But most importantly, I would like for people to contribute to the  
"Usage"

section of the introduction page!

Thanks to all for listening!


Note that if the KGS really wants to be a KGS (literally "known good",  
it's a matter of semantics, not of technology):


- An invariant must be met that only one version of each package  
should be present in the index.


- The set is frozen (no packages will be added to or removed from or  
changed).


The first is true for what we have now neither of the "minimal" set or  
the set you're calling the "KGS".  The second I'm pretty sure is not  
true of the thing you're calling the KGS (it still mirrors the  
cheeseshop regularly), I'm not sure about the intent for the "minimal"  
set.


- C

___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


[Zope3-Users] Re: KGS Site Updated

2007-11-18 Thread Philipp von Weitershausen

Stephan Richter wrote:

I just updated the Zope 3.4 KGS with some new features.

1. You only need to upload the "controlled-packages.cfg" file now; all other 
files are generated.


2. The "controlled-packages.cfg" file now supports a name and version option. 
Thus, all generated files are versioned now. The unversioned version of the 
files refers to the latest one.


3. A new "links.html" file now lists all packages in one URL, so that it is 
suitable for the "find-links" option. (I have not tested this yet, anyone?)


That's quite useful when combining multiple KGSs

4. A new "minimal/" folder now contains an index just of the controlled 
packages. This minimal index can be used by compoze as one contributing 
index. (I have not tested this yet, can anyone try this and report how it can 
be done?)


5. There is now an introduction page called "intro.html" that lists all 
versions and files. It also explains how to use the files. See:

http://download.zope.org/zope3.4/intro.html


You have a typo there. The buildout option is called "extends", not 
"extend".


6. The KGS now supports extensions, meaning one KGS can build on another. You 
simply specify the "extend" option in the "[KGS]" section of the controlled 
packages configuration file. This should allow frameworks built on top of 
Zoep 3, like grok, to build their own KGS without much effort.


That said, I would really like for people to test all the features and see 
whether they work for them.


But most importantly, I would like for people to contribute to the "Usage" 
section of the introduction page!


___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


[Zope3-Users] Re: virtualenv problems

2007-11-18 Thread Philipp von Weitershausen

George Wright wrote:

Gidday
I have been trying to set up a virtualenv as has been suggested several 
times on this list.

Following steps in section 1.4 of "Zope Component Architecture.pdf"
I have a path problem:

$ easy_install virtualenv
...
virtualenv 0.8.4 is already the active version in easy-install.pth
Installing virtualenv script to 
/Library/Frameworks/Python.framework/Versions/2.4/bin
Using 
/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/site-packages/virtualenv-0.8.4-py2.4.egg

...
Finished processing dependencies for virtualenv

$ virtualenv myvirtualenv
New python executable in myvirtualenv/bin/Python
ERROR: The executable myvirtualenv/bin/Python is not functioning
ERROR: It thinks sys.prefix is 
'/Library/Frameworks/Python.framework/Versions/2.4' (should be 
'/Users/georgewright/myvirtualenv')

ERROR: virtualenv is not compatible with this system or executable
$

How do I fix that sys.prefix problem?


You update to a newer virtualenv version that has a fix for this 
problem. easy_install -U virtualenv. Or you install a proper Python 
executable that isn't messed up as a framework build (see below).


Following threads on virtualenv I gather I should be using a "non-system 
python installation". How do I do that?


By compiling it yourself. Download the Python-2.4.4.tgz tarball and do 
the configure --prefix=...; make; make install dance.


I highly recommend that everybody, no matter what platform s/he's on, 
does this. Default Python setups ("system pythons") are just too messed 
up and often tainted by the global installation of eggs.


___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users