Re: [Zope-dev] Searching/Indexing/ZODB/SQL/BerkleyDB

2001-12-05 Thread Chris Withers

Wolfram Kerber wrote:
> 
> Ok, i've put it here :
> http://www.gallileus.info/gallileus/members/m_wolf/publications/100756611705
> /10075665840/protoCat.zip
> 
> I should put together some doc about the changes as well ...

Indeed :-)

I shall have a look though...

Chris

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] My thoughts on the development process

2001-12-05 Thread Chris Withers

Martijn Faassen wrote:
> 
> I agree that I should just 'do it', but I'm not following the guidelines if
> I do it, 

Then the guidelines are wrong ;-)

> and though I'm Dutch and toleration of not following the rules is
> institutional here, I also don't think it's the ideal situation. 

I think the rules should change then.

> Either
> we work out who is maintainer for what and the fishbowl process for the
> *maintainers* is spelled out (the fishbowl introduction focuses much more
> on the artifacts to be produced than on the human aspects), or we scrap
> or completely overhaul the fishbowl process as we do something else anyway.

Where can I buy my "I'm an An4rCh15T!!" badge? ;-)

*grinz*

Chris

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] corrupted data.fs

2001-12-05 Thread Chris McDonough

I am forwarding this message to ZODB-dev, as it is more appropriate
there.

- Original Message -
From: "Chris Kratz" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Wednesday, December 05, 2001 6:17 PM
Subject: [Zope-dev] corrupted data.fs


> Hello all,
>
> My apologies if this is not appropriate on this list and my
apologies for
> this "book".  But, we have been having more and more problems with
Zope and
> it is getting quite frustrating.  I thought since I had posted on
the zope
> list and no one had any suggestions that I would try this list next.
>
> The behavior we are seeing is as follows.  We are using versions
heavily.
> There are two of us primary developers, soon to be three working
heavily
> within the same data.fs.  We use versions, often running several at
the same
> time.  When the code is ready, we save the version incorporating the
changes
> to the live site.
>
> Ever since we upgraded to Zope 2.4.1, saving the version rarely
actually does
> that.  It will save some objects, but usually only a few.  We have
to then go
> to each object and save it again (sometimes making changes) and
continue
> saving the version until we get all the locked objects unlocked and
> committed.  This is very annoying, but not a show stopper.  What is
starting
> to scare me is that I wonder if this problem with the version
commits is
> somehow causing the corruption of the database.
>
> Now, I say all this because it may or may not be related to the
other
> problems we continue to have.  We periodically, get folders that are
no
> longer visible within the ZMI and produce a keyerror in
filestorage.py
> (traceback at end of msg).  But, the same folder is still happily
being
> served externally (ie it generates the web pages based within that
folder
> without error to our customers).  This tells me that it is still in
the ZODB,
> it is just unreachable via the ZODB.  Since we cannot access it from
> within zope any longer, we have to load the data.fs from backup and
restore
> the offending folder losing any work done since the previous night.
It never
> seems to effect any other parts of the website and it has happened
in several
> different areas.  This is becoming more and more of a showstopper
especially
> when we lose code.
>
> 1. I have packed the database.
> 2. I have run fsrecover.py over the data.fs. - Nothing to recover.
So, if we
> aren't corrupted, why can we no longer work with that folder?
> 3. I have exported and imported the offending folder without effect
(XML and
> regular).
> 4. We were packing the zope database nightly via a cron job to
control ZODB
> bloat.  I have turned that off for now on the theory that somehow
mixing
> overnight packs with versions is causing problems.
>
> Help!!! This continues to happen and it is really scary when your
database
> continues to get corrupted underneath you on a live site when you
are in
> heavy development.  Can anyone give any ideas on how to track down
this
> problem?  Could it be with the versioning code?  Is there a better
way to
> work with a production site and still get the benefits of the
versioning?  Is
> versioning just dangerous and shouldn't be used?  Pardon my tone,
but I am a
> little frustrated.
>
> I will say that the last time this happened, thankfully, that
particular
> folder was being worked on in a version and even though the folder
was
> inaccessible outside of the version, when working within the
version, it was
> still there.  So, when that version was cut in, we were again able
to work
> with that folder.  This time however, the folder in question wasn't
begin
> worked on in a version.
>
> Thank you for your time,
>
> Sincerely
>
> -Chris
>
> -
>
> **Traceback**
>
>
> Error Type: KeyError
> Error Value: ?f
>
> Traceback
> Traceback (innermost last): File
>
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/ZPublisher/Publish
.py,
> line 171, in publish File
>
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/ZPublisher/mapply.
py,
> line 160, in mapply (Object: manage_main) File
>
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/ZPublisher/Publish
.py,
> line 112, in call_object (Object: manage_main) File
>
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/Shared/DC/Scripts/
Bindings.py,
> line 324, in __call__ (Object: manage_main) File
>
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/Shared/DC/Scripts/
Bindings.py,
> line 354, in _bindAndExec (Object: manage_main) File
> /usr/local/zope/lib/python/App/special_dtml.py, line 244, in _exec
(Object:
> manage_main) File
/usr/local/zope/lib/python/DocumentTemplate/DT_In.py, line
> 711, in renderwob (Object: objectItems) File
> /usr/local/zope/lib/python/DocumentTemplate/DT_In.py, line 839, in
> sort_sequence (Object: objectItems) File
>
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/ZODB/Connection.py
, line
> 519, in setstate File lib/python/ZODB/FileStorage.py, line 588, in
load
> (Object: /usr/local/zope/var/Data.fs) File
lib/python/ZODB/File

[Zope-dev] corrupted data.fs

2001-12-05 Thread Chris Kratz

Hello all,

My apologies if this is not appropriate on this list and my apologies for 
this "book".  But, we have been having more and more problems with Zope and 
it is getting quite frustrating.  I thought since I had posted on the zope 
list and no one had any suggestions that I would try this list next.

The behavior we are seeing is as follows.  We are using versions heavily.  
There are two of us primary developers, soon to be three working heavily 
within the same data.fs.  We use versions, often running several at the same 
time.  When the code is ready, we save the version incorporating the changes 
to the live site.

Ever since we upgraded to Zope 2.4.1, saving the version rarely actually does 
that.  It will save some objects, but usually only a few.  We have to then go 
to each object and save it again (sometimes making changes) and continue 
saving the version until we get all the locked objects unlocked and 
committed.  This is very annoying, but not a show stopper.  What is starting 
to scare me is that I wonder if this problem with the version commits is 
somehow causing the corruption of the database.

Now, I say all this because it may or may not be related to the other 
problems we continue to have.  We periodically, get folders that are no 
longer visible within the ZMI and produce a keyerror in filestorage.py 
(traceback at end of msg).  But, the same folder is still happily being 
served externally (ie it generates the web pages based within that folder 
without error to our customers).  This tells me that it is still in the ZODB, 
it is just unreachable via the ZODB.  Since we cannot access it from 
within zope any longer, we have to load the data.fs from backup and restore 
the offending folder losing any work done since the previous night.  It never 
seems to effect any other parts of the website and it has happened in several 
different areas.  This is becoming more and more of a showstopper especially 
when we lose code.

1. I have packed the database.
2. I have run fsrecover.py over the data.fs. - Nothing to recover.  So, if we 
aren't corrupted, why can we no longer work with that folder?
3. I have exported and imported the offending folder without effect (XML and 
regular).
4. We were packing the zope database nightly via a cron job to control ZODB 
bloat.  I have turned that off for now on the theory that somehow mixing 
overnight packs with versions is causing problems.

Help!!! This continues to happen and it is really scary when your database 
continues to get corrupted underneath you on a live site when you are in 
heavy development.  Can anyone give any ideas on how to track down this 
problem?  Could it be with the versioning code?  Is there a better way to 
work with a production site and still get the benefits of the versioning?  Is 
versioning just dangerous and shouldn't be used?  Pardon my tone, but I am a 
little frustrated.

I will say that the last time this happened, thankfully, that particular 
folder was being worked on in a version and even though the folder was 
inaccessible outside of the version, when working within the version, it was 
still there.  So, when that version was cut in, we were again able to work 
with that folder.  This time however, the folder in question wasn't begin 
worked on in a version.

Thank you for your time,

Sincerely

-Chris

-

**Traceback**


Error Type: KeyError
Error Value: ?f

Traceback
Traceback (innermost last): File 
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/ZPublisher/Publish.py, 
line 171, in publish File 
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/ZPublisher/mapply.py, 
line 160, in mapply (Object: manage_main) File 
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/ZPublisher/Publish.py, 
line 112, in call_object (Object: manage_main) File 
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/Shared/DC/Scripts/Bindings.py, 
line 324, in __call__ (Object: manage_main) File 
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/Shared/DC/Scripts/Bindings.py, 
line 354, in _bindAndExec (Object: manage_main) File 
/usr/local/zope/lib/python/App/special_dtml.py, line 244, in _exec (Object: 
manage_main) File /usr/local/zope/lib/python/DocumentTemplate/DT_In.py, line 
711, in renderwob (Object: objectItems) File 
/usr/local/zope/lib/python/DocumentTemplate/DT_In.py, line 839, in 
sort_sequence (Object: objectItems) File 
/usr/local/zope2.4/Zope-2.4.0-linux2-x86/lib/python/ZODB/Connection.py, line 
519, in setstate File lib/python/ZODB/FileStorage.py, line 588, in load 
(Object: /usr/local/zope/var/Data.fs) File lib/python/ZODB/FileStorage.py, 
line 564, in _load (Object: /usr/local/zope/var/Data.fs) KeyError: ?f



**Instalation Info**

Platform: RH 7.2
Zope Version: (Zope 2.4.1 (binary release, python 2.1, linux2-x86), python 
2.1.1, linux2)
Python Version: 2.1.1 (#1, Aug 8 2001, 11:57:42) [GCC 2.96 2731 (Red Hat 
Linux 7.1 2.96-81)]
System Platform: linux2

Products ins

RE: [Zope-dev] Searching

2001-12-05 Thread sean . upton

I think this could be done well at the application level, above the Catalog
if done right, but one would have to have good synonym translation table
specific to their application.

I do this in an application using a TinyTable with translation information
for abbreviations (i.e. VW printed in a classified auto ad gets expanded to
Volkswagen, so people can search for both)...  If there was any sort of
thesaurus database of sorts available to your application, I suppose, in
theory, one could do some synonym-oriented indexing, profided that you index
a method that brute-force weights the real words by outputting them a
greater factor of times than the synonym (i.e. index a method that outputs
the original text 3 times and synonyms for the meaningful words (non-stop
words) in that text perhaps once.  This is not difficult from a development
perspective, but involves having synonym data and deciding what words should
be translated to their synonyms, and what ones should not.

I think the real issue here is not having a database of synonyms - and, at
that, you would have to have one for whatever language(s) you needed to
support.

Sean

-Original Message-
From: Dieter Maurer [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, December 05, 2001 1:24 PM
To: Dirk Datzert
Cc: [EMAIL PROTECTED]
Subject: Re: [Zope-dev] Searching


Dirk Datzert writes:
 > I'm looking for a search tool which can do semantic/synonym search.
 > 
 > Can this be done via ZCatalog ?
Not out of the box.

You could place something before ZCatalog (which parses subquerie for
search term and expands them into a set of synonyms).
But you would need to work quite hard to get true semantic search...



Dieter

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: hooking up gdb (was Re: [Zope-dev] More signal 11 restarts....)

2001-12-05 Thread Dieter Maurer

Matthew T. Kromer writes:
 > ...
 > Well largely, ALL I want is the backtrace -- and I'm wondering if I 
 > could cobble something together that could get it.  The problem is it 
 > needs to look at the symbol table, and I dont know how to get at that 
 > via C -- ie, gdb doesnt have an interface that I know of that you can 
 > link in to grab a stack trace and exit.
I seem to remember that one can define gdb commands that are executed
whenever the program stops.

It this were true, we could activate such a definition in a ".gdbinit"
file and then run the program.
When the Python stops due to a signal, the command would be activated.
It would make a backtrace followed by a quit.

Not sure, it will work, though...


Dieter

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Searching

2001-12-05 Thread Dieter Maurer

Dirk Datzert writes:
 > I'm looking for a search tool which can do semantic/synonym search.
 > 
 > Can this be done via ZCatalog ?
Not out of the box.

You could place something before ZCatalog (which parses subquerie for
search term and expands them into a set of synonyms).
But you would need to work quite hard to get true semantic search...



Dieter

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Catalog wierdness ...

2001-12-05 Thread Joachim Werner

Hi!


> This isn't a Catalog error, it's a ZODB error.  It appears that your
> ZODB data has beome inconsistent.  You might want to try to run
> fsrecover.py against it after making a backup to see if it detects any
> errors.

I don't think so:

- fsrecover doesn't find anything
- the error occurs on two machines that are synched via "ZSyncer", so a
physical corruption of the ZODB is not likely
- the error ONLY occurs with ZCatalog indexing attempts

But maybe I am missing something ...

Cheers

Joachim



-


Traceback (innermost last):
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
line 224, in publish_module
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
line 187, in publish
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/Zope/__init__.py, line
226, in zpublisher_exception_hook
(Object: TransparencySupport)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
line 171, in publish
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/mapply.py,
line 160, in mapply
(Object: manage_addSmartTextBlock)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
line 112, in call_object
(Object: manage_addSmartTextBlock)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartT
extBlock.py, line 63, in manage_addSmartTextBlock
(Object: TransparencySupport)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartS
ectionElement.py, line 30, in manage_addSectionElement
(Object: TransparencySupport)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/OrderedFolder/Ordere
dObjectManager.py, line 118, in _setObject
(Object: TransparencySupport)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/OFS/ObjectManager.py,
line 330, in _setObject
(Object: TransparencySupport)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartS
ectionElement.py, line 177, in manage_afterAdd
(Object: ElementWithAttributes)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartS
ectionElement.py, line 172, in manage_routineTasks
(Object: ElementWithAttributes)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartS
ection.py, line 89, in contentIndexObject
(Object: TransparencySupport)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/Kontentor/Katalog.py
, line 130, in indexObject
(Object: LockableItem)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/ZCatalog/ZCatalog.py
, line 498, in catalog_object
(Object: LockableItem)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/ZCatalog/Catalog.py,
line 438, in catalogObject
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/TextIn
dex/TextIndex.py, line 381, in index_object
(Object: PluggableIndex)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/TextIn
dex/GlobbingLexicon.py, line 166, in getWordId
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/TextIn
dex/GlobbingLexicon.py, line 206, in assignWordId
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/Connection.py,
line 519, in setstate
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
line 588, in load
(Object: /home/ftp/root/kue-projekt/dev_8080/var/Data.fs)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
line 584, in _load
(Object: /home/ftp/root/kue-projekt/dev_8080/var/Data.fs)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
line 1905, in _loadBack
KeyError: (see above)



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



[Zope-dev] maybe we could script it (Re: hooking up gdb)

2001-12-05 Thread Leonardo Rochael Almeida

On Wed, 2001-12-05 at 18:41, Matthew T. Kromer wrote:
> Leonardo Rochael Almeida wrote:
> 
> 
> 
> Well largely, ALL I want is the backtrace -- and I'm wondering if I 
> could cobble something together that could get it.  The problem is it 
> needs to look at the symbol table, and I dont know how to get at that 
> via C -- ie, gdb doesnt have an interface that I know of that you can 
> link in to grab a stack trace and exit.
> 
> Its been a while since I prowled the gdb source.  I may not be able to 
> do anything automatic like you want -- but I sure wish that tool was 
> available!

Maybe we could script it. If we can convince python, in the event of a
SIG11, freeze every other thread and run some python function, or even
an external script, we could make this script invoke gdb with another
script (a gdb script) that would attach to the zope python process and
get a stack trace of every thread.

No need to get fancy with C.

Now the nice thing would be if I could generate a Zope package just like
the binary Zopes at zope.org, but compiled with my options (such as -g).

Speaking of options, is linux-binary-Zope-2.4.3-python still being
compiled with --pymalloc? As I mentioned before, our segfaults reduced
drastically WITHOUT it.

Cheers, Leo

PS: if anyone is wondering why I keep changing the subject in this
thread, check out this URL:
http://udell.roninhouse.com/GroupwareReport.html

-- 
Ideas don't stay in some minds very long because they don't like
solitary confinement.



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: hooking up gdb (was Re: [Zope-dev] More signal 11 restarts....)

2001-12-05 Thread Matthew T. Kromer

Leonardo Rochael Almeida wrote:

>Well, one of the things I was going to ask next was for some help doing
>postmortem.
>
>We aren't getting any core files, even after setting ulimit correctly
>(although we could be setting it uncorrectly. I'll look into that
>further). Anyway, someone else in this list said that core dumps for
>threaded apps in Linux were mostly useless, so we aren't investing much
>energy in it anyway.
>
>With the short restart times we have, I'd prever a solution that didn't
>involve keeping a dead site dead for too long (as in, debugging with
>gdb). We are working in a ZEO scheme that would switch over the
>accelerator to proxy another zeo client, but we are not there yet.
>
>It would be ideal if we could instruct python to grab the SIG11, invoke
>gdb, get a C stacktrace for all threads and let Zope die in peace. If it
>all happend in a few seconds, we will still keep the client happy.
>
>So, to answer your question, yes, I am confortable hooking up gdb. I'd
>just prefer if it could be done in as little time as possible.
>
>   Cheers, Leo
>


Well largely, ALL I want is the backtrace -- and I'm wondering if I 
could cobble something together that could get it.  The problem is it 
needs to look at the symbol table, and I dont know how to get at that 
via C -- ie, gdb doesnt have an interface that I know of that you can 
link in to grab a stack trace and exit.

Its been a while since I prowled the gdb source.  I may not be able to 
do anything automatic like you want -- but I sure wish that tool was 
available!



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



hooking up gdb (was Re: [Zope-dev] More signal 11 restarts....)

2001-12-05 Thread Leonardo Rochael Almeida

Well, one of the things I was going to ask next was for some help doing
postmortem.

We aren't getting any core files, even after setting ulimit correctly
(although we could be setting it uncorrectly. I'll look into that
further). Anyway, someone else in this list said that core dumps for
threaded apps in Linux were mostly useless, so we aren't investing much
energy in it anyway.

With the short restart times we have, I'd prever a solution that didn't
involve keeping a dead site dead for too long (as in, debugging with
gdb). We are working in a ZEO scheme that would switch over the
accelerator to proxy another zeo client, but we are not there yet.

It would be ideal if we could instruct python to grab the SIG11, invoke
gdb, get a C stacktrace for all threads and let Zope die in peace. If it
all happend in a few seconds, we will still keep the client happy.

So, to answer your question, yes, I am confortable hooking up gdb. I'd
just prefer if it could be done in as little time as possible.

Cheers, Leo

On Wed, 2001-12-05 at 18:10, Matthew T. Kromer wrote:
> 
> Leo,
> 
> Are you comfortable with hooking up gdb to Zope to try to catch this?  I 
> suspect, but do not know, that the MySQL python adapter is probably  not 
> doing something right w.r.t. memory management.  Unfortunately, it is 
> probably also the case that the problem only occurs with high-volume 
> traffic -- particularly if it is a timing related bug.
> 
> We have not been able to reproduce this problem in any deterministic way 
> -- and the only people who seem to have it are those who are heavy MySQL 
> users; it makes me think there is something in the adapter which is not 
> behaving the same way under Python 2.1 than it did under Python 1.5.2. 
>  I have not looked at the adapter, so I'm making a few guesses as what 
> is going wrong.
> 
> 
-- 
Ideas don't stay in some minds very long because they don't like
solitary confinement.



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] More signal 11 restarts....

2001-12-05 Thread Matthew T. Kromer

Leonardo Rochael Almeida wrote:

>
>It's not fixed, but we managed to make it bearable so as not to lose the
>client.
>
>by replacing LoginManager with exUserFolder we managed to bring down the
>zope restart time from 5 min (we have a HUGE Data.fs) to 20 secs, and by
>installing ZEO we brought down the restart time to between 2 and 8 secs.
>By increasing the caching of requests we managed to increase the time
>between restart from 15 min to 2 hours. That and a nicely formated
>Apache error page for Proxy Errors, for the lucky bastards who happen to
>hit the server in the exactly 2 seconds of restart, managed to calm down
>the client enough for us to breath.
>
>I'll try the requestprofiler tip Chris gave, but I don't have much hope,
>since we use mysql for authentication and the site is authenticated
>mostly everywhere.
>
>We are seriously considering droping mysql for postgresql.
>
>   Cheers, Leo
>


Leo,

Are you comfortable with hooking up gdb to Zope to try to catch this?  I 
suspect, but do not know, that the MySQL python adapter is probably  not 
doing something right w.r.t. memory management.  Unfortunately, it is 
probably also the case that the problem only occurs with high-volume 
traffic -- particularly if it is a timing related bug.

We have not been able to reproduce this problem in any deterministic way 
-- and the only people who seem to have it are those who are heavy MySQL 
users; it makes me think there is something in the adapter which is not 
behaving the same way under Python 2.1 than it did under Python 1.5.2. 
 I have not looked at the adapter, so I'm making a few guesses as what 
is going wrong.


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZPT & Plain Text

2001-12-05 Thread Martijn Faassen

Ulrich Eck wrote:
> Hi out there :)
> 
> >>How would you do repeating texts or conditional texts like this? I mean,
> >>perhaps it's obvious; I haven't played enough with ZPT yet.
> 
> Just for your info:
> 
> there is one product that tries to address this problem: TERRY
> http://www.zope.org/Members/lalo/TextTemplates
> 
> It is a modified version of TAL that doesn't use XML but
> a custom syntax:
> 
> %(tal:content="here/fgcolor" black)%
> 
> I don't now, if this makes things easier, but it would
> ensure at least the use of TALES and has similar usage.

Yes, TALES seems to be the way to go, unless we opt for a really
micro-language dedicated to do only one thing and nothing more. I'm 
unconvinced I want to explain ZPT with omit-tag etc for someone just writing
SQL, for instance, though. Looks worse and is harder to explain even
than DTML, which is bad news.

Regards,

Martijn


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] My thoughts on the development process

2001-12-05 Thread Martijn Faassen

Chris Withers wrote:
> Martijn Faassen wrote:
> > 
> > a mailing list, are needed at least to get contributors going. I had
> > to ask about releasing ParsedXML several times until I got some kind of
> > 'aye' out of anyone. And it still wasn't clear. I shouldn't have to
> > be that persistent.
> 
> Well, and now I'm being devils advocate, this is Open Source.
> "Just do it" (now where have I heard that before ;-)

That doesn't follow these guidelines:

http://dev.zope.org/Fishbowl/Introduction.html

with unclear ideas on how you actually get moved from Inception to
Eleboration to Construction. I need to post to zope-dev and then wait
for Inception->Elaboration to happen, and the 'maintainer of the software
product in question' (who do I whine to if I don't know who this is in the
first place?) will then just listen and pick up on it and do the
editorial and technical review. In practice, I am not sure if any
identifiable maintainer steps up, though I do get feedback from ZC
people.

This is more than just an 'aye', and I need to be persistent about that
already.. 

>From Elaboration->Construction I just need "if everything is in order,
a CVS branch will be created for the project team to start working on". By
whom? Do fishbowl proposals commonly make it here?

> If you do it wrong, whatever that means, someone will let you know, but you're
> not breaking any lawas and activity, as you've shown with ParsedXML, is always
> better than inactivity :-)

I agree that I should just 'do it', but I'm not following the guidelines if 
I do it, and though I'm Dutch and toleration of not following the rules is
institutional here, I also don't think it's the ideal situation. Either 
we work out who is maintainer for what and the fishbowl process for the
*maintainers* is spelled out (the fishbowl introduction focuses much more
on the artifacts to be produced than on the human aspects), or we scrap
or completely overhaul the fishbowl process as we do something else anyway.

Regards,

Martijn


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] More signal 11 restarts....

2001-12-05 Thread Leonardo Rochael Almeida

Sorry, I made an incorrect statement. see below.

On Wed, 2001-12-05 at 17:26, Leonardo Rochael Almeida wrote:
> Hi Harald,
> 
> On Wed, 2001-12-05 at 14:32, Harald Koschinski wrote:
> > Daniel Duclos wrote:
> > 
> > >   I have a zope that is dumping signal 11 every 40 minutes or so. I have tried 
> > >recompile python 2.1.1 with-threads without-pymalloc, recompile Zope with it, 
> > >recompile ZPAtterns, recompile and instal MYSQL for Python 0.9.1, upgraded to 
> > >Zope 2.4.3, all this on a Debian Linux box.
> > >   Nothing changed... still restarting...
> > >   Anybody, please, has any ideia on this matter?
> > >   Please, let me know if there's any relevant info that I forgot to mention 
> > >abot my case!
> > >   Thanks in advance!!
> > >
> > 
> > I have the same problem since we are live :-(((
> > 
> > I have the same versions running like you and I tried  the same to fix - 
> > but no change.
> > 
> > What is your state with this problem. Fixed ? How?
> 
> It's not fixed, but we managed to make it bearable so as not to lose the
> client.
> 
> by replacing LoginManager with exUserFolder we managed to bring down the
> zope restart time from 5 min (we have a HUGE Data.fs) to 20 secs, and by
> installing ZEO we brought down the restart time to between 2 and 8 secs.
> By increasing the caching of requests we managed to increase the time
> between restart from 15 min to 2 hours.

that is incorrect. by recompiling Python without pymalloc we increased
the time between restart from 15 min to 40 min, and by caching SQL
requests we increased the time further to 2h between restarts.

> That and a nicely formated
> Apache error page for Proxy Errors, for the lucky bastards who happen to
> hit the server in the exactly 2 seconds of restart, managed to calm down
> the client enough for us to breath.
> 
> I'll try the requestprofiler tip Chris gave, but I don't have much hope,
> since we use mysql for authentication and the site is authenticated
> mostly everywhere.
> 
> We are seriously considering droping mysql for postgresql.
> 

-- 
Ideas don't stay in some minds very long because they don't like
solitary confinement.



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] More signal 11 restarts....

2001-12-05 Thread Leonardo Rochael Almeida

Hi Harald,

On Wed, 2001-12-05 at 14:32, Harald Koschinski wrote:
> Daniel Duclos wrote:
> 
> > I have a zope that is dumping signal 11 every 40 minutes or so. I have tried 
> >recompile python 2.1.1 with-threads without-pymalloc, recompile Zope with it, 
> >recompile ZPAtterns, recompile and instal MYSQL for Python 0.9.1, upgraded to 
> >Zope 2.4.3, all this on a Debian Linux box.
> > Nothing changed... still restarting...
> > Anybody, please, has any ideia on this matter?
> > Please, let me know if there's any relevant info that I forgot to mention 
> >abot my case!
> > Thanks in advance!!
> >
> 
> I have the same problem since we are live :-(((
> 
> I have the same versions running like you and I tried  the same to fix - 
> but no change.
> 
> What is your state with this problem. Fixed ? How?

It's not fixed, but we managed to make it bearable so as not to lose the
client.

by replacing LoginManager with exUserFolder we managed to bring down the
zope restart time from 5 min (we have a HUGE Data.fs) to 20 secs, and by
installing ZEO we brought down the restart time to between 2 and 8 secs.
By increasing the caching of requests we managed to increase the time
between restart from 15 min to 2 hours. That and a nicely formated
Apache error page for Proxy Errors, for the lucky bastards who happen to
hit the server in the exactly 2 seconds of restart, managed to calm down
the client enough for us to breath.

I'll try the requestprofiler tip Chris gave, but I don't have much hope,
since we use mysql for authentication and the site is authenticated
mostly everywhere.

We are seriously considering droping mysql for postgresql.

Cheers, Leo

-- 
Ideas don't stay in some minds very long because they don't like
solitary confinement.



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] More signal 11 restarts....

2001-12-05 Thread Chris McDonough

You folks should turn on "big M" logging (via -M) and see if you see a
pattern to when the system dumps core.  You can use the
utilities/requestprofiler script to analyze the big M log.

- Original Message -
From: "Harald Koschinski" <[EMAIL PROTECTED]>
To: "Daniel Duclos" <[EMAIL PROTECTED]>; "zope-dev"
<[EMAIL PROTECTED]>
Sent: Wednesday, December 05, 2001 11:32 AM
Subject: Re: [Zope-dev] More signal 11 restarts


> Daniel Duclos wrote:
>
> > I have a zope that is dumping signal 11 every 40 minutes or so. I
have tried
> >recompile python 2.1.1 with-threads without-pymalloc, recompile
Zope with it,
> >recompile ZPAtterns, recompile and instal MYSQL for Python 0.9.1,
upgraded to
> >Zope 2.4.3, all this on a Debian Linux box.
> > Nothing changed... still restarting...
> > Anybody, please, has any ideia on this matter?
> > Please, let me know if there's any relevant info that I forgot to
mention
> >abot my case!
> > Thanks in advance!!
> >
>
> I have the same problem since we are live :-(((
>
> I have the same versions running like you and I tried  the same to
fix -
> but no change.
>
> What is your state with this problem. Fixed ? How?
>
> regards
>
> Harald
>
>
>
>
> ___
> Zope-Dev maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope )
>


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Searching/Indexing/ZODB/SQL/BerkleyDB

2001-12-05 Thread Wolfram Kerber


> Wolfram Kerber wrote:
> >
> > Could you explain the problems that should be solved by this a little?
>
> The idea is to provide a flexible, scalable and powerful indexing solution
that
> works out of the box for Python, rather than Zope.
>
> > I
> > find it rather hard to contribute anything useful without knowing some
> > concrete examples ...
>
> Hehe, wait for the docs, which I'm hopefully gonna start checking in
today...
>
> > Btw, i have a prototype Catalog that speeds up things a bit in usual
> > scenarios. It is cacheable, implements an extended query interface and
> > solves two performance issues with certain queries. I intend to put that
> > into a proposal :-), but probably not until next week. If anybody wants
to
> > discuss that and/or take a look, just mail me.
>
> Well, I'd love to see this, where can I get the code?
>

Ok, i've put it here :
http://www.gallileus.info/gallileus/members/m_wolf/publications/100756611705
/10075665840/protoCat.zip

I should put together some doc about the changes as well ...


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] absolute_url FTP upload and CatalogAware

2001-12-05 Thread Steve Alexander

Niclas Kuehne wrote:

> When I upload a file of a certain class (HTMLDocument) that is 
> CatalogAware the entry in the catalog does not contain the real 
> absolute_url. Instead it shows 
> "http://myserver:21/Zope/Dir1/Dir2/object.html"; where "myserver" is the 
> hostname of the linux server, 21 is the FTP port used by Zope and Dir1 & 
> Dir2 are directories. When I clear the catalog and add the documents by 
> clicking "Find Objects" the absolute_url is correct. What is happening 
> here? Any help?


Please don't post in HTML to this mailing list.

Please do not post to both the zope-dev and [EMAIL PROTECTED] lists.



The problem is that you are using CatalogAware. Try using 
CatalogPathAware in its place.

The CatalogAware mixin was written before Zope was improved to cope with 
virtual hosting.

The replacement is CatalogPathAware, with CatalogAware kept around to 
support legacy systems.

--
Steve Alexander



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] More signal 11 restarts....

2001-12-05 Thread Harald Koschinski

Daniel Duclos wrote:

>   I have a zope that is dumping signal 11 every 40 minutes or so. I have tried 
>recompile python 2.1.1 with-threads without-pymalloc, recompile Zope with it, 
>recompile ZPAtterns, recompile and instal MYSQL for Python 0.9.1, upgraded to 
>Zope 2.4.3, all this on a Debian Linux box.
>   Nothing changed... still restarting...
>   Anybody, please, has any ideia on this matter?
>   Please, let me know if there's any relevant info that I forgot to mention 
>abot my case!
>   Thanks in advance!!
>

I have the same problem since we are live :-(((

I have the same versions running like you and I tried  the same to fix - 
but no change.

What is your state with this problem. Fixed ? How?

regards

Harald




___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



[Zope-dev] absolute_url FTP upload and CatalogAware (PLAIN TEXT!)

2001-12-05 Thread Niclas Kuehne

When I upload a file of a certain class (HTMLDocument) that is 
CatalogAware the entry in the catalog does not contain the real 
absolute_url. Instead it shows 
"http://myserver:21/Zope/Dir1/Dir2/object.html"; where "myserver" 
is the hostname of the linux server, 21 is the FTP port used by 
Zope and Dir1 & Dir2 are directories. When I clear the catalog 
and add the documents by clicking "Find Objects" the 
absolute_url is correct. What is happening here? Any help?

Niclas Kuehne 
Reply to: [EMAIL PROTECTED]

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZPT & Plain Text

2001-12-05 Thread Chris Withers

Steve Alexander wrote:
> 
> I guess you'd need to have a special page template interpreter that
> knows that it isn't putting out SGML-style stuff.

Indeed, you can, of course, use < amd & in the meantime if the HTML
parser in ZPT does barf (which maybe it shouldn't?)

Sounds like the content type in a page template could be very useful:

if content_type='text/plain':
  self._parser = PlainTextTagParser()
  self._alls_ommit_tags=1

cheers,

Chris

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Catalog wierdness ...

2001-12-05 Thread Chris McDonough

This isn't a Catalog error, it's a ZODB error.  It appears that your
ZODB data has beome inconsistent.  You might want to try to run
fsrecover.py against it after making a backup to see if it detects any
errors.

- Original Message -
From: "Joachim Werner" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Wednesday, December 05, 2001 11:16 AM
Subject: [Zope-dev] Catalog wierdness ...


> Hi!
>
> Any ZCatalog experts out there?
>
> I am suddenly getting this with a ZCatalog (it is actually a
subclassed
> version of the ZCatalog, almost a one-to-one copy of the CMF Catalog
tool):
>
> --
>
> Zope Error
> Zope has encountered an error while publishing this resource.
>
> Error Type: KeyError
> Error Value: -"
>
>
>
> 

> 
>
> Troubleshooting Suggestions
>
> This resource may be trying to reference a nonexistent object or
variable -
> ".
> The URL may be incorrect.
> The parameters passed to this resource may be incorrect.
> A resource that this resource relies on may be encountering an
error.
> For more detailed information about the error, please refer to the
HTML
> source for this page.
>
> If the error persists please contact the site maintainer. Thank you
for your
> patience.
>
>
> Traceback (innermost last):
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
> line 224, in publish_module
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
> line 187, in publish
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Zope/__init__.py, line
> 226, in zpublisher_exception_hook
> (Object: TransparencySupport)
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
> line 171, in publish
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/mapply.py,
> line 160, in mapply
> (Object: manage_addSmartTextBlock)
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
> line 112, in call_object
> (Object: manage_addSmartTextBlock)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/
SmartT
> extBlock.py, line 63, in manage_addSmartTextBlock
> (Object: TransparencySupport)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/
SmartS
> ectionElement.py, line 30, in manage_addSectionElement
> (Object: TransparencySupport)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/OrderedFolder/
Ordere
> dObjectManager.py, line 118, in _setObject
> (Object: TransparencySupport)
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/OFS/ObjectManager.py,
> line 330, in _setObject
> (Object: TransparencySupport)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/
SmartS
> ectionElement.py, line 177, in manage_afterAdd
> (Object: ElementWithAttributes)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/
SmartS
> ectionElement.py, line 172, in manage_routineTasks
> (Object: ElementWithAttributes)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/
SmartS
> ection.py, line 89, in contentIndexObject
> (Object: TransparencySupport)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/Kontentor/Kata
log.py
> , line 130, in indexObject
> (Object: LockableItem)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/ZCatalog/ZCata
log.py
> , line 498, in catalog_object
> (Object: LockableItem)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/ZCatalog/Catal
og.py,
> line 438, in catalogObject
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/
TextIn
> dex/TextIndex.py, line 381, in index_object
> (Object: PluggableIndex)
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/
TextIn
> dex/GlobbingLexicon.py, line 166, in getWordId
>   File
>
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/
TextIn
> dex/GlobbingLexicon.py, line 206, in assignWordId
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/Connection.py,
> line 519, in setstate
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
> line 588, in load
> (Object: /home/ftp/root/kue-projekt/dev_8080/var/Data.fs)
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
> line 584, in _load
> (Object: /home/ftp/root/kue-projekt/dev_8080/var/Data.fs)
>   File
/home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
> line 1905, in _loadBack
> KeyError: (see above)
>
>
> -
>
>
> Very strange, as it seems to be a rather low-level error. Any hints?
>
> Joachim
>
>
>
>
> ___
> Zope-Dev maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists -
>  http:/

[Zope-dev] absolute_url FTP upload and CatalogAware

2001-12-05 Thread Niclas Kuehne
Title: absolute_url FTP upload and CatalogAware






When I upload a file of a certain class (HTMLDocument) that is CatalogAware the entry in the catalog does not contain the real absolute_url. Instead it shows "http://myserver:21/Zope/Dir1/Dir2/object.html" where "myserver" is the hostname of the linux server, 21 is the FTP port used by Zope and Dir1 & Dir2 are directories. When I clear the catalog and add the documents by clicking "Find Objects" the absolute_url is correct. What is happening here? Any help?

Niclas Kuehne
Reply to: [EMAIL PROTECTED]






___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists -
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )


[Zope-dev] Catalog wierdness ...

2001-12-05 Thread Joachim Werner

Hi!

Any ZCatalog experts out there?

I am suddenly getting this with a ZCatalog (it is actually a subclassed
version of the ZCatalog, almost a one-to-one copy of the CMF Catalog tool):

--

Zope Error
Zope has encountered an error while publishing this resource.

Error Type: KeyError
Error Value: -"






Troubleshooting Suggestions

This resource may be trying to reference a nonexistent object or variable -
".
The URL may be incorrect.
The parameters passed to this resource may be incorrect.
A resource that this resource relies on may be encountering an error.
For more detailed information about the error, please refer to the HTML
source for this page.

If the error persists please contact the site maintainer. Thank you for your
patience.


Traceback (innermost last):
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
line 224, in publish_module
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
line 187, in publish
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/Zope/__init__.py, line
226, in zpublisher_exception_hook
(Object: TransparencySupport)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
line 171, in publish
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/mapply.py,
line 160, in mapply
(Object: manage_addSmartTextBlock)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZPublisher/Publish.py,
line 112, in call_object
(Object: manage_addSmartTextBlock)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartT
extBlock.py, line 63, in manage_addSmartTextBlock
(Object: TransparencySupport)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartS
ectionElement.py, line 30, in manage_addSectionElement
(Object: TransparencySupport)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/OrderedFolder/Ordere
dObjectManager.py, line 118, in _setObject
(Object: TransparencySupport)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/OFS/ObjectManager.py,
line 330, in _setObject
(Object: TransparencySupport)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartS
ectionElement.py, line 177, in manage_afterAdd
(Object: ElementWithAttributes)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartS
ectionElement.py, line 172, in manage_routineTasks
(Object: ElementWithAttributes)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/SmartSections/SmartS
ection.py, line 89, in contentIndexObject
(Object: TransparencySupport)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/Kontentor/Katalog.py
, line 130, in indexObject
(Object: LockableItem)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/ZCatalog/ZCatalog.py
, line 498, in catalog_object
(Object: LockableItem)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/ZCatalog/Catalog.py,
line 438, in catalogObject
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/TextIn
dex/TextIndex.py, line 381, in index_object
(Object: PluggableIndex)
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/TextIn
dex/GlobbingLexicon.py, line 166, in getWordId
  File
/home/ftp/root/kue-projekt/dev_8080/lib/python/Products/PluginIndexes/TextIn
dex/GlobbingLexicon.py, line 206, in assignWordId
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/Connection.py,
line 519, in setstate
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
line 588, in load
(Object: /home/ftp/root/kue-projekt/dev_8080/var/Data.fs)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
line 584, in _load
(Object: /home/ftp/root/kue-projekt/dev_8080/var/Data.fs)
  File /home/ftp/root/kue-projekt/dev_8080/lib/python/ZODB/FileStorage.py,
line 1905, in _loadBack
KeyError: (see above)


-


Very strange, as it seems to be a rather low-level error. Any hints?

Joachim




___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Searching/Indexing/ZODB/SQL/BerkleyDB

2001-12-05 Thread Chris Withers

Casey Duncan wrote:
> 
> I posted a few references I found around the web on
> info retrieval and indexing to the s'forge doc area.

SF understands HTML, not structured text ;-)

> I
> think Chris'll need to "approve" them first I think
> before they are publically accessible.

Yeah, you can do this now too...

> Chris: Do I have commit privs to the CVS? If so, I'll
> start helping out with some requirements and whatever
> other documentation we need.

You do now :-) Please have a look at the 'Documentation' module and commit any
changes you wanna make on a branch :-)

> Also, we should probably create a prototypes or
> some-such directory in the CVS for existing code.

I've created a SourceForge Tracker for this and put up mine and Marcus' Collins'
prototype SQLIndexer there...

> I
> have a couple of things that can go up there for
> reference or just as samples.

Cool :-)

> Also Chris, please create a mailing list for the
> project. 

http://lists.sourceforge.net/mailman/listinfo/pythonindexer-discuss

Can anyone who's interested please sign up to that...

cheers,

Chris

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZPT & Plain Text

2001-12-05 Thread Steve Alexander

Chris Withers wrote:

>
> Chris -- more and more a ZPT-ONLY! fan each day...


How would you email someone some output from the Python interactive 
interpreter?

In other words, how do you get a naked < or > or & in a plain-text ZPT?

I guess you'd need to have a special page template interpreter that 
knows that it isn't putting out SGML-style stuff.

--
Steve Alexander



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Wild and crazzzzy idea: Hierarchial permissions

2001-12-05 Thread Adrian Hungate

Limiting the list of products in the Add Object list can be done currently
using my PatchKit product - http://www.zope.org/Members/haqa/PatchKit

(It does some other stuff too)

Adrian...
- Original Message -
From: "Oliver Bleutgen" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Thursday, November 22, 2001 12:22 PM
Subject: Re: [Zope-dev] Wild and cray idea: Hierarchial permissions


Lennart Regebro wrote:

> The list of permissions is getting quite long. It's the basic permissions
of
> Zope, plus the ones for our CM system. And we haven't even integrated CMF
> with it (which we may or may not do in the future).
>
> To make things easier to find we have names all our permissions "Easy
> ". I then got the idea that the permission list could be
> hierarchial or filtered or grouped or something. All permissions would
have
> another setting to specify it group. That way the Zope base permissions
> could be grouped together into a "Zope Base" persmission group. We could
> group our in an "Torped Easy Publisher" permission group, and so on.
>
> Good idea or stupid?

Well, for your use you could just hardcode some permission "groups" and
include them in the dtml-file which resembles zopes security screen.
A little bit javascript and selecting one of your groups would
automagically be checked when you check one of your groups.

What I'm missig more is flexibility for the "Add object" mechanism.
The possibility to install products not globally, but locally for a
folder and it's subfolders and some hierachical sorting of "add type"
selectbox.
Perhaps the tree could be (ab-)used to get a structure like

+ text product
- DTML Document
- DTML Method
+ Images, Files
- Image
- File
+ SQL Stuff
- ZSQL Method
- PoPy Database Connection
- Search Interface

etc

To get back to the topic, perhaps your wishes and mine could be
combined: A permissions group for "edit text products" which would
automatically select the right permissions.

cheers,
oliver





___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists -
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Searching/Indexing/ZODB/SQL/BerkleyDB

2001-12-05 Thread Casey Duncan

I posted a few references I found around the web on
info retrieval and indexing to the s'forge doc area. I
think Chris'll need to "approve" them first I think
before they are publically accessible.

Chris: Do I have commit privs to the CVS? If so, I'll
start helping out with some requirements and whatever
other documentation we need.

Also, we should probably create a prototypes or
some-such directory in the CVS for existing code. I
have a couple of things that can go up there for
reference or just as samples.

Also Chris, please create a mailing list for the
project. And grant me admin to whatever you want to, I
can certainly help administer the project as well.

ttfn,

Casey

--- Chris Withers <[EMAIL PROTECTED]> wrote:
> Casey Duncan wrote:
> > 
> > Chris, hows about adding me to this project, my
> > s'forge username is cduncan.
> 
> done... lemme know if ya need anything else :-)
> 
> Chris
> 
> 


__
Do You Yahoo!?
Buy the perfect holiday gifts at Yahoo! Shopping.
http://shopping.yahoo.com

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZPT & Plain Text

2001-12-05 Thread Leonardo Rochael Almeida

I was about to mention TERRY, but Ulrich beat me to it.

One nice thing about TERRY is that it allows you to change the markup
simbols. For instance it is entirely possible to use:

(which, by the way, is a semi-standard way to do extentions to html and
looks like php escapes)
instead of
%(tal:content="here/fgcolor" black)%

However I think there still isn't an easy, thru the web, way to change
the markup signals.

On Wed, 2001-12-05 at 09:41, Ulrich Eck wrote:
> Hi out there :)
> 
> >>
> >> How would you do repeating texts or conditional texts like this? I mean,
> >> perhaps it's obvious; I haven't played enough with ZPT yet.
> >
> 
> Just for your info:
> 
> there is one product that tries to address this problem: TERRY
> http://www.zope.org/Members/lalo/TextTemplates
> 
> It is a modified version of TAL that doesn't use XML but
> a custom syntax:
> 
> %(tal:content="here/fgcolor" black)%
> 
> I don't now, if this makes things easier, but it would
> ensure at least the use of TALES and has similar usage.
> 
> >
> >> I also think this looks rather unnatural when doing email templates or
> >> SQL templates.
> >
> > I used to think that, I'm quickly changing positions. Perhaps the only
> > option I'd like is a check box somewhere on the template object saying
> > something like "always include tal:omit-tag by default. Then I reckon it
> > could do for everything :-)
> >
> > cheers,
> >
> > Chris -- more and more a ZPT-ONLY! fan each day...
> 
> 
> YES :)))  One Template-Language for all: ZPT
> .. and one Expression Syntax as well: TALES ..

-- 
Ideas don't stay in some minds very long because they don't like
solitary confinement.



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZPT & Plain Text

2001-12-05 Thread Ulrich Eck

Hi out there :)

>>
>> How would you do repeating texts or conditional texts like this? I mean,
>> perhaps it's obvious; I haven't played enough with ZPT yet.
>

Just for your info:

there is one product that tries to address this problem: TERRY
http://www.zope.org/Members/lalo/TextTemplates

It is a modified version of TAL that doesn't use XML but
a custom syntax:

%(tal:content="here/fgcolor" black)%

I don't now, if this makes things easier, but it would
ensure at least the use of TALES and has similar usage.

>
>> I also think this looks rather unnatural when doing email templates or
>> SQL templates.
>
> I used to think that, I'm quickly changing positions. Perhaps the only
> option I'd like is a check box somewhere on the template object saying
> something like "always include tal:omit-tag by default. Then I reckon it
> could do for everything :-)
>
> cheers,
>
> Chris -- more and more a ZPT-ONLY! fan each day...


YES :)))  One Template-Language for all: ZPT
.. and one Expression Syntax as well: TALES ..

cheers

Ulrich Eck
---
net-labs Systemhaus GmbH
Ebersberger Str. 46
85570 Markt Schwaben
fon:   +49-8121-4747-11
fax:   +49-8121-4747-77
email: [EMAIL PROTECTED]
http://www.net-labs.de

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZPT & Plain Text

2001-12-05 Thread Chris Withers

Martijn Faassen wrote:
> 
> How would you do repeating texts or conditional texts like this? I mean,
> perhaps it's obvious; I haven't played enough with ZPT yet.

repeat:


I am 


condition:


You have  objects in your basket


Your basket is empty


> I also think this looks rather unnatural when doing email templates or SQL
> templates.

I used to think that, I'm quickly changing positions. Perhaps the only option
I'd like is a check box somewhere on the template object saying something like
"always include tal:omit-tag by default. Then I reckon it could do for
everything :-)

cheers,

Chris -- more and more a ZPT-ONLY! fan each day...

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Zope Exceptions and translation

2001-12-05 Thread Andre Schubert

Seb Bacon schrieb:
> 
> From: Trevor Toenjes <[EMAIL PROTECTED]>
> 
> > This proposal is dead-on to make the errors more accessible and
> > customizable.  This is the solution to some of my previous error_message
> > threads.
> >
> > How do we move this from proposal to project?
> 
> We need to define the scope very clearly.  Please add your ideas to the Wiki 
> :)

I have added my ideas to the wiki, i hope all english-speaking poeple
understand it. :)

thanks

> 
> > Why not start with a less ambitious first phase of opening up Exceptions
> > control as a "product".  How about a Folder attribute or a
> > standard_error_message controller?
> 
> This is a very good idea.  One risk is that because it should work with
> string-based exceptions, it might *encourage* people to continue to work
> with string-based exceptions.
> 
> We would also need to fix the 'errors outside html' and 'hardcoded errors'
> problems as part of the project, I think.
> 
> seb
> 
> ___
> Zope-Dev maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope )

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] My thoughts on the development process

2001-12-05 Thread Chris Withers

Martijn Faassen wrote:
> 
> a mailing list, are needed at least to get contributors going. I had
> to ask about releasing ParsedXML several times until I got some kind of
> 'aye' out of anyone. And it still wasn't clear. I shouldn't have to
> be that persistent.

Well, and now I'm being devils advocate, this is Open Source. "Just do it" (now
where have I heard that before ;-)
If you do it wrong, whatever that means, someone will let you know, but you're
not breaking any lawas and activity, as you've shown with ParsedXML, is always
better than inactivity :-)

> Anyway, I'm not really complaining about ZC; I have a lot of
> admiration for what you're doing and the steps you've already taken are
> not mere baby steps at all from my perspective. 

+5 

It feels like Zope's had a huge shot in the arm in the last few days, so I guess
we need to send AKM some beer... ;-)

cheers,

Chris

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Searching/Indexing/ZODB/SQL/BerkleyDB

2001-12-05 Thread Chris Withers

Wolfram Kerber wrote:
> 
> Could you explain the problems that should be solved by this a little?

The idea is to provide a flexible, scalable and powerful indexing solution that
works out of the box for Python, rather than Zope.

> I
> find it rather hard to contribute anything useful without knowing some
> concrete examples ...

Hehe, wait for the docs, which I'm hopefully gonna start checking in today...

> Btw, i have a prototype Catalog that speeds up things a bit in usual
> scenarios. It is cacheable, implements an extended query interface and
> solves two performance issues with certain queries. I intend to put that
> into a proposal :-), but probably not until next week. If anybody wants to
> discuss that and/or take a look, just mail me.

Well, I'd love to see this, where can I get the code?

cheers,

Chris

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )