RE: [Zope-dev] Cache growing during single REQUEST
Tim Peters wrote at 2003-9-14 16:40 -0400: ... [Dieter Maurer] Whoever wants to use it right now: the no more ReadConflictErrors patch on http://www.dieter.handshake.de/pyprojects/zope does precisely this (for storages that support history information). How has that been working out for people (not limited to Dieter)? It works fine for us. We are working on a content management system with tens of thousands of large SGML/XML documents. My colleague likes to make parallel imports. Before the patch, cataloguing (using an improved version of Shane's QueueCatalog) did almost not proceed due to an incredible amount of ReadConflictErrors. After the patch, there are occasional WriteConflictErrors (caused by the catalog BTrees performing conflict resolution only at the leaf level), but in general the system is stable. We now use it also in production systems without problems. That's indeed what we're after, although Jeremy has in mind deeper/broader changes aimed at being more efficient than digging thru history. The history is consulted only rarely (only when the current state is too young). However, in this case, the pickled data is read twice. Of course, I do not mind when it gets more efficient... Dieter ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Communication between Zserver and ZPublisher
Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets? I have a problem with hanging connections (for more than 1s) on the debug screen in zopes control panel and when all connections are jammed zope freezes. I need to find out where the connections gets stuck and why there is no timeout (i even tried to hack in the timeoutsocket module without any effect). I think i need to debug this on the os level to find out what these blocked connections are doing. But since i'm no unix system administrator i really don't know where i should start my investigation. thanks, Alexander Schad Alexander G. Schad (Project Manager) beehive KG mailto: [EMAIL PROTECTED] http://www.beehive-eu.com ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Cache growing during single REQUEST
Tim Peters wrote: Probably none for many apps. You'll be working with possibly non-current data, so think of ways your apps could possibly be damaged by that. For example, you're Bill Gates, using ZODB to track all your assets. A summary report takes hours to generate, and by the time you get it, perhaps a few of your billion-dollar overseas accounts were wiped out in the wee hours by an adverse court judgment, but the total you get added in the account values as of the time the report-generating transaction began. Oops. To the extent that MVCC hides that you're working with non-current data, to that extent also does an app relying on current data become vulnerable. When Bill is contemplating fleeing the country during turbulent times, he presumably needs to know how much cash he has right now, not what he had last night. Most apps aren't like that, but a one-size-fits-all policy for long-running transactions (like Bill's) doesn't exist. Ah, okay. That all makes sense... Of course, Bill may appreciate having a report that says based on data no newer than X where X is the time the transaction to generate the report started, rather than no report at all due to lots of read conflicts ;-) Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Communication between Zserver and ZPublisher
Alexander Schad wrote: Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets? Neither, AFAIK. I have a problem with hanging connections (for more than 1s) on the debug screen in zopes control panel and when all connections are jammed zope freezes. You using relational databases at all? What do the hung threads say they're doing on the debug info panel? cheers, Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Communication between Zserver and ZPublisher
At 13:17 15.09.2003 +0100, Chris Withers wrote:
Alexander Schad wrote:
Hi all,
I'd like to understand how the communication between the ZServer and the
ZODB
works. As far as i know the ZServer (Web server) talks to the ZPublisher
(ORB)
to get the Requested Object. But do they communicate via tcpip sockets or
unix sockets?
Neither, AFAIK.
I have a problem with hanging
connections (for more than 1s) on the debug
screen in zopes control panel and when all connections are jammed zope
freezes.
You using relational databases at all?
Yes an oracle DB and i'm using an external session service to store and
retrieve
session data using the httplib.
What do the hung threads say
they're doing on the debug info panel?
for example:
Connections:
Fri Sep 12 10:28:09 2003 (11650.65s) ({'HTTP_ACCEPT_ENCODING':
'gzip,deflate,compress;q=0.9', 'SERVER_PORT': '', 'PATH_TRANSLATED':
...
thanx,
Alex
cheers,
Chris
Alexander G. Schad (Project
Manager) beehive
KG
mailto:
[EMAIL PROTECTED]
http://www.beehive-eu.com
___
Zope-Dev maillist - [EMAIL PROTECTED]
http://mail.zope.org/mailman/listinfo/zope-dev
** No cross posts or HTML encoding! **
(Related lists -
http://mail.zope.org/mailman/listinfo/zope-announce
http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Communication between Zserver and ZPublisher
Alexander Schad wrote:
Yes an oracle DB and i'm using an external session service to store and
retrieve
session data using the httplib.
I think using httplib to return session data is risk to put it mildly. I'd put
money on the fact that it's either that or your ORacle query that's hanging...
What do the hung threads say they're doing on the debug info panel?
for example:
* Connections:
* Fri Sep 12 10:28:09 2003 (11650.65s) ({'HTTP_ACCEPT_ENCODING':
'gzip,deflate,compress;q=0.9', 'SERVER_PORT': '',
'PATH_TRANSLATED': ...
Well, yeah, the result of that would be helpful...
Chris
___
Zope-Dev maillist - [EMAIL PROTECTED]
http://mail.zope.org/mailman/listinfo/zope-dev
** No cross posts or HTML encoding! **
(Related lists -
http://mail.zope.org/mailman/listinfo/zope-announce
http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Communication between Zserver and ZPublisher
On Mon, Sep 15, 2003 at 01:49:50PM +0200, Alexander Schad wrote: Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets? They communicate by Python Method call :) From 100km overhead it looks like that: ZServer gets a request, handles all the protocol specific stuff, and gives it to ZPublisher. ZPublisher than gets the application object it publishes and traverses the tree to find the right method to call. The application object is usually (in the Zope case) fetched from the ZODB. Andreas Kostyrka ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Etag support in page templates
Tres Seaver wrote: The empty E-tag exists to support *very* broken clients (MSOffice over WebFolders); it should be removed, perhaps with a knob which allows re-enabling it for the sites that actually have people editing content using those clients. Yeah it should be removed, but I'd say don't provide any way to add it back (apart from maybe some textual instructions in the doc directory or something). The thing that continues to baffle me is why people add braindamage like this to Zope at all. Its not the correct place to add dumb workarounds for dumber clients, the correct place is to use an external program that wraps the clean conversation and inserts this junk on the fly. I bet you could do it with apache's mod_headers for example. Same story for that MS-Author-Via junk. Poluting Zope's source code isn't the right answer. -- Jamie Heilman http://audible.transient.net/~jamie/ You came all this way, without saying squat, and now you're trying to tell me a '56 Chevy can beat a '47 Buick in a dead quarter mile? I liked you better when you weren't saying squat kid. -Buddy ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] Etag support in page templates
On Sun, 2003-09-14 at 22:59, Bjorn Stabell wrote: Dieter wrote: Please read the HTTP 1.1 spec... Caching requires either an ETag or Last-Modified header. For good reasons... That would explain why it never got fixed, but that's not how I understand the RFC: http://www.w3.org/Protocols/rfc2616/rfc2616.html I reread the HTTP 1.1 spec and you are right. Section 13.4 allows any successful response to be cached unless prohibited by a cache-control directive, while it does not expect caching if there is neither a cache validator (ETag, Last-Modified) nor an expiration time. Dieter ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] AW: [Summary] Caching prob with AHCM and headers
On Mon, Sep 15, 2003 at 01:14:51PM +0100, Chris Withers wrote: Fred Yankowski wrote: But I can't see how to create more restrictive Predicate. My initial attempt was to set Predicate like so: python: content.meta_type == 'Filesystem Image' Do you have any content with this metatype? There is nothing in the portal_catalog with that meta_type. But there are lots of objects with that type: most everything in portal_skins/plone_images/, for example. -- Fred Yankowski [EMAIL PROTECTED] tel: +1.630.879.1312 OntoSys, IncPGP keyID: 7B449345fax: +1.630.879.1370 www.ontosys.com 38W242 Deerpath Rd, Batavia, IL 60510-9461, USA ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
