Re: [Zope-dev] where is Zope 2.5.1?

2002-03-14 Thread Toby Dickenson

On 13 Mar 2002 16:44:25 -0300, Leonardo Rochael Almeida
[EMAIL PROTECTED] wrote:

The problem is, as far as I could check, the crashes all happen inside
the gc, which runs orthogonal to the requests, so getting a
reproduceable test case is really hard.

Thinking aloud If I remember correctly (but its been a while since
I looked at the python gc) it is possible to manually force a gc
sweep.

It may (or may not ;-) be easier to spot a pattern if you force a
sweep after every request



Toby Dickenson
[EMAIL PROTECTED]

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists -
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



RE: [Zope-dev] where is Zope 2.5.1?

2002-03-13 Thread Leonardo Rochael Almeida

On Wed, 2002-03-13 at 13:03, Brian Lloyd wrote:
 We are trying to get to the bottom of a few straggling
 instability reports, so we're planning to go ahead with
 a b2 as soon as we've either a) figured out and fixed them
 b) figured them out and found it wasn't a Zope core problem
 or c) decide that we can't make enough progress in a
 reasonable time to continue holding up the release.

Is there anything that we with unstable Zopes can do to help?

-- 
Ideas don't stay in some minds very long because they don't like
solitary confinement.


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



RE: [Zope-dev] where is Zope 2.5.1?

2002-03-13 Thread Leonardo Rochael Almeida

On Wed, 2002-03-13 at 14:04, Brian Lloyd wrote:
 
 The best way to help is to help get this (these) down to 
 a minimal, reproducable test case.

The problem is, as far as I could check, the crashes all happen inside
the gc, which runs orthogonal to the requests, so getting a
reproduceable test case is really hard.

 Getting there can be 
 tricky, but there are some things that we can try to find 
 out:
 
   - In the logs, is there any pattern to what is being 
 accessed at the time of the crash? If there is a 
 particular object or objects that seems to often be 
 the last accessed before a crash, we can start looking 
 at what PythonScripts the object uses.

No, crashes happen all over the map (most of the site runs the same
python scripts for authentication and inside ZClass instances)

 
   - Use the big M log to try to narrow down exactly what 
 is happening at the time of the crash.

Will do, but since the crashes happen all over the map, I don't think
we'll be able to get much out of it

   - Ensure that you are getting absolutely no python scripts 
 need to be recompiled messages

Check!

 
   - Absolutely eliminate SQL db access as a cause (it sounds 
 like we have proof of this now)

Check!


As someone else mentioned on this list, maybe if we could force the gc
to collect alligned with the requests (say, in the first phase of the
two-phase-commit transaction engine, or after the second phase) we could
get the crashes to be reproduceable, or at least more localized.

Also, as I pointed out before, since '-t 1' solves the crashes, if we
could incrementally reduce the contention area around the code, by
putting and successively removing locks around certain sections, we
might be able to track it down.

The problem is, I don't know enough about Zope code to know how to do
any of those things, and I suspect the other folks with crashes are in
the same situation.

Cheers, Leo

-- 
Ideas don't stay in some minds very long because they don't like
solitary confinement.


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



RE: [Zope-dev] where is Zope 2.5.1?

2002-03-13 Thread Andy Dustman

On Wed, 2002-03-13 at 12:04, Brian Lloyd wrote:

   - Absolutely eliminate SQL db access as a cause (it sounds 
 like we have proof of this now)

This sounds like it is not specific to any DA. Is that the case?

-- 
Andy Dustman PGP: 0x930B8AB6
@   .net http://dustman.net/andy
You can have my keys when you pry them from my dead, cold neurons.


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



RE: [Zope-dev] where is Zope 2.5.1?

2002-03-13 Thread Brian Lloyd

- Absolutely eliminate SQL db access as a cause (it sounds 
  like we have proof of this now)
 
 This sounds like it is not specific to any DA. Is that the case?

The only one I know of is the MySQL DA, but what I was 
getting at here was that eliminating ANY sql db access 
lets us discard the possibility of a DA problem and focus 
on other possibilities (IOW, is this really in Zope, or 
is this related to use or misuse of database libraries, 
which can vary widely in their thread support (or lack 
thereof).


Brian Lloyd[EMAIL PROTECTED]
V.P. Engineering   540.361.1716   
Zope Corporation   http://www.zope.com



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )