Re: [Mailman-Users] MM3 Test Hangs

2014-02-26 Thread Tom Browder
On Wed, Feb 26, 2014 at 12:45 AM, Stephen J. Turnbull
step...@xemacs.org wrote:
 Tom Browder writes:
...
 Actually, I do have a couple of ideas.  First, you should always
 report the whole error trace (if you think that's ugly in an email,
...

Thanks, Steve, for the good advice.

-Tom
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] [Mailman-Developers] MM3 Test Hangs

2014-02-26 Thread Tom Browder
On Wed, Feb 26, 2014 at 3:13 AM, Nicolas Karageuzian
nico...@karageuzian.com wrote:
 I encountered db lock using sqlite with mailman3 and tools.
 Switching to postgres avoid the db locking states.
 Maybe you should explore that way.

I'll try that.

 Hyperkitty moved to github so the lp ref is quite out of date for this
 resource.

I thought so--that't why I was asking for definitive, easy-to-find
links on the wiki.

Thanks, Nicolas.

-Tom
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] [Mailman-Developers] MM3 Test Hangs

2014-02-26 Thread Barry Warsaw
On Feb 26, 2014, at 02:45 PM, Stephen J. Turnbull wrote:

  I have no idea what to do next,

This is clearly a bug, although I think it's relatively recent, so it might be
worth seeing if earlier revisions avoid the problem.  Yes, I can reproduce it.

The interesting thing is that the test is in rest/docs/membership.rst so these
are multiprocess related bugs.  Typically when this happens (and it will only
be with the default SQLite database, as observed by others), it's a bug in the
test, not necessarily a bug in the core.

Tests which involve multiple processes, as the REST tests do (i.e. the
foreground testing process and a background runner process) have to be careful
to release the database lock when they expect background processes to access
the database.  Releasing the lock means calling .commit() or .abort() at the
appropriate time.  The thing to keep in mind is that with Storm, even doing an
operation that results in a database query opens a transaction and thus
acquires the lock.

In the context of membership.rst, what this probably means is that somewhere
in the doctest there's a database query with a missing explicit .commit() or
.abort() before the background REST runner process executes.  Tracing through
the doctest to find out exactly where it hangs usually helps isolate where the
missing commit/abort should go.

Of course, it's possible that there's a missing commit/abort in the core, but
I rather doubt it, since that's pretty well tied into the REST runner's HTTP
transaction machinery, and other REST tests don't exhibit the hang.

Tom, if you're up for debugging it, that would be great.  If not, no worries.
The test suite hangs for me, so I'll find some time this weekend to take a
look.

-Barry
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org