Re: [Mailman-Users] Subscribers suddenly disappear

2008-08-05 Thread Max Lanfranconi

Hi,
I would much appreciate if someone could take the time to replicate the 
following mailman behaviour.

Please let me know if you find the same issues.



Thanks in advance,

Regards,
Max

Max Lanfranconi wrote:



Mailman 2.1.11
Python 2.4.4
OS Solaris 2.11


Hi,

I have been able to reproduce this bug consistently by running the
replicate_bug script:


replicate _bug is the following:

#!/bin/sh
/usr/local/mailman/bin/rmlist testlist1
/usr/local/mailman/bin/rmlist testlist2
/usr/local/mailman/bin/rmlist testlist3
/usr/local/mailman/bin/rmlist testlist4
/usr/local/mailman/bin/rmlist testlist5
/usr/local/mailman/bin/rmlist testlist6
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist1
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist2
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist3
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist4
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist5
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist6
[EMAIL PROTECTED] testpwd


echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist1
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist2
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist3
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist4
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist5
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist6
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist1
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist2
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist3
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist4
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist5
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist6

After a short wait the following output is received:

Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]

[EMAIL PROTECTED] receives 6 confirmation emails, as [EMAIL PROTECTED] does. S
o far so
good.

At this point testlist1-6 each should contain 2 subscribers: [EMAIL PROTECTED]
and [EMAIL PROTECTED]

BUT

/usr/local/mailman/bin/list_members testlist1
/usr/local/mailman/bin/list_members testlist2
/usr/local/mailman/bin/list_members testlist3
/usr/local/mailman/bin/list_members testlist4
/usr/local/mailman/bin/list_members testlist5
/usr/local/mailman/bin/list_members testlist6

invariably produce some random combination in which one or more of the
subscribers are missing:
for example:
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]

in which three instances of [EMAIL PROTECTED] are missing...

No Errors in any Mailman log.


Thanks in advance for your help. Please let me know if you need 
additional

details.
Regards,
Max



--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


Re: [Mailman-Users] Subscribers suddenly disappear

2008-08-05 Thread Barry Finkel
Max Lanfranconi [EMAIL PROTECTED] wrote:

Mailman 2.1.11
Python 2.4.4
OS Solaris 2.11


Hi,

I have been able to reproduce this bug consistently by running the
replicate_bug script:


replicate _bug is the following:

#!/bin/sh
/usr/local/mailman/bin/rmlist testlist1
/usr/local/mailman/bin/rmlist testlist2
/usr/local/mailman/bin/rmlist testlist3
/usr/local/mailman/bin/rmlist testlist4
/usr/local/mailman/bin/rmlist testlist5
/usr/local/mailman/bin/rmlist testlist6
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist1
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist2
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist3
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist4
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist5
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist6
[EMAIL PROTECTED] testpwd


echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist1
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist2
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist3
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist4
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist5
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist6
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist1
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist2
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist3
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist4
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist5
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist6

After a short wait the following output is received:

Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]

[EMAIL PROTECTED] receives 6 confirmation emails, as [EMAIL PROTECTED] does. S
o far so
good.

At this point testlist1-6 each should contain 2 subscribers: [EMAIL PROTECTED]
and [EMAIL PROTECTED]

BUT

/usr/local/mailman/bin/list_members testlist1
/usr/local/mailman/bin/list_members testlist2
/usr/local/mailman/bin/list_members testlist3
/usr/local/mailman/bin/list_members testlist4
/usr/local/mailman/bin/list_members testlist5
/usr/local/mailman/bin/list_members testlist6

invariably produce some random combination in which one or more of the
subscribers are missing:
for example:
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]

in which three instances of [EMAIL PROTECTED] are missing...

No Errors in any Mailman log.


Thanks in advance for your help. Please let me know if you need additional
details.
Regards,
Max

I ran the script (after some minor modifications) on

 Ubuntu Dapper
 Mailman 2.1.11  (self-built package)
 Python 2.4.3 (#2, Oct  6 2006, 07:49:22)

and I get similar results:

 Script started on Tue 05 Aug 2008 09:45:31 AM CDT
 # set prompt=mailman11-test# 
 mailman11-test# ./replicate_bug.exec
 Remove the components of a mailing list with impunity - beware!

 This removes (almost) all traces of a mailing list.  By default, the lists
 archives are not removed, which is very handy for retiring old lists.

 Usage:
 rmlist [-a] [-h] listname

 Where:
 --archives
 -a
 Remove the list's archives too, or if the list has already been
 deleted, remove any residual archives.

 --help
 -h
 Print this help message and exit.


 No such list (or list already deleted): testlist1
 Remove the components of a mailing list with impunity - beware!

 This removes (almost) all traces of a mailing list.  By default, the lists
 archives are not removed, which is very handy for retiring old lists.

 Usage:
 rmlist [-a] [-h] listname

 Where:
 --archives
 -a
 Remove the list's archives too, or if the list has already been
 deleted, remove any residual archives.

 --help
 -h
 Print this help message and exit.


 No such list (or list already deleted): testlist2
 Remove the components of a mailing list with impunity - beware!

 This removes (almost) all traces of a mailing list.  By default, the lists
 archives are not removed, which is very handy for retiring old lists.

 Usage:
 rmlist [-a] 

Re: [Mailman-Users] Subscribers suddenly disappear

2008-08-05 Thread Mark Sapiro
Barry Finkel wrote:

Max Lanfranconi [EMAIL PROTECTED] wrote:

Mailman 2.1.11
Python 2.4.4
OS Solaris 2.11


Hi,

I have been able to reproduce this bug consistently by running the
replicate_bug script:
snip

I ran the script (after some minor modifications) on

 Ubuntu Dapper
 Mailman 2.1.11  (self-built package)
 Python 2.4.3 (#2, Oct  6 2006, 07:49:22)

and I get similar results:

snip

I then added

 sleep 5

after each add_members line, and the output looked fine.
I changed the sleep interval from 5 down to 1 in successive
runs, and each output looks fine; each list has the proper two
subscribers.  Is there a timing issue here?


There appears to be some kind of race issue. There are two other
reports of strangeness like this at
http://mail.python.org/pipermail/mailman-developers/2008-May/020190.html
and
http://mail.python.org/pipermail/mailman-users/2008-May/061720.html.

In both of those cases it seemed there may have been a locking failure
of some kind, but I couldn't see how. See the above threads for more
detail.

However, locking (at least list locking at the Mailman level) doesn't
seem to be involved in this case because each command process will
have saved and unlocked the list and terminated before the next
command process begins.

I intend to test the script on two other platforms (Cygwin/Python
2.5.1, and Centos 5/Python 2.4.3) later today.

Given that this script is (or should be) running the command processes
serially with no contention between commands for the config.pck files,
It would seem like an OS issue, but the script failure occurs on two
different OS platforms already, so I'm at a loss for what the issue
may be.

-- 
Mark Sapiro [EMAIL PROTECTED]The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


Re: [Mailman-Users] Subscribers suddenly disappear

2008-08-05 Thread Mark Sapiro
Mark Sapiro wrote:

However, locking (at least list locking at the Mailman level) doesn't
seem to be involved in this case because each command process will
have saved and unlocked the list and terminated before the next
command process begins.


While is correct as far as it goes, I forgot about VirginRunner and
OutgoingRunner sending the welcome messages. So there are other
mailman processes running in parallel accessing the same config.pck
files so list locking is involved.


I intend to test the script on two other platforms (Cygwin/Python
2.5.1, and Centos 5/Python 2.4.3) later today.


I have run a somewhat revised script on both platforms with the
following results:

Cygwin 1.5.19(0.150/4/2) on Windows XP with Python 2.5.1
  No loss of members whether or not mailman is running concurrently
  (3 of 3 tries with mailman running).

CentOS 5 (Linux 2.6.18-8.1.14.el5) with Python 2.4.3
  No loss of members if script is run with mailman stopped.
  Lost members if script is run with mailman running on 2 out of 3
  tries.

So far, all the failures reported have been with Python 2.4.x and
Python 2.5.1 didn't fail, but this could also be Cygwin and
independent of Python. It would help if others could try this with
Python 2.5.x and report.

Here's the script I used. It is similar to the original, but I
parameterized several things and I added '-a' to the rmlist command.

#!/bin/sh

prefix=/usr/local/mailman
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
edomain=msapiro.net
listname=testlist

$prefix/bin/rmlist -a ${listname}1
$prefix/bin/rmlist -a ${listname}2
$prefix/bin/rmlist -a ${listname}3
$prefix/bin/rmlist -a ${listname}4
$prefix/bin/rmlist -a ${listname}5
$prefix/bin/rmlist -a ${listname}6
$prefix/bin/newlist -q -e $edomain ${listname}1 $owner testpwd
$prefix/bin/newlist -q -e $edomain ${listname}2 $owner testpwd
$prefix/bin/newlist -q -e $edomain ${listname}3 $owner testpwd
$prefix/bin/newlist -q -e $edomain ${listname}4 $owner testpwd
$prefix/bin/newlist -q -e $edomain ${listname}5 $owner testpwd
$prefix/bin/newlist -q -e $edomain ${listname}6 $owner testpwd


echo $usera | $prefix/bin/add_members -r - ${listname}1
echo $usera | $prefix/bin/add_members -r - ${listname}2
echo $usera | $prefix/bin/add_members -r - ${listname}3
echo $usera | $prefix/bin/add_members -r - ${listname}4
echo $usera | $prefix/bin/add_members -r - ${listname}5
echo $usera | $prefix/bin/add_members -r - ${listname}6
echo $userb | $prefix/bin/add_members -r - ${listname}1
echo $userb | $prefix/bin/add_members -r - ${listname}2
echo $userb | $prefix/bin/add_members -r - ${listname}3
echo $userb | $prefix/bin/add_members -r - ${listname}4
echo $userb | $prefix/bin/add_members -r - ${listname}5
echo $userb | $prefix/bin/add_members -r - ${listname}6

sleep 5

$prefix/bin/list_members ${listname}1
$prefix/bin/list_members ${listname}2
$prefix/bin/list_members ${listname}3
$prefix/bin/list_members ${listname}4
$prefix/bin/list_members ${listname}5
$prefix/bin/list_members ${listname}6

-- 
Mark Sapiro [EMAIL PROTECTED]The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


Re: [Mailman-Users] Subscribers suddenly disappear - SOLVED

2008-08-05 Thread Mark Sapiro
This thread moved to Mailman-Developers. See 
http://mail.python.org/pipermail/mailman-developers/2008-August/020330.html 
for the analysis.


--
Mark Sapiro [EMAIL PROTECTED]The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


[Mailman-Users] Subscribers suddenly disappear

2008-08-04 Thread Max Lanfranconi



Mailman 2.1.11
Python 2.4.4
OS Solaris 2.11


Hi,

I have been able to reproduce this bug consistently by running the
replicate_bug script:


replicate _bug is the following:

#!/bin/sh
/usr/local/mailman/bin/rmlist testlist1
/usr/local/mailman/bin/rmlist testlist2
/usr/local/mailman/bin/rmlist testlist3
/usr/local/mailman/bin/rmlist testlist4
/usr/local/mailman/bin/rmlist testlist5
/usr/local/mailman/bin/rmlist testlist6
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist1
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist2
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist3
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist4
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist5
[EMAIL PROTECTED] testpwd
/usr/local/mailman/bin/newlist -q -e url.domain.com testlist6
[EMAIL PROTECTED] testpwd


echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist1
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist2
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist3
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist4
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist5
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist6
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist1
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist2
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist3
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist4
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist5
echo [EMAIL PROTECTED] | /usr/local/mailman/bin/add_members -r - testlist6

After a short wait the following output is received:

Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]
Subscribed: [EMAIL PROTECTED]

[EMAIL PROTECTED] receives 6 confirmation emails, as [EMAIL PROTECTED] does. S
o far so
good.

At this point testlist1-6 each should contain 2 subscribers: [EMAIL PROTECTED]
and [EMAIL PROTECTED]

BUT

/usr/local/mailman/bin/list_members testlist1
/usr/local/mailman/bin/list_members testlist2
/usr/local/mailman/bin/list_members testlist3
/usr/local/mailman/bin/list_members testlist4
/usr/local/mailman/bin/list_members testlist5
/usr/local/mailman/bin/list_members testlist6

invariably produce some random combination in which one or more of the
subscribers are missing:
for example:
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]
[EMAIL PROTECTED]

in which three instances of [EMAIL PROTECTED] are missing...

No Errors in any Mailman log.


Thanks in advance for your help. Please let me know if you need additional
details.
Regards,
Max
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9