Re: [Mailman-Users] delate all bounces....

2006-06-08 Thread Mark Sapiro 
kalin mintchev wrote:

from the qrunner log:
Nov 15 17:00:14 2005 (2584) Qrunner BounceRunner reached maximum restart
limit of 10, not restarting.

what's this thing about maximum restart limit?!


What's in the log prior to this for the 10 deaths that required restart?

The idea is the master mailmanctl daemon watches the qrunner processes
and if one dies (for some, but not all reasons), the master restarts
it, but once it reaches the limit of 10 (coded in mailmanctl), it
stops the restarting on the theory that this is a hard error and we
don't want to loop forever on it.


that's the last record before the entry of the new restart. right now it's
running..

now there is this huge and growing bounce-events-.pck file thought. i
guess at some point the bouncer will process it?


Bounce runner processes the queued bounces, but rather than processing
them as they come and going through the list lock, load and save
process for each bounce, they are stored in the bounce-events-.pck and
that in turn is processed once every (default, controlled by
REGISTER_BOUNCES_EVERY) 15 minutes in list order so the list is only
locked, loaded and saved once.

I still don't know what the underlying issue is, possibly you have so
many bounces that the bounce-events-.pck reaches some size limitation.
What does the 'qrunner' log say about the deaths? What's in the
'error' log.

-- 
Mark Sapiro [EMAIL PROTECTED]   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp

Re: [Mailman-Users] delate all bounces....

2006-06-08 Thread kalin mintchev 
 I still don't know what the underlying issue is, possibly you have so
 many bounces that the bounce-events-.pck reaches some size limitation.
 What does the 'qrunner' log say about the deaths? What's in the
 'error' log.


well BounceRunner died apparently short after i restarted everything
again. from the qrunner log:

Jun 08 06:00:57 2006 (7641) BounceRunner qrunner started.

Jun 08 06:30:52 2006 (7639) Master qrunner detected subprocess exit
(pid: 7641, sig: 9, sts: None, class: BounceRunner, slice: 1/1) [restarting]
Jun 08 06:31:05 2006 (8048) BounceRunner qrunner started.
Jun 08 06:43:12 2006 (7639) Master qrunner detected subprocess exit
(pid: 8048, sig: 11, sts: None, class: BounceRunner, slice: 1/1) [restarting]
Jun 08 06:43:16 2006 (8159) BounceRunner qrunner started.
Jun 08 06:43:23 2006 (7639) Master qrunner detected subprocess exit
(pid: 8159, sig: None, sts: 1, class: BounceRunner, slice: 1/1) [restarting]
.(repeated 10 time i guess).
Jun 08 06:44:14 2006 (7639) Qrunner BounceRunner reached maximum restart
limit of 10, not restarting.



the output from the error log for the same times is a bit longer so i'm
attaching it. there are no other error log after these...

thanks...



--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp

Re: [Mailman-Users] delate all bounces....

2006-06-08 Thread kalin mintchev 

 the output from the error log for the same times is a bit longer so i'm
 attaching it.

i guess no attachments ok here it is:

Jun 08 06:43:23 2006 qrunner(8159): Traceback (most recent call last):
Jun 08 06:43:23 2006 qrunner(8159):   File /var/mailman/bin/qrunner,
line 270, in ?
Jun 08 06:43:23 2006 qrunner(8159):  main()
Jun 08 06:43:23 2006 qrunner(8159):   File /var/mailman/bin/qrunner,
line 230, in main
Jun 08 06:43:23 2006 qrunner(8159):  qrunner.run()
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/Mailman/Queue/Runner.py, line 70, in run
Jun 08 06:43:23 2006 qrunner(8159):  filecnt = self._oneloop()
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/Mailman/Queue/Runner.py, line 99, in _oneloop
Jun 08 06:43:23 2006 qrunner(8159):  msg, msgdata =
self._switchboard.dequeue(filebase)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/Mailman/Queue/Switchboard.py, line 151, in dequeue
Jun 08 06:43:23 2006 qrunner(8159):  msg =
email.message_from_string(msg, Message.Message)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/__init__.py, line 52, in
message_from_string
Jun 08 06:43:23 2006 qrunner(8159):  return Parser(_class,
strict=strict).parsestr(s)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 75, in parsestr
Jun 08 06:43:23 2006 qrunner(8159):  return self.parse(StringIO(text),
headersonly=headersonly)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 64, in parse
Jun 08 06:43:23 2006 qrunner(8159):  self._parsebody(root, fp,
firstbodyline)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 240, in _parsebody
Jun 08 06:43:23 2006 qrunner(8159):  msgobj = self.parsestr(part)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 75, in parsestr
Jun 08 06:43:23 2006 qrunner(8159):  return self.parse(StringIO(text),
headersonly=headersonly)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 61, in parse
Jun 08 06:43:23 2006 qrunner(8159):  root = self._class()
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/Mailman/Message.py, line 46, in __init__
Jun 08 06:43:23 2006 qrunner(8159):  email.Message.Message.__init__(self)
Jun 08 06:43:23 2006 qrunner(8159): AttributeError :  'tuple' object has
no attribute 'Message'
Jun 08 06:43:42 2006 qrunner(8170): Traceback (most recent call last):
Jun 08 06:43:42 2006 qrunner(8170):   File /var/mailman/bin/qrunner,
line 270, in ?
Jun 08 06:43:42 2006 qrunner(8170):  main()
Jun 08 06:43:42 2006 qrunner(8170):   File /var/mailman/bin/qrunner,
line 217, in main
Jun 08 06:43:42 2006 qrunner(8170):  qrunner = make_qrunner(*runners[0])
Jun 08 06:43:42 2006 qrunner(8170):   File /var/mailman/bin/qrunner,
line 106, in make_qrunner
Jun 08 06:43:42 2006 qrunner(8170):  __import__(modulename)
Jun 08 06:43:42 2006 qrunner(8170):   File
/var/mailman/Mailman/Queue/BounceRunner.py, line 29, in ?
Jun 08 06:43:42 2006 qrunner(8170):  from Mailman import Utils
Jun 08 06:43:42 2006 qrunner(8170):   File
/var/mailman/Mailman/Utils.py, line 68, in ?
Jun 08 06:43:42 2006 qrunner(8170):  cre =
re.compile(r'%\(([_a-z]\w*?)\)s?', re.IGNORECASE)
Jun 08 06:43:42 2006 qrunner(8170):   File
/usr/local/lib/python2.4/sre.py, line 180, in compile
Jun 08 06:43:42 2006 qrunner(8170):  return _compile(pattern, flags)
Jun 08 06:43:42 2006 qrunner(8170):   File
/usr/local/lib/python2.4/sre.py, line 222, in _compile
Jun 08 06:43:42 2006 qrunner(8170):  if not
sre_compile.isstring(pattern):
Jun 08 06:43:42 2006 qrunner(8170):   File
/usr/local/lib/python2.4/sre_compile.py, line 471, in isstring
Jun 08 06:43:42 2006 qrunner(8170):  if isinstance(obj, tp):
Jun 08 06:43:42 2006 qrunner(8170): TypeError :  isinstance() arg 2 must
be a class, type, or tuple of classes and types
Jun 08 06:44:07 2006 qrunner(8173): Traceback (most recent call last):
Jun 08 06:44:07 2006 qrunner(8173):   File /var/mailman/bin/qrunner,
line 270, in ?
Jun 08 06:44:07 2006 qrunner(8173):  main()
Jun 08 06:44:07 2006 qrunner(8173):   File /var/mailman/bin/qrunner,
line 217, in main
Jun 08 06:44:07 2006 qrunner(8173):  qrunner = make_qrunner(*runners[0])
Jun 08 06:44:07 2006 qrunner(8173):   File /var/mailman/bin/qrunner,
line 106, in make_qrunner
Jun 08 06:44:07 2006 qrunner(8173):  __import__(modulename)
Jun 08 06:44:07 2006 qrunner(8173):   File
/var/mailman/Mailman/Queue/BounceRunner.py, line 24, in ?
Jun 08 06:44:07 2006 qrunner(8173):  from email.MIMEText import MIMEText
Jun 08 06:44:07 2006 qrunner(8173):   File
/var/mailman/pythonlib/email/MIMEText.py, line 8, in ?
Jun 08 06:44:07 2006 qrunner(8173):  from email.MIMENonMultipart
import MIMENonMultipart
Jun 08 06:44:07 2006 qrunner(8173):   File
/var/mailman/pythonlib/email/MIMENonMultipart.py, line 8, in ?
Jun 08 06:44:07 2006

Re: [Mailman-Users] delate all bounces....

2006-06-08 Thread Mark Sapiro 
kalin mintchev wrote:

 I still don't know what the underlying issue is, possibly you have so
 many bounces that the bounce-events-.pck reaches some size limitation.
 What does the 'qrunner' log say about the deaths? What's in the
 'error' log.


well BounceRunner died apparently short after i restarted everything
again. from the qrunner log:

Jun 08 06:30:52 2006 (7639) Master qrunner detected subprocess exit
(pid: 7641, sig: 9, sts: None, class: BounceRunner, slice: 1/1) [restarting]


sig 9 is a SIGKILL ?


Jun 08 06:31:05 2006 (8048) BounceRunner qrunner started.
Jun 08 06:43:12 2006 (7639) Master qrunner detected subprocess exit
(pid: 8048, sig: 11, sts: None, class: BounceRunner, slice: 1/1) [restarting]


Sig 11 is a segment violation.


the output from the error log for the same times is a bit longer so i'm
attaching it. there are no other error log after these...

See next reply.

-- 
Mark Sapiro [EMAIL PROTECTED]   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp

Re: [Mailman-Users] delate all bounces....

2006-06-08 Thread Mark Sapiro 
kalin mintchev wrote:

i guess no attachments ok here it is:

Jun 08 06:43:23 2006 qrunner(8159): Traceback (most recent call last):
Jun 08 06:43:23 2006 qrunner(8159):   File /var/mailman/bin/qrunner,
line 270, in ?
Jun 08 06:43:23 2006 qrunner(8159):  main()
Jun 08 06:43:23 2006 qrunner(8159):   File /var/mailman/bin/qrunner,
line 230, in main
Jun 08 06:43:23 2006 qrunner(8159):  qrunner.run()
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/Mailman/Queue/Runner.py, line 70, in run
Jun 08 06:43:23 2006 qrunner(8159):  filecnt = self._oneloop()
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/Mailman/Queue/Runner.py, line 99, in _oneloop
Jun 08 06:43:23 2006 qrunner(8159):  msg, msgdata =
self._switchboard.dequeue(filebase)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/Mailman/Queue/Switchboard.py, line 151, in dequeue
Jun 08 06:43:23 2006 qrunner(8159):  msg =
email.message_from_string(msg, Message.Message)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/__init__.py, line 52, in
message_from_string
Jun 08 06:43:23 2006 qrunner(8159):  return Parser(_class,
strict=strict).parsestr(s)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 75, in parsestr
Jun 08 06:43:23 2006 qrunner(8159):  return self.parse(StringIO(text),
headersonly=headersonly)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 64, in parse
Jun 08 06:43:23 2006 qrunner(8159):  self._parsebody(root, fp,
firstbodyline)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 240, in _parsebody
Jun 08 06:43:23 2006 qrunner(8159):  msgobj = self.parsestr(part)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 75, in parsestr
Jun 08 06:43:23 2006 qrunner(8159):  return self.parse(StringIO(text),
headersonly=headersonly)
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/pythonlib/email/Parser.py, line 61, in parse
Jun 08 06:43:23 2006 qrunner(8159):  root = self._class()
Jun 08 06:43:23 2006 qrunner(8159):   File
/var/mailman/Mailman/Message.py, line 46, in __init__
Jun 08 06:43:23 2006 qrunner(8159):  email.Message.Message.__init__(self)
Jun 08 06:43:23 2006 qrunner(8159): AttributeError :  'tuple' object has
no attribute 'Message'



Jun 08 06:43:42 2006 qrunner(8170): Traceback (most recent call last):
Jun 08 06:43:42 2006 qrunner(8170):   File /var/mailman/bin/qrunner,
line 270, in ?
Jun 08 06:43:42 2006 qrunner(8170):  main()
Jun 08 06:43:42 2006 qrunner(8170):   File /var/mailman/bin/qrunner,
line 217, in main
Jun 08 06:43:42 2006 qrunner(8170):  qrunner = make_qrunner(*runners[0])
Jun 08 06:43:42 2006 qrunner(8170):   File /var/mailman/bin/qrunner,
line 106, in make_qrunner
Jun 08 06:43:42 2006 qrunner(8170):  __import__(modulename)
Jun 08 06:43:42 2006 qrunner(8170):   File
/var/mailman/Mailman/Queue/BounceRunner.py, line 29, in ?
Jun 08 06:43:42 2006 qrunner(8170):  from Mailman import Utils
Jun 08 06:43:42 2006 qrunner(8170):   File
/var/mailman/Mailman/Utils.py, line 68, in ?
Jun 08 06:43:42 2006 qrunner(8170):  cre =
re.compile(r'%\(([_a-z]\w*?)\)s?', re.IGNORECASE)
Jun 08 06:43:42 2006 qrunner(8170):   File
/usr/local/lib/python2.4/sre.py, line 180, in compile
Jun 08 06:43:42 2006 qrunner(8170):  return _compile(pattern, flags)
Jun 08 06:43:42 2006 qrunner(8170):   File
/usr/local/lib/python2.4/sre.py, line 222, in _compile
Jun 08 06:43:42 2006 qrunner(8170):  if not
sre_compile.isstring(pattern):
Jun 08 06:43:42 2006 qrunner(8170):   File
/usr/local/lib/python2.4/sre_compile.py, line 471, in isstring
Jun 08 06:43:42 2006 qrunner(8170):  if isinstance(obj, tp):
Jun 08 06:43:42 2006 qrunner(8170): TypeError :  isinstance() arg 2 must
be a class, type, or tuple of classes and types



Jun 08 06:44:07 2006 qrunner(8173): Traceback (most recent call last):
Jun 08 06:44:07 2006 qrunner(8173):   File /var/mailman/bin/qrunner,
line 270, in ?
Jun 08 06:44:07 2006 qrunner(8173):  main()
Jun 08 06:44:07 2006 qrunner(8173):   File /var/mailman/bin/qrunner,
line 217, in main
Jun 08 06:44:07 2006 qrunner(8173):  qrunner = make_qrunner(*runners[0])
Jun 08 06:44:07 2006 qrunner(8173):   File /var/mailman/bin/qrunner,
line 106, in make_qrunner
Jun 08 06:44:07 2006 qrunner(8173):  __import__(modulename)
Jun 08 06:44:07 2006 qrunner(8173):   File
/var/mailman/Mailman/Queue/BounceRunner.py, line 24, in ?
Jun 08 06:44:07 2006 qrunner(8173):  from email.MIMEText import MIMEText
Jun 08 06:44:07 2006 qrunner(8173):   File
/var/mailman/pythonlib/email/MIMEText.py, line 8, in ?
Jun 08 06:44:07 2006 qrunner(8173):  from email.MIMENonMultipart
import MIMENonMultipart
Jun 08 06:44:07 2006 qrunner(8173):   File
/var/mailman/pythonlib/email/MIMENonMultipart.py, line 8, in ?
Jun 08 06:44:07 2006 qrunner(8173):  from email import MIMEBase
Jun 08 06:44:07 2006

Re: [Mailman-Users] delate all bounces....

2006-06-07 Thread kalin mintchev 


 Are you talking about files in qfiles/bounces/ or files in data/ named
 bounce-events-p.pck?

the former. i don't see the BounceRunner in the mailman processes and will
start it through mailmanctl but i remember reading somewhere that that
daemon should run every 15 min?!?  by default?!

the latter are all from last year so they'll be all gone... pretty big
too

thanks

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp

Re: [Mailman-Users] delate all bounces....

2006-06-07 Thread kalin mintchev 

 the former. i don't see the BounceRunner in the mailman processes and will
 start it through mailmanctl but i remember reading somewhere that that
 daemon should run every 15 min?!?  by default?!

ok. i did restart the daemons. but is till don't see BounceRunner in the
ps list

after getting rid of all the orphaned files i have a bit more space
available but it'll be nice to get rid of those bounces too

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp

Re: [Mailman-Users] delate all bounces....

2006-06-07 Thread Mark Sapiro 
kalin mintchev wrote:

 the former. i don't see the BounceRunner in the mailman processes and will
 start it through mailmanctl but i remember reading somewhere that that
 daemon should run every 15 min?!?  by default?!


That was Mailman 2.0.x. Mailman 2.1 uses the mailmanctl daemon instead.


ok. i did restart the daemons. but is till don't see BounceRunner in the
ps list


Did you do this cleanly? See
http://www.python.org/cgi-bin/faqw-mm.py?req=showfile=faq04.068.htp

There is some problem with BounceRunner. What's in Mailman's qrunner
log and error log?

BTW, if those bounces in qfiles/bounces are old, you can just delete
them (one of them may be the problem). In fact, it would be a good
idea after resolving your original BounceRunner problem to just remove
the qfiles/bounces/ directory itself and let Mailman recreate it in
order to shrink it.

-- 
Mark Sapiro [EMAIL PROTECTED]   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp

[Mailman-Users] delate all bounces....

2006-06-06 Thread kalin mintchev 

 hi...

 i have a huge directory full of bounces and much of disk space left. i'll
be add a new disk soon but can i just wipe out all the bounce files under
bounces?!!

thanks...

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp

Re: [Mailman-Users] delate all bounces....

2006-06-06 Thread Mark Sapiro 
kalin mintchev wrote:

 i have a huge directory full of bounces and much of disk space left. i'll
be add a new disk soon but can i just wipe out all the bounce files under
bounces?!!


Are you talking about files in qfiles/bounces/ or files in data/ named
bounce-events-p.pck?

If the former, these should be processed and deleted by BounceRunner
which it would seem is not running.

If the latter, they are all orphaned and can be removed except for the
one if any that's less than 15 minutes old and has p equal to the
pid of the current BounceRunner.

See the Mailman 2.1.x information in sections 1 and 5 of
http://www.python.org/cgi-bin/faqw-mm.py?req=showfile=faq03.014.htp

-- 
Mark Sapiro [EMAIL PROTECTED]   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp