[Mailman-Users] mail is getting misdirected
Hi all, I'm using version 2.1.12rc1 on CentOS 5.2 64 bit and postfix-2.3.3-2. I thought I configured mailman correctly, but I have issues when list members reply to al messages, this is the issue when I post a message from myl...@lists.jcvi.orgmailto:myl...@lists.jcvi.org it is sent to all subscribers, however when they try to respond the users are automatically responding to myl...@jcvi.orgmailto:myl...@jcvi.org. Why is mailman truncating the lists.jcvi.org ? Where is the configured in mailman or postfix ? Please help I need to upgrade my OS and software but now I know my list server is not working as designed. Bill -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Is There a list member limitation?
Hello Mark, I had a user send an email to one of our lists (approx. 700 email address), he states that some users received them about (450) and other did not. Is there a email address limitation or member limitation? If so where would the configuration be? Or where (beside the mail server) could I look to see who didn't receive the email? Bill -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Is There a list member limitation?
Thanks, That's what I thought you just confirmed it. Bill -Original Message- From: mailman-users-bounces+wgoodman=jcvi@python.org [mailto:mailman-users-bounces+wgoodman=jcvi@python.org] On Behalf Of LuKreme Sent: Friday, January 15, 2010 12:08 PM To: mailman-users@python.org Subject: Re: [Mailman-Users] Is There a list member limitation? On 15-Jan-2010, at 09:24, Goodman, William wrote: I had a user send an email to one of our lists (approx. 700 email address), he states that some users received them about (450) and other did not. Is there a email address limitation or member limitation? Not in Mailman. There are many reasons that a mail may not be received by some members of a list. 1) Spam filters on their machines that trap the mail as spam 2) limitations on your sending server on how many emails you can send to how many people in what amount of time 3) Your server is on an RBL 4) THEIR server is on an RBL 5) They DID receive the mail, they just can't find it 6) DNS issues (yours or theirs) There are probably other things. -- Gods don't like people not doing much work. People who aren't busy all the time might start to think. --Small Gods -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/wgoodman%40jcvi.org -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Is There a list member limitation?
Interesting... I also manage the mail servers, we use postfix with Amavid, ClamAV and Spamassassian. I know this is a mailman list but, is that (SMTP_MAX_RCPTS = 500) a postfix mail server configuration? Bill -Original Message- From: mailman-users-bounces+wgoodman=jcvi@python.org [mailto:mailman-users-bounces+wgoodman=jcvi@python.org] On Behalf Of Mark Sapiro Sent: Friday, January 15, 2010 12:27 PM To: mailman-users@python.org Subject: Re: [Mailman-Users] Is There a list member limitation? LuKreme wrote: On 15-Jan-2010, at 09:24, Goodman, William wrote: I had a user send an email to one of our lists (approx. 700 email address), he states that some users received them about (450) and other did not. Is there a email address limitation or member limitation? Not in Mailman. There are many reasons that a mail may not be received by some members of a list. 1) Spam filters on their machines that trap the mail as spam 2) limitations on your sending server on how many emails you can send to how many people in what amount of time 3) Your server is on an RBL 4) THEIR server is on an RBL 5) They DID receive the mail, they just can't find it 6) DNS issues (yours or theirs) There are probably other things. In addition to the above, check Mailman's smtp-failure log if you can. The 450 number (and exactly how can he know that?) suggests that possibly list delivery was chunked with the default SMTP_MAX_RCPTS = 500 and only one chunk was accepted by the MTA. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/wgoodman%40jcvi.org -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Is There a list member limitation?
I see things like below to users I know didn't receive the email. So you first assessment is correct they did receive it but they just can't find it. to=u...@somewhere.com, relay=mail.somewhere.com[212.137.44.179]:25, delay=8.3, delays=0.02/4.4/0.67/3.3, dsn=4.0.0, status=deferred (host mail.somewhere.com[212.137.44.179] said: 451 u...@somewhere.com... Requested mail action not taken: mailbox unavailable (in reply to RCPT TO command)) Jan 13 15:25:00 my-mailserver postfix/smtp[28262]: B405E2D858F Thanks for all your help... Bill -Original Message- From: mailman-users-bounces+wgoodman=jcvi@python.org [mailto:mailman-users-bounces+wgoodman=jcvi@python.org] On Behalf Of Larry Stone Sent: Friday, January 15, 2010 1:28 PM To: mailman-users@python.org Subject: Re: [Mailman-Users] Is There a list member limitation? On Fri, 15 Jan 2010, Goodman, William wrote: Interesting... I also manage the mail servers, we use postfix with Amavid, ClamAV and Spamassassian. I know this is a mailman list but, is that (SMTP_MAX_RCPTS = 500) a postfix mail server configuration? Since you're also managing the mail servers, you should be able to look in the postfix logs to see what's happening. -- Larry Stone lston...@stonejongleux.com -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/wgoodman%40jcvi.org -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Is There a list member limitation?
We have a very busy mail server so I set it to 4 hours, when I used the default we had a mailq of over 200 everyday which slowed our performance. So it will keep trying to send it for 4 hours then it gets bounced. -Original Message- From: Larry Stone [mailto:lston...@stonejongleux.com] Sent: Friday, January 15, 2010 4:17 PM To: Goodman, William Cc: mailman-users@python.org Subject: RE: [Mailman-Users] Is There a list member limitation? On Fri, 15 Jan 2010, Goodman, William wrote: I see things like below to users I know didn't receive the email. So you first assessment is correct they did receive it but they just can't find it. Uh no, the message below is a deferral. Postfix keeps retrying until it times out at which point is bounced. How long until it times out is a site configurable length of time (default five days, I think). to=u...@somewhere.com, relay=mail.somewhere.com[212.137.44.179]:25, delay=8.3, delays=0.02/4.4/0.67/3.3, dsn=4.0.0, status=deferred (host mail.somewhere.com[212.137.44.179] said: 451 u...@somewhere.com... Requested mail action not taken: mailbox unavailable (in reply to RCPT TO command)) Jan 13 15:25:00 my-mailserver postfix/smtp[28262]: B405E2D858F -- Larry Stone lston...@stonejongleux.com -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] mailman python-2.4 using 96% cpu
I apologize Mark... This is the output of: # ls -aR /opt/software/mailman/qfiles/ /opt/software/mailman/qfiles/: . .. archive bounces commands in news out retry shunt virgin /opt/software/mailman/qfiles/archive: . .. /opt/software/mailman/qfiles/bounces: . .. 1234190987.539598+fd6c983022fae575bb19abe36c1eb9c9e4d7a896.pck 1234190987.546752+fe6f1ad1df8e2079ccb23fc3cfeeff4fd5441082.pck 1234190987.7204871+3a2c234edd8b221eaca05854a5dfd5162c58f6da.pck 1234190987.960499+c00b2d2522ee0d1246583d41a3323958520da746.pck 1234190988.063931+b4b96d43770f9f37a42f57ad50055c8837b21874.pck 1234190988.3409979+4f2d8e7a9fc7810110611d42fd82f57c167dbc1c.pck 1234190988.366761+dab73d1f6982797f201613fd4b60237b4e01bab3.pck 1234190988.669873+d4e730813b15eb5a7a3c427183808d07fb0b7ca4.pck 1234190988.7999749+9e225d8f549d8f35a9a4255c572ac88f6bd5c845.pck 1234190988.961921+417ad154e340bd2947ed5df80c530ab697d7a17a.pck.tmp /opt/software/mailman/qfiles/commands: . .. /opt/software/mailman/qfiles/in: . .. 1234190978.5258429+b87a7a844ad37ebb49d0724f57432f96a184db71.bak 1234190978.5667651+ed691242dad999eb51ccc8fab3343b6619856592.pck 1234190978.6760139+e4f48d142e1cb482489bebd1027e9b550915dc55.pck 1234190988.577697+6801e46df1e6c7432b7f9e458ef424bf28792659.pck /opt/software/mailman/qfiles/news: . .. /opt/software/mailman/qfiles/out: . 1234190978.3703849+eed96b821c17c2186fc25541469e5ef0c0af6a47.pck .. 1234190978.738651+91bcf5af1bdaac8c799b378c3b1301b10a53252c.bak /opt/software/mailman/qfiles/retry: . .. /opt/software/mailman/qfiles/shunt: . .. /opt/software/mailman/qfiles/virgin: . .. -Original Message- From: Mark Sapiro [mailto:m...@msapiro.net] Sent: Friday, February 06, 2009 8:05 PM To: Goodman, William; mailman-users@python.org Subject: RE: [Mailman-Users] mailman python-2.4 using 96% cpu Goodman, William wrote: Cool Mike that helped a lot... It's Mark ... I was so frustrated I set it to: QRUNNER_SLEEP_TIME = seconds(10) That seem to calm it down a bit. top - 18:38:02 up 56 min, 2 users, load average: 1.25, 1.20, 1.83 Tasks: 109 total, 1 running, 108 sleeping, 0 stopped, 0 zombie Cpu(s): 20.3%us, 0.3%sy, 0.0%ni, 79.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 3866604k total, 494800k used, 3371804k free, 175632k buffers Swap: 4194296k total,0k used, 4194296k free, 172108k cached PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 19021 mailman 25 0 150m 12m 2752 S 41 0.3 1:59.92 python2.4 8 root 10 -5 000 S0 0.0 0:03.72 events/0 19797 root 16 0 12584 1068 800 S0 0.0 0:00.30 top 1 root 15 0 10324 692 580 S0 0.0 0:00.40 init But I still see 99% spikes from time to time. Is there a BOUNCERUNNER and INCOMINGRUNNER parameter? QRUNNER_SLEEP_TIME applies to all the runners. I suppose it's possible you are just being bombarded with mail. Perhaps there is some kind of mail loop. What's in Mailman's vette log? What do you see if you stop Mailman and while it is stopped do ls -aR qfiles/ Do you see any entries? If so, and you do the ls again are there more entries or the same ones? If there are entries, what's in them (use bin/show_qfiles to list them)? Also, as root do strace -p xxx -o filename where xxx is the pid of incoming runner. Let it run for 10 or 20 seconds and then stop it with control-C and see what's in the output (filename). -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://wiki.list.org/x/QIA9
[Mailman-Users] Need help with archiving and the Reply to: fails
Hello I think these issues are related: First after moving my lists server all basic functions work, however the list server is not archiving, even when I select daily. This is most likely because users cannot reply because they get bounced with: Your message did not reach some or all of the intended recipients. Subject: RE: [Mylist] Test message Sent: 2/4/2009 6:12 PM The following recipient(s) could not be reached: myl...@jcvi.org on 2/4/2009 6:12 PM The e-mail account does not exist at the organization this message was sent to. Check the e-mail address, or contact the recipient directly to find out the correct address. EXCHANGE..ORG #5.1.1 Also in a previous post I was concern that the mailman python-2.4 using 96% cpu... searching but finding no answers. Bill -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://wiki.list.org/x/QIA9
Re: [Mailman-Users] mailman python-2.4 using 96% cpu
What release did you upgrade from? From 2.1.7 to 2.1.12rc1 What's in Mailman's logs? snipet from bounce: Feb 05 13:48:17 2009 (4760) gme_conference: bounce message w/no discernable addresses: 200902051848.n15imfx1011...@independence.tigr.org Feb 05 13:48:17 2009 (4760) gme_conference: forwarding unrecognized, message-id: 200902051848.n15imfx1011...@independence.tigr.org snipet from error: Feb 04 19:13:23 2009 (4759) Traceback (most recent call last): File /opt/software/mailman/Mailman/Queue/Runner.py, line 120, in _oneloop self._onefile(msg, msgdata) File /opt/software/mailman/Mailman/Queue/Runner.py, line 191, in _onefile keepqueued = self._dispose(mlist, msg, msgdata) File /opt/software/mailman/Mailman/Queue/ArchRunner.py, line 73, in _dispose mlist.ArchiveMail(msg) File /opt/software/mailman/Mailman/Archiver/Archiver.py, line 216, in ArchiveMail h.processUnixMailbox(f) File /opt/software/mailman/Mailman/Archiver/pipermail.py, line 564, in processUnixMailbox m = mbox.next() File /usr/lib64/python2.4/mailbox.py, line 35, in next return self.factory(_Subfile(self.fp, start, stop)) File /opt/software/mailman/Mailman/Mailbox.py, line 89, in scrubber return mailbox.scrub(msg) File /opt/software/mailman/Mailman/Mailbox.py, line 109, in scrub return self._scrubber(self._mlist, msg) File /opt/software/mailman/Mailman/Handlers/Scrubber.py, line 408, in process replace_payload_by_text(msg, sep.join(text), charset) File /opt/software/mailman/Mailman/Handlers/Scrubber.py, line 170, in replace_payload_by_text msg.set_payload(text, charset) File /usr/lib64/python2.4/email/Message.py, line 218, in set_payload self.set_charset(charset) File /usr/lib64/python2.4/email/Message.py, line 242, in set_charset raise TypeError(charset) TypeError: us-ascii snipet from qrunner: (pid: 4948, sig: None, sts: 15, class: CommandRunner, slice: 1/1) Feb 04 17:25:24 2009 (4759) ArchRunner qrunner started. Feb 04 17:25:24 2009 (4762) CommandRunner qrunner started. Feb 04 17:25:24 2009 (4760) BounceRunner qrunner started. Feb 04 17:25:24 2009 (4765) NewsRunner qrunner started. Feb 04 17:25:24 2009 (4764) IncomingRunner qrunner started. Feb 04 17:25:24 2009 (4767) VirginRunner qrunner started. Feb 04 17:25:24 2009 (4766) OutgoingRunner qrunner started. Feb 04 17:25:24 2009 (4768) RetryRunner qrunner started. snipet from smtp-failure: .org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection refused'), msgid: 20090204222702.7f98420...@lists.jcvi.org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection refused'), msgid: 20090204222701.70f4f20...@lists.jcvi.org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection refused'), msgid: 20090204222702.9d7d820...@lists.jcvi.org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') The other logs show normal logging nor errors or warnings What's in Mailman's qfiles/in/ directory? empty What are the other two high cpu runners (pids 4951 and 4946)? Yes that's it. Does Mailman work normally except for this high cpu usage? First after moving my lists server all basic functions work, however the list server is not archiving, even when I select daily. This is most likely because users cannot reply because they get bounced with: Your message did not reach some or all of the intended recipients. Subject: RE: [Mylist] Test message Sent: 2/4/2009 6:12 PM The following recipient(s) could not be reached: myl...@jcvi.org on 2/4/2009 6:12 PM The e-mail account does not exist at the organization this message was sent to. Check the e-mail address, or contact the recipient directly to find out the correct address. EXCHANGE..ORG #5.1.1 -Original Message- From: Mark Sapiro [mailto:m...@msapiro.net] Sent: Thursday, February 05, 2009 2:14 PM To: Goodman, William; mailman-users@python.org Subject: Re: [Mailman-Users] mailman python-2.4 using 96% cpu Goodman, William wrote: After downloading and installing the latest version of mailman-2.1.12rc1 and I'm using Apache-2.2-11 and Postfix-2.3.3-2.1.el5_2. On CentOS 5.2 (RedhHat) for some reason I can't understand the CPU usage is at 96% for mailman. When I do a top I get: top - 11:18:13 up 16:38, 1 user, load average: 2.78, 2.76, 2.62 Tasks: 122 total, 2 running, 120 sleeping, 0 stopped, 0 zombie Cpu(s): 33.4%us, 2.3%sy, 0.0%ni, 64.0%id, 0.2%wa, 0.0%hi, 0.1%si, 0.0%st Mem: 3866536k total, 2471544k used, 1394992k free, 409096k buffers Swap: 4194296k total,0k used, 4194296k free, 1435408k
Re: [Mailman-Users] mailman python-2.4 using 96% cpu
Hi Mike, Theses are the high cpu grabbers: mailman 4764 4751 74 Feb04 ?17:00:03 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s UIDPID PPID C STIME TTY TIME CMD mailman 4766 4751 22 Feb04 ?05:08:33 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s UIDPID PPID C STIME TTY TIME CMD mailman 4760 4751 4 Feb04 ?01:01:34 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=BounceRunner:0:1 -s Also there's a dead like to the patch location you sent me. Bill -Original Message- From: Mark Sapiro [mailto:m...@msapiro.net] Sent: Thursday, February 05, 2009 3:47 PM To: Goodman, William; mailman-users@python.org Subject: RE: [Mailman-Users] mailman python-2.4 using 96% cpu Goodman, William wrote: What release did you upgrade from? From 2.1.7 to 2.1.12rc1 OK What's in Mailman's logs? [...] snipet from error: Feb 04 19:13:23 2009 (4759) Traceback (most recent call last): File /opt/software/mailman/Mailman/Queue/Runner.py, line 120, in _oneloop self._onefile(msg, msgdata) File /opt/software/mailman/Mailman/Queue/Runner.py, line 191, in _onefile keepqueued = self._dispose(mlist, msg, msgdata) File /opt/software/mailman/Mailman/Queue/ArchRunner.py, line 73, in _dispose mlist.ArchiveMail(msg) File /opt/software/mailman/Mailman/Archiver/Archiver.py, line 216, in ArchiveMail h.processUnixMailbox(f) File /opt/software/mailman/Mailman/Archiver/pipermail.py, line 564, in processUnixMailbox m = mbox.next() File /usr/lib64/python2.4/mailbox.py, line 35, in next return self.factory(_Subfile(self.fp, start, stop)) File /opt/software/mailman/Mailman/Mailbox.py, line 89, in scrubber return mailbox.scrub(msg) File /opt/software/mailman/Mailman/Mailbox.py, line 109, in scrub return self._scrubber(self._mlist, msg) File /opt/software/mailman/Mailman/Handlers/Scrubber.py, line 408, in process replace_payload_by_text(msg, sep.join(text), charset) File /opt/software/mailman/Mailman/Handlers/Scrubber.py, line 170, in replace_payload_by_text msg.set_payload(text, charset) File /usr/lib64/python2.4/email/Message.py, line 218, in set_payload self.set_charset(charset) File /usr/lib64/python2.4/email/Message.py, line 242, in set_charset raise TypeError(charset) TypeError: us-ascii This is a problem in the 2.1.12rc1 release. See the post at http://mail.python.org/pipermail/mailman-announce/2009-January/000129.h tml for the fix. There are a couple of other problems too. I will be releasing 2.1.12rc2 in a day or so. [...] snipet from smtp-failure: .org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection refused'), msgid: 20090204222702.7f98420...@lists.jcvi.org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection refused'), msgid: 20090204222701.70f4f20...@lists.jcvi.org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection refused'), msgid: 20090204222702.9d7d820...@lists.jcvi.org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Your MTA is not accepting connects from Mailman, at least part of the time. See the FAQ at http://wiki.list.org/x/-IA9 for debugging hints if this is an ongoing problem. What's in Mailman's qfiles/in/ directory? empty What are the other two high cpu runners (pids 4951 and 4946)? Yes that's it. Yes, but which runners are they? ps -fwp 4946 4951 Does Mailman work normally except for this high cpu usage? First after moving my lists server all basic functions work, however the list server is not archiving, even when I select daily. The not archiving is the issue referred to above. Once you apply the patch from http://mail.python.org/pipermail/mailman-announce/2009-January/000129.h tml, you can check that you have no 'old' files in qfiles/shunt and run bin/unshunt to archive the the messages that were shunted during archiving. This is most likely because users cannot reply because they get bounced with: Your message did not reach some or all of the intended recipients. Subject: RE: [Mylist] Test message Sent: 2/4/2009 6:12 PM The following recipient(s) could not be reached: myl...@jcvi.org on 2/4/2009 6:12 PM The e-mail account does not exist at the organization this message was sent to. Check the e-mail address, or contact the recipient directly to find out the correct address. EXCHANGE..ORG #5.1.1 This is an MTA issue. Were these list's working before the upgrade? -- Mark
Re: [Mailman-Users] mailman python-2.4 using 96% cpu
Sorry to say Mike this is after applying all patches... but it now archiving top - 16:33:18 up 1 day, 23:08, 2 users, load average: 2.87, 2.24, 1.32 Tasks: 106 total, 3 running, 103 sleeping, 0 stopped, 0 zombie Cpu(s): 58.7%us, 3.5%sy, 0.0%ni, 37.4%id, 0.2%wa, 0.0%hi, 0.2%si, 0.0%st Mem: 3866604k total, 1600176k used, 2266428k free, 442080k buffers Swap: 4194296k total,4k used, 4194292k free, 373852k cached PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 8969 mailman 25 0 150m 12m 2748 R 93 0.3 5:37.84 python2.4 8971 mailman 16 0 147m 9952 2808 S9 0.3 1:42.04 python2.4 8967 mailman 16 0 151m 12m 2748 S1 0.3 0:20.62 python2.4 2 root RT -5 000 S0 0.0 0:06.35 migration/0 10760 postfix 16 0 54212 2624 2064 S0 0.1 0:00.12 local 10895 postfix 15 0 54252 2356 1820 S0 0.1 0:00.11 cleanup # ps -fwp 8969 UIDPID PPID C STIME TTY TIME CMD mailman 8969 8965 73 16:25 ?00:06:43 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s # ps -fwp 8971 UIDPID PPID C STIME TTY TIME CMD mailman 8971 8965 22 16:25 ?00:02:10 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s # ps -fwp 8967 UIDPID PPID C STIME TTY TIME CMD mailman 8967 8965 4 16:25 ?00:00:28 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=BounceRunner:0:1 -s Any other suggestions are welcomed. Bill -Original Message- From: mailman-users-bounces+wgoodman=jcvi@python.org [mailto:mailman-users-bounces+wgoodman=jcvi@python.org] On Behalf Of Goodman, William Sent: Thursday, February 05, 2009 4:10 PM To: Mark Sapiro; mailman-users@python.org Subject: Re: [Mailman-Users] mailman python-2.4 using 96% cpu Hi Mike, Theses are the high cpu grabbers: mailman 4764 4751 74 Feb04 ?17:00:03 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s UIDPID PPID C STIME TTY TIME CMD mailman 4766 4751 22 Feb04 ?05:08:33 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s UIDPID PPID C STIME TTY TIME CMD mailman 4760 4751 4 Feb04 ?01:01:34 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=BounceRunner:0:1 -s Also there's a dead like to the patch location you sent me. Bill -Original Message- From: Mark Sapiro [mailto:m...@msapiro.net] Sent: Thursday, February 05, 2009 3:47 PM To: Goodman, William; mailman-users@python.org Subject: RE: [Mailman-Users] mailman python-2.4 using 96% cpu Goodman, William wrote: What release did you upgrade from? From 2.1.7 to 2.1.12rc1 OK What's in Mailman's logs? [...] snipet from error: Feb 04 19:13:23 2009 (4759) Traceback (most recent call last): File /opt/software/mailman/Mailman/Queue/Runner.py, line 120, in _oneloop self._onefile(msg, msgdata) File /opt/software/mailman/Mailman/Queue/Runner.py, line 191, in _onefile keepqueued = self._dispose(mlist, msg, msgdata) File /opt/software/mailman/Mailman/Queue/ArchRunner.py, line 73, in _dispose mlist.ArchiveMail(msg) File /opt/software/mailman/Mailman/Archiver/Archiver.py, line 216, in ArchiveMail h.processUnixMailbox(f) File /opt/software/mailman/Mailman/Archiver/pipermail.py, line 564, in processUnixMailbox m = mbox.next() File /usr/lib64/python2.4/mailbox.py, line 35, in next return self.factory(_Subfile(self.fp, start, stop)) File /opt/software/mailman/Mailman/Mailbox.py, line 89, in scrubber return mailbox.scrub(msg) File /opt/software/mailman/Mailman/Mailbox.py, line 109, in scrub return self._scrubber(self._mlist, msg) File /opt/software/mailman/Mailman/Handlers/Scrubber.py, line 408, in process replace_payload_by_text(msg, sep.join(text), charset) File /opt/software/mailman/Mailman/Handlers/Scrubber.py, line 170, in replace_payload_by_text msg.set_payload(text, charset) File /usr/lib64/python2.4/email/Message.py, line 218, in set_payload self.set_charset(charset) File /usr/lib64/python2.4/email/Message.py, line 242, in set_charset raise TypeError(charset) TypeError: us-ascii This is a problem in the 2.1.12rc1 release. See the post at http://mail.python.org/pipermail/mailman-announce/2009-January/000129.h tml for the fix. There are a couple of other problems too. I will be releasing 2.1.12rc2 in a day or so. [...] snipet from smtp-failure: .org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection refused'), msgid: 20090204222702.7f98420...@lists.jcvi.org Feb 04 17:27:18 2009 (4766) delivery to mailman-ow...@lists.tigr.org failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009
Re: [Mailman-Users] mailman python-2.4 using 96% cpu
Cool Mike that helped a lot...
I was so frustrated I set it to:
QRUNNER_SLEEP_TIME = seconds(10)
That seem to calm it down a bit.
top - 18:38:02 up 56 min, 2 users, load average: 1.25, 1.20, 1.83
Tasks: 109 total, 1 running, 108 sleeping, 0 stopped, 0 zombie
Cpu(s): 20.3%us, 0.3%sy, 0.0%ni, 79.2%id, 0.2%wa, 0.0%hi, 0.0%si,
0.0%st
Mem: 3866604k total, 494800k used, 3371804k free, 175632k buffers
Swap: 4194296k total,0k used, 4194296k free, 172108k cached
PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND
19021 mailman 25 0 150m 12m 2752 S 41 0.3 1:59.92 python2.4
8 root 10 -5 000 S0 0.0 0:03.72 events/0
19797 root 16 0 12584 1068 800 S0 0.0 0:00.30 top
1 root 15 0 10324 692 580 S0 0.0 0:00.40 init
But I still see 99% spikes from time to time. Is there a BOUNCERUNNER
and INCOMINGRUNNER parameter?
Bill
-Original Message-
From: Mark Sapiro [mailto:m...@msapiro.net]
Sent: Friday, February 06, 2009 5:19 PM
To: Goodman, William; mailman-users@python.org
Subject: RE: [Mailman-Users] mailman python-2.4 using 96% cpu
Goodman, William wrote:
Sorry to say Mike this is after applying all patches... but it now
archiving
OK. That's good.
top - 16:33:18 up 1 day, 23:08, 2 users, load average: 2.87, 2.24,
1.32
Tasks: 106 total, 3 running, 103 sleeping, 0 stopped, 0 zombie
Cpu(s): 58.7%us, 3.5%sy, 0.0%ni, 37.4%id, 0.2%wa, 0.0%hi, 0.2%si,
0.0%st
Mem: 3866604k total, 1600176k used, 2266428k free, 442080k
buffers
Swap: 4194296k total,4k used, 4194292k free, 373852k cached
PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND
8969 mailman 25 0 150m 12m 2748 R 93 0.3 5:37.84 python2.4
8971 mailman 16 0 147m 9952 2808 S9 0.3 1:42.04 python2.4
8967 mailman 16 0 151m 12m 2748 S1 0.3 0:20.62 python2.4
2 root RT -5 000 S0 0.0 0:06.35
migration/0
10760 postfix 16 0 54212 2624 2064 S0 0.1 0:00.12 local
10895 postfix 15 0 54252 2356 1820 S0 0.1 0:00.11 cleanup
# ps -fwp 8969
UIDPID PPID C STIME TTY TIME CMD
mailman 8969 8965 73 16:25 ?00:06:43 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s
# ps -fwp 8971
UIDPID PPID C STIME TTY TIME CMD
mailman 8971 8965 22 16:25 ?00:02:10 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s
# ps -fwp 8967
UIDPID PPID C STIME TTY TIME CMD
mailman 8967 8965 4 16:25 ?00:00:28 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=BounceRunner:0:1 -s
Any other suggestions are welcomed.
I hope you don't have anything like
QRUNNER_SLEEP_TIME = 0
in mm_cfg.py. It's unlikely that that would cause a pattern like this.
More likely would be all runners using aproximately equal CPU.
You could try putting
QRUNNER_SLEEP_TIME = seconds(5)
in mm_cfg.py (the default is 1) and restarting Mailman to see if that
changes things. If that doesn't help, you may need to strace the PID of
IncomingRunner to see what it's doing. It should be spending almost all
of it's time waiting for
select(0, NULL, NULL, NULL, {1, 0})
(or maybe
select(0, NULL, NULL, NULL, {5, 0})
if you made the QRUNNER_SLEEP_TIME change).
--
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe:
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Security Policy: http://wiki.list.org/x/QIA9
[Mailman-Users] mailman python-2.4 using 96% cpu
Hello, After downloading and installing the latest version of mailman-2.1.12rc1 and I'm using Apache-2.2-11 and Postfix-2.3.3-2.1.el5_2. On CentOS 5.2 (RedhHat) for some reason I can't understand the CPU usage is at 96% for mailman. When I do a top I get: top - 11:18:13 up 16:38, 1 user, load average: 2.78, 2.76, 2.62 Tasks: 122 total, 2 running, 120 sleeping, 0 stopped, 0 zombie Cpu(s): 33.4%us, 2.3%sy, 0.0%ni, 64.0%id, 0.2%wa, 0.0%hi, 0.1%si, 0.0%st Mem: 3866536k total, 2471544k used, 1394992k free, 409096k buffers Swap: 4194296k total,0k used, 4194296k free, 1435408k cached PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 4949 mailman 25 0 175m 37m 2760 R 97 1.0 944:03.94 python2.4 4951 mailman 16 0 168m 30m 2828 S 12 0.8 288:29.09 python2.4 4946 mailman 16 0 171m 33m 2752 S2 0.9 57:05.67 python2.4 11093 postfix 15 0 54512 2848 2228 S1 0.1 0:00.29 smtpd 14 root 10 -5 000 S0 0.0 1:02.48 events/0 3935 root 10 -5 000 S0 0.0 2:42.83 kjournald 6479 root 15 0 88068 3232 2516 S0 0.1 0:00.17 sshd 10942 postfix 15 0 54212 2624 2064 S0 0.1 0:00.20 local 11157 postfix 15 0 54252 2360 1820 S0 0.1 0:00.11 cleanup 11172 postfix 16 0 55140 2356 1820 S0 0.1 0:00.10 cleanup When I search for that PID I get this: # ps -ef | grep 4949 mailman 4949 4938 94 Feb03 ?15:44:50 /usr/bin/python2.4 /opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s I've search the archives but I haven't seen an up to date resolution. Can anyone help. Bill -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://wiki.list.org/x/QIA9
