Re: [Mailman-Users] How to monitor mailman transaction
On Nov 16, 2009, at 12:10 AM, Stephen J. Turnbull wrote: Hien HUYNH HUU writes: Wow , may be this is my problem . Could you explain me more ? I'm sorry, I don't really have time to go back and look at all the information right now. The issues are pretty well explained in several FAQs (unfortunately there are a few relevant ones, but I think you get all of them if you search for performance). If you enable any kind of personalization, then you'll get individual messages being delivered by Mailman to the MTA. This includes footers with a user-specific string to tell them what their particular link is to unsubscribe from the list, etc You'll have to disable all types of personalization and VERP to get more than one recipient per message being sent to the MTA. And qmail is not an ideal MTA for maximum performance on a mailing list -- I can run rings around it with postfix. -- Brad Knowles bradknow...@shub-internet.org LinkedIn Profile: http://tinyurl.com/y8kpxu -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] How to monitor mailman transaction
Hien HUYNH HUU wrote: I wonder why the smtp log just show 1 recips why I wish It show numbers : Nov 16 08:24:34 2009 (2874) mailman.305.1258334667.21888.listn...@maillist.com smtp to listname for 1 recips, completed in 0.241 seconds Nov 16 08:24:35 2009 (21892) mailman.309.1258334667.21888.listn...@maillist.com smtp to listname for 1 recips, completed in 0.281 seconds Nov 16 08:24:35 2009 (21892) mailman.292.1258334666.21888.listn...@maillist.com smtp to listname for 1 recips, completed in 0.271 seconds Nov 16 08:24:35 2009 (21892) mailman.295.1258334666.21888.listn...@maillist.com smtp to listname for 1 recips, completed in 0.213 seconds Nov 16 08:24:36 2009 (21892) mailman.307.1258334667.21888.listn...@maillist.com smtp to listname for 1 recips, completed in 0.285 seconds Nov 16 08:25:00 2009 (2874) mailman.87.1258334698.2870.listn...@maillist.com smtp to listname for 1 recips, completed in 0.256 seconds Nov 16 08:25:00 2009 (21892) mailman.89.1258334698.2870.listn...@maillist.com smtp to listname for 1 recips, completed in 0.306 seconds Nov 16 08:25:00 2009 (2874) mailman.90.1258334698.2870.listn...@maillist.com smtp to listname for 1 recips, completed in 0.332 seconds Nov 16 08:25:00 2009 (21892) mailman.91.1258334698.2870.listn...@maillist.com smtp to listname for 1 recips, completed in 0.381 seconds Nov 16 08:25:01 2009 (2874) mailman.92.1258334698.2870.listn...@maillist.com smtp to listname for 1 recips, completed in 0.407 seconds Nov 16 08:25:01 2009 (21892) mailman.93.1258334698.2870.listn...@maillist.com smtp to listname for 1 recips, completed in 0.425 seconds Nov 16 08:25:01 2009 (2874) mailman.94.1258334698.2870.listn...@maillist.com smtp to listname for 1 recips, completed in 0.320 seconds If you have standard GNU Mailman, none of the above messages is a post. Every one of them is some kind of Mailman generated notice (maybe from BounceRunner, I'm guessing). You can tell because each has a Mailman generated message id. It looks like you have two OutgoingRunner processes with PIDs 2874 and 21892. Is this intentional? Some of those messages were generated by PID 2870 and some by PID 21888. What are these processes? It also seems that you may have two sets of Mailman qrunners running which were started at different times, thus not sliced. This is bad. See the FAQ at http://wiki.list.org/x/_4A9. Stephen and Brad's replies notwithstanding, SMTPDirect.py, which is the module that writes the above messages, writes only one such log message for each processed queue entry, regardless of the number of SMTP transactions used to deliver the message to the MTA. Even if the message is personalized and/or VERPed so that SMTPDirect deliveres one slightly different message to each recipient, it still only writes one log message after completing the entire delivery to all recipients. What is in all your Mailman logs. Particularly, smtp-failure and bounce? Up to now, I can't count how many emails mailman inject to qmail queue at the same time although I set these options in Mailman : Mailman does not inject messages into qmail's queue. Mailman deliveres messages by SMTP to qmail and qmail queues them. This may be a subtle distinction, but if you're trying to measure things, it helps to understand what you're measuring. SMTP_MAX_RCPTS = 500 SMTP_MAX_SESSIONS_PER_CONNECTION = 0 SENDMAIL_CMD = '/usr/lib/sendmail' ## I wonder can I use qmail-inject ? The above setting can be anything you want because Mailman doesn't use it unless you set DELIVERY_MODULE = 'Sendmail', but DO NOT DO THAT - you have been warned. QRUNNER_LOCK_LIFETIME = hours(20) QRUNNER_PROCESS_LIFETIME = minutes(120) QRUNNER_MAX_MESSAGES = 5 The above three settings are Mailman 2.0.x settings that have no relevance in Mailman 2.1.x How can we know the statistics of mailman for injecting these mails to qmail? I don't know why you are not seeing the appropriate log message. If you receive a post from the list, grep Mailman's log files for its message-id and see what you find. Look in Mailman's 'post' log for messages like Nov 15 18:09:38 2009 (2392) post to LIST from u...@example.com, size=2263, message-id=2a01c490-cda1-4bd4-a10c-1158731fd...@example.com, success and then look for the same message-id in the smtp log. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] How to monitor mailman transaction
Stephen J. Turnbull wrote: Hien HUYNH HUU writes: Hi Mark, I wonder why the smtp log just show 1 recips why I wish It show numbers : Because each SMTP connection is only sending to one recipient, that's why. If you are using VERP or personalized messages, the messages really are different as far as the MTA is concerned, and thus each one must be sent separately. But even though SMTPDirect.py sends a separate message in a separate SMTP transaction for each recipient, it still only writes one summary log message for the entire batch. For personalized messages, this is true at the Mailman stage, and you'll have to choose: multiple recipients per transaction, or personalization. You can't have both. For VERP, it may be possible to configure Mailman *without* VERP, and have the MTA do VERP itself. However, I don't know if you'll be able to take advantage of Mailman's VERP features (such as for bounce processing) in that case. You may need to have a separate system take care of those features at the MTA level. The regexp used to extract the recipient local-part and domain from the VERPed bounce recipient is set in Defaults.py as VERP_REGEXP and can be overridden in mm_cfg.py if necessary to accommodate the MTA's VERP format. So it should be possible to integrate MTA VERP with Mailman's bounce processing with any MTA that supports VERP. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] How to monitor mailman transaction
Hien HUYNH HUU wrote: Summary, I wish the mail list will : + inject messages to MTA (QMAIL) faster and faster . + I can log how many mails I can inject to MTA at the same time. At the risk of being overly pedantic and redundant, Mailman doesn't 'inject' messages. It delivers them via SMTP, and the rate is pretty much entirely determined by the MTA's response delays during SMTP. I.e. making it faster is an MTA tuning/configuration issue, not a Mailman issue. Mailman's SMTPDirect.py writes ONE log message with the number of recipients and time when it finishes it's delivery to the MTA of all recipients. I don't know why you are unable to find this message in Mailman's SMTP log, but it should be there. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Call me Don Quixote... :-(
This morning I checked the smtp log to see if I could find a match to my daily ping. I did find it today, 1 entry for 156 members. And I got 156 summarized bounces with 554 errors. :-/ I'm going to try renaming the list or creating a new one with the same members to see what happens... John Mark Sapiro wrote: Does the smtp log say it delivered the post to the appropriate number of recipients? it's hard to say... there is no single entry for the problem list that has the correct number (446 less a few nomail). What are the recipient numbers in the entry(s) for the message-id of a post? If VERP is on won't there only be 1 recipient/message-id, but multiple message-ids/post to Non-digest members? I also can't find a match to the received message IDs. It looks like digest is different, 2 entries totaling 262 recips... The individual (non-digest) messages are all the same message with the original message-id. The message may be delivered to the MTA by the SMTPDirect.py module in multiple transactions or even (with VERP) in transactions with a single recipient and a unique envelope sender, but there is still only one smtp log entry written by Mailman with the total number of recipients delivered to the MTA. The message-id in a message received from the list should be logged in the smtp log. Two entries per digest with Mailman generated message-ids is correct. one entry is for the plain format digest and one for the MIME format digest. These are separate messages with distinct contents, thus two messages. These may have been delivered to the MTA in multiple transactions or VERPed, but there are still only one log entry for the plain digest and one for the MIME digest. For now, I'm going to assume (ouch) that it's my provider's problem. Thanks for all for the patience and answers. If nothing else, I learned more about the workings of Mailman qmail. :-DI may try shutting off the RFC headers on the lists and see if that changes anything... There is some reason why this only affects one list. The question is why does the smarthost see mail from this list differently? Does the smarthost rate-limit you? I.e. does it reject all but the first 300 recipients in an hour or something like that? -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Call me Don Quixote... :-(
John wrote: This morning I checked the smtp log to see if I could find a match to my daily ping. I did find it today, 1 entry for 156 members. And I got 156 summarized bounces with 554 errors. :-/ I'm going to try renaming the list or creating a new one with the same members to see what happens... Do I understand correctly that you have a local MTA that uses the smarthost as a relay, and Mailman delivers to the local MTA? If so, is there anything interesting in the MTA's logs? -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] buildup of attachment files...
On one mailing list I'm seeing alot of attachment files building up in the archive directory: # pwd /var/lib/mailman/archives/private # ls listname* listname: attachments index.html listname.mbox: Looking down a couple directory levels in attachements: # pwd /var/lib/mailman/archives/private/listname/attachments/20091116/4763b4e9 # file * attachment.obj: gzip compressed data, was ErrorReport.21234.txt, from Unix, last modified: Mon Nov 16 11:03:59 2009 [r...@albers 4763b4e9]# ls attachment.obj Basically there are many directories in the attachments directory that go from 20070808 to 20091116. I'm running 2.1.9. I just need to know how to cleanup and turnoff if possible. Thanks! Troy -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] How to monitor mailman transaction
THANK YOU VERY MUCH FOR ALL . You, all you , help me very much , I want to say thank you for all. Now I detect my problem when using mailman and qmail . It's Personalize setting , and I change to use batch mode sending (personalized=0). It works perfect just having a small problem : It attached a text file (as footer, but I don't use footer so It's emty) . Could I leave this attachment , don't send It to users? Best regards, Huu Hien -Original Message- From: Mark Sapiro [mailto:m...@msapiro.net] Sent: Monday, November 16, 2009 11:43 PM To: Hien HUYNH HUU; Stephen J. Turnbull Cc: Carl Zwanzig; mailman-users@python.org Subject: RE: [Mailman-Users] How to monitor mailman transaction Hien HUYNH HUU wrote: Summary, I wish the mail list will : + inject messages to MTA (QMAIL) faster and faster . + I can log how many mails I can inject to MTA at the same time. At the risk of being overly pedantic and redundant, Mailman doesn't 'inject' messages. It delivers them via SMTP, and the rate is pretty much entirely determined by the MTA's response delays during SMTP. I.e. making it faster is an MTA tuning/configuration issue, not a Mailman issue. Mailman's SMTPDirect.py writes ONE log message with the number of recipients and time when it finishes it's delivery to the MTA of all recipients. I don't know why you are unable to find this message in Mailman's SMTP log, but it should be there. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Please help
Hello Dear friend: We are a nonprofit organization and our website is www.hc-mambd.org. We are hosting this site with a friend who has a hosting company. However, to my knowledge, he does not support any maling lists which we need. I have another website hosted by justhost.com and they support the mailing lists. My idea is to put the first site in the second's account which I did and create my mailing list. However, when I created the mailing list (i...@hc-mambd.org) and want to add the members (Membership Management), it tells me this: - No such list info_hc-mambd.orgThere currently are no publicly-advertised Mailman mailing lists on hc-mambd.org.To visit the administrators configuration page for an unadvertised list, open a URL similar to this one, but with a '/' and the right list name appended. If you have the proper authority, you can also create a new mailing list. General list information can be found at the mailing list overview page.(Send questions and comments to mail...@hc-mambd.org.)--- Can you PLEASE help me create my list (i...@hc-mambd.org) and add members to it? Thank you, Dr. Kassem. -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Cant send emails
Hi I can't send an email to my list. It worked well until last week I am the administrator. When I send from outlook it does not notify me that I need to moderate. When I go to mailman for moderation pending, it is there, as soon as I accept it it disappears Is there a solution Regards Verdi Ras -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Allowing non-subscribers to submit messages not working
I have been using mailman for a mailing list where non-subscribers are permitted to send messages, but those messages are moderated using emergency moderation. After a recent upgrade, this stopped working. Now, I get a message: Reason: Non-members are not allowed to post messages to this list. I am running 2.1.12.cp3. I do not know what version I was running previously. There does not appear to be a setting to allow non-subscribers to post. Is there a way to re-enable non-subscribers to send messages to the list? Thanks, Jerry -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] buildup of attachment files...
Troy Campbell wrote: On one mailing list I'm seeing alot of attachment files building up in the archive directory: [...] Basically there are many directories in the attachments directory that go from 20070808 to 20091116. I'm running 2.1.9. I just need to know how to cleanup and turnoff if possible. It is Scrubber.py that saves these. Depending on settings, you may get one or two copies of each attachment which is either not text/plain or text/plain with an unknown character set. If the list's Non-digest options - scrub-nondigest is Yes, you will get one saved attachment when the attachment is removed from the message and replaced by a link to the saved attachment. Otherwise, you get two. One when the attachment is scrubbed for the archive and one when the attachment is scrubbed from the plain format digest. You can avoid almost all of this by removing all non-plain text with content filtering. If you don't remove them with content filtering, you can avoid the 'digest copies' by setting Digest options - digestable to No. You can avoid the 'archive copies' by turning off archiving for the list. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] How to monitor mailman transaction
Hien HUYNH HUU wrote: It works perfect just having a small problem : It attached a text file (as footer, but I don't use footer so It's emty) . Could I leave this attachment , don't send It to users? If Mailman is attaching an empty footer to the message, msg_footer is not empty. It probably contains some white space character(s). Either select all of the msg_footer box in the web interface and delete it and submit changes or set msg_footer = '' with bin/config_list -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Cant send emails
Verdi Ras wrote: Hi I can't send an email to my list. It worked well until last week I am the administrator. When I send from outlook it does not notify me that I need to moderate. When I go to mailman for moderation pending, it is there, as soon as I accept it it disappears Possibly, you are not getting a need to moderate notice because General Options - admin_immed_notify is No, or possibly the entire issue is that Mailman's OutgoingRunner is not running and messages are just queued in Mailman's out queue and not sent. If this is your Mailman installation, see the FAQ at http://wiki.list.org/x/A4E9. If it is hosted, contact the host. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Allowing non-subscribers to submit messages notworking
Jerry Bell wrote: I have been using mailman for a mailing list where non-subscribers are permitted to send messages, but those messages are moderated using emergency moderation. After a recent upgrade, this stopped working. Now, I get a message: Reason: Non-members are not allowed to post messages to this list. I am running 2.1.12.cp3. I do not know what version I was running previously. There does not appear to be a setting to allow non-subscribers to post. Privacy options... - Sender filters - generic_nonmember_action = Accept If that isn't the answer, see the FAQ at http://wiki.list.org/x/sYA9. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Please help
Abdelmajid Kassem wrote: We are a nonprofit organization and our website is www.hc-mambd.org. We are hosting this site with a friend who has a hosting company. However, to my knowledge, he does not support any maling lists which we need. I have another website hosted by justhost.com and they support the mailing lists. My idea is to put the first site in the second's account which I did and create my mailing list. However, when I created the mailing list (i...@hc-mambd.org) and want to add the members (Membership Management), it tells me this: - No such list info_hc-mambd.orgThere currently are no publicly-advertised Mailman mailing lists on hc-mambd.org.To visit the administrators configuration page for an unadvertised list, open a URL similar to this one, but with a '/' and the right list name appended. If you have the proper authority, you can also create a new mailing list. General list information can be found at the mailing list overview page.(Send questions and comments to mail...@hc-mambd.org.)--- Can you PLEASE help me create my list (i...@hc-mambd.org) and add members to it? Please contact customer support at justhost.com with this issue. They are in a much better position to help with this problem than are the members of this list. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
