Re: [Mailman-Users] How to monitor mailman transaction

2009-11-16 Thread Brad Knowles
On Nov 16, 2009, at 12:10 AM, Stephen J. Turnbull wrote:

 Hien HUYNH HUU writes:
 
 Wow , may be this is my problem . Could you explain me more ?
 
 I'm sorry, I don't really have time to go back and look at all the
 information right now.  The issues are pretty well explained in
 several FAQs (unfortunately there are a few relevant ones, but I think
 you get all of them if you search for performance).

If you enable any kind of personalization, then you'll get individual messages 
being delivered by Mailman to the MTA.  This includes footers with a 
user-specific string to tell them what their particular link is to unsubscribe 
from the list, etc

You'll have to disable all types of personalization and VERP to get more than 
one recipient per message being sent to the MTA.  And qmail is not an ideal MTA 
for maximum performance on a mailing list -- I can run rings around it with 
postfix.

--
Brad Knowles bradknow...@shub-internet.org
LinkedIn Profile: http://tinyurl.com/y8kpxu

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-16 Thread Mark Sapiro
Hien HUYNH HUU wrote:

   I wonder why the smtp log just show 1 recips why I wish It show numbers :

Nov 16 08:24:34 2009 (2874) 
mailman.305.1258334667.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.241 seconds
Nov 16 08:24:35 2009 (21892) 
mailman.309.1258334667.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.281 seconds
Nov 16 08:24:35 2009 (21892) 
mailman.292.1258334666.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.271 seconds
Nov 16 08:24:35 2009 (21892) 
mailman.295.1258334666.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.213 seconds
Nov 16 08:24:36 2009 (21892) 
mailman.307.1258334667.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.285 seconds
Nov 16 08:25:00 2009 (2874) mailman.87.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.256 seconds
Nov 16 08:25:00 2009 (21892) 
mailman.89.1258334698.2870.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.306 seconds
Nov 16 08:25:00 2009 (2874) mailman.90.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.332 seconds
Nov 16 08:25:00 2009 (21892) 
mailman.91.1258334698.2870.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.381 seconds
Nov 16 08:25:01 2009 (2874) mailman.92.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.407 seconds
Nov 16 08:25:01 2009 (21892) 
mailman.93.1258334698.2870.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.425 seconds
Nov 16 08:25:01 2009 (2874) mailman.94.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.320 seconds


If you have standard GNU Mailman, none of the above messages is a post.
Every one of them is some kind of Mailman generated notice (maybe from
BounceRunner, I'm guessing). You can tell because each has a Mailman
generated message id. It looks like you have two OutgoingRunner
processes with PIDs 2874 and 21892. Is this intentional? Some of those
messages were generated by PID 2870 and some by PID 21888. What are
these processes?

It also seems that you may have two sets of Mailman qrunners running
which were started at different times, thus not sliced. This is bad.
See the FAQ at http://wiki.list.org/x/_4A9.

Stephen and Brad's replies notwithstanding, SMTPDirect.py, which is the
module that writes the above messages, writes only one such log
message for each processed queue entry, regardless of the number of
SMTP transactions used to deliver the message to the MTA.

Even if the message is personalized and/or VERPed so that SMTPDirect
deliveres one slightly different message to each recipient, it still
only writes one log message after completing the entire delivery to
all recipients.

What is in all your Mailman logs. Particularly, smtp-failure and bounce?


  Up to now, I can't count how many emails mailman inject to qmail queue at 
 the same time although I set these options in Mailman :


Mailman does not inject messages into qmail's queue. Mailman deliveres
messages by SMTP to qmail and qmail queues them. This may be a subtle
distinction, but if you're trying to measure things, it helps to
understand what you're measuring.


SMTP_MAX_RCPTS = 500
SMTP_MAX_SESSIONS_PER_CONNECTION = 0
SENDMAIL_CMD = '/usr/lib/sendmail'   ## I wonder can I use 
qmail-inject ?


The above setting can be anything you want because Mailman doesn't use
it unless you set DELIVERY_MODULE = 'Sendmail', but DO NOT DO THAT -
you have been warned.


QRUNNER_LOCK_LIFETIME = hours(20)
QRUNNER_PROCESS_LIFETIME = minutes(120)
QRUNNER_MAX_MESSAGES = 5


The above three settings are Mailman 2.0.x settings that have no
relevance in Mailman 2.1.x


  How can we know the statistics of mailman for injecting these mails to qmail?


I don't know why you are not seeing the appropriate log message. If you
receive a post from the list, grep Mailman's log files for its
message-id and see what you find.

Look in Mailman's 'post' log for messages like

Nov 15 18:09:38 2009 (2392) post to LIST from u...@example.com,
size=2263,
message-id=2a01c490-cda1-4bd4-a10c-1158731fd...@example.com, success

and then look for the same message-id in the smtp log.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-16 Thread Mark Sapiro
Stephen J. Turnbull wrote:

Hien HUYNH HUU writes:
  Hi Mark, 
 I wonder why the smtp log just show 1 recips why I wish It show numbers :

Because each SMTP connection is only sending to one recipient, that's
why.  If you are using VERP or personalized messages, the messages
really are different as far as the MTA is concerned, and thus each one
must be sent separately.


But even though SMTPDirect.py sends a separate message in a separate
SMTP transaction for each recipient, it still only writes one summary
log message for the entire batch.


For personalized messages, this is true at the Mailman stage, and
you'll have to choose: multiple recipients per transaction, or
personalization.  You can't have both.

For VERP, it may be possible to configure Mailman *without* VERP, and
have the MTA do VERP itself.  However, I don't know if you'll be able
to take advantage of Mailman's VERP features (such as for bounce
processing) in that case.  You may need to have a separate system take
care of those features at the MTA level.


The regexp used to extract the recipient local-part and domain from the
VERPed bounce recipient is set in Defaults.py as VERP_REGEXP and can
be overridden in mm_cfg.py if necessary to accommodate the MTA's VERP
format. So it should be possible to integrate MTA VERP with Mailman's
bounce processing with any MTA that supports VERP.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-16 Thread Mark Sapiro
Hien HUYNH HUU wrote:

 Summary, I wish the mail list  will :
+  inject messages to MTA (QMAIL) faster and faster .
+ I can log how many mails I can inject to MTA at the same time.


At the risk of being overly pedantic and redundant, Mailman doesn't
'inject' messages. It delivers them via SMTP, and the rate is pretty
much entirely determined by the MTA's response delays during SMTP.
I.e. making it faster is an MTA tuning/configuration issue, not a
Mailman issue.

Mailman's SMTPDirect.py writes ONE log message with the number of
recipients and time when it finishes it's delivery to the MTA of all
recipients. I don't know why you are unable to find this message in
Mailman's SMTP log, but it should be there.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-16 Thread Hien HUYNH HUU
THANK YOU VERY MUCH FOR ALL .
   You, all you , help me very much , I want to say thank you for all.
   Now I detect my problem when using mailman and qmail . It's Personalize 
setting  , and I change to use batch mode sending (personalized=0).
   It works perfect just having a small problem : It attached a text file (as 
footer, but I don't use footer so It's emty) . Could I leave this attachment , 
don't send It to users?
   Best regards,
   Huu Hien

  



-Original Message-
From: Mark Sapiro [mailto:m...@msapiro.net] 
Sent: Monday, November 16, 2009 11:43 PM
To: Hien HUYNH HUU; Stephen J. Turnbull
Cc: Carl Zwanzig; mailman-users@python.org
Subject: RE: [Mailman-Users] How to monitor mailman transaction

Hien HUYNH HUU wrote:

 Summary, I wish the mail list  will :
+  inject messages to MTA (QMAIL) faster and faster .
+ I can log how many mails I can inject to MTA at the same time.


At the risk of being overly pedantic and redundant, Mailman doesn't
'inject' messages. It delivers them via SMTP, and the rate is pretty
much entirely determined by the MTA's response delays during SMTP.
I.e. making it faster is an MTA tuning/configuration issue, not a
Mailman issue.

Mailman's SMTPDirect.py writes ONE log message with the number of
recipients and time when it finishes it's delivery to the MTA of all
recipients. I don't know why you are unable to find this message in
Mailman's SMTP log, but it should be there.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-16 Thread Mark Sapiro
Hien HUYNH HUU wrote:
   It works perfect just having a small problem : It attached a text file (as 
 footer, but I don't use footer so It's emty) . Could I leave this attachment 
 , don't send It to users?


If Mailman is attaching an empty footer to the message, msg_footer is
not empty. It probably contains some white space character(s).

Either select all of the msg_footer box in the web interface and delete
it and submit changes or set

msg_footer = ''

with bin/config_list

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-15 Thread Hien HUYNH HUU
Hi Mark, 
   I wonder why the smtp log just show 1 recips why I wish It show numbers :

Nov 16 08:24:34 2009 (2874) 
mailman.305.1258334667.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.241 seconds
Nov 16 08:24:35 2009 (21892) 
mailman.309.1258334667.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.281 seconds
Nov 16 08:24:35 2009 (21892) 
mailman.292.1258334666.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.271 seconds
Nov 16 08:24:35 2009 (21892) 
mailman.295.1258334666.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.213 seconds
Nov 16 08:24:36 2009 (21892) 
mailman.307.1258334667.21888.listn...@maillist.com smtp to listname for 1 
recips, completed in 0.285 seconds
Nov 16 08:25:00 2009 (2874) mailman.87.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.256 seconds
Nov 16 08:25:00 2009 (21892) mailman.89.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.306 seconds
Nov 16 08:25:00 2009 (2874) mailman.90.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.332 seconds
Nov 16 08:25:00 2009 (21892) mailman.91.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.381 seconds
Nov 16 08:25:01 2009 (2874) mailman.92.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.407 seconds
Nov 16 08:25:01 2009 (21892) mailman.93.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.425 seconds
Nov 16 08:25:01 2009 (2874) mailman.94.1258334698.2870.listn...@maillist.com 
smtp to listname for 1 recips, completed in 0.320 seconds
 
  Up to now, I can't count how many emails mailman inject to qmail queue at the 
same time although I set these options in Mailman :

SMTP_MAX_RCPTS = 500
SMTP_MAX_SESSIONS_PER_CONNECTION = 0
SENDMAIL_CMD = '/usr/lib/sendmail'   ## I wonder can I use 
qmail-inject ?
QRUNNER_LOCK_LIFETIME = hours(20)
QRUNNER_PROCESS_LIFETIME = minutes(120)
QRUNNER_MAX_MESSAGES = 5
   
  How can we know the statistics of mailman for injecting these mails to qmail?
  Best regards,
  Huu Hien

 
   

-Original Message-
From: Mark Sapiro [mailto:m...@msapiro.net] 
Sent: Thursday, November 12, 2009 4:14 PM
To: Hien HUYNH HUU; Carl Zwanzig
Cc: mailman-users@python.org
Subject: RE: [Mailman-Users] How to monitor mailman transaction

Hien HUYNH HUU wrote:

  These 2 log lines are generated when a post was sent successful to everyone 
 (I just tail 2 last lines). May be something wrongs ? I'm using 
 Mailman-2.1.12.


Try looking at the whole log or grepping it for the message id of your
post.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-15 Thread Stephen J. Turnbull
Hien HUYNH HUU writes:
  Hi Mark, 
 I wonder why the smtp log just show 1 recips why I wish It show numbers :

Because each SMTP connection is only sending to one recipient, that's
why.  If you are using VERP or personalized messages, the messages
really are different as far as the MTA is concerned, and thus each one
must be sent separately.

For personalized messages, this is true at the Mailman stage, and
you'll have to choose: multiple recipients per transaction, or
personalization.  You can't have both.

For VERP, it may be possible to configure Mailman *without* VERP, and
have the MTA do VERP itself.  However, I don't know if you'll be able
to take advantage of Mailman's VERP features (such as for bounce
processing) in that case.  You may need to have a separate system take
care of those features at the MTA level.

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-15 Thread Hien HUYNH HUU
Hi Stephen,

Wow , may be this is my problem . Could you explain me more ? How can I chose 
multiple recipients per transaction rather than 1 recipients per transaction as 
now ? ( I see that I  set VERP_PERSONALIZED_DELIVERIES = No now) .
 
 Summary, I wish the mail list  will :
+  inject messages to MTA (QMAIL) faster and faster .
+ I can log how many mails I can inject to MTA at the same time.
 Best regards,
 Huu Hien


-Original Message-
From: Stephen J. Turnbull [mailto:step...@xemacs.org] 
Sent: Monday, November 16, 2009 11:14 AM
To: Hien HUYNH HUU
Cc: Mark Sapiro; Carl Zwanzig; mailman-users@python.org
Subject: Re: [Mailman-Users] How to monitor mailman transaction

Hien HUYNH HUU writes:
  Hi Mark, 
 I wonder why the smtp log just show 1 recips why I wish It show numbers :

Because each SMTP connection is only sending to one recipient, that's
why.  If you are using VERP or personalized messages, the messages
really are different as far as the MTA is concerned, and thus each one
must be sent separately.

For personalized messages, this is true at the Mailman stage, and
you'll have to choose: multiple recipients per transaction, or
personalization.  You can't have both.

For VERP, it may be possible to configure Mailman *without* VERP, and
have the MTA do VERP itself.  However, I don't know if you'll be able
to take advantage of Mailman's VERP features (such as for bounce
processing) in that case.  You may need to have a separate system take
care of those features at the MTA level.

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-15 Thread Stephen J. Turnbull
Hien HUYNH HUU writes:

  Wow , may be this is my problem . Could you explain me more ?

I'm sorry, I don't really have time to go back and look at all the
information right now.  The issues are pretty well explained in
several FAQs (unfortunately there are a few relevant ones, but I think
you get all of them if you search for performance).

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-12 Thread Hien HUYNH HUU
Hi Mark,
   I checked , but It didn't show exactly :

Nov 12 10:35:17 2009 (21892) mailman.185.1257996917.21888.listn...@domain.com 
smtp to listname for 1 recips, completed in 0.111 seconds
Nov 12 10:45:17 2009 (21892) mailman.186.1257997515.21888.listn...@domain.com 
smtp to listname for 1 recips, completed in 0.095 seconds
   
   As you see, It just show 1 recips per line in 0.x seconds.
   When I count :

  [r...@pxp02 logs]# cat smtp | grep Nov 12 |wc -l
  30
  
   But my list has over 1 emails , so this log shows not correctly.
   Best regards,
   Huu Hien


-Original Message-
From: Mark Sapiro [mailto:m...@msapiro.net] 
Sent: Thursday, November 12, 2009 2:33 PM
To: Hien HUYNH HUU; Carl Zwanzig
Cc: mailman-users@python.org
Subject: Re: [Mailman-Users] How to monitor mailman transaction

Hien HUYNH HUU wrote:

I checked mailman's logs and MTA's logs ,  but It can't said exactly how many 
mails transferred between mail server and mailman at a point time. 


Mailman's smtp log contains entries like:

Nov 11 18:16:07 2009 (2392) message-id smtp to listname for 181
recips, completed in 5.353 seconds

It seems that that is exactly the information you're looking for. You
can look at the raw log or use the mmdsr script referred to by Stephen
and Brad to summarize it.

If you need more detail that that, you'll have to analyze your MTA's
logs.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-12 Thread Mark Sapiro
Hien HUYNH HUU wrote:

Hi Mark,
   I checked , but It didn't show exactly :

Nov 12 10:35:17 2009 (21892) 
mailman.185.1257996917.21888.listn...@domain.com smtp to listname for 1 
recips, completed in 0.111 seconds
Nov 12 10:45:17 2009 (21892) 
mailman.186.1257997515.21888.listn...@domain.com smtp to listname for 1 
recips, completed in 0.095 seconds

   As you see, It just show 1 recips per line in 0.x seconds.
   When I count :


Those two entries are for the delivery of mailman generated notices to
the list owner or the poster or ?? They are not for delivery of a post.


  [r...@pxp02 logs]# cat smtp | grep Nov 12 |wc -l
  30

   But my list has over 1 emails , so this log shows not correctly.


If there is a post on Nov 12, Mailman hasn't yet finished it's delivery
to the MTA. The log entry is written after the message has been sent
to everyone.

If you want to know where it is in the delivery process for a single
message that is taking a long time, you will have to look at the MTA
logs or perhaps enable debug output from smtplib - see the FAQ at
http://wiki.list.org/x/-IA9.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-12 Thread Hien HUYNH HUU
Hi Mark,
  These 2 log lines are generated when a post was sent successful to everyone 
(I just tail 2 last lines). May be something wrongs ? I'm using Mailman-2.1.12.
  Rgds,
  Huu Hien
  

-Original Message-
From: Mark Sapiro [mailto:m...@msapiro.net] 
Sent: Thursday, November 12, 2009 3:35 PM
To: Hien HUYNH HUU; Carl Zwanzig
Cc: mailman-users@python.org
Subject: RE: [Mailman-Users] How to monitor mailman transaction

Hien HUYNH HUU wrote:

Hi Mark,
   I checked , but It didn't show exactly :

Nov 12 10:35:17 2009 (21892) 
mailman.185.1257996917.21888.listn...@domain.com smtp to listname for 1 
recips, completed in 0.111 seconds
Nov 12 10:45:17 2009 (21892) 
mailman.186.1257997515.21888.listn...@domain.com smtp to listname for 1 
recips, completed in 0.095 seconds

   As you see, It just show 1 recips per line in 0.x seconds.
   When I count :


Those two entries are for the delivery of mailman generated notices to
the list owner or the poster or ?? They are not for delivery of a post.


  [r...@pxp02 logs]# cat smtp | grep Nov 12 |wc -l
  30

   But my list has over 1 emails , so this log shows not correctly.


If there is a post on Nov 12, Mailman hasn't yet finished it's delivery
to the MTA. The log entry is written after the message has been sent
to everyone.

If you want to know where it is in the delivery process for a single
message that is taking a long time, you will have to look at the MTA
logs or perhaps enable debug output from smtplib - see the FAQ at
http://wiki.list.org/x/-IA9.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-12 Thread Mark Sapiro
Hien HUYNH HUU wrote:

  These 2 log lines are generated when a post was sent successful to everyone 
 (I just tail 2 last lines). May be something wrongs ? I'm using 
 Mailman-2.1.12.


Try looking at the whole log or grepping it for the message id of your
post.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-11 Thread Carl Zwanzig

Hien HUYNH HUU wrote:

Dear all, How can we monitor mailman transaction with Mail Server ? It
means how could we know that how many email are delivered from mailman to
mail server at a time point ? I check qfile/out but It didn't show
exactly .


You can either look at mailman's logs, at the MTA's logs, or watch the
connection with something like wireshark/ethereal.

z!
--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-11 Thread Hien HUYNH HUU
I checked mailman's logs and MTA's logs ,  but It can't said exactly how many 
mails transferred between mail server and mailman at a point time. 
Have you got any idea ?
Rgds,
HHH

-Original Message-
From: Carl Zwanzig [mailto:c...@tuunq.com] 
Sent: Thursday, November 12, 2009 10:15 AM
To: Hien HUYNH HUU
Cc: mailman-users@python.org
Subject: Re: [Mailman-Users] How to monitor mailman transaction

Hien HUYNH HUU wrote:
 Dear all, How can we monitor mailman transaction with Mail Server ? It
 means how could we know that how many email are delivered from mailman to
 mail server at a time point ? I check qfile/out but It didn't show
 exactly .

You can either look at mailman's logs, at the MTA's logs, or watch the
connection with something like wireshark/ethereal.

z!
--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-11 Thread Stephen J. Turnbull
Hien HUYNH HUU writes:

  I checked mailman's logs and MTA's logs , but It can't said exactly
  how many mails transferred between mail server and mailman at a
  point time.

I think that in the contrib directory there's a script that produces a
summary of the logs.  You should be able to get such statistics with
that script or a modified version.

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-11 Thread Brad Knowles
On Nov 11, 2009, at 11:36 PM, Stephen J. Turnbull wrote:

 I think that in the contrib directory there's a script that produces a
 summary of the logs.  You should be able to get such statistics with
 that script or a modified version.

I originally wrote the mmdsr script because there was all sorts of information 
in the wide variety of Mailman logs, but it was very inconsistent in the way 
that information was logged, and what went into what log file.  At the time, I 
desperately needed more information to help me assist in the management of the 
mailing lists and general mail server functions for python.org, including this 
list.

Since then, I've gotten a better handle on what is going on when, and I have 
had less need for the script myself, but there are others on the 
Mailman/Python.org Postmaster Team who continue to find that information very 
useful.  Mark has semi-unofficially taken over continuing maintenance on it, 
which is fine by me because I haven't had the time or inclination to deal with 
some of the issues that have been reported since the last time I touched the 
script.


However, that's just the Mailman side of that equation.  You should have 
similar tools for whatever MTA you're using, so that you get a better idea of 
what's going on across the whole system.

I have not touched any such scripts in many, many years, but I'm sure there are 
plenty of such tools available for various popular MTAs out there.

--
Brad Knowles bradknow...@shub-internet.org
LinkedIn Profile: http://tinyurl.com/y8kpxu

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] How to monitor mailman transaction

2009-11-11 Thread Mark Sapiro
Hien HUYNH HUU wrote:

I checked mailman's logs and MTA's logs ,  but It can't said exactly how many 
mails transferred between mail server and mailman at a point time. 


Mailman's smtp log contains entries like:

Nov 11 18:16:07 2009 (2392) message-id smtp to listname for 181
recips, completed in 5.353 seconds

It seems that that is exactly the information you're looking for. You
can look at the raw log or use the mmdsr script referred to by Stephen
and Brad to summarize it.

If you need more detail that that, you'll have to analyze your MTA's
logs.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org