Re: [Mailman-Users] Slow Processing/Delivery

[Brad Knowles]

At 7:54 PM -0500 12/14/06, [EMAIL PROTECTED] wrote:

>  Anyone know what exactly these mean or how to handle it? Or point me in
>  the right direction of where to look to get this resolved since it's an
>  smtp problem?

The error "Connection unexpectedly closed" points to a problem within 
your MTA.  Depending on which MTA you use, there are some hints 
regarding performance tuning in the Mailman FAQ Wizard, but this is 
really an MTA-specific issue and you should use the books, web pages, 
mailing lists, etc... that are devoted to supporting that product.

-- 
Brad Knowles, <[EMAIL PROTECTED]>

Trend Micro has announced that they will cancel the stop.mail-abuse.org
mail forwarding service as of 15 November 2006.  If you have an old
e-mail account for me at this domain, please make sure you correct that
with the current address.
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] Slow Processing/Delivery

[Mark Sapiro]

[EMAIL PROTECTED] wrote:
>
>post.1:Dec 13 04:39:48 2006 (23382) post to star from [EMAIL PROTECTED],
>size=28696, message-id=<[EMAIL PROTECTED]>,
>16 failures


The smtp-failure entries give more info about the same event.


>The same goes for these in the smtp-failure logs:
>
>Dec 13 04:29:46 2006 (23382) Low level smtp error: Connection unexpectedly
>closed, msgid: <[EMAIL PROTECTED]>
>
>Dec 13 04:39:48 2006 (23382) delivery to [EMAIL PROTECTED] failed with code -
>1: Connection unexpectedly closed


The outgoing MTA is 'hanging up' on Mailman during SMTP delivery from
Mailman. This may be because of something it doesn't like about a
recipient or some other reason. It should not be doing DNS validation,
spam scanning or any such things on messages coming from Mailman. That
is a real performance killer. See the relevant hits from
.


>Anyone know what exactly these mean or how to handle it? Or point me in
>the right direction of where to look to get this resolved since it's an
>smtp problem?


If your Python is 2.4 or later, see

for a way to get debugging information from Python's smtplib.

-- 
Mark Sapiro <[EMAIL PROTECTED]>   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] Slow Processing/Delivery

[jrotunno]

Thanks for the replies. I checked out the log files and saw problems. The
example I gave in my previous message, for example, generated a bunch of
stuff. In the post logs I saw this repeated throughout the day until the
message was delivered:

post.1:Dec 13 04:39:48 2006 (23382) post to star from [EMAIL PROTECTED],
size=28696, message-id=<[EMAIL PROTECTED]>,
16 failures


The same goes for these in the smtp-failure logs:

Dec 13 04:29:46 2006 (23382) Low level smtp error: Connection unexpectedly
closed, msgid: <[EMAIL PROTECTED]>

Dec 13 04:39:48 2006 (23382) delivery to [EMAIL PROTECTED] failed with code -
1: Connection unexpectedly closed

Anyone know what exactly these mean or how to handle it? Or point me in
the right direction of where to look to get this resolved since it's an
smtp problem?

Thanks,
Jason

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] Slow Processing/Delivery

[Mark Sapiro]

Jason Rotunno wrote:
>
>Does mailman do any kind of 
>prioritizing depending on system load?


No. Each of mailman's queues (only 'in' and 'out' for message
processing and delivery) is processed FIFO and as quickly as
resources, and in the case of 'out', MTA responses allow.

Brad has given some good info in his reply. Also, look at Mailman's
'smtp' log and correlate the entries there with the Postfix log. Some
cases of slow delivery can result from a backlogged 'out' queue, and
this will show up in the entries in the 'smtp' log having time stamps
which are equal to the prior entry's time stamp plus the processing
time.

-- 
Mark Sapiro <[EMAIL PROTECTED]>   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] Slow Processing/Delivery

[Brad Knowles]

At 3:23 PM -0500 12/14/06, Jason Rotunno wrote:

>  We're experiencing some significant delays with our mailman lists. Some
>  messages are delivered instantly, while others can take hours (or over a
>  day) before it's delivered.

A certain amount of delay is not unusual, and variable amounts of 
delay for busy servers is not unusual.

What is unusual is the level of variable delay you're talking about.

>  We're running about 8-10 mailing lists, with membership numbers ranging
>  from a dozen members to about 1,000 (though there isn't much activity on
>  any of them), and our MTA is postfix. The delays aren't confined to one
>  list and they're not consistent. I don't believe there are mail delivery
>  delays with messages not sent to mailman.

There's some stuff in the FAQ on performance-tuning, but most of it 
has to do with things that are outside of Mailman itself.

> Does mailman do any kind of
>  prioritizing depending on system load?

Nope.


Things you can do with Mailman include splitting large lists up into 
several smaller lists and then setting up a parent "umbrella" list to 
take over the function of the existing single list.  This helps 
performance internal to Mailman itself by reducing competition for 
locks on the Python database where all the list configuration and 
user subscription information is stored.

You can also create multiple sets of queue runners for each queue, 
and they will process the data in that queue in parallel.  However, 
this is a pretty advanced configuration for Mailman, and is not well 
documented.  What little documentation you will find on this subject 
is mostly contained within the source code and the Defaults.py file, 
as opposed to the FAQ Wizard.


Of course, you want to do all the other performance tuning things 
that are described in the FAQ, to make sure that as much of system 
performance as possible is made available to Mailman, and you don't 
have multiple processes fighting for limited resources.

-- 
Brad Knowles, <[EMAIL PROTECTED]>

Trend Micro has announced that they will cancel the stop.mail-abuse.org
mail forwarding service as of 15 November 2006.  If you have an old
e-mail account for me at this domain, please make sure you correct that
with the current address.
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

[Mailman-Users] Slow Processing/Delivery

[Jason Rotunno]

Hi,

We're experiencing some significant delays with our mailman lists. Some 
messages are delivered instantly, while others can take hours (or over a 
day) before it's delivered. For example, a message came in at 4:07am and 
was passed on to  mailman for processing:

Dec 13 04:07:43 cork postfix/nqmgr[30962]: 45D6040050: from=<[EMAIL 
PROTECTED]>, 
size=28307, nrcpt=1 (queue active)
Dec 13 04:07:43 cork postfix/local[18473]: 45D6040050: to=<[EMAIL PROTECTED]>, 
relay=local, delay=1, status=sent ("|/var/mailman/mail/mailman post star")

The mail wasn't actually sent out from the mailman list until 2:25pm, 
though:

Dec 13 14:25:20 cork postfix/nqmgr[30962]: BE6DC3FCCD: 
from=<[EMAIL PROTECTED]>, size=29664, nrcpt=7 (queue active)
Dec 13 14:25:20 cork postfix/nqmgr[30962]: C85E53FCCE: 
from=<[EMAIL PROTECTED]>, size=29688, nrcpt=1 (queue active)
Dec 13 14:25:20 cork postfix/nqmgr[30962]: CFDB03FCCF: 
from=<[EMAIL PROTECTED]>, size=29664, nrcpt=8 (queue active)
Dec 13 14:51:34 cork postfix/nqmgr[30962]: C85E53FCCE: 
from=<[EMAIL PROTECTED]>, size=29688, nrcpt=1 (queue active)

We're running about 8-10 mailing lists, with membership numbers ranging 
from a dozen members to about 1,000 (though there isn't much activity on 
any of them), and our MTA is postfix. The delays aren't confined to one 
list and they're not consistent. I don't believe there are mail delivery 
delays with messages not sent to mailman. Does mailman do any kind of 
prioritizing depending on system load?
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] slow processing

[Patrick Bogen]

On 10/20/06, Dr. Scott S. Jones <[EMAIL PROTECTED]> wrote:
> Patrick Bogen [20/10/06 13:37 -0500]:
>
> > This is most likely caused by MTA issues. Search the FAQ for 'performance'.
> >
> > Is this the only list on that machine? Are you sure it wasn't a
> > one-time delay? (E.g., a nameserver that was temporarily inaccessible)
>
> Sorry to ask, but which FAQ am I to check for 'performance'?
>
>
That would be the Mailman FAQ that's linked at the bottom of every
mailing list mail. Also, please keep all replies on-list; it's likely
that there are people who know more or have better insight than I, so
they deserve the chance show me I'm wrong.


-- 
- Patrick Bogen
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] slow processing

[Patrick Bogen]

On 10/20/06, Dr. Scott S. Jones <[EMAIL PROTECTED]> wrote:
> What might cause really slow processing of email sent to a list? I set up a
> new list yesterday around 4:00 pmdidn't receive any response, until this
> morning, I noticed that around 7:00 pm, the mail finally arrived.

This is most likely caused by MTA issues. Search the FAQ for 'performance'.

Is this the only list on that machine? Are you sure it wasn't a
one-time delay? (E.g., a nameserver that was temporarily inaccessible)


-- 
- Patrick Bogen
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

[Mailman-Users] slow processing

[Dr. Scott S. Jones]

What might cause really slow processing of email sent to a list? I set up a
new list yesterday around 4:00 pmdidn't receive any response, until this
morning, I noticed that around 7:00 pm, the mail finally arrived. 

??

Scott



signature.asc
Description: Digital signature
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp