[Mailman-Users] Strange error with Mailman 2.1.9

[Richard Hartmann]

Hi all,

I have this in my error log:

Nov 27 09:53:19 2008 post(18252): Traceback (most recent call last):
post(18252):   File "/usr/lib/mailman/scripts/post", line 69, in ?
post(18252):  main()
post(18252):   File "/usr/lib/mailman/scripts/post", line 64, in main
post(18252):  tolist=1, _plaintext=1)
post(18252):   File "/usr/lib/mailman/Mailman/Queue/Switchboard.py",
line 137, in enqueue
post(18252):  os.fsync(fp.fileno())
post(18252): OSError :  [Errno 5] Input/output error
post(19319):   File "/usr/lib/mailman/scripts/post", line 64, in main
post(19319):  tolist=1, _plaintext=1)
post(19319):   File "/usr/lib/mailman/Mailman/Queue/Switchboard.py",
line 137, in enqueue
post(19319):  os.fsync(fp.fileno())
post(19319): OSError :  [Errno 5] Input/output error
Nov 28 11:49:40 2008 post(927): Traceback (most recent call last):
post(927):   File "/usr/lib/mailman/scripts/post", line 69, in ?
post(927):  main()
post(927):   File "/usr/lib/mailman/scripts/post", line 64, in main
post(927):  tolist=1, _plaintext=1)
post(927):   File "/usr/lib/mailman/Mailman/Queue/Switchboard.py",
line 137, in enqueue
post(927):  os.fsync(fp.fileno())
post(927): OSError :  [Errno 5] Input/output error

And my in looks like:

./in:
total 3.4M
-rw-rw  1 root mailman 456K Nov 27 09:48
1227775710.928695+a44f4a2c5af5927c529c6c4a5589ab71759a1f86.pck.tmp
-rw-rw  1 root mailman 120K Nov 27 14:38
1227793170.26085+afbc8b7ceee95547b83dc3e69f055d67e53acb33.pck.tmp
-rw-rw  1 root mailman  16M Nov 28 11:43
1227861580.003396+d73b39bd22372e715d2d80786654ef362e65fae0.pck.tmp



Things I checked are:

1) free disk space: more than enough
2) free inodes: more than enough
3) no SELinux or other security/restriction framework installed
4) bin/check_perms does not list any errors
5) other email is delivered


Any other ideas what to check? Upgrading Mailmain is an option, but I
would like to avoid that, if possible.


Thanks for all feedback,
Richard
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Richard Hartmann]

Further info:

Restarting mailman gives me

# /etc/init.d/mailman restart
Shutting down mailman

  done
rm: cannot remove `/var/lib/mailman/locks/*': No such file or directory
Starting mailmanrm: cannot remove `/var/lib/mailman/locks/*': No such
file or directory
 # ls -l /var/lib/mailman/locks/
total 8
-rw-rw-r--  2 mailman mailman 49 Dec  2  2008 master-qrunner
-rw-rw-r--  2 mailman mailman 49 Dec  2  2008 master-qrunner.plesk1.6444
#


I tried stopping mailman, moving the messages to shunt/, starting Mailman again
and then running bin/unshunt, but that does not work, either. Neither does this
produce any new log output.


Any and all ideas appreciated..
Richard
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Richard Hartmann]

Even more info (should have stated that in the first email):

This is a NFS share. So it might 'just' be a crappy net connection.

Any thoughts about this patch which I plan to apply locally?
Beware evil GMail linebreaks..


--- /usr/lib/mailman/Mailman/Queue/Switchboard.py.orig  2008-12-01
11:46:31.524425955 +0100
+++ /usr/lib/mailman/Mailman/Queue/Switchboard.py   2008-12-01
11:48:39.676765175 +0100
@@ -134,7 +134,19 @@
 fp.write(msgsave)
 cPickle.dump(data, fp, protocol)
 fp.flush()
-os.fsync(fp.fileno())
+# os.fsync(fp.fileno())
+# Sometimes, the sync to our NFS share fails. This retries
+# nine times and then gives up -- RichiH 081201
+for trial in xrange(10):
+try:
+os.fsync(fp.fileno())
+except OSError, e:
+if trial == 9 or e.errno != errno.EIO:
+raise
+time.sleep(1)
+continue
+else:
+break
 finally:
 fp.close()
 finally:



Thanks,
Richars
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[J.A. Terranson]

On Mon, 1 Dec 2008, Richard Hartmann wrote:

> Restarting mailman gives me
>
> # /etc/init.d/mailman restart
> Shutting down mailman
>
>   done
> rm: cannot remove `/var/lib/mailman/locks/*': No such file or directory
> Starting mailmanrm: cannot remove `/var/lib/mailman/locks/*': No such
> file or directory


try this:

./mailmanctl stop
./mailmanctl --stale-lock-cleanup start


-- 
Yours,
J.A. Terranson
sysadmin_at_mfn.org
0xpgp_key_mgmt_is_broken-dont_bother

"Never belong to any party, always oppose privileged classes and public
plunderers, never lack sympathy with the poor, always remain devoted to
the public welfare, never be satisfied with merely printing news, always
be drastically independent, never be afraid to attack wrong, whether by
predatory plutocracy or predatory poverty."

Joseph Pulitzer
1907 Speech
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Richard Hartmann]

On Mon, Dec 1, 2008 at 15:14, J.A. Terranson <[EMAIL PROTECTED]> wrote:

> try this:
>
>./mailmanctl stop
>./mailmanctl --stale-lock-cleanup start

Nope, the warnings are still there. I don't really care about those, though.
My main concern is to make Mailman reliably relay list mail.


Thanks though!
Rihcard
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Mark Sapiro]

Richard Hartmann wrote:

>Further info:
>
>Restarting mailman gives me
>
># /etc/init.d/mailman restart
>Shutting down mailman
>
>  done
>rm: cannot remove `/var/lib/mailman/locks/*': No such file or directory
>Starting mailmanrm: cannot remove `/var/lib/mailman/locks/*': No such
>file or directory
> # ls -l /var/lib/mailman/locks/
>total 8
>-rw-rw-r--  2 mailman mailman 49 Dec  2  2008 master-qrunner
>-rw-rw-r--  2 mailman mailman 49 Dec  2  2008 master-qrunner.plesk1.6444
>#


First of all, your /etc/init.d/mailman script come from plesk or some
other packager. Our suggested script doesn't attempt to remove lock
files.

Second, I'm guessing, but if the rm /var/lib/mailman/locks/* comes
after "mailmanctl stop" it is normal that there are no locks, although
your ls seems to show a master lock which may be stale. Is there a pid
6444 running?

Still guessing, but perhaps your script does something like

mailmanctl stop
rm /var/lib/mailman/locks/*
...
rm /var/lib/mailman/locks/*
mailmanctl start

in order to remove all locks after stoping and before starting. Then
tha absence of locks would be normal, and the locks you see from 'ls'
are the ones just created when Mailman started.

Finally, if "rm /var/lib/mailman/locks/*" says "cannot remove
`/var/lib/mailman/locks/*': No such file or directory" when there are
files, this is not a Mailman question.


>I tried stopping mailman, moving the messages to shunt/, starting Mailman again
>and then running bin/unshunt, but that does not work, either. Neither does this
>produce any new log output.


You indicated files named *.pck.tmp in /in/

These won't be processed by unshunt. If you want to reprocess them,
just leave them in the /in/ queue and remove the .tmp from the name.
Then IncomingRunner will process them.  However, since the write to
flush and sync the file failed, the file may be incomplete. You should
dump the file with "bin/dumpdb -p" to make sure it contains both a
message and a metadata object before renaming it.

Do not unshunt files that weren't shunted to begin with.

-- 
Mark Sapiro <[EMAIL PROTECTED]>The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Mark Sapiro]

Richard Hartmann wrote:

>Even more info (should have stated that in the first email):
>
>This is a NFS share. So it might 'just' be a crappy net connection.
>
>Any thoughts about this patch which I plan to apply locally?
>Beware evil GMail linebreaks..
>
>
>--- /usr/lib/mailman/Mailman/Queue/Switchboard.py.orig  2008-12-01
>11:46:31.524425955 +0100
>+++ /usr/lib/mailman/Mailman/Queue/Switchboard.py   2008-12-01
>11:48:39.676765175 +0100
>@@ -134,7 +134,19 @@
> fp.write(msgsave)
> cPickle.dump(data, fp, protocol)
> fp.flush()
>-os.fsync(fp.fileno())
>+# os.fsync(fp.fileno())
>+# Sometimes, the sync to our NFS share fails. This retries
>+# nine times and then gives up -- RichiH 081201
>+for trial in xrange(10):
>+try:
>+os.fsync(fp.fileno())
>+except OSError, e:
>+if trial == 9 or e.errno != errno.EIO:
>+raise
>+time.sleep(1)
>+continue
>+else:
>+break
> finally:
> fp.close()
> finally:


The patch looks OK. Let us know how it works.

-- 
Mark Sapiro <[EMAIL PROTECTED]>The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Richard Hartmann]

On Mon, Dec 1, 2008 at 18:01, Mark Sapiro <[EMAIL PROTECTED]> wrote:

> First of all, your /etc/init.d/mailman script come from plesk or some
> other packager. Our suggested script doesn't attempt to remove lock
> files.

Yes, it's Plesk (unfortunately).


> You should
> dump the file with "bin/dumpdb -p" to make sure it contains both a
> message and a metadata object before renaming it.

# /usr/lib/mailman/bin/dumpdb -p
/var/lib/mailman/qfiles/shunt/1227775710.928695+a44f4a2c5af5927c529c6c4a5589ab71759a1f86.pck.tmp
[- start pickle file -]
Traceback (most recent call last):
  File "/usr/lib/mailman/bin/dumpdb", line 159, in 
msg = main()
  File "/usr/lib/mailman/bin/dumpdb", line 139, in main
obj = load(fp)
ValueError: insecure string pickle
# /usr/lib/mailman/bin/dumpdb -p
/var/lib/mailman/qfiles/shunt/1227793170.26085+afbc8b7ceee95547b83dc3e69f055d67e53acb33.pck.tmp
[- start pickle file -]
Traceback (most recent call last):
  File "/usr/lib/mailman/bin/dumpdb", line 159, in 
msg = main()
  File "/usr/lib/mailman/bin/dumpdb", line 139, in main
obj = load(fp)
ValueError: insecure string pickle
# /usr/lib/mailman/bin/dumpdb -p
/var/lib/mailman/qfiles/shunt/1227861580.003396+d73b39bd22372e715d2d80786654ef362e65fae0.pck.tmp
[- start pickle file -]
Traceback (most recent call last):
  File "/usr/lib/mailman/bin/dumpdb", line 159, in 
msg = main()
  File "/usr/lib/mailman/bin/dumpdb", line 139, in main
obj = load(fp)
ValueError: insecure string pickle
#


> Do not unshunt files that weren't shunted to begin with.

OK, thanks. I added your hint to my personal wiki. Very useful!


Richard
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Mark Sapiro]

Richard Hartmann wrote:
>
>> You should
>> dump the file with "bin/dumpdb -p" to make sure it contains both a
>> message and a metadata object before renaming it.
>
># /usr/lib/mailman/bin/dumpdb -p
>/var/lib/mailman/qfiles/shunt/1227775710.928695+a44f4a2c5af5927c529c6c4a5589ab71759a1f86.pck.tmp
>[- start pickle file -]
>Traceback (most recent call last):
>  File "/usr/lib/mailman/bin/dumpdb", line 159, in 
>msg = main()
>  File "/usr/lib/mailman/bin/dumpdb", line 139, in main
>obj = load(fp)
>ValueError: insecure string pickle


It looks like the files are corrupt. You may be able to see something
of the contents with 'strings', but Mailman won't be able to process
them as they are.

If strings allows you to actually recover a message from the file, you
can re-post that message with bin/inject.

-- 
Mark Sapiro <[EMAIL PROTECTED]>The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Richard Hartmann]

On Mon, Dec 1, 2008 at 18:24, Mark Sapiro <[EMAIL PROTECTED]> wrote:

> It looks like the files are corrupt. You may be able to see something
> of the contents with 'strings', but Mailman won't be able to process
> them as they are.
>
> If strings allows you to actually recover a message from the file, you
> can re-post that message with bin/inject.


Thank you very much!
For reference, how should the output of dumpdb -p look like if the
files were OK?


Richard
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Mark Sapiro]

Richard Hartmann wrote:
>
>For reference, how should the output of dumpdb -p look like if the
>files were OK?

Something like the following:

[- start pickle file -]
<- start object 1 ->

(this section has the raw message text)

<- start object 2 ->
{   '_parsemsg': True,
'listname': 'list1',
'received_time': 1199323852.640625,
'tolist': 1,
'version': 3}
[- end pickle file -]


-- 
Mark Sapiro <[EMAIL PROTECTED]>The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Strange error with Mailman 2.1.9

[Richard Hartmann]

On Mon, Dec 1, 2008 at 18:39, Mark Sapiro <[EMAIL PROTECTED]> wrote:

> Something like the following:


Thanks yet again!


Richard
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] when does logs/post get updated?

[Ricardo Kleemann]

Mark, thanks for your help.

For the most part I did get around the SMTP issues last week, I disabled 
ident lookup on the smtp server. But it seems to be back today and I don't 
quite understand what could be the problem.


I wrote a tiny perl script to test the connection to the server via 
localhost and I can consistently do 500 connections in 30 seconds. I don't 
see any other evidence of the smtp hanging up.


But if I do an strace on the outgoing runner, it basically is working very 
slowly through a large memberlist. It will process a certain number, then 
hang a few seconds before it processes the next batch. The server is not 
loaded and I don't see any other evidence of problems.


Do you have a small python script I can run to test out the localhost smtp 
that can maybe output some diagnostic information?


Thanks
Ricardo

- Original Message - 
From: "Mark Sapiro" <[EMAIL PROTECTED]>

To: "Ricardo Kleemann" <[EMAIL PROTECTED]>
Cc: "mailman-users" 
Sent: Friday, November 28, 2008 10:35 AM
Subject: Re: [Mailman-Users] when does logs/post get updated?



Ricardo Kleemann wrote:


I have some more data on this...

I enabled the debug in SMTPDirect.py, and it shows that there really
aren't any problems. It shows that slowly a message is being sent out.



So your real issue is why is it proceeding so slowly.



I followed the performance tuning suggestions that had the MAX_RCPTS in
Defaults.py at an optimal value from 2-5, so I set it to 3.



Is the MTA doing DNS verification on incoming mail from Mailman? Are
you having some DNS issue?



But does that mean that mailman is going to simply get stuck on one
single message distribution and won't process any others until this one
is finished?



Yes.



I used to have these lists on another server and over there I had the
MAX_RCPTS set to a high number, but my mail server is set to reject
above 25 rcpts anyway so the end result that at max it would handle 25
rcpts. I remember that whenever a message arrived for the list (again
20,000 members) on the other server, the load average on the server
would go pretty high as it processed the list.

But now on this new server I never see the load avg go up. Is this
because of the MAX_RCPTS setting? What else would keep mailman from
efficiently handling the messages?



Slow response from the MTA. Even with SMTP_MAX_RCPTS set to 3, you
should be delivering on the order of 100 or more recipients per
second. What do you see in Mailman's smtp log for processing tomes for
messages. How do the latest ones compare to those from days or a week
ago?



The OutgoingRunner is just sitting there slowly distributing the message
and never seems to get to the next one.



It will when it finishes this one.

--
Mark Sapiro <[EMAIL PROTECTED]>The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan




--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

[Mailman-Users] Administrivia intercept not working.

[Brad Rogers]

Hello All,

I run a small mailing list which under version 2.1.11 of Mailman. A
while ago, an unsubscribe message came to the list rather than be
intercepted and acted upon.  I thought nothing of it at the time, but
a similar occurrence on another list (to which I subscribe but do not
have admin priveleges) prompted me to look closer at my settings.  Admin
messages to the list are supposed to be intercepted, but for some
reason, this one (actually, there were several from the same person)
wasn't.  Obviously something amiss.  The other list runs under v2.1.9 of
MM.

I can forward copies of messages (with headers) if required so those of
you more knowledgeable than me can see what's happening.

Finally, I only have web access to my Mailman list settings (via cPanel)
as the list is run by my domain provider's servers, not locally.
Therefore, I can't alter code directly.  What access the list owner of
the second list has, I don't know.

Thanks, in advance, for all assistance.

-- 
 Regards  _
 / )   "The blindingly obvious is
/ _)radnever immediately apparent"


signature.asc
Description: PGP signature
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Mailman Site Admin email Problem

[Mark Sapiro]

Sean Murphy wrote:

>Mark Sapiro wrote:
>> 
>> When sent, the mail is sent to [EMAIL PROTECTED] (or whatever the name
>> of the site list is). You can test if this mail is deliverable by just
>> mailing anything to that address.
>> 
>
>I checked the mm_cfg.py and then the defaults.py it is currently set to 
>manual, that should be good.  So I think the email address for the site 
>admin is incorrect.  I did a couple of searches in those files above 
>with no luck.  Where do I change the "site admin's" email address?


As I said, the mail is sent to [EMAIL PROTECTED] (assuming the site
list is named 'mailman' and is ultimately sent to the owner of that
list.

Go to the admin web interface for the 'mailman' list (something like
http://www.example.com/mailman/admin/mailman/), log in and set 'owner'
(The list administrator email addresses. Multiple administrator
addresses, each on separate line is okay.)

-- 
Mark Sapiro <[EMAIL PROTECTED]>The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] when does logs/post get updated?

[Mark Sapiro]

Ricardo Kleemann wrote:
>
>I wrote a tiny perl script to test the connection to the server via 
>localhost and I can consistently do 500 connections in 30 seconds. I don't 
>see any other evidence of the smtp hanging up.


The connection rate is generally not an issue as Mailman normall does
all the transactions over a single connection.  I.e. it connects, does
a "MAIL FROM" one or more "RCPT TO", and "DATA", and then begins
another "MAIL FROM", etc transaction without quitting or
disconnectiing.


>But if I do an strace on the outgoing runner, it basically is working very 
>slowly through a large memberlist. It will process a certain number, then 
>hang a few seconds before it processes the next batch. The server is not 
>loaded and I don't see any other evidence of problems.


If there are significant delays between sending RCPT TO and the
responce from the server, the server is probably doing DNS verifies on
the recipients. This kills performance on large lists.

What's it doing when it "hangs for a few seconds"? Presumably it is
either sending the message content or waiting for a reply from the MTA.


>Do you have a small python script I can run to test out the localhost smtp 
>that can maybe output some diagnostic information?


No. I don't have any such script. As I said in previous posts

>Even with SMTP_MAX_RCPTS set to 3, you
>should be delivering on the order of 100 or more recipients per
>second. What do you see in Mailman's smtp log for processing tomes for
>messages. How do the latest ones compare to those from days or a week
>ago?

and

>Search the FAQ  for "tuning".

-- 
Mark Sapiro <[EMAIL PROTECTED]>The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Administrivia intercept not working.

[Mark Sapiro]

Brad Rogers wrote:
>
>I run a small mailing list which under version 2.1.11 of Mailman. A
>while ago, an unsubscribe message came to the list rather than be
>intercepted and acted upon.  I thought nothing of it at the time, but
>a similar occurrence on another list (to which I subscribe but do not
>have admin priveleges) prompted me to look closer at my settings.  Admin
>messages to the list are supposed to be intercepted, but for some
>reason, this one (actually, there were several from the same person)
>wasn't.  Obviously something amiss.  The other list runs under v2.1.9 of
>MM.


A message really has to look like a command that would be sent to the
-request address to be classed as administrivia. There are several
tests, but here's a summary:

If the message has more than DEFAULT_MAIL_COMMANDS_MAX_LINES (default
25) non-blank body lines preceeding a signature ("-- ") separator it
is not administrivia. Thus the typical message that says "unsubscribe
me" followed without an intervening "-- " line by a quote of a 50 line
post is not administrivia.

Then if the message body has exactly one word and that word is one of
the words in this list

'confirm'
'help'
'info'
'lists'
'options'
'password'
'remove'
'set'
'subscribe'
'unsubscribe'
'who'

the message is administrivia.

Then if the message body is more than one word, it is administrivia if
the subject or one of the first 5 non-blank body lines begins with one
of the above words and has the right number of following words to be a
syntactically valid email command.

All other messages are not administrivia.


>I can forward copies of messages (with headers) if required so those of
>you more knowledgeable than me can see what's happening.


If the above doesn't explain it, You can send me a sample message.

-- 
Mark Sapiro <[EMAIL PROTECTED]>The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] when does logs/post get updated?

[Brad Knowles]

on 12/1/08 1:50 PM, Ricardo Kleemann said:

But if I do an strace on the outgoing runner, it basically is working 
very slowly through a large memberlist. It will process a certain 
number, then hang a few seconds before it processes the next batch. The 
server is not loaded and I don't see any other evidence of problems.


That sounds like your MTA is doing DNS lookups for each and every 
envelope recipient as you try to transmit mail.  That needs to be fixed, 
and is one of the many "performance" tuning techniques that is discussed 
in the FAQ Wiki.


--
Brad Knowles <[EMAIL PROTECTED]>
LinkedIn Profile: 
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9