Re: [Mailman-Users] Mailing list + message filter problem

2009-05-14 Thread Mark Sapiro
Filipe Zanluca DarĂ³s wrote:

I had set myself as a member. I thought you meant otherwise.

I receive mails sent directly to the list, but not when messages get 
redirected by the filter.


If the message is archived, and the list is otherwise working, then
Mailman has attempted the send the message to all the non-digest list
members with the following exceptions:

Any list member who has nodups set and whose address appears in To:
or Cc: of the message will not be sent a copy.

The poster (From: address) will not get a copy if the poster has not
metoo set.

If the list has topics defined and a member has subscribed to one or
more topics and the message matches an unsubscribed topic or no topic
if the member has not elected to receive 'non-matching' posts, the
member will not be sent a copy.

The poster will also not see a copy if the poster uses gmail/googlemail
- see http://wiki.list.org/x/2IA9.

If you are not receiving the post, and you are a non-digest member who
doesn't fall into one of the above categories, then I don't know what
the problem might be. If the problem is not one of the above, download
the raw archive from a URL like
http://www.example.com/mailman/private/list.mbox/list.mbox and find
a direct message that you did receive and a redirected message that
you didn't receive, and try to find some difference in the headers
that might explain this.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


[Mailman-Users] Question about 'Content filtered message notification'

2009-05-14 Thread Rick Pasotto
One of my mailing lists rejected a message today and I don't understand
why. The contents of the mailman message are:

  I 1 no description[text/plain, 7bit, us-ascii, 0.2K]
  I 2 Got a call from SBOE today [message/rfc822, 7bit, 14K]
  I 3   no description   [multipa/related, 7bit, 12K]
  I 4 no description [multipa/alternativ, 7bit, 3.6K]
  I 5   no description   [text/plain, quoted, us-ascii, 1.2K]
  I 6   no description[text/html, quoted, us-ascii, 1.9K]
  I 7 12758269.jpg   [image/jpeg, base64, 8.8K]

filter_content is 'yes'
filter_mime_types is blank
pass_mime_types is: multipart/mixed, multipart/alternative, text/plain
filter_filename_extensions is exe, bat, cmd, com, pif, scr, vbs, cpl
pass_filename_extensions is blank
collapse_alternatives is 'yes'
convert_html_to_plaintext is 'yes'
for filter_action is 'Forward to List Owner'

Why was this message rejected?

(using 1:2.1.11-11 on debian)

-- 
The ability to talk well is to a man what cutting and polishing are to
 the rough diamond. The grinding does not add anything to the diamond. It
 merely reveals its wealth. -- Orison S Marden
Rick Pasottor...@niof.nethttp://www.niof.net
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


Re: [Mailman-Users] Question about 'Content filtered message notification'

2009-05-14 Thread Mark Sapiro
Rick Pasotto wrote

One of my mailing lists rejected a message today and I don't understand
why. The contents of the mailman message are:

  I 1 no description[text/plain, 7bit, us-ascii, 0.2K]
  I 2 Got a call from SBOE today [message/rfc822, 7bit, 14K]
  I 3   no description   [multipa/related, 7bit, 12K]
  I 4 no description [multipa/alternativ, 7bit, 3.6K]
  I 5   no description   [text/plain, quoted, us-ascii, 1.2K]
  I 6   no description[text/html, quoted, us-ascii, 1.9K]
  I 7 12758269.jpg   [image/jpeg, base64, 8.8K]

filter_content is 'yes'
filter_mime_types is blank
pass_mime_types is: multipart/mixed, multipart/alternative, text/plain
filter_filename_extensions is exe, bat, cmd, com, pif, scr, vbs, cpl
pass_filename_extensions is blank
collapse_alternatives is 'yes'
convert_html_to_plaintext is 'yes'
for filter_action is 'Forward to List Owner'

Why was this message rejected?


I don't know. If in fact the message Mailman saw was as described,
content filtering should have removed the message/rfc822 part (and all
its subparts - parts 2 through 7) but left part 1.

Is the structure above the message sent to the list, or is it the
'Content filtered message notification' you (the list owner) received
from content filtering?

If the latter, then the original message was essentially parts 3
through 7, and it was filtered because you don't accept
multipart/related.

If you don't accept a particular multipart type, that part and all its
sub-parts are filtered regardless of the types of the subparts. If you
want to accept any text/plain part regardless of where it appears in
the message hierarchy, set pass_mime_types to multipart, text/plain

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


Re: [Mailman-Users] Question about 'Content filtered message notification'

2009-05-14 Thread Mark Sapiro
Mark Sapiro wrote:

Rick Pasotto wrote

One of my mailing lists rejected a message today and I don't understand
why. The contents of the mailman message are:

  I 1 no description[text/plain, 7bit, us-ascii, 0.2K]
  I 2 Got a call from SBOE today [message/rfc822, 7bit, 14K]
  I 3   no description   [multipa/related, 7bit, 12K]
  I 4 no description [multipa/alternativ, 7bit, 3.6K]
  I 5   no description   [text/plain, quoted, us-ascii, 1.2K]
  I 6   no description[text/html, quoted, us-ascii, 1.9K]
  I 7 12758269.jpg   [image/jpeg, base64, 8.8K]

[...]
If the latter, then the original message was essentially parts 3
through 7, and it was filtered because you don't accept
multipart/related.

As an aside to the original question, I think the MIME structure

multipart/related
multipart/alternative
text/plain
text/html
image/jpeg

is fundamentally wrong since the image/jpeg part is related to the
text/html part and not to the multipart/alternative part. I think the
proper MIME structure for this message is

multipart/alternative
text/plain
multipart/related
text/html
image/jpeg

i.e., the message consists of two alternative parts, one of which is
text/plain and the other is text/html with an image.

That said, I have seen the former structure often, notably I think with
stationery from Microsoft MUAs.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


Re: [Mailman-Users] Patch for use of Postfix VERP support

2009-05-14 Thread Mark Sapiro
Brad Knowles wrote:

This is a postfix problem.  Find the sites that cause the problems, and set 
up separate queues for them, with different parallelism and 
re-queueing/re-try schedules.


Brad,

Normally, I would defer to you for all things MTA as your knowledge and
experience in this area are far greater than mine, but I have been
under the impression that if an MTA has two or more messages to
deliver to the the same remote MX, that it can and perhaps will
deliver them in one SMTP session as follows

connect
HELO (or EHLO)
MAIL FROM
RCPT TO
DATA
.
MAIL FROM
RCPT TO
DATA
.
...
QUIT

I.e., each message will be sent with a separate MAIL FROM, RCPT TO and
DATA, but more than one message will be sent within a single connect,
HELO, QUIT session.

If this is actually done (or can be done) by Postfix, it might help
Fil, since the complaint in Fil's post was

(host mx01..xxx[x] refused to talk to me: 421 4.3.2 Connection
rate limit exceeded.)

in response to a connect request. Thus, if more messages could be sent
over one connection, that would reduce the connection rate even though
it wouldn't reduce the message rate.

Also, I think from earlier messages in this thread
(http://mail.python.org/pipermail/mailman-users/2009-January/064588.html
et seq) that Fil is already successfully using Postfix VERPing with
Mailman, so the only question here is can Postfix be convinced to send
multiple messages to the same MX over a single connection.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


Re: [Mailman-Users] Question about 'Content filtered message notification'

2009-05-14 Thread Stephen J. Turnbull
Mark Sapiro writes:

  As an aside to the original question, I think the MIME structure
  
  multipart/related
  multipart/alternative
  text/plain
  text/html
  image/jpeg
  
  is fundamentally wrong since the image/jpeg part is related to the
  text/html part and not to the multipart/alternative part.

I don't think you can say that in general, though.  Here's a picture
of my new baby! with a nice inline display for the HTML subpart, and
presented by the MUA as an attachment for people who are momentarily
restricted to text-only, seems like a common application.

  That said, I have seen the former structure often, notably I think with
  stationery from Microsoft MUAs.

That's definitely wrong, though, if the image is part of the HTML
stationery.


--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9


Re: [Mailman-Users] Patch for use of Postfix VERP support

2009-05-14 Thread Brad Knowles

on 5/14/09 7:58 PM, Mark Sapiro said:


Normally, I would defer to you for all things MTA as your knowledge and
experience in this area are far greater than mine, but I have been
under the impression that if an MTA has two or more messages to
deliver to the the same remote MX, that it can and perhaps will
deliver them in one SMTP session as follows


My understanding is that the issue here isn't so much the single SMTP 
connection, which may or may not get re-used, depending on the queueing 
strategy of the sender.


If you want to increase your efficiency in this area, then you make sure 
that your submission actually just puts the message into the queue in 
deferred mode and doesn't make an immediate delivery attempt, and of 
course you turn off all spam and other access control checks on the 
outbound side, since you should have already done all those on inbound. 
 You then allow later queue runs to come along and pick that up, along 
with any other messages bound for that destination.


I think we cover this in the various performance articles in the FAQ Wiki.


My understanding is that the issue here is whether or not the VERP'ed 
format will be understood and usable by Mailman if there is a bounce, 
and how many unique messages will be delivered, as opposed to how many 
connections will be created to deliver the messages.


--
Brad Knowles
b...@shub-internet.orgIf you like Jazz/RB guitar, check out
LinkedIn Profile: my friend bigsbytracks on YouTube at
http://tinyurl.com/y8kpxuhttp://preview.tinyurl.com/bigsbytracks
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9