Re: [Mailman-Users] Strange rejection - THANKS!!!
On Sat, 2014-10-25 at 08:36 -0700, Mark Sapiro wrote: On 10/24/2014 11:17 PM, Lindsay Haisley wrote: The vette logfile just says: Oct 24 23:15:30 2014 (2180) Message discarded, msgid: 1414210524.38839.9.ca...@pudina.fmp.com In Mailman/Queue/IncomingRunner.py, in the _dopipeline() method look at the code for the except Errors.DiscardMessage: clause and the except Errors.RejectMessage, e: clause. Augment the syslog message in except Errors.DiscardMessage: similarly to that in except Errors.RejectMessage, e:, except there is no 'e' in the discard case so you can't include the 'reason:' part. Note that the only standard handlers that discard messages are [..snip] SpamDetect: Privacy options... - Spam filters - header_filter_rules with discard action header matches something in mm_cfg.KNOWN_SPAMMERS With the help of the vette logging enhancement which Mark suggested, I isolated the problem to the SpamDetect handler and tracked it down to a filter rule which objected to the regexp .*SpamAssassin in any header. For some reason this was showing up in the header of my inbound posts (which were coming in remotely from FMP's other server) but not when Mailman and this list were running on on the same host as the mail server handling my personal SMTP service. I don't know if I've fine-tuned SpamAssassin on the new host box either. That's a substantial job! So again, heartfelt thanks to Mark for pointing me in the right direction. This is one of the reasons I like open source software :) -- Lindsay Haisley | Everything works if you let it FMP Computer Services | 512-259-1190 | --- The Roadie http://www.fmp.com| -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Strange rejection - THANKS!!!
On 10/27/2014 02:17 PM, Lindsay Haisley wrote: With the help of the vette logging enhancement which Mark suggested, ... So again, heartfelt thanks to Mark for pointing me in the right direction. This is one of the reasons I like open source software :) You're welcome and community is one of the things I really like about open source too. Also, I have committed the vette logging enhancement for the next release. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Strange rejection
I'm moving mailing lists from one server to another using a couple of scripts which I've used successfully many times before for other such moves. On the 3rd list I've moved (second domain name) I've run into a very strange problem. On trying to post to the list on the new server my posts get delivered to the list and discarded with no further explanation. The vette logfile just says: Oct 24 23:15:30 2014 (2180) Message discarded, msgid: 1414210524.38839.9.ca...@pudina.fmp.com The Mailman version on the old system is 2.1.18, and 2.1.18-1 on the new one. The working environment is almost identical on both systems. The list configurations are completely identical. The two other lists which I've already moved to the new location are working properly, as best I can tell so far. I'm subscribed to the list, which is an open discussion list, added myself as a list moderator, and am on the accept_these_nonmembers list (or not - it makes no difference) in case I should get unsubscribed. The only thing I see which _might_ make a difference is that the new server is running Python 2.7.6 while the old one is running 2.7.3. I backed out the move and posted to this problem list in its old location, and the post went trough to the subscribers and the archive. There are no other related entries in the Mailman log files - just Message discarded in the vette file. Is there any way to turn on more thorough debugging, or tracebacks if there are hidden code glitches? What could be causing this? I'm Python-literate and can read tracebacks and poke diagnostic code into Mailman modules if someone can point me in the right direction to get to the bottom of this. I've got half a dozen or so lists to move so I have to get this solved. -- Lindsay Haisley | Everything works if you let it FMP Computer Services | 512-259-1190 | --- The Roadie http://www.fmp.com| -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Strange rejection
On 10/24/2014 11:17 PM, Lindsay Haisley wrote: The vette logfile just says: Oct 24 23:15:30 2014 (2180) Message discarded, msgid: 1414210524.38839.9.ca...@pudina.fmp.com Some handler in the pipeline is discarding the message. More below. Is there any way to turn on more thorough debugging, or tracebacks if there are hidden code glitches? At some point I augmented he vette logging for rejects to include the name of the handler and the reject reason. I jhought I had done something similar for discards, but I didn't. What could be causing this? I'm Python-literate and can read tracebacks and poke diagnostic code into Mailman modules if someone can point me in the right direction to get to the bottom of this. I've got half a dozen or so lists to move so I have to get this solved. In Mailman/Queue/IncomingRunner.py, in the _dopipeline() method look at the code for the except Errors.DiscardMessage: clause and the except Errors.RejectMessage, e: clause. Augment the syslog message in except Errors.DiscardMessage: similarly to that in except Errors.RejectMessage, e:, except there is no 'e' in the discard case so you can't include the 'reason:' part. Note that the only standard handlers that discard messages are MimeDel: Content filtering - filter_action = Discard Moderate: Privacy options... - Sender filters - member_moderation_action dmarc_moderation_action discard_these_nonmembers generic_nonmember_action Scrubber: if Non-digest options - scrub_nondigest is Yes and mm_cfg.ARCHIVE_HTML_SANITIZER = 0 and the outer message is text/html SpamDetect: Privacy options... - Spam filters - header_filter_rules with discard action header matches something in mm_cfg.KNOWN_SPAMMERS If you examine the above for Discard actions and maybe (temporarily) change them to Hold, that may help. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Strange rejection
On Sat, 2014-10-25 at 08:36 -0700, Mark Sapiro wrote:
In Mailman/Queue/IncomingRunner.py, in the _dopipeline() method look at
the code for the except Errors.DiscardMessage: clause
and the except Errors.RejectMessage, e: clause. Augment the syslog
message in except Errors.DiscardMessage: similarly to that in except
Errors.RejectMessage, e:, except there is no 'e' in the discard case so
you can't include the 'reason:' part.
Thanks, Mark! This will at least tell me where my posts are getting
nuked.
Does this look correct?
--- IncomingRunner.py.orig 2014-10-25 10:53:02.0 -0500
+++ IncomingRunner.py 2014-10-25 11:03:40.0 -0500
@@ -157,8 +157,11 @@
os._exit(1)
except Errors.DiscardMessage:
# Throw the message away; we need do nothing else with it.
-syslog('vette', 'Message discarded, msgid: %s',
- msg.get('message-id', 'n/a'))
+syslog('vette', Message discarded, msgid: %s
+ list: %s,
+ handler: %s,
+ msg.get('message-id', 'n/a'),
+ mlist.real_name, handler)
return 0
except Errors.HoldMessage:
# Let the approval process take it from here. The message no
A test list posts correctly, so no stupid syntax or indentation errors
(which shouldn't be a problem anyway since the added code is all inside
a function call argument list)
I'm a great fan of intelligent logging! This would be a good mod for a
future version of MM 2.
--
Lindsay Haisley | Everything works if you let it
FMP Computer Services |
512-259-1190 | --- The Roadie
http://www.fmp.com|
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe:
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Strange rejection
On 10/25/2014 09:20 AM, Lindsay Haisley wrote:
Does this look correct?
--- IncomingRunner.py.orig2014-10-25 10:53:02.0 -0500
+++ IncomingRunner.py 2014-10-25 11:03:40.0 -0500
@@ -157,8 +157,11 @@
os._exit(1)
except Errors.DiscardMessage:
# Throw the message away; we need do nothing else with it.
-syslog('vette', 'Message discarded, msgid: %s',
- msg.get('message-id', 'n/a'))
+syslog('vette', Message discarded, msgid: %s
+ list: %s,
+ handler: %s,
+ msg.get('message-id', 'n/a'),
+ mlist.real_name, handler)
return 0
except Errors.HoldMessage:
# Let the approval process take it from here. The message no
Yes, it looks right.
A test list posts correctly, so no stupid syntax or indentation errors
(which shouldn't be a problem anyway since the added code is all inside
a function call argument list)
I'm a great fan of intelligent logging! This would be a good mod for a
future version of MM 2.
I plan to do it. I don't know why I didn't do it at the same time as the
reject logging enhancement, but I'll do it now.
--
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe:
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
