Re: [Mailman-Users] Mailman not sending email to list users / Archives giving 403

[Tom Ray [Lists]]

Mark Sapiro wrote:

Tom Ray [Lists] wrote:

Mark Sapiro wrote:


Do posts get archived?
No. Not one of the test emails I've sent to the test list are 
archived. So it's dieing some where between being received and sent 
to the in queue.



Actually, the exim log entry you posted says the mail was delivered 
via the mailman-transport which says it was piped to


  /mail/listdomain.net/mailman/mail/mailman post test

which, assuming that wrapper and the 'post' script are not totally 
broken to the point that they terminate normally without doing 
anything, says that the mail made it to qfiles/in.




See <http://wiki.list.org/x/A4E9>.






Check the various things in the above FAQ article.

I managed to get this working. It turned out to be what I thought it 
was, Permissions issues. I had to go in and change the permissions back 
bin/check_perms -f didn't do it.



Thanks for the assistance.

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Mailman not sending email to list users / Archives giving 403

[Tom Ray [Lists]]

Mark Sapiro wrote:


Do you have a directory block in your apache config for the 
archives/public directory something like



Options +FollowSymLinks
Order allow,deny
Allow from all

$
If that isn't it, are you running SELinux or some other security 
policy manager> What's in Apache's error_log?

OK this worked I can now get to the archives. Thanks.




Second, none of the email is being sent to the list users.



Do posts get archived?
No. Not one of the test emails I've sent to the test list are archived. 
So it's dieing some where between being received and sent to the in queue.



All of the exim stuff above has to do with mail TO Mailman. If posts 
are getting queued in Mailman's 'in' queue or getting beyond that to 
the list archives, all that is working.


See .


--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

[Mailman-Users] Mailman not sending email to list users / Archives giving 403

[Tom Ray [Lists]]

I had a server crash and I needed to move two domains that are using 
mailman lists to a new server. I didn't think this was a big deal 
because they were moved from server that was taken out of production to 
the server that crashed without issue. Everything seems to be working 
just fine. They can manage their lists and add new ones but two things 
are happening now.


First, the archives are giving 403 errors when you try to view them. 
Apache logs a "client denied by server configuration:" error. Here are 
the current permissions:


drwxrws--x  26 root mailman 808 Jul  9 14:36 private
drwxrwsr-x   2 root mailman 288 Jul  9 14:36 public

All the subdirectories in private are set to "drwxrwsr-x" with the 
root:mailman user/group. All the html and txt files are set to 644. And 
in the .mbox dirs the .mbox file is set to 664.


I'm not sure why it's pulling a 403 error. Is there something I missed? 
I ran bin/check_perms -f everything once they were moved over and it 
fixed all the permissions and ownerships.


Second, none of the email is being sent to the list users. If a new user 
joins the list the welcome letter is sent. If a non-user tries to post 
to the list the moderators are emailed and the poster is emailed the 
"your post awaits approval" but the registered list users are not 
receiving emails.


This is what I see in the maillog: 2008-07-14 16:13:20 1KIUQB-00053s-5D 
=> test <[EMAIL PROTECTED]> R=mailman_router T=mailman_transport


I'm using Exim 4.69 with Mailman 2.1.10

Exim Config:

Router:
mailman_router:
   driver = accept
   require_files = 
/mail/${domain}/mailman/lists/${lc::$local_part}/config.pck

   local_part_suffix_optional
   local_part_suffix = -bounces : -bounces+* : \
   -confirm+* : -join : -leave : \
   -owner : -request : -admin
   transport = mailman_transport

Transport:
mailman_transport:
   driver = pipe
   command = /mail/${domain}/mailman/mail/mailman \
 '${if def:local_part_suffix \
   {${sg{$local_part_suffix}{-(\\w+)(\\+.*)?}{\$1}}} \
   {post}}' \
 $local_part
   current_directory = /mail/${domain}/mailman
   home_directory = /mail/${domain}/mailman
   user = MAILMAN_USER
   group = MAILMAN_GROUP


MAILMAN_USER and MAILMAN_GROUP are mailman.

Can anyone give me any insight on this please?

Thanks!
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: http://wiki.list.org/x/QIA9

Re: [Mailman-Users] Reporting

[Tom Ray [Lists]]

Mark Sapiro wrote:
> Tom Ray [Lists] wrote:
>
>   
>> Mark Sapiro wrote:
>> 
>>> This is a bug in Mailman pre 2.1.7 that logged the envelope sender of
>>> the outgoing message instead of the incoming message.
>>>
>>>   
>>>   
>> So I'm sure I'm understanding you correctly then  that some of those 
>> message could be valid posts made by members since this list was around 
>> since 2.1.4 or so?
>> 
>
>
> These are all valid posts made by list members. Everything in the
> 'post' log should be a valid post to the list. Occasionally, when
> there is an smtp-failure on a mailman generated message (say a reject
> of spam with a forged non-existant local address), you can get a
> failure entry in the post log even though the message wasn't a post,
> but if you filter out the failures (or the
> [EMAIL PROTECTED] message-ids), everything else is
> a legitimate list post.
>
> Note that these failures appear in the mmdsr report under Other
> Messages:->Log file: post.
>
>
>   
Thanks. That helps a lot.
>   
>> Thanks for the information. I'm tearing apart the post log because I 
>> want to get the total size of the message. Then I need to figure out how 
>> many emails where sent so I can figure out bandwidth usage. I mean if 
>> they send a 10K file to a list with 1,000 members that's a lot of 
>> bandwidth to send out.
>> 
>
>
> Yes, but if you want to be truly accurate, you also have to look at
> your MTA logs.
>
> For example, if a 10K message is sent to a list with 1000 members, and
> the list is not personalized, and the message is not VERPed in
> Mailman, mailman might deliver this to the MTA in say 5 transactions
> with 200 recipients each for a total exchange between Mailman and the
> MTA of about 50K plus the address list.
>
> The MTA in turn might batch delivery so if say 50 of those 1000
> recipients are in the aol.com domain, the MTA might send one 10K +
> transaction to AOL for all 50, rather that sending 10K 50 times.
>
>   
I see what you are saying. I'll write something to dig through my Exim 
logs and see what I can come up with.

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] Reporting

[Tom Ray [Lists]]

Mark Sapiro wrote:
> Tom Ray [Lists] wrote:
>   
>> According to the report one list has 14,297 posts but according to the 
>> Post Count by Sender report 13,797 of those posts came from 
>> [EMAIL PROTECTED] So does that mean that only 500 posts were made by 
>> members or are those 13,797 more then just commands from the members? I 
>> would appreciate a better explanation on that.
>> 
>
>
> This is a bug in Mailman pre 2.1.7 that logged the envelope sender of
> the outgoing message instead of the incoming message.
>
>   
So I'm sure I'm understanding you correctly then  that some of those 
message could be valid posts made by members since this list was around 
since 2.1.4 or so?
>   
>> Also, under the Hourly Summary of Message Sent report from the smtp log. 
>> The totals are based on how many email addresses the message was sent 
>> to, correct? So if a list has 250 members it counts each message per 
>> member? I know that it bundles the message per connection so a single 
>> SMTP connect could have 100 messages in it. I just want to make sure.
>> 
>
>
> Yes, you are correct. This comes from the smtp log and is the total
> number of recipients which depending on mm_cfg settings could be one
> smtp connection per recipient or a single smtp connection with a few
> smtp transactions with hundreds of recipients per transaction, or
> something in between. But the number is always the total recipients.
>
>
>   
>> The problem is that my email server is being beaten in to the ground and 
>> it looks like this clients lists (they have 8 or so) are seeing a heavy 
>> increase in membership and frequency. I need to put numbers together so 
>> I can tell them they need to either get a dedicated list server or pay 
>> more (so I can upgrade!).
>>
>> Any help would be great. I'm just a bit ignorant on the internal 
>> workings of MM but am learning. Plus I don't know Python from a hole in 
>> the ground so I'm leery about messing with code to much.
>> 
>
>
> The mmdsr report gives you post count per list and by sender, but due
> to the mailman bug in 2.1.6 and earlier, these are usually the same
> since the sender is list-bounces.
>
> It also gives the hourly summary of posts and of messages sent, the
> latter of which is really the number of recipients, not the number of
> smtp transactions or smtp connects.
>
> It does not give you messages sent by list. In order to get that, you
> need to look at the 'post' log to get the list and from information
> and the message-id and then get the corresponding message-id entry
> from the smtp log to get the number of recipients.
>
>   
Thanks for the information. I'm tearing apart the post log because I 
want to get the total size of the message. Then I need to figure out how 
many emails where sent so I can figure out bandwidth usage. I mean if 
they send a 10K file to a list with 1,000 members that's a lot of 
bandwidth to send out.
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] Reporting

[Tom Ray [Lists]]

Brad Knowles wrote:
> On 10/24/07, Tom Ray [Lists] wrote:
>
>>  I guess the real question is will it do a history too? I need to figure
>>  out past history.
>
> As the author of mmdsr, I'll say that you should be able to feed it 
> old Mailman log data and have it "just work", but I won't guarantee 
> that.  If you try this and it doesn't work for you, please let me know 
> and I'll try to work with you to modify the code so that it does "just 
> work" when fed old log data.
>
>
> Keep in mind that there's a good chunk of mmdsr where it goes and 
> looks at the current status of what is in the various queue 
> directories, etc... and this obviously won't be relevant for 
> processing of historical log data.
>
> I should probably add a command-line flag so that you can tell it 
> whether to just do the summary based on the log data (which should 
> work regardless of whether the data is historical or current), or to 
> do the log data summary plus the current condition report.
>
> Let me think about that, and see if I have any time available.
>
Alright, I just ran a blanketed request that went through the whole log 
file, which was pretty nice since I haven't rotated ever. It goes back 
to April 2006. I do have some questions about the report though, and 
please forgive my ignorance. I use MM but I really haven't dove into 
like I should have so I'm still a little shaky on how things work.

According to the report one list has 14,297 posts but according to the 
Post Count by Sender report 13,797 of those posts came from 
[EMAIL PROTECTED] So does that mean that only 500 posts were made by 
members or are those 13,797 more then just commands from the members? I 
would appreciate a better explanation on that.

Also, under the Hourly Summary of Message Sent report from the smtp log. 
The totals are based on how many email addresses the message was sent 
to, correct? So if a list has 250 members it counts each message per 
member? I know that it bundles the message per connection so a single 
SMTP connect could have 100 messages in it. I just want to make sure.

The problem is that my email server is being beaten in to the ground and 
it looks like this clients lists (they have 8 or so) are seeing a heavy 
increase in membership and frequency. I need to put numbers together so 
I can tell them they need to either get a dedicated list server or pay 
more (so I can upgrade!).

Any help would be great. I'm just a bit ignorant on the internal 
workings of MM but am learning. Plus I don't know Python from a hole in 
the ground so I'm leery about messing with code to much.

--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] Reporting

[Tom Ray [Lists]]

Steven Stern wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> On 10/24/2007 06:33 PM, Tom Ray [Lists] wrote:
>   
>> Is there a way to generate a report that will tell me how many emails a 
>> list is sending out? I'm curious as to the traffic a few lists are doing 
>> and I need to see how much mail is being processed by the list.
>>
>> So if the list has 400 members and it only has four emails a week sent 
>> to it, no big deal. But I want to see a list that has traffic on it like 
>> this one or something in the lines of 100 emails per day because of the 
>> level of activity.
>>
>> So how can I tell how many messages were sent through list X?
>> 
>
> Use mmdsr. It's in the contrib directory under your mailman install.  I
> run it from cron at 23:59 every night and get a daily report of list
> traffic.
>
> - --
>
>   Steve
> -BEGIN PGP SIGNATURE-
> Version: GnuPG v1.4.7 (GNU/Linux)
> Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org
>
> iD8DBQFHH+odeERILVgMyvARAor+AJ9ay6tVDHFuhLuOxSR1Vo53vQ2enwCeLRM0
> 4D9rGdZFPuo1VwlCXy8XIS0=
> =vs6O
> -END PGP SIGNATURE-
> --
> Mailman-Users mailing list
> Mailman-Users@python.org
> http://mail.python.org/mailman/listinfo/mailman-users
> Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
> Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
> Unsubscribe: 
> http://mail.python.org/mailman/options/mailman-users/lists%40blazestudios.com
>
> Security Policy: 
> http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp
>   

I guess the real question is will it do a history too? I need to figure 
out past history.
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

Re: [Mailman-Users] Reporting

[Tom Ray [Lists]]

Mark Sapiro wrote:
> Tom Ray [Lists] wrote:
>
>   
>> Is there a way to generate a report that will tell me how many emails a 
>> list is sending out? I'm curious as to the traffic a few lists are doing 
>> and I need to see how much mail is being processed by the list.
>> 
>
>
> See
> <http://sourceforge.net/tracker/index.php?func=detail&aid=1123383&group_id=103&atid=300103>.
>
>   
Thanks, I'll give it a shot.
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp

[Mailman-Users] Reporting

[Tom Ray [Lists]]

Is there a way to generate a report that will tell me how many emails a 
list is sending out? I'm curious as to the traffic a few lists are doing 
and I need to see how much mail is being processed by the list.

So if the list has 400 members and it only has four emails a week sent 
to it, no big deal. But I want to see a list that has traffic on it like 
this one or something in the lines of 100 emails per day because of the 
level of activity.

So how can I tell how many messages were sent through list X?

Thanks.
--
Mailman-Users mailing list
Mailman-Users@python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Security Policy: 
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp