Re: [Mailman-Users] qrunner running away (Mailman 2.0.11)
Poking at this a bit more I have more data. It seems like whenever mail is sent to one list in particular, the qrunner script hangs up for a very long time processing that mail. I think it's that list because I see the lock for that list existing for a long time with the same pid in the locks directory. Looking at the truss of this (unfortunately I don't have the start, only from the middle on) it seems like it's freaking out writing a huge file. First it has a huge list of break()'s, interspersed with a few mmap()'s, then it does a bunch of writes in 8K blocks, then it does some cleanup on the lock files and ends. Then it does it again for the next message to that list. The mbox file for this list is about 100M, this month's .txt archive file is about 32M, and this month's .gz file is about 3M. I tried stopping qrunner and renaming the .mbox file, but it still has the same problem so that evidently wasn't it. If this sounds familiar to anyone, let me know... In the background I'm working on 2.1.5 but I'd _REALLY_ prefer to not have an emergency upgrade situation... on the other hand some users are talking about switching to Exchange lists so it _IS_ something of an emergency :). I want to upgrade Python as well since our version is 2.2.1 which is pretty old. -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Re: [Mailman-Users] qrunner running away (Mailman 2.0.11)
OK, after more poking and prodding, it looks like the problem is related to the private/list/database directory. The article file here for the list that was causing the problems was 44M, the author was 51K, date was 41K, subject was 55K, and thread was 42k. I moved all those files aside and ran qrunner, and it didn't pause there at all, although it has paused for lesser amounts of time in other (also larger) lists. I guess that the size of this list is simply overwhelming the pipermail archiver. Is there anything I can do about this short of disabling archives? Can I update the archives less often, or do it with a separate process somehow so that at least my mail keeps flowing even while the archive is being updated? -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
[Mailman-Users] qrunner running away (Mailman 2.0.11)
I know this is a really old version, but I'm hoping someone has some hints for me on troubleshooting this: upgrading to 2.1.4 or 2.1.5 is on my TODO list but... This server has probably 50 lists on it, and it has relatively low traffic overall. It's no great shakes hardware-wise (a dual PIII 500MHz box with 512M RAM), but for a mail server at this level that should be quite sufficient. And, in fact, it has been up until fairly recently. No changes have been made to this box (it's running FreeBSD 4.3-RELEASE) or its environment that I can think of. What's happening is that the qrunner process is sucking down one entire CPU, with 99% cpu usage. That same qrunner (python instance) will run for 30 minutes or more, then it will finish and the box will be idle for a while, then it will start again. Mail that used to be delivered almost instantly now can take up to an hour to get through the box. Top shows that the box is not memory starved. I tried to truss the python process but I get nothing but break() after break(); no real system calls at all. This one process ends up using about 190M. Does anyone have any ideas about how to debug this problem? Is there something stuck in the mail queue which is causing all this havoc? How can I find it and get it out of there? Thanks! -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Re: [Mailman-Users] qrunner running away (Mailman 2.0.11)
%% Brad Knowles [EMAIL PROTECTED] writes: bk At 5:41 PM -0400 2004/05/18, Paul Smith wrote: I know this is a really old version, but I'm hoping someone has some hints for me on troubleshooting this: upgrading to 2.1.4 or 2.1.5 is on my TODO list but... bk Problem is, runaway Python processes are something that I bk believe 2.1.5 was created to help address. Yeah, I saw that in the announcement. But, this system was running fine until a few weeks ago. I don't know of any real change in its usage patterns and certainly not in its configuration that would account for this change in behavior. I was just wondering whether anyone had any debugging tips, like checking for messages stuck in the queue that would be causing this problem, or lock files that might be breaking something, or whatever. -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
[Mailman-Users] [Repost] Internal vs. external mail addresses
[[ I sent this back in October 2003 but no response... I wonder if anyone has any thoughts about this problem? ]] I have some internal mailing lists that are trying to be closed (only members can post without moderator approval). Unfortunately, we have different email addresses for internal vs. external mail, and our Exchange (:-/) server rewrites our addresses for mail we send internally to be from the internal address, even if we have a From: line etc. using the external address. So, when people send mail to the list part of the time it looks like it comes from their external address, and part of the time it looks like it comes from their internal address. When the mail looks like it comes from the other address and it's addressed to a closed list, the moderator has to approve it. This is a major pain! I'm wondering if there's any capability in Mailman to have it understand that two different mail domains are really equivalent, so that [EMAIL PROTECTED] is the same as [EMAIL PROTECTED] (for example)? Anyone else have any ideas (not including changing the way our email or Exchange servers work... believe me I'd love to do that but...)? -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT: HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ This message was sent to: [EMAIL PROTECTED] Unsubscribe or change your options at http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] [Repost] Internal vs. external mail addresses
%% Brad Knowles [EMAIL PROTECTED] writes: bk At 10:02 AM -0500 2004/02/27, Paul Smith wrote: I'm wondering if there's any capability in Mailman to have it understand that two different mail domains are really equivalent, so that [EMAIL PROTECTED] is the same as [EMAIL PROTECTED] (for example)? bk Not without hacking the source code, at least so far as I know. Hm. What about something that sits between the MDA and Mailman and makes this translation? Does that seem feasible? Would this require changing the alias for each list, for example, or is there another way to do this from within the MTA? I'm using postfix. I'm willing to require that all addresses that Mailman sees be the external address (@foobar.com), and the internal addresses can all be easily mapped to that external address by stripping off the internal domain and adding the external domain. The reverse is not true because there are multiple Exchange servers with different addresses. Anyone else have any ideas (not including changing the way our email or Exchange servers work... believe me I'd love to do that but...)? bk IMO, the solution is to fix the problem where it is created. As I said, that would be good but is utterly out of the question. The people in charge of all the mail infrastructure will never do that. -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ This message was sent to: [EMAIL PROTECTED] Unsubscribe or change your options at http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] [Repost] Internal vs. external mail addresses
%% Brad Knowles [EMAIL PROTECTED] writes: bk At 12:41 PM -0500 2004/02/27, Paul Smith wrote: Hm. What about something that sits between the MDA and Mailman and makes this translation? Does that seem feasible? bk What would you put there? How would that program work? Well... what field does Mailman use to get the sender's address when it verifies they are a member of the list? Basically I was thinking I'd just do the equivalent of: sed 's/^\(Sender: [EMAIL PROTECTED])@[^ ]*\.bar\.com/[EMAIL PROTECTED]/' Obviously there might be a little tweaking necessary. -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ This message was sent to: [EMAIL PROTECTED] Unsubscribe or change your options at http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Internal vs. external mail addresses
I have some internal mailing lists that are trying to be closed (only members can post without moderator approval). Unfortunately, we have different email addresses for internal vs. external mail, and our Exchange (:-/) server rewrites our addresses for mail we send internally to be from the internal address, even if we have a From: line etc. using the external address. So, when people send mail to the list part of the time it looks like it comes from their external address, and part of the time it looks like it comes from their internal address. When the mail looks like it comes from the other address and it's addressed to a closed list, the moder has to approve it (or they have to allow every user's alternate address individually). This is a major pain! I'm wondering if there's any capability in Mailman to have it understand that two different mail domains are really equivalent, so that [EMAIL PROTECTED] is the same as [EMAIL PROTECTED] (for example)? Anyone else have any ideas (not including changing the way our email or Exchange servers work... believe me I'd love to do that but...) -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ This message was sent to: [EMAIL PROTECTED] Unsubscribe or change your options at http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Messages not being sent
Hi, I'm running Mailman 2.1.1 on a FreeBSD 4.8 server, with Sendmail as the MTA. It's installed from the Ports collection. We've been experiencing a problem were a user posts to a list, and the message is not delivered right away. From the mail logs, we can see that the post is being processed by the mailman executable, and the post is added to the archives. However, the post does not actually seem to get delivered. We discovered this after restarting the qrunners from an init script: suddenly, a whole bunch of posts went out, as if they had been queued for later delivery. In fact, for important broadcast posts, we've gotten in the habit of manually restarting the qrunners to make sure they go out. Mailman logs show no errors that would seem to apply to this situation. Any advice? What should I be looking for? Is there a way to periodic force the queue to be delivered? Cheers, Paul -- Paul Smith [EMAIL PROTECTED] Webmaster/Systems Administrator Center for Neighborhood Technology Chicago, IL USA -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ This message was sent to: [EMAIL PROTECTED] Unsubscribe or change your options at http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] How do I subscribe to a list by email ?
I would like to create a subscribe / unsubscribe facility on my list rather that getting people to go to the admin page. I was hoping to get them to reply with unsubscribe in the body or subject line ?/ How do I do this, or can you direct me ?/ Thanks _ Join the worlds largest e-mail service with MSN Hotmail. http://www.hotmail.com -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
