RE: Problems running Spam Assassin
Hi, Ok, I've updated my procmailrc file to have:- MAILDIR=/var/spool/mail This has fixed procmail putting spam emails in probably-spam and almost-certainly-spam mail boxes (I also created each of those as a user, but don't think it was that which made the real difference). Now the confusing thing is that even though both these mail boxes are filling up with the spam emails, the mails are still being delivered to the users mail boxes. Looking at my procmail log that's recording with the config:- VERBOSE=yes LOGABSTRACT=all LOGFILE=/var/log/procmail.log Also I've noticed that all emails procmail logs through that are not directed to probably-spam or almost-certainly-spam are apparently put in /var/mail/root procmail: Opening /var/mail/root procmail: Acquiring kernel-lock procmail: Unlocking /var/mail/root.lock procmail: Notified comsat: [EMAIL PROTECTED]:/var/mail/root From [EMAIL PROTECTED] Wed Nov 29 01:10:57 2006 Subject: Postmaster notify: see transcript for details Folder: /var/mail/root Am I to take it that some other program is at work taking emails that have been through procmail then forwarding to the mail boxes?? They must be going to procmail first to have the SPAMASSASSIN [SPAM] header tags. I'm on the last hurdle. If someone could help me with this I'd be VERY appreciative. CosmicPerl wrote: Hi, I changed it to 2 days. I've also setup a script that checks for double bounce emails in the queue and deletes them automatically. The specific EX_TEMPFAIL i was getting was due to quota issues on some accounts. Seems that if the master user for a domain is over quota then any [EMAIL PROTECTED] emails get stuck in the queue rather than rejected. I'm going to make another script that checks for these emails in the queue and notifys me automatically. Now everything seems to be running smoothly. I've had the [SPAM] added to subjects for over a week now, I'm happy that it's filtering spam and not legit mail. Now I'm having trouble getting it to delete mails marked as spam rather than just add the [SPAM] to the subject. I've added the lines:- :0: * ^X-Spam-Level: \*\*\*\*\*\*\*\*\*\*\*\*\*\*\* almost-certainly-spam :0: * ^X-Spam-Status: Yes probably-spam To my procmailrc, files containing emails called almost-certainly-spam and probably-spam have appeared in /var/spool/mqueue/, I thought they would have gone in /var/spool/mail? Either way I'm still getting emails coming through with [SPAM] in the subject despite the lines I've added. Not sure what to do now? Please help. Sietse van Zanen wrote: These mails stay there for 5 days. At least if you set up sendmail according to RFC's. that's the whole idea of SMTP store and forward. If address is unavailable, keep trying for a while before giving up. You can set the grace time to any period you like btw. -Sietse From: CosmicPerl Sent: Tue 21-Nov-06 16:48 To: users@spamassassin.apache.org Subject: Re: Problems running Spam Assassin Hi All, Ok, I've figured that having define(`confSEPARATE_PROC', `True') in my SendMail config was what was causing the flushing of the mail queue to create such a huge server load as it was spawning a new sendmail, procmail, and spamassassin child for each message in the mqueue. So I've disabled this, but I still cannot figure out why mail aimed at non existant uses is still staying in the message queue and not being rejected?? Any help would be very much appreciated. CosmicPerl wrote: Hi, It appears that as I was accepted to the mailing list after making my first post, my post did not hit the list. Here is my original full post below:- CosmicPerl wrote: Hi, I installed the latest SpamAssassin on my server. At first all my tests looked good, apart from load. So I setup spamc and spamd and everything seemed great, for a short while at least. A day later my mqueue had about 1500 messages in it, most with the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL. This seems to be coming up if the mailbox is full or the email is to an address that doesn't exist. It seemed that about every hour or so Sendmail was trying to flush out these messages, causing 1000's of processes to be started and making the server freeze up. Despite my Sendmail config having define(`confMAX_DAEMON_CHILDREN', `12')dnl In my procmailrc file I have:- DROPPRIVS=yes :0fw: spamassassin.lock * 256000 | spamc The SpamAssassin daemon was started with /usr/bin/spamd -d -u nobody At some point all mail stopped coming in. When I looked at the maillog file it had lots of lines like:- mkdir /root/.spamassassin: Permission denied Which I guess was causing the problem. This wasn't a problem before so I'm not sure why it happened. Any clues? Basically I need to set things up so that when sendmail trys to flush I don't get my server falling over. Emails that are sent to addresses that don't
RE: Problems running Spam Assassin
Hi, Does it have something to do with /etc/mail/virtusertable??? CosmicPerl wrote: Hi, Ok, I've updated my procmailrc file to have:- MAILDIR=/var/spool/mail This has fixed procmail putting spam emails in probably-spam and almost-certainly-spam mail boxes (I also created each of those as a user, but don't think it was that which made the real difference). Now the confusing thing is that even though both these mail boxes are filling up with the spam emails, the mails are still being delivered to the users mail boxes. Looking at my procmail log that's recording with the config:- VERBOSE=yes LOGABSTRACT=all LOGFILE=/var/log/procmail.log Also I've noticed that all emails procmail logs through that are not directed to probably-spam or almost-certainly-spam are apparently put in /var/mail/root procmail: Opening /var/mail/root procmail: Acquiring kernel-lock procmail: Unlocking /var/mail/root.lock procmail: Notified comsat: [EMAIL PROTECTED]:/var/mail/root From [EMAIL PROTECTED] Wed Nov 29 01:10:57 2006 Subject: Postmaster notify: see transcript for details Folder: /var/mail/root Am I to take it that some other program is at work taking emails that have been through procmail then forwarding to the mail boxes?? They must be going to procmail first to have the SPAMASSASSIN [SPAM] header tags. I'm on the last hurdle. If someone could help me with this I'd be VERY appreciative. CosmicPerl wrote: Hi, I changed it to 2 days. I've also setup a script that checks for double bounce emails in the queue and deletes them automatically. The specific EX_TEMPFAIL i was getting was due to quota issues on some accounts. Seems that if the master user for a domain is over quota then any [EMAIL PROTECTED] emails get stuck in the queue rather than rejected. I'm going to make another script that checks for these emails in the queue and notifys me automatically. Now everything seems to be running smoothly. I've had the [SPAM] added to subjects for over a week now, I'm happy that it's filtering spam and not legit mail. Now I'm having trouble getting it to delete mails marked as spam rather than just add the [SPAM] to the subject. I've added the lines:- :0: * ^X-Spam-Level: \*\*\*\*\*\*\*\*\*\*\*\*\*\*\* almost-certainly-spam :0: * ^X-Spam-Status: Yes probably-spam To my procmailrc, files containing emails called almost-certainly-spam and probably-spam have appeared in /var/spool/mqueue/, I thought they would have gone in /var/spool/mail? Either way I'm still getting emails coming through with [SPAM] in the subject despite the lines I've added. Not sure what to do now? Please help. Sietse van Zanen wrote: These mails stay there for 5 days. At least if you set up sendmail according to RFC's. that's the whole idea of SMTP store and forward. If address is unavailable, keep trying for a while before giving up. You can set the grace time to any period you like btw. -Sietse From: CosmicPerl Sent: Tue 21-Nov-06 16:48 To: users@spamassassin.apache.org Subject: Re: Problems running Spam Assassin Hi All, Ok, I've figured that having define(`confSEPARATE_PROC', `True') in my SendMail config was what was causing the flushing of the mail queue to create such a huge server load as it was spawning a new sendmail, procmail, and spamassassin child for each message in the mqueue. So I've disabled this, but I still cannot figure out why mail aimed at non existant uses is still staying in the message queue and not being rejected?? Any help would be very much appreciated. CosmicPerl wrote: Hi, It appears that as I was accepted to the mailing list after making my first post, my post did not hit the list. Here is my original full post below:- CosmicPerl wrote: Hi, I installed the latest SpamAssassin on my server. At first all my tests looked good, apart from load. So I setup spamc and spamd and everything seemed great, for a short while at least. A day later my mqueue had about 1500 messages in it, most with the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL. This seems to be coming up if the mailbox is full or the email is to an address that doesn't exist. It seemed that about every hour or so Sendmail was trying to flush out these messages, causing 1000's of processes to be started and making the server freeze up. Despite my Sendmail config having define(`confMAX_DAEMON_CHILDREN', `12')dnl In my procmailrc file I have:- DROPPRIVS=yes :0fw: spamassassin.lock * 256000 | spamc The SpamAssassin daemon was started with /usr/bin/spamd -d -u nobody At some point all mail stopped coming in. When I looked at the maillog file it had lots of lines like:- mkdir /root/.spamassassin: Permission denied Which I guess was causing the problem. This wasn't a problem before so I'm not sure why it happened. Any clues? Basically I need to set
RE: Problems running Spam Assassin
Hi, I changed it to 2 days. I've also setup a script that checks for double bounce emails in the queue and deletes them automatically. The specific EX_TEMPFAIL i was getting was due to quota issues on some accounts. Seems that if the master user for a domain is over quota then any [EMAIL PROTECTED] emails get stuck in the queue rather than rejected. I'm going to make another script that checks for these emails in the queue and notifys me automatically. Now everything seems to be running smoothly. I've had the [SPAM] added to subjects for over a week now, I'm happy that it's filtering spam and not legit mail. Now I'm having trouble getting it to delete mails marked as spam rather than just add the [SPAM] to the subject. I've added the lines:- :0: * ^X-Spam-Level: \*\*\*\*\*\*\*\*\*\*\*\*\*\*\* almost-certainly-spam :0: * ^X-Spam-Status: Yes probably-spam To my procmailrc, files containing emails called almost-certainly-spam and probably-spam have appeared in /var/spool/mqueue/, I thought they would have gone in /var/spool/mail? Either way I'm still getting emails coming through with [SPAM] in the subject despite the lines I've added. Not sure what to do now? Please help. Sietse van Zanen wrote: These mails stay there for 5 days. At least if you set up sendmail according to RFC's. that's the whole idea of SMTP store and forward. If address is unavailable, keep trying for a while before giving up. You can set the grace time to any period you like btw. -Sietse From: CosmicPerl Sent: Tue 21-Nov-06 16:48 To: users@spamassassin.apache.org Subject: Re: Problems running Spam Assassin Hi All, Ok, I've figured that having define(`confSEPARATE_PROC', `True') in my SendMail config was what was causing the flushing of the mail queue to create such a huge server load as it was spawning a new sendmail, procmail, and spamassassin child for each message in the mqueue. So I've disabled this, but I still cannot figure out why mail aimed at non existant uses is still staying in the message queue and not being rejected?? Any help would be very much appreciated. CosmicPerl wrote: Hi, It appears that as I was accepted to the mailing list after making my first post, my post did not hit the list. Here is my original full post below:- CosmicPerl wrote: Hi, I installed the latest SpamAssassin on my server. At first all my tests looked good, apart from load. So I setup spamc and spamd and everything seemed great, for a short while at least. A day later my mqueue had about 1500 messages in it, most with the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL. This seems to be coming up if the mailbox is full or the email is to an address that doesn't exist. It seemed that about every hour or so Sendmail was trying to flush out these messages, causing 1000's of processes to be started and making the server freeze up. Despite my Sendmail config having define(`confMAX_DAEMON_CHILDREN', `12')dnl In my procmailrc file I have:- DROPPRIVS=yes :0fw: spamassassin.lock * 256000 | spamc The SpamAssassin daemon was started with /usr/bin/spamd -d -u nobody At some point all mail stopped coming in. When I looked at the maillog file it had lots of lines like:- mkdir /root/.spamassassin: Permission denied Which I guess was causing the problem. This wasn't a problem before so I'm not sure why it happened. Any clues? Basically I need to set things up so that when sendmail trys to flush I don't get my server falling over. Emails that are sent to addresses that don't exist that are currently getting the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL be delete from the queue automatically. Ideally I'd like to give each different virtual server I have it's own possibly spam folder. I'm using Webmin and have a 100 or so Virtual servers so if anyone knows a good automated way of doing this that would be great. Either way I can't have things go down again otherwise I'll loose all my clients! And SpamAssassin working again. At first it was just marking emails with [spam] in the subject. Then Yesterday It then also started changing the message to an attachment and having Spam detection software, running on the system ns.cosmicsitehosting.com, has identified this incoming email as possible spam... in the message text. I've no idea what was changed so that this started happening. I didn't think I changed anything. Then last night it stopped sending any emails. Please help! Thanks in advance. Oh by the way my local.cf file contains required_hits 10 rewrite_header Subject [SPAM] report_safe 1 use_bayes 1 skip_rbl_checks 1 use_pyzor 1 Can anyone help with this? -- View this message in context: http://www.nabble.com/Problems-running-Spam-Assassin-tf2664618.html#a7473573 Sent from the SpamAssassin - Users mailing list archive at Nabble.com. -- View this message
Re: Problems running Spam Assassin
Hi, But I want users to be able to setup config directories. Do I need to start spamd in a different way? Do I need to run it as root, or is that to big a security hole? You shouldn't accept mails for invalid addresses, then they won't be in the queue at all. Sounds great, but how do I do that? I figured out the report_safe thing. Thanks in advance. Theo Van Dinter-2 wrote: On Tue, Nov 21, 2006 at 07:21:22AM -0800, CosmicPerl wrote: The SpamAssassin daemon was started with /usr/bin/spamd -d -u nobody At some point all mail stopped coming in. When I looked at the maillog file it had lots of lines like:- mkdir /root/.spamassassin: Permission denied Which I guess was causing the problem. This wasn't a problem before so I'm not sure why it happened. Any clues? You're telling spamd to run as user nobody, but haven't told it to stop using user config directories. So when mail comes in for root, root calls spamd, spamd can't access root's home dir, and you get the error message. Emails that are sent to addresses that don't exist that are currently getting the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL be delete from the queue automatically. You shouldn't accept mails for invalid addresses, then they won't be in the queue at all. And SpamAssassin working again. At first it was just marking emails with [spam] in the subject. Then Yesterday It then also started changing the message to an attachment and having Spam detection software, running on the system ns.cosmicsitehosting.com, has identified this incoming email as possible spam... in the message text. I've no idea what was changed so that this started happening. I didn't think I changed anything. Then last night it stopped sending any emails. your config enables report_safe, which causes SA to encapsulate the original message as an attachment. Oh by the way my local.cf file contains [...] report_safe 1 -- Randomly Selected Tagline: She's got a mortgage on my body and a lease on my soul. -- View this message in context: http://www.nabble.com/Problems-running-Spam-Assassin-tf2664618.html#a7562313 Sent from the SpamAssassin - Users mailing list archive at Nabble.com.
Re: Problems running Spam Assassin
Hi, Thanks for the reply. I want users to have the option to have their own spamassassin configuration. Is it best just to start spamd without -u? I've got over 100 virtual servers, I don't want to setup folders and permissions for each user. What's the easiest and safest way? How would you do it? Thanks Magnus Holmgren wrote: On Sunday 19 November 2006 18:04, CosmicPerl wrote: Hi, I installed the latest SpamAssassin on my server. At first all my tests looked good, apart from load. So I setup spamc and spamd and everything seemed great, for a short while at least. A day later my mqueue had about 1500 messages in it, most with the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL. This seems to be coming up if the mailbox is full or the email is to an address that doesn't exist. It seemed that about every hour or so Sendmail was trying to flush out these messages, causing 1000's of processes to be started and making the server freeze up. Despite my Sendmail config having define(`confMAX_DAEMON_CHILDREN', `12')dnl In my procmailrc file I have:- DROPPRIVS=yes :0fw: spamassassin.lock * 256000 | spamc The SpamAssassin daemon was started with /usr/bin/spamd -d -u nobody At some point all mail stopped coming in. When I looked at the maillog file it had lots of lines like:- mkdir /root/.spamassassin: Permission denied Which I guess was causing the problem. This wasn't a problem before so I'm not sure why it happened. Any clues? I guess you might get some problem if you run spamd with -u nobody but without --nouser-config (either spamd will try to access the users' home directories as nobody, or it will try to access the home directory of nobody - I'm not sure, but in either case it will work badly. If you want per-user preferences together with -u you must either use -x --virtual-config-dir, make all users' .spamassassin directories readable (and writable, if you want bayes and/or AWL) by the spamd user (should be a special user - the nobody user isn't supposed to have any particular access to any files), or use a database. See README.spamd for security considerations if you have any untrusted users with shell access. -- Magnus Holmgren[EMAIL PROTECTED] (No Cc of list mail needed, thanks) -- View this message in context: http://www.nabble.com/Problems-running-Spam-Assassin-tf2664618.html#a7572889 Sent from the SpamAssassin - Users mailing list archive at Nabble.com.
RE: Problems running Spam Assassin
Actually I was replying to my forum thread and deleted my original message that it quoted as I thought it had already hit the list. Sietse van Zanen wrote: Probably with him being too lazy to copy and paste his original message from the other board, or list.. Well, I am too lazy to follow his link... From: Theo Van Dinter Sent: Tue 21-Nov-06 15:24 To: CosmicPerl Cc: users@spamassassin.apache.org Subject: Re: Problems running Spam Assassin On Tue, Nov 21, 2006 at 06:16:15AM -0800, CosmicPerl wrote: Can anyone help with this? With what? -- Randomly Selected Tagline: ... the menu is written in more elementary Spanish than a Dora the Explorer episode ... - Karl Chalabala about a lunch menu at work -- View this message in context: http://www.nabble.com/Problems-running-Spam-Assassin-tf2664618.html#a7473175 Sent from the SpamAssassin - Users mailing list archive at Nabble.com.
Re: Problems running Spam Assassin
Hi All, Ok, I've figured that having define(`confSEPARATE_PROC', `True') in my SendMail config was what was causing the flushing of the mail queue to create such a huge server load as it was spawning a new sendmail, procmail, and spamassassin child for each message in the mqueue. So I've disabled this, but I still cannot figure out why mail aimed at non existant uses is still staying in the message queue and not being rejected?? Any help would be very much appreciated. CosmicPerl wrote: Hi, It appears that as I was accepted to the mailing list after making my first post, my post did not hit the list. Here is my original full post below:- CosmicPerl wrote: Hi, I installed the latest SpamAssassin on my server. At first all my tests looked good, apart from load. So I setup spamc and spamd and everything seemed great, for a short while at least. A day later my mqueue had about 1500 messages in it, most with the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL. This seems to be coming up if the mailbox is full or the email is to an address that doesn't exist. It seemed that about every hour or so Sendmail was trying to flush out these messages, causing 1000's of processes to be started and making the server freeze up. Despite my Sendmail config having define(`confMAX_DAEMON_CHILDREN', `12')dnl In my procmailrc file I have:- DROPPRIVS=yes :0fw: spamassassin.lock * 256000 | spamc The SpamAssassin daemon was started with /usr/bin/spamd -d -u nobody At some point all mail stopped coming in. When I looked at the maillog file it had lots of lines like:- mkdir /root/.spamassassin: Permission denied Which I guess was causing the problem. This wasn't a problem before so I'm not sure why it happened. Any clues? Basically I need to set things up so that when sendmail trys to flush I don't get my server falling over. Emails that are sent to addresses that don't exist that are currently getting the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL be delete from the queue automatically. Ideally I'd like to give each different virtual server I have it's own possibly spam folder. I'm using Webmin and have a 100 or so Virtual servers so if anyone knows a good automated way of doing this that would be great. Either way I can't have things go down again otherwise I'll loose all my clients! And SpamAssassin working again. At first it was just marking emails with [spam] in the subject. Then Yesterday It then also started changing the message to an attachment and having Spam detection software, running on the system ns.cosmicsitehosting.com, has identified this incoming email as possible spam... in the message text. I've no idea what was changed so that this started happening. I didn't think I changed anything. Then last night it stopped sending any emails. Please help! Thanks in advance. Oh by the way my local.cf file contains required_hits 10 rewrite_header Subject [SPAM] report_safe 1 use_bayes 1 skip_rbl_checks 1 use_pyzor 1 Can anyone help with this? -- View this message in context: http://www.nabble.com/Problems-running-Spam-Assassin-tf2664618.html#a7473573 Sent from the SpamAssassin - Users mailing list archive at Nabble.com.
Re: Problems running Spam Assassin
Can anyone help with this? -- View this message in context: http://www.nabble.com/Problems-running-Spam-Assassin-tf2664618.html#a7471981 Sent from the SpamAssassin - Users mailing list archive at Nabble.com.
Problems running Spam Assassin
Hi, I installed the latest SpamAssassin on my server. At first all my tests looked good, apart from load. So I setup spamc and spamd and everything seemed great, for a short while at least. A day later my mqueue had about 1500 messages in it, most with the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL. This seems to be coming up if the mailbox is full or the email is to an address that doesn't exist. It seemed that about every hour or so Sendmail was trying to flush out these messages, causing 1000's of processes to be started and making the server freeze up. Despite my Sendmail config having define(`confMAX_DAEMON_CHILDREN', `12')dnl In my procmailrc file I have:- DROPPRIVS=yes :0fw: spamassassin.lock * 256000 | spamc The SpamAssassin daemon was started with /usr/bin/spamd -d -u nobody At some point all mail stopped coming in. When I looked at the maillog file it had lots of lines like:- mkdir /root/.spamassassin: Permission denied Which I guess was causing the problem. This wasn't a problem before so I'm not sure why it happened. Any clues? Basically I need to set things up so that when sendmail trys to flush I don't get my server falling over. Emails that are sent to addresses that don't exist that are currently getting the error local mailer (/usr/bin/procmail) exited with EX_TEMPFAIL be delete from the queue automatically. Ideally I'd like to give each different virtual server I have it's own possibly spam folder. I'm using Webmin and have a 100 or so Virtual servers so if anyone knows a good automated way of doing this that would be great. Either way I can't have things go down again otherwise I'll loose all my clients! And SpamAssassin working again. At first it was just marking emails with [spam] in the subject. Then Yesterday It then also started changing the message to an attachment and having Spam detection software, running on the system ns.cosmicsitehosting.com, has identified this incoming email as possible spam... in the message text. I've no idea what was changed so that this started happening. I didn't think I changed anything. Then last night it stopped sending any emails. Please help! Thanks in advance. Oh by the way my local.cf file contains required_hits 10 rewrite_header Subject [SPAM] report_safe 1 use_bayes 1 skip_rbl_checks 1 use_pyzor 1 -- View this message in context: http://www.nabble.com/Problems-running-Spam-Assassin-tf2664618.html#a7431008 Sent from the SpamAssassin - Users mailing list archive at Nabble.com.
