Re: [Dbmail] High Load Average and dbmail-pop3d ?
When you run top, do you find that most of the CPU time is being taken by dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to tune the database a bit in my.cnf, and to add the indices posted to the list a couple of times. If it's pop3d.. umm... sounds bad, post more info! Aaron On 16 May 2003, Jason Burfield wrote: > I have searched through back messages and found one thread with someone > having huge load averages caused by dbmail-smtpd. > > Well...I'm getting HUGE load averages with dbmail-pop3d. > > For whatever reason the load average on my box is jumping up to well > over 7.00 after dbmail-pop3d has been running for a few minutes. > > This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the > life of me, imagine what would cause that type of load. > > This mail server went up last night...so in the past 24 hours it has > accepted something around 2000 messages. We do have lots of clients > checking mail frequently, around every 5 minutes, however, I wouldn't > think that would cause this type of load. > > I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) > > As an example, at this very moment the box has a load average of 5.62. > There are currently 6 clients connected to the pop server. > > Does anyone have any idea what may be causing this? We don't have that > many clients, only about 300 email clients...what type of load should be > expected from that type of base? > > Any help is greatly appreciated. > > Thanks! > > -- Jason > > -- Jason Burfield > -- [EMAIL PROTECTED] > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail >
Re: [Dbmail] High Load Average and dbmail-pop3d ?
It's dbmail-pop3d. Currently TOP is showing this: PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d The database currently has all proper indexes...and it does not seem to be a MySQL issue at all. And, the load average continues to grow the longer that dbmail-pop3d continues to run. It is currently at 11.57 This is the highest I personally have EVER seen one of my machines go. Also, when I check the maillog it does not seem to be doing anything out of the ordinary. It almost looks like one child process has just run off and refuses to stop...but the log is not showing tons of stuff going on. I'm totally freaked and confused now! Thanks! -- Jason On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: > When you run top, do you find that most of the CPU time is being taken by > dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to > tune the database a bit in my.cnf, and to add the indices posted to the > list a couple of times. If it's pop3d.. umm... sounds bad, post more info! > > Aaron > > > On 16 May 2003, Jason Burfield wrote: > > > I have searched through back messages and found one thread with someone > > having huge load averages caused by dbmail-smtpd. > > > > Well...I'm getting HUGE load averages with dbmail-pop3d. > > > > For whatever reason the load average on my box is jumping up to well > > over 7.00 after dbmail-pop3d has been running for a few minutes. > > > > This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the > > life of me, imagine what would cause that type of load. > > > > This mail server went up last night...so in the past 24 hours it has > > accepted something around 2000 messages. We do have lots of clients > > checking mail frequently, around every 5 minutes, however, I wouldn't > > think that would cause this type of load. > > > > I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) > > > > As an example, at this very moment the box has a load average of 5.62. > > There are currently 6 clients connected to the pop server. > > > > Does anyone have any idea what may be causing this? We don't have that > > many clients, only about 300 email clients...what type of load should be > > expected from that type of base? > > > > Any help is greatly appreciated. > > > > Thanks! > > > > -- Jason > > > > -- Jason Burfield > > -- [EMAIL PROTECTED] > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail >
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Sometimes I see similar behaviour with dbmail-imapd, actually. To get a load average this high, though, you need a lot of processes. I sometimes see one or two dbmail-imapd's go haywire and I have to kill them, but I'm only running 5-10 at a time. The frequency of this happening on my server went way down when I upgraded its glibc (I had attached a gdb process and found that it was stuck in a malloc() of all places!). It was at Mandrake 8.1, so I got the 8.2 RPM. I'm very hesitant to blame the problem on glibc, but I am comfortable saying that there might be some code in dbmail that's not playing nice. Aaron On 16 May 2003, Jason Burfield wrote: > It's dbmail-pop3d. > > Currently TOP is showing this: > > PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND > 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d > > The database currently has all proper indexes...and it does not seem to > be a MySQL issue at all. > > And, the load average continues to grow the longer that dbmail-pop3d > continues to run. > > It is currently at 11.57 > > This is the highest I personally have EVER seen one of my machines go. > > Also, when I check the maillog it does not seem to be doing anything out > of the ordinary. It almost looks like one child process has just run off > and refuses to stop...but the log is not showing tons of stuff going on. > > I'm totally freaked and confused now! > > Thanks! > > -- Jason > > > On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: > > When you run top, do you find that most of the CPU time is being taken by > > dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to > > tune the database a bit in my.cnf, and to add the indices posted to the > > list a couple of times. If it's pop3d.. umm... sounds bad, post more info! > > > > Aaron > > > > > > On 16 May 2003, Jason Burfield wrote: > > > > > I have searched through back messages and found one thread with someone > > > having huge load averages caused by dbmail-smtpd. > > > > > > Well...I'm getting HUGE load averages with dbmail-pop3d. > > > > > > For whatever reason the load average on my box is jumping up to well > > > over 7.00 after dbmail-pop3d has been running for a few minutes. > > > > > > This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the > > > life of me, imagine what would cause that type of load. > > > > > > This mail server went up last night...so in the past 24 hours it has > > > accepted something around 2000 messages. We do have lots of clients > > > checking mail frequently, around every 5 minutes, however, I wouldn't > > > think that would cause this type of load. > > > > > > I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) > > > > > > As an example, at this very moment the box has a load average of 5.62. > > > There are currently 6 clients connected to the pop server. > > > > > > Does anyone have any idea what may be causing this? We don't have that > > > many clients, only about 300 email clients...what type of load should be > > > expected from that type of base? > > > > > > Any help is greatly appreciated. > > > > > > Thanks! > > > > > > -- Jason > > > > > > -- Jason Burfield > > > -- [EMAIL PROTECTED] > > > > > > ___ > > > Dbmail mailing list > > > Dbmail@dbmail.org > > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail >
Re: [Dbmail] High Load Average and dbmail-pop3d ?
In some email I received from Jason Burfield <[EMAIL PROTECTED]> on 16 May 2003 14:54:16 -0400, wrote: Hi jason, did you try to attach a debugger to the process? in any way if you can get us dump image off the process that would be great. kill -ABRT should make the process exit with a core dump. anyway, might be an infinite loop or something? cheers. > It's dbmail-pop3d. > > Currently TOP is showing this: > > PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND > 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d > > The database currently has all proper indexes...and it does not seem to > be a MySQL issue at all. > > And, the load average continues to grow the longer that dbmail-pop3d > continues to run. > > It is currently at 11.57 > > This is the highest I personally have EVER seen one of my machines go. > > Also, when I check the maillog it does not seem to be doing anything out > of the ordinary. It almost looks like one child process has just run off > and refuses to stop...but the log is not showing tons of stuff going on. > > I'm totally freaked and confused now! > > Thanks! > > -- Jason > > > On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: > > When you run top, do you find that most of the CPU time is being taken by > > dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to > > tune the database a bit in my.cnf, and to add the indices posted to the > > list a couple of times. If it's pop3d.. umm... sounds bad, post more info! > > > > Aaron > > > > > > On 16 May 2003, Jason Burfield wrote: > > > > > I have searched through back messages and found one thread with someone > > > having huge load averages caused by dbmail-smtpd. > > > > > > Well...I'm getting HUGE load averages with dbmail-pop3d. > > > > > > For whatever reason the load average on my box is jumping up to well > > > over 7.00 after dbmail-pop3d has been running for a few minutes. > > > > > > This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the > > > life of me, imagine what would cause that type of load. > > > > > > This mail server went up last night...so in the past 24 hours it has > > > accepted something around 2000 messages. We do have lots of clients > > > checking mail frequently, around every 5 minutes, however, I wouldn't > > > think that would cause this type of load. > > > > > > I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) > > > > > > As an example, at this very moment the box has a load average of 5.62. > > > There are currently 6 clients connected to the pop server. > > > > > > Does anyone have any idea what may be causing this? We don't have that > > > many clients, only about 300 email clients...what type of load should be > > > expected from that type of base? > > > > > > Any help is greatly appreciated. > > > > > > Thanks! > > > > > > -- Jason > > > > > > -- Jason Burfield > > > -- [EMAIL PROTECTED] > > > > > > ___ > > > Dbmail mailing list > > > Dbmail@dbmail.org > > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail > -- Lou Kamenov / Network Infrastructure/Security Analyst AEYE R&D - http://www.aeye.net [EMAIL PROTECTED] AEYE Technologies - http://www.aeyetech.co.uk [EMAIL PROTECTED] phone: +44 (0) 20 8879 9832 fax: +44 (0) 7092 129079 mobile: +44 (0) 79 3945 3026 PGP Key ID - 0xA297084A AEYE(=AI) stands for Artificial Intelligence.
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Jason, Have you tried attaching a strace to the process involved? That might give you an idea of what's eating so much cpu cycles. strace -p Also, use the DEBUG_LEVEL in the config. It's your friend in an hour of need. Jason Burfield wrote: It's dbmail-pop3d. Currently TOP is showing this: PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d The database currently has all proper indexes...and it does not seem to be a MySQL issue at all. And, the load average continues to grow the longer that dbmail-pop3d continues to run. It is currently at 11.57 This is the highest I personally have EVER seen one of my machines go. Also, when I check the maillog it does not seem to be doing anything out of the ordinary. It almost looks like one child process has just run off and refuses to stop...but the log is not showing tons of stuff going on. I'm totally freaked and confused now! Thanks! -- Jason On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: When you run top, do you find that most of the CPU time is being taken by dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to tune the database a bit in my.cnf, and to add the indices posted to the list a couple of times. If it's pop3d.. umm... sounds bad, post more info! Aaron On 16 May 2003, Jason Burfield wrote: I have searched through back messages and found one thread with someone having huge load averages caused by dbmail-smtpd. Well...I'm getting HUGE load averages with dbmail-pop3d. For whatever reason the load average on my box is jumping up to well over 7.00 after dbmail-pop3d has been running for a few minutes. This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the life of me, imagine what would cause that type of load. This mail server went up last night...so in the past 24 hours it has accepted something around 2000 messages. We do have lots of clients checking mail frequently, around every 5 minutes, however, I wouldn't think that would cause this type of load. I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) As an example, at this very moment the box has a load average of 5.62. There are currently 6 clients connected to the pop server. Does anyone have any idea what may be causing this? We don't have that many clients, only about 300 email clients...what type of load should be expected from that type of base? Any help is greatly appreciated. Thanks! -- Jason -- Jason Burfield -- [EMAIL PROTECTED] ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail -- Paul Stevens mailto:[EMAIL PROTECTED] NET FACILITIES GROUP PGP: finger [EMAIL PROTECTED] The Netherlandshttp://www.nfg.nl
Re: [Dbmail] High Load Average and dbmail-pop3d ?
I have not tried to attach a debugger yet... I just restarted dbmail-pop3d after I found one anomoly in dbmail.conf, not that I think this would cause it, but instead of being set to run as user: dbmail and group: dbmail it was running as nobody and nogroup. I can't imagine that would make a difference, but I changed it and restarted...so now I'm waiting to see if it's going to climb again. If it does, I try the debugger and send a dump. Thanks! -- Jason On Fri, 2003-05-16 at 16:07, lou wrote: > In some email I received from Jason Burfield <[EMAIL PROTECTED]> on 16 May > 2003 14:54:16 > -0400, wrote: > > Hi jason, > > did you try to attach a debugger to the process? > in any way if you can get us dump image off the process that would be great. > > kill -ABRT > > should make the process exit with a core dump. > > anyway, might be an infinite loop or something? > > > cheers. > > > > It's dbmail-pop3d. > > > > Currently TOP is showing this: > > > > PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND > > 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d > > > > The database currently has all proper indexes...and it does not seem to > > be a MySQL issue at all. > > > > And, the load average continues to grow the longer that dbmail-pop3d > > continues to run. > > > > It is currently at 11.57 > > > > This is the highest I personally have EVER seen one of my machines go. > > > > Also, when I check the maillog it does not seem to be doing anything out > > of the ordinary. It almost looks like one child process has just run off > > and refuses to stop...but the log is not showing tons of stuff going on. > > > > I'm totally freaked and confused now! > > > > Thanks! > > > > -- Jason > > > > > > On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: > > > When you run top, do you find that most of the CPU time is being taken by > > > dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to > > > tune the database a bit in my.cnf, and to add the indices posted to the > > > list a couple of times. If it's pop3d.. umm... sounds bad, post more info! > > > > > > Aaron > > > > > > > > > On 16 May 2003, Jason Burfield wrote: > > > > > > > I have searched through back messages and found one thread with someone > > > > having huge load averages caused by dbmail-smtpd. > > > > > > > > Well...I'm getting HUGE load averages with dbmail-pop3d. > > > > > > > > For whatever reason the load average on my box is jumping up to well > > > > over 7.00 after dbmail-pop3d has been running for a few minutes. > > > > > > > > This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the > > > > life of me, imagine what would cause that type of load. > > > > > > > > This mail server went up last night...so in the past 24 hours it has > > > > accepted something around 2000 messages. We do have lots of clients > > > > checking mail frequently, around every 5 minutes, however, I wouldn't > > > > think that would cause this type of load. > > > > > > > > I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) > > > > > > > > As an example, at this very moment the box has a load average of 5.62. > > > > There are currently 6 clients connected to the pop server. > > > > > > > > Does anyone have any idea what may be causing this? We don't have that > > > > many clients, only about 300 email clients...what type of load should be > > > > expected from that type of base? > > > > > > > > Any help is greatly appreciated. > > > > > > > > Thanks! > > > > > > > > -- Jason > > > > > > > > -- Jason Burfield > > > > -- [EMAIL PROTECTED] > > > > > > > > ___ > > > > Dbmail mailing list > > > > Dbmail@dbmail.org > > > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > > > > > > > ___ > > > Dbmail mailing list > > > Dbmail@dbmail.org > > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > >
Re: [Dbmail] High Load Average and dbmail-pop3d ?
I have been working the DEBUG_LEVEL, but there really isn't anything out of the ordinary showing up...that's the confusing part. When I do: strace -p I get: attach: ptrace(PTRACE_ATTACH, ...): Operation not permitted I'm no C programmer, so I have no idea what that means. However, when I tried it earlier it seemed to attach and listen...but now I get what is above. Again, thanks all for your help...much appreciated. -- Jason On Fri, 2003-05-16 at 15:09, Paul Stevens wrote: > Jason, > > Have you tried attaching a strace to the process involved? > That might give you an idea of what's eating so much cpu cycles. > > strace -p > > Also, use the DEBUG_LEVEL in the config. It's your friend in an hour of > need. > > > > > Jason Burfield wrote: > > It's dbmail-pop3d. > > > > Currently TOP is showing this: > > > > PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND > > 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d > > > > The database currently has all proper indexes...and it does not seem to > > be a MySQL issue at all. > > > > And, the load average continues to grow the longer that dbmail-pop3d > > continues to run. > > > > It is currently at 11.57 > > > > This is the highest I personally have EVER seen one of my machines go. > > > > Also, when I check the maillog it does not seem to be doing anything out > > of the ordinary. It almost looks like one child process has just run off > > and refuses to stop...but the log is not showing tons of stuff going on. > > > > I'm totally freaked and confused now! > > > > Thanks! > > > > -- Jason > > > > > > On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: > > > >>When you run top, do you find that most of the CPU time is being taken by > >>dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to > >>tune the database a bit in my.cnf, and to add the indices posted to the > >>list a couple of times. If it's pop3d.. umm... sounds bad, post more info! > >> > >>Aaron > >> > >> > >>On 16 May 2003, Jason Burfield wrote: > >> > >> > >>>I have searched through back messages and found one thread with someone > >>>having huge load averages caused by dbmail-smtpd. > >>> > >>>Well...I'm getting HUGE load averages with dbmail-pop3d. > >>> > >>>For whatever reason the load average on my box is jumping up to well > >>>over 7.00 after dbmail-pop3d has been running for a few minutes. > >>> > >>>This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the > >>>life of me, imagine what would cause that type of load. > >>> > >>>This mail server went up last night...so in the past 24 hours it has > >>>accepted something around 2000 messages. We do have lots of clients > >>>checking mail frequently, around every 5 minutes, however, I wouldn't > >>>think that would cause this type of load. > >>> > >>>I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) > >>> > >>>As an example, at this very moment the box has a load average of 5.62. > >>>There are currently 6 clients connected to the pop server. > >>> > >>>Does anyone have any idea what may be causing this? We don't have that > >>>many clients, only about 300 email clients...what type of load should be > >>>expected from that type of base? > >>> > >>>Any help is greatly appreciated. > >>> > >>>Thanks! > >>> > >>> -- Jason > >>> > >>> -- Jason Burfield > >>> -- [EMAIL PROTECTED] > >>> > >>>___ > >>>Dbmail mailing list > >>>Dbmail@dbmail.org > >>>https://mailman.fastxs.nl/mailman/listinfo/dbmail > >>> > >> > >>___ > >>Dbmail mailing list > >>Dbmail@dbmail.org > >>https://mailman.fastxs.nl/mailman/listinfo/dbmail > >> > > > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > >
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Hi all, I am having an extremely similar problem with dbmail-imapd (running dbmail 1.1). And, to simplify things somewhat, I can tell you a bit about the problem. 1. MySQL is *not* the cause of this problem. I am using MySQL 4.0.12 and killing dbmail-imapd very quickly brings the load average down. 2. The load average grows linearly, so one day after having dbmail-imapd running, the load average will read "1.00 1.00 1.00", the second day "2.00 2.00 2.00" the third day "3.00 3.00 3.00" etc. 3. I am running Mandrake 9.0 (one of the last glibc 2.2-based distros). 4. DBMail very happily maxes out MySQL's connection pool. I'm betting this has something to do with it (trying to connect from any other machine with any MySQL client or another DBMail instance will always fail after dbmail-imapd has been running for a few days). 5. I have many indexes and foreign key constraints in place as have been suggested on this list. 6. I only have 8 people using this server - 6 with IMAP clients and 2 with POP3 clients. 7. SquirrelMail's performance degrades as the load average goes up, and massively. It takes 10 seconds to render each frame due to the IMAP side of things being so heavily choked. If anyone has any other questions or any suggestion as to where the problem is in the source (I'm a 4th year Software Engineering student at a uni where C is the primary language and Unix is the primary platform) I'll have a go at fixing it. Interestingly, Roel said that they only get this problem every few months with some of their customer sites Chris lou wrote: In some email I received from Jason Burfield <[EMAIL PROTECTED]> on 16 May 2003 14:54:16 -0400, wrote: Hi jason, did you try to attach a debugger to the process? in any way if you can get us dump image off the process that would be great. kill -ABRT should make the process exit with a core dump. anyway, might be an infinite loop or something? cheers. It's dbmail-pop3d. Currently TOP is showing this: PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d The database currently has all proper indexes...and it does not seem to be a MySQL issue at all. And, the load average continues to grow the longer that dbmail-pop3d continues to run. It is currently at 11.57 This is the highest I personally have EVER seen one of my machines go. Also, when I check the maillog it does not seem to be doing anything out of the ordinary. It almost looks like one child process has just run off and refuses to stop...but the log is not showing tons of stuff going on. I'm totally freaked and confused now! Thanks! -- Jason On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: When you run top, do you find that most of the CPU time is being taken by dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to tune the database a bit in my.cnf, and to add the indices posted to the list a couple of times. If it's pop3d.. umm... sounds bad, post more info! Aaron On 16 May 2003, Jason Burfield wrote: I have searched through back messages and found one thread with someone having huge load averages caused by dbmail-smtpd. Well...I'm getting HUGE load averages with dbmail-pop3d. For whatever reason the load average on my box is jumping up to well over 7.00 after dbmail-pop3d has been running for a few minutes. This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the life of me, imagine what would cause that type of load. This mail server went up last night...so in the past 24 hours it has accepted something around 2000 messages. We do have lots of clients checking mail frequently, around every 5 minutes, however, I wouldn't think that would cause this type of load. I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) As an example, at this very moment the box has a load average of 5.62. There are currently 6 clients connected to the pop server. Does anyone have any idea what may be causing this? We don't have that many clients, only about 300 email clients...what type of load should be expected from that type of base? Any help is greatly appreciated. Thanks! -- Jason -- Jason Burfield -- [EMAIL PROTECTED] ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] High Load Average and dbmail-pop3d ?
The most important thing pop & imap share is the connection handling code. Roel is checking that out for bugs. Best regards, eelco On zaterdag, mei 17, 2003, at 04:22 Europe/Amsterdam, Chris Nolan wrote: Hi all, I am having an extremely similar problem with dbmail-imapd (running dbmail 1.1). And, to simplify things somewhat, I can tell you a bit about the problem. 1. MySQL is *not* the cause of this problem. I am using MySQL 4.0.12 and killing dbmail-imapd very quickly brings the load average down. 2. The load average grows linearly, so one day after having dbmail-imapd running, the load average will read "1.00 1.00 1.00", the second day "2.00 2.00 2.00" the third day "3.00 3.00 3.00" etc. 3. I am running Mandrake 9.0 (one of the last glibc 2.2-based distros). 4. DBMail very happily maxes out MySQL's connection pool. I'm betting this has something to do with it (trying to connect from any other machine with any MySQL client or another DBMail instance will always fail after dbmail-imapd has been running for a few days). 5. I have many indexes and foreign key constraints in place as have been suggested on this list. 6. I only have 8 people using this server - 6 with IMAP clients and 2 with POP3 clients. 7. SquirrelMail's performance degrades as the load average goes up, and massively. It takes 10 seconds to render each frame due to the IMAP side of things being so heavily choked. If anyone has any other questions or any suggestion as to where the problem is in the source (I'm a 4th year Software Engineering student at a uni where C is the primary language and Unix is the primary platform) I'll have a go at fixing it. Interestingly, Roel said that they only get this problem every few months with some of their customer sites Chris lou wrote: In some email I received from Jason Burfield <[EMAIL PROTECTED]> on 16 May 2003 14:54:16 -0400, wrote: Hi jason, did you try to attach a debugger to the process? in any way if you can get us dump image off the process that would be great. kill -ABRT should make the process exit with a core dump. anyway, might be an infinite loop or something? cheers. It's dbmail-pop3d. Currently TOP is showing this: PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d The database currently has all proper indexes...and it does not seem to be a MySQL issue at all. And, the load average continues to grow the longer that dbmail-pop3d continues to run. It is currently at 11.57 This is the highest I personally have EVER seen one of my machines go. Also, when I check the maillog it does not seem to be doing anything out of the ordinary. It almost looks like one child process has just run off and refuses to stop...but the log is not showing tons of stuff going on. I'm totally freaked and confused now! Thanks! -- Jason On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: When you run top, do you find that most of the CPU time is being taken by dbmail-pop3d itself, or by mysqld? In the latter case, you may do well to tune the database a bit in my.cnf, and to add the indices posted to the list a couple of times. If it's pop3d.. umm... sounds bad, post more info! Aaron On 16 May 2003, Jason Burfield wrote: I have searched through back messages and found one thread with someone having huge load averages caused by dbmail-smtpd. Well...I'm getting HUGE load averages with dbmail-pop3d. For whatever reason the load average on my box is jumping up to well over 7.00 after dbmail-pop3d has been running for a few minutes. This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for the life of me, imagine what would cause that type of load. This mail server went up last night...so in the past 24 hours it has accepted something around 2000 messages. We do have lots of clients checking mail frequently, around every 5 minutes, however, I wouldn't think that would cause this type of load. I'm running dmail-1.1, MySQL and Postfix on Linux. (RH 8) As an example, at this very moment the box has a load average of 5.62. There are currently 6 clients connected to the pop server. Does anyone have any idea what may be causing this? We don't have that many clients, only about 300 email clients...what type of load should be expected from that type of base? Any help is greatly appreciated. Thanks! -- Jason -- Jason Burfield -- [EMAIL PROTECTED] ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing
Re: [Dbmail] High Load Average and dbmail-pop3d ?
So far the only thing I have found that seems to show up in the logs when the load starts to go up is someone attempting to check mail with the wrong credentials, pretty much always a wrong password. Would that be possible? I attached gdb and did an strace but seemed to come up with nothing. -- Jason on 5/17/03 2:23 AM, Eelco van Beek - IC&S at [EMAIL PROTECTED] wrote: > The most important thing pop & imap share is the connection handling > code. Roel is checking that out for bugs. > > Best regards, > > eelco > > > On zaterdag, mei 17, 2003, at 04:22 Europe/Amsterdam, Chris Nolan wrote: > >> Hi all, >> >> I am having an extremely similar problem with dbmail-imapd (running >> dbmail 1.1). And, to simplify things somewhat, I can tell you a bit >> about the problem. >> >> 1. MySQL is *not* the cause of this problem. I am using MySQL 4.0.12 >> and killing dbmail-imapd very quickly brings the load average down. >> 2. The load average grows linearly, so one day after having >> dbmail-imapd running, the load average will read "1.00 1.00 1.00", the >> second day "2.00 2.00 2.00" the third day "3.00 3.00 3.00" etc. >> 3. I am running Mandrake 9.0 (one of the last glibc 2.2-based distros). >> 4. DBMail very happily maxes out MySQL's connection pool. I'm betting >> this has something to do with it (trying to connect from any other >> machine with any MySQL client or another DBMail instance will always >> fail after dbmail-imapd has been running for a few days). >> 5. I have many indexes and foreign key constraints in place as have >> been suggested on this list. >> 6. I only have 8 people using this server - 6 with IMAP clients and 2 >> with POP3 clients. >> 7. SquirrelMail's performance degrades as the load average goes up, >> and massively. It takes 10 seconds to render each frame due to the >> IMAP side of things being so heavily choked. >> >> If anyone has any other questions or any suggestion as to where the >> problem is in the source (I'm a 4th year Software Engineering student >> at a uni where C is the primary language and Unix is the primary >> platform) I'll have a go at fixing it. >> >> Interestingly, Roel said that they only get this problem every few >> months with some of their customer sites >> >> Chris >> >> lou wrote: >> >>> In some email I received from Jason Burfield <[EMAIL PROTECTED]> on >>> 16 May 2003 14:54:16 >>> -0400, wrote: >>> >>> Hi jason, >>> did you try to attach a debugger to the process? >>> in any way if you can get us dump image off the process that would be >>> great. >>> >>> kill -ABRT >>> should make the process exit with a core dump. >>> >>> anyway, might be an infinite loop or something? >>> >>> cheers. >>> >>> >>> It's dbmail-pop3d. Currently TOP is showing this: PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d The database currently has all proper indexes...and it does not seem to be a MySQL issue at all. And, the load average continues to grow the longer that dbmail-pop3d continues to run. It is currently at 11.57 This is the highest I personally have EVER seen one of my machines go. Also, when I check the maillog it does not seem to be doing anything out of the ordinary. It almost looks like one child process has just run off and refuses to stop...but the log is not showing tons of stuff going on. I'm totally freaked and confused now! Thanks! -- Jason On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: > When you run top, do you find that most of the CPU time is being > taken by > dbmail-pop3d itself, or by mysqld? In the latter case, you may do > well to > tune the database a bit in my.cnf, and to add the indices posted to > the > list a couple of times. If it's pop3d.. umm... sounds bad, post > more info! > > Aaron > > > On 16 May 2003, Jason Burfield wrote: > > >> I have searched through back messages and found one thread with >> someone >> having huge load averages caused by dbmail-smtpd. >> >> Well...I'm getting HUGE load averages with dbmail-pop3d. >> >> For whatever reason the load average on my box is jumping up to >> well >> over 7.00 after dbmail-pop3d has been running for a few minutes. >> >> This is on a dual 2.4ghz Xeon with 4 gigs of RAM...so I can't for >> the >> life of me, imagine what would cause that type of load. >> >> This mail server went up last night...so in the past 24 hours it >> has >> accepted something around 2000 messages. We do have lots of clients >> checking mail frequently, around every 5 minutes, however, I >> wouldn't >> think that would cause this type of load. >> >> I'm run
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Another quick follow-up... My server just freaked and ran up to a load average over 32.00. That is out of control! Wow! There were 30 dbmail-pop3d processes all carrying a load. I killed the server and then with a copy of the log file, traced each of the pids back. Every single one of them ended with: --- May 17 17:31:21 vault dbmail/pop3d[24001]: auth_md5_validate(): user [EMAIL PROTECTED] could not be validated --- Obviously, the address has been changed. I found that this user is using the Apple Mail program on OS X to check mail. And, he is checking mail every one minute. (yeah, I know...but what can I do?) It seems that most of his connections work fine, but then, for whatever reason, he gets an error about his password being incorrect. This seems to be when the server takes off and creates a huge load. I'm really getting concerned now because when the server is left alone for a few hours, it gets to be out of control. If there is any additional info anyone would like to see, please let me know...I'd like to help figure this one out! Thanks again... -- Jason on 5/17/03 2:23 AM, Eelco van Beek - IC&S at [EMAIL PROTECTED] wrote: > The most important thing pop & imap share is the connection handling > code. Roel is checking that out for bugs. > > Best regards, > > eelco > > > On zaterdag, mei 17, 2003, at 04:22 Europe/Amsterdam, Chris Nolan wrote: > >> Hi all, >> >> I am having an extremely similar problem with dbmail-imapd (running >> dbmail 1.1). And, to simplify things somewhat, I can tell you a bit >> about the problem. >> >> 1. MySQL is *not* the cause of this problem. I am using MySQL 4.0.12 >> and killing dbmail-imapd very quickly brings the load average down. >> 2. The load average grows linearly, so one day after having >> dbmail-imapd running, the load average will read "1.00 1.00 1.00", the >> second day "2.00 2.00 2.00" the third day "3.00 3.00 3.00" etc. >> 3. I am running Mandrake 9.0 (one of the last glibc 2.2-based distros). >> 4. DBMail very happily maxes out MySQL's connection pool. I'm betting >> this has something to do with it (trying to connect from any other >> machine with any MySQL client or another DBMail instance will always >> fail after dbmail-imapd has been running for a few days). >> 5. I have many indexes and foreign key constraints in place as have >> been suggested on this list. >> 6. I only have 8 people using this server - 6 with IMAP clients and 2 >> with POP3 clients. >> 7. SquirrelMail's performance degrades as the load average goes up, >> and massively. It takes 10 seconds to render each frame due to the >> IMAP side of things being so heavily choked. >> >> If anyone has any other questions or any suggestion as to where the >> problem is in the source (I'm a 4th year Software Engineering student >> at a uni where C is the primary language and Unix is the primary >> platform) I'll have a go at fixing it. >> >> Interestingly, Roel said that they only get this problem every few >> months with some of their customer sites >> >> Chris >> >> lou wrote: >> >>> In some email I received from Jason Burfield <[EMAIL PROTECTED]> on >>> 16 May 2003 14:54:16 >>> -0400, wrote: >>> >>> Hi jason, >>> did you try to attach a debugger to the process? >>> in any way if you can get us dump image off the process that would be >>> great. >>> >>> kill -ABRT >>> should make the process exit with a core dump. >>> >>> anyway, might be an infinite loop or something? >>> >>> cheers. >>> >>> >>> It's dbmail-pop3d. Currently TOP is showing this: PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 21088 root 15 0 564 564 500 S99.9 0.0 181:42 dbmail-pop3d The database currently has all proper indexes...and it does not seem to be a MySQL issue at all. And, the load average continues to grow the longer that dbmail-pop3d continues to run. It is currently at 11.57 This is the highest I personally have EVER seen one of my machines go. Also, when I check the maillog it does not seem to be doing anything out of the ordinary. It almost looks like one child process has just run off and refuses to stop...but the log is not showing tons of stuff going on. I'm totally freaked and confused now! Thanks! -- Jason On Fri, 2003-05-16 at 14:39, Aaron Stone wrote: > When you run top, do you find that most of the CPU time is being > taken by > dbmail-pop3d itself, or by mysqld? In the latter case, you may do > well to > tune the database a bit in my.cnf, and to add the indices posted to > the > list a couple of times. If it's pop3d.. umm... sounds bad, post > more info! > > Aaron > > > On 16 May 2003, Jason Burfield wrote: > > >> I have searched through back messages and found one thread w
Re: [Dbmail] High Load Average and dbmail-pop3d ?
go through the logs and find where he's getting an invalid PW error, if you have the trace level set to 5 it should provide some usefull information there. Post that bit if you can maybe others can help. I would restart the pop server and purposely log in with an incorrect password too to see what happens. I know I have at least 1 OSX user and this isn't a problem, I'm using a CVS from February though. -Micah On Saturday 17 May 2003 3:30 pm, Jason Burfield wrote: > Another quick follow-up... > > My server just freaked and ran up to a load average over 32.00. That is out > of control! Wow! > > There were 30 dbmail-pop3d processes all carrying a load. I killed the > server and then with a copy of the log file, traced each of the pids back. > > Every single one of them ended with: > > --- > May 17 17:31:21 vault dbmail/pop3d[24001]: auth_md5_validate(): user > [EMAIL PROTECTED] could not be validated > --- > > Obviously, the address has been changed. > > I found that this user is using the Apple Mail program on OS X to check > mail. And, he is checking mail every one minute. (yeah, I know...but what > can I do?) > > It seems that most of his connections work fine, but then, for whatever > reason, he gets an error about his password being incorrect. > > This seems to be when the server takes off and creates a huge load. > > I'm really getting concerned now because when the server is left alone for > a few hours, it gets to be out of control. > > If there is any additional info anyone would like to see, please let me > know...I'd like to help figure this one out! > > Thanks again... > > -- Jason > > on 5/17/03 2:23 AM, Eelco van Beek - IC&S at [EMAIL PROTECTED] wrote: > > The most important thing pop & imap share is the connection handling > > code. Roel is checking that out for bugs. > > > > Best regards, > > > > eelco > > > > On zaterdag, mei 17, 2003, at 04:22 Europe/Amsterdam, Chris Nolan wrote: > >> Hi all, > >> > >> I am having an extremely similar problem with dbmail-imapd (running > >> dbmail 1.1). And, to simplify things somewhat, I can tell you a bit > >> about the problem. > >> > >> 1. MySQL is *not* the cause of this problem. I am using MySQL 4.0.12 > >> and killing dbmail-imapd very quickly brings the load average down. > >> 2. The load average grows linearly, so one day after having > >> dbmail-imapd running, the load average will read "1.00 1.00 1.00", the > >> second day "2.00 2.00 2.00" the third day "3.00 3.00 3.00" etc. > >> 3. I am running Mandrake 9.0 (one of the last glibc 2.2-based distros). > >> 4. DBMail very happily maxes out MySQL's connection pool. I'm betting > >> this has something to do with it (trying to connect from any other > >> machine with any MySQL client or another DBMail instance will always > >> fail after dbmail-imapd has been running for a few days). > >> 5. I have many indexes and foreign key constraints in place as have > >> been suggested on this list. > >> 6. I only have 8 people using this server - 6 with IMAP clients and 2 > >> with POP3 clients. > >> 7. SquirrelMail's performance degrades as the load average goes up, > >> and massively. It takes 10 seconds to render each frame due to the > >> IMAP side of things being so heavily choked. > >> > >> If anyone has any other questions or any suggestion as to where the > >> problem is in the source (I'm a 4th year Software Engineering student > >> at a uni where C is the primary language and Unix is the primary > >> platform) I'll have a go at fixing it. > >> > >> Interestingly, Roel said that they only get this problem every few > >> months with some of their customer sites > >> > >> Chris > >> > >> lou wrote: > >>> In some email I received from Jason Burfield <[EMAIL PROTECTED]> on > >>> 16 May 2003 14:54:16 > >>> -0400, wrote: > >>> > >>> Hi jason, > >>> did you try to attach a debugger to the process? > >>> in any way if you can get us dump image off the process that would be > >>> great. > >>> > >>> kill -ABRT > >>> should make the process exit with a core dump. > >>> > >>> anyway, might be an infinite loop or something? > >>> > >>> cheers. > >>> > It's dbmail-pop3d. > > Currently TOP is showing this: > > PIDUSER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND > 21088 root 15 0 564 564 500 S99.9 0.0 181:42 > dbmail-pop3d > > The database currently has all proper indexes...and it does not seem > to > be a MySQL issue at all. > > And, the load average continues to grow the longer that dbmail-pop3d > continues to run. > > It is currently at 11.57 > > This is the highest I personally have EVER seen one of my machines > go. > > Also, when I check the maillog it does not seem to be doing anything > out > of the ordinary. It almost looks like one child process has just run > off > and refuses to stop...but the log is not showing tons of stuff going > >>
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Well...I have found one thing that is interesting... With the trace_level set to 5, I do NOT have any problems at all. However, at 0,1,2,3 or 4 I have problems. Does this make any sense to anyone? The most I can get in a log file is at trace_level=4 and it is just this: --- May 19 17:18:51 vault dbmail/pop3d[24695]: PerformChildTask(): incoming connection from [xx.xxx.xxx.xx] May 29 17:18:51 vault dbmail/pop3d[24695]: user [EMAIL PROTECTED] could not be validated --- At this point it seems to go into a loop or something, using up all processor ticks and NOT returning an error to the user. When I go in and issue 'killall dbmail-pop3d' is when the user gets a 'password incorrect' message on his/her screen. So far it will not freak out when it's at trace_level 5, but then the logs are huge. I'm still baffled. Thanks... -- Jason On Sun, 2003-05-18 at 13:34, Micah Stevens wrote: > go through the logs and find where he's getting an invalid PW error, if you > have the trace level set to 5 it should provide some usefull information > there. Post that bit if you can maybe others can help. > > I would restart the pop server and purposely log in with an incorrect > password > too to see what happens. > > I know I have at least 1 OSX user and this isn't a problem, I'm using a CVS > from February though. > > -Micah > > > On Saturday 17 May 2003 3:30 pm, Jason Burfield wrote: > > Another quick follow-up... > > > > My server just freaked and ran up to a load average over 32.00. That is out > > of control! Wow! > > > > There were 30 dbmail-pop3d processes all carrying a load. I killed the > > server and then with a copy of the log file, traced each of the pids back. > > > > Every single one of them ended with: > > > > -- > > May 17 17:31:21 vault dbmail/pop3d[24001]: auth_md5_validate(): user > > [EMAIL PROTECTED] could not be validated > > -- > > > > Obviously, the address has been changed. > > > > I found that this user is using the Apple Mail program on OS X to check > > mail. And, he is checking mail every one minute. (yeah, I know...but what > > can I do?) > > > > It seems that most of his connections work fine, but then, for whatever > > reason, he gets an error about his password being incorrect. > > > > This seems to be when the server takes off and creates a huge load. > > > > I'm really getting concerned now because when the server is left alone for > > a few hours, it gets to be out of control. > > > > If there is any additional info anyone would like to see, please let me > > know...I'd like to help figure this one out! > > > > Thanks again... > > > > -- Jason > > > > on 5/17/03 2:23 AM, Eelco van Beek - IC&S at [EMAIL PROTECTED] wrote: > > > The most important thing pop & imap share is the connection handling > > > code. Roel is checking that out for bugs. > > > > > > Best regards, > > > > > > eelco > > > > > > On zaterdag, mei 17, 2003, at 04:22 Europe/Amsterdam, Chris Nolan wrote: > > >> Hi all, > > >> > > >> I am having an extremely similar problem with dbmail-imapd (running > > >> dbmail 1.1). And, to simplify things somewhat, I can tell you a bit > > >> about the problem. > > >> > > >> 1. MySQL is *not* the cause of this problem. I am using MySQL 4.0.12 > > >> and killing dbmail-imapd very quickly brings the load average down. > > >> 2. The load average grows linearly, so one day after having > > >> dbmail-imapd running, the load average will read "1.00 1.00 1.00", the > > >> second day "2.00 2.00 2.00" the third day "3.00 3.00 3.00" etc. > > >> 3. I am running Mandrake 9.0 (one of the last glibc 2.2-based distros). > > >> 4. DBMail very happily maxes out MySQL's connection pool. I'm betting > > >> this has something to do with it (trying to connect from any other > > >> machine with any MySQL client or another DBMail instance will always > > >> fail after dbmail-imapd has been running for a few days). > > >> 5. I have many indexes and foreign key constraints in place as have > > >> been suggested on this list. > > >> 6. I only have 8 people using this server - 6 with IMAP clients and 2 > > >> with POP3 clients. > > >> 7. SquirrelMail's performance degrades as the load average goes up, > > >> and massively. It takes 10 seconds to render each frame due to the > > >> IMAP side of things being so heavily choked. > > >> > > >> If anyone has any other questions or any suggestion as to where the > > >> problem is in the source (I'm a 4th year Software Engineering student > > >> at a uni where C is the primary language and Unix is the primary > > >> platform) I'll have a go at fixing it. > > >> > > >> Interestingly, Roel said that they only get this problem every few > > >> months with some of their customer sites > > >> > > >> Chris > > >> > > >> lou wrote: > > >>> In some email I received from Jason Burfield <[EMAIL PROTECTED]> on > > >>> 16 May 2003 14:54:16 > > >>> -0400, wrote: > > >>> > > >>> Hi jason, > > >>> did you try to attach a debugger to the process? > > >>> in
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Hello Jason, An earlier post showed auth_md5_validate() in the logs, which is what does APOP validation - this time, no mention. Can you forward the logs at trace level 5 (when the problem "should" happen). Are you using APOP or not? (Maybe after running through APOP command a variable is reused for USER/PASS without initialization or something.) Also, I assume the user(s) this happens for does have the password saved correctly, as this doesn't happen 100% of the time? Or do they manually enter it (ie. sometime it'll be right, sometimes not)? Jesse Original Message From: Jason Burfield To: dbmail@dbmail.org Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? Sent: 19 May 2003 17:24:21 -0400 > Well...I have found one thing that is interesting... > > With the trace_level set to 5, I do NOT have any problems at all. > However, at 0,1,2,3 or 4 I have problems. > > Does this make any sense to anyone? > > The most I can get in a log file is at trace_level=4 and it is just > this: > > --- > May 19 17:18:51 vault dbmail/pop3d[24695]: PerformChildTask(): incoming > connection from [xx.xxx.xxx.xx] > May 29 17:18:51 vault dbmail/pop3d[24695]: user [EMAIL PROTECTED] could > not be validated > --- > > At this point it seems to go into a loop or something, using up all > processor ticks and NOT returning an error to the user. > > When I go in and issue 'killall dbmail-pop3d' is when the user gets a > 'password incorrect' message on his/her screen. > > So far it will not freak out when it's at trace_level 5, but then the > logs are huge. > > I'm still baffled. > > Thanks... > > -- Jason > > > On Sun, 2003-05-18 at 13:34, Micah Stevens wrote: > > go through the logs and find where he's getting an invalid PW error, if you > > have the trace level set to 5 it should provide some usefull information > > there. Post that bit if you can maybe others can help. > > > > I would restart the pop server and purposely log in with an incorrect > > password > > too to see what happens. > > > > I know I have at least 1 OSX user and this isn't a problem, I'm using a CVS > > from February though. > > > > -Micah > > > > > > On Saturday 17 May 2003 3:30 pm, Jason Burfield wrote: > > > Another quick follow-up... > > > > > > My server just freaked and ran up to a load average over 32.00. That is > > > out > > > of control! Wow! > > > > > > There were 30 dbmail-pop3d processes all carrying a load. I killed the > > > server and then with a copy of the log file, traced each of the pids back. > > > > > > Every single one of them ended with: > > > > > > -- > > > May 17 17:31:21 vault dbmail/pop3d[24001]: auth_md5_validate(): user > > > [EMAIL PROTECTED] could not be validated > > > -- > > > > > > Obviously, the address has been changed. > > > > > > I found that this user is using the Apple Mail program on OS X to check > > > mail. And, he is checking mail every one minute. (yeah, I know...but what > > > can I do?) > > > > > > It seems that most of his connections work fine, but then, for whatever > > > reason, he gets an error about his password being incorrect. > > > > > > This seems to be when the server takes off and creates a huge load. > > > > > > I'm really getting concerned now because when the server is left alone for > > > a few hours, it gets to be out of control. > > > > > > If there is any additional info anyone would like to see, please let me > > > know...I'd like to help figure this one out! > > > > > > Thanks again... > > > > > > -- Jason > > > > > > on 5/17/03 2:23 AM, Eelco van Beek - IC&S at [EMAIL PROTECTED] wrote: > > > > The most important thing pop & imap share is the connection handling > > > > code. Roel is checking that out for bugs. > > > > > > > > Best regards, > > > > > > > > eelco > > > > > > > > On zaterdag, mei 17, 2003, at 04:22 Europe/Amsterdam, Chris Nolan wrote: > > > >> Hi all, > > > >> > > > >> I am having an extremely similar problem with dbmail-imapd (running > > > >> dbmail 1.1). And, to simplify things somewhat, I can tell you a bit > > > >> about the problem. > > > >> > > > >> 1. MySQL is *not* the cause of this problem. I am using MySQL 4.
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Jesse... Some are using APOP, some are not. And, it finally crapped out with a trace_level of 5 as well...here is the relevant log info from that session: --- May 19 18:47:27 vault dbmail/pop3d[25871]: PerformChildTask(): waiting for connection May 19 18:57:25 vault dbmail/pop3d[25871]: PerformChildTask(): incoming connection from [141.155.157.55] May 19 18:57:25 vault dbmail/pop3d[25871]: PerformChildTask(): client info init complete, calling client handler May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): incoming buffer: [APOP [EMAIL PROTECTED] e9624c82649cacdf5b9905391b07d4d3] May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): command issued :cmd [APOP], value [EMAIL PROTECTED] e9624c82649cacdf5b9905391b07d4d3] May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): command looked up as commandtype 11 May 19 18:57:27 vault dbmail/pop3d[25871]: __auth_query(): executing query [SELECT user_idnr FROM users WHERE userid='[EMAIL PROTECTED]'] May 19 18:57:27 vault dbmail/pop3d[25871]: __auth_query(): executing query [SELECT encryption_type FROM users WHERE user_idnr = 78] May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username [EMAIL PROTECTED], md5_hash [EMAIL PROTECTED] May 19 18:57:27 vault dbmail/pop3d[25871]: __auth_query(): executing query [SELECT passwd,user_idnr FROM users WHERE userid="[EMAIL PROTECTED]"] May 19 18:57:27 vault dbmail/pop3d[25871]: auth_md5_validate(): apop_stamp=[<[EMAIL PROTECTED]>], userpw=[pass] May 19 18:57:27 vault dbmail/pop3d[25871]: auth_md5_validate(): checkstring for md5 [<[EMAIL PROTECTED]>pass] -> result [e9624c82649cacdf5b9905391b07d4d3] May 19 18:57:27 vault dbmail/pop3d[25871]: auth_md5_validate(): validating md5_apop_we=[e9624c82649cacdf5b9905391b07d4d3] md5_apop_he=[<[EMAIL PROTECTED]>pass] May 19 18:57:27 vault dbmail/pop3d[25871]: auth_md5_validate(): user [EMAIL PROTECTED] could not be validated --- That is everything for that PID for that specific user, which is what caused it to take off again. Up to that point that same PID was handling connections with no problems. That same process actually handled this same user logging in several times before, with no problems. I have had it happen with a few different users, but this specific user seems to have it happen a lot. He has his password set correctly and all other info is set correctly as well. He can log in and get mail several times, then all of a sudden this happens. We are using usernames in the form of '[EMAIL PROTECTED]' but I wouldn't think this would make a difference to dbmail would it? Is this helping at all? Any additional info that would help I can get... Again, many thanks! -- Jason On Mon, 2003-05-19 at 17:36, Jesse Norell wrote: > Hello Jason, > > An earlier post showed auth_md5_validate() in the logs, which is > what does APOP validation - this time, no mention. Can you forward > the logs at trace level 5 (when the problem "should" happen). Are > you using APOP or not? (Maybe after running through APOP command > a variable is reused for USER/PASS without initialization or > something.) Also, I assume the user(s) this happens for does have > the password saved correctly, as this doesn't happen 100% of the time? > Or do they manually enter it (ie. sometime it'll be right, sometimes > not)? > > Jesse > > Original Message > From: Jason Burfield > To: dbmail@dbmail.org > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > Sent: 19 May 2003 17:24:21 -0400 > > > Well...I have found one thing that is interesting... > > > > With the trace_level set to 5, I do NOT have any problems at all. > > However, at 0,1,2,3 or 4 I have problems. > > > > Does this make any sense to anyone? > > > > The most I can get in a log file is at trace_level=4 and it is just > > this: > > > > --- > > May 19 17:18:51 vault dbmail/pop3d[24695]: PerformChildTask(): incoming > > connection from [xx.xxx.xxx.xx] > > May 29 17:18:51 vault dbmail/pop3d[24695]: user [EMAIL PROTECTED] could > > not be validated > > --- > > > > At this point it seems to go into a loop or something, using up all > > processor ticks and NOT returning an error to the user. > > > > When I go in and issue 'killall dbmail-pop3d' is when the user gets a > > 'password incorrect' message on his/her screen. > > > > So far it will not freak out when it's at trace_level 5, but then the > > logs are huge. > > > > I'm still baffled. > > > > Thanks... > > > > -- Jason > > > > > > On Sun, 2003-05-18 at 13:34, Micah Stevens wrote: > > > go through the logs and find where he's getting an invalid PW error, if > >
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Hello, Right off, this looks quite suspect: > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username > [EMAIL PROTECTED], md5_hash [EMAIL PROTECTED] There are invalid characters in that md5 hash - the variable is probably getting walked on somewhere. I'll see if I can find anything obvious from the code. Is this a pretty busy server? Can you look at the logs and try to determine if this only happenes when there are multiple users simultaneously authenticating? Also, for testing, see if setting MAXCONNECTS to 1 in dbmail.conf makes the problem go away. -- Jesse Norell jesse (at) kci.net
Re: [Dbmail] High Load Average and dbmail-pop3d ?
If setting the maxconnect=1 does fix the problem, its quite possibly a side affect of the patch I made an believe I sent to the list a while back, and recently sent to Jason upon request for apop authentication. APOP has no password associated with it, and the dbmail-pop3d has a state machine that if there is not a valid username and password, it will always fail the connection. This was causing anyone using apop to have problems for us, so my fix (search the archives for the patch) was to set the session->password on an apop connection = the apop hash This works for me, but I always have maxconnect=1 since the previous bug about disconnecting in the middle of a session sent your mail to the next person who connected to that process bug... On Tue, 2003-05-20 at 09:51, Jesse Norell wrote: > Hello, > > Right off, this looks quite suspect: > > > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username > > [EMAIL PROTECTED], md5_hash [EMAIL PROTECTED] > > There are invalid characters in that md5 hash - the variable is > probably getting walked on somewhere. I'll see if I can find anything > obvious from the code. Is this a pretty busy server? Can you look at > the logs and try to determine if this only happenes when there are > multiple users simultaneously authenticating? Also, for testing, see > if setting MAXCONNECTS to 1 in dbmail.conf makes the problem go away. > > > > -- > Jesse Norell > jesse (at) kci.net > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail signature.asc Description: This is a digitally signed message part
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Hmm... Jason, you running non-standard code? :) I've looked all through the pop3 code for md5 from today's cvs, and I don't see anything that would be a problem - my next questions were going to be along the lines of questioning your libc, because you've got values printing out in variables that are for other things (eg. in md5_apop_he=[<[EMAIL PROTECTED]>pass] - that variable should only contain an md5 hash, not the apop_stamp+password). Original Message From: Ryan Butler To: dbmail@dbmail.org Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? Sent: 20 May 2003 11:14:02 -0500 > If setting the maxconnect=1 does fix the problem, its quite possibly a > side affect of the patch I made an believe I sent to the list a while > back, and recently sent to Jason upon request for apop authentication. > > APOP has no password associated with it, and the dbmail-pop3d has a > state machine that if there is not a valid username and password, it > will always fail the connection. This was causing anyone using apop to > have problems for us, so my fix (search the archives for the patch) was > to set the session->password on an apop connection = the apop hash > > This works for me, but I always have maxconnect=1 since the previous bug > about disconnecting in the middle of a session sent your mail to the > next person who connected to that process bug... > > > On Tue, 2003-05-20 at 09:51, Jesse Norell wrote: > > Hello, > > > > Right off, this looks quite suspect: > > > > > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username > > > [EMAIL PROTECTED], md5_hash [EMAIL PROTECTED] > > > > There are invalid characters in that md5 hash - the variable is > > probably getting walked on somewhere. I'll see if I can find anything > > obvious from the code. Is this a pretty busy server? Can you look at > > the logs and try to determine if this only happenes when there are > > multiple users simultaneously authenticating? Also, for testing, see > > if setting MAXCONNECTS to 1 in dbmail.conf makes the problem go away. > > > > > > > > -- > > Jesse Norell > > jesse (at) kci.net > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > -- End Original Message -- -- Jesse Norell jesse (at) kci.net
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Hello, Perhaps this is a problem with SIGPIPE from the fflush(ci->tx) on line 158 of pop3.c (in pop3_handle_connection()). I'll have to dig up Ryan's patch and look at it. The current signal handler should call _exit(1) on SIGPIPE, which is pretty hard to screw up :), but if yours doesn't do that, perhaps you're experiencing the same behavior noted in ChildSigHandler: serverchild.c: line 122-ish /* * For some reason i have not yet determined the process starts eating up * all CPU time when trying to disconnect. * For now: just bail out :-) */ _exit(1); Jesse Original Message From: Jason Burfield To: dbmail@dbmail.org Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? Sent: 19 May 2003 19:41:49 -0400 > Jesse... > > Some are using APOP, some are not. > > And, it finally crapped out with a trace_level of 5 as well...here is > the relevant log info from that session: > > --- > May 19 18:47:27 vault dbmail/pop3d[25871]: PerformChildTask(): waiting > for connection > May 19 18:57:25 vault dbmail/pop3d[25871]: PerformChildTask(): incoming > connection from [141.155.157.55] > May 19 18:57:25 vault dbmail/pop3d[25871]: PerformChildTask(): client > info init complete, calling client handler > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): incoming buffer: > [APOP [EMAIL PROTECTED] e9624c82649cacdf5b9905391b07d4d3] > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): command issued :cmd > [APOP], value [EMAIL PROTECTED] e9624c82649cacdf5b9905391b07d4d3] > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): command looked up as > commandtype 11 > May 19 18:57:27 vault dbmail/pop3d[25871]: __auth_query(): executing > query [SELECT user_idnr FROM users WHERE userid='[EMAIL PROTECTED]'] > May 19 18:57:27 vault dbmail/pop3d[25871]: __auth_query(): executing > query [SELECT encryption_type FROM users WHERE user_idnr = 78] > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username > [EMAIL PROTECTED], md5_hash [EMAIL PROTECTED] > May 19 18:57:27 vault dbmail/pop3d[25871]: __auth_query(): executing > query [SELECT passwd,user_idnr FROM users WHERE > userid="[EMAIL PROTECTED]"] > May 19 18:57:27 vault dbmail/pop3d[25871]: auth_md5_validate(): > apop_stamp=[<[EMAIL PROTECTED]>], userpw=[pass] > May 19 18:57:27 vault dbmail/pop3d[25871]: auth_md5_validate(): > checkstring for md5 [<[EMAIL PROTECTED]>pass] -> result > [e9624c82649cacdf5b9905391b07d4d3] > May 19 18:57:27 vault dbmail/pop3d[25871]: auth_md5_validate(): > validating md5_apop_we=[e9624c82649cacdf5b9905391b07d4d3] > md5_apop_he=[<[EMAIL PROTECTED]>pass] > May 19 18:57:27 vault dbmail/pop3d[25871]: auth_md5_validate(): user > [EMAIL PROTECTED] could not be validated > --- > > > That is everything for that PID for that specific user, which is what > caused it to take off again. > > Up to that point that same PID was handling connections with no > problems. > > That same process actually handled this same user logging in several > times before, with no problems. > > I have had it happen with a few different users, but this specific user > seems to have it happen a lot. He has his password set correctly and all > other info is set correctly as well. He can log in and get mail several > times, then all of a sudden this happens. > > We are using usernames in the form of '[EMAIL PROTECTED]' but I wouldn't > think this would make a difference to dbmail would it? > > Is this helping at all? Any additional info that would help I can get... > > Again, many thanks! > > -- Jason > > > On Mon, 2003-05-19 at 17:36, Jesse Norell wrote: > > Hello Jason, > > > > An earlier post showed auth_md5_validate() in the logs, which is > > what does APOP validation - this time, no mention. Can you forward > > the logs at trace level 5 (when the problem "should" happen). Are > > you using APOP or not? (Maybe after running through APOP command > > a variable is reused for USER/PASS without initialization or > > something.) Also, I assume the user(s) this happens for does have > > the password saved correctly, as this doesn't happen 100% of the time? > > Or do they manually enter it (ie. sometime it'll be right, sometimes > > not)? > > > > Jesse > > > > Original Message > > From: Jason Burfield > > To: dbmail@dbmail.org > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > > Sent: 19 May 2003 17:24:21 -0400 > > > > > Well...I have found one thing that is interesting... > > > > > > With the trace_level set to 5, I do NOT ha
Re: [Dbmail] High Load Average and dbmail-pop3d ?
Yeah, I am using that patch that Ryan supplied. Without it all my clients were getting multiple copies of each email. The server really is not that busy. There are about 300 total email addresses handled by the machine with only about 75 or so using POP to actually check for mail. The rest forward off to different places. During the last few times that it took off, there was only one connection to the server. The one before it was 10 seconds before. I set the MAXCONNECTS to 1 and still have the problem. Unfortunately. Also, I know this is strange, but it's true...I have a client that can cause this situation to happen on demand by supplying an incorrect password for his account. HOWEVER, at trace_level 5 it does not happen frequently at all. I just set the trace_level to 1 and had him send an incorrect password, dbmail-pop3d immediately took off on the machine. I then changed the trace_level to 5 and had him try it again, this time it did not run away like it did before. I'm running glibc-2.3.2-4.80 which I believe is standard RedHat 8. I saw the wrong hash being passed in and tried to figure out where it was coming from, but I'm by no means a C programmer so I wasn't having much luck. :o Is there any additional info I should pass along? I was going to try the latest daily snapshot, would that be worth a try you think? However, I would still need Ryan's patch to keep clients from freaking out on me about the multiple copies of each email... Again..thanks for all the help! -- Jason On Tue, 2003-05-20 at 12:33, Jesse Norell wrote: > Hmm... > > Jason, you running non-standard code? :) I've looked all through > the pop3 code for md5 from today's cvs, and I don't see anything > that would be a problem - my next questions were going to be along > the lines of questioning your libc, because you've got values printing > out in variables that are for other things (eg. in > md5_apop_he=[<[EMAIL PROTECTED]>pass] - that variable should > only contain an md5 hash, not the apop_stamp+password). > > > ---- Original Message > From: Ryan Butler > To: dbmail@dbmail.org > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > Sent: 20 May 2003 11:14:02 -0500 > > > If setting the maxconnect=1 does fix the problem, its quite possibly a > > side affect of the patch I made an believe I sent to the list a while > > back, and recently sent to Jason upon request for apop authentication. > > > > APOP has no password associated with it, and the dbmail-pop3d has a > > state machine that if there is not a valid username and password, it > > will always fail the connection. This was causing anyone using apop to > > have problems for us, so my fix (search the archives for the patch) was > > to set the session->password on an apop connection = the apop hash > > > > This works for me, but I always have maxconnect=1 since the previous bug > > about disconnecting in the middle of a session sent your mail to the > > next person who connected to that process bug... > > > > > > On Tue, 2003-05-20 at 09:51, Jesse Norell wrote: > > > Hello, > > > > > > Right off, this looks quite suspect: > > > > > > > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username > > > > [EMAIL PROTECTED], md5_hash [EMAIL PROTECTED] > > > > > > There are invalid characters in that md5 hash - the variable is > > > probably getting walked on somewhere. I'll see if I can find anything > > > obvious from the code. Is this a pretty busy server? Can you look at > > > the logs and try to determine if this only happenes when there are > > > multiple users simultaneously authenticating? Also, for testing, see > > > if setting MAXCONNECTS to 1 in dbmail.conf makes the problem go away. > > > > > > > > > > > > -- > > > Jesse Norell > > > jesse (at) kci.net > > > > > > ___ > > > Dbmail mailing list > > > Dbmail@dbmail.org > > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > > -- End Original Message -- > > > -- > Jesse Norell > jesse (at) kci.net > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail >
Re: [Dbmail] High Load Average and dbmail-pop3d ?
It sounds to me like the patch is allocating memory and not full free()ing it at the end of the session... Ryan, if you can post your patch again, we can give it a quick audit. In the mean time, if this is a configuration that won't work in the standard code without a patch, then let's make sure that patch gets applied to CVS! Aaron On 20 May 2003, Jason Burfield wrote: > Yeah, I am using that patch that Ryan supplied. Without it all my > clients were getting multiple copies of each email. > > The server really is not that busy. There are about 300 total email > addresses handled by the machine with only about 75 or so using POP to > actually check for mail. The rest forward off to different places. > > During the last few times that it took off, there was only one > connection to the server. The one before it was 10 seconds before. > > I set the MAXCONNECTS to 1 and still have the problem. Unfortunately. > > Also, I know this is strange, but it's true...I have a client that can > cause this situation to happen on demand by supplying an incorrect > password for his account. HOWEVER, at trace_level 5 it does not happen > frequently at all. > > I just set the trace_level to 1 and had him send an incorrect password, > dbmail-pop3d immediately took off on the machine. I then changed the > trace_level to 5 and had him try it again, this time it did not run away > like it did before. > > I'm running glibc-2.3.2-4.80 which I believe is standard RedHat 8. > > I saw the wrong hash being passed in and tried to figure out where it > was coming from, but I'm by no means a C programmer so I wasn't having > much luck. :o > > Is there any additional info I should pass along? > > I was going to try the latest daily snapshot, would that be worth a try > you think? However, I would still need Ryan's patch to keep clients from > freaking out on me about the multiple copies of each email... > > Again..thanks for all the help! > > -- Jason > > > On Tue, 2003-05-20 at 12:33, Jesse Norell wrote: > > Hmm... > > > > Jason, you running non-standard code? :) I've looked all through > > the pop3 code for md5 from today's cvs, and I don't see anything > > that would be a problem - my next questions were going to be along > > the lines of questioning your libc, because you've got values printing > > out in variables that are for other things (eg. in > > md5_apop_he=[<[EMAIL PROTECTED]>pass] - that variable should > > only contain an md5 hash, not the apop_stamp+password). > > > > > > Original Message > > From: Ryan Butler > > To: dbmail@dbmail.org > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > > Sent: 20 May 2003 11:14:02 -0500 > > > > > If setting the maxconnect=1 does fix the problem, its quite possibly a > > > side affect of the patch I made an believe I sent to the list a while > > > back, and recently sent to Jason upon request for apop authentication. > > > > > > APOP has no password associated with it, and the dbmail-pop3d has a > > > state machine that if there is not a valid username and password, it > > > will always fail the connection. This was causing anyone using apop to > > > have problems for us, so my fix (search the archives for the patch) was > > > to set the session->password on an apop connection = the apop hash > > > > > > This works for me, but I always have maxconnect=1 since the previous bug > > > about disconnecting in the middle of a session sent your mail to the > > > next person who connected to that process bug... > > > > > > > > > On Tue, 2003-05-20 at 09:51, Jesse Norell wrote: > > > > Hello, > > > > > > > > Right off, this looks quite suspect: > > > > > > > > > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username > > > > > [EMAIL PROTECTED], md5_hash [EMAIL PROTECTED] > > > > > > > > There are invalid characters in that md5 hash - the variable is > > > > probably getting walked on somewhere. I'll see if I can find anything > > > > obvious from the code. Is this a pretty busy server? Can you look at > > > > the logs and try to determine if this only happenes when there are > > > > multiple users simultaneously authenticating? Also, for testing, see > > > > if setting MAXCONNECTS to 1 in dbmail.conf makes the problem go away. > > > > > > > > > > > > > > > > -- > > > > Jesse Norell > > > > jesse (at) kci.net > > > > > > > > ___ > > > > Dbmail mailing list > > > > Dbmail@dbmail.org > > > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > > > > > -- End Original Message -- > > > > > > -- > > Jesse Norell > > jesse (at) kci.net > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail >
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Hello Jason, After a little discussion with Ryan, the purpose of his patch was to fix the pop3 state machine when returning from apop (which has no plaintext password, creating a problem with a check for password!=NULL at a point), but it created a double free() of a pointer. According to the man page, that creates undefined behavior, which for Ryan seems to be working fine, but for you is quite nasty. :) The attached patch handles that case in the state machine, as well as checking a couple lengths (and fixing a buffer overrun with long USER arg) ... it seems to work fine in a small amount of testing, but give it a try and see if it fixes your problem, etc. Please report back with your results, as this is something that needs to be fixed in cvs code. (Download latest cvs code, and don't use Ryan's patch with this.) Later, Jesse Original Message From: Jason Burfield To: dbmail@dbmail.org Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? Sent: 20 May 2003 13:34:47 -0400 > Yeah, I am using that patch that Ryan supplied. Without it all my > clients were getting multiple copies of each email. > > The server really is not that busy. There are about 300 total email > addresses handled by the machine with only about 75 or so using POP to > actually check for mail. The rest forward off to different places. > > During the last few times that it took off, there was only one > connection to the server. The one before it was 10 seconds before. > > I set the MAXCONNECTS to 1 and still have the problem. Unfortunately. > > Also, I know this is strange, but it's true...I have a client that can > cause this situation to happen on demand by supplying an incorrect > password for his account. HOWEVER, at trace_level 5 it does not happen > frequently at all. > > I just set the trace_level to 1 and had him send an incorrect password, > dbmail-pop3d immediately took off on the machine. I then changed the > trace_level to 5 and had him try it again, this time it did not run away > like it did before. > > I'm running glibc-2.3.2-4.80 which I believe is standard RedHat 8. > > I saw the wrong hash being passed in and tried to figure out where it > was coming from, but I'm by no means a C programmer so I wasn't having > much luck. :o > > Is there any additional info I should pass along? > > I was going to try the latest daily snapshot, would that be worth a try > you think? However, I would still need Ryan's patch to keep clients from > freaking out on me about the multiple copies of each email... > > Again..thanks for all the help! > > -- Jason > > > On Tue, 2003-05-20 at 12:33, Jesse Norell wrote: > > Hmm... > > > > Jason, you running non-standard code? :) I've looked all through > > the pop3 code for md5 from today's cvs, and I don't see anything > > that would be a problem - my next questions were going to be along > > the lines of questioning your libc, because you've got values printing > > out in variables that are for other things (eg. in > > md5_apop_he=[<[EMAIL PROTECTED]>pass] - that variable should > > only contain an md5 hash, not the apop_stamp+password). > > > > > > Original Message > > From: Ryan Butler > > To: dbmail@dbmail.org > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > > Sent: 20 May 2003 11:14:02 -0500 > > > > > If setting the maxconnect=1 does fix the problem, its quite possibly a > > > side affect of the patch I made an believe I sent to the list a while > > > back, and recently sent to Jason upon request for apop authentication. > > > > > > APOP has no password associated with it, and the dbmail-pop3d has a > > > state machine that if there is not a valid username and password, it > > > will always fail the connection. This was causing anyone using apop to > > > have problems for us, so my fix (search the archives for the patch) was > > > to set the session->password on an apop connection = the apop hash > > > > > > This works for me, but I always have maxconnect=1 since the previous bug > > > about disconnecting in the middle of a session sent your mail to the > > > next person who connected to that process bug... > > > > > > > > > On Tue, 2003-05-20 at 09:51, Jesse Norell wrote: > > > > Hello, > > > > > > > > Right off, this looks quite suspect: > > > > > > > > > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username > > > > > [EMAIL PROTECTED], md5_hash [EMAIL PROTECTED] > > > >
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
[Resending, with patch actually included this time.] Hello Jason, After a little discussion with Ryan, the purpose of his patch was to fix the pop3 state machine when returning from apop (which has no plaintext password, creating a problem with a check for password!=NULL at a point), but it created a double free() of a pointer. According to the man page, that creates undefined behavior, which for Ryan seems to be working fine, but for you is quite nasty. :) The attached patch handles that case in the state machine, as well as checking a couple lengths (and fixing a buffer overrun with long USER arg) ... it seems to work fine in a small amount of testing, but give it a try and see if it fixes your problem, etc. Please report back with your results, as this is something that needs to be fixed in cvs code. (Download latest cvs code, and don't use Ryan's patch with this.) Later, Jesse Original Message From: Jason Burfield To: dbmail@dbmail.org Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? Sent: 20 May 2003 13:34:47 -0400 > Yeah, I am using that patch that Ryan supplied. Without it all my > clients were getting multiple copies of each email. > > The server really is not that busy. There are about 300 total email > addresses handled by the machine with only about 75 or so using POP to > actually check for mail. The rest forward off to different places. > > During the last few times that it took off, there was only one > connection to the server. The one before it was 10 seconds before. > > I set the MAXCONNECTS to 1 and still have the problem. Unfortunately. > > Also, I know this is strange, but it's true...I have a client that can > cause this situation to happen on demand by supplying an incorrect > password for his account. HOWEVER, at trace_level 5 it does not happen > frequently at all. > > I just set the trace_level to 1 and had him send an incorrect password, > dbmail-pop3d immediately took off on the machine. I then changed the > trace_level to 5 and had him try it again, this time it did not run away > like it did before. > > I'm running glibc-2.3.2-4.80 which I believe is standard RedHat 8. > > I saw the wrong hash being passed in and tried to figure out where it > was coming from, but I'm by no means a C programmer so I wasn't having > much luck. :o > > Is there any additional info I should pass along? > > I was going to try the latest daily snapshot, would that be worth a try > you think? However, I would still need Ryan's patch to keep clients from > freaking out on me about the multiple copies of each email... > > Again..thanks for all the help! > > -- Jason > > > On Tue, 2003-05-20 at 12:33, Jesse Norell wrote: > > Hmm... > > > > Jason, you running non-standard code? :) I've looked all through > > the pop3 code for md5 from today's cvs, and I don't see anything > > that would be a problem - my next questions were going to be along > > the lines of questioning your libc, because you've got values printing > > out in variables that are for other things (eg. in > > md5_apop_he=[<[EMAIL PROTECTED]>pass] - that variable should > > only contain an md5 hash, not the apop_stamp+password). > > > > > > Original Message > > From: Ryan Butler > > To: dbmail@dbmail.org > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > > Sent: 20 May 2003 11:14:02 -0500 > > > > > If setting the maxconnect=1 does fix the problem, its quite possibly a > > > side affect of the patch I made an believe I sent to the list a while > > > back, and recently sent to Jason upon request for apop authentication. > > > > > > APOP has no password associated with it, and the dbmail-pop3d has a > > > state machine that if there is not a valid username and password, it > > > will always fail the connection. This was causing anyone using apop to > > > have problems for us, so my fix (search the archives for the patch) was > > > to set the session->password on an apop connection = the apop hash > > > > > > This works for me, but I always have maxconnect=1 since the previous bug > > > about disconnecting in the middle of a session sent your mail to the > > > next person who connected to that process bug... > > > > > > > > > On Tue, 2003-05-20 at 09:51, Jesse Norell wrote: > > > > Hello, > > > > > > > > Right off, this looks quite suspect: > > > > > > > > > May 19 18:57:27 vault dbmail/pop3d[25871]: pop3(): APOP auth, username > > > > > [EMAIL
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Jesse (and everyone!) THANKS MUCH! I just installed this...I'll keep an eye on it for the rest of the day and see how it goes...most likely I can post an update in the morning. Thanks again! It's really appreciated! -- Jason On Tue, 2003-05-20 at 16:07, Jesse Norell wrote: > [Resending, with patch actually included this time.] > > Hello Jason, > > After a little discussion with Ryan, the purpose of his patch was > to fix the pop3 state machine when returning from apop (which has no > plaintext password, creating a problem with a check for password!=NULL > at a point), but it created a double free() of a pointer. According > to the man page, that creates undefined behavior, which for Ryan seems > to be working fine, but for you is quite nasty. :) The attached > patch handles that case in the state machine, as well as checking a > couple lengths (and fixing a buffer overrun with long USER arg) ... it > seems to work fine in a small amount of testing, but give it a try and > see if it fixes your problem, etc. Please report back with your > results, as this is something that needs to be fixed in cvs code. > (Download latest cvs code, and don't use Ryan's patch with this.) > > Later, > Jesse > > > ---- Original Message ---- > From: Jason Burfield > To: dbmail@dbmail.org > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > Sent: 20 May 2003 13:34:47 -0400 > > > Yeah, I am using that patch that Ryan supplied. Without it all my > > clients were getting multiple copies of each email. > > > > The server really is not that busy. There are about 300 total email > > addresses handled by the machine with only about 75 or so using POP to > > actually check for mail. The rest forward off to different places. > > > > During the last few times that it took off, there was only one > > connection to the server. The one before it was 10 seconds before. > > > > I set the MAXCONNECTS to 1 and still have the problem. Unfortunately. > > > > Also, I know this is strange, but it's true...I have a client that can > > cause this situation to happen on demand by supplying an incorrect > > password for his account. HOWEVER, at trace_level 5 it does not happen > > frequently at all. > > > > I just set the trace_level to 1 and had him send an incorrect password, > > dbmail-pop3d immediately took off on the machine. I then changed the > > trace_level to 5 and had him try it again, this time it did not run away > > like it did before. > > > > I'm running glibc-2.3.2-4.80 which I believe is standard RedHat 8. > > > > I saw the wrong hash being passed in and tried to figure out where it > > was coming from, but I'm by no means a C programmer so I wasn't having > > much luck. :o > > > > Is there any additional info I should pass along? > > > > I was going to try the latest daily snapshot, would that be worth a try > > you think? However, I would still need Ryan's patch to keep clients from > > freaking out on me about the multiple copies of each email... > > > > Again..thanks for all the help! > > > > -- Jason > > > > > > On Tue, 2003-05-20 at 12:33, Jesse Norell wrote: > > > Hmm... > > > > > > Jason, you running non-standard code? :) I've looked all through > > > the pop3 code for md5 from today's cvs, and I don't see anything > > > that would be a problem - my next questions were going to be along > > > the lines of questioning your libc, because you've got values printing > > > out in variables that are for other things (eg. in > > > md5_apop_he=[<[EMAIL PROTECTED]>pass] - that variable should > > > only contain an md5 hash, not the apop_stamp+password). > > > > > > > > > Original Message > > > From: Ryan Butler > > > To: dbmail@dbmail.org > > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > > > Sent: 20 May 2003 11:14:02 -0500 > > > > > > > If setting the maxconnect=1 does fix the problem, its quite possibly a > > > > side affect of the patch I made an believe I sent to the list a while > > > > back, and recently sent to Jason upon request for apop authentication. > > > > > > > > APOP has no password associated with it, and the dbmail-pop3d has a > > > > state machine that if there is not a valid username and password, it > > > > will always fail the connection. This was causing anyone using apop to > > > > have problems for
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Jesse... This seems to have fixed all of the problems I was having. It not only took care of the process taking off on me, but also seems to have fixed one other small problem I was having. I had a few clients that said about 50% of the time they had trouble getting their mail, and would get errors of the server denying or not being found. At first I thought it was a DNS error, which didn't make any sense because some clients with multiple accounts on the same machine would be able to check one but not another at the same time. Anyway...since installing this updated version that problem has also gone away. Many thanks! -- Jason On Tue, 2003-05-20 at 16:07, Jesse Norell wrote: > [Resending, with patch actually included this time.] > > Hello Jason, > > After a little discussion with Ryan, the purpose of his patch was > to fix the pop3 state machine when returning from apop (which has no > plaintext password, creating a problem with a check for password!=NULL > at a point), but it created a double free() of a pointer. According > to the man page, that creates undefined behavior, which for Ryan seems > to be working fine, but for you is quite nasty. :) The attached > patch handles that case in the state machine, as well as checking a > couple lengths (and fixing a buffer overrun with long USER arg) ... it > seems to work fine in a small amount of testing, but give it a try and > see if it fixes your problem, etc. Please report back with your > results, as this is something that needs to be fixed in cvs code. > (Download latest cvs code, and don't use Ryan's patch with this.) > > Later, > Jesse > > > Original Message ---- > From: Jason Burfield > To: dbmail@dbmail.org > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > Sent: 20 May 2003 13:34:47 -0400 > > > Yeah, I am using that patch that Ryan supplied. Without it all my > > clients were getting multiple copies of each email. > > > > The server really is not that busy. There are about 300 total email > > addresses handled by the machine with only about 75 or so using POP to > > actually check for mail. The rest forward off to different places. > > > > During the last few times that it took off, there was only one > > connection to the server. The one before it was 10 seconds before. > > > > I set the MAXCONNECTS to 1 and still have the problem. Unfortunately. > > > > Also, I know this is strange, but it's true...I have a client that can > > cause this situation to happen on demand by supplying an incorrect > > password for his account. HOWEVER, at trace_level 5 it does not happen > > frequently at all. > > > > I just set the trace_level to 1 and had him send an incorrect password, > > dbmail-pop3d immediately took off on the machine. I then changed the > > trace_level to 5 and had him try it again, this time it did not run away > > like it did before. > > > > I'm running glibc-2.3.2-4.80 which I believe is standard RedHat 8. > > > > I saw the wrong hash being passed in and tried to figure out where it > > was coming from, but I'm by no means a C programmer so I wasn't having > > much luck. :o > > > > Is there any additional info I should pass along? > > > > I was going to try the latest daily snapshot, would that be worth a try > > you think? However, I would still need Ryan's patch to keep clients from > > freaking out on me about the multiple copies of each email... > > > > Again..thanks for all the help! > > > > -- Jason > > > > > > On Tue, 2003-05-20 at 12:33, Jesse Norell wrote: > > > Hmm... > > > > > > Jason, you running non-standard code? :) I've looked all through > > > the pop3 code for md5 from today's cvs, and I don't see anything > > > that would be a problem - my next questions were going to be along > > > the lines of questioning your libc, because you've got values printing > > > out in variables that are for other things (eg. in > > > md5_apop_he=[<[EMAIL PROTECTED]>pass] - that variable should > > > only contain an md5 hash, not the apop_stamp+password). > > > > > > > > > Original Message > > > From: Ryan Butler > > > To: dbmail@dbmail.org > > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > > > Sent: 20 May 2003 11:14:02 -0500 > > > > > > > If setting the maxconnect=1 does fix the problem, its quite possibly a > > > > side affect of the patch I made an believe I sent to the list a while &
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Incidentally, I sometimes get the same symptoms in my unpatched, stock 1.1 dbmail-imapd. While not the same code at work, perhaps there is a similar memory corruption issue to be found. Roel, you were reportedly looking into problems in the common server parts, but perhaps there's simply an innocent looking memory issue in the imapd code... I'd dig into it, but I don't have any time this week :-\ I think it's time for more-eyes-make-every-bug-shallow ;-) Hope this patch makes it into CVS soon! Aaron On 22 May 2003, Jason Burfield wrote: > Jesse... > > This seems to have fixed all of the problems I was having. It not only > took care of the process taking off on me, but also seems to have fixed > one other small problem I was having. > > I had a few clients that said about 50% of the time they had trouble > getting their mail, and would get errors of the server denying or not > being found. At first I thought it was a DNS error, which didn't make > any sense because some clients with multiple accounts on the same > machine would be able to check one but not another at the same time. > > Anyway...since installing this updated version that problem has also > gone away. > > Many thanks! > > -- Jason > > > On Tue, 2003-05-20 at 16:07, Jesse Norell wrote: > > [Resending, with patch actually included this time.] > > > > Hello Jason, > > > > After a little discussion with Ryan, the purpose of his patch was > > to fix the pop3 state machine when returning from apop (which has no > > plaintext password, creating a problem with a check for password!=NULL > > at a point), but it created a double free() of a pointer. According > > to the man page, that creates undefined behavior, which for Ryan seems > > to be working fine, but for you is quite nasty. :) The attached > > patch handles that case in the state machine, as well as checking a > > couple lengths (and fixing a buffer overrun with long USER arg) ... it > > seems to work fine in a small amount of testing, but give it a try and > > see if it fixes your problem, etc. Please report back with your > > results, as this is something that needs to be fixed in cvs code. > > (Download latest cvs code, and don't use Ryan's patch with this.) > > > > Later, > > Jesse > > > > > > Original Message > > From: Jason Burfield > > To: dbmail@dbmail.org > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? > > Sent: 20 May 2003 13:34:47 -0400 > > > > > Yeah, I am using that patch that Ryan supplied. Without it all my > > > clients were getting multiple copies of each email. > > > > > > The server really is not that busy. There are about 300 total email > > > addresses handled by the machine with only about 75 or so using POP to > > > actually check for mail. The rest forward off to different places. > > > > > > During the last few times that it took off, there was only one > > > connection to the server. The one before it was 10 seconds before. > > > > > > I set the MAXCONNECTS to 1 and still have the problem. Unfortunately. > > > > > > Also, I know this is strange, but it's true...I have a client that can > > > cause this situation to happen on demand by supplying an incorrect > > > password for his account. HOWEVER, at trace_level 5 it does not happen > > > frequently at all. > > > > > > I just set the trace_level to 1 and had him send an incorrect password, > > > dbmail-pop3d immediately took off on the machine. I then changed the > > > trace_level to 5 and had him try it again, this time it did not run away > > > like it did before. > > > > > > I'm running glibc-2.3.2-4.80 which I believe is standard RedHat 8. > > > > > > I saw the wrong hash being passed in and tried to figure out where it > > > was coming from, but I'm by no means a C programmer so I wasn't having > > > much luck. :o > > > > > > Is there any additional info I should pass along? > > > > > > I was going to try the latest daily snapshot, would that be worth a try > > > you think? However, I would still need Ryan's patch to keep clients from > > > freaking out on me about the multiple copies of each email... > > > > > > Again..thanks for all the help! > > > > > > -- Jason > > > > > > > > > On Tue, 2003-05-20 at 12:33, Jesse Norell wrote: > > > > Hmm... > > > > > > > > Jason, you running no
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Hey, Good point - that should be a comparison, not assignment. I corrected that in the attached patch. Thanks, Jesse Original Message From: Ben Gras <[EMAIL PROTECTED]> To: Jesse Norell <[EMAIL PROTECTED]> Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] Sent: Thu, 22 May 2003 18:38:50 +0200 > Hi Jesse, > > > After a little discussion with Ryan, the purpose of his patch was > > to fix the pop3 state machine when returning from apop (which has no > > plaintext password, creating a problem with a check for password!=NULL > > at a point), but it created a double free() of a pointer. According > > to the man page, that creates undefined behavior, which for Ryan seems > > to be working fine, but for you is quite nasty. :) The attached > > patch handles that case in the state machine, as well as checking a > > couple lengths (and fixing a buffer overrun with long USER arg) ... it > > seems to work fine in a small amount of testing, but give it a try and > > see if it fixes your problem, etc. Please report back with your > > results, as this is something that needs to be fixed in cvs code. > > (Download latest cvs code, and don't use Ryan's patch with this.) > > This line in your patch looks fishy: > + if (session.username != NULL && (session.cmdtype = 11 || > session.password != NULL)) > > It's either a clever (but unclear) way of assigning 11 to cmdtype > if the username != NULL, or a bug, which is likely because the 2nd > part of the conjunction will always be true.. > > =Ben > > > -- End Original Message -- -- Jesse Norell jesse (at) kci.net dbmail-20030520-apop-statemachine-fix.patch Description: Binary data
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Just to be clear...this is a patch to fix the previous patch, yeah? -- Jason On Thu, 2003-05-22 at 13:24, Jesse Norell wrote: > Hey, > > Good point - that should be a comparison, not assignment. I > corrected that in the attached patch. > > Thanks, > Jesse > > Original Message > From: Ben Gras <[EMAIL PROTECTED]> > To: Jesse Norell <[EMAIL PROTECTED]> > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > Sent: Thu, 22 May 2003 18:38:50 +0200 > > > Hi Jesse, > > > > > After a little discussion with Ryan, the purpose of his patch was > > > to fix the pop3 state machine when returning from apop (which has no > > > plaintext password, creating a problem with a check for password!=NULL > > > at a point), but it created a double free() of a pointer. According > > > to the man page, that creates undefined behavior, which for Ryan seems > > > to be working fine, but for you is quite nasty. :) The attached > > > patch handles that case in the state machine, as well as checking a > > > couple lengths (and fixing a buffer overrun with long USER arg) ... it > > > seems to work fine in a small amount of testing, but give it a try and > > > see if it fixes your problem, etc. Please report back with your > > > results, as this is something that needs to be fixed in cvs code. > > > (Download latest cvs code, and don't use Ryan's patch with this.) > > > > This line in your patch looks fishy: > > + if (session.username != NULL && (session.cmdtype = 11 || > > session.password != NULL)) > > > > It's either a clever (but unclear) way of assigning 11 to cmdtype > > if the username != NULL, or a bug, which is likely because the 2nd > > part of the conjunction will always be true.. > > > > =Ben > > > > > > > -- End Original Message -- > > > -- > Jesse Norell > jesse (at) kci.net
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Hello, No, it's the whole patch again, with that single change included (or just manually change session.cmdtype = 11 to session.cmdtype == 11 in pop3.c, about line 173). Jesse Original Message From: Jason Burfield To: dbmail@dbmail.org Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] Sent: 22 May 2003 13:58:14 -0400 > Just to be clear...this is a patch to fix the previous patch, yeah? > > -- Jason > > > On Thu, 2003-05-22 at 13:24, Jesse Norell wrote: > > Hey, > > > > Good point - that should be a comparison, not assignment. I > > corrected that in the attached patch. > > > > Thanks, > > Jesse > > > > Original Message > > From: Ben Gras <[EMAIL PROTECTED]> > > To: Jesse Norell <[EMAIL PROTECTED]> > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > > Sent: Thu, 22 May 2003 18:38:50 +0200 > > > > > Hi Jesse, > > > > > > > After a little discussion with Ryan, the purpose of his patch was > > > > to fix the pop3 state machine when returning from apop (which has no > > > > plaintext password, creating a problem with a check for password!=NULL > > > > at a point), but it created a double free() of a pointer. According > > > > to the man page, that creates undefined behavior, which for Ryan seems > > > > to be working fine, but for you is quite nasty. :) The attached > > > > patch handles that case in the state machine, as well as checking a > > > > couple lengths (and fixing a buffer overrun with long USER arg) ... it > > > > seems to work fine in a small amount of testing, but give it a try and > > > > see if it fixes your problem, etc. Please report back with your > > > > results, as this is something that needs to be fixed in cvs code. > > > > (Download latest cvs code, and don't use Ryan's patch with this.) > > > > > > This line in your patch looks fishy: > > > + if (session.username != NULL && (session.cmdtype = 11 || > > > session.password != NULL)) > > > > > > It's either a clever (but unclear) way of assigning 11 to cmdtype > > > if the username != NULL, or a bug, which is likely because the 2nd > > > part of the conjunction will always be true.. > > > > > > =Ben > > > > > > > > > > > -- End Original Message -- > > > > > > -- > > Jesse Norell > > jesse (at) kci.net > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail > -- End Original Message -- -- Jesse Norell jesse (at) kci.net
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
this patch sounds good, not that i'm having problem, :D Paul you debian packages rocks.. only 1 thing, is this patch in the debian package, and in the last update i had an error, after the apt-get update (... on the debian mirror i always get the first time an error , but it works the second time.) the i do the apt-get dist-upgrade after the install of dbmail update the dbmail server didnt start not a big problem, but i answered no ssl , and ssl was set to true. just for you information. keep on going guys you product rocks.
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
[EMAIL PROTECTED] wrote: this patch sounds good, not that i'm having problem, :D Paul you debian packages rocks.. great. only 1 thing, is this patch in the debian package, Definitely not. I will release a new package when the patch hits cvs. and in the last update i had an error, after the apt-get update (... on the debian mirror i always get the first time an error , but it works the second time.) Hmm. Been having some serious problems with the cluster that runs our nameserver. Could be that we had some downtime, causing you to fallover to our secondary dns. The machine that hosts debian.nfgd.net was never offline. It will be offline for a couple of minutes next tuesday for a memory upgrade. the i do the apt-get dist-upgrade after the install of dbmail update the dbmail server didnt start not a big problem, but i answered no ssl , and ssl was set to true. Ok. I'm rethinking the whole debconf setup. This will be addressed. just for you information. keep on going guys you product rocks. -- Paul Stevens mailto:[EMAIL PROTECTED] NET FACILITIES GROUP PGP: finger [EMAIL PROTECTED] The Netherlandshttp://www.nfg.nl
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Well...interestingly enough, when I apply this patch to dbmail, the multiple email problem comes back. If 'session.cmdtype = 11' stays as is everything works fine. However, when changed to 'session.cmdtype == 11' any APOP clients start getting multiple copies of every mail. Basically as though they have never been checked. This is the same problem I originally had. Any thoughts? -- Jason On Thu, 2003-05-22 at 14:25, Jesse Norell wrote: > Hello, > > No, it's the whole patch again, with that single change included > (or just manually change session.cmdtype = 11 to session.cmdtype == 11 > in pop3.c, about line 173). > > Jesse > > Original Message > From: Jason Burfield > To: dbmail@dbmail.org > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > Sent: 22 May 2003 13:58:14 -0400 > > > Just to be clear...this is a patch to fix the previous patch, yeah? > > > > -- Jason > > > > > > On Thu, 2003-05-22 at 13:24, Jesse Norell wrote: > > > Hey, > > > > > > Good point - that should be a comparison, not assignment. I > > > corrected that in the attached patch. > > > > > > Thanks, > > > Jesse > > > > > > Original Message > > > From: Ben Gras <[EMAIL PROTECTED]> > > > To: Jesse Norell <[EMAIL PROTECTED]> > > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > > > Sent: Thu, 22 May 2003 18:38:50 +0200 > > > > > > > Hi Jesse, > > > > > > > > > After a little discussion with Ryan, the purpose of his patch was > > > > > to fix the pop3 state machine when returning from apop (which has no > > > > > plaintext password, creating a problem with a check for password!=NULL > > > > > at a point), but it created a double free() of a pointer. According > > > > > to the man page, that creates undefined behavior, which for Ryan seems > > > > > to be working fine, but for you is quite nasty. :) The attached > > > > > patch handles that case in the state machine, as well as checking a > > > > > couple lengths (and fixing a buffer overrun with long USER arg) ... it > > > > > seems to work fine in a small amount of testing, but give it a try and > > > > > see if it fixes your problem, etc. Please report back with your > > > > > results, as this is something that needs to be fixed in cvs code. > > > > > (Download latest cvs code, and don't use Ryan's patch with this.) > > > > > > > > This line in your patch looks fishy: > > > > + if (session.username != NULL && (session.cmdtype = 11 || > > > > session.password != NULL)) > > > > > > > > It's either a clever (but unclear) way of assigning 11 to cmdtype > > > > if the username != NULL, or a bug, which is likely because the 2nd > > > > part of the conjunction will always be true.. > > > > > > > > =Ben > > > > > > > > > > > > > > > -- End Original Message -- > > > > > > > > > -- > > > Jesse Norell > > > jesse (at) kci.net > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > -- End Original Message -- > > > -- > Jesse Norell > jesse (at) kci.net > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail >
Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]
Ok, One more shot at this fix. The last one didn't work because each command overwrote the cmdtype, so the last one (QUIT) was rarely/never from the APOP command itsself. Anyways, this one just saves a flag if it was an APOP session, not the actual commandtype index. It is a patch against current (as of 5 min. ago) cvs, which has changed since the last time, so grab a fresh copy. (I can make the patch against older cvs versions too, if anyone needs it just ask.) Please report your success with it. Thanks, Jesse Original Message From: Jason Burfield To: dbmail@dbmail.org Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] Sent: 23 May 2003 17:20:10 -0400 > Well...interestingly enough, when I apply this patch to dbmail, the > multiple email problem comes back. > > If 'session.cmdtype = 11' stays as is everything works fine. > > However, when changed to 'session.cmdtype == 11' any APOP clients start > getting multiple copies of every mail. Basically as though they have > never been checked. > > This is the same problem I originally had. > > Any thoughts? > > -- Jason > > > On Thu, 2003-05-22 at 14:25, Jesse Norell wrote: > > Hello, > > > > No, it's the whole patch again, with that single change included > > (or just manually change session.cmdtype = 11 to session.cmdtype == 11 > > in pop3.c, about line 173). > > > > Jesse > > > > Original Message > > From: Jason Burfield > > To: dbmail@dbmail.org > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > > Sent: 22 May 2003 13:58:14 -0400 > > > > > Just to be clear...this is a patch to fix the previous patch, yeah? > > > > > > -- Jason > > > > > > > > > On Thu, 2003-05-22 at 13:24, Jesse Norell wrote: > > > > Hey, > > > > > > > > Good point - that should be a comparison, not assignment. I > > > > corrected that in the attached patch. > > > > > > > > Thanks, > > > > Jesse > > > > > > > > Original Message > > > > From: Ben Gras <[EMAIL PROTECTED]> > > > > To: Jesse Norell <[EMAIL PROTECTED]> > > > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > > > > Sent: Thu, 22 May 2003 18:38:50 +0200 > > > > > > > > > Hi Jesse, > > > > > > > > > > > After a little discussion with Ryan, the purpose of his patch was > > > > > > to fix the pop3 state machine when returning from apop (which has no > > > > > > plaintext password, creating a problem with a check for > > > > > > password!=NULL > > > > > > at a point), but it created a double free() of a pointer. According > > > > > > to the man page, that creates undefined behavior, which for Ryan > > > > > > seems > > > > > > to be working fine, but for you is quite nasty. :) The attached > > > > > > patch handles that case in the state machine, as well as checking a > > > > > > couple lengths (and fixing a buffer overrun with long USER arg) ... > > > > > > it > > > > > > seems to work fine in a small amount of testing, but give it a try > > > > > > and > > > > > > see if it fixes your problem, etc. Please report back with your > > > > > > results, as this is something that needs to be fixed in cvs code. > > > > > > (Download latest cvs code, and don't use Ryan's patch with this.) > > > > > > > > > > This line in your patch looks fishy: > > > > > + if (session.username != NULL && (session.cmdtype = 11 || > > > > > session.password != NULL)) > > > > > > > > > > It's either a clever (but unclear) way of assigning 11 to cmdtype > > > > > if the username != NULL, or a bug, which is likely because the 2nd > > > > > part of the conjunction will always be true.. > > > > > > > > > > =Ben > > > > > > > > > > > > > > > > > > > -- End Original Message -- > > > > > > > > > > > > -- > > > > Jesse Norell > > > > jesse (at) kci.net > > > > > > ___ > > > Dbmail mailing list > > > Dbmail@dbmail.org > > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > > -- End Original Message -- > > > > > > -- > > Jesse Norell > > jesse (at) kci.net > > > > ___ > > Dbmail mailing list > > Dbmail@dbmail.org > > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail > -- End Original Message -- -- Jesse Norell jesse (at) kci.net dbmail-20030527-apop-statemachine-fix.patch Description: Binary data
Re: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH]]
This one seems good! I've been running this for a little more than one day now with no problems. Thanks! -- Jason > From: Jesse Norell <[EMAIL PROTECTED]> > To: dbmail@dbmail.org > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > Date: 27 May 2003 09:52:13 -0600 > > Ok, > > One more shot at this fix. The last one didn't work because each > command overwrote the cmdtype, so the last one (QUIT) was rarely/never > from the APOP command itsself. Anyways, this one just saves a flag > if it was an APOP session, not the actual commandtype index. It is > a patch against current (as of 5 min. ago) cvs, which has changed > since the last time, so grab a fresh copy. (I can make the patch > against older cvs versions too, if anyone needs it just ask.) > > Please report your success with it. > > Thanks, > Jesse > > > > ---- Original Message ---- > From: Jason Burfield > To: dbmail@dbmail.org > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > Sent: 23 May 2003 17:20:10 -0400 > > > Well...interestingly enough, when I apply this patch to dbmail, the > > multiple email problem comes back. > > > > If 'session.cmdtype = 11' stays as is everything works fine. > > > > However, when changed to 'session.cmdtype == 11' any APOP clients start > > getting multiple copies of every mail. Basically as though they have > > never been checked. > > > > This is the same problem I originally had. > > > > Any thoughts? > > > > -- Jason > > > > > > On Thu, 2003-05-22 at 14:25, Jesse Norell wrote: > > > Hello, > > > > > > No, it's the whole patch again, with that single change included > > > (or just manually change session.cmdtype = 11 to session.cmdtype == 11 > > > in pop3.c, about line 173). > > > > > > Jesse > > > > > > Original Message > > > From: Jason Burfield > > > To: dbmail@dbmail.org > > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > > > Sent: 22 May 2003 13:58:14 -0400 > > > > > > > Just to be clear...this is a patch to fix the previous patch, yeah? > > > > > > > > -- Jason > > > > > > > > > > > > On Thu, 2003-05-22 at 13:24, Jesse Norell wrote: > > > > > Hey, > > > > > > > > > > Good point - that should be a comparison, not assignment. I > > > > > corrected that in the attached patch. > > > > > > > > > > Thanks, > > > > > Jesse > > > > > > > > > > Original Message > > > > > From: Ben Gras <[EMAIL PROTECTED]> > > > > > To: Jesse Norell <[EMAIL PROTECTED]> > > > > > Subject: Re: [Dbmail] High Load Average and dbmail-pop3d ? [PATCH] > > > > > Sent: Thu, 22 May 2003 18:38:50 +0200 > > > > > > > > > > > Hi Jesse, > > > > > > > > > > > > > After a little discussion with Ryan, the purpose of his patch > > > > > > > was > > > > > > > to fix the pop3 state machine when returning from apop (which has > > > > > > > no > > > > > > > plaintext password, creating a problem with a check for > > > > > > > password!=NULL > > > > > > > at a point), but it created a double free() of a pointer. > > > > > > > According > > > > > > > to the man page, that creates undefined behavior, which for Ryan > > > > > > > seems > > > > > > > to be working fine, but for you is quite nasty. :) The attached > > > > > > > patch handles that case in the state machine, as well as checking > > > > > > > a > > > > > > > couple lengths (and fixing a buffer overrun with long USER arg) > > > > > > > ... it > > > > > > > seems to work fine in a small amount of testing, but give it a > > > > > > > try and > > > > > > > see if it fixes your problem, etc. Please report back with your > > > > > > > results, as this is something that needs to be fixed in cvs code. > > > > > > > (Download latest cvs code, and don't use Ryan's patch with this.) > > > > > > > > > > > > This line in your patch looks
