RE: [Dbmail] Imapd is slow as hell
My imap is working fine but pop3 is very slow, I have ask a few times on the list but apparently nobody is interested :( Ming-Wei -Original Message- From: John Wall [mailto:[EMAIL PROTECTED] Sent: Monday, August 26, 2002 9:24 AM To: dbmail@dbmail.org Subject: [Dbmail] Imapd is slow as hell Imapd is slow as hell. pop3d is fast when i press "send and recive" but on my imapd account it takes up to a minute before it tryes to login. I heave allready check DNS and my host file. Imapd works fast sometimes and sometimes it slow as hell. I got only 3 users on that mailserver with dbmail. The server it runs on is strong so there is no problem with the server. The slow part is when I login to the imapd server, it takes up to a minute before I see any login tries in the logfile. This is so wierd ... /John ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] Imapd is slow as hell
On Monday 26 August 2002 02:24 am, John Wall wrote: > Imapd is slow as hell. Have you checked out the database tuneups suggested on the mailing list? https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html Check that out. > > > /John > -- Bret Baptist Systems and Technical Support Specialist [EMAIL PROTECTED] Internet Exposure, Inc. http://www.iexposure.com (612)676-1946 x17 Web Development-Web Marketing-ISP Services -- Today is the tomorrow you worried about yesterday.
Re: [Dbmail] Imapd is slow as hell
On Monday 26 August 2002 04:43 am, Shih Ming-Wei wrote: > My imap is working fine but pop3 is very slow, I have ask a few > times on the list but apparently nobody is interested :( Have you checked out the suggested database indexing mentioned on the mailing list? https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html Bret. > > Ming-Wei > -- Bret Baptist Systems and Technical Support Specialist [EMAIL PROTECTED] Internet Exposure, Inc. http://www.iexposure.com (612)676-1946 x17 Web Development-Web Marketing-ISP Services -- Today is the tomorrow you worried about yesterday.
RE: [Dbmail] Imapd is slow as hell
Well just 1 test user with 1 test msg, I don't think tuning the db would help much. With the same condition the imap is fast as hell :) Ming-Wei -Original Message- From: Bret Baptist [mailto:[EMAIL PROTECTED] Sent: Monday, August 26, 2002 4:16 PM To: dbmail@dbmail.org Subject: Re: [Dbmail] Imapd is slow as hell On Monday 26 August 2002 04:43 am, Shih Ming-Wei wrote: > My imap is working fine but pop3 is very slow, I have ask a few > times on the list but apparently nobody is interested :( Have you checked out the suggested database indexing mentioned on the mailing list? https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html Bret. > > Ming-Wei > -- Bret Baptist Systems and Technical Support Specialist [EMAIL PROTECTED] Internet Exposure, Inc. http://www.iexposure.com (612)676-1946 x17 Web Development-Web Marketing-ISP Services -- Today is the tomorrow you worried about yesterday. ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
RE: [Dbmail] Imapd is slow as hell
I haven't even indexed my database, and with about 100 users, it's works fine. I notice no slowing at all, and most of my users use SquirrelMail to interface via IMAP, so I would think that would aggrevate the problem. I'm running Redhat 7.2, postfix, dbmail (cvs as of last week), mysql 4.0.2 on a 900 mhz pentiumIII with 256 megs -o- ram. (along with apache, and proftpd for the clients) It's all running smooth. -Micah > My imap is working fine but pop3 is very slow, I have ask a few > times on the list but apparently nobody is interested :( > > Ming-Wei > > -Original Message- > From: John Wall [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 9:24 AM > To: dbmail@dbmail.org > Subject: [Dbmail] Imapd is slow as hell > > > Imapd is slow as hell. > > pop3d is fast when i press "send and recive" but on my imapd account it > takes up to a minute before it tryes to login. I heave allready check > DNS and my host file. > > Imapd works fast sometimes and sometimes it slow as hell. I got only 3 > users on that mailserver with dbmail. The server it runs on is strong so > there is no problem with the server. > > The slow part is when I login to the imapd server, it takes up to a > minute before I see any login tries in the logfile. This is so wierd ... > > /John > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail
RE: [Dbmail] Imapd is slow as hell
I really love dbmail and I am going to implement it on a system for 5k - 10K users, but I need a solution for the speed of pop3, can any developer help me? Or at least help me to locate the problem TIA Ming-Wei -Original Message- From: Shih Ming-Wei [mailto:[EMAIL PROTECTED] Sent: Monday, August 26, 2002 4:57 PM To: 'dbmail@dbmail.org' Subject: RE: [Dbmail] Imapd is slow as hell Well just 1 test user with 1 test msg, I don't think tuning the db would help much. With the same condition the imap is fast as hell :) Ming-Wei -Original Message- From: Bret Baptist [ mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> ] Sent: Monday, August 26, 2002 4:16 PM To: dbmail@dbmail.org Subject: Re: [Dbmail] Imapd is slow as hell On Monday 26 August 2002 04:43 am, Shih Ming-Wei wrote: > My imap is working fine but pop3 is very slow, I have ask a few > times on the list but apparently nobody is interested :( Have you checked out the suggested database indexing mentioned on the mailing list? https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html <https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html> Bret. > > Ming-Wei > -- Bret Baptist Systems and Technical Support Specialist [EMAIL PROTECTED] Internet Exposure, Inc. http://www.iexposure.com <http://www.iexposure.com> (612)676-1946 x17 Web Development-Web Marketing-ISP Services -- Today is the tomorrow you worried about yesterday. ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail <https://mailman.fastxs.nl/mailman/listinfo/dbmail>
Re: [Dbmail] Imapd is slow as hell
What is wrong with the speed of pop3? We're running dbmail for 22.000 users all using pop3. No problems at all... Best regards, Eelco Shih Ming-Wei heeft op dinsdag, 27 aug 2002 om 10:51 (Europe/Amsterdam) het volgende geschreven: I really love dbmail and I am going to implement it on a system for 5k - 10K users, but I need a solution for the speed of pop3, can any developer help me? Or at least help me to locate the problem TIA Ming-Wei -Original Message- From: Shih Ming-Wei [mailto:[EMAIL PROTECTED] Sent: Monday, August 26, 2002 4:57 PM To: 'dbmail@dbmail.org' Subject: RE: [Dbmail] Imapd is slow as hell Well just 1 test user with 1 test msg, I don't think tuning the db would help much. With the same condition the imap is fast as hell :) Ming-Wei -Original Message- From: Bret Baptist [mailto:[EMAIL PROTECTED] Sent: Monday, August 26, 2002 4:16 PM To: dbmail@dbmail.org Subject: Re: [Dbmail] Imapd is slow as hell On Monday 26 August 2002 04:43 am, Shih Ming-Wei wrote: > My imap is working fine but pop3 is very slow, I have ask a few > times on the list but apparently nobody is interested :( Have you checked out the suggested database indexing mentioned on the mailing list? https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html Bret. > > Ming-Wei > -- Bret Baptist Systems and Technical Support Specialist [EMAIL PROTECTED] Internet Exposure, Inc. http://www.iexposure.com (612)676-1946 x17 Web Development-Web Marketing-ISP Services -- Today is the tomorrow you worried about yesterday. ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail __ E.J.A. van Beek ICT Manager IC&S T: +31 30 2322878 F: +31 30 2322305 PGP-key: www.ic-s.nl/keys/eelco.txt
RE: [Dbmail] Imapd is slow as hell
I set up dbmail with mysql (innodb) on a small machine (pII 366, 128 MB RAM). Then I created 1 user and send a mail of 6MB, when trying to retrieve the mail with pop3 it is much slower then imap (+/- 10 min instead of +/- 30 sec). I don't think indexing the db would help, and I can't think anything else then that the pop3d is slower then imapd. Oh BTW the pop3d uses a lot of CPU (above 96%) and imapd a lot less (few %) I appreciate you asked xming -Original Message- From: Eelco van Beek - IC&S [mailto:[EMAIL PROTECTED] Sent: Tuesday, August 27, 2002 10:57 AM To: dbmail@dbmail.org Subject: Re: [Dbmail] Imapd is slow as hell What is wrong with the speed of pop3? We're running dbmail for 22.000 users all using pop3. No problems at all... Best regards, Eelco Shih Ming-Wei heeft op dinsdag, 27 aug 2002 om 10:51 (Europe/Amsterdam) het volgende geschreven: > I really love dbmail and I am going to implement it on a system for 5k > - 10K users, but I need > a solution for the speed of pop3, can any developer help me? Or at > least help me to locate the > problem > > TIA > > Ming-Wei > > -Original Message- > From: Shih Ming-Wei [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 4:57 PM > To: 'dbmail@dbmail.org' > Subject: RE: [Dbmail] Imapd is slow as hell > > Well just 1 test user with 1 test msg, I don't think tuning the > db would help much. With the same condition the imap is fast as > hell :) > > Ming-Wei > > -Original Message- > From: Bret Baptist [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 4:16 PM > To: dbmail@dbmail.org > Subject: Re: [Dbmail] Imapd is slow as hell > > > On Monday 26 August 2002 04:43 am, Shih Ming-Wei wrote: > > My imap is working fine but pop3 is very slow, I have ask a few > > times on the list but apparently nobody is interested :( > > Have you checked out the suggested database indexing mentioned on the > mailing > list? > > https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html > > Bret. > > > > > > Ming-Wei > > > > -- > Bret Baptist > Systems and Technical Support Specialist > [EMAIL PROTECTED] > Internet Exposure, Inc. > http://www.iexposure.com > > (612)676-1946 x17 > Web Development-Web Marketing-ISP Services > -- > > > Today is the tomorrow you worried about yesterday. > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > __ E.J.A. van Beek ICT Manager IC&S T: +31 30 2322878 F: +31 30 2322305 PGP-key: www.ic-s.nl/keys/eelco.txt ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
RE: [Dbmail] Imapd is slow as hell
> I set up dbmail with mysql (innodb) on a small machine (pII 366, 128 MB Which version of dbmail are you using? Is it RC3, or a more recent CVS version? Chris Hilts [EMAIL PROTECTED]
Re: [Dbmail] Imapd is slow as hell
Hi I have a problem using dbmail and fetchmail i'm not quit sure what the problem is maybe u can help me running suse7.3 with dbmail and all it requirements as well as fetchmail just to recieve mail , when recieving e-mail from my e-mail server I get a thrown from mda error i think it has something to do with fetchmail i'm not quit sure , can u pleaz share some light on this problem. It could also be that my mail server is not properly configured My Mail Server is running Postfix basically it does the same job as any other isp mailserver recieve e-mail for a domain Thanks >>> [EMAIL PROTECTED] 08/27/02 10:56AM >>> What is wrong with the speed of pop3? We're running dbmail for 22.000 users all using pop3. No problems at all... Best regards, Eelco Shih Ming-Wei heeft op dinsdag, 27 aug 2002 om 10:51 (Europe/Amsterdam) het volgende geschreven: > I really love dbmail and I am going to implement it on a system for 5k > - 10K users, but I need > a solution for the speed of pop3, can any developer help me? Or at > least help me to locate the > problem > > TIA > > Ming-Wei > > -Original Message- > From: Shih Ming-Wei [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 4:57 PM > To: 'dbmail@dbmail.org' > Subject: RE: [Dbmail] Imapd is slow as hell > > Well just 1 test user with 1 test msg, I don't think tuning the > db would help much. With the same condition the imap is fast as > hell :) > > Ming-Wei > > -Original Message- > From: Bret Baptist [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 4:16 PM > To: dbmail@dbmail.org > Subject: Re: [Dbmail] Imapd is slow as hell > > > On Monday 26 August 2002 04:43 am, Shih Ming-Wei wrote: > > My imap is working fine but pop3 is very slow, I have ask a few > > times on the list but apparently nobody is interested :( > > Have you checked out the suggested database indexing mentioned on the > mailing > list? > > https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html > > Bret. > > > > > > Ming-Wei > > > > -- > Bret Baptist > Systems and Technical Support Specialist > [EMAIL PROTECTED] > Internet Exposure, Inc. > http://www.iexposure.com > > (612)676-1946 x17 > Web Development-Web Marketing-ISP Services > -- > > > Today is the tomorrow you worried about yesterday. > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > __ E.J.A. van Beek ICT Manager IC&S T: +31 30 2322878 F: +31 30 2322305 PGP-key: www.ic-s.nl/keys/eelco.txt ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
RE: [Dbmail] Imapd is slow as hell
try fetchmail -vvv to see more debug info, and share it with us Ming-Wei -Original Message- From: Abdulla Damingo [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 28, 2002 9:10 AM To: dbmail@dbmail.org Subject: Re: [Dbmail] Imapd is slow as hell Hi I have a problem using dbmail and fetchmail i'm not quit sure what the problem is maybe u can help me running suse7.3 with dbmail and all it requirements as well as fetchmail just to recieve mail , when recieving e-mail from my e-mail server I get a thrown from mda error i think it has something to do with fetchmail i'm not quit sure , can u pleaz share some light on this problem. It could also be that my mail server is not properly configured My Mail Server is running Postfix basically it does the same job as any other isp mailserver recieve e-mail for a domain Thanks >>> [EMAIL PROTECTED] 08/27/02 10:56AM >>> What is wrong with the speed of pop3? We're running dbmail for 22.000 users all using pop3. No problems at all... Best regards, Eelco Shih Ming-Wei heeft op dinsdag, 27 aug 2002 om 10:51 (Europe/Amsterdam) het volgende geschreven: > I really love dbmail and I am going to implement it on a system for 5k > - 10K users, but I need > a solution for the speed of pop3, can any developer help me? Or at > least help me to locate the > problem > > TIA > > Ming-Wei > > -Original Message- > From: Shih Ming-Wei [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 4:57 PM > To: 'dbmail@dbmail.org' > Subject: RE: [Dbmail] Imapd is slow as hell > > Well just 1 test user with 1 test msg, I don't think tuning the > db would help much. With the same condition the imap is fast as > hell :) > > Ming-Wei > > -Original Message- > From: Bret Baptist [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 4:16 PM > To: dbmail@dbmail.org > Subject: Re: [Dbmail] Imapd is slow as hell > > > On Monday 26 August 2002 04:43 am, Shih Ming-Wei wrote: > > My imap is working fine but pop3 is very slow, I have ask a few > > times on the list but apparently nobody is interested :( > > Have you checked out the suggested database indexing mentioned on the > mailing > list? > > https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html > > Bret. > > > > > > Ming-Wei > > > > -- > Bret Baptist > Systems and Technical Support Specialist > [EMAIL PROTECTED] > Internet Exposure, Inc. > http://www.iexposure.com > > (612)676-1946 x17 > Web Development-Web Marketing-ISP Services > -- > > > Today is the tomorrow you worried about yesterday. > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > __ E.J.A. van Beek ICT Manager IC&S T: +31 30 2322878 F: +31 30 2322305 PGP-key: www.ic-s.nl/keys/eelco.txt ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] Imapd is slow as hell
Hi john, how fast does the imap server respond if you open a telnet session to the server? And what is the speed difference if you connect to localhost (i.e. running telnet on the imap server machine)? regards roel - Original Message - From: "John Wall" <[EMAIL PROTECTED]> To: Sent: Monday, August 26, 2002 9:24 AM Subject: [Dbmail] Imapd is slow as hell > Imapd is slow as hell. > > pop3d is fast when i press "send and recive" but on my imapd account it > takes up to a minute before it tryes to login. I heave allready check DNS > and my host file. > > Imapd works fast sometimes and sometimes it slow as hell. I got only 3 users > on that mailserver with dbmail. The server it runs on is strong so there is > no problem with the server. > > The slow part is when I login to the imapd server, it takes up to a minute > before I see any login tries in the logfile. This is so wierd ... > > /John > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail >
RE: [Dbmail] Imapd is slow as hell
This is what i see i don't know if u can see this i'll try to send another one >>> [EMAIL PROTECTED] 08/28/02 09:47AM >>> try fetchmail -vvv to see more debug info, and share it with us Ming-Wei -Original Message- From: Abdulla Damingo [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 28, 2002 9:10 AM To: dbmail@dbmail.org Subject: Re: [Dbmail] Imapd is slow as hell Hi I have a problem using dbmail and fetchmail i'm not quit sure what the problem is maybe u can help me running suse7.3 with dbmail and all it requirements as well as fetchmail just to recieve mail , when recieving e-mail from my e-mail server I get a thrown from mda error i think it has something to do with fetchmail i'm not quit sure , can u pleaz share some light on this problem. It could also be that my mail server is not properly configured My Mail Server is running Postfix basically it does the same job as any other isp mailserver recieve e-mail for a domain Thanks >>> [EMAIL PROTECTED] 08/27/02 10:56AM >>> What is wrong with the speed of pop3? We're running dbmail for 22.000 users all using pop3. No problems at all... Best regards, Eelco Shih Ming-Wei heeft op dinsdag, 27 aug 2002 om 10:51 (Europe/Amsterdam) het volgende geschreven: > I really love dbmail and I am going to implement it on a system for 5k > - 10K users, but I need > a solution for the speed of pop3, can any developer help me? Or at > least help me to locate the > problem > > TIA > > Ming-Wei > > -Original Message- > From: Shih Ming-Wei [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 4:57 PM > To: 'dbmail@dbmail.org' > Subject: RE: [Dbmail] Imapd is slow as hell > > Well just 1 test user with 1 test msg, I don't think tuning the > db would help much. With the same condition the imap is fast as > hell :) > > Ming-Wei > > -Original Message----- > From: Bret Baptist [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 4:16 PM > To: dbmail@dbmail.org > Subject: Re: [Dbmail] Imapd is slow as hell > > > On Monday 26 August 2002 04:43 am, Shih Ming-Wei wrote: > > My imap is working fine but pop3 is very slow, I have ask a few > > times on the list but apparently nobody is interested :( > > Have you checked out the suggested database indexing mentioned on the > mailing > list? > > https://mailman.fastxs.nl/pipermail/dbmail/2002-April/000435.html > > Bret. > > > > > > Ming-Wei > > > > -- > Bret Baptist > Systems and Technical Support Specialist > [EMAIL PROTECTED] > Internet Exposure, Inc. > http://www.iexposure.com > > (612)676-1946 x17 > Web Development-Web Marketing-ISP Services > -- > > > Today is the tomorrow you worried about yesterday. > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail > > __ E.J.A. van Beek ICT Manager IC&S T: +31 30 2322878 F: +31 30 2322305 PGP-key: www.ic-s.nl/keys/eelco.txt ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
RE: [Dbmail] Imapd is slow as hell
RC3 and cvs, I just build dbmail on a new machine (sun T1, ultrasparc 500Mhz, 512 MB, 2x17Gb UW SCSI with gentoo Linux) with just one test user and one test mail (6 MB) and the pop3d is using more than 96% of CPU and slow as hell? Please does someone know where the problem might be? Now I have tried 2 diff platform and 2 diff gcc (2.95.3 and gcc 3.2) but still the same, is there anyone using pop3? If yes don't you have the same problem? I am desperate now :( Ming-Wei -Original Message- From: Chris Hilts [mailto:[EMAIL PROTECTED] Sent: Tuesday, August 27, 2002 4:21 PM To: [EMAIL PROTECTED] Cc: dbmail@dbmail.org Subject: RE: [Dbmail] Imapd is slow as hell > I set up dbmail with mysql (innodb) on a small machine (pII 366, 128 MB Which version of dbmail are you using? Is it RC3, or a more recent CVS version? Chris Hilts [EMAIL PROTECTED]
Re: [Dbmail] Imapd is slow as hell
I am using both IMAP and POP3. I have about 1000 users and my dbmail system is very fast. I have no problems downloading 100 emails at a time in mere seconds. This is with amavisd-new/sophie/spamassasin/razor. I think there is something very messed up with you system. I would try installing new network cards, or checking other settings on your system. Check other parts of your network for slowdown, ie faulty switches, faulty nameservers, other computers with the same ip address... Bret. On Thursday 05 September 2002 09:59 am, Shih Ming-Wei wrote: > RC3 and cvs, I just build dbmail on a new machine (sun T1, ultrasparc > 500Mhz, 512 MB, 2x17Gb UW SCSI with gentoo Linux) with just one test user > and one test mail (6 MB) and the pop3d is using more than 96% of CPU and > slow as hell? > > Please does someone know where the problem might be? > > Now I have tried 2 diff platform and 2 diff gcc (2.95.3 and gcc 3.2) but > still the same, is there anyone using pop3? If yes don't you have the same > problem? > > I am desperate now :( > > Ming-Wei > > > -Original Message- > From: Chris Hilts [mailto:[EMAIL PROTECTED] > Sent: Tuesday, August 27, 2002 4:21 PM > To: [EMAIL PROTECTED] > Cc: dbmail@dbmail.org > Subject: RE: [Dbmail] Imapd is slow as hell > > > I set up dbmail with mysql (innodb) on a small machine (pII 366, 128 MB > > Which version of dbmail are you using? Is it RC3, or a more recent CVS > version? > > Chris Hilts > [EMAIL PROTECTED] -- Bret Baptist Systems and Technical Support Specialist [EMAIL PROTECTED] Internet Exposure, Inc. http://www.iexposure.com (612)676-1946 x17 Web Development-Web Marketing-ISP Services -- Today is the tomorrow you worried about yesterday.
RE: [Dbmail] Imapd is slow as hell
Well, as I said, I tried it on 2 different newly installed platforms (one intel and one sparc) in two different networks with 2 different ip addresses. So the problem is really the pop3d on my system, 'cause imapd is fast as hell and pop3d is slow as hell and it is using more the 96% of the cpu (one mail, one user, so it's not the db neither). euh, using more then 96% of the cpu has nothing to do with the network, please, please, please Still thanks for the reply Ming-Wei -Original Message- From: Bret Baptist [mailto:[EMAIL PROTECTED] Sent: Thursday, September 05, 2002 6:03 PM To: dbmail@dbmail.org Subject: Re: [Dbmail] Imapd is slow as hell I am using both IMAP and POP3. I have about 1000 users and my dbmail system is very fast. I have no problems downloading 100 emails at a time in mere seconds. This is with amavisd-new/sophie/spamassasin/razor. I think there is something very messed up with you system. I would try installing new network cards, or checking other settings on your system. Check other parts of your network for slowdown, ie faulty switches, faulty nameservers, other computers with the same ip address... Bret. On Thursday 05 September 2002 09:59 am, Shih Ming-Wei wrote: > RC3 and cvs, I just build dbmail on a new machine (sun T1, ultrasparc > 500Mhz, 512 MB, 2x17Gb UW SCSI with gentoo Linux) with just one test user > and one test mail (6 MB) and the pop3d is using more than 96% of CPU and > slow as hell? > > Please does someone know where the problem might be? > > Now I have tried 2 diff platform and 2 diff gcc (2.95.3 and gcc 3.2) but > still the same, is there anyone using pop3? If yes don't you have the same > problem? > > I am desperate now :( > > Ming-Wei > > > -Original Message- > From: Chris Hilts [mailto:[EMAIL PROTECTED] > Sent: Tuesday, August 27, 2002 4:21 PM > To: [EMAIL PROTECTED] > Cc: dbmail@dbmail.org > Subject: RE: [Dbmail] Imapd is slow as hell > > > I set up dbmail with mysql (innodb) on a small machine (pII 366, 128 MB > > Which version of dbmail are you using? Is it RC3, or a more recent CVS > version? > > Chris Hilts > [EMAIL PROTECTED] -- Bret Baptist Systems and Technical Support Specialist [EMAIL PROTECTED] Internet Exposure, Inc. http://www.iexposure.com (612)676-1946 x17 Web Development-Web Marketing-ISP Services -- Today is the tomorrow you worried about yesterday. ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] Imapd is slow as hell
On 2002-09-05 18:13:31 +0200, Shih Ming-Wei wrote: > Well, as I said, I tried it on 2 different newly installed platforms > (one intel and one sparc) in two different networks with 2 different > ip addresses. So the problem is really the pop3d on my system, 'cause > imapd is fast as hell and pop3d is slow as hell and it is using more > the 96% of the cpu (one mail, one user, so it's not the db neither). > > euh, using more then 96% of the cpu has nothing to do with the > network, please, please, please Question: Is this user or system CPU time? Things to try: 1. strace -p $pid_of_pop3_process This will let you know what (if any) system calls are being made. 2. tcpdump port 110 This will let you see the packets flying across your network. I don't have any algorithm to solve the problems, but obviously we need more information. -- Shane Carpe Diem
RE: [Dbmail] Imapd is slow as hell
Hi, We have noticed that and make some tests with several Webmail and mail clients as Netscape, Outlook, vs courier-imap with the same mail clients. First conclusions the PHPs' webmails are very slow except Squirrelmail because it use its own imap libraries instead of PHP-IMAP. But it's true Courier-IMAP it's much faster than dbmail-imap, we have add the mysql indexes as explained in this list, tuned the mysql config and got some improvements but never too fast as courier-imap. Then we have put the trace_level to 5 and make the same tests and we have noticed that to get each mail header dbmail-imap need 4 or 5 queries and in my opinion I think that it should be possible to get the same think with only one or two: By use a "SELECT * FROM messages" instead "SELECT field-1, field-2..." and/or change the table structure to put the mail header on "messages" whith the from:, to:, subject:, field and perhaps the body too, or just the body on messageblks. DBmail is the right way to make an isp mail solution with a lot of capabilities as CRM, etc, but we have to improve its speed and discuss to find the best way to do. Shih Ming-Wei a dit : > My imap is working fine but pop3 is very slow, I have ask a few times > on the list but apparently nobody is interested :( > > Ming-Wei > > -Original Message- > From: John Wall [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 9:24 AM > To: dbmail@dbmail.org > Subject: [Dbmail] Imapd is slow as hell > > > Imapd is slow as hell. > > pop3d is fast when i press "send and recive" but on my imapd account > it takes up to a minute before it tryes to login. I heave allready > check DNS and my host file. > > Imapd works fast sometimes and sometimes it slow as hell. I got only 3 > users on that mailserver with dbmail. The server it runs on is strong > so there is no problem with the server. > > The slow part is when I login to the imapd server, it takes up to a > minute before I see any login tries in the logfile. This is so wierd > ... > > /John -- Sam Przyswa - Chef de projet Arial Concept - Intégrateur Internet 36, rue de Turin - 75008 - Paris Tel: 01 40 54 86 04 - Fax: 01 40 54 83 01 Web: http://www.arial-concept.com - Email: [EMAIL PROTECTED]
RE: [Dbmail] Imapd is slow as hell
Just a note, on your query comments, although I'm not arguing with your basic point, it's always been my understanding that SELECT statements that use '*' instead of stating field names are slower. If you don't specify the field names the database has to spend time figuring out what they are, but if you name them all it has to do it error if it can't find the name. In practice I've noticed it to be only marginally faster to explicitly name the fields rather than use the '*' wildcard. Not really noticeable unless you're doing tons of SELECT statements. Back to the point of your mail though: Is it faster to make one big conglomerate SQL statement that takes the database longer to parse? If it's the difference between one connection, and two, I doubt it, but the more you slim things down the better. That's for sure. I hate Mondays. -Micah At 03:26 AM 9/24/2002 +0200, you wrote: Hi, We have noticed that and make some tests with several Webmail and mail clients as Netscape, Outlook, vs courier-imap with the same mail clients. First conclusions the PHPs' webmails are very slow except Squirrelmail because it use its own imap libraries instead of PHP-IMAP. But it's true Courier-IMAP it's much faster than dbmail-imap, we have add the mysql indexes as explained in this list, tuned the mysql config and got some improvements but never too fast as courier-imap. Then we have put the trace_level to 5 and make the same tests and we have noticed that to get each mail header dbmail-imap need 4 or 5 queries and in my opinion I think that it should be possible to get the same think with only one or two: By use a "SELECT * FROM messages" instead "SELECT field-1, field-2..." and/or change the table structure to put the mail header on "messages" whith the from:, to:, subject:, field and perhaps the body too, or just the body on messageblks. DBmail is the right way to make an isp mail solution with a lot of capabilities as CRM, etc, but we have to improve its speed and discuss to find the best way to do. Shih Ming-Wei a dit : > My imap is working fine but pop3 is very slow, I have ask a few times > on the list but apparently nobody is interested :( > > Ming-Wei > > -Original Message- > From: John Wall [mailto:[EMAIL PROTECTED] > Sent: Monday, August 26, 2002 9:24 AM > To: dbmail@dbmail.org > Subject: [Dbmail] Imapd is slow as hell > > > Imapd is slow as hell. > > pop3d is fast when i press "send and recive" but on my imapd account > it takes up to a minute before it tryes to login. I heave allready > check DNS and my host file. > > Imapd works fast sometimes and sometimes it slow as hell. I got only 3 > users on that mailserver with dbmail. The server it runs on is strong > so there is no problem with the server. > > The slow part is when I login to the imapd server, it takes up to a > minute before I see any login tries in the logfile. This is so wierd > ... > > /John -- Sam Przyswa - Chef de projet Arial Concept - Intégrateur Internet 36, rue de Turin - 75008 - Paris Tel: 01 40 54 86 04 - Fax: 01 40 54 83 01 Web: http://www.arial-concept.com - Email: [EMAIL PROTECTED] ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] Imapd is slow as hell
On Mon, 23 Sep 2002 18:48:33 -0700 in message <[EMAIL PROTECTED]>, Micah Stevens <[EMAIL PROTECTED]> wrote: > Just a note, on your query comments, although I'm not arguing with your > basic point, it's always been my understanding that SELECT statements that > use '*' instead of stating field names are slower. If you don't specify the > field names the database has to spend time figuring out what they are, but > if you name them all it has to do it error if it can't find the name. Probably depends on the implementation. But if you're looking for a speed up there, you're probably barking up the wrong tree. You're better off trying to optimize away a call to the database. Any decent database will already have the column descriptions cached anyway. But even worse, select * can be a maintence nightmare. Unless your program is getting back the rows as name value pairs and picking through what gets sent back, you want to be specifying the columns and the order that they are to be sent back, not asking for everything and assuming that the order and number of the fields is what you think might be there. (because someone like me be implementing that table as a view, or adding columns for my use, or something like that. ) eric
RE: [Dbmail] Imapd is slow as hell
Micah Stevens ([EMAIL PROTECTED]) wrote: > >Just a note, on your query comments, although I'm not arguing with your >basic point, it's always been my understanding that SELECT statements that >use '*' instead of stating field names are slower. If you don't specify the >field names the database has to spend time figuring out what they are, but >if you name them all it has to do it error if it can't find the name. > >In practice I've noticed it to be only marginally faster to explicitly name >the fields rather than use the '*' wildcard. Not really noticeable unless >you're doing tons of SELECT statements. Either or not use wildcards it should be faster to get the header in one query instead of five, I think. >Back to the point of your mail though: Is it faster to make one big >conglomerate SQL statement that takes the database longer to parse? If it's >the difference between one connection, and two, I doubt it, but the more >you slim things down the better. That's for sure. If the message is stored directly in "messages" instead of "messages" + "messageblks" the query look like: "SELECT * FROM messages WHERE message_idnr = AND status<2 AND unique_id ! = '' AND mailbox_idnr = " ...or for exemple: "SELECT from,to,subject,seen_flag FROM messages WHERE message_idnr = AND status<2 AND unique_id != '' AND mailbox_idnr = " My second question: why to use the extra table messageblks to store the message ? Thanks for spend your time to reply to my questions. Sam. >At 03:26 AM 9/24/2002 +0200, you wrote: >>Hi, >> >>We have noticed that and make some tests with several Webmail and mail >>clients as Netscape, Outlook, vs courier-imap with the same mail >>clients. >> >>First conclusions the PHPs' webmails are very slow except Squirrelmail >>because it use its own imap libraries instead of PHP-IMAP. But it's true >>Courier-IMAP it's much faster than dbmail-imap, we have add the mysql >>indexes as explained in this list, tuned the mysql config and got some >>improvements but never too fast as courier-imap. >> >>Then we have put the trace_level to 5 and make the same tests and we >>have noticed that to get each mail header dbmail-imap need 4 or 5 >>queries and in my opinion I think that it should be possible to get the >>same think with only one or two: >> >>By use a "SELECT * FROM messages" instead "SELECT field-1, field-2..." >>and/or change the table structure to put the mail header on "messages" >>whith the from:, to:, subject:, field and perhaps the body too, or just >>the body on messageblks. >> >>DBmail is the right way to make an isp mail solution with a lot of >>capabilities as CRM, etc, but we have to improve its speed and discuss >>to find the best way to do. >> -- Sam Przyswa - Chef de projet Arial Concept - Intégrateur Internet 36, rue de Turin - 75008 - Paris Tel: 01 40 54 86 04 - Fax: 01 40 54 83 01 Web: http://www.arial-concept.com - Email: [EMAIL PROTECTED]
Re: [Dbmail] Imapd is slow as hell
Why use messageblks? Well, for one reason, mysql has a limit on the record size so a split-up is necessary anyway. The system was chosen to handle big messages in chunks. - Original Message - From: "Sam Przyswa" <[EMAIL PROTECTED]> To: Sent: Tuesday, September 24, 2002 3:52 PM Subject: RE: [Dbmail] Imapd is slow as hell > Micah Stevens ([EMAIL PROTECTED]) wrote: > > > >Just a note, on your query comments, although I'm not arguing with your > >basic point, it's always been my understanding that SELECT statements that > >use '*' instead of stating field names are slower. If you don't specify the > >field names the database has to spend time figuring out what they are, but > >if you name them all it has to do it error if it can't find the name. > > > >In practice I've noticed it to be only marginally faster to explicitly name > >the fields rather than use the '*' wildcard. Not really noticeable unless > >you're doing tons of SELECT statements. > > Either or not use wildcards it should be faster to get the header in one query > instead of five, I think. > > >Back to the point of your mail though: Is it faster to make one big > >conglomerate SQL statement that takes the database longer to parse? If it's > >the difference between one connection, and two, I doubt it, but the more > >you slim things down the better. That's for sure. > > If the message is stored directly in "messages" instead of "messages" > + "messageblks" the query look like: > > "SELECT * FROM messages WHERE message_idnr = AND status<2 AND unique_id ! > = '' AND mailbox_idnr = " > > ...or for exemple: > > "SELECT from,to,subject,seen_flag FROM messages WHERE message_idnr = AND > status<2 AND unique_id != '' AND mailbox_idnr = " > > My second question: why to use the extra table messageblks to store the message ? > > Thanks for spend your time to reply to my questions. > > Sam. > > >At 03:26 AM 9/24/2002 +0200, you wrote: > >>Hi, > >> > >>We have noticed that and make some tests with several Webmail and mail > >>clients as Netscape, Outlook, vs courier-imap with the same mail > >>clients. > >> > >>First conclusions the PHPs' webmails are very slow except Squirrelmail > >>because it use its own imap libraries instead of PHP-IMAP. But it's true > >>Courier-IMAP it's much faster than dbmail-imap, we have add the mysql > >>indexes as explained in this list, tuned the mysql config and got some > >>improvements but never too fast as courier-imap. > >> > >>Then we have put the trace_level to 5 and make the same tests and we > >>have noticed that to get each mail header dbmail-imap need 4 or 5 > >>queries and in my opinion I think that it should be possible to get the > >>same think with only one or two: > >> > >>By use a "SELECT * FROM messages" instead "SELECT field-1, field-2..." > >>and/or change the table structure to put the mail header on "messages" > >>whith the from:, to:, subject:, field and perhaps the body too, or just > >>the body on messageblks. > >> > >>DBmail is the right way to make an isp mail solution with a lot of > >>capabilities as CRM, etc, but we have to improve its speed and discuss > >>to find the best way to do. > >> > -- > Sam Przyswa - Chef de projet > Arial Concept - Intégrateur Internet > 36, rue de Turin - 75008 - Paris > Tel: 01 40 54 86 04 - Fax: 01 40 54 83 01 > Web: http://www.arial-concept.com - Email: [EMAIL PROTECTED] > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail >
Re: [Dbmail] Imapd is slow as hell
eric ([EMAIL PROTECTED]) écrivait: > >On Mon, 23 Sep 2002 18:48:33 -0700 in message <[EMAIL PROTECTED]>, Micah Stevens <[EMAIL PROTECTED]> wrote: >> Just a note, on your query comments, although I'm not arguing with your >> basic point, it's always been my understanding that SELECT statements that >> use '*' instead of stating field names are slower. If you don't specify the >> field names the database has to spend time figuring out what they are, but >> if you name them all it has to do it error if it can't find the name. > >Probably depends on the implementation. But if you're looking for a speed up there, you're probably barking up the wrong tree. You're better off trying to optimize away a call to the database. Any decent database will already have the column descriptions cached anyway. But even worse, select * can be a maintence nightmare. > >Unless your program is getting back the rows as name value pairs and picking through what gets sent back, you want to be specifying the columns and the order that they are to be sent back, not asking for everything and assuming that the order and number of the fields is what you think might be there. Sure it's easiest to SELECT named fields as SELECT * and use raw[x] to get the value. Our main goal it's to speed up DBmail and any suggestions are welcome ! Sam. -- Sam Przyswa - Chef de projet Arial Concept - Intégrateur Internet 36, rue de Turin - 75008 - Paris Tel: 01 40 54 86 04 - Fax: 01 40 54 83 01 Web: http://www.arial-concept.com - Email: [EMAIL PROTECTED]
Re: [Dbmail] Imapd is slow as hell
Roel Rozendaal ([EMAIL PROTECTED]) écrivait: > >Why use messageblks? Well, for one reason, mysql has a limit on the record >size so a split-up is necessary anyway. The system was chosen to handle big >messages in chunks. > Ok, I guessed that there is a good reason to do that, but it's possible to use messageblks only to store the body part of the mail, then we don't need to accede to it to fetch the headers fields by putting them into the messages table, what did you think about ? Sam. -- Sam Przyswa - Chef de projet Arial Concept - Intégrateur Internet 36, rue de Turin - 75008 - Paris Tel: 01 40 54 86 04 - Fax: 01 40 54 83 01 Web: http://www.arial-concept.com - Email: [EMAIL PROTECTED]
Re: [Dbmail] Imapd is slow as hell
The basic layout for dbmail was based upon pop3 but we are interested in better schemes for imap. One of the main goals right now is to have the fastest imap server around. Better table layouts would mean a great improvement; just don't know how much time will be involved in implementing those. Things to do right now in my opinion are to fix annoying bugs and update the package with the several patches we have to release a STABLE 1.0 version asap. Right after that we can start playing with the table layouts and imap server logic to maximize speed for a 2.0 imap update. On Tue, 2002-09-24 at 18:03, Sam Przyswa wrote: > Roel Rozendaal ([EMAIL PROTECTED]) écrivait: > > > >Why use messageblks? Well, for one reason, mysql has a limit on the record > >size so a split-up is necessary anyway. The system was chosen to handle big > >messages in chunks. > > > > Ok, I guessed that there is a good reason to do that, but it's possible to use > messageblks only to store the body part of the mail, then we don't need to > accede > to it to fetch the headers fields by putting them into the messages table, > what > did you think about ? > > Sam. > -- > Sam Przyswa - Chef de projet > Arial Concept - Intégrateur Internet > 36, rue de Turin - 75008 - Paris > Tel: 01 40 54 86 04 - Fax: 01 40 54 83 01 > Web: http://www.arial-concept.com - Email: [EMAIL PROTECTED] > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail signature.asc Description: This is a digitally signed message part
Re: [Dbmail] Imapd is slow as hell
Roel Rozendaal ([EMAIL PROTECTED]) écrivait: > >The basic layout for dbmail was based upon pop3 but we are interested in >better schemes for imap. One of the main goals right now is to have the >fastest imap server around. Better table layouts would mean a great >improvement; just don't know how much time will be involved in >implementing those. Yes I know ! >Things to do right now in my opinion are to fix annoying bugs and update >the package with the several patches we have to release a STABLE 1.0 >version asap. Sure, we have already talked about that one week ago, in the bug fix list can you add the "&" character un the mailbox name to permit the UTF code, and permit dbmail to accept ISO-8859-1 charset for search functions, at this time we got an error message with Squirrelmail "unsupported character set". >Right after that we can start playing with the table layouts and imap >server logic to maximize speed for a 2.0 imap update. I will try to work on the imap speed improvements and will tell you if we got good results. Thanks for your work and your attention. Sam.
Re: [Dbmail] Imapd is slow as hell
On Tue, 2002-09-24 at 10:48, Sam Przyswa wrote: > >Unless your program is getting back the rows as name value pairs and picking > through what gets sent back, you want to be specifying the columns and the > order > that they are to be sent back, not asking for everything and assuming that the > order and number of the fields is what you think might be there. > > Sure it's easiest to SELECT named fields as SELECT * and use raw[x] to get the > value. Our main goal it's to speed up DBmail and any suggestions are welcome ! > That is not the easiest method, because unless you're getting it as an associative array (name/val pairs, etc) Then you have no idea if raw[4] is really what you expect on every installation (someone may have added a field they need to the table). That is why the inserts and selects only ask for the columns they need in the order they need. So that the underlying table can be changed and not botch the whole system.
Re: [Dbmail] Imapd is slow as hell
Honestly I don't think using "select " or "select *" is a big speed difference - it's more like the ultimate fine tuning. I think dramatic results can be achieved by developing a table layout/imap logic that minimizes the number of queries and the amount of parsing done by the imap server. On Tue, 2002-09-24 at 18:55, Ryan Butler wrote: > On Tue, 2002-09-24 at 10:48, Sam Przyswa wrote: > > > >Unless your program is getting back the rows as name value pairs and > > >picking > > through what gets sent back, you want to be specifying the columns and the > > order > > that they are to be sent back, not asking for everything and assuming that > > the > > order and number of the fields is what you think might be there. > > > > Sure it's easiest to SELECT named fields as SELECT * and use raw[x] to get > > the > > value. Our main goal it's to speed up DBmail and any suggestions are > > welcome ! > > > > That is not the easiest method, because unless you're getting it as an > associative array (name/val pairs, etc) Then you have no idea if raw[4] > is really what you expect on every installation (someone may have added > a field they need to the table). That is why the inserts and selects > only ask for the columns they need in the order they need. So that the > underlying table can be changed and not botch the whole system. > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail signature.asc Description: This is a digitally signed message part
Re: [Dbmail] Imapd is slow as hell
Parsing is definitely the issue. I wrote a very simple Python application to parse headers in my dbmail inbox - a run against 50 messages takes about 4 seconds on a very fast box, using standard Python libraries. The question is, what's more important - message insertion or subsequent processing. My vote is that subsequent processing (each access by a web mail, pop or IMAP client) is more important since they are 1 plus n accesses to the data, whereas insertion is a one time thing. In the short term a web mail client could use the 'seen' flag - parse the messages and write to its own tables to contain the header fields of interest, but, would be nice to see dbmail 2.0 do this on message insertion. Then watch imap fly! At 07:14 PM 9/24/2002 +0200, you wrote: Honestly I don't think using "select " or "select *" is a big speed difference - it's more like the ultimate fine tuning. I think dramatic results can be achieved by developing a table layout/imap logic that minimizes the number of queries and the amount of parsing done by the imap server. On Tue, 2002-09-24 at 18:55, Ryan Butler wrote: > On Tue, 2002-09-24 at 10:48, Sam Przyswa wrote: > > > >Unless your program is getting back the rows as name value pairs and picking > > through what gets sent back, you want to be specifying the columns and the order > > that they are to be sent back, not asking for everything and assuming that the > > order and number of the fields is what you think might be there. > > > > Sure it's easiest to SELECT named fields as SELECT * and use raw[x] to get the > > value. Our main goal it's to speed up DBmail and any suggestions are welcome ! > > > > That is not the easiest method, because unless you're getting it as an > associative array (name/val pairs, etc) Then you have no idea if raw[4] > is really what you expect on every installation (someone may have added > a field they need to the table). That is why the inserts and selects > only ask for the columns they need in the order they need. So that the > underlying table can be changed and not botch the whole system. > > > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] Imapd is slow as hell
On 25/9/02 4:21 AM, "Roel Rozendaal" <[EMAIL PROTECTED]> wrote: > The basic layout for dbmail was based upon pop3 but we are interested in > better schemes for imap. One of the main goals right now is to have the > fastest imap server around. Better table layouts would mean a great > improvement; just don't know how much time will be involved in > implementing those. > Things to do right now in my opinion are to fix annoying bugs and update > the package with the several patches we have to release a STABLE 1.0 > version asap. One annoying bug I've notices is the mis-match between the status and flag_read fields. When you use POP and keep messages on server, all the messages are set to be read by setting status to 02. However, Imap only seems to look at the flag_read field, which is not updated by the POP session. Suggest either syncing the two fields, or at least getting rid of flag_read. /Mark