Re: [Dbmail] Performance Issues
probably the 64 mb that's nagging you. 7000 e-mail messages isn't that extreme, i've got much more in some of my folders, it works perfectly :D Eelco On zondag, feb 9, 2003, at 23:17 Europe/Amsterdam, Ulrich Spoerlein wrote: Ok, I wanted an overall solution for my Email "Problem". Problem, because I have about 7500 Emails in one folder (high-volume maillinglist). I know I could make "monthly-folders" but I don't like that approach. I always wanted Email to go into some sort of database and have IMAP as a front-end. Sadly the performance with such a system sucks :( Ok, I did the following, to get the Maildir Folder into the database (MySQL running on a P200, 64MB): foreach file in *;do cat $file|dbmail-smtp -u q; done I know, this approach is bound to suck, but after 2h all Emails were in (database size: 45MB). I then access my IMAP INBOX with Sylpheed from my Workstation via Fast-Ethernet. Took roughly a minute :( I then created a folder with the name of the mailinglist and tried to move all the Mails into that folder. After 3h I killed sylpheed and shut down dbmail+mysql. Is this slowness expected? Are you really using TCP for the database connect? Why not rely on Unix-sockets (should be faster, not?) Does anybody here have experience with bigger Mail folders on "home-sized servers"? ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail _ E.J.A. van Beek ICT Manager IC&S T: +31 30 2322878 F: +31 30 2322305 PGP-key: www.ic-s.nl/keys/eelco.txt
Re: [Dbmail] Performance Issues
hi a couple of weeks ago i had exactly the same problem. it took me "hours" to delete some mails via imap. i reported my problem to the mailinglist and got a "you have to purchase more rams" response. i upgraded the whole machine from pII 450/256mb ram to celeron 1700/256mb sdram. now it performes great! i'm still waiting for my new rams but it they arn't necessary any more. imho mysqld isnt a database which performes very well on "low-end workstations". the problem is definitively NOT! dbmail - the problem is the db (mysqld / postgresql) ! hope that helps you and doesn't cost you too much :) best regards, armin. Ulrich Spoerlein wrote: Ok, I wanted an overall solution for my Email "Problem". Problem, because I have about 7500 Emails in one folder (high-volume maillinglist). I know I could make "monthly-folders" but I don't like that approach. I always wanted Email to go into some sort of database and have IMAP as a front-end. Sadly the performance with such a system sucks :( Ok, I did the following, to get the Maildir Folder into the database (MySQL running on a P200, 64MB): foreach file in *;do cat $file|dbmail-smtp -u q; done I know, this approach is bound to suck, but after 2h all Emails were in (database size: 45MB). I then access my IMAP INBOX with Sylpheed from my Workstation via Fast-Ethernet. Took roughly a minute :( I then created a folder with the name of the mailinglist and tried to move all the Mails into that folder. After 3h I killed sylpheed and shut down dbmail+mysql. Is this slowness expected? Are you really using TCP for the database connect? Why not rely on Unix-sockets (should be faster, not?) Does anybody here have experience with bigger Mail folders on "home-sized servers"? ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] Performance Issues
Ok, I did the following, to get the Maildir Folder into the database (MySQL running on a P200, 64MB): foreach file in *;do cat $file|dbmail-smtp -u q; done There have been numerous complaints about the speed of IMAP in dbmail. I don't know if a definitive answer has ever been given but I remember somebody saying that the problems went away when they moved the database to a better box. Maybe p200 64MB is just not big enough to run dbmail especially if IMAP is needed. Can you do a top and tell us if your memory or CPU is overwhelmed? I remember somebody complaining about dbmail hogging the CPU once. :wq Tim Uckun US Investigations Services/Due Diligence http://www.diligence.com/
Re: [Dbmail] Performance Issues
Hello, You don't have to use tcp with mysql; we're running (or have run) several setups using unix sockets. Haven't tried it with recent cvs, but in older setups you just set MAIL_HOST and AUTH_HOST to "localhost" in config.h, and make sure mysql is setup to listen on a socket. Original Message From: Ulrich Spoerlein To: dbmail@dbmail.org Subject: Re: [Dbmail] Performance Issues Sent: Mon, 10 Feb 2003 19:10:26 +0100 > On Mon, 10.02.2003 at 10:46:14 -0700, Tim Uckun wrote: > > > > >Ok, I did the following, to get the Maildir Folder into the database > > >(MySQL running on a P200, 64MB): > > >foreach file in *;do cat $file|dbmail-smtp -u q; done > > > > There have been numerous complaints about the speed of IMAP in dbmail. I > > don't know if a definitive answer has ever been given but I remember > > somebody saying that the problems went away when they moved the database to > > a better box. Maybe p200 64MB is just not big enough to run dbmail > > especially if IMAP is needed. > > Can you do a top and tell us if your memory or CPU is overwhelmed? I > > remember somebody complaining about dbmail hogging the CPU once. > > I can't give you exact values right now, but during the mail "import" > dbmail & mysql the load was only 0.8. I think creating thousands of > sockets and IP packets just takes too long. Being able to connect to the > Database over TCP/IP _is_ nice, but where it isn't needed it slows > things down unnecessarily. > > When moving the mails inside the database, the load was 1.0 with mysql > grabbing all available CPU Power (didn't look for RAM usage :( > > Btw, I will install an additional 64MB sometime next week, the problem > is the small Cache Tag on that board, i.e. only the first 64MB are > cached :( > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail > -- End Original Message -- -- Jesse Norell [EMAIL PROTECTED]
Re: [Dbmail] Performance Issues
MySQL will try its level best to move the indexes into RAM and will keep as much of them there as possible. It will try to move the tables there as well, if it can. If your database is over 64 MB, you're in trouble. I don't know how many users you have or how big your mail spool is, but if you're going to be running a serious DB server, you need lots of RAM; half a GB or better. As always, ymmv. Also if you're running a more modern version of *nix/*nux, then you need RAM. I'm running RH8.0 on a PII-450 with 256MB of RAM as a development machine. It would run much better if I had more RAM and my databases aren't that big. Curtis Jesse Norell said: > > Hello, > > You don't have to use tcp with mysql; we're running (or have run) > several setups using unix sockets. Haven't tried it with recent > cvs, but in older setups you just set MAIL_HOST and AUTH_HOST to > "localhost" in config.h, and make sure mysql is setup to listen > on a socket. > > Original Message > From: Ulrich Spoerlein > To: dbmail@dbmail.org > Subject: Re: [Dbmail] Performance Issues > Sent: Mon, 10 Feb 2003 19:10:26 +0100 > >> On Mon, 10.02.2003 at 10:46:14 -0700, Tim Uckun wrote: >> > >> > >Ok, I did the following, to get the Maildir Folder into the >> > >database (MySQL running on a P200, 64MB): >> > >foreach file in *;do cat $file|dbmail-smtp -u q; done >> > >> > There have been numerous complaints about the speed of IMAP in >> > dbmail. I don't know if a definitive answer has ever been given but >> > I remember somebody saying that the problems went away when they >> > moved the database to a better box. Maybe p200 64MB is just not big >> > enough to run dbmail especially if IMAP is needed. >> > Can you do a top and tell us if your memory or CPU is overwhelmed? I >> > remember somebody complaining about dbmail hogging the CPU once. >> >> I can't give you exact values right now, but during the mail "import" >> dbmail & mysql the load was only 0.8. I think creating thousands of >> sockets and IP packets just takes too long. Being able to connect to >> the Database over TCP/IP _is_ nice, but where it isn't needed it slows >> things down unnecessarily. >> >> When moving the mails inside the database, the load was 1.0 with mysql >> grabbing all available CPU Power (didn't look for RAM usage :( >> >> Btw, I will install an additional 64MB sometime next week, the problem >> is the small Cache Tag on that board, i.e. only the first 64MB are >> cached :( >> ___ >> Dbmail mailing list >> Dbmail@dbmail.org >> https://mailman.fastxs.nl/mailman/listinfo/dbmail >> > -- End Original Message -- > > > -- > Jesse Norell > [EMAIL PROTECTED] > ___ > Dbmail mailing list > Dbmail@dbmail.org > https://mailman.fastxs.nl/mailman/listinfo/dbmail
