Running out of memory for mysql(dump)
I've asked this question on the mysql-users list, but there wasn't any more information than what I've seen on google. The problem is that I get an error when trying to use mysqldump to get a backup of our RT Attachments table (all other tables will process fine) /usr/local/bin/mysqldump: Error 5: Out of memory (Needed 14154840 bytes) when dumping table `Attachments` at row: 24285 mysql Ver 12.22 Distrib 4.0.24, for portbld-freebsd5.3 (i386) mysqldump Ver 10.9 Distrib 4.1.12, for portbld-freebsd5.3 (i386) and mysqldump Ver 9.11 Distrib 4.0.24, for portbld-freebsd5.3 (i386) There are pages in the mysql online docs about setting variables in /boot/loader.conf to avoid the 512MB per-process limit in FreeBSD: seisei# more /boot/loader.conf set console=comconsole kern.maxdsiz="1G" # kern.dfldsiz="751619277" # 750 MB kern.maxssiz="134217728" # 128MB No change after reboot. FreeBSD seisei.cs.myharris.net 5.3-RELEASE-p9 FreeBSD 5.3-RELEASE-p9 #0: Wed Apr 20 13:14:54 EDT 2005 [EMAIL PROTECTED]:/usr/obj/usr/src/sys/GENERIC i386 vm.vmtotal: System wide totals computed every five seconds: (values in kilobytes) === Processes: (RUNQ: 1 Disk Wait: 0 Page Wait: 0 Sleep: 58) Virtual Memory: (Total: 1823K, Active 1132540K) Real Memory:(Total: 1009492K Active 708436K) Shared Virtual Memory: (Total: 40948K Active: 26944K) Shared Real Memory: (Total: 37572K Active: 24768K) Free Memory Pages: 48428K Any suggestions for dealing with this? Thanks, Graham ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Running out of memory
On Thu, 5 May 2005 11:39:05 -1000 Clifton Royston <[EMAIL PROTECTED]> wrote: > On Thu, May 05, 2005 at 04:08:00PM -0500, Jacob S wrote: > > This server's hosting about 250 websites - the majority being poorly > > written php, and incoming e-mail for those domains. It has cPanel > > installed, so incoming e-mail goes through exim, spamassassin and > > clamav, but outgoing uses qmail and qmqp to let another server do > > the hard(er) delivery work. > > If you aren't limiting queue concurrency to a fairly modest value, I > would suspect SpamAssassin is consuming most of the RAM. (And CPU.) > SA is a pig. I would hate it if it didn't do such a useful job. :-) We just noticed several users with full mailboxes as well, which backs up the Exim queue and uses more ram. And of course, these are the people that are currently getting spammed heavily. So, I should have some good starting points for minimizing load. Thanks, Jacob ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Running out of memory
On Thu, May 05, 2005 at 04:08:00PM -0500, Jacob S wrote: > This server's hosting about 250 websites - the majority being poorly > written php, and incoming e-mail for those domains. It has cPanel > installed, so incoming e-mail goes through exim, spamassassin and > clamav, but outgoing uses qmail and qmqp to let another server do the > hard(er) delivery work. If you aren't limiting queue concurrency to a fairly modest value, I would suspect SpamAssassin is consuming most of the RAM. (And CPU.) SA is a pig. I would hate it if it didn't do such a useful job. :-) -- Clifton -- Clifton Royston -- [EMAIL PROTECTED] Tiki Technologies Lead Programmer/Software Architect "I'm gonna tell my son to grow up pretty as the grass is green And whip-smart as the English Channel's wide..." -- 'Whip-Smart', Liz Phair ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Running out of memory
On Thu, 5 May 2005 13:33:04 -0500 "Andrew L. Gould" <[EMAIL PROTECTED]> wrote: > On Thursday 05 May 2005 09:59 am, Jacob S wrote: > > I've got a server that keeps running out of memory and crashing. It > > has 1GB of swap and 1GB of ram. I originally made the swap the same > > size as the ram, as my previous experience with *nix machines was > > that when swap is double the size of ram, the computer is almost > > totally unuseable for at least 30 minutes whenever the computer > > needs to clean out swap. > > > > Has anyone else seen this problem, or is it safe for me to add > > another GB of swap? > > > > Also, I made the mistake of partitioning all the space on the hard > > drive, with only 1GB set aside for swap. How big of a performance > > hit would it be to use a swap file instead of a swap partition? Is > > there an easy (and safe!) way to resize partitions so that I could > > add in a second swap partition? > > What is it that you're doing that would use up so much RAM and swap? > Was the high swap usage expected? This server's hosting about 250 websites - the majority being poorly written php, and incoming e-mail for those domains. It has cPanel installed, so incoming e-mail goes through exim, spamassassin and clamav, but outgoing uses qmail and qmqp to let another server do the hard(er) delivery work. It stays busy enough to keep a 2Mbps connection close to its limit and Apache is usually pretty close to its 375 client limit. The server is a 2.8Ghz Xeon running FreeBSD 5.3. The load is not totally unexpected, as we have been watching the load increase as more sites were added. We will probably end up dumping another GB of ram on it before long. Thanks, Jacob ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Running out of memory
On Thu, May 05, 2005 at 09:59:27AM -0500, Jacob S wrote: > I've got a server that keeps running out of memory and crashing. It has > 1GB of swap and 1GB of ram. I originally made the swap the same size as > the ram, as my previous experience with *nix machines was that when swap > is double the size of ram, the computer is almost totally unuseable for > at least 30 minutes whenever the computer needs to clean out swap. FreeBSD doesn't ever "clean out swap", so I have no idea what you mean by this. > Also, I made the mistake of partitioning all the space on the hard > drive, with only 1GB set aside for swap. How big of a performance hit > would it be to use a swap file instead of a swap partition? There is a performance hit, but you have to remember that if your machine is swapping heavily *at all* it means you're overloading it and performance will be in the toilet. Kris pgpm3yRxHZYjm.pgp Description: PGP signature
Re: Running out of memory
On Thursday 05 May 2005 09:59 am, Jacob S wrote: > I've got a server that keeps running out of memory and crashing. It > has 1GB of swap and 1GB of ram. I originally made the swap the same > size as the ram, as my previous experience with *nix machines was > that when swap is double the size of ram, the computer is almost > totally unuseable for at least 30 minutes whenever the computer needs > to clean out swap. > > Has anyone else seen this problem, or is it safe for me to add > another GB of swap? > > Also, I made the mistake of partitioning all the space on the hard > drive, with only 1GB set aside for swap. How big of a performance hit > would it be to use a swap file instead of a swap partition? Is there > an easy (and safe!) way to resize partitions so that I could add in a > second swap partition? > > TIA, > Jacob What is it that you're doing that would use up so much RAM and swap? Was the high swap usage expected? Andrew Gould ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Running out of memory
On 5/5/2005 20:29, Jacob S wrote: I've got a server that keeps running out of memory and crashing. It has 1GB of swap and 1GB of ram. I originally made the swap the same size as the ram, as my previous experience with *nix machines was that when swap is double the size of ram, the computer is almost totally unuseable for at least 30 minutes whenever the computer needs to clean out swap. Has anyone else seen this problem, or is it safe for me to add another GB of swap? Also, I made the mistake of partitioning all the space on the hard drive, with only 1GB set aside for swap. How big of a performance hit would it be to use a swap file instead of a swap partition? Is there an easy (and safe!) way to resize partitions so that I could add in a second swap partition? TIA, Jacob ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" My box has 2GB of physical RAM and 4 GB of swap spread across 3 SATA drives. I havent seen any lockups. Regards S. -- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Running out of memory
I've got a server that keeps running out of memory and crashing. It has 1GB of swap and 1GB of ram. I originally made the swap the same size as the ram, as my previous experience with *nix machines was that when swap is double the size of ram, the computer is almost totally unuseable for at least 30 minutes whenever the computer needs to clean out swap. Has anyone else seen this problem, or is it safe for me to add another GB of swap? Also, I made the mistake of partitioning all the space on the hard drive, with only 1GB set aside for swap. How big of a performance hit would it be to use a swap file instead of a swap partition? Is there an easy (and safe!) way to resize partitions so that I could add in a second swap partition? TIA, Jacob ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
