Re: high memory problems with imap

2003-12-06 Thread Russell Coker
On Sat, 6 Dec 2003 12:16, Theodore Knab [EMAIL PROTECTED] wrote:
 I have a courier/postfix maildir IMAP mail server with 10GB of RAM.

 Occasionally, the memory gets all chewed up and it becomes unusable. I
 think it becoming unusable because of buffer bounces.
 However, the documentation tells me that the
 virtual memory allocation and bounce buffer problem was fixed in 2001.

My experience is that the problem you describe was occurring in the latest 
2.4.x kernels in late 2002 and early 2003.

It is fixed in the Red Hat and SUSE kernel trees, at the time I had the 
problem I used a SUSE kernel to fix it.  Today I would probably use a Red Hat 
kernel instead.

For such things instead of trying to patch a Debian kernel source tree or a 
kernel.org tree I recommend taking a working and tested kernel source tree 
such as that from Red Hat (which also fixes other bugs that may affect you in 
future).

-- 
http://www.coker.com.au/selinux/   My NSA Security Enhanced Linux packages
http://www.coker.com.au/bonnie++/  Bonnie++ hard drive benchmark
http://www.coker.com.au/postal/Postal SMTP/POP benchmark
http://www.coker.com.au/~russell/  My home page


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



Re: high memory problems with imap

2003-12-06 Thread Russell Coker
On Sat, 6 Dec 2003 22:36, [EMAIL PROTECTED] (Donovan Baarda) wrote:
 On Sat, Dec 06, 2003 at 06:19:23PM +1100, Russell Coker wrote:
  For such things instead of trying to patch a Debian kernel source tree or
  a kernel.org tree I recommend taking a working and tested kernel source
  tree such as that from Red Hat (which also fixes other bugs that may
  affect you in future).

 Man, that's sad... a Debian list having to recommend a RedHat kernel...

Look on the bright side.  At least you know that on a Debian list you'll get 
the best answer on technical merits.

Producing a good kernel for serious server use is a lot of work.  Red Hat has 
many good kernel coders working 40+ hours a week on back-porting code from 
2.6, writing drivers for various unsupported hardware, and merging the best 
patches that float by the l-k list.

There's no reason for Debian to try to reproduce this effort, the Red Hat 
kernel source is entirely GPL, there's no reason not to use it.  I've been 
meaning to package it for Debian...

-- 
http://www.coker.com.au/selinux/   My NSA Security Enhanced Linux packages
http://www.coker.com.au/bonnie++/  Bonnie++ hard drive benchmark
http://www.coker.com.au/postal/Postal SMTP/POP benchmark
http://www.coker.com.au/~russell/  My home page


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



Re: high memory problems with imap

2003-12-06 Thread Donovan Baarda
On Sat, Dec 06, 2003 at 06:19:23PM +1100, Russell Coker wrote:
 On Sat, 6 Dec 2003 12:16, Theodore Knab [EMAIL PROTECTED] wrote:
[...]
 For such things instead of trying to patch a Debian kernel source tree or a 
 kernel.org tree I recommend taking a working and tested kernel source tree 
 such as that from Red Hat (which also fixes other bugs that may affect you in 
 future).

Man, that's sad... a Debian list having to recommend a RedHat kernel...



-- 

Donovan Baardahttp://minkirri.apana.org.au/~abo/



-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



Re:

2003-12-06 Thread Bryan Allen
On Dec 6, 2003, at 12:45 AM, Ramadoss B wrote:
I need to find the current cpu ( memory) usage on my
machine, as a percentage, can anyone help ?
man top
--
bda
Cyberpunk is dead.  Long live cyberpunk.
http://mirrorshades.org
--
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]


Re:

2003-12-06 Thread Steve Kemp
On Sat, Dec 06, 2003 at 07:27:31AM +0100, Robert Cates wrote:

 the 'top' command may be what you want.
 The very first line gives you the 'uptime' (another command).
 There's also memory usage info very much the same to that of 'free' (another
 command).

  A more graphical solution such as phpsysinfo might also be
 useful.
 
Steve
--


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



duplicating servers - remote backup to HD

2003-12-06 Thread W.D.McKinney
Hello,

I'd like to backup a couple of Debian Woody servers remotely to my a
Storage array that I was given recently. The servers are are at a local
colo and I nad a xDSL connection provided by the ISP that serves the
Colo so that's good. I am thinking that someone might have an rysnc
script that are using like this ? Is there one available any where ?

Thanks,
Dee

-- 
Alaska Wireless Systems
http://www.akwireless.net 


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



Re: duplicating servers - remote backup to HD

2003-12-06 Thread George Georgalis
On Sat, Dec 06, 2003 at 01:33:32PM -0900, W.D.McKinney wrote:
Hello,

I'd like to backup a couple of Debian Woody servers remotely to my a
Storage array that I was given recently. The servers are are at a local
colo and I nad a xDSL connection provided by the ISP that serves the
Colo so that's good. I am thinking that someone might have an rysnc
script that are using like this ? Is there one available any where ?



Sure, here's what I use for taking an image of a system. If you plan
to restore from your backup don't exclude your hostname, ssh host
keys, etc. You do want to exclude /proc and any NFS etc though. And
don't forget '--numeric-ids' as the specific numbers are referenced in
/etc/{passwd,group}

rsync -av --progress --delete-excluded --numeric-ids \
--exclude=**/cdrom/* \
--exclude=**/etc/hostname \
--exclude=**/etc/mtab \
--exclude=**/etc/network/interfaces \
--exclude=**/floppy/* \
--exclude=**/var/lock/* \
--exclude=.bash_history \
--exclude=.viminfo \
--exclude=/.ssh/id* \
--exclude=/etc/**/[EMAIL PROTECTED] \
--exclude=/etc/**/current \
--exclude=/etc/ssh/ssh_host_dsa_key \
--exclude=/etc/ssh/ssh_host_dsa_key.pub \
--exclude=/etc/ssh/ssh_host_rsa_key \
--exclude=/etc/ssh/ssh_host_rsa_key.pub \
--exclude=/supervise/status \
--exclude=/tmp/* \
--exclude=/var/backups/*gz \
--exclude=/var/log/**/[EMAIL PROTECTED] \
--exclude=/var/log/**/current \
--exclude=/var/log/dmesg \
--exclude=/var/run/*pid \
--exclude=/var/tmp/* \
--exclude=dhclient.leases \
--exclude=dhcpd.leases \
--exclude=known_hosts \
--exclude=locatedb \
--exclude=ntp.drift \
--exclude=proc/* \
--exclude=random-seed \
--exclude=utmp \
--exclude=wtmp \
$src $dest

you'll need -essh and root on both sides to read/create all the uids.

Caveat emperor and you may still have some problems with daemontools
control files being included...

// George


-- 
GEORGE GEORGALIS, System Admin/Architectcell: 646-331-2027IXOYE
Security Services, Web, Mail,mailto:[EMAIL PROTECTED] 
Multimedia, DB, DNS and Metrics.   http://www.galis.org/george 


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



Re: duplicating servers - remote backup to HD

2003-12-06 Thread Chris Wagner
Do you mean that you want to send a backup (i.e. tarball) to the remote
storage or do you mean that you want to keep a live synchronized copy
(rsync) on the remote storage?  The former is easier and will probably give
u everything u want.  I don't really see any need for an rsync unless you
want some kind of hot standby setup.






--
REMEMBER THE WORLD TRADE CENTER ---= WTC 911 =--
...ne cede males

0100


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



Re: high memory problems with imap

2003-12-06 Thread Theodore Knab
Thanks, that sounds like a perfectly good way to solve the problem.

I never thought to use another distro's kernel. 

I guess it does not really hurt anything to use the RedHat kernel on a
Debian system. Actually, I forgot that RedHat has been making a big effort to 
create a kernel that would run high memory Oracle systems.

Thus, RedHat probably has the most experienced kernel package developers for
high memory support.

 Producing a good kernel for serious server use is a lot of work.  Red
 Hat has
 many good kernel coders working 40+ hours a week on back-porting code
 from
 2.6, writing drivers for various unsupported hardware, and merging the
 best
 patches that float by the l-k list.

 There's no reason for Debian to try to reproduce this effort, the Red
 Hat
 kernel source is entirely GPL, there's no reason not to use it.  I've
 been
 meaning to package it for Debian...


-- 
--
Ted Knab
Chester, MD 21619

--
940216d6021602a41607166696c656c202778696368602d65616e637
02940226c696e646c69702c6f667560256675627478696e67602a416
0716e6563756e2a0


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



Re: duplicating servers - remote backup to HD

2003-12-06 Thread W.D.McKinney
On Sat, 2003-12-06 at 17:20, Chris Wagner wrote:
 Do you mean that you want to send a backup (i.e. tarball) to the remote
 storage or do you mean that you want to keep a live synchronized copy
 (rsync) on the remote storage?  The former is easier and will probably give
 u everything u want.  I don't really see any need for an rsync unless you
 want some kind of hot standby setup.
 

Good Points, may be a tar bar would be better. Nothing like getting
opinions.

Dee 

-- 
Alaska Wireless Systems
http://www.akwireless.net -=- Take Control of Your E-Mail!
(907)349-4308 Office - AIM = awswired


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



Re: duplicating servers - remote backup to HD

2003-12-06 Thread W.D.McKinney
On Sat, 2003-12-06 at 14:23, George Georgalis wrote:
 On Sat, Dec 06, 2003 at 01:33:32PM -0900, W.D.McKinney wrote:
 Hello,
 
 I'd like to backup a couple of Debian Woody servers remotely to my a
 Storage array that I was given recently. The servers are are at a local
 colo and I nad a xDSL connection provided by the ISP that serves the
 Colo so that's good. I am thinking that someone might have an rysnc
 script that are using like this ? Is there one available any where ?
 
 
 
 Sure, here's what I use for taking an image of a system. If you plan
 to restore from your backup don't exclude your hostname, ssh host
 keys, etc. You do want to exclude /proc and any NFS etc though. And
 don't forget '--numeric-ids' as the specific numbers are referenced in
 /etc/{passwd,group}
 
 rsync -av --progress --delete-excluded --numeric-ids \
 --exclude=**/cdrom/* \
 --exclude=**/etc/hostname \
 --exclude=**/etc/mtab \
 --exclude=**/etc/network/interfaces \
 --exclude=**/floppy/* \
 --exclude=**/var/lock/* \
 --exclude=.bash_history \
 --exclude=.viminfo \
 --exclude=/.ssh/id* \
 --exclude=/etc/**/[EMAIL PROTECTED] \
 --exclude=/etc/**/current \
 --exclude=/etc/ssh/ssh_host_dsa_key \
 --exclude=/etc/ssh/ssh_host_dsa_key.pub \
 --exclude=/etc/ssh/ssh_host_rsa_key \
 --exclude=/etc/ssh/ssh_host_rsa_key.pub \
 --exclude=/supervise/status \
 --exclude=/tmp/* \
 --exclude=/var/backups/*gz \
 --exclude=/var/log/**/[EMAIL PROTECTED] \
 --exclude=/var/log/**/current \
 --exclude=/var/log/dmesg \
 --exclude=/var/run/*pid \
 --exclude=/var/tmp/* \
 --exclude=dhclient.leases \
 --exclude=dhcpd.leases \
 --exclude=known_hosts \
 --exclude=locatedb \
 --exclude=ntp.drift \
 --exclude=proc/* \
 --exclude=random-seed \
 --exclude=utmp \
 --exclude=wtmp \
 $src $dest
 
 you'll need -essh and root on both sides to read/create all the uids.
 
 Caveat emperor and you may still have some problems with daemontools
 control files being included...
 

Hi George,

Hey thanks I will try this as well. Good to hear from twice in a week
:-)

Dee


-- 
Alaska Wireless Systems
http://www.akwireless.net -=- Take Control of Your E-Mail!
(907)349-4308 Office - AIM = awswired


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]



[no subject]

2003-12-06 Thread Ramadoss B
 Hi,

I need to find the current cpu ( memory) usage on my
machine, as a percentage, can anyone help ?

Regards,

B. Ramadoss
System Admin.






Re: high memory problems with imap

2003-12-06 Thread Russell Coker
On Sat, 6 Dec 2003 12:16, Theodore Knab [EMAIL PROTECTED] wrote:
 I have a courier/postfix maildir IMAP mail server with 10GB of RAM.

 Occasionally, the memory gets all chewed up and it becomes unusable. I
 think it becoming unusable because of buffer bounces.
 However, the documentation tells me that the
 virtual memory allocation and bounce buffer problem was fixed in 2001.

My experience is that the problem you describe was occurring in the latest 
2.4.x kernels in late 2002 and early 2003.

It is fixed in the Red Hat and SUSE kernel trees, at the time I had the 
problem I used a SUSE kernel to fix it.  Today I would probably use a Red Hat 
kernel instead.

For such things instead of trying to patch a Debian kernel source tree or a 
kernel.org tree I recommend taking a working and tested kernel source tree 
such as that from Red Hat (which also fixes other bugs that may affect you in 
future).

-- 
http://www.coker.com.au/selinux/   My NSA Security Enhanced Linux packages
http://www.coker.com.au/bonnie++/  Bonnie++ hard drive benchmark
http://www.coker.com.au/postal/Postal SMTP/POP benchmark
http://www.coker.com.au/~russell/  My home page




Re: high memory problems with imap

2003-12-06 Thread Donovan Baarda
On Sat, Dec 06, 2003 at 06:19:23PM +1100, Russell Coker wrote:
 On Sat, 6 Dec 2003 12:16, Theodore Knab [EMAIL PROTECTED] wrote:
[...]
 For such things instead of trying to patch a Debian kernel source tree or a 
 kernel.org tree I recommend taking a working and tested kernel source tree 
 such as that from Red Hat (which also fixes other bugs that may affect you in 
 future).

Man, that's sad... a Debian list having to recommend a RedHat kernel...



-- 

Donovan Baardahttp://minkirri.apana.org.au/~abo/





Re:

2003-12-06 Thread Bryan Allen
On Dec 6, 2003, at 12:45 AM, Ramadoss B wrote:
I need to find the current cpu ( memory) usage on my
machine, as a percentage, can anyone help ?
man top
--
bda
Cyberpunk is dead.  Long live cyberpunk.
http://mirrorshades.org



duplicating servers - remote backup to HD

2003-12-06 Thread W.D.McKinney
Hello,

I'd like to backup a couple of Debian Woody servers remotely to my a
Storage array that I was given recently. The servers are are at a local
colo and I nad a xDSL connection provided by the ISP that serves the
Colo so that's good. I am thinking that someone might have an rysnc
script that are using like this ? Is there one available any where ?

Thanks,
Dee

-- 
Alaska Wireless Systems
http://www.akwireless.net 




Re: duplicating servers - remote backup to HD

2003-12-06 Thread George Georgalis
On Sat, Dec 06, 2003 at 01:33:32PM -0900, W.D.McKinney wrote:
Hello,

I'd like to backup a couple of Debian Woody servers remotely to my a
Storage array that I was given recently. The servers are are at a local
colo and I nad a xDSL connection provided by the ISP that serves the
Colo so that's good. I am thinking that someone might have an rysnc
script that are using like this ? Is there one available any where ?



Sure, here's what I use for taking an image of a system. If you plan
to restore from your backup don't exclude your hostname, ssh host
keys, etc. You do want to exclude /proc and any NFS etc though. And
don't forget '--numeric-ids' as the specific numbers are referenced in
/etc/{passwd,group}

rsync -av --progress --delete-excluded --numeric-ids \
--exclude=**/cdrom/* \
--exclude=**/etc/hostname \
--exclude=**/etc/mtab \
--exclude=**/etc/network/interfaces \
--exclude=**/floppy/* \
--exclude=**/var/lock/* \
--exclude=.bash_history \
--exclude=.viminfo \
--exclude=/.ssh/id* \
--exclude=/etc/**/[EMAIL PROTECTED] \
--exclude=/etc/**/current \
--exclude=/etc/ssh/ssh_host_dsa_key \
--exclude=/etc/ssh/ssh_host_dsa_key.pub \
--exclude=/etc/ssh/ssh_host_rsa_key \
--exclude=/etc/ssh/ssh_host_rsa_key.pub \
--exclude=/supervise/status \
--exclude=/tmp/* \
--exclude=/var/backups/*gz \
--exclude=/var/log/**/[EMAIL PROTECTED] \
--exclude=/var/log/**/current \
--exclude=/var/log/dmesg \
--exclude=/var/run/*pid \
--exclude=/var/tmp/* \
--exclude=dhclient.leases \
--exclude=dhcpd.leases \
--exclude=known_hosts \
--exclude=locatedb \
--exclude=ntp.drift \
--exclude=proc/* \
--exclude=random-seed \
--exclude=utmp \
--exclude=wtmp \
$src $dest

you'll need -essh and root on both sides to read/create all the uids.

Caveat emperor and you may still have some problems with daemontools
control files being included...

// George


-- 
GEORGE GEORGALIS, System Admin/Architectcell: 646-331-2027IXOYE
Security Services, Web, Mail,mailto:[EMAIL PROTECTED] 
Multimedia, DB, DNS and Metrics.   http://www.galis.org/george 




Re: duplicating servers - remote backup to HD

2003-12-06 Thread Chris Wagner
Do you mean that you want to send a backup (i.e. tarball) to the remote
storage or do you mean that you want to keep a live synchronized copy
(rsync) on the remote storage?  The former is easier and will probably give
u everything u want.  I don't really see any need for an rsync unless you
want some kind of hot standby setup.






--
REMEMBER THE WORLD TRADE CENTER ---= WTC 911 =--
...ne cede males

0100




Re: high memory problems with imap

2003-12-06 Thread Theodore Knab
Thanks, that sounds like a perfectly good way to solve the problem.

I never thought to use another distro's kernel. 

I guess it does not really hurt anything to use the RedHat kernel on a
Debian system. Actually, I forgot that RedHat has been making a big effort to 
create a kernel that would run high memory Oracle systems.

Thus, RedHat probably has the most experienced kernel package developers for
high memory support.

 Producing a good kernel for serious server use is a lot of work.  Red
 Hat has
 many good kernel coders working 40+ hours a week on back-porting code
 from
 2.6, writing drivers for various unsupported hardware, and merging the
 best
 patches that float by the l-k list.

 There's no reason for Debian to try to reproduce this effort, the Red
 Hat
 kernel source is entirely GPL, there's no reason not to use it.  I've
 been
 meaning to package it for Debian...


-- 
--
Ted Knab
Chester, MD 21619

--
940216d6021602a41607166696c656c202778696368602d65616e637
02940226c696e646c69702c6f667560256675627478696e67602a416
0716e6563756e2a0