Re: Swapping caused by very large (regular) file size

2008-01-19 Thread Thomas Hurst
* Thomas Hurst ([EMAIL PROTECTED]) wrote: * Kris Kennaway ([EMAIL PROTECTED]) wrote: Excellent. I've been seeing this behavior for a long time, mostly on backup runs (RAID-1 amr SATA - 1 disk Marvell ata). It's pretty odd seeing a system with 8G of memory, 60% of which is just cache,

Re: Swapping caused by very large (regular) file size

2008-01-19 Thread Kris Kennaway
Thomas Hurst wrote: * Thomas Hurst ([EMAIL PROTECTED]) wrote: * Kris Kennaway ([EMAIL PROTECTED]) wrote: Excellent. I've been seeing this behavior for a long time, mostly on backup runs (RAID-1 amr SATA - 1 disk Marvell ata). It's pretty odd seeing a system with 8G of memory, 60% of which

Re: Swapping caused by very large (regular) file size

2008-01-19 Thread Kris Kennaway
Thomas Hurst wrote: * Kris Kennaway ([EMAIL PROTECTED]) wrote: I don't understand your test procedure, can you elaborate? The spikes from last night are from: (/sbin/dump -$level -LuaC128 -f - $fs | /usr/bin/tee ${target} | /sbin/sha1 ${target}.sha1) Followed by: nice -n 19

Re: Swapping caused by very large (regular) file size

2008-01-19 Thread Thomas Hurst
* Kris Kennaway ([EMAIL PROTECTED]) wrote: I don't understand your test procedure, can you elaborate? The spikes from last night are from: (/sbin/dump -$level -LuaC128 -f - $fs | /usr/bin/tee ${target} | /sbin/sha1 ${target}.sha1) Followed by: nice -n 19 /home/freaky/bin/par2 c -t+ -r5

Re: Swapping caused by very large (regular) file size

2008-01-16 Thread Thomas Hurst
* Kris Kennaway ([EMAIL PROTECTED]) wrote: Excellent. I've been seeing this behavior for a long time, mostly on backup runs (RAID-1 amr SATA - 1 disk Marvell ata). It's pretty odd seeing a system with 8G of memory, 60% of which is just cache, swap out half a dozen things for no apparant

Re: Swapping caused by very large (regular) file size

2008-01-16 Thread Adam McDougall
On Sat, Jan 12, 2008 at 12:05:38AM -0500, John Baldwin wrote: On Friday 11 January 2008 10:31:47 pm Peter Jeremy wrote: On Fri, Jan 11, 2008 at 06:44:20PM +0100, Kris Kennaway wrote: Ian West wrote: dd if=/dev/zero bs=32768 of=junkfile count=10 seems to do it quite reliably on

Re: Swapping caused by very large (regular) file size

2008-01-15 Thread Kris Kennaway
Thomas Hurst wrote: * John Baldwin ([EMAIL PROTECTED]) wrote: We have noticed an issue at work but only on faster controllers (e.g. certain mfi(4) drive configurations) when doing I/O to a single file like the dd command mentioned causes the buffer cache to fill up. The problem being that we

Re: Swapping caused by very large (regular) file size

2008-01-14 Thread Thomas Hurst
* John Baldwin ([EMAIL PROTECTED]) wrote: We have noticed an issue at work but only on faster controllers (e.g. certain mfi(4) drive configurations) when doing I/O to a single file like the dd command mentioned causes the buffer cache to fill up. The problem being that we can't lock the vm

Re: Swapping caused by very large (regular) file size

2008-01-11 Thread Kris Kennaway
Ian West wrote: Hello, I have noticed while benchmarking a system with a fair bit of ram (3G usable of 4G installed) that when using a very large file (3G upwards) in a simple benchmark it will cause the system to swap, even though the actual process does not show in top to be using a lot of

Re: Swapping caused by very large (regular) file size

2008-01-11 Thread Peter Jeremy
On Fri, Jan 11, 2008 at 06:44:20PM +0100, Kris Kennaway wrote: Ian West wrote: dd if=/dev/zero bs=32768 of=junkfile count=10 seems to do it quite reliably on all the boxes I have tested ? I am unable to reproduce this on 7.0. I can't reproduce it on 6.3-PRERELEASE/amd64 with 1GB RAM.

Re: Swapping caused by very large (regular) file size

2008-01-11 Thread John Baldwin
On Friday 11 January 2008 10:31:47 pm Peter Jeremy wrote: On Fri, Jan 11, 2008 at 06:44:20PM +0100, Kris Kennaway wrote: Ian West wrote: dd if=/dev/zero bs=32768 of=junkfile count=10 seems to do it quite reliably on all the boxes I have tested ? I am unable to reproduce this on 7.0.

Swapping caused by very large (regular) file size

2007-12-02 Thread Ian West
Hello, I have noticed while benchmarking a system with a fair bit of ram (3G usable of 4G installed) that when using a very large file (3G upwards) in a simple benchmark it will cause the system to swap, even though the actual process does not show in top to be using a lot of memory, as soon as