Re: [U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Dan Fitzgerald
Other users could have been hanging at malloc. With a swappiness of 100 (on some kernels) or 100 (on others) or "not 0 or 100"(not sure which behavior you get on 2.6.18), pages wouldn't be getting freed up quickly enough duing the creation/copying of a large file. Another thing to look at (al

Re: [U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Wols Lists
On 04/02/13 21:34, Perry Taylor wrote: > Yes we are on RH support. I'll run it by them and see. Again, this is from memory, but I think somebody noticed that copying a single very large file brought a system to its knees until the copy finished, and the whole thing spiralled from there. Probably

Re: [U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Perry Taylor
Yes we are on RH support. I'll run it by them and see. Thanks. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists Sent: Monday, February 04, 2013 2:15 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] [

Re: [U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Perry Taylor
70. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan Fitzgerald Sent: Monday, February 04, 2013 2:06 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] [UV] Large File Operations Kill Linux What's the value i

Re: [U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Wols Lists
On 04/02/13 21:05, Dan Fitzgerald wrote: > > What's the value in /proc/sys/vm/swappiness? How will that make any difference? 2.6.18-348 SOUNDS like an ancient (in linux terms) kernel. Are you on RedHat support? This is a problem with the linux kernel that was addressed recently, iirc. Large amou

Re: [U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Dan Fitzgerald
What's the value in /proc/sys/vm/swappiness? > From: perry.tay...@zirmed.com > To: u2-users@listserver.u2ug.org > Date: Mon, 4 Feb 2013 20:53:13 + > Subject: Re: [U2] [UV] Large File Operations Kill Linux > > We're on RHEL5 (2.6.18-348.el5), ext3 and 132GB ram. > > -Original Message---

Re: [U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Perry Taylor
We're on RHEL5 (2.6.18-348.el5), ext3 and 132GB ram. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Monday, February 04, 2013 9:23 AM To: 'U2 Users List' Subject: Re: [U2] [UV] Large File Operatio

Re: [U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Symeon Breen
A few questions - What linux version/distro are you on and what type of file system, and how much ram do you have -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Perry Taylor Sent: 04 February 2013 15:57 To: U2-Users

[U2] [UV] Large File Operations Kill Linux

2013-02-04 Thread Perry Taylor
Looking for some ideas on how to keep Linux from becoming largely unresponsive when creating large files. What happens is as the new file is being created the I/O buffer cache quickly fills up with dirty buffers. Until the kernel can flush these out to disk there is no avail buffers for I/O op