Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread James Peach
On 5/11/06, Jeremy Allison [EMAIL PROTECTED] wrote: On Wed, May 10, 2006 at 12:29:53PM -0400, Claus Lund wrote: Well, then Windows Explorer is braindamaged as well (which is a claim I won't contest ;) )... because it's slow deleting files right through Explorer as well. Yep - I completely

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Jeremy Allison
On Fri, May 12, 2006 at 12:50:37AM +1000, James Peach wrote: On 5/11/06, Jeremy Allison [EMAIL PROTECTED] wrote: On Wed, May 10, 2006 at 12:29:53PM -0400, Claus Lund wrote: Well, then Windows Explorer is braindamaged as well (which is a claim I won't contest ;) )... because it's slow

RE: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Claus Lund
sounds like samba is recreating the directory hash for change notifies It only does that every 30 seconds or so - so I don't think that is the problem (although turning if off might prove me wrong). Jeremy. How can I turn that off? I'm willing to do any testing on this issue that you

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread William Jojo
- Original Message - From: Jeremy Allison [EMAIL PROTECTED] To: James Peach [EMAIL PROTECTED] Cc: Jeremy Allison [EMAIL PROTECTED]; Claus Lund [EMAIL PROTECTED]; samba@lists.samba.org; [EMAIL PROTECTED] Sent: Thursday, May 11, 2006 11:30 AM Subject: Re: [Samba] Performance issue on AIX

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Jeremy Allison
On Thu, May 11, 2006 at 11:37:50AM -0400, Claus Lund wrote: sounds like samba is recreating the directory hash for change notifies It only does that every 30 seconds or so - so I don't think that is the problem (although turning if off might prove me wrong). Jeremy. How can I

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Jeremy Allison
On Thu, May 11, 2006 at 11:45:34AM -0400, William Jojo wrote: I'm looking into this here. Are you referring to stat cache? I've confirmed that 150k statx's are being done after each delete request. I mocked it up here on JFS2 and JFS. I'm mocking is up now in FC3/4 on ext3 to see if this is

RE: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Claus Lund
sounds like samba is recreating the directory hash for change notifies It only does that every 30 seconds or so - so I don't think that is the problem (although turning if off might prove me wrong). Jeremy. How can I turn that off? I'm willing to do any testing on

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Jeremy Allison
On Thu, May 11, 2006 at 12:33:59PM -0400, Claus Lund wrote: sounds like samba is recreating the directory hash for change notifies It only does that every 30 seconds or so - so I don't think that is the problem (although turning if off might prove me wrong). Jeremy.

RE: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Claus Lund
Ok, so it isn't the change notify effect James suspected You are using the canonicalized case settings and case sensitive settings needed for large directories aren't you ? I tried changing the settings per this HOWTO:

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Jeremy Allison
On Thu, May 11, 2006 at 12:55:04PM -0400, Claus Lund wrote: Ok, so it isn't the change notify effect James suspected You are using the canonicalized case settings and case sensitive settings needed for large directories aren't you ? I tried changing the settings per this

RE: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Claus Lund
Ok, so it isn't the change notify effect James suspected You are using the canonicalized case settings and case sensitive settings needed for large directories aren't you ? I tried changing the settings per this HOWTO:

RE: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Claus Lund
Confirmed on FC3/ext3 and AIX/JFS2/JFS. statx's still being done between deletes. I'm using same settings as Claus and all files are in the form file%d (0 through 14). Now for me the initial display of files is ~30 seconds. AIX delete shows a slow meter with 20,15,... seconds remaining.

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread James Peach
On 5/12/06, Jeremy Allison [EMAIL PROTECTED] wrote: On Fri, May 12, 2006 at 12:50:37AM +1000, James Peach wrote: On 5/11/06, Jeremy Allison [EMAIL PROTECTED] wrote: On Wed, May 10, 2006 at 12:29:53PM -0400, Claus Lund wrote: Well, then Windows Explorer is braindamaged as well (which is a

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-11 Thread Jeremy Allison
On Fri, May 12, 2006 at 11:43:39AM +1000, James Peach wrote: IIRC, after each delete, the change notify fires and the client then reapplies it causing the hash to be recreated. Yeah, that's what I just realized and mentioned to Bill. I'm working on fixing this... Jeremy. -- To unsubscribe

[Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Claus Lund
Server: - AIX5.3 with JFS2 file systems - IBM pSeries 520 (1.9GHz p5+ CPU) - Samba 3.0.22 (and the same problem exists in 3.0.21a) - I tested Samba compiled from sources with GCC 4.0.2 and 3.4.3 same result for both. I also downloaded the AIX binary from

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Jeremy Allison
On Wed, May 10, 2006 at 10:17:53AM -0400, Claus Lund wrote: We have an application that creates a large number of files in a single directory. At peak times the number of files in that directory get up around 150,000. The files are around 10-200KB in size. When I try to delete files out of

RE: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Claus Lund
We have an application that creates a large number of files in a single directory. At peak times the number of files in that directory get up around 150,000. The files are around 10-200KB in size. When I try to delete files out of that directory then things get really slow ... up to

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Jeremy Allison
On Wed, May 10, 2006 at 12:29:53PM -0400, Claus Lund wrote: Well, then Windows Explorer is braindamaged as well (which is a claim I won't contest ;) )... because it's slow deleting files right through Explorer as well. Yep - I completely agree Explorer is braindamaged. That's probably the

RE: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Claus Lund
Well, it looks like a Samba problem to me (or maybe a compiler/compiler optimization problem?). I'm trying to get Samba compiled using IBM's XLC instead of GCC in the hopes that XLC might produce faster running binaries ... but unfortunately that seems like a somewhat involved task (Samba

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Jeremy Allison
On Wed, May 10, 2006 at 01:14:08PM -0400, Claus Lund wrote: I agree that it's not a Samba logic problem ... more like a Samba porting problem? And I don't think we can just blame JFS2 and/or AIX either because deleting files in that directory directly on the box or even through NFS is orders

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Eric Warnke
Could this have anything to do with the SYNC problem that was brought to light in the past two weeks? Maybe AIX/jfs is doing dome additional processing in order to flush the disks. I know that ext3 can do write combining that may be driving down the cost of the SYNC. I'm not saying that my bet

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Jeremy Allison
On Wed, May 10, 2006 at 01:53:07PM -0400, Eric Warnke wrote: Could this have anything to do with the SYNC problem that was brought to light in the past two weeks? Maybe AIX/jfs is doing dome additional processing in order to flush the disks. I know that ext3 can do write combining that may

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Eric Warnke
- Samba 3.0.22 (and the same problem exists in 3.0.21a) So the SYNC could be the issue then no? Cheers, Eric On 5/10/06, Jeremy Allison [EMAIL PROTECTED] wrote: Possible, but I thought he was using 3.0.14a which doesn't have the O_SYNC problem. Jeremy. -- To unsubscribe from this list go

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Volker Lendecke
On Wed, May 10, 2006 at 02:18:58PM -0400, Eric Warnke wrote: - Samba 3.0.22 (and the same problem exists in 3.0.21a) So the SYNC could be the issue then no? It could, but the best way to know whether it is we need a truss, as William wrote. Volker pgpU53Jw7YP9N.pgp Description: PGP

RE: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Claus Lund
Hi Bill, I already tried updating AIX. I'm on 5300-04 (only a couple of security related fixes added since the tech level) on my production box (we're using Samba 3.0.21a on that box). And I'm on the latest Technology Level + all the latest fixes on my test box (and that's where I currently have

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread William Jojo
- Original Message - From: Claus Lund [EMAIL PROTECTED] To: William Jojo [EMAIL PROTECTED]; Jeremy Allison [EMAIL PROTECTED] Cc: [EMAIL PROTECTED]; samba@lists.samba.org Sent: Wednesday, May 10, 2006 2:29 PM Subject: RE: [Samba] Performance issue on AIX when deleting files in a directory

Re: [Samba] Performance issue on AIX when deleting files in a directory with a large number of files

2006-05-10 Thread Jeremy Allison
On Wed, May 10, 2006 at 02:18:58PM -0400, Eric Warnke wrote: - Samba 3.0.22 (and the same problem exists in 3.0.21a) So the SYNC could be the issue then no? Yes, the bug is in 3.0.22. It doesn't affect delete though, only writes. Jeremy. -- To unsubscribe from this list go to the following