Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-20 Thread Andrew Guertin
On 08/18/2011 10:38 AM, Chris Mason wrote: Excerpts from Andrew Guertin's message of 2011-08-11 21:13:18 -0400: On 08/09/2011 05:29 PM, Andrew Guertin wrote: I have not tried 3.1-rc1, but plan to soon. I've tested now, this does still occur in 3.1-rc1. Ok, I had high hopes that the btrfs ch

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-19 Thread Anand Jain
Andrew, Facing some challenges to test this. If you have a chance to test it again, the following output will be interesting to observe. iostat -ctx -p sda 3 > /tmp/iostat.out Also note your system time when this problem occurs, (iostat has time stamp, I wish see the waitQ and activeQ a

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-19 Thread Chris Samuel
On 18/08/11 16:58, youagree wrote: > Are these processes principally btrfs-submit and btrfs-transacti > in particular? > > Then it may be related to my very similar issue reported earlier. I spent a little bit of time last night looking at it and it seems that what I'm seeing also affects ext4 o

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Chris Mason
Excerpts from Andrew Guertin's message of 2011-08-11 21:13:18 -0400: > On 08/09/2011 05:29 PM, Andrew Guertin wrote: > > I have not tried 3.1-rc1, but plan to soon. > > I've tested now, this does still occur in 3.1-rc1. Ok, I had high hopes that the btrfs changes in rc1 would fix this. Could you

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Andrew Guertin
On 08/18/2011 03:29 AM, Andrew Guertin wrote: > I have not seen slowdowns on 2.6.38. More specifically, I observe the > following behaviors after commit 4e69b59: > > * Many processes occasionally hang for a short time > * When this happens, my cpu monitor shows a short burst of cpu activity > (100

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread youagree
On 08/18/2011 09:29 AM, Andrew Guertin wrote: > * Many processes occasionally hang for a short time > * When this happens, my cpu monitor shows a short burst of cpu activity > (100% of 1 core) followed by a longer period of IO > * When this happens, iotop shows [btrfs-submit-0] and [btrfs-transacti

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Andrew Guertin
On 08/17/2011 10:41 PM, Anand Jain wrote: Dave, good to have a test case on the 3.0 kernel. do you have btrfs as root fs ? and can you show how are you using the btrfs mainly I would need 'btrfs fi show' let me try if I can reproduce. Thanks, Anand Personally, I find that large compiles are v

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Andrew Guertin
On 08/18/2011 02:44 AM, youagree wrote: Also, a patch by Josef Bacik was an attempt for fixing this, but no one reported about testing it on an affected system, it did not eliminate the slowdowns for me: PLEASE TEST: Everybody who is seeing weird and long hangs news://news.gmane.org:119/4e36c47e

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread youagree
Are these processes principally btrfs-submit and btrfs-transacti in particular? Then it may be related to my very similar issue reported earlier. On 08/18/2011 08:47 AM, Chris Samuel wrote: > On 18/08/11 00:29, Michael Cronenworth wrote: > >> I'm running kernel 3.0 (Fedora 15's 2.6.40) on two b

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Chris Samuel
On 18/08/11 00:29, Michael Cronenworth wrote: > I'm running kernel 3.0 (Fedora 15's 2.6.40) on two boxes > and I have not seen slow downs or hangs. I use Firefox. I've got btrfs on an external USB drive with the 3.0.1 kernel and I see that sync seems to take an age, according to iotop it seems th

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread youagree
This is most probably related to the same regression seen after 2.6.38, my blocked comment on 3 August included an indication to that the behavior was present in my distro 2.6.38 kernel too, it just was appearing after a considerably longer uptime (on my desktop system using btrfs as rootfs on an I

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Anand Jain
Dave, good to have a test case on the 3.0 kernel. do you have btrfs as root fs ? and can you show how are you using the btrfs mainly I would need 'btrfs fi show' let me try if I can reproduce. Thanks, Anand I've been simply living with this issue. I can reproduce it by rsyncing very la

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Dave
On Wed, Aug 17, 2011 at 10:38:42AM -0400, Andrew Guertin wrote: > Well I'd expect it to be somewhat uncommon, or it wouldn't survive 3 > kernel versions :) But at least 3 people have reported it, and for me at > least it's reliably reproducible enough to bisect, so I'm quite certain > there's somet

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Andrew Guertin
On 08/17/2011 10:29 AM, Michael Cronenworth wrote: > Andrew Guertin on 08/17/2011 09:24 AM wrote: >> I (and presumably others) haven't >> been able to upgrade my kernel past 2.6.38 because of this. > > I'm running kernel 3.0 (Fedora 15's 2.6.40) on two boxes and I have not > seen slow downs or han

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Michael Cronenworth
Andrew Guertin on 08/17/2011 09:24 AM wrote: I (and presumably others) haven't been able to upgrade my kernel past 2.6.38 because of this. I'm running kernel 3.0 (Fedora 15's 2.6.40) on two boxes and I have not seen slow downs or hangs. I use Firefox. -- To unsubscribe from this list: send th

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Andrew Guertin
On 08/09/2011 05:29 PM, Andrew Guertin wrote: > On 06/21/2011 01:15 PM, Jan Stilow wrote: >> Hello, >> >> Nirbheek Chauhan gentoo.org> writes: >>> [...] >>> >>> Every few minutes, (I guess) when applications do fsync (firefox, >>> xchat, vim, etc), all applications that use fsync() hang for severa

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-11 Thread Andrew Guertin
On 08/09/2011 05:29 PM, Andrew Guertin wrote: > I have not tried 3.1-rc1, but plan to soon. I've tested now, this does still occur in 3.1-rc1. --Andrew -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo in

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-09 Thread Andrew Guertin
On 06/21/2011 01:15 PM, Jan Stilow wrote: > Hello, > > Nirbheek Chauhan gentoo.org> writes: >> [...] >> >> Every few minutes, (I guess) when applications do fsync (firefox, >> xchat, vim, etc), all applications that use fsync() hang for several >> seconds, and applications that use general IO suf

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-03 Thread mck
On Mon, 2011-07-18 at 14:17 -0400, Josef Bacik wrote: > I've been looking into this and I have a suspicion. Would you run > with this patch and see if the problem goes away? Didn't help me. 2.6.39 is not usable. 3.0.0 is ok for a few hours then too becomes unusable. This is discussed in future

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-07-20 Thread Nirbheek Chauhan
On Mon, Jul 18, 2011 at 11:47 PM, Josef Bacik wrote: > On 06/06/2011 06:58 PM, Nirbheek Chauhan wrote: >> What can I do to debug this issue? What other information should I >> supply? Could someone guide me on how to figure out why my machine is >> unusable now? > > I've been looking into this and

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-07-18 Thread Josef Bacik
On 06/06/2011 06:58 PM, Nirbheek Chauhan wrote: > Hello list, > > I've been using btrfs on my personal machines for about two years now, > and on this machine for about a year with absolutely no problems. > Infact, it has held up better than ext4 with regards to reliability. > > However, recently

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-07-18 Thread Mck
On Tue, 2011-06-07 at 04:28 +0530, Nirbheek Chauhan wrote: > Every few minutes, (I guess) when applications do fsync (firefox, > xchat, vim, etc), all applications that use fsync() hang for several > seconds, and applications that use general IO suffer extreme > slowdowns. iotop shows various combi

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-06-21 Thread Jan Stilow
Hello, Nirbheek Chauhan gentoo.org> writes: > However, recently, perhaps with 2.6.39, or after I quickly started > filling up my disk again, it has become impossible for me to work for > long periods on my machine. > > Every few minutes, (I guess) when applications do fsync (firefox, > xchat, vim

Applications using fsync cause hangs for several seconds every few minutes

2011-06-06 Thread Nirbheek Chauhan
Hello list, I've been using btrfs on my personal machines for about two years now, and on this machine for about a year with absolutely no problems. Infact, it has held up better than ext4 with regards to reliability. However, recently, perhaps with 2.6.39, or after I quickly started filling up m