On Thu 27-06-13 09:24:26, Dave Chinner wrote: > On Wed, Jun 26, 2013 at 10:15:09AM +0200, Michal Hocko wrote: > > On Tue 25-06-13 12:27:54, Dave Chinner wrote: > > > On Tue, Jun 18, 2013 at 03:50:25PM +0200, Michal Hocko wrote: > > > > And again, another hang. It looks like the inode deletion never > > > > finishes. The good thing is that I do not see any LRU related BUG_ONs > > > > anymore. I am going to test with the other patch in the thread. > > > > > > > > 2476 [<ffffffff8118325e>] __wait_on_freeing_inode+0x9e/0xc0 <<< > > > > waiting for an inode to go away > > > > [<ffffffff81183321>] find_inode_fast+0xa1/0xc0 > > > > [<ffffffff8118525f>] iget_locked+0x4f/0x180 > > > > [<ffffffff811ef9e3>] ext4_iget+0x33/0x9f0 > > > > [<ffffffff811f6a1c>] ext4_lookup+0xbc/0x160 > > > > [<ffffffff81174ad0>] lookup_real+0x20/0x60 > > > > [<ffffffff81177e25>] lookup_open+0x175/0x1d0 > > > > [<ffffffff8117815e>] do_last+0x2de/0x780 <<< > > > > holds i_mutex > > > > [<ffffffff8117ae9a>] path_openat+0xda/0x400 > > > > [<ffffffff8117b303>] do_filp_open+0x43/0xa0 > > > > [<ffffffff81168ee0>] do_sys_open+0x160/0x1e0 > > > > [<ffffffff81168f9c>] sys_open+0x1c/0x20 > > > > [<ffffffff81582fe9>] system_call_fastpath+0x16/0x1b > > > > [<ffffffffffffffff>] 0xffffffffffffffff > > > > > > I don't think this has anything to do with LRUs. > > > > I am not claiming that. It might be a timing issue which never mattered > > but it is strange I can reproduce this so easily and repeatedly with the > > shrinkers patchset applied. > > As I said earlier, this might be breakage in my -mm tree as well > > (missing some patch which didn't go via Andrew or misapplied patch). The > > situation is worsen by the state of linux-next which has some unrelated > > issues. > > > > I really do not want to delay the whole patchset just because of some > > problem on my side. Do you have any tree that I should try to test? > > No, I've just been testing Glauber's tree and sending patches for > problems back to him based on it. > > > > I won't have seen this on XFS stress testing, because it doesn't use > > > the VFS inode hashes for inode lookups. Given that XFS is not > > > triggering either problem you are seeing, that makes me think > > > > I haven't tested with xfs. > > That might be worthwhile if you can easily do that - another data > point indicating a hang or absence of a hang will help point us in > the right direction here...
OK, still hanging (with inode_lru_isolate-fix.patch). It is not the same thing, though, as xfs seem to do lookup slightly differently. 12467 [<ffffffffa02ca03e>] xfs_iget+0xbe/0x190 [xfs] [<ffffffffa02d6e98>] xfs_lookup+0xe8/0x110 [xfs] [<ffffffffa02cdad9>] xfs_vn_lookup+0x49/0x90 [xfs] [<ffffffff81174ad0>] lookup_real+0x20/0x60 [<ffffffff81177e25>] lookup_open+0x175/0x1d0 [<ffffffff8117815e>] do_last+0x2de/0x780 [<ffffffff8117ae9a>] path_openat+0xda/0x400 [<ffffffff8117b303>] do_filp_open+0x43/0xa0 [<ffffffff81168ee0>] do_sys_open+0x160/0x1e0 [<ffffffff81168f9c>] sys_open+0x1c/0x20 [<ffffffff815830e9>] system_call_fastpath+0x16/0x1b [<ffffffffffffffff>] 0xffffffffffffffff 12667 [<ffffffffa02ca03e>] xfs_iget+0xbe/0x190 [xfs] [<ffffffffa02d6e98>] xfs_lookup+0xe8/0x110 [xfs] [<ffffffffa02cdad9>] xfs_vn_lookup+0x49/0x90 [xfs] [<ffffffff81174ad0>] lookup_real+0x20/0x60 [<ffffffff81177e25>] lookup_open+0x175/0x1d0 [<ffffffff8117815e>] do_last+0x2de/0x780 [<ffffffff8117ae9a>] path_openat+0xda/0x400 [<ffffffff8117b303>] do_filp_open+0x43/0xa0 [<ffffffff81168ee0>] do_sys_open+0x160/0x1e0 [<ffffffff81168f9c>] sys_open+0x1c/0x20 [<ffffffff815830e9>] system_call_fastpath+0x16/0x1b [<ffffffffffffffff>] 0xffffffffffffffff 13830 [<ffffffffa02ca03e>] xfs_iget+0xbe/0x190 [xfs] [<ffffffffa02d6e98>] xfs_lookup+0xe8/0x110 [xfs] [<ffffffffa02cdad9>] xfs_vn_lookup+0x49/0x90 [xfs] [<ffffffff81174ad0>] lookup_real+0x20/0x60 [<ffffffff81175254>] __lookup_hash+0x34/0x40 [<ffffffff81179872>] path_lookupat+0x7a2/0x830 [<ffffffff81179933>] filename_lookup+0x33/0xd0 [<ffffffff8117ab0b>] user_path_at_empty+0x7b/0xb0 [<ffffffff8117ab4c>] user_path_at+0xc/0x10 [<ffffffff81169c30>] sys_faccessat+0xe0/0x230 [<ffffffff81169d93>] sys_access+0x13/0x20 [<ffffffff815830e9>] system_call_fastpath+0x16/0x1b [<ffffffffffffffff>] 0xffffffffffffffff 13913 [<ffffffffa02ca03e>] xfs_iget+0xbe/0x190 [xfs] [<ffffffffa02d6e98>] xfs_lookup+0xe8/0x110 [xfs] [<ffffffffa02cdad9>] xfs_vn_lookup+0x49/0x90 [xfs] [<ffffffff81174ad0>] lookup_real+0x20/0x60 [<ffffffff81177e25>] lookup_open+0x175/0x1d0 [<ffffffff8117815e>] do_last+0x2de/0x780 [<ffffffff8117ae9a>] path_openat+0xda/0x400 [<ffffffff8117b303>] do_filp_open+0x43/0xa0 [<ffffffff81168ee0>] do_sys_open+0x160/0x1e0 [<ffffffff81168f9c>] sys_open+0x1c/0x20 [<ffffffff815830e9>] system_call_fastpath+0x16/0x1b [<ffffffffffffffff>] 0xffffffffffffffff 14245 [<ffffffff81178144>] do_last+0x2c4/0x780 [<ffffffff8117ae9a>] path_openat+0xda/0x400 [<ffffffff8117b303>] do_filp_open+0x43/0xa0 [<ffffffff81168ee0>] do_sys_open+0x160/0x1e0 [<ffffffff81168f9c>] sys_open+0x1c/0x20 [<ffffffff815830e9>] system_call_fastpath+0x16/0x1b [<ffffffffffffffff>] 0xffffffffffffffff 14365 [<ffffffffa02ca03e>] xfs_iget+0xbe/0x190 [xfs] [<ffffffffa02d6e98>] xfs_lookup+0xe8/0x110 [xfs] [<ffffffffa02cdad9>] xfs_vn_lookup+0x49/0x90 [xfs] [<ffffffff81174ad0>] lookup_real+0x20/0x60 [<ffffffff81177e25>] lookup_open+0x175/0x1d0 [<ffffffff8117815e>] do_last+0x2de/0x780 [<ffffffff8117ae9a>] path_openat+0xda/0x400 [<ffffffff8117b303>] do_filp_open+0x43/0xa0 [<ffffffff81168ee0>] do_sys_open+0x160/0x1e0 [<ffffffff81168f9c>] sys_open+0x1c/0x20 [<ffffffff815830e9>] system_call_fastpath+0x16/0x1b [<ffffffffffffffff>] 0xffffffffffffffff 14384 [<ffffffff81179862>] path_lookupat+0x792/0x830 [<ffffffff81179933>] filename_lookup+0x33/0xd0 [<ffffffff8117ab0b>] user_path_at_empty+0x7b/0xb0 [<ffffffff8117ab4c>] user_path_at+0xc/0x10 [<ffffffff8116ff91>] vfs_fstatat+0x51/0xb0 [<ffffffff81170116>] vfs_stat+0x16/0x20 [<ffffffff8117013f>] sys_newstat+0x1f/0x50 [<ffffffff815830e9>] system_call_fastpath+0x16/0x1b [<ffffffffffffffff>] 0xffffffffffffffff 14413 [<ffffffff81179862>] path_lookupat+0x792/0x830 [<ffffffff81179933>] filename_lookup+0x33/0xd0 [<ffffffff8117ab0b>] user_path_at_empty+0x7b/0xb0 [<ffffffff8117ab4c>] user_path_at+0xc/0x10 [<ffffffff8116ff91>] vfs_fstatat+0x51/0xb0 [<ffffffff81170116>] vfs_stat+0x16/0x20 [<ffffffff8117013f>] sys_newstat+0x1f/0x50 [<ffffffff815830e9>] system_call_fastpath+0x16/0x1b [<ffffffffffffffff>] 0xffffffffffffffff -- Michal Hocko SUSE Labs -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
