Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-08-05 Thread Gioh Kim
2014-08-02 오전 1:04, Peter Zijlstra 쓴 글: On Fri, Aug 01, 2014 at 05:24:59PM +0200, Jan Kara wrote: OK, makes sense. But then if there's heavy IO going on, anything that has IO pending on it is pinned and IO completion can easily take something close to a second or more. So meeting subsecond

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-08-01 Thread Peter Zijlstra
On Fri, Aug 01, 2014 at 05:24:59PM +0200, Jan Kara wrote: > OK, makes sense. But then if there's heavy IO going on, anything that has > IO pending on it is pinned and IO completion can easily take something > close to a second or more. So meeting subsecond deadlines may be tough even > for ordin

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-08-01 Thread Jan Kara
On Fri 01-08-14 15:36:18, Peter Zijlstra wrote: > On Fri, Aug 01, 2014 at 11:57:00AM +0200, Jan Kara wrote: > > So the quiestion really is how hard guarantee do you need that a page in > > movable zone is really movable. Or better in what timeframe should it be > > movable? It may be possible to ma

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-08-01 Thread Peter Zijlstra
On Fri, Aug 01, 2014 at 11:57:00AM +0200, Jan Kara wrote: > So the quiestion really is how hard guarantee do you need that a page in > movable zone is really movable. Or better in what timeframe should it be > movable? It may be possible to make e.g. migratepage callback for ext4 > blkdev pages whi

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-08-01 Thread Jan Kara
On Fri 01-08-14 10:06:40, Gioh Kim wrote: > Function path is like followings: > > [ 97.868304] [<8011a750>] (drop_buffers+0xfc/0x168) from [<8011bc64>] > (try_to_free_buffers+0x50/0xbc) > [ 97.877457] [<8011bc64>] (try_to_free_buffers+0x50/0xbc) from [<80121e40>] > (blkdev_releasepage+0x38/0

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-08-01 Thread Jan Kara
On Fri 01-08-14 17:34:46, Joonsoo Kim wrote: > On Thu, Jul 31, 2014 at 02:21:14PM +0200, Jan Kara wrote: > > On Thu 31-07-14 09:37:15, Gioh Kim wrote: > > > > > > > > > 2014-07-31 오전 9:03, Jan Kara 쓴 글: > > > >On Thu 31-07-14 08:54:40, Gioh Kim wrote: > > > >>2014-07-30 오후 7:11, Jan Kara 쓴 글: > >

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-08-01 Thread Joonsoo Kim
On Thu, Jul 31, 2014 at 02:21:14PM +0200, Jan Kara wrote: > On Thu 31-07-14 09:37:15, Gioh Kim wrote: > > > > > > 2014-07-31 오전 9:03, Jan Kara 쓴 글: > > >On Thu 31-07-14 08:54:40, Gioh Kim wrote: > > >>2014-07-30 오후 7:11, Jan Kara 쓴 글: > > >>>On Wed 30-07-14 16:44:24, Gioh Kim wrote: > > 2014-

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-31 Thread Gioh Kim
2014-08-01 오전 9:07, Gioh Kim 쓴 글: 2014-07-31 오후 9:21, Jan Kara 쓴 글: On Thu 31-07-14 09:37:15, Gioh Kim wrote: 2014-07-31 오전 9:03, Jan Kara 쓴 글: On Thu 31-07-14 08:54:40, Gioh Kim wrote: 2014-07-30 오후 7:11, Jan Kara 쓴 글: On Wed 30-07-14 16:44:24, Gioh Kim wrote: 2014-07-22 오후 6:38, Jan

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-31 Thread Gioh Kim
2014-07-31 오후 9:21, Jan Kara 쓴 글: On Thu 31-07-14 09:37:15, Gioh Kim wrote: 2014-07-31 오전 9:03, Jan Kara 쓴 글: On Thu 31-07-14 08:54:40, Gioh Kim wrote: 2014-07-30 오후 7:11, Jan Kara 쓴 글: On Wed 30-07-14 16:44:24, Gioh Kim wrote: 2014-07-22 오후 6:38, Jan Kara 쓴 글: On Tue 22-07-14 09:30:05,

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-31 Thread Jan Kara
On Thu 31-07-14 09:37:15, Gioh Kim wrote: > > > 2014-07-31 오전 9:03, Jan Kara 쓴 글: > >On Thu 31-07-14 08:54:40, Gioh Kim wrote: > >>2014-07-30 오후 7:11, Jan Kara 쓴 글: > >>>On Wed 30-07-14 16:44:24, Gioh Kim wrote: > 2014-07-22 오후 6:38, Jan Kara 쓴 글: > >On Tue 22-07-14 09:30:05, Peter Zijlst

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Gioh Kim
2014-07-31 오전 9:03, Jan Kara 쓴 글: On Thu 31-07-14 08:54:40, Gioh Kim wrote: 2014-07-30 오후 7:11, Jan Kara 쓴 글: On Wed 30-07-14 16:44:24, Gioh Kim wrote: 2014-07-22 오후 6:38, Jan Kara 쓴 글: On Tue 22-07-14 09:30:05, Peter Zijlstra wrote: On Tue, Jul 22, 2014 at 02:18:47PM +0900, Gioh Kim wrote

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Jan Kara
On Thu 31-07-14 08:54:40, Gioh Kim wrote: > 2014-07-30 오후 7:11, Jan Kara 쓴 글: > >On Wed 30-07-14 16:44:24, Gioh Kim wrote: > >>2014-07-22 오후 6:38, Jan Kara 쓴 글: > >>>On Tue 22-07-14 09:30:05, Peter Zijlstra wrote: > On Tue, Jul 22, 2014 at 02:18:47PM +0900, Gioh Kim wrote: > >Hello, > >

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Gioh Kim
2014-07-30 오후 7:11, Jan Kara 쓴 글: On Wed 30-07-14 16:44:24, Gioh Kim wrote: 2014-07-22 오후 6:38, Jan Kara 쓴 글: On Tue 22-07-14 09:30:05, Peter Zijlstra wrote: On Tue, Jul 22, 2014 at 02:18:47PM +0900, Gioh Kim wrote: Hello, This patch try to solve problem that a long-lasting page cache of e

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Gioh Kim
2014-07-30 오후 7:19, Peter Zijlstra 쓴 글: On Wed, Jul 30, 2014 at 12:11:43PM +0200, Jan Kara wrote: sb_bread allocates page from movable area but it is not movable until the reference counter of the buffer-head becomes zero. There is no lock for the buffer but the reference counter acts like loc

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Peter Zijlstra
On Wed, Jul 30, 2014 at 12:11:43PM +0200, Jan Kara wrote: > > sb_bread allocates page from movable area but it is not movable until the > > reference counter of the buffer-head becomes zero. > > There is no lock for the buffer but the reference counter acts like lock. > OK, but why do you care ab

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Jan Kara
On Wed 30-07-14 16:44:24, Gioh Kim wrote: > 2014-07-22 오후 6:38, Jan Kara 쓴 글: > >On Tue 22-07-14 09:30:05, Peter Zijlstra wrote: > >>On Tue, Jul 22, 2014 at 02:18:47PM +0900, Gioh Kim wrote: > >>>Hello, > >>> > >>>This patch try to solve problem that a long-lasting page cache of > >>>ext4 superbloc

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Kyungmin Park
Adding Marek & Tomasz, On Wed, Jul 30, 2014 at 4:44 PM, Gioh Kim wrote: > > > 2014-07-22 오후 6:38, Jan Kara 쓴 글: > >> On Tue 22-07-14 09:30:05, Peter Zijlstra wrote: >>> >>> On Tue, Jul 22, 2014 at 02:18:47PM +0900, Gioh Kim wrote: Hello, This patch try to solve problem that a

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Gioh Kim
2014-07-27 오전 10:01, Theodore Ts'o 쓴 글: Gioh, As follow up, if you want some further discussions about why these patches should be accepted, it would be good to get some hard data about why the keeping the ext4 superblock pinned is causing such a problem for page migation. Can you give us mor

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-30 Thread Gioh Kim
2014-07-22 오후 6:38, Jan Kara 쓴 글: On Tue 22-07-14 09:30:05, Peter Zijlstra wrote: On Tue, Jul 22, 2014 at 02:18:47PM +0900, Gioh Kim wrote: Hello, This patch try to solve problem that a long-lasting page cache of ext4 superblock disturbs page migration. I've been testing CMA feature on my A

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-26 Thread Theodore Ts'o
Gioh, As follow up, if you want some further discussions about why these patches should be accepted, it would be good to get some hard data about why the keeping the ext4 superblock pinned is causing such a problem for page migation. Can you give us more details about what the impact is of not ha

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-22 Thread Jan Kara
On Tue 22-07-14 09:30:05, Peter Zijlstra wrote: > On Tue, Jul 22, 2014 at 02:18:47PM +0900, Gioh Kim wrote: > > Hello, > > > > This patch try to solve problem that a long-lasting page cache of > > ext4 superblock disturbs page migration. > > > > I've been testing CMA feature on my ARM-based platf

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-22 Thread Theodore Ts'o
On Tue, Jul 22, 2014 at 09:30:05AM +0200, Peter Zijlstra wrote: > > I introduce a new API for allocating page from non-movable area. > > It is useful for ext4 and others that want to hold page cache for a long > > time. > > There's no word on why you can't teach ext4 to still migrate that page. >

Re: [PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-22 Thread Peter Zijlstra
On Tue, Jul 22, 2014 at 02:18:47PM +0900, Gioh Kim wrote: > Hello, > > This patch try to solve problem that a long-lasting page cache of > ext4 superblock disturbs page migration. > > I've been testing CMA feature on my ARM-based platform > and found some pages for page caches cannot be migrated.

[PATCH 0/2] new API to allocate buffer-cache for superblock in non-movable area

2014-07-21 Thread Gioh Kim
Hello, This patch try to solve problem that a long-lasting page cache of ext4 superblock disturbs page migration. I've been testing CMA feature on my ARM-based platform and found some pages for page caches cannot be migrated. Some of them are page caches of superblock of ext4 filesystem. Current