[WIP PATCHSET 1/4] blk-mq: pass bio to blk_mq_sched_get_rq_priv

2017-02-07 Thread Paolo Valente
bio is used in bfq-mq's get_rq_priv, to get the request group. We could pass directly the group here, but I thought that passing the bio was more general, giving the possibility to get other pieces of information if needed. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/

[WIP PATCHSET 1/4] blk-mq: pass bio to blk_mq_sched_get_rq_priv

2017-02-07 Thread Paolo Valente
bio is used in bfq-mq's get_rq_priv, to get the request group. We could pass directly the group here, but I thought that passing the bio was more general, giving the possibility to get other pieces of information if needed. Signed-off-by: Paolo Valente --- block/blk-mq-sched.c | 8

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-02 Thread Paolo Valente
> Il giorno 02 feb 2017, alle ore 16:30, Jens Axboe <ax...@fb.com> ha scritto: > > On 02/02/2017 02:19 AM, Paolo Valente wrote: >> The scheme is clear. One comment, in case it could make sense and >> avoid more complexity: since put_rq_priv is invoked in two dif

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-02 Thread Paolo Valente
> Il giorno 02 feb 2017, alle ore 16:30, Jens Axboe ha scritto: > > On 02/02/2017 02:19 AM, Paolo Valente wrote: >> The scheme is clear. One comment, in case it could make sense and >> avoid more complexity: since put_rq_priv is invoked in two different >> contex

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-02 Thread Paolo Valente
> Il giorno 02 feb 2017, alle ore 06:19, Jens Axboe <ax...@fb.com> ha scritto: > > On 02/01/2017 04:11 AM, Paolo Valente wrote: >>> +static bool dd_bio_merge(struct blk_mq_hw_ctx *hctx, struct bio *bio) >>> +{ >>> + struct request_queue *q = hctx-&g

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-02 Thread Paolo Valente
> Il giorno 02 feb 2017, alle ore 06:19, Jens Axboe ha scritto: > > On 02/01/2017 04:11 AM, Paolo Valente wrote: >>> +static bool dd_bio_merge(struct blk_mq_hw_ctx *hctx, struct bio *bio) >>> +{ >>> + struct request_queue *q = hctx->queue; >>

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-01 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- > block/Kconfig.iosched |

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-01 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- > block/Kconfig.iosched | 6 + > block/Makefile

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-01 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- > block/Kconfig.iosched |

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-01 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- > block/Kconfig.iosched | 6 + > block/Makefile

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-26 Thread Paolo Valente
> Il giorno 25 gen 2017, alle ore 17:13, Jens Axboe <ax...@fb.com> ha scritto: > > On 01/25/2017 01:46 AM, Paolo Valente wrote: >> >>> Il giorno 23 gen 2017, alle ore 18:42, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> On 01/23/2017 10:04

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-26 Thread Paolo Valente
> Il giorno 25 gen 2017, alle ore 17:13, Jens Axboe ha scritto: > > On 01/25/2017 01:46 AM, Paolo Valente wrote: >> >>> Il giorno 23 gen 2017, alle ore 18:42, Jens Axboe ha scritto: >>> >>> On 01/23/2017 10:04 AM, Paolo Valente wrote: >>>&

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-25 Thread Paolo Valente
> Il giorno 23 gen 2017, alle ore 18:42, Jens Axboe <ax...@fb.com> ha scritto: > > On 01/23/2017 10:04 AM, Paolo Valente wrote: >> >>> Il giorno 18 gen 2017, alle ore 17:21, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> On 01

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-25 Thread Paolo Valente
> Il giorno 23 gen 2017, alle ore 18:42, Jens Axboe ha scritto: > > On 01/23/2017 10:04 AM, Paolo Valente wrote: >> >>> Il giorno 18 gen 2017, alle ore 17:21, Jens Axboe ha scritto: >>> >>> On 01/18/2017 08:14 AM, Paolo Valente wrote: >>>&

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-23 Thread Paolo Valente
> Il giorno 18 gen 2017, alle ore 17:21, Jens Axboe <ax...@fb.com> ha scritto: > > On 01/18/2017 08:14 AM, Paolo Valente wrote: >> according to the function blk_mq_sched_put_request, the >> mq.completed_request hook seems to always be invoked (if set)

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-23 Thread Paolo Valente
> Il giorno 18 gen 2017, alle ore 17:21, Jens Axboe ha scritto: > > On 01/18/2017 08:14 AM, Paolo Valente wrote: >> according to the function blk_mq_sched_put_request, the >> mq.completed_request hook seems to always be invoked (if set) for a >> request for which th

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 20 gen 2017, alle ore 14:14, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > >> >> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >> >> This is basically identical to deadline-iosched, exc

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 20 gen 2017, alle ore 14:14, Paolo Valente > ha scritto: > >> >> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: >> >> This is basically identical to deadline-iosched, except it registers >> as a MQ capable schedul

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > Jens, no spin_lock_irq* in the code. So, also request dispatches are

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > Jens, no spin_lock_irq* in the code. So, also request dispatches are guaranteed to

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/22/2016 09:49 AM, Paolo Valente wrote: >> >>> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> This is basica

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe ha scritto: > > On 12/22/2016 09:49 AM, Paolo Valente wrote: >> >>> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: >>> >>> This is basically identical to deadline-iosched, except

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-18 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 11:49, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > > [NEW RESEND ATTEMPT] > >> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: >> >> On 12/22/2016 08:28 AM, Paolo Valente

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-18 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 11:49, Paolo Valente > ha scritto: > > [NEW RESEND ATTEMPT] > >> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe ha scritto: >> >> On 12/22/2016 08:28 AM, Paolo Valente wrote: >>> >>>> Il giorno 19

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-17 Thread Paolo Valente
[NEW RESEND ATTEMPT] > Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/22/2016 08:28 AM, Paolo Valente wrote: >> >>> Il giorno 19 dic 2016, alle ore 22:05, Jens Axboe <ax...@fb.com> ha scritto: >>> &g

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-17 Thread Paolo Valente
[NEW RESEND ATTEMPT] > Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe ha scritto: > > On 12/22/2016 08:28 AM, Paolo Valente wrote: >> >>> Il giorno 19 dic 2016, alle ore 22:05, Jens Axboe ha scritto: >>> >>> On 12/19/2016 11:21 AM, Paolo Valent

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2017-01-17 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/22/2016 04:13 AM, Paolo Valente wrote: >> >>> Il giorno 22 dic 2016, alle ore 10:59, Paolo Valente >>> <paolo.vale...@linaro.org> ha scritto: >>>

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2017-01-17 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe ha scritto: > > On 12/22/2016 04:13 AM, Paolo Valente wrote: >> >>> Il giorno 22 dic 2016, alle ore 10:59, Paolo Valente >>> ha scritto: >>> >>>> >>>> I

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2017-01-17 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/22/2016 02:59 AM, Paolo Valente wrote: >> >>> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> This adds a set of h

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2017-01-17 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe ha scritto: > > On 12/22/2016 02:59 AM, Paolo Valente wrote: >> >>> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: >>> >>> This adds a set of hooks that intercepts the blk-m

Re: [PATCHSET v6] blk-mq scheduling framework

2017-01-15 Thread Paolo Valente
> Il giorno 11 gen 2017, alle ore 22:39, Jens Axboe ha scritto: > > Another year, another posting of this patchset. The previous posting > was here: > > https://www.spinics.net/lists/kernel/msg2406106.html > > (yes, I've skipped v5, it was fixes on top of v4, not the rework). >

Re: [PATCHSET v6] blk-mq scheduling framework

2017-01-15 Thread Paolo Valente
> Il giorno 11 gen 2017, alle ore 22:39, Jens Axboe ha scritto: > > Another year, another posting of this patchset. The previous posting > was here: > > https://www.spinics.net/lists/kernel/msg2406106.html > > (yes, I've skipped v5, it was fixes on top of v4, not the rework). > > I've

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-23 Thread Paolo Valente
> Il giorno 22 dic 2016, alle ore 10:59, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > >> >> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >> >> This adds a set of hooks that intercepts the blk-mq path

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-23 Thread Paolo Valente
> Il giorno 22 dic 2016, alle ore 10:59, Paolo Valente > ha scritto: > >> >> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: >> >> This adds a set of hooks that intercepts the blk-mq path of >> allocating/inserting/issuing/complet

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > One last question (for today ...):in mq-deadline there are no "schedule

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > One last question (for today ...):in mq-deadline there are no "schedule dispatch" or

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- ... > diff --git

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- ... > diff --git a/block/mq-deadline.c

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-22 Thread Paolo Valente
> Il giorno 19 dic 2016, alle ore 22:05, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/19/2016 11:21 AM, Paolo Valente wrote: >> >>> Il giorno 19 dic 2016, alle ore 16:20, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> On 12/19/2016 04:32

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-22 Thread Paolo Valente
> Il giorno 19 dic 2016, alle ore 22:05, Jens Axboe ha scritto: > > On 12/19/2016 11:21 AM, Paolo Valente wrote: >> >>> Il giorno 19 dic 2016, alle ore 16:20, Jens Axboe ha scritto: >>> >>> On 12/19/2016 04:32 AM, Paolo Valente wrote: >>>&

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-22 Thread Paolo Valente
> Il giorno 21 dic 2016, alle ore 03:22, Jens Axboe <ax...@fb.com> ha scritto: > > On Tue, Dec 20 2016, Paolo Valente wrote: >>> + else >>> + rq = __blk_mq_alloc_request(data, op); >>> + >>> + if (rq) { >>> + rq-

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-22 Thread Paolo Valente
> Il giorno 21 dic 2016, alle ore 03:22, Jens Axboe ha scritto: > > On Tue, Dec 20 2016, Paolo Valente wrote: >>> + else >>> + rq = __blk_mq_alloc_request(data, op); >>> + >>> + if (rq) { >>> + rq->el

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-22 Thread Paolo Valente
> Il giorno 22 dic 2016, alle ore 10:59, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > >> >> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >> >> This adds a set of hooks that intercepts the blk-mq path

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-22 Thread Paolo Valente
> Il giorno 22 dic 2016, alle ore 10:59, Paolo Valente > ha scritto: > >> >> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: >> >> This adds a set of hooks that intercepts the blk-mq path of >> allocating/inserting/issuing/complet

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This adds a set of hooks that intercepts the blk-mq path of > allocating/inserting/issuing/completing requests, allowing > us to develop a scheduler within that framework. > > We reuse the existing elevator

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This adds a set of hooks that intercepts the blk-mq path of > allocating/inserting/issuing/completing requests, allowing > us to develop a scheduler within that framework. > > We reuse the existing elevator scheduler API on

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This adds a set of hooks that intercepts the blk-mq path of > allocating/inserting/issuing/completing requests, allowing > us to develop a scheduler within that framework. > > We reuse the existing elevator

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This adds a set of hooks that intercepts the blk-mq path of > allocating/inserting/issuing/completing requests, allowing > us to develop a scheduler within that framework. > > We reuse the existing elevator scheduler API on

Re: [PATCH 3/8] block: move rq_ioc() to blk.h

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > We want to use it outside of blk-core.c. > Hi Jens, no hooks equivalent to elevator_init_icq_fn and elevator_exit_icq_fn are invoked. In particular, the second hook let bfq (as with cfq) know when it could

Re: [PATCH 3/8] block: move rq_ioc() to blk.h

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > We want to use it outside of blk-core.c. > Hi Jens, no hooks equivalent to elevator_init_icq_fn and elevator_exit_icq_fn are invoked. In particular, the second hook let bfq (as with cfq) know when it could finally exit the

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > ... > + > +static bool

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > ... > + > +static bool dd_has_work(struct blk_mq_hw_ctx

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-19 Thread Paolo Valente
> Il giorno 19 dic 2016, alle ore 16:20, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/19/2016 04:32 AM, Paolo Valente wrote: >> >>> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> This is

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-19 Thread Paolo Valente
> Il giorno 19 dic 2016, alle ore 16:20, Jens Axboe ha scritto: > > On 12/19/2016 04:32 AM, Paolo Valente wrote: >> >>> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: >>> >>> This is version 4 of this patchset, version 3 was posted

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-19 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is version 4 of this patchset, version 3 was posted here: > > https://marc.info/?l=linux-block=148178513407631=2 > > From the discussion last time, I looked into the feasibility of having > two sets of tags

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-19 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is version 4 of this patchset, version 3 was posted here: > > https://marc.info/?l=linux-block=148178513407631=2 > > From the discussion last time, I looked into the feasibility of having > two sets of tags for the same

Re: [PATCHSET/RFC v2] blk-mq scheduling framework

2016-12-13 Thread Paolo Valente
> Il giorno 13 dic 2016, alle ore 16:17, Jens Axboe <ax...@fb.com> ha scritto: > > On Tue, Dec 13 2016, Paolo Valente wrote: >> >>> Il giorno 08 dic 2016, alle ore 21:13, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> As a followup to this

Re: [PATCHSET/RFC v2] blk-mq scheduling framework

2016-12-13 Thread Paolo Valente
> Il giorno 13 dic 2016, alle ore 16:17, Jens Axboe ha scritto: > > On Tue, Dec 13 2016, Paolo Valente wrote: >> >>> Il giorno 08 dic 2016, alle ore 21:13, Jens Axboe ha scritto: >>> >>> As a followup to this posting from yesterday: >>> >

Re: [PATCHSET/RFC v2] blk-mq scheduling framework

2016-12-13 Thread Paolo Valente
> Il giorno 08 dic 2016, alle ore 21:13, Jens Axboe ha scritto: > > As a followup to this posting from yesterday: > > https://marc.info/?l=linux-block=148115232806065=2 > > this is version 2. I wanted to post a new one fairly quickly, as there > ended up being a number of

Re: [PATCHSET/RFC v2] blk-mq scheduling framework

2016-12-13 Thread Paolo Valente
> Il giorno 08 dic 2016, alle ore 21:13, Jens Axboe ha scritto: > > As a followup to this posting from yesterday: > > https://marc.info/?l=linux-block=148115232806065=2 > > this is version 2. I wanted to post a new one fairly quickly, as there > ended up being a number of potential crashes in

Re: [PATCHSET/RFC v2] Make legacy IO schedulers work with blk-mq

2016-12-06 Thread Paolo Valente
> Il giorno 05 dic 2016, alle ore 19:26, Jens Axboe ha scritto: > > Version 2 of the hack/patchset, that enables blk-mq to use the legacy > IO schedulers with single queue devices. Original posting is here: > > https://marc.info/?l=linux-block=148073493203664=2 > > You can also

Re: [PATCHSET/RFC v2] Make legacy IO schedulers work with blk-mq

2016-12-06 Thread Paolo Valente
> Il giorno 05 dic 2016, alle ore 19:26, Jens Axboe ha scritto: > > Version 2 of the hack/patchset, that enables blk-mq to use the legacy > IO schedulers with single queue devices. Original posting is here: > > https://marc.info/?l=linux-block=148073493203664=2 > > You can also found this

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-29 Thread Paolo Valente
> Il giorno 29 ott 2016, alle ore 16:12, Jens Axboe <ax...@kernel.dk> ha > scritto: > > On 10/28/2016 11:38 PM, Paolo Valente wrote: >> >>> Il giorno 26 ott 2016, alle ore 18:12, Jens Axboe <ax...@kernel.dk> ha >>> scritto: >>> >&g

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-29 Thread Paolo Valente
> Il giorno 29 ott 2016, alle ore 16:12, Jens Axboe ha > scritto: > > On 10/28/2016 11:38 PM, Paolo Valente wrote: >> >>> Il giorno 26 ott 2016, alle ore 18:12, Jens Axboe ha >>> scritto: >>> >>> On 10/26/2016 10:04 AM, Paolo Valente wr

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-28 Thread Paolo Valente
> Il giorno 26 ott 2016, alle ore 18:12, Jens Axboe <ax...@kernel.dk> ha > scritto: > > On 10/26/2016 10:04 AM, Paolo Valente wrote: >> >>> Il giorno 26 ott 2016, alle ore 17:32, Jens Axboe <ax...@kernel.dk> ha >>> scritto: >>> >>

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-28 Thread Paolo Valente
> Il giorno 26 ott 2016, alle ore 18:12, Jens Axboe ha > scritto: > > On 10/26/2016 10:04 AM, Paolo Valente wrote: >> >>> Il giorno 26 ott 2016, alle ore 17:32, Jens Axboe ha >>> scritto: >>> >>> On 10/26/2016 09:29 AM, Christoph Hellwi

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-26 Thread Paolo Valente
> Il giorno 26 ott 2016, alle ore 17:32, Jens Axboe ha > scritto: > > On 10/26/2016 09:29 AM, Christoph Hellwig wrote: >> On Wed, Oct 26, 2016 at 05:13:07PM +0200, Arnd Bergmann wrote: >>> The question to ask first is whether to actually have pluggable >>> schedulers on blk-mq

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-26 Thread Paolo Valente
> Il giorno 26 ott 2016, alle ore 17:32, Jens Axboe ha > scritto: > > On 10/26/2016 09:29 AM, Christoph Hellwig wrote: >> On Wed, Oct 26, 2016 at 05:13:07PM +0200, Arnd Bergmann wrote: >>> The question to ask first is whether to actually have pluggable >>> schedulers on blk-mq at all, or just

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-26 Thread Paolo Valente
> Il giorno 26 ott 2016, alle ore 12:19, Christoph Hellwig > ha scritto: > > Just as last time: > > big NAK for introducing giant new infrastructure like a new I/O scheduler > for the legacy request structure. > I would fully agree, if there weren't important problems

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-26 Thread Paolo Valente
> Il giorno 26 ott 2016, alle ore 12:19, Christoph Hellwig > ha scritto: > > Just as last time: > > big NAK for introducing giant new infrastructure like a new I/O scheduler > for the legacy request structure. > I would fully agree, if there weren't important problems involved. But there

[PATCH 02/14] block, bfq: add full hierarchical scheduling and cgroups support

2016-10-26 Thread Paolo Valente
ed-off-by: Fabio Checconi <fchecc...@gmail.com> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/Kconfig.iosched |7 + block/bfq-iosched.c| 1789 +++- inclu

[PATCH 02/14] block, bfq: add full hierarchical scheduling and cgroups support

2016-10-26 Thread Paolo Valente
-by: Paolo Valente Signed-off-by: Arianna Avanzini --- block/Kconfig.iosched |7 + block/bfq-iosched.c| 1789 +++- include/linux/blkdev.h |2 +- 3 files changed, 1635 insertions(+), 163 deletions(-) diff --git a/block/Kconfig.iosched b/block

[PATCH 05/14] block, bfq: add more fairness with writes and slow processes

2016-10-26 Thread Paolo Valente
Annual International Systems and Storage Conference (SYSTOR '12), June 2012. Slightly extended version: http://algogroup.unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente <paolo.vale...

[PATCH 04/14] block, bfq: modify the peak-rate estimator

2016-10-26 Thread Paolo Valente
no request is silently dropped), the following obvious convergence property holds: the number of requests dispatched MUST become closer and closer to the number of requests completed as the observation interval grows. This is the key property used in this new version of the peak-rate estimator. Signed-off

[PATCH 03/14] block, bfq: improve throughput boosting

2016-10-26 Thread Paolo Valente
unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- bl

[PATCH 04/14] block, bfq: modify the peak-rate estimator

2016-10-26 Thread Paolo Valente
no request is silently dropped), the following obvious convergence property holds: the number of requests dispatched MUST become closer and closer to the number of requests completed as the observation interval grows. This is the key property used in this new version of the peak-rate estimator. Signed-off

[PATCH 03/14] block, bfq: improve throughput boosting

2016-10-26 Thread Paolo Valente
unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente Signed-off-by: Arianna Avanzini --- block/bfq-iosched.c | 83 ++--- 1 file changed, 41 insertions(+), 42

[PATCH 05/14] block, bfq: add more fairness with writes and slow processes

2016-10-26 Thread Paolo Valente
Annual International Systems and Storage Conference (SYSTOR '12), June 2012. Slightly extended version: http://algogroup.unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente Signed-off-

[PATCH 07/14] block, bfq: reduce I/O latency for soft real-time applications

2016-10-26 Thread Paolo Valente
ony requirements, then the end of the weight-raising period for the queue is moved forward, and so on. Note that an application whose associated queue never happens to be empty when it expires will never have the opportunity to be deemed as soft real-time. Signed-off-by: Paolo Valente <paol

[PATCH 09/14] block, bfq: reduce latency during request-pool saturation

2016-10-26 Thread Paolo Valente
one. Along the same line, if there are weight-raised queues, then this patch halves the service rate of async (write) requests for non-weight-raised queues. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/b

[PATCH 09/14] block, bfq: reduce latency during request-pool saturation

2016-10-26 Thread Paolo Valente
one. Along the same line, if there are weight-raised queues, then this patch halves the service rate of async (write) requests for non-weight-raised queues. Signed-off-by: Paolo Valente Signed-off-by: Arianna Avanzini --- block/bfq-iosched.c | 66

[PATCH 07/14] block, bfq: reduce I/O latency for soft real-time applications

2016-10-26 Thread Paolo Valente
ony requirements, then the end of the weight-raising period for the queue is moved forward, and so on. Note that an application whose associated queue never happens to be empty when it expires will never have the opportunity to be deemed as soft real-time. Signed-off-by: Paolo Valente Signed-

[PATCH 06/14] block, bfq: improve responsiveness

2016-10-26 Thread Paolo Valente
. http://algogroup.unimore.it/people/paolo/disk_sched/mst-2015.pdf Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/Kconfig.iosched | 3 +- block/bfq-iosched.c | 785 --

[PATCH 06/14] block, bfq: improve responsiveness

2016-10-26 Thread Paolo Valente
. http://algogroup.unimore.it/people/paolo/disk_sched/mst-2015.pdf Signed-off-by: Paolo Valente Signed-off-by: Arianna Avanzini --- block/Kconfig.iosched | 3 +- block/bfq-iosched.c | 785 -- 2 files changed, 706 insertions(+), 82 deletions(-) diff --g

[PATCH 08/14] block, bfq: preserve a low latency also with NCQ-capable drives

2016-10-26 Thread Paolo Valente
hed/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/bfq-iosched.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)

[PATCH 08/14] block, bfq: preserve a low latency also with NCQ-capable drives

2016-10-26 Thread Paolo Valente
hed/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente Signed-off-by: Arianna Avanzini --- block/bfq-iosched.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/block/bfq-iosched.c b/block/bfq-iosched.c index d9b090

[PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-26 Thread Paolo Valente
ttps://lkml.org/lkml/2016/2/1/818 Arianna Avanzini (4): block, bfq: add full hierarchical scheduling and cgroups support block, bfq: add Early Queue Merge (EQM) block, bfq: reduce idling only in symmetric scenarios block, bfq: handle bursts of queue activations Paolo Valente (10): bloc

[PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-26 Thread Paolo Valente
ttps://lkml.org/lkml/2016/2/1/818 Arianna Avanzini (4): block, bfq: add full hierarchical scheduling and cgroups support block, bfq: add Early Queue Merge (EQM) block, bfq: reduce idling only in symmetric scenarios block, bfq: handle bursts of queue activations Paolo Valente (10): bloc

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-16 Thread Paolo Valente
> Il giorno 14 ott 2016, alle ore 20:35, Tejun Heo <t...@kernel.org> ha scritto: > > Hello, Paolo. > > On Fri, Oct 14, 2016 at 07:13:41PM +0200, Paolo Valente wrote: >> That said, your 'thus' seems a little too strong: "bfq does not yet >> handle fast SSD

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-16 Thread Paolo Valente
> Il giorno 14 ott 2016, alle ore 20:35, Tejun Heo ha scritto: > > Hello, Paolo. > > On Fri, Oct 14, 2016 at 07:13:41PM +0200, Paolo Valente wrote: >> That said, your 'thus' seems a little too strong: "bfq does not yet >> handle fast SSDs, thus we n

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-14 Thread Paolo Valente
, that's absolutely true. I'm already thinking about an idleless solution. As I already wrote, I'm willing to help with scheduling in blk-mq. I hope there will be the opportunity to find some way to go at KS. Thanks, Paolo > Thanks. > > -- > tejun -- Paolo Valente Algogroup Dipartimento di Scienze Fisiche, Informatiche e Matematiche Via Campi 213/B 41125 Modena - Italy http://algogroup.unimore.it/people/paolo/

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-14 Thread Paolo Valente
m already thinking about an idleless solution. As I already wrote, I'm willing to help with scheduling in blk-mq. I hope there will be the opportunity to find some way to go at KS. Thanks, Paolo > Thanks. > > -- > tejun -- Paolo Valente Algogroup Dipartimento di Scienze Fisiche, Informatiche e Matematiche Via Campi 213/B 41125 Modena - Italy http://algogroup.unimore.it/people/paolo/

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 21:57, Shaohua Li <s...@fb.com> ha scritto: > > On Thu, Oct 06, 2016 at 09:58:44AM +0200, Paolo Valente wrote: >> >>> Il giorno 05 ott 2016, alle ore 22:46, Shaohua Li <s...@fb.com> ha scritto: >>> >>> O

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 21:57, Shaohua Li ha scritto: > > On Thu, Oct 06, 2016 at 09:58:44AM +0200, Paolo Valente wrote: >> >>> Il giorno 05 ott 2016, alle ore 22:46, Shaohua Li ha scritto: >>> >>> On Wed, Oct 05, 2016 at 09:47:19PM +0200,

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 20:32, Vivek Goyal <vgo...@redhat.com> ha > scritto: > > On Thu, Oct 06, 2016 at 08:01:42PM +0200, Paolo Valente wrote: >> >>> Il giorno 06 ott 2016, alle ore 19:49, Vivek Goyal <vgo...@redhat.com> ha >>> scri

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 20:32, Vivek Goyal ha > scritto: > > On Thu, Oct 06, 2016 at 08:01:42PM +0200, Paolo Valente wrote: >> >>> Il giorno 06 ott 2016, alle ore 19:49, Vivek Goyal ha >>> scritto: >>> >>> On Thu,

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 19:49, Vivek Goyal <vgo...@redhat.com> ha > scritto: > > On Thu, Oct 06, 2016 at 03:15:50PM +0200, Paolo Valente wrote: > > [..] >> Shaohua, I have just realized that I have unconsciously defended a >> wrong argument.

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 19:49, Vivek Goyal ha > scritto: > > On Thu, Oct 06, 2016 at 03:15:50PM +0200, Paolo Valente wrote: > > [..] >> Shaohua, I have just realized that I have unconsciously defended a >> wrong argument. Although all the facts that I

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 15:52, Austin S. Hemmelgarn > <ahferro...@gmail.com> ha scritto: > > On 2016-10-06 08:50, Paolo Valente wrote: >> >>> Il giorno 06 ott 2016, alle ore 13:57, Austin S. Hemmelgarn >>> <ahferro...@gmail.com> ha s

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 15:52, Austin S. Hemmelgarn > ha scritto: > > On 2016-10-06 08:50, Paolo Valente wrote: >> >>> Il giorno 06 ott 2016, alle ore 13:57, Austin S. Hemmelgarn >>> ha scritto: >>> >>> On 2016-10-06 07:03

<    3   4   5   6   7   8   9   10   11   12   >