Re: [PATCH block/for-3.17-fixes/core] blk-mq, percpu_ref: implement a kludge for SCSI blk-mq stall during probe
On 09/24/2014 08:33 AM, Tejun Heo wrote: > On Wed, Sep 24, 2014 at 08:30:33AM -0600, Jens Axboe wrote: >> On 09/24/2014 02:23 AM, Christoph Hellwig wrote: >>> Thanks, this fixes the boot stall for me. >>> >>> Tested-by: Christoph Hellwig >> >> Sweet, I'll shove this off today, so we are done for 3.17 release. > > Cool, once it hits the block branch, I'll pull it into percpu/for-3.18 > and apply the patches for proper fix on top. It's in for-linus now. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: [PATCH block/for-3.17-fixes/core] blk-mq, percpu_ref: implement a kludge for SCSI blk-mq stall during probe
On Wed, Sep 24, 2014 at 08:30:33AM -0600, Jens Axboe wrote: > On 09/24/2014 02:23 AM, Christoph Hellwig wrote: > > Thanks, this fixes the boot stall for me. > > > > Tested-by: Christoph Hellwig > > Sweet, I'll shove this off today, so we are done for 3.17 release. Cool, once it hits the block branch, I'll pull it into percpu/for-3.18 and apply the patches for proper fix on top. Thanks. -- tejun -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: [PATCH block/for-3.17-fixes/core] blk-mq, percpu_ref: implement a kludge for SCSI blk-mq stall during probe
On 09/24/2014 02:23 AM, Christoph Hellwig wrote: > Thanks, this fixes the boot stall for me. > > Tested-by: Christoph Hellwig Sweet, I'll shove this off today, so we are done for 3.17 release. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: [PATCH block/for-3.17-fixes/core] blk-mq, percpu_ref: implement a kludge for SCSI blk-mq stall during probe
Thanks, this fixes the boot stall for me. Tested-by: Christoph Hellwig -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: [PATCH block/for-3.17-fixes/core] blk-mq, percpu_ref: implement a kludge for SCSI blk-mq stall during probe
Oops, I forgot to cc Kent. Kent, the patch is at http://lkml.kernel.org/g/20140923192432.ga24...@mtj.dyndns.org On Tue, Sep 23, 2014 at 01:29:03PM -0600, Jens Axboe wrote: > The hack looks fine to me, if it passes Christophs boot stall test. The > hack isn't THAT nasty, since you already have a series queued up to fix > it for real for 3.18. Yeah, then I can pull in block fixes branch into a percpu for-3.18 branch, revert the hack and then apply the patches to implement the proper fix. Thanks. -- tejun -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: [PATCH block/for-3.17-fixes/core] blk-mq, percpu_ref: implement a kludge for SCSI blk-mq stall during probe
On 09/23/2014 01:24 PM, Tejun Heo wrote:
> blk-mq uses percpu_ref for its usage counter which tracks the number
> of in-flight commands and used to synchronously drain the queue on
> freeze. percpu_ref shutdown takes measureable wallclock time as it
> involves a sched RCU grace period. This means that draining a blk-mq
> takes measureable wallclock time. One would think that this shouldn't
> matter as queue shutdown should be a rare event which takes place
> asynchronously w.r.t. userland.
>
> Unfortunately, SCSI probing involves synchronously setting up and then
> tearing down a lot of request_queues back-to-back for non-existent
> LUNs. This means that SCSI probing may take more than ten seconds
> when scsi-mq is used.
>
> This will be properly fixed by implementing a mechanism to keep
> q->mq_usage_counter in atomic mode till genhd registration; however,
> that involves rather big updates to percpu_ref which is difficult to
> apply late in the devel cycle (v3.17-rc6 at the moment). As a
> stop-gap measure till the proper fix can be implemented in the next
> cycle, this patch introduces __percpu_ref_kill_expedited() and makes
> blk_mq_freeze_queue() use it. This is heavy-handed but should work
> for testing the experimental SCSI blk-mq implementation.
>
> Signed-off-by: Tejun Heo
> Reported-by: Christoph Hellwig
> Link: http://lkml.kernel.org/g/20140919113815.ga10...@lst.de
> Fixes: add703fda981 ("blk-mq: use percpu_ref for mq usage count")
> Cc: Kent Overstreet
> Cc: Jens Axboe
> ---
> Hello, Jens, Christoph.
>
> How about this one? This is kinda ugly but should work fine in most
> cases and easy to apply to v3.17 and take out during v3.18.
The hack looks fine to me, if it passes Christophs boot stall test. The
hack isn't THAT nasty, since you already have a series queued up to fix
it for real for 3.18.
--
Jens Axboe
--
To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
the body of a message to majord...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
