### Motivation
Currently, the relationship between IOThreads and the resources using them is
opaque. From a management perspective, it is difficult to determine which
devices or block exports are currently associated with a specific IOThread
via QMP or HMP.

This series introduces a "holder" tracking mechanism based on QOM paths or
block exports to significantly improve IOThread observability.
In high-performance virtualization environments, users often pre-allocate
a set of IOThreads to serve as a persistent thread pool. During device
hotplug/unplug cycles, while IOThread objects remain persistent,
their attachment state changes dynamically.

By tracking these "holders," administrators can use `query-iothreads` to
monitor the real-time load distribution of the thread pool and identify which
specific devices (e.g., virtio-blk, BlockExport) are attached to which thread.

### Technical Overview
* Holder tracking

  Add a QAPI holder list to each IOThread.  A holder identifies either
  a QOM object by its canonical path or a block export by its unique
  BlockExportOptions ID.

* Explicit reference lifecycle

  Add iothread_ref_and_get_aio_context() and the matching
  iothread_unref_and_put_aio_context().  Acquiring an AioContext registers a
  holder and keeps the IOThread alive until the matching put.

  Legacy callers without a matching lifecycle use the explicitly named
  iothread_unsafe_get_aio_context().  The ambiguous legacy
  iothread_get_aio_context() is removed after all production callers
  are migrated.

* Subsystem integration

  Track holders for block exports, monitors, virtio-blk, virtio-scsi,
  virtio queue mappings, virtio balloon thread pinning, COLO compare,
  vfio-user proxy, and xen-block.

* Introspection

  Extend IOThreadInfo with a holders array returned by
  query-iothreads.  Display the same information with info iothreads.


=====================================================================

### V20 -> V19 Changelog
  - Rebased onto upstream v11.2.0-rc0 (29760efaf96b).
  - Add the RB in the patch 14/14.
  - Adapted patches 1 and 5 to the updated QOM property registration
    context, and resolved patch 9's conflicts with vfio-user region
    FD cleanup. No functional changes to the series.

### V19 -> V18 Changelog
  - Added new patch in the last:
    docs/devel: document holder-aware IOThread AioContext APIs
  - Rebased on upstream code.
  - Added IOThread prepare_delete() to reject deletion while holders
    remain, preventing NULL IOThread lookups during virtqueue mapping
    cleanup.

### V18 -> V17 Changelog
  - Saved the COLO object's QOM path for finalization and guarded
    holder cleanup against incomplete initialization.
  - Used the owning PCI device's QOM path for vfio-user holders
    and saved it for disconnect().
  - Simplified the monitor QOM path field name and clarified
    PATCH 12's commit message.
  - Rebased on upstream and collected Reviewed-by tags.

### V17 -> V16 Changelog
  - Rebase code to resolve code conflicts for patch 8:
    "virtio-balloon: Update tracking iothread users with holder".
    This issue caused by latest merged patch "fdc3f9a83d".

### V16 -> V15 Changelog
  - Unified per-monitor IOThread checks and accesses through
    mon->iothread after initialization.
  - Simplified PATCH 13's commit message and clarified why blockdev
    cannot use the holder-aware get/put APIs.
  - Dropped the v15 Patch 1 in this series, It will be taken away
    independently by trivial-patches tree.

### V15 -> V14 Changelog
  - Moved monitor IOThread cleanup from unparent() to monitor_finalize(),
    pairing complete() with instance finalization.
  - Squashed V14 PATCH 04 and PATCH 14 into PATCH 13 and clarified the
    blockdev lifetime assumption. Since the additional changes are minimal,
    PATCH 13 retains Stefan's Reviewed-by from V14 PATCH 04.
  - Rebased and adapted info iothreads to the MonitorHMP interface.

### V14 -> V13 Changelog
  - Renamed patch 3 and clarified that it introduces holder-tracking
    infrastructure, with users converted in subsequent patches.
  - Documented that monitor holders are not visible to management
    applications, while retaining the tracking for a consistent holder
    and IOThread reference lifecycle.
  - Rebased on the latest upstream.



Zhang Chen (14):
  iothread: introduce holder tracking
  iothread: add holder-aware AioContext accessors
  block/export: track IOThread references
  monitor: track IOThread users with QOM paths
  virtio-vq-mapping: track iothread-vq-mapping references using device
    path
  virtio: track IOThread references for thread pinning
  net/colo: track IOThread references using path-based holder
  virtio-balloon: Update tracking iothread users with holder
  vfio-user/proxy: Update tracking iothread users with device QOM paths
  xen-block: Update tracking iothread users with holder name
  monitor/hmp: display IOThread holders
  iothread: make legacy AioContext getter explicitly unsafe
  tests/unit/iothread: update AioContext ref/put helpers
  docs/devel: document holder-aware IOThread AioContext APIs

 block/export/export.c                   |  62 +++++++++++---
 blockdev.c                              |   9 ++-
 docs/devel/multiple-iothreads.rst       |  19 +++--
 hw/block/dataplane/xen-block.c          |  19 ++++-
 hw/block/virtio-blk.c                   |  21 +++--
 hw/scsi/virtio-scsi-dataplane.c         |  22 +++--
 hw/vfio-user/pci.c                      |   2 +-
 hw/vfio-user/proxy.c                    |  20 ++++-
 hw/vfio-user/proxy.h                    |   4 +-
 hw/virtio/iothread-vq-mapping.c         |  20 +++--
 hw/virtio/virtio-balloon.c              |  21 +++--
 include/block/export.h                  |   5 ++
 include/hw/virtio/iothread-vq-mapping.h |   6 +-
 include/hw/virtio/virtio-balloon.h      |   1 +
 include/system/iothread.h               |  38 ++++++++-
 iothread.c                              | 102 +++++++++++++++++++++++-
 monitor/hmp-cmds.c                      |  20 +++++
 monitor/monitor-internal.h              |   7 +-
 monitor/monitor.c                       |  36 ++++++---
 monitor/qmp.c                           |  14 ++--
 net/colo-compare.c                      |  36 ++++++---
 qapi/misc.json                          |  94 +++++++++++++++++++---
 tests/unit/iothread.c                   |  18 +++--
 tests/unit/iothread.h                   |   7 +-
 tests/unit/test-aio-multithread.c       |   5 +-
 tests/unit/test-bdrv-drain.c            |  18 +++--
 tests/unit/test-block-iothread.c        |  21 +++--
 27 files changed, 535 insertions(+), 112 deletions(-)

-- 
2.53.0


Reply via email to