On 10/30/14 15:19, Sagi Grimberg wrote:
My impression here that in the default settings, on a 1 NUMA node with
8 cores, 2 different srp connections (using 4 channels each) will be
associated with comp vectors 0-3. while it could potentially use
vectors 4-7 and reduce possible mutual interference. right?
Hello Sagi,
That's correct. For this example if use of all completion vectors is
desired additional configuration is required, e.g. by setting ch_count
to 8 in /etc/modprobe.d/ib_srp.conf. By the way, I'm not sure it is
possible to avoid manual configuration and tuning entirely. As an
example, with a six core CPU at the initiator side and with
hyperthreading enabled (12 CPU threads in total) I see higher IOPS
results with ch_count=6 compared to ch_count=8 or ch_count=12. I have
not tried to determine why but maybe this is because ch_count values
that are below the number of CPU threads cause some interrupt coalescing.
Bart.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majord...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
