On Mon, 7 Aug 2017 21:04:16 +0800
Bob Chen <a175818...@gmail.com> wrote:
> Besides, I checked the lspci -vvv output, no capabilities of Access Control
> are seen.
Are these switches onboard an NVIDIA card or are they separate
components? The examples I have on NVIDIA cards do include ACS:
+-02.0-[42-47]----00.0-[43-47]--+-08.0-[44]----00.0 NVIDIA Corporation GK107GL
[GRID K1]
+-09.0-[45]----00.0 NVIDIA Corporation GK107GL
[GRID K1]
+-10.0-[46]----00.0 NVIDIA Corporation GK107GL
[GRID K1]
\-11.0-[47]----00.0 NVIDIA Corporation GK107GL
[GRID K1]
# lspci -vvvs 43: | grep -A 2 "Access Control Services"
Capabilities: [f24 v1] Access Control Services
ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl+ DirectTrans+
ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl- DirectTrans-
--
Capabilities: [f24 v1] Access Control Services
ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl+ DirectTrans+
ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl- DirectTrans-
--
Capabilities: [f24 v1] Access Control Services
ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl+ DirectTrans+
ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl- DirectTrans-
--
Capabilities: [f24 v1] Access Control Services
ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl+ DirectTrans+
ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl- DirectTrans-
+-03.0-[04-07]----00.0-[05-07]--+-08.0-[06]----00.0 NVIDIA Corporation GM204GL
[Tesla M60]
\-10.0-[07]----00.0 NVIDIA Corporation GM204GL
[Tesla M60]
# lspci -vvvs 5: | grep -A 2 "Access Control Services"
Capabilities: [f24 v1] Access Control Services
ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl+ DirectTrans+
ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl- DirectTrans-
--
Capabilities: [f24 v1] Access Control Services
ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl+ DirectTrans+
ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+
EgressCtrl- DirectTrans-
Without ACS on the downstream switch ports, the GPUs sharing the switch
will be in the same IOMMU group and we have no ability to control
anything about the routing between downstream ports. Thanks,
Alex
