On Mon, 2008-02-18 at 15:53 +0200, Tziporet Koren wrote:
> Hi,
>
> If you got this mail in the "To" section it means you own a document
> in OFED and you have not yet updated it for OFED 1.3.
>
> Please send me patches against:
> git://git.openfabrics.org/~tziporet/docs.git ofed_1_3
>
diff --git a/ipoib_release_notes.txt b/ipoib_release_notes.txt
index bce03d3..9c897e6 100644
--- a/ipoib_release_notes.txt
+++ b/ipoib_release_notes.txt
@@ -12,6 +12,7 @@ Table of Contents
3. Known Issues
4. DHCP Support of IPoIB
5. High Availability (HA) Service
+6. Switching between CM and UD mode
===============================================================================
1. Overview
@@ -30,6 +31,8 @@ At load time this can be done by inserting the following line in
/etc/modprobe.conf:
options ib_ipoib debug_level=<integer number>
+0 shuts debug messages off and a none zero value will turn them on.
+
At runtime the value can be controlled by writing the following to sysfs:
echo <integer number> > /sys/module/ib_ipoib/parameters/debug_level
@@ -40,8 +43,37 @@ Note that on some older kernels (like the one supplied with Redhat AS 4.0),
the path for inspecting the debug level is different and is as follows:
/sys/module/ib_ipoib/debug_level
+This version adds support for CM mode for HCAs which do not support Infiniband
+Shared Receive Qeueus (SRQ). The detection is done automatically at run time. In
+this case, the driver uses RC connections between the peers for transferring IPOIB
+traffic.
+
+Even if the HCA does support SRQ, the administrator can force the driver to not
+use SRQs. This can be done by setting the module parameter "set_nonsrq".
+
+This version of ofed introduces improvements to IPOIB by cutting the CPU
+overhead in handling both send and receive packets. This will improve operation
+in different modes of operation but the change is mostly noticeable for small
+UDP message were message rate has increased.
+
+Support for interrupt moderation was introduced. This is done for HCAs which
+support this feature (like Mellanox's mlx4). Controlling moderation params is
+done through the ethtool interface.
+
+ethtool -c ib0
+will display the parameters for ib0. Two kinds of parameters are supported:
+rx-usecs, tx_usecs and rx-frames, tx_frames - value for rx and tx are identical.
+To change a value you need to do:
+ethtool -C ib0 rx-usecs <new val>
+This will change both rx_usecs and tx_usecs for ib0.
+
+The semantics of the parameters is this: an EQE will be pushed to the event queue
+if any of the conditions have been met - *-usecs have elapsed or *-frames were
+received since the last time an EQE was generated. Using this helps reduce
+interrupt rate generated by the device.
+
===============================================================================
-3. Known Issues
+3. Know Issues
===============================================================================
1. If a host has multiple interfaces, each belonging to a different IP subnet,
yet they use the same InfiniBand switch, the host may build an incorrect ARP
@@ -149,3 +181,15 @@ The HA service may also be activated manually, via the following command:
--with-multicast support applications that are using multicast
-v verbose output
+===============================================================================
+5. Switching between CM and UD mode
+===============================================================================
+
+1. The mode of operation can be set by an entry in the file
+/etc/infiniband/openib.conf:
+SET_IPOIB_CM=yes => CM mode is enabled
+SET_IPOIB_CM=no => UD mode is enabled
+
+2. The mode of operation can be changed in runtime by writing to a sysfs file:
+echo datagram > /sys/class/net/ib0/mode sets the mode of ib0 to UD
+echo connected > /sys/class/net/ib0/mode sets the mode ib0 to CM
_______________________________________________
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
