Hi Todd,

What we need to do every so often after initial configuration, is a bw_rlimit speed change via TC reconfig.

In the end we will probably have two (or more) mpprio queues per interface, each at a different shaped rate which we would like to change every so often. In our application we will direct traffic from one queue to the other at different times. Ideally it is better not to have packet loss during the reconfiguration change, however, if it is very small and only affects the particular mqprio queue whose rate we are changing, we can work around it.

Thanks again for your help with this.

Kind regards,

David

On Wed, Apr 27 2022 at 17:10, "Fujinaka, Todd" <todd.fujin...@intel.com> wrote:

I had a couple more questions from the developer about your requirements.

What is needed: is speed change, TC reconfig, queue number change correct?

Would it be acceptable to see packet loss during reconfiguration with changes to the configuration?

Todd Fujinaka
Software Application Engineer
Ethernet Products Group
Intel Corporation
todd.fujin...@intel.com

-----Original Message-----
From: Fujinaka, Todd <todd.fujin...@intel.com> Sent: Tuesday, April 26, 2022 8:34 AM
To: David Hayes <dav...@simula.no>
Cc: e1000-de...@lists.sf.net
Subject: Re: [E1000-devel] tc changing mqprio parameters X710-T4L

OK. I'll let you know when I get some updates from the developers.

Todd Fujinaka
Software Application Engineer
Ethernet Products Group
Intel Corporation
todd.fujin...@intel.com

-----Original Message-----
From: David Hayes <dav...@simula.no>
Sent: Tuesday, April 26, 2022 6:47 AM
To: Fujinaka, Todd <todd.fujin...@intel.com>
Cc: e1000-de...@lists.sf.net
Subject: Re: [E1000-devel] tc changing mqprio parameters X710-T4L

Hi Todd,

Thanks for this. I have confirmed that what the engineering team suggest as a work around does work on our equipment. However, for our application we do need to leave the filters on.

Thanks so much for your help.

Kind regards,

David

On Tue, Apr 26 2022 at 13:29, "Fujinaka, Todd" <todd.fujin...@intel.com> wrote:

I got a reply from the engineering team:

A workaround is to reinitialize everything. Instead of:

tc qdisc replace dev enp130s0f0 root mqprio num_tc 1 hw 1 mode channel shaper bw_rlimit min_rate 0Mbit max_rate 500Mbit map 0 0 0 0 0 0 0 0 queues 1@0 tc qdisc change dev enp130s0f0 root mqprio num_tc 1 hw 1 mode channel shaper bw_rlimit min_rate 0Mbit max_rate 200Mbit map 0 0
0 0 0 0 0 0 queues 1@0

Can you do this:
tc qdisc replace dev enp130s0f0 root mqprio num_tc 1 hw 1 mode channel shaper bw_rlimit min_rate 0Mbit max_rate 500Mbit map 0 0 0 0 0 0 0 0 queues 1@0 tc qdisc del dev enp130s0f0 root tc qdisc replace dev enp130s0f0 root mqprio num_tc 1 hw 1 mode channel shaper bw_rlimit min_rate 0Mbit max_rate 200Mbit map 0 0 0 0 0 0 0 0 queues 1@0

They did mention this would inactivate the filters, so if you need leave them on we'll need to do some more work on our end.

Todd Fujinaka
Software Application Engineer
Ethernet Products Group
Intel Corporation
todd.fujin...@intel.com

-----Original Message-----
From: David Hayes <dav...@simula.no>
Sent: Thursday, April 21, 2022 2:47 AM
To: Fujinaka, Todd <todd.fujin...@intel.com>
Cc: e1000-de...@lists.sf.net
Subject: Re: [E1000-devel] tc changing mqprio parameters X710-T4L

Hi Todd,

Thank you for getting back to me. It is probably easier if you file the bug.

A little more information in case it is useful:

We have also tried this running the 5.17.1 kernel with the same result.

When the OS starts, the interfaces are initially given default fq_codel qdiscs. We are able to replace these with the mqprio qdisc, but after doing that we can make no further changes.

The cards have the latest (8.60 version) firmware installed.

Thanks and regards,

David


On Wed, Apr 20 2022 at 19:01, "Fujinaka, Todd" <todd.fujin...@intel.com> wrote:

Do you have some way to file a bug with us through your factory contact? Otherwise I will file a bug and then relay the info via email.

Todd Fujinaka
Software Application Engineer
Ethernet Products Group
Intel Corporation
todd.fujin...@intel.com

-----Original Message-----
From: David Hayes <dav...@simula.no>
Sent: Wednesday, April 13, 2022 5:27 AM
To: e1000-de...@lists.sf.net
Subject: [E1000-devel] tc changing mqprio parameters X710-T4L


Hi list,

We are using a couple of X710-T4L cards in an experimental testbed.
The computer with the cards is currently manjaro linux
5.17rc7 kernel, and cards have been updated with the latest nvm 8.60. As part of the work we wish to periodically change the shapers' max_rate parameter.

We set up the qdisc as follows:

# tc qdisc replace dev <interface> root mqprio num_tc 1 hw 1 mode channel shaper bw_rlimit min_rate 0Mbit max_rate 500Mbit map 0 0
  0 0 0 0 0 0 queues 1@0

This works well and we are able to confirm the 500Mbit limit experimentally.

However, when we try to change the speed:

# tc qdisc change dev <interface> root mqprio num_tc 1 hw 1 mode channel shaper bw_rlimit min_rate 0Mbit max_rate 200Mbit map 0 0
  0 0 0 0 0 0 queues 1@0

we get the following error message:

Change operation is not supported by specified qdisc

We are also unable use "replace" a second time.

I know our use case is a little unusual, but it is simple. Does anyone have any ideas what the problem could be and how we can fix it or work around it?

Many thanks,

David



_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel Ethernet, visit https://forums.intel.com/s/topic/0TO0P00000018NbWAI/intel-ethernet




_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel Ethernet, visit https://forums.intel.com/s/topic/0TO0P00000018NbWAI/intel-ethernet


_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel Ethernet, visit 
https://forums.intel.com/s/topic/0TO0P00000018NbWAI/intel-ethernet

Reply via email to