On Tue, 2017-02-14 at 16:56 +0200, Tariq Toukan wrote: > As the previous series caused hangs, we must run functional regression > tests over this series as well. > Run has already started, and results will be available tomorrow morning. > > In general, I really like this series. The re-factorization looks more > elegant and more correct, functionally. > > However, performance wise: we fear that the numbers will be drastically > lower with this transition to order-0 pages, > because of the (becoming critical) page allocator and dma operations > bottlenecks, especially on systems with costly > dma operations, such as ARM, iommu=on, etc... >
So, again, performance after this patch series his higher, once you have sensible RX queues parameters, for the expected workload. Only in pathological cases, you might have some regression. The old schem was _maybe_ better _when_ memory is not fragmented. When you run hosts for months, memory _is_ fragmented. You never see that on benchmarks, unless you force memory being fragmented. > We already have this exact issue in mlx5, where we moved to order-0 > allocations with a fixed size cache, but that was not enough. > Customers of mlx5 have already complained about the performance > degradation, and currently this is hurting our business. > We get a clear nack from our performance regression team regarding doing > the same in mlx4. > So, the question is, can we live with this degradation until those > bottleneck challenges are addressed? Again, there is no degradation. We have been using order-0 pages for years at Google. Only when we made the mistake to rebase from the upstream driver and order-3 pages we got horrible regressions, causing production outages. I was silly to believe that mm layer got better. > Following our perf experts feedback, I cannot just simply Ack. We need > to have a clear plan to close the perf gap or reduce the impact. Your perf experts need to talk to me, or any experts at Google and Facebook, really. Anything _relying_ on order-3 pages being available to impress friends/customers is a lie.
