Re: [PATCH v2] RFC: Benchmarking script

[Stefano Brivio <sbrivio@redhat.com>]

On Fri,  5 Apr 2024 17:12:21 +1100
David Gibson <david@gibson.dropbear.id.au> wrote:

> Although we make some performance measurements in our regular testsuite,
> those are designed more for getting a quick(ish) rough idea of the
> performance, rather than a more precise measurement.
> 
> This patch adds a Python script in contrib/benchmark which can make more
> detailed benchmarks.  It can test both passt & pasta themselves, but also
> various other scenarios for comparison, such as kernel veth, qemu -net tap
> and slirp (either qemu -net user or slirp4netns).

Hah, nice. I haven't tried or reviewed this yet, but I just realised
one thing: iperf3 3.16 finally implements separate streams (-P) as
multiple threads! See:

  https://github.com/esnet/iperf/pull/1591

or release notes. That also means that the whole parallel process
nonsense in the regular suite can finally go away, I guess. I haven't
tested that yet, though.

By the way of that, you mentioned in the past that you had some
throughput failures with UDP tests. Well, I looked into 3.16 changes
because of that -- they started failing for me as well with the new
version. I temporarily reverted back to 3.14 on my system, until we
figure out how to adjust to the new meaning of the "-P" option.

Another thing that occurred to me: it would probably be helpful to
already have vhost-user cases for passt here.

Anyway, I'll give this a try soon. I can also apply it right away if
you prefer.

-- 
Stefano