From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from gandalf.ozlabs.org (mail.ozlabs.org [IPv6:2404:9400:2221:ea00::3]) by passt.top (Postfix) with ESMTPS id 6E20F5A0275 for ; Sat, 6 Apr 2024 06:25:16 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gibson.dropbear.id.au; s=202312; t=1712377509; bh=hOQZiy2IadAURTddbZl3nIsptredWvWBs0Mehr8JcoM=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=XjOzOuCjZkVlrBjGOQOxk85gZlwolzOGvS3M4RWARtmKNpLergZc+GCFrkEJ4n2hv RkZC63Pb9mao7G0S+C8wWoDRenMYYsE5XYfoZBrAhPhpBwTbqKCLwON9bmGFG06tf/ A/u8oVOyMUs5MNYRMcC2XUsXTrXgOtAmk/HOZGndNdcDS9Kh1O9B52ni7DnyPY2jHP ep/h8iQFMGTLD0O3bggIigOoR9Y/klSIR4sML//FaUyIdprlsY/LBhwm/Suw/2QijQ OVPALzg1bRvClj3Cz/tagACSeevM/SO7I3ZyOamg+8m/wTMMNUeTYs0A2wwsOMBYWU TzT/JegY/a0Ag== Received: by gandalf.ozlabs.org (Postfix, from userid 1007) id 4VBMhj3vxWz4wyS; Sat, 6 Apr 2024 15:25:09 +1100 (AEDT) Date: Sat, 6 Apr 2024 14:31:52 +1100 From: David Gibson To: Stefano Brivio Subject: Re: [PATCH v2] RFC: Benchmarking script Message-ID: References: <20240405061222.15966-1-david@gibson.dropbear.id.au> <20240405201026.54877fa2@elisabeth> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="hUHWqQ+edAnUA88O" Content-Disposition: inline In-Reply-To: <20240405201026.54877fa2@elisabeth> Message-ID-Hash: LK4BFEO6LPV7AQRCLTZDXBSCKS7GRGYQ X-Message-ID-Hash: LK4BFEO6LPV7AQRCLTZDXBSCKS7GRGYQ X-MailFrom: dgibson@gandalf.ozlabs.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: passt-dev@passt.top X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: --hUHWqQ+edAnUA88O Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Apr 05, 2024 at 08:10:26PM +0200, Stefano Brivio wrote: > On Fri, 5 Apr 2024 17:12:21 +1100 > David Gibson wrote: >=20 > > Although we make some performance measurements in our regular testsuite, > > those are designed more for getting a quick(ish) rough idea of the > > performance, rather than a more precise measurement. > >=20 > > This patch adds a Python script in contrib/benchmark which can make more > > detailed benchmarks. It can test both passt & pasta themselves, but al= so > > various other scenarios for comparison, such as kernel veth, qemu -net = tap > > and slirp (either qemu -net user or slirp4netns). >=20 > Hah, nice. I haven't tried or reviewed this yet, but I just realised > one thing: iperf3 3.16 finally implements separate streams (-P) as > multiple threads! See: >=20 > https://github.com/esnet/iperf/pull/1591 I hadn't realised it was just a new addition, but I did notice that -P used multiple threads > or release notes. That also means that the whole parallel process > nonsense in the regular suite can finally go away, I guess. I haven't > tested that yet, though. Yes, that would make things notably less messy. This script doesn't yet use parallel streams - I need to make it do that though, because I'll need those results for my talk in a week/ > By the way of that, you mentioned in the past that you had some > throughput failures with UDP tests. Well, I looked into 3.16 changes > because of that -- they started failing for me as well with the new > version. I temporarily reverted back to 3.14 on my system, until we > figure out how to adjust to the new meaning of the "-P" option. Ok, good to know. In any case the UDP "throughput" tests as they stand are basically nonsense. Testing UDP throughput needs a fancier method, basically increasing the rate until we start dropping packets. iperf3 doesn't do that (and tools that do seem to be kinda hard to find). At the moment we basically just have some hardcoded target rates, so really all these tests are doing is saying "can we reach this target throughput, where this target was selected with no consideration of the capabilities of this host system". > Another thing that occurred to me: it would probably be helpful to > already have vhost-user cases for passt here. Yes, it would. And in particular those would be useful for my talk as well. > Anyway, I'll give this a try soon. I can also apply it right away if > you prefer. >=20 --=20 David Gibson | I'll have my music baroque, and my code david AT gibson.dropbear.id.au | minimalist, thank you. NOT _the_ _other_ | _way_ _around_! http://www.ozlabs.org/~dgibson --hUHWqQ+edAnUA88O Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEO+dNsU4E3yXUXRK2zQJF27ox2GcFAmYQwh0ACgkQzQJF27ox 2Ge8Kg//Y8HX8vgb1MIPUm4sS5taRSmuXDTITPKDu2vPMeoPQs1/sZJlaGOlA2r3 HqBSScfXzUBqLOFZJrcabYhInqhdDZo5UBc3WdsXnDv0+0umId1blw2kLC9KhgLC 1/q9gPu9a7T2RqjnjxlfyLEkhXy4ZZAdorkN5GYqDjx6HJPkST5qS7wVLmIb36Zj +kcRdvBh6utUAKnDiGPV1zxyNCdVE5SN/K4XTq2Mbe6iZVQnwQP3TuzNqWXOyUKR gwiRdrkFdiU050wxGRNYWm3SUSqRwg/DtEfvVoEEv/pLamQLzcgmkqPaGEk7ipx0 7ynjoQlk6NbwDVeDkgih4Bodg4nP4cYQGigpCwt7RYxgHF5LK+8mcYIiK+aITedG vbXG9aXVezoxd5SdayMiiHVMbDbn5QcwZ6rnMdLneov6X7Y5ZPT8aIdC/FhDa/MD dFw/4ppjWUc8N/LjpCu1VEW8wcfy30LTmRH2VmB8sEghG0qVbuLJAYtQ9gDrtZVT xb/gbTGQVB9b7/L/ELBZNJjY4M7W9eLh3x3gQHt46JtLUhQH8OEP00PVQBrhWy1u 8s6bszPHajHxdDerLknlqTNnmyXE5wczSxL2ZW2HAR8cKmHSX9sT8c8SlXLsfGRn QvvY3d3tllJh3cMjSaCjFnc6hauHkT27zvSOOMusMu2QKuyWVlQ= =Fush -----END PGP SIGNATURE----- --hUHWqQ+edAnUA88O--