From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: passt.top; dmarc=none (p=none dis=none) header.from=gibson.dropbear.id.au Authentication-Results: passt.top; dkim=pass (2048-bit key; secure) header.d=gibson.dropbear.id.au header.i=@gibson.dropbear.id.au header.a=rsa-sha256 header.s=202508 header.b=EQy8gUNw; dkim-atps=neutral Received: from mail.ozlabs.org (mail.ozlabs.org [IPv6:2404:9400:2221:ea00::3]) by passt.top (Postfix) with ESMTPS id 90AC35A0271 for ; Tue, 05 Aug 2025 08:09:44 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gibson.dropbear.id.au; s=202508; t=1754374181; bh=wzSDoGuDCfOC/0a3SgoH1RuHD3Xo94G/g4iblxBOrfU=; h=Date:From:To:Cc:Subject:From; b=EQy8gUNwjnFWVjBq5cX0FtH0xkkTvHcU40UaQ9AcS3pz1eNRr1FcvRRAW/3iQT5w8 0jXk2PfQpBvw2TDyCEc2faeITNnjCffDPh4ihpvpNdoxDkkx3YiFjhNByckhuSm8C7 9YvAa14rMjOp7pZcln1WQDRmkuGSXRnzF1w+axk3+GQkLu+Tmk/dVKmVvHXbbZBmZP 1tVl2sG+iRbu6J28bQ3x4SBnOvgNjF9KCZy4LTcNacs3eXooCqHeIeKxA+BCM2XzXC ntU3fnWqLrItGdK29fF2ez45D3RiPb+XNh8EFkTF1WHrJFFeJ3BGMNgtsLQ51tGR0z DX3Cej/9hHZ4Q== Received: by gandalf.ozlabs.org (Postfix, from userid 1007) id 4bx311132Gz4wcd; Tue, 5 Aug 2025 16:09:41 +1000 (AEST) Date: Tue, 5 Aug 2025 16:09:34 +1000 From: David Gibson To: Stefano Brivio Subject: Exeter testing, next steps Message-ID: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="tTWdI+lJz6gZvm9z" Content-Disposition: inline Message-ID-Hash: UCBM7LIYUM6FYCBFJQU74F5ZORKIU4HP X-Message-ID-Hash: UCBM7LIYUM6FYCBFJQU74F5ZORKIU4HP X-MailFrom: dgibson@gandalf.ozlabs.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: passt-dev@passt.top X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: --tTWdI+lJz6gZvm9z Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Today I finally had a good look at what the next steps need to be if we are to use exeter based test "for real" in the passt repo. I already have draft series which move a bunch of the simpler tests to exeter. But in order to actually use these we need some sort of runner. We're not tied to that runner, we can easily change - that's the whole point of exeter - but we need to have something. AIUI, Stefano is not happy with the idea of using either Avocado or Meson as the default which were the runners I initially focused on for exeter. I now suggest two more options: 1) Add a tool as part of exeter that will generate a BATS test script from an exeter test program. So you'd do something like: $ exetool --bats > foo.bats $ bats foo.bats This should be pretty easy to do, it's basically what I already have for Avocado support, indeed a little easier. For reasons internal to exeter, Python is the obvious choice to implement exetool, but I could do it in shell if you really don't like that. 2) Hand-roll a minimal exeter runner as part of passt's existing test scripts. I'm thinking you could essentially point our test stuff at an exeter program as an alternative to pointing it at a file with the existing test DSL. This is more work, but still not too bad. It has the advantage of not adding another dependency, and means we could count exeter results along with our existing test results in the final summary. However, we'd lose parallel execution and filtering. Stefano, would you be willing to merge patches which add some basic exeter tests using one of these approaches? This would probably just be static checked and build tests at this point, as a proof-of-concept. If we can start introducing some exeter tests, the next step would be to work on the support library stuff for constructing more complex network environments from namespaces. I have draft series with this as well, but I was looking at splitting it into another mini-project (tentative name "sinte" - Simulated Inter Network Test Environment). --=20 David Gibson (he or they) | I'll have my music baroque, and my code david AT gibson.dropbear.id.au | minimalist, thank you, not the other way | around. http://www.ozlabs.org/~dgibson --tTWdI+lJz6gZvm9z Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEO+dNsU4E3yXUXRK2zQJF27ox2GcFAmiRoB0ACgkQzQJF27ox 2GetXBAAgbEpmiiUoJIByrXtL9w8/l8Gt2ncgcEnPYCJeGdDasYWUm/NkvBamAag 55dxQigL/qT+QOoUe/dQQ/7Qzxst0Uu55C3REMOak4sUYjX9pV4ZHKih8lFiAeY6 pw+5FQQ5Nnu0fWhHO7zEgXMu6EfPAeUM+gMQjvypG9bPunL0s0qqDWshw0sgYv9B 08oL5cBLzRPqAyryG3H4585MuIPWkYObYkN8fpI8brO0KhqGvF8/2us2oi8RYdfd W97FQRMNhGXOuSgWSw6ZjqPE4Rt8AD7Zxwo/dcrveYP1Drvwwa4ipCwJCIdxFv9l prDvwQHWCEzc59fC3hnv9bVr4TeEuwWvCEUTi9MiCD7ZVuwIy+h9RTIPQsTbiURy aHJShz6ngm+ACilk8UXqsnQX2nUHoolzhsLfry4c84QectDN6GGhbg4WPC5bofE1 WE4oD6Wjpqmz8ZSYo3AHm1uJRRs7U74GyjV005ZZlTej34gceipgq/wiJn3ZlZ3e mK01u+hbSvvlNXjEl8OXJOfa2XmJZ/tETTjNKqYgcCqHWOgu/gvYiqX1Lf9LS5e8 096b3m9Qc2rlCvXjNtR8os8+9NPZG7cQwnltUmwDWQpVgIbHhUlIKnvUQO8ntXQ2 rTSnNzEuev08Duin/gAvP9ifeR9SaTDgVe5GUu/9zgrT8rjr1cI= =kQ5x -----END PGP SIGNATURE----- --tTWdI+lJz6gZvm9z--