From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail.ozlabs.org (gandalf.ozlabs.org [150.107.74.76]) by passt.top (Postfix) with ESMTPS id 8DF0E5A004E for ; Fri, 05 Jul 2024 13:46:51 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gibson.dropbear.id.au; s=202312; t=1720180000; bh=usQtW/MkPSaOedORUzmlbRvNVAv3wOWXm9S5ZJcWdEg=; h=Date:From:To:Cc:Subject:From; b=jOWg6yIA2rJdDLQBOco7Yg3e1dWO1TqR3KfetQlht4SQb5ftnh8VFttQ6SelbhpB/ f1BZ4nqDunQglLtVdPcoLEvvVMCms7IGhPBn1nnM7saytgxBIi8uSZbZ2NctEo24am uYcLYTU1TRsKQrJ7ZoWDWpK72oXCqT++W5r/cd33oho1GfLttjPZkJVApsnBZfaNiB l4t+xl2qBLWa4/37ytCYVbRrht1jVCb/V8yWX0JF6xAL4e5AX2eiNPctb5uUOcodXx V9p+Sp7YgVKb/e07OknqSWohSOL2o8vJCd/JUd3uID8aTnMmU8lnxQyKlC7dElPZgX jvbat8TLOIDJw== Received: by gandalf.ozlabs.org (Postfix, from userid 1007) id 4WFsDc3FTXz4wx5; Fri, 5 Jul 2024 21:46:40 +1000 (AEST) Date: Fri, 5 Jul 2024 21:46:33 +1000 From: David Gibson To: Cleber Rosa Subject: Avocado, passt, etc. Message-ID: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="m2L/3RCsK6A34ez7" Content-Disposition: inline Message-ID-Hash: G4E2KGHWWDWDK7JBXXOJFKCE4ZNQEZM2 X-Message-ID-Hash: G4E2KGHWWDWDK7JBXXOJFKCE4ZNQEZM2 X-MailFrom: dgibson@gandalf.ozlabs.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: passt-dev@passt.top, David Gibson X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: --m2L/3RCsK6A34ez7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi again, Following on on your specific patch, I've done a little bit more thinking on how we might want to use Avocado for more extensive testing. I think I mentioned during some of our calls my idea of having some sort of test side library to automatically turn test code into executables that can be used from Avocado's extended exec stuff. I don't think I explained it very clearly though. I've made a super rudimentary draft of this idea here: https://gitlab.com/dgibson/exeter The "example.py" program, run without arguments lists all the ways you can run it, each of which constitutes a single test case. The idea is that that "list" mode would be extended to generate the json manifest that Avocado can consume. So first you run it to generate the json, then you feed that into avocado which will run each of the cases as a separate test. Ideally avocado could do both steps itself (this is what I was talking about with the "variant 2" of the extended exec stuff). But we can do it externally for the time being. Having things separated this way makes it super easy to manually re-run a specific test case. We can also allow the same library to emit the list of tests in other formats for other runners (being able to do this for meson seems like it might be pretty useful). Obviously, it would need a bunch more functionality to be really useful: ways of automatically generating matrices of tests, composing functions together to make test cases, as well as basic helper functions like assert variants. --=20 David Gibson (he or they) | I'll have my music baroque, and my code david AT gibson.dropbear.id.au | minimalist, thank you, not the other way | around. http://www.ozlabs.org/~dgibson --m2L/3RCsK6A34ez7 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEO+dNsU4E3yXUXRK2zQJF27ox2GcFAmaH3QUACgkQzQJF27ox 2GcCSQ//VzS1ZWolnsinV/QcMth2sT3aPbY0uS8A9CIp7tNeNx5iDHwiuCy68TbN ivrJOCogV+PQPPDvmxejYfS4yQo2OdOE/FhRkTwMg7fShf4bHnZ8ygUOAR8WpW31 K1uzG9nilCxSdcWJxs9bRQNRxcZ555yQeKc+dwDHJlNfJBgWWu9ut433LLvV+UT5 ek3HrRFYW9238iCWGHuth4467yppst1aqqs/x4j+TuVb1wE5r9T2hTcIWpdhTjro 5mJjIcNxGPdiM+5MRYv4G6WipzHPS/YqV66ExRBVBQKk87lHdhM6bZl0yRA0VoBF ytN+xgwErYrqCXmWuSrrvJ/SaT7HTKg377hMPKT5hv8QiK40vEtIj3ED+4Zn4TNE /5liTh+nOt49kBpzhqHXBKbXVsZi07oWQZEes9eYliY4nBMvDElH1C2o2Ro8/v+f Oe3t+GWbpv1QZ/DGIou1ukqHlhg0Ct7CJGDBBEqGWHrY31ZAEpqdoP+9Ki+Qls4/ LTNmKHrjKCLBE9KWzP8FGtCgpRTppvvogdu+afyvgvXwEzU3KpnvLM28Z5vD1pRk /2zXuMbv+6D+Bl68p437ayZ9CgxlmaHmDbCIBpTuBSap3IV2u4p0GakEILvwnKmH Zq+BPZSr8dBzv0pMbckoJfe3efogd6mUb2mhgX5vNGiAsKLEN5w= =6YWe -----END PGP SIGNATURE----- --m2L/3RCsK6A34ez7--