From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: passt.top; dmarc=none (p=none dis=none) header.from=gibson.dropbear.id.au Authentication-Results: passt.top; dkim=pass (2048-bit key; secure) header.d=gibson.dropbear.id.au header.i=@gibson.dropbear.id.au header.a=rsa-sha256 header.s=202508 header.b=tFo4Ub51; dkim-atps=neutral Received: from mail.ozlabs.org (gandalf.ozlabs.org [150.107.74.76]) by passt.top (Postfix) with ESMTPS id D03AA5A0279 for ; Fri, 05 Sep 2025 08:43:22 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gibson.dropbear.id.au; s=202508; t=1757054599; bh=OQLKcWr++jyRAnO6iLxpAiUeHyyBzfEiu1NWWoM8JZ0=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=tFo4Ub51hUGpbqdN3j/WVhM/dDkbFPXBJqmHrZuxqT0cUMGg34IviAkTGd3SWdEfG aU3Y++bCnpoy/gBQO0NS6fBBgJgOAXmYmm6owSo+DXblAYytWuwdlGgc2SUCIpjxR5 w34N4LJgU7Pkxe6cToTIF5oNHXAxn3SgZ1H5ju2qFwZJ6Bk36kEeb7CxfqNFyc6ZLa EF2/W860GocVlHoJsld3amK5Bs4DOgUm1ElVEq6LmVkihtzrx20ZuzWPDBSuY4llZ3 P5Sz9j4e4W/Uq7rzxYv1cfu1xRYPgqGg/oD1pckNefED2YtUaC8yaQea/oziUZoyAb jUVXrgz2gJ/nA== Received: by gandalf.ozlabs.org (Postfix, from userid 1007) id 4cJ6HW4VDtz4wB1; Fri, 5 Sep 2025 16:43:19 +1000 (AEST) Date: Fri, 5 Sep 2025 11:35:53 +1000 From: David Gibson To: Stefano Brivio Subject: Re: [PATCH v7 0/4] Introduce first exeter based test infrastructure Message-ID: References: <20250904025004.491185-1-david@gibson.dropbear.id.au> <20250905011433.41c0d242@elisabeth> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="TKIASoAKVB7HePe5" Content-Disposition: inline In-Reply-To: <20250905011433.41c0d242@elisabeth> Message-ID-Hash: TZQF2AJJOVOHRP4A7L3MG52PNOGVRNTT X-Message-ID-Hash: TZQF2AJJOVOHRP4A7L3MG52PNOGVRNTT X-MailFrom: dgibson@gandalf.ozlabs.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: passt-dev@passt.top X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: --TKIASoAKVB7HePe5 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Sep 05, 2025 at 01:14:33AM +0200, Stefano Brivio wrote: > On Thu, 4 Sep 2025 12:50:00 +1000 > David Gibson wrote: >=20 > > Here's a new approach to building passt tests with exeter. This new > > one no longer uses Avocado in the default case, although it would > > still be possible to manually run the exeter based tests with Avocado. > >=20 > > For now this only does simple tests, to show how the integration could > > work. It adds some new trivial "smoke tests" and converts the linter > > and build checks to exeter. More complex tests will require building > > the tunbridge library we've discussed. A lot of the work for that > > already exists in my earlier exeter test series, but it will need some > > rework to split it into a separate component. > >=20 > > v7: > > * Use "exetool list" rather than "--list" directly to get test manifes= t. > > * Update Makefiles to automatically update exeter sources as necessary. > > * Update series cover letter removing some outdated information. >=20 > I was about to apply this, but then realised that the usual build test > links at https://passt.top/#ci disappeared, see also > https://passt.top/builds/latest/web/ci.js. Huh, that's weird. > I didn't really investigate > yet, we're missing something equivalent to the "test" directive. We shouldn't be. exeter() calls status_test_{start,ok,fail} much like test(). > If I > recall correctly, that was working in v5, but I'm not sure why. I still > need to look into this, unless you figure it out meanwhile. Right, you said v5 worked. Hrm.... one of the main differences since v5 is getting the descriptions, which *are* used as the parameter to status_test_start. Could the descriptions be using some character we weren't before and we're missing an escape somewhere? Not seeing an obvious spot. > Something minor I noticed is that indentation of some lines in > run_selected() is broken now (spaces instead of tabs). Drat, I thought I fixed my editor config for that. I've fixed it in my branch, I'll hold of on another spin until we figure out what's going on with the CI links. --=20 David Gibson (he or they) | I'll have my music baroque, and my code david AT gibson.dropbear.id.au | minimalist, thank you, not the other way | around. http://www.ozlabs.org/~dgibson --TKIASoAKVB7HePe5 Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEO+dNsU4E3yXUXRK2zQJF27ox2GcFAmi6PmMACgkQzQJF27ox 2GdZ+BAAiAUf7y9WkGKwRI1G00Tn/z1hnzovJdoL/YMdihLTx7+LSEFoutMB9nFY N7UErV7nTFeKzje4GmdrStzumk1JEK6QlEkIxnXTdPl4d+6dlFkJD/Entg+0vfKq 8wW+SPv08WYnTqYOo50cinRLbtVGb8WBKm5I2h+vWX8Pm/pDwvMHqbuDNePYEb7S PQM0t8KlBwcXO01mbASku/+o0gAT/mdDrXdP2v+g8pTsyosVnZf2eGXS3ZciN8ID cAnGpoZu3x5Pc32E5btpo62tucMrVCyEDWctSmwL9q3P7pzHduOzCCG20DkRs+Kz pVKRVubM8arvi/G5QoTsJ5HALyLKD8JReMw0+7OXvmkua9jCunD1AR+6WNznjI0h Twj1BwXiACAqlmvh6I2QuzM8sR5rkcahEmKT4bvQjMvMtDe/1wsEDgPxUurQUteD Gp8PHtfiDn/V2cA267dsKb9p0W0au1JCmBiGKecFTt+lPegsEebqqr+TzKxO97i0 Q6Y85xXnFPK3CoWL1ruMLBJcHiDJh9ikwb8ZeAoUIlM00iFMcYBR1KqVDtnA0zxD cppqlf4prg9rfmgtRSye6xMEYi5VVYIQZF1JzdMFyxhNdWVxBhnu3FJCRGjgKguf 0fvNVFzU/ZJnU9zx3tvwlhKpGz8AaDORy/uAhIX+dQusQQG+l2I= =hcI5 -----END PGP SIGNATURE----- --TKIASoAKVB7HePe5--