From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: passt.top; dmarc=none (p=none dis=none) header.from=gibson.dropbear.id.au Authentication-Results: passt.top; dkim=pass (2048-bit key; secure) header.d=gibson.dropbear.id.au header.i=@gibson.dropbear.id.au header.a=rsa-sha256 header.s=202508 header.b=D9BshfN7; dkim-atps=neutral Received: from mail.ozlabs.org (mail.ozlabs.org [IPv6:2404:9400:2221:ea00::3]) by passt.top (Postfix) with ESMTPS id 175EB5A0279 for ; Mon, 01 Sep 2025 06:25:21 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gibson.dropbear.id.au; s=202508; t=1756700718; bh=tlNoKAXpwoAy9zuZyIbUY/gRQp/ZXRCwzSxQNXo5q0I=; h=From:To:Cc:Subject:Date:From; b=D9BshfN7+3GxXJ8BHExk/yomIvSeZ6KwCmsiQnczCnpXHCrXMFO160of4Xw43RDNj HQRQLI1rzTN/ssXHUTIVwLOdl1I4+BZmfP3A80SCFrJe5aj9b8HFqkJoG0fwxGo8wc ri9eTjUOi/DJXeOr2ZDAHVxOOUqwuRuPj6pyRiwkBKkq+HMQbQaY4F+CP80B30nLvM m9cpwS8UzZCNqEUdkdFWPd0SR/V9duhDGXFIGa7Z6xe+4j+OKBjspgp/89ebuBnuDg cMyxtIqsGW3i07Kd/ZjrtqCMFwEd/8HoIviXdKi7YsoVgtkO1WfufODX5hhsfxXJ+1 dd6/0vEHNCSzA== Received: by gandalf.ozlabs.org (Postfix, from userid 1007) id 4cFbQ60wH5z4w91; Mon, 1 Sep 2025 14:25:18 +1000 (AEST) From: David Gibson To: passt-dev@passt.top, Stefano Brivio Subject: [PATCH v6 0/4] New proof-of-concept based exeter tests Date: Mon, 1 Sep 2025 14:25:11 +1000 Message-ID: <20250901042515.138861-1-david@gibson.dropbear.id.au> X-Mailer: git-send-email 2.51.0 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Message-ID-Hash: 4QITHVICJBQZCMUUOX2JU5H2XV2G6ZG6 X-Message-ID-Hash: 4QITHVICJBQZCMUUOX2JU5H2XV2G6ZG6 X-MailFrom: dgibson@gandalf.ozlabs.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: David Gibson X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Here's a new approach to building passt tests with exeter. This new one no longer uses Avocado in the default case, although it would still be possible to manually run the exeter based tests with Avocado. Here's another draft of my work on testing passt with Avocado and the exeter library I recently created. It includes Cleber's patch adding some basic Avocado tests and builds on that. For now this only does simple tests, to show how the integration could work. It adds some new trivial "smoke tests" and converts the linter and build checks to exeter. More complex tests will require building the sinte/pesto library we've discussed. A lot of the work for that already exists in my earlier exeter test series, but it will need some rework to split it into a separate component. v6: * Use exeter's new metadata support to print nicer test names v5: * Updated according to Stefano's review - Fixed a number of whitespace errors - Improved many comments and variable names to make things clearer * New patch adding parallel test execution with BATS * Improved autodetection of exeter tests using "exetool probe" David Gibson (4): test: Extend test scripts to allow running exeter tests. test: Run static checkers as exeter tests test: Convert build tests to exeter test: Allow exeter & podman tests to be parallel executed with BATS test/.gitignore | 2 + test/Makefile | 22 ++++++- test/build/all | 61 ------------------- test/build/build.py | 109 ++++++++++++++++++++++++++++++++++ test/build/clang_tidy | 17 ------ test/build/cppcheck | 17 ------ test/build/static_checkers.sh | 26 ++++++++ test/lib/exeter | 57 ++++++++++++++++++ test/run | 18 ++++-- test/smoke/smoke.sh | 33 ++++++++++ 10 files changed, 260 insertions(+), 102 deletions(-) delete mode 100644 test/build/all create mode 100755 test/build/build.py delete mode 100644 test/build/clang_tidy delete mode 100644 test/build/cppcheck create mode 100755 test/build/static_checkers.sh create mode 100644 test/lib/exeter create mode 100755 test/smoke/smoke.sh -- 2.51.0