From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: passt.top; dmarc=none (p=none dis=none) header.from=gibson.dropbear.id.au Authentication-Results: passt.top; dkim=pass (2048-bit key; secure) header.d=gibson.dropbear.id.au header.i=@gibson.dropbear.id.au header.a=rsa-sha256 header.s=202508 header.b=QdsommIW; dkim-atps=neutral Received: from mail.ozlabs.org (gandalf.ozlabs.org [150.107.74.76]) by passt.top (Postfix) with ESMTPS id 9DEA65A0271 for ; Thu, 04 Sep 2025 04:50:08 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gibson.dropbear.id.au; s=202508; t=1756954205; bh=PXDK+wJJxLhK5lmGPyscJgHJdhoB3gJnZo2gZ0W8f0k=; h=From:To:Cc:Subject:Date:From; b=QdsommIWZAhv+HKtBQabFdEO9GV8+FIF8v+9LPc2cW7kENI+TGHefotS8PgOUhKjc Yr2Vm2Ton7MzPkFYm48zgWgzF/zD1SBwHMtfGYMsb0dkaytJPts+1SCQpuM9HPtHF9 Ny+TxzvUq/4d8kW3/vvO5OcSf0iLfkEW4225gFMXP3+bOIoEpqZOXxGbMyR1wqAWFv TQWJ4cKooMTRuYuQnVvbWvug0i6WkcEfVYVsDxDRJ9x9/tcfDtesNtr7NCylgRFhBS CJ4pB81ljoiJ3gC+EohwPT+yKJONWZyJR/pBN2vYd9VHV1sp4cHDnzWh49gyQUPzOV O0uy76fPodK0A== Received: by gandalf.ozlabs.org (Postfix, from userid 1007) id 4cHP8s5Fqzz4w8y; Thu, 4 Sep 2025 12:50:05 +1000 (AEST) From: David Gibson To: Stefano Brivio , passt-dev@passt.top Subject: [PATCH v7 0/4] Introduce first exeter based test infrastructure Date: Thu, 4 Sep 2025 12:50:00 +1000 Message-ID: <20250904025004.491185-1-david@gibson.dropbear.id.au> X-Mailer: git-send-email 2.51.0 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Message-ID-Hash: QVD4YGCTRNMW5FORWN6H7ZQGA4DUF7JH X-Message-ID-Hash: QVD4YGCTRNMW5FORWN6H7ZQGA4DUF7JH X-MailFrom: dgibson@gandalf.ozlabs.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: David Gibson X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Here's a new approach to building passt tests with exeter. This new one no longer uses Avocado in the default case, although it would still be possible to manually run the exeter based tests with Avocado. For now this only does simple tests, to show how the integration could work. It adds some new trivial "smoke tests" and converts the linter and build checks to exeter. More complex tests will require building the tunbridge library we've discussed. A lot of the work for that already exists in my earlier exeter test series, but it will need some rework to split it into a separate component. v7: * Use "exetool list" rather than "--list" directly to get test manifest. * Update Makefiles to automatically update exeter sources as necessary. * Update series cover letter removing some outdated information. v6: * Use exeter's new metadata support to print nicer test names v5: * Updated according to Stefano's review - Fixed a number of whitespace errors - Improved many comments and variable names to make things clearer * New patch adding parallel test execution with BATS * Improved autodetection of exeter tests using "exetool probe" David Gibson (4): test: Extend test scripts to allow running exeter tests. test: Run static checkers as exeter tests test: Convert build tests to exeter test: Allow exeter & podman tests to be parallel executed with BATS test/.gitignore | 2 + test/Makefile | 24 +++++++- test/build/all | 61 ------------------- test/build/build.py | 109 ++++++++++++++++++++++++++++++++++ test/build/clang_tidy | 17 ------ test/build/cppcheck | 17 ------ test/build/static_checkers.sh | 26 ++++++++ test/lib/exeter | 57 ++++++++++++++++++ test/run | 18 ++++-- test/smoke/smoke.sh | 33 ++++++++++ 10 files changed, 261 insertions(+), 103 deletions(-) delete mode 100644 test/build/all create mode 100755 test/build/build.py delete mode 100644 test/build/clang_tidy delete mode 100644 test/build/cppcheck create mode 100755 test/build/static_checkers.sh create mode 100644 test/lib/exeter create mode 100755 test/smoke/smoke.sh -- 2.51.0