From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: passt.top; dmarc=pass (p=quarantine dis=none) header.from=redhat.com Authentication-Results: passt.top; dkim=pass (1024-bit key; unprotected) header.d=redhat.com header.i=@redhat.com header.a=rsa-sha256 header.s=mimecast20190719 header.b=cIYy79Kg; dkim-atps=neutral Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by passt.top (Postfix) with ESMTPS id F0A8D5A0271 for ; Tue, 02 Sep 2025 09:39:59 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1756798798; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HF5gkQ9J20JAzW8ckPkb43SrgjebZp1esbxxCzg+z1U=; b=cIYy79KgdZgJ+Re1ytYaQk1pIsfsDf4zNoD21tzFjFQJej+x5KMoNTBis3AyIKrgJzBlNL 33TF131VChv4I022XwWz/T1phiKoltAUbTabeDEjF+m9EUTjfMbqMeZmS+Ek2o5g6BWi4H aHXsDQDdahUvwOURncoo2xkfbIgvm1o= Received: from mail-wr1-f72.google.com (mail-wr1-f72.google.com [209.85.221.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-622-yZiWz3DINLiW3E9WJSJagA-1; Tue, 02 Sep 2025 03:39:57 -0400 X-MC-Unique: yZiWz3DINLiW3E9WJSJagA-1 X-Mimecast-MFC-AGG-ID: yZiWz3DINLiW3E9WJSJagA_1756798796 Received: by mail-wr1-f72.google.com with SMTP id ffacd0b85a97d-3d226c3a7c2so2080878f8f.1 for ; Tue, 02 Sep 2025 00:39:57 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1756798796; x=1757403596; h=content-transfer-encoding:mime-version:organization:references :in-reply-to:message-id:subject:cc:to:from:date:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=HF5gkQ9J20JAzW8ckPkb43SrgjebZp1esbxxCzg+z1U=; b=vVVIIO2ychdp2I6f1DKMz71lBQc2MpH9IlJ1AplZQ3HYUWLHNF+FZ3lXYznnanw0ud 4aPgzA6CGvssndBxIX/JosaVx8xRZ6MHHmCb2isIpgO6Yb0MS4aLD2fwCYLoA6weiT3n RFnjvsmq5uyGyVYKvM9ZeklggUbF//Kb3jUBTI2KdTL+nNbk9g+jr5vFU1Py6ql8yJ9c GOwgWxIM12cPjL4yJcKgA7rxURZTUULfzsRW8yEbxH9DjRuj3Fg8Uf7cQmqLagUN2uPU NMJRGGwbg9m61eiZm3+fwHshCfR+R1jc85nVhF76RpLL55m2LcPXIDJ2OZSEbkyRA01O j9kw== X-Gm-Message-State: AOJu0YxBorbAnv4/0t18yQMkwIKeQ1sO/EG5S1Hr2BaEndDheVTL5X2y m5d0nxCR7571ff3sRyUGUXwnHZo0qoes82PPc5hsZ8/Xr60+PDLmiAiK9fOvtlPIiJfsr5NgUC9 IwIjgmrwBRfJk42XNdKd1DO+kJZn1iyH3opIM6eXDdiDn7B++nuGlBqBjiLN2qg== X-Gm-Gg: ASbGncvZQTcUd948Rvt5NDK2luUaLFmkMJwmfH/FCEGfJ4XhJdSXi0wWwewJWObF+CW +Kj9p2urndgE327d7R3n9YzEY2f7cNBaxFz2lV/NxVnfNHXBPeL5FhyyKXDswWdNEQsYKf0k5u/ cfMduKj/JDMM2nQwJdUPfX2p2eRRne16kMscVzN+xKweCNB0B4XEcllRBU9lH2TTyOvfu/C8hIf ShLTI9yTfTeNPptAwSMll8UfcMj7sKeUzMD/kHZnfbdmNEEBRfAxRXBv9X3Y/x8g86ZxkYtjrKD QsaedTKfKgPBPrvxHjnrm1rsyfU1s37F2nAwbQAfdUl5HOVaFd8AzxW7Ke9Ju5pKjoqF X-Received: by 2002:a05:6000:2893:b0:3d3:8711:d951 with SMTP id ffacd0b85a97d-3d38711dd3emr8048179f8f.45.1756798795781; Tue, 02 Sep 2025 00:39:55 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGGjiZ6XvkukywORab/fBvNimsRcYihh65ZoxVp2KyvQuBABHPSeqxQK8Wyp6KOyZIuvtBuWA== X-Received: by 2002:a05:6000:2893:b0:3d3:8711:d951 with SMTP id ffacd0b85a97d-3d38711dd3emr8048163f8f.45.1756798795395; Tue, 02 Sep 2025 00:39:55 -0700 (PDT) Received: from maya.myfinge.rs (ifcgrfdd.trafficplex.cloud. [176.103.220.4]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-3d12c90a01bsm15911040f8f.31.2025.09.02.00.39.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 02 Sep 2025 00:39:54 -0700 (PDT) Date: Tue, 2 Sep 2025 09:39:53 +0200 From: Stefano Brivio To: David Gibson Subject: Re: [PATCH v6 3/4] test: Convert build tests to exeter Message-ID: <20250902093953.734411c7@elisabeth> In-Reply-To: <20250901042515.138861-4-david@gibson.dropbear.id.au> References: <20250901042515.138861-1-david@gibson.dropbear.id.au> <20250901042515.138861-4-david@gibson.dropbear.id.au> Organization: Red Hat X-Mailer: Claws Mail 4.2.0 (GTK 3.24.49; x86_64-pc-linux-gnu) MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-MFC-PROC-ID: VuhqvOFiyeK6DnIVZzcNQhE5nVKcN08ieza6wZQnCDg_1756798796 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Message-ID-Hash: EHMGPCFOLW7F4JV3CG7VTR5YEDVYCXR7 X-Message-ID-Hash: EHMGPCFOLW7F4JV3CG7VTR5YEDVYCXR7 X-MailFrom: sbrivio@redhat.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: passt-dev@passt.top X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: On Mon, 1 Sep 2025 14:25:14 +1000 David Gibson wrote: > +def test_make(target: str, expected_files: list[str]) -> None: > + """Test `make {target}` > + > + Arguments: > + target -- make target to invoke > + expected_files -- files make is expected to create > + > + Verifies that > + 1) `make target` completes successfully > + 2) expected_files care created by `make target` > + 3) expected_files are removed by `make clean` > + """ > + > + ex_paths = [Path(f) for f in expected_files] > + with clone_sources(): > + for p in ex_paths: > + assert not p.exists(), f"{p} existed before make" > + sh(f'make {target} CFLAGS="-Werror"') > + for p in ex_paths: > + assert p.exists(), f"{p} wasn't made" > + sh('make clean') > + for p in ex_paths: > + assert not p.exists(), f"{p} existed after make clean" > + > + > +exeter.register('make_passt', test_make, 'passt', ['passt']) > +exeter.register('make_pasta', test_make, 'pasta', ['pasta']) > +exeter.register('make_qrap', test_make, 'qrap', ['qrap']) > +exeter.register('make_all', test_make, 'all', ['passt', 'pasta', 'qrap']) I guess I'm missing something, but how do you set descriptions from Python? By the way, the shell script interface you added for that looks quite convenient and obvious to me. -- Stefano