From: David Gibson <david@gibson.dropbear.id.au>
To: passt-dev@passt.top, Stefano Brivio <sbrivio@redhat.com>
Cc: crosa@redhat.com, jarichte@redhat.com,
David Gibson <david@gibson.dropbear.id.au>
Subject: [PATCH 11/27] avocado-classless: Allow overriding default timeout
Date: Tue, 27 Jun 2023 12:54:12 +1000 [thread overview]
Message-ID: <20230627025429.2209702-12-david@gibson.dropbear.id.au> (raw)
In-Reply-To: <20230627025429.2209702-1-david@gibson.dropbear.id.au>
Currently the avocado-classless plugin always uses a fixed (short) timeout
for tests. However the appropriate timeout really depends on what's being
tested.
Allow tests to set different timeouts, by placing not a plain function, but
an object representing metadata into the classless test manifest. Then
tests can use a parameterized version of the decorator to put additional
information in that metadata. For now, just add the timeout there, but
we might add other things in future.
Signed-off-by: David Gibson <david@gibson.dropbear.id.au>
---
.../avocado_classless/manifest.py | 11 ++++++++---
test/avocado_classless/avocado_classless/plugin.py | 4 +---
test/avocado_classless/avocado_classless/test.py | 14 ++++++++++----
test/avocado_classless/examples.py | 8 +++++++-
4 files changed, 26 insertions(+), 11 deletions(-)
diff --git a/test/avocado_classless/avocado_classless/manifest.py b/test/avocado_classless/avocado_classless/manifest.py
index 8f7fe688..34c815cd 100644
--- a/test/avocado_classless/avocado_classless/manifest.py
+++ b/test/avocado_classless/avocado_classless/manifest.py
@@ -12,6 +12,7 @@ Manage the manifest of classless tests in a module
import sys
MANIFEST = "__avocado_classless__"
+DEFAULT_TIMEOUT = 60.0
def manifest(mod):
@@ -24,14 +25,18 @@ def manifest(mod):
class ManifestTestInfo: # pylint: disable=R0903
"""Metadata about a classless test"""
- def __init__(self, func):
+ def __init__(self, func, timeout=DEFAULT_TIMEOUT):
self.func = func
+ self.__timeout = float(timeout)
def run_test(self):
self.func()
+ def timeout(self):
+ return self.__timeout
-def manifest_add(mod, name, func):
+
+def manifest_add(mod, name, func, **kwargs):
"""Register a function as a classless test"""
if isinstance(mod, str):
@@ -40,4 +45,4 @@ def manifest_add(mod, name, func):
mfest = manifest(mod)
if name in mfest:
raise ValueError(f"Duplicate classless test name {name}")
- mfest[name] = ManifestTestInfo(func)
+ mfest[name] = ManifestTestInfo(func, **kwargs)
diff --git a/test/avocado_classless/avocado_classless/plugin.py b/test/avocado_classless/avocado_classless/plugin.py
index 442642d5..e2c9b1eb 100644
--- a/test/avocado_classless/avocado_classless/plugin.py
+++ b/test/avocado_classless/avocado_classless/plugin.py
@@ -38,7 +38,6 @@ from avocado.core.utils import messages
from .manifest import manifest
SHBANG = b'#! /usr/bin/env avocado-runner-avocado-classless'
-DEFAULT_TIMEOUT = 5.0
def load_mod(path):
@@ -184,7 +183,6 @@ class ClasslessRunner(BaseRunner):
process.start()
time_started = time.monotonic()
- timeout = DEFAULT_TIMEOUT
next_status_time = None
while True:
time.sleep(RUNNER_RUN_CHECK_INTERVAL)
@@ -196,7 +194,7 @@ class ClasslessRunner(BaseRunner):
):
next_status_time = now + RUNNER_RUN_STATUS_INTERVAL
yield messages.RunningMessage.get()
- if (now - time_started) > timeout:
+ if (now - time_started) > testinfo.timeout():
process.terminate()
yield messages.FinishedMessage.get("interrupted",
"timeout")
diff --git a/test/avocado_classless/avocado_classless/test.py b/test/avocado_classless/avocado_classless/test.py
index e5251960..04fa52ab 100644
--- a/test/avocado_classless/avocado_classless/test.py
+++ b/test/avocado_classless/avocado_classless/test.py
@@ -14,10 +14,16 @@ from collections import Counter
from .manifest import manifest_add
-def test(func):
- """Function decorator to mark a function as a classless test"""
- manifest_add(func.__module__, func.__name__, func)
- return func
+def classless_test(**kwargs):
+ """Mark a function as a classless test with options"""
+ def dec(func):
+ manifest_add(func.__module__, func.__name__, func, **kwargs)
+ return func
+ return dec
+
+
+# Simple version of classless_test with default options
+test = classless_test()
def test_output(*tests):
diff --git a/test/avocado_classless/examples.py b/test/avocado_classless/examples.py
index a0e883f3..8625c9d3 100644
--- a/test/avocado_classless/examples.py
+++ b/test/avocado_classless/examples.py
@@ -7,8 +7,9 @@ are expected to fail.
"""
import sys
+import time
-from avocado_classless.test import test, test_output
+from avocado_classless.test import classless_test, test, test_output
@test
@@ -49,3 +50,8 @@ def positive_fraction():
@test_output(is_integer, is_positive)
def negative_fraction():
return -3.5
+
+
+@classless_test(timeout=1.0)
+def timeout():
+ time.sleep(3)
--
@@ -7,8 +7,9 @@ are expected to fail.
"""
import sys
+import time
-from avocado_classless.test import test, test_output
+from avocado_classless.test import classless_test, test, test_output
@test
@@ -49,3 +50,8 @@ def positive_fraction():
@test_output(is_integer, is_positive)
def negative_fraction():
return -3.5
+
+
+@classless_test(timeout=1.0)
+def timeout():
+ time.sleep(3)
--
2.41.0
next prev parent reply other threads:[~2023-06-27 2:54 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-06-27 2:54 [PATCH 00/27] RFC: Start converting passt & pasta tests to Avocado using special plugin David Gibson
2023-06-27 2:54 ` [PATCH 01/27] avocado: Make a duplicate copy of testsuite for comparison purposes David Gibson
2023-06-27 2:54 ` [PATCH 02/27] avocado: Don't double download assets for test/ and oldtest/ David Gibson
2023-06-27 2:54 ` [PATCH 03/27] avocado: Move static checkers to avocado David Gibson
2023-06-27 2:54 ` [PATCH 04/27] avocado: Introduce "avocado-classless" plugin, runner and outline David Gibson
2023-06-27 2:54 ` [PATCH 05/27] avocado, test: Add static checkers for Python code David Gibson
2023-06-27 2:54 ` [PATCH 06/27] avocado: Resolver implementation for avocado-classless plugin David Gibson
2023-06-27 2:54 ` [PATCH 07/27] avocado: Add basic assertion helpers to " David Gibson
2023-06-27 2:54 ` [PATCH 08/27] tasst, avocado: Introduce library of common test helpers David Gibson
2023-06-27 2:54 ` [PATCH 09/27] avocado-classless: Test matrices by composition David Gibson
2023-06-27 2:54 ` [PATCH 10/27] tasst: Helper functions for executing commands in different places David Gibson
2023-06-27 2:54 ` David Gibson [this message]
2023-06-27 2:54 ` [PATCH 12/27] avocado: Convert build tests to avocado David Gibson
2023-06-27 2:54 ` [PATCH 13/27] tasst: Add helpers for running background commands on sites David Gibson
2023-06-27 2:54 ` [PATCH 14/27] tasst: Add helper to get network interface names for a site David Gibson
2023-06-27 2:54 ` [PATCH 15/27] tasst: Add helpers to run commands with nstool David Gibson
2023-06-27 2:54 ` [PATCH 16/27] tasst: Add ifup and network address helpers to Site David Gibson
2023-06-27 2:54 ` [PATCH 17/27] tasst: Helper for creating veth devices between namespaces David Gibson
2023-06-27 2:54 ` [PATCH 18/27] tasst: Add helper for getting MTU of a network interface David Gibson
2023-06-27 2:54 ` [PATCH 19/27] tasst: Add helper to wait for IP address to appear David Gibson
2023-06-27 2:54 ` [PATCH 20/27] tasst: Add helpers for getting a site's routes David Gibson
2023-06-27 2:54 ` [PATCH 21/27] tasst: Helpers to test transferring data between sites David Gibson
2023-06-27 2:54 ` [PATCH 22/27] tasst: IP address allocation helpers David Gibson
2023-06-27 2:54 ` [PATCH 23/27] tasst: Helpers for running daemons with a pidfile David Gibson
2023-06-27 2:54 ` [PATCH 24/27] tasst: Helpers for testing NDP behaviour David Gibson
2023-06-27 2:54 ` [PATCH 25/27] tasst: Helpers for testing DHCP & DHCPv6 behaviour David Gibson
2023-06-27 2:54 ` [PATCH 26/27] tasst: Helpers to construct a simple network environment for tests David Gibson
2023-06-27 2:54 ` [PATCH 27/27] avocado: Convert basic pasta tests David Gibson
2023-07-05 0:30 ` Stefano Brivio
2023-07-05 3:27 ` David Gibson
2023-07-07 17:42 ` Stefano Brivio
2023-07-10 7:45 ` David Gibson
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20230627025429.2209702-12-david@gibson.dropbear.id.au \
--to=david@gibson.dropbear.id.au \
--cc=crosa@redhat.com \
--cc=jarichte@redhat.com \
--cc=passt-dev@passt.top \
--cc=sbrivio@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://passt.top/passt
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for IMAP folder(s).