public inbox for passt-dev@passt.top
 help / color / mirror / code / Atom feed
From: David Gibson <david@gibson.dropbear.id.au>
To: passt-dev@passt.top, Stefano Brivio <sbrivio@redhat.com>
Cc: crosa@redhat.com, jarichte@redhat.com,
	David Gibson <david@gibson.dropbear.id.au>
Subject: [PATCH 11/27] avocado-classless: Allow overriding default timeout
Date: Tue, 27 Jun 2023 12:54:12 +1000	[thread overview]
Message-ID: <20230627025429.2209702-12-david@gibson.dropbear.id.au> (raw)
In-Reply-To: <20230627025429.2209702-1-david@gibson.dropbear.id.au>

Currently the avocado-classless plugin always uses a fixed (short) timeout
for tests.  However the appropriate timeout really depends on what's being
tested.

Allow tests to set different timeouts, by placing not a plain function, but
an object representing metadata into the classless test manifest.  Then
tests can use a parameterized version of the decorator to put additional
information in that metadata.  For now, just add the timeout there, but
we might add other things in future.

Signed-off-by: David Gibson <david@gibson.dropbear.id.au>
---
 .../avocado_classless/manifest.py                  | 11 ++++++++---
 test/avocado_classless/avocado_classless/plugin.py |  4 +---
 test/avocado_classless/avocado_classless/test.py   | 14 ++++++++++----
 test/avocado_classless/examples.py                 |  8 +++++++-
 4 files changed, 26 insertions(+), 11 deletions(-)

diff --git a/test/avocado_classless/avocado_classless/manifest.py b/test/avocado_classless/avocado_classless/manifest.py
index 8f7fe688..34c815cd 100644
--- a/test/avocado_classless/avocado_classless/manifest.py
+++ b/test/avocado_classless/avocado_classless/manifest.py
@@ -12,6 +12,7 @@ Manage the manifest of classless tests in a module
 import sys
 
 MANIFEST = "__avocado_classless__"
+DEFAULT_TIMEOUT = 60.0
 
 
 def manifest(mod):
@@ -24,14 +25,18 @@ def manifest(mod):
 class ManifestTestInfo:  # pylint: disable=R0903
     """Metadata about a classless test"""
 
-    def __init__(self, func):
+    def __init__(self, func, timeout=DEFAULT_TIMEOUT):
         self.func = func
+        self.__timeout = float(timeout)
 
     def run_test(self):
         self.func()
 
+    def timeout(self):
+        return self.__timeout
 
-def manifest_add(mod, name, func):
+
+def manifest_add(mod, name, func, **kwargs):
     """Register a function as a classless test"""
 
     if isinstance(mod, str):
@@ -40,4 +45,4 @@ def manifest_add(mod, name, func):
     mfest = manifest(mod)
     if name in mfest:
         raise ValueError(f"Duplicate classless test name {name}")
-    mfest[name] = ManifestTestInfo(func)
+    mfest[name] = ManifestTestInfo(func, **kwargs)
diff --git a/test/avocado_classless/avocado_classless/plugin.py b/test/avocado_classless/avocado_classless/plugin.py
index 442642d5..e2c9b1eb 100644
--- a/test/avocado_classless/avocado_classless/plugin.py
+++ b/test/avocado_classless/avocado_classless/plugin.py
@@ -38,7 +38,6 @@ from avocado.core.utils import messages
 from .manifest import manifest
 
 SHBANG = b'#! /usr/bin/env avocado-runner-avocado-classless'
-DEFAULT_TIMEOUT = 5.0
 
 
 def load_mod(path):
@@ -184,7 +183,6 @@ class ClasslessRunner(BaseRunner):
             process.start()
 
             time_started = time.monotonic()
-            timeout = DEFAULT_TIMEOUT
             next_status_time = None
             while True:
                 time.sleep(RUNNER_RUN_CHECK_INTERVAL)
@@ -196,7 +194,7 @@ class ClasslessRunner(BaseRunner):
                     ):
                         next_status_time = now + RUNNER_RUN_STATUS_INTERVAL
                         yield messages.RunningMessage.get()
-                    if (now - time_started) > timeout:
+                    if (now - time_started) > testinfo.timeout():
                         process.terminate()
                         yield messages.FinishedMessage.get("interrupted",
                                                            "timeout")
diff --git a/test/avocado_classless/avocado_classless/test.py b/test/avocado_classless/avocado_classless/test.py
index e5251960..04fa52ab 100644
--- a/test/avocado_classless/avocado_classless/test.py
+++ b/test/avocado_classless/avocado_classless/test.py
@@ -14,10 +14,16 @@ from collections import Counter
 from .manifest import manifest_add
 
 
-def test(func):
-    """Function decorator to mark a function as a classless test"""
-    manifest_add(func.__module__, func.__name__, func)
-    return func
+def classless_test(**kwargs):
+    """Mark a function as a classless test with options"""
+    def dec(func):
+        manifest_add(func.__module__, func.__name__, func, **kwargs)
+        return func
+    return dec
+
+
+# Simple version of classless_test with default options
+test = classless_test()
 
 
 def test_output(*tests):
diff --git a/test/avocado_classless/examples.py b/test/avocado_classless/examples.py
index a0e883f3..8625c9d3 100644
--- a/test/avocado_classless/examples.py
+++ b/test/avocado_classless/examples.py
@@ -7,8 +7,9 @@ are expected to fail.
 """
 
 import sys
+import time
 
-from avocado_classless.test import test, test_output
+from avocado_classless.test import classless_test, test, test_output
 
 
 @test
@@ -49,3 +50,8 @@ def positive_fraction():
 @test_output(is_integer, is_positive)
 def negative_fraction():
     return -3.5
+
+
+@classless_test(timeout=1.0)
+def timeout():
+    time.sleep(3)
-- 
@@ -7,8 +7,9 @@ are expected to fail.
 """
 
 import sys
+import time
 
-from avocado_classless.test import test, test_output
+from avocado_classless.test import classless_test, test, test_output
 
 
 @test
@@ -49,3 +50,8 @@ def positive_fraction():
 @test_output(is_integer, is_positive)
 def negative_fraction():
     return -3.5
+
+
+@classless_test(timeout=1.0)
+def timeout():
+    time.sleep(3)
-- 
2.41.0


  parent reply	other threads:[~2023-06-27  2:54 UTC|newest]

Thread overview: 32+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-06-27  2:54 [PATCH 00/27] RFC: Start converting passt & pasta tests to Avocado using special plugin David Gibson
2023-06-27  2:54 ` [PATCH 01/27] avocado: Make a duplicate copy of testsuite for comparison purposes David Gibson
2023-06-27  2:54 ` [PATCH 02/27] avocado: Don't double download assets for test/ and oldtest/ David Gibson
2023-06-27  2:54 ` [PATCH 03/27] avocado: Move static checkers to avocado David Gibson
2023-06-27  2:54 ` [PATCH 04/27] avocado: Introduce "avocado-classless" plugin, runner and outline David Gibson
2023-06-27  2:54 ` [PATCH 05/27] avocado, test: Add static checkers for Python code David Gibson
2023-06-27  2:54 ` [PATCH 06/27] avocado: Resolver implementation for avocado-classless plugin David Gibson
2023-06-27  2:54 ` [PATCH 07/27] avocado: Add basic assertion helpers to " David Gibson
2023-06-27  2:54 ` [PATCH 08/27] tasst, avocado: Introduce library of common test helpers David Gibson
2023-06-27  2:54 ` [PATCH 09/27] avocado-classless: Test matrices by composition David Gibson
2023-06-27  2:54 ` [PATCH 10/27] tasst: Helper functions for executing commands in different places David Gibson
2023-06-27  2:54 ` David Gibson [this message]
2023-06-27  2:54 ` [PATCH 12/27] avocado: Convert build tests to avocado David Gibson
2023-06-27  2:54 ` [PATCH 13/27] tasst: Add helpers for running background commands on sites David Gibson
2023-06-27  2:54 ` [PATCH 14/27] tasst: Add helper to get network interface names for a site David Gibson
2023-06-27  2:54 ` [PATCH 15/27] tasst: Add helpers to run commands with nstool David Gibson
2023-06-27  2:54 ` [PATCH 16/27] tasst: Add ifup and network address helpers to Site David Gibson
2023-06-27  2:54 ` [PATCH 17/27] tasst: Helper for creating veth devices between namespaces David Gibson
2023-06-27  2:54 ` [PATCH 18/27] tasst: Add helper for getting MTU of a network interface David Gibson
2023-06-27  2:54 ` [PATCH 19/27] tasst: Add helper to wait for IP address to appear David Gibson
2023-06-27  2:54 ` [PATCH 20/27] tasst: Add helpers for getting a site's routes David Gibson
2023-06-27  2:54 ` [PATCH 21/27] tasst: Helpers to test transferring data between sites David Gibson
2023-06-27  2:54 ` [PATCH 22/27] tasst: IP address allocation helpers David Gibson
2023-06-27  2:54 ` [PATCH 23/27] tasst: Helpers for running daemons with a pidfile David Gibson
2023-06-27  2:54 ` [PATCH 24/27] tasst: Helpers for testing NDP behaviour David Gibson
2023-06-27  2:54 ` [PATCH 25/27] tasst: Helpers for testing DHCP & DHCPv6 behaviour David Gibson
2023-06-27  2:54 ` [PATCH 26/27] tasst: Helpers to construct a simple network environment for tests David Gibson
2023-06-27  2:54 ` [PATCH 27/27] avocado: Convert basic pasta tests David Gibson
2023-07-05  0:30   ` Stefano Brivio
2023-07-05  3:27     ` David Gibson
2023-07-07 17:42       ` Stefano Brivio
2023-07-10  7:45         ` David Gibson

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20230627025429.2209702-12-david@gibson.dropbear.id.au \
    --to=david@gibson.dropbear.id.au \
    --cc=crosa@redhat.com \
    --cc=jarichte@redhat.com \
    --cc=passt-dev@passt.top \
    --cc=sbrivio@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://passt.top/passt

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for IMAP folder(s).