From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by passt.top (Postfix) with ESMTP id 3A1EC5A0276 for ; Fri, 5 Apr 2024 20:11:07 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1712340666; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=J5Zt06hhOz3NAdVugZQSNubEsmhaW/41G0hN0NX5vFM=; b=MdCQBnJq0yh4Fc5PCJKGxl3Qw/KhEWBp7JrYyxct1q/copBSW6W9nTRhY1+koO7HZ9Z28a mV8x/4VVY0lvtyuZoa4kn0F9w5wYoTI+KKigxQwGgt7Kz3SN1ZWU1OY1jlEp6iK8Tt2thZ JKdl4ZYxmKPU55QYsiUNFca++BOYoBM= Received: from mail-ej1-f69.google.com (mail-ej1-f69.google.com [209.85.218.69]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-631-BPIbeYtvNAGCtbf2zUhJ0w-1; Fri, 05 Apr 2024 14:11:04 -0400 X-MC-Unique: BPIbeYtvNAGCtbf2zUhJ0w-1 Received: by mail-ej1-f69.google.com with SMTP id a640c23a62f3a-a51a3459f16so33211566b.0 for ; Fri, 05 Apr 2024 11:11:04 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1712340662; x=1712945462; h=content-transfer-encoding:mime-version:organization:references :in-reply-to:message-id:subject:cc:to:from:date:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=J5Zt06hhOz3NAdVugZQSNubEsmhaW/41G0hN0NX5vFM=; b=QyIJAur+zOjwnVCI+6y16lBRrzIvCrjsaGnNfL4JgBg9m5+rRto51Z4w60tFMUeRw7 6ifGUh0kAkUGay5WGfgviMBZ+LINaTG4GX6awKCbS2+fo3PXnHpRwFSlm2i3MijlCZNR GWTGKg/f30SqXDRFpR+Zv7ZH7OhRpH/sA/y0ly4HUYdMO1g2QSRr09b8jsXsA/Ms6iow mVxZw7UIsAjwvfwdFKYxFKgh2gCpn7+fqXma/z72AwQQbHUFI7kSOmSYVunG4Mq/klfs gLR+ATHw0XLfjigW0k7dcQyzOZpB7shLtr1eaJ0aPREKZaUQ0MSxCP9HN0DqgLcs4vBN /dNg== X-Gm-Message-State: AOJu0YxT64Joh4I/0ZCkXfwg2nO8tAbnRisLofvEkVWOsaPiWg8kn9XF pWtzArYHXowK3UHvFwN64mzCO1B7XR+Ab0W0KGdv4w3SXZME8dc84JQ0SU9wpLOyd9oSR9AulOZ QAG8237yJ3UIHS9YP4MQcmZRyjnNIm9zPYcWgUosDdywR87BC6B+1MnKZyuw6 X-Received: by 2002:a50:8ad1:0:b0:56b:d1c2:9b42 with SMTP id k17-20020a508ad1000000b0056bd1c29b42mr2396031edk.29.1712340662407; Fri, 05 Apr 2024 11:11:02 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGKSIU0bGciLIxUqDPiQ2cbkFH85Tmm5KeuTSqf36mn2Z/q6dcb8WuwRk/CRWS9ikGiBk6CgA== X-Received: by 2002:a50:8ad1:0:b0:56b:d1c2:9b42 with SMTP id k17-20020a508ad1000000b0056bd1c29b42mr2396005edk.29.1712340661846; Fri, 05 Apr 2024 11:11:01 -0700 (PDT) Received: from maya.cloud.tilaa.com (maya.cloud.tilaa.com. [164.138.29.33]) by smtp.gmail.com with ESMTPSA id e7-20020aa7d7c7000000b0056c522d014esm1025700eds.57.2024.04.05.11.11.00 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 05 Apr 2024 11:11:00 -0700 (PDT) Date: Fri, 5 Apr 2024 20:10:26 +0200 From: Stefano Brivio To: David Gibson Subject: Re: [PATCH v2] RFC: Benchmarking script Message-ID: <20240405201026.54877fa2@elisabeth> In-Reply-To: <20240405061222.15966-1-david@gibson.dropbear.id.au> References: <20240405061222.15966-1-david@gibson.dropbear.id.au> Organization: Red Hat X-Mailer: Claws Mail 4.2.0 (GTK 3.24.36; x86_64-pc-linux-gnu) MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Message-ID-Hash: XZGUZ27R4DYWXGMX3CHNG4B7DILGBOY6 X-Message-ID-Hash: XZGUZ27R4DYWXGMX3CHNG4B7DILGBOY6 X-MailFrom: sbrivio@redhat.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: passt-dev@passt.top X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: On Fri, 5 Apr 2024 17:12:21 +1100 David Gibson wrote: > Although we make some performance measurements in our regular testsuite, > those are designed more for getting a quick(ish) rough idea of the > performance, rather than a more precise measurement. > > This patch adds a Python script in contrib/benchmark which can make more > detailed benchmarks. It can test both passt & pasta themselves, but also > various other scenarios for comparison, such as kernel veth, qemu -net tap > and slirp (either qemu -net user or slirp4netns). Hah, nice. I haven't tried or reviewed this yet, but I just realised one thing: iperf3 3.16 finally implements separate streams (-P) as multiple threads! See: https://github.com/esnet/iperf/pull/1591 or release notes. That also means that the whole parallel process nonsense in the regular suite can finally go away, I guess. I haven't tested that yet, though. By the way of that, you mentioned in the past that you had some throughput failures with UDP tests. Well, I looked into 3.16 changes because of that -- they started failing for me as well with the new version. I temporarily reverted back to 3.14 on my system, until we figure out how to adjust to the new meaning of the "-P" option. Another thing that occurred to me: it would probably be helpful to already have vhost-user cases for passt here. Anyway, I'll give this a try soon. I can also apply it right away if you prefer. -- Stefano