From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: passt.top; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: passt.top; dkim=pass (1024-bit key; unprotected) header.d=redhat.com header.i=@redhat.com header.a=rsa-sha256 header.s=mimecast20190719 header.b=EUjA4Af5; dkim-atps=neutral Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by passt.top (Postfix) with ESMTP id B18395A004C for ; Wed, 09 Oct 2024 11:07:22 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1728464841; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=tWlsH1MUy9/wF7DPlp5ntJYnF4zoXz2bVIvrOgrqXrs=; b=EUjA4Af5c/f1qhFMMdh8ZUdjm+tvRNJtkK0XbPpo9oO0GSoOeOY6p1q1+3LYWYaMNElp+k PAlx7VwGPMPElolB2Qe37VulnXUgkQ6SL7zhS1MIwOhCwKx/b7HUGj1qbLfI9N+OBRRHjk cZO0skM9lKQpj81YUqhVj6SWOxaUMKs= Received: from mx-prod-mc-01.mail-002.prod.us-west-2.aws.redhat.com (ec2-54-186-198-63.us-west-2.compute.amazonaws.com [54.186.198.63]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-49-EUeKI6FXMyuNOkhogsVFGw-1; Wed, 09 Oct 2024 05:07:19 -0400 X-MC-Unique: EUeKI6FXMyuNOkhogsVFGw-1 Received: from mx-prod-int-02.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-02.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-01.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id F39D71954B24 for ; Wed, 9 Oct 2024 09:07:18 +0000 (UTC) Received: from lenovo-t14s.redhat.com (unknown [10.39.192.184]) by mx-prod-int-02.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTP id 0D6421956086; Wed, 9 Oct 2024 09:07:17 +0000 (UTC) From: Laurent Vivier To: passt-dev@passt.top Subject: [PATCH v7 0/8] Add vhost-user support to passt. (part 3) Date: Wed, 9 Oct 2024 11:07:07 +0200 Message-ID: <20241009090716.691361-1-lvivier@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.0 on 10.30.177.15 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-ID-Hash: 42B2YMLEDYLBWFOXPWSFJAKEIP4SWND5 X-Message-ID-Hash: 42B2YMLEDYLBWFOXPWSFJAKEIP4SWND5 X-MailFrom: lvivier@redhat.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: Laurent Vivier X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: This series of patches adds vhost-user support to passt=0D and then allows passt to connect to QEMU network backend using=0D virtqueue rather than a socket.=0D =0D With QEMU, rather than using to connect:=0D =0D -netdev stream,id=3Ds,server=3Doff,addr.type=3Dunix,addr.path=3D/tmp/pass= t_1.socket=0D =0D we will use:=0D =0D -chardev socket,id=3Dchr0,path=3D/tmp/passt_1.socket=0D -netdev vhost-user,id=3Dnetdev0,chardev=3Dchr0=0D -device virtio-net,netdev=3Dnetdev0=0D -object memory-backend-memfd,id=3Dmemfd0,share=3Don,size=3D$RAMSIZE=0D -numa node,memdev=3Dmemfd0=0D =0D The memory backend is needed to share data between passt and QEMU.=0D =0D Performance comparison between "-netdev stream" and "-netdev vhost-user":= =0D =0D $ iperf3 -c localhost -p 10001 -t 60 -6 -u -b 50G=0D =0D socket:=0D [ 5] 0.00-60.05 sec 95.6 GBytes 13.7 Gbits/sec 0.017 ms 6998988/101= 32413 (69%) receiver=0D vhost-user:=0D [ 5] 0.00-60.04 sec 237 GBytes 33.9 Gbits/sec 0.006 ms 53673/78137= 70 (0.69%) receiver=0D =0D $ iperf3 -c localhost -p 10001 -t 60 -4 -u -b 50G=0D =0D socket:=0D [ 5] 0.00-60.05 sec 98.9 GBytes 14.1 Gbits/sec 0.018 ms 6260735/950= 1832 (66%) receiver=0D vhost-user:=0D [ 5] 0.00-60.05 sec 235 GBytes 33.7 Gbits/sec 0.008 ms 37581/77526= 99 (0.48%) receiver=0D =0D $ iperf3 -c localhost -p 10001 -t 60 -6=0D =0D socket:=0D [ 5] 0.00-60.00 sec 17.3 GBytes 2.48 Gbits/sec 0 sende= r=0D [ 5] 0.00-60.06 sec 17.3 GBytes 2.48 Gbits/sec recei= ver=0D vhost-user:=0D [ 5] 0.00-60.00 sec 191 GBytes 27.4 Gbits/sec 0 sende= r=0D [ 5] 0.00-60.05 sec 191 GBytes 27.3 Gbits/sec recei= ver=0D =0D $ iperf3 -c localhost -p 10001 -t 60 -4=0D =0D socket:=0D [ 5] 0.00-60.00 sec 15.6 GBytes 2.24 Gbits/sec 0 sende= r=0D [ 5] 0.00-60.06 sec 15.6 GBytes 2.24 Gbits/sec recei= ver=0D vhost-user:=0D [ 5] 0.00-60.00 sec 189 GBytes 27.1 Gbits/sec 0 sende= r=0D [ 5] 0.00-60.04 sec 189 GBytes 27.0 Gbits/sec recei= ver=0D =0D v7:=0D - rebase=0D - use vu_collect_one_frame() to do vu_collect() (collect multiple frame)= =0D - add vhost-user tests from Stefano=0D =0D v6:=0D - rebase=0D - extract 3 patches from "vhost-user: add vhost-user":=0D passt: rename tap_sock_init() to tap_backend_init()=0D tcp: Export headers functions=0D udp: Prepare udp.c to be shared with vhost-user=0D - introduce new functions vu_collect_one_frame(),=0D vu_collect(), vu_set_vnethdr(), vu_flush(), vu_send_single()=0D to be called from tcp_vu.c, udp_vu.c and ICMP/DHCP where vhost-user=0D code was duplicated.=0D =0D v5:=0D - rebase on top of 2024_09_06.6b38f07=0D - rework udp_vu.c as ref.udp.v6 has been removed and we need to=0D know if we receive IPv4 or IPv6 frame when we prepare the=0D guest buffers for recvmsg()=0D - remove vnet->hdrlen as the size is always the same with virtio-net v1= =0D - address comments from David and Stefano=0D =0D v4:=0D - rebase on top of 2024_08_21.1d6142f=0D (rebasing on top of 620e19a1b48a ("udp: Merge udp[46]_mh_recv arrays")= =0D introduces a regression in the measure of the latency with UDP=0D because I think I don't replace correctly ref.udp.v6 that is removed= =0D by this commit)=0D - Addressed most of the comments from David and Stefano=0D (I didn't want to postpone this version to next week,=0D so I'll address the remaining comments in the next version).=0D =0D v3:=0D - rebase on top of flow table=0D - update tcp_vu.c to look like udp_vu.c (recv()/prepare()/send_frame())= =0D - address comments from Stefano and David on version 2=0D =0D v2:=0D - remove PATCH 4=0D - rewrite PATCH 2 and 3 to follow passt coding style=0D - move some code from PATCH 3 to PATCH 4 (previously PATCH 5)=0D - partially addressed David's comment on PATCH 5=0D =0D Laurent Vivier (7):=0D packet: replace struct desc by struct iovec=0D vhost-user: introduce virtio API=0D vhost-user: introduce vhost-user API=0D udp: Prepare udp.c to be shared with vhost-user=0D tcp: Export headers functions=0D passt: rename tap_sock_init() to tap_backend_init()=0D vhost-user: add vhost-user=0D =0D Stefano Brivio (1):=0D test: Add tests for passt in vhost-user mode=0D =0D Makefile | 9 +-=0D conf.c | 21 +-=0D epoll_type.h | 4 +=0D iov.c | 1 -=0D isolation.c | 15 +-=0D packet.c | 91 ++--=0D packet.h | 22 +-=0D passt.1 | 10 +-=0D passt.c | 11 +-=0D passt.h | 6 +=0D pcap.c | 1 -=0D tap.c | 128 +++--=0D tap.h | 7 +-=0D tcp.c | 37 +-=0D tcp_internal.h | 15 +=0D tcp_vu.c | 476 +++++++++++++++++++=0D tcp_vu.h | 12 +=0D test/lib/perf_report | 15 +=0D test/lib/setup | 77 ++-=0D test/lib/setup_ugly | 2 +-=0D test/passt_vu | 1 +=0D test/passt_vu_in_ns | 1 +=0D test/perf/passt_vu_tcp | 211 +++++++++=0D test/perf/passt_vu_udp | 159 +++++++=0D test/run | 25 +=0D test/two_guests_vu | 1 +=0D udp.c | 84 ++--=0D udp_internal.h | 34 ++=0D udp_vu.c | 332 +++++++++++++=0D udp_vu.h | 13 +=0D util.h | 8 +=0D vhost_user.c | 1005 ++++++++++++++++++++++++++++++++++++++++=0D vhost_user.h | 206 ++++++++=0D virtio.c | 660 ++++++++++++++++++++++++++=0D virtio.h | 184 ++++++++=0D vu_common.c | 358 ++++++++++++++=0D vu_common.h | 47 ++=0D 37 files changed, 4135 insertions(+), 154 deletions(-)=0D create mode 100644 tcp_vu.c=0D create mode 100644 tcp_vu.h=0D create mode 120000 test/passt_vu=0D create mode 120000 test/passt_vu_in_ns=0D create mode 100644 test/perf/passt_vu_tcp=0D create mode 100644 test/perf/passt_vu_udp=0D create mode 120000 test/two_guests_vu=0D create mode 100644 udp_internal.h=0D create mode 100644 udp_vu.c=0D create mode 100644 udp_vu.h=0D create mode 100644 vhost_user.c=0D create mode 100644 vhost_user.h=0D create mode 100644 virtio.c=0D create mode 100644 virtio.h=0D create mode 100644 vu_common.c=0D create mode 100644 vu_common.h=0D =0D --=20=0D 2.46.2=0D =0D