From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: passt.top; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: passt.top; dkim=pass (1024-bit key; unprotected) header.d=redhat.com header.i=@redhat.com header.a=rsa-sha256 header.s=mimecast20190719 header.b=XtlgVfoe; dkim-atps=neutral Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by passt.top (Postfix) with ESMTP id 30A375A004E for ; Fri, 06 Sep 2024 18:05:01 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1725638700; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=9TImZRQIFHHjj7hW8prBclqzy37d2uWIQRf38s3n4mo=; b=XtlgVfoeQuLuyXRAcANqmFd3tNm0wFFflluS61wQ/08+ikq5cu+8CHE5xcfRv9xklDdS3x qHFmKqNEM5mU9/gyLbpUPlFYK/fHtPu4nI3SXqcvN0ZtWc+0GUAJLWpYXvPEYfBvQSPaPi y8Q/oAdk+jsZw5eGr4sda+HA0awlFkQ= Received: from mx-prod-mc-04.mail-002.prod.us-west-2.aws.redhat.com (ec2-54-186-198-63.us-west-2.compute.amazonaws.com [54.186.198.63]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-688-sgc0tlCoOP6OLjoJM3EDqQ-1; Fri, 06 Sep 2024 12:04:58 -0400 X-MC-Unique: sgc0tlCoOP6OLjoJM3EDqQ-1 Received: from mx-prod-int-02.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-02.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-04.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id E043E19560BE for ; Fri, 6 Sep 2024 16:04:57 +0000 (UTC) Received: from lenovo-t14s.redhat.com (unknown [10.39.193.22]) by mx-prod-int-02.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTP id C7DBD1956086; Fri, 6 Sep 2024 16:04:56 +0000 (UTC) From: Laurent Vivier To: passt-dev@passt.top Subject: [PATCH v4 0/4] Add vhost-user support to passt. (part 3) Date: Fri, 6 Sep 2024 18:04:45 +0200 Message-ID: <20240906160455.2088854-1-lvivier@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.0 on 10.30.177.15 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-ID-Hash: D2NAHCTPQP5IF2Y6J275KGVUVCJZCRKD X-Message-ID-Hash: D2NAHCTPQP5IF2Y6J275KGVUVCJZCRKD X-MailFrom: lvivier@redhat.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: Laurent Vivier X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: This series of patches adds vhost-user support to passt=0D and then allows passt to connect to QEMU network backend using=0D virtqueue rather than a socket.=0D =0D With QEMU, rather than using to connect:=0D =0D -netdev stream,id=3Ds,server=3Doff,addr.type=3Dunix,addr.path=3D/tmp/pass= t_1.socket=0D =0D we will use:=0D =0D -chardev socket,id=3Dchr0,path=3D/tmp/passt_1.socket=0D -netdev vhost-user,id=3Dnetdev0,chardev=3Dchr0=0D -device virtio-net,netdev=3Dnetdev0=0D -object memory-backend-memfd,id=3Dmemfd0,share=3Don,size=3D$RAMSIZE=0D -numa node,memdev=3Dmemfd0=0D =0D The memory backend is needed to share data between passt and QEMU.=0D =0D Performance comparison between "-netdev stream" and "-netdev vhost-user":= =0D =0D $ iperf3 -c localhost -p 10001 -t 60 -6 -u -b 50G=0D =0D socket:=0D [ 5] 0.00-60.05 sec 95.6 GBytes 13.7 Gbits/sec 0.017 ms 6998988/101= 32413 (69%) receiver=0D vhost-user:=0D [ 5] 0.00-60.04 sec 237 GBytes 33.9 Gbits/sec 0.006 ms 53673/78137= 70 (0.69%) receiver=0D =0D $ iperf3 -c localhost -p 10001 -t 60 -4 -u -b 50G=0D =0D socket:=0D [ 5] 0.00-60.05 sec 98.9 GBytes 14.1 Gbits/sec 0.018 ms 6260735/950= 1832 (66%) receiver=0D vhost-user:=0D [ 5] 0.00-60.05 sec 235 GBytes 33.7 Gbits/sec 0.008 ms 37581/77526= 99 (0.48%) receiver=0D =0D $ iperf3 -c localhost -p 10001 -t 60 -6=0D =0D socket:=0D [ 5] 0.00-60.00 sec 17.3 GBytes 2.48 Gbits/sec 0 sende= r=0D [ 5] 0.00-60.06 sec 17.3 GBytes 2.48 Gbits/sec recei= ver=0D vhost-user:=0D [ 5] 0.00-60.00 sec 191 GBytes 27.4 Gbits/sec 0 sende= r=0D [ 5] 0.00-60.05 sec 191 GBytes 27.3 Gbits/sec recei= ver=0D =0D $ iperf3 -c localhost -p 10001 -t 60 -4=0D =0D socket:=0D [ 5] 0.00-60.00 sec 15.6 GBytes 2.24 Gbits/sec 0 sende= r=0D [ 5] 0.00-60.06 sec 15.6 GBytes 2.24 Gbits/sec recei= ver=0D vhost-user:=0D [ 5] 0.00-60.00 sec 189 GBytes 27.1 Gbits/sec 0 sende= r=0D [ 5] 0.00-60.04 sec 189 GBytes 27.0 Gbits/sec recei= ver=0D =0D v4:=0D - rebase on top of 2024_08_21.1d6142f=0D (rebasing on top of 620e19a1b48a ("udp: Merge udp[46]_mh_recv arrays")= =0D introduces a regression in the measure of the latency with UDP=0D because I think I don't replace correctly ref.udp.v6 that is removed= =0D by this commit)=0D - Addressed most of the comments from David and Stefano=0D (I didn't want to postpone this version to next week,=0D so I'll address the remaining comments in the next version).=0D =0D v3:=0D - rebase on top of flow table=0D - update tcp_vu.c to look like udp_vu.c (recv()/prepare()/send_frame())= =0D - address comments from Stefano and David on version 2=0D =0D v2:=0D - remove PATCH 4=0D - rewrite PATCH 2 and 3 to follow passt coding style=0D - move some code from PATCH 3 to PATCH 4 (previously PATCH 5)=0D - partially addressed David's comment on PATCH 5=0D =0D Laurent Vivier (4):=0D packet: replace struct desc by struct iovec=0D vhost-user: introduce virtio API=0D vhost-user: introduce vhost-user API=0D vhost-user: add vhost-user=0D =0D Makefile | 6 +-=0D checksum.c | 1 -=0D conf.c | 23 +-=0D epoll_type.h | 4 +=0D iov.c | 1 -=0D isolation.c | 15 +-=0D packet.c | 91 ++--=0D packet.h | 22 +-=0D passt.1 | 10 +-=0D passt.c | 26 +-=0D passt.h | 6 +=0D pcap.c | 1 -=0D tap.c | 111 ++++-=0D tap.h | 5 +-=0D tcp.c | 31 +-=0D tcp_buf.c | 8 +-=0D tcp_internal.h | 3 +-=0D tcp_vu.c | 656 +++++++++++++++++++++++++=0D tcp_vu.h | 12 +=0D udp.c | 76 +--=0D udp.h | 8 +-=0D udp_internal.h | 34 ++=0D udp_vu.c | 386 +++++++++++++++=0D udp_vu.h | 13 +=0D util.h | 8 +=0D vhost_user.c | 1267 ++++++++++++++++++++++++++++++++++++++++++++++++=0D vhost_user.h | 203 ++++++++=0D virtio.c | 659 +++++++++++++++++++++++++=0D virtio.h | 185 +++++++=0D vu_common.c | 35 ++=0D vu_common.h | 34 ++=0D 31 files changed, 3801 insertions(+), 139 deletions(-)=0D create mode 100644 tcp_vu.c=0D create mode 100644 tcp_vu.h=0D create mode 100644 udp_internal.h=0D create mode 100644 udp_vu.c=0D create mode 100644 udp_vu.h=0D create mode 100644 vhost_user.c=0D create mode 100644 vhost_user.h=0D create mode 100644 virtio.c=0D create mode 100644 virtio.h=0D create mode 100644 vu_common.c=0D create mode 100644 vu_common.h=0D =0D --=20=0D 2.46.0=0D =0D