public inbox for passt-dev@passt.top
 help / color / mirror / code / Atom feed
* [PATCH 00/24] Add vhost-user support to passt.
@ 2024-02-02 14:11 Laurent Vivier
  2024-02-02 14:11 ` [PATCH 01/24] iov: add some functions to manage iovec Laurent Vivier
                   ` (23 more replies)
  0 siblings, 24 replies; 83+ messages in thread
From: Laurent Vivier @ 2024-02-02 14:11 UTC (permalink / raw)
  To: passt-dev; +Cc: Laurent Vivier

This series of patches adds vhost-user support to passt
and then allows passt to connect to QEMU network backend using
virtqueue rather than a socket.

We have with iperf3 a 10x speed improvement:

  $ iperf3 -c localhost -p 10001  -t 60 -6 -u -b 50G

  socket:
  [  5]   0.00-60.04  sec  30.5 GBytes  4.36 Gbits/sec  0.065 ms  9127377/10125415 (90%)  receiver
  vhost-user:
  [  5]   0.00-60.05  sec   292 GBytes  41.8 Gbits/sec  0.007 ms  259805/9832736 (2.6%)  receiver

  $ iperf3 -c localhost -p 10001  -t 60 -4 -u -b 50G

  socket:
  [  5]   0.00-60.04  sec  36.4 GBytes  5.21 Gbits/sec  0.048 ms  7535735/8728101 (86%)  receiver
  vhost-user:
  [  5]   0.00-60.05  sec   259 GBytes  37.0 Gbits/sec  0.003 ms  142594/8616705 (1.7%)  receiver

  $ iperf3 -c localhost -p 10001  -t 60 -6

  socket:
  [  5]   0.00-60.00  sec  16.3 GBytes  2.33 Gbits/sec    0             sender
  [  5]   0.00-60.06  sec  16.3 GBytes  2.32 Gbits/sec                  receiver
  vhost-user:
  [ ID] Interval           Transfer     Bitrate         Retr
  [  5]   0.00-60.00  sec   205 GBytes  29.3 Gbits/sec    0             sender
  [  5]   0.00-60.04  sec   205 GBytes  29.3 Gbits/sec                  receiver

  $ iperf3 -c localhost -p 10001  -t 60 -4

  socket:
  [  5]   0.00-60.00  sec  16.1 GBytes  2.31 Gbits/sec    0             sender
  [  5]   0.00-60.07  sec  16.1 GBytes  2.31 Gbits/sec                  receiver
  vhost-user:
  [  5]   0.00-60.00  sec   201 GBytes  28.7 Gbits/sec    0             sender
  [  5]   0.00-60.04  sec   201 GBytes  28.7 Gbits/sec                  receiver

With QEMU, rather than using to connect:

  -netdev stream,id=s,server=off,addr.type=unix,addr.path=/tmp/passt_1.socket

we will use:

  -chardev socket,id=chr0,path=/tmp/passt_1.socket
  -netdev vhost-user,id=netdev0,chardev=chr0
  -device virtio-net,netdev=netdev0
  -object memory-backend-memfd,id=memfd0,share=on,size=$RAMSIZE
  -numa node,memdev=memfd0

The memory backend is needed to share data between passt and QEMU.

The series starts to introduce new functions to manage iovec and
to do checksum on unaligned memory (we cannot align buffers provided
by the guest with the same value we use with internal passt buffers):

  iov: add some functions to manage iovec
  pcap: add pcap_iov()
  checksum: align buffers
  checksum: add csum_iov()

We introduce new files ip.c and ip.h to provide IP generic functions:

  util: move IP stuff from util.[ch] to ip.[ch]
  ip: move duplicate IPv4 checksum function to ip.h

Then we extract from existing TCP and UDP function the internal
passt buffer management to be able to use them with the guest
provided buffers:

  tcp: extract buffer management from tcp_send_flag()
  tcp: extract buffer management from tcp_conn_tap_mss()
  tcp: rename functions that manage buffers
  tcp: move buffers management functions to their own file
  tap: make tap_update_mac() generic
  tap: export pool_flush()/tapX_handler()/packet_add()
  udp: move udpX_l2_buf_t and udpX_l2_mh_sock out of udp_update_hdrX()
  udp: rename udp_sock_handler() to udp_buf_sock_handler()
  packet: replace struct desc by struct iovec

As vhost-user is a variant of passt mode, modify the code to compare
to (!MODE_PASTA) rather than (MODE_PASST || MODE_VU)

  vhost-user: compare mode MODE_PASTA and not MODE_PASST

We introduce virtio and vhost-user management functions:

  vhost-user: introduce virtio API
  vhost-user: introduce vhost-user API

And then a first version of vhost-user that copies data from the passt buffers
to guest memory, and vice-versa, as it's done with the socket algorithm:

  vhost-user: add vhost-user

And finaly remove the buffers copy on TX and RX (TCP/UDP):

  vhost-user: use guest buffer directly in vu_handle_tx()
  tcp: vhost-user RX nocopy
  udp: vhost-user RX nocopy
  vhost-user: remove tap_send_frames_vu()

Thanks,
Laurent

Laurent Vivier (24):
  iov: add some functions to manage iovec
  pcap: add pcap_iov()
  checksum: align buffers
  checksum: add csum_iov()
  util: move IP stuff from util.[ch] to ip.[ch]
  ip: move duplicate IPv4 checksum function to ip.h
  ip: introduce functions to compute the header part checksum for
    TCP/UDP
  tcp: extract buffer management from tcp_send_flag()
  tcp: extract buffer management from tcp_conn_tap_mss()
  tcp: rename functions that manage buffers
  tcp: move buffers management functions to their own file
  tap: make tap_update_mac() generic
  tap: export pool_flush()/tapX_handler()/packet_add()
  udp: move udpX_l2_buf_t and udpX_l2_mh_sock out of udp_update_hdrX()
  udp: rename udp_sock_handler() to udp_buf_sock_handler()
  packet: replace struct desc by struct iovec
  vhost-user: compare mode MODE_PASTA and not MODE_PASST
  vhost-user: introduce virtio API
  vhost-user: introduce vhost-user API
  vhost-user: add vhost-user
  vhost-user: use guest buffer directly in vu_handle_tx()
  tcp: vhost-user RX nocopy
  udp: vhost-user RX nocopy
  vhost-user: remove tap_send_frames_vu()

 Makefile       |    7 +-
 checksum.c     |   51 ++-
 checksum.h     |    1 +
 conf.c         |   33 +-
 dhcp.c         |    1 +
 flow.c         |    1 +
 icmp.c         |    1 +
 iov.c          |   78 ++++
 iov.h          |   46 +++
 ip.c           |   72 ++++
 ip.h           |  124 ++++++
 isolation.c    |   10 +-
 ndp.c          |    1 +
 packet.c       |   81 ++--
 packet.h       |   16 +-
 passt.c        |   18 +-
 passt.h        |   10 +
 pcap.c         |   32 ++
 pcap.h         |    1 +
 port_fwd.c     |    1 +
 qrap.c         |    1 +
 tap.c          |  226 +++++++----
 tap.h          |   13 +-
 tcp.c          |  789 ++++++------------------------------
 tcp.h          |    2 +-
 tcp_buf.c      |  569 ++++++++++++++++++++++++++
 tcp_buf.h      |   17 +
 tcp_internal.h |   78 ++++
 tcp_splice.c   |    1 +
 tcp_vu.c       |  447 +++++++++++++++++++++
 tcp_vu.h       |   10 +
 udp.c          |  171 ++++----
 udp.h          |    4 +-
 udp_internal.h |   21 +
 udp_vu.c       |  215 ++++++++++
 udp_vu.h       |    8 +
 util.c         |   55 ---
 util.h         |   83 +---
 vhost_user.c   | 1050 ++++++++++++++++++++++++++++++++++++++++++++++++
 vhost_user.h   |  137 +++++++
 virtio.c       |  484 ++++++++++++++++++++++
 virtio.h       |  121 ++++++
 42 files changed, 4041 insertions(+), 1046 deletions(-)
 create mode 100644 iov.c
 create mode 100644 iov.h
 create mode 100644 ip.c
 create mode 100644 ip.h
 create mode 100644 tcp_buf.c
 create mode 100644 tcp_buf.h
 create mode 100644 tcp_internal.h
 create mode 100644 tcp_vu.c
 create mode 100644 tcp_vu.h
 create mode 100644 udp_internal.h
 create mode 100644 udp_vu.c
 create mode 100644 udp_vu.h
 create mode 100644 vhost_user.c
 create mode 100644 vhost_user.h
 create mode 100644 virtio.c
 create mode 100644 virtio.h

-- 
2.42.0


^ permalink raw reply	[flat|nested] 83+ messages in thread

end of thread, other threads:[~2024-02-14  2:10 UTC | newest]

Thread overview: 83+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2024-02-02 14:11 [PATCH 00/24] Add vhost-user support to passt Laurent Vivier
2024-02-02 14:11 ` [PATCH 01/24] iov: add some functions to manage iovec Laurent Vivier
2024-02-05  5:57   ` David Gibson
2024-02-06 14:28     ` Laurent Vivier
2024-02-07  1:01       ` David Gibson
2024-02-07 10:00         ` Laurent Vivier
2024-02-06 16:10   ` Stefano Brivio
2024-02-07 14:02     ` Laurent Vivier
2024-02-07 14:57       ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 02/24] pcap: add pcap_iov() Laurent Vivier
2024-02-05  6:25   ` David Gibson
2024-02-06 16:10   ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 03/24] checksum: align buffers Laurent Vivier
2024-02-05  6:02   ` David Gibson
2024-02-07  9:01     ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 04/24] checksum: add csum_iov() Laurent Vivier
2024-02-05  6:07   ` David Gibson
2024-02-07  9:02   ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 05/24] util: move IP stuff from util.[ch] to ip.[ch] Laurent Vivier
2024-02-05  6:13   ` David Gibson
2024-02-07  9:03     ` Stefano Brivio
2024-02-08  0:04       ` David Gibson
2024-02-02 14:11 ` [PATCH 06/24] ip: move duplicate IPv4 checksum function to ip.h Laurent Vivier
2024-02-05  6:16   ` David Gibson
2024-02-07 10:40   ` Stefano Brivio
2024-02-07 23:43     ` David Gibson
2024-02-02 14:11 ` [PATCH 07/24] ip: introduce functions to compute the header part checksum for TCP/UDP Laurent Vivier
2024-02-05  6:20   ` David Gibson
2024-02-07 10:41   ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 08/24] tcp: extract buffer management from tcp_send_flag() Laurent Vivier
2024-02-06  0:24   ` David Gibson
2024-02-08 16:57   ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 09/24] tcp: extract buffer management from tcp_conn_tap_mss() Laurent Vivier
2024-02-06  0:47   ` David Gibson
2024-02-08 16:59   ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 10/24] tcp: rename functions that manage buffers Laurent Vivier
2024-02-06  1:48   ` David Gibson
2024-02-08 17:10     ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 11/24] tcp: move buffers management functions to their own file Laurent Vivier
2024-02-02 14:11 ` [PATCH 12/24] tap: make tap_update_mac() generic Laurent Vivier
2024-02-06  1:49   ` David Gibson
2024-02-08 17:10     ` Stefano Brivio
2024-02-09  5:02       ` David Gibson
2024-02-02 14:11 ` [PATCH 13/24] tap: export pool_flush()/tapX_handler()/packet_add() Laurent Vivier
2024-02-02 14:29   ` Laurent Vivier
2024-02-06  1:52   ` David Gibson
2024-02-11 23:15   ` Stefano Brivio
2024-02-12  2:22     ` David Gibson
2024-02-02 14:11 ` [PATCH 14/24] udp: move udpX_l2_buf_t and udpX_l2_mh_sock out of udp_update_hdrX() Laurent Vivier
2024-02-06  1:59   ` David Gibson
2024-02-11 23:16   ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 15/24] udp: rename udp_sock_handler() to udp_buf_sock_handler() Laurent Vivier
2024-02-06  2:14   ` David Gibson
2024-02-11 23:17     ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 16/24] packet: replace struct desc by struct iovec Laurent Vivier
2024-02-06  2:25   ` David Gibson
2024-02-11 23:18     ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 17/24] vhost-user: compare mode MODE_PASTA and not MODE_PASST Laurent Vivier
2024-02-06  2:29   ` David Gibson
2024-02-02 14:11 ` [PATCH 18/24] vhost-user: introduce virtio API Laurent Vivier
2024-02-06  3:51   ` David Gibson
2024-02-11 23:18     ` Stefano Brivio
2024-02-12  2:26       ` David Gibson
2024-02-02 14:11 ` [PATCH 19/24] vhost-user: introduce vhost-user API Laurent Vivier
2024-02-07  2:13   ` David Gibson
2024-02-02 14:11 ` [PATCH 20/24] vhost-user: add vhost-user Laurent Vivier
2024-02-07  2:40   ` David Gibson
2024-02-11 23:19     ` Stefano Brivio
2024-02-12  2:47       ` David Gibson
2024-02-13 15:22         ` Stefano Brivio
2024-02-14  2:05           ` David Gibson
2024-02-11 23:19   ` Stefano Brivio
2024-02-12  2:49     ` David Gibson
2024-02-12 10:02       ` Laurent Vivier
2024-02-12 16:56         ` Stefano Brivio
2024-02-02 14:11 ` [PATCH 21/24] vhost-user: use guest buffer directly in vu_handle_tx() Laurent Vivier
2024-02-09  4:26   ` David Gibson
2024-02-02 14:11 ` [PATCH 22/24] tcp: vhost-user RX nocopy Laurent Vivier
2024-02-09  4:57   ` David Gibson
2024-02-02 14:11 ` [PATCH 23/24] udp: " Laurent Vivier
2024-02-09  5:00   ` David Gibson
2024-02-02 14:11 ` [PATCH 24/24] vhost-user: remove tap_send_frames_vu() Laurent Vivier
2024-02-09  5:01   ` David Gibson

Code repositories for project(s) associated with this public inbox

	https://passt.top/passt

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for IMAP folder(s).