From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: passt.top; dmarc=none (p=none dis=none) header.from=gibson.dropbear.id.au Authentication-Results: passt.top; dkim=pass (2048-bit key; secure) header.d=gibson.dropbear.id.au header.i=@gibson.dropbear.id.au header.a=rsa-sha256 header.s=202510 header.b=ymzbB+QN; dkim-atps=neutral Received: from mail.ozlabs.org (mail.ozlabs.org [IPv6:2404:9400:2221:ea00::3]) by passt.top (Postfix) with ESMTPS id 619395A061A for ; Wed, 26 Nov 2025 04:17:08 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gibson.dropbear.id.au; s=202510; t=1764127020; bh=5IoPQhb58jLb4y+4YnT6OpT0y33aZspqV2RIrkgooNQ=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=ymzbB+QNddv3QfxTTavfv0HVLX9R/Dps9sKxThPWpfzUeScBON5RBi/bQuNUrcHGx vs/7R6S+jodMxhXKm+Gw553aK4msFSgptWga0hNyPCb2vscCBKhym31WFbPor4GgqH hL8X4y7fXm3RZtQcEaCv24RIYvaZ4C+7xk93CnS3e3kDZdQMpthUK6cceM4ShaU2ck 3UwceN5eqA1mBqaofOqTggwxwEZXGXNVaLYpKXh+Ne4Bl9eS16mSeZ3ZGOnyWg3VIN PH77PMtSIhDrkPUrMW9FjfGuFw2R9e5c1S6aHQjK2YCWaJ1GlND0eu8VT7UeE1gQYJ xW9tppzmURFfQ== Received: by gandalf.ozlabs.org (Postfix, from userid 1007) id 4dGPqc0nRCz4wGX; Wed, 26 Nov 2025 14:17:00 +1100 (AEDT) Date: Wed, 26 Nov 2025 13:35:29 +1100 From: David Gibson To: Laurent Vivier Subject: Re: [PATCH v2 3/6] vhost-user: Add queue pair parameter throughout the network stack Message-ID: References: <20251121165902.1014964-1-lvivier@redhat.com> <20251121165902.1014964-4-lvivier@redhat.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ePe/xjREjcEZppOR" Content-Disposition: inline In-Reply-To: <20251121165902.1014964-4-lvivier@redhat.com> Message-ID-Hash: KKESZJVBI3DYSNWQNXDMSKZKWTOQRU77 X-Message-ID-Hash: KKESZJVBI3DYSNWQNXDMSKZKWTOQRU77 X-MailFrom: dgibson@gandalf.ozlabs.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: passt-dev@passt.top X-Mailman-Version: 3.3.8 Precedence: list List-Id: Development discussion and patches for passt Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: --ePe/xjREjcEZppOR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Nov 21, 2025 at 05:58:59PM +0100, Laurent Vivier wrote: > Add a queue pair parameter to vu_send_single() and propagate this paramet= er > through the entire network stack call chain. The queue pair parameter spe= cifies > which queue pair to use for sending packets in vhost-user mode. "sending" in this case meaning passt -> guest, right? Which is the Rx queue in vu terminology. > Functions modified to accept and propagate the queue pair parameter: > - Core sending: tap_send_single(), vu_send_single() > - UDP/ICMP helpers: tap_udp4_send(), tap_udp6_send(), tap_icmp4_send(), > tap_icmp6_send() > - Protocol handlers: arp(), dhcp(), dhcpv6(), ndp(), tcp_rst_no_conn() > - ARP helpers: arp_announce() > - NDP helpers: ndp_send(), ndp_na(), ndp_ra(), ndp_unsolicited_na() > - UDP error handling: udp_send_tap_icmp4(), udp_send_tap_icmp6() >=20 > All callers currently pass queue pair #0 to preserve existing > behavior. This is a preparatory step for enabling multi-queue and > per-queue worker threads in vhost-user mode. >=20 > No functional change. >=20 > Signed-off-by: Laurent Vivier Reviewed-by: David Gibson Couple of trivial queries below. > --- > arp.c | 12 +++++++----- > arp.h | 4 ++-- > dhcp.c | 5 +++-- > dhcp.h | 2 +- > dhcpv6.c | 12 +++++++----- > dhcpv6.h | 2 +- > fwd.c | 4 ++-- > icmp.c | 6 ++++-- > ndp.c | 32 +++++++++++++++++++------------- > ndp.h | 5 +++-- > tap.c | 37 ++++++++++++++++++++++--------------- > tap.h | 13 +++++++------ > tcp.c | 8 +++++--- > udp.c | 14 ++++++++------ > vu_common.c | 9 ++++++--- > vu_common.h | 3 ++- > 16 files changed, 99 insertions(+), 69 deletions(-) >=20 > diff --git a/arp.c b/arp.c > index 33b03cf6c316..c43d33ced2c3 100644 > --- a/arp.c > +++ b/arp.c > @@ -63,11 +63,12 @@ static bool ignore_arp(const struct ctx *c, > /** > * arp() - Check if this is a supported ARP message, reply as needed > * @c: Execution context > + * @qpair: Queue pair on which to send the reply > * @data: Single packet with Ethernet buffer > * > * Return: 1 if handled, -1 on failure > */ > -int arp(const struct ctx *c, struct iov_tail *data) > +int arp(const struct ctx *c, int qpair, struct iov_tail *data) > { > union inany_addr tgt; > struct { > @@ -112,7 +113,7 @@ int arp(const struct ctx *c, struct iov_tail *data) > memcpy(resp.am.tha, am->sha, sizeof(resp.am.tha)); > memcpy(resp.am.tip, am->sip, sizeof(resp.am.tip)); > =20 > - tap_send_single(c, &resp, sizeof(resp)); > + tap_send_single(c, qpair, &resp, sizeof(resp)); > =20 > return 1; > } > @@ -148,16 +149,17 @@ void arp_send_init_req(const struct ctx *c) > memcpy(req.am.tip, &c->ip4.addr, sizeof(req.am.tip)); > =20 > debug("Sending initial ARP request for guest MAC address"); > - tap_send_single(c, &req, sizeof(req)); > + tap_send_single(c, 0, &req, sizeof(req)); Should this one also go into the caller? I don't think it really matters, it's only a question of what seems logically more sensible. > } > =20 > /** > * arp_announce() - Send an ARP announcement for an IPv4 host > * @c: Execution context > + * @qpair: Queue pair on which to send the announcement > * @ip: IPv4 address we announce as owned by @mac > * @mac: MAC address to advertise for @ip > */ > -void arp_announce(const struct ctx *c, struct in_addr *ip, > +void arp_announce(const struct ctx *c, int qpair, struct in_addr *ip, > const unsigned char *mac) > { > char ip_str[INET_ADDRSTRLEN]; > @@ -199,5 +201,5 @@ void arp_announce(const struct ctx *c, struct in_addr= *ip, > eth_ntop(mac, mac_str, sizeof(mac_str)); > debug("ARP announcement for %s / %s", ip_str, mac_str); > =20 > - tap_send_single(c, &msg, sizeof(msg)); > + tap_send_single(c, qpair, &msg, sizeof(msg)); > } > diff --git a/arp.h b/arp.h > index 4862e90a14ee..7dd872809340 100644 > --- a/arp.h > +++ b/arp.h > @@ -20,9 +20,9 @@ struct arpmsg { > unsigned char tip[4]; > } __attribute__((__packed__)); > =20 > -int arp(const struct ctx *c, struct iov_tail *data); > +int arp(const struct ctx *c, int qpair, struct iov_tail *data); > void arp_send_init_req(const struct ctx *c); > -void arp_announce(const struct ctx *c, struct in_addr *ip, > +void arp_announce(const struct ctx *c, int qpair, struct in_addr *ip, > const unsigned char *mac); > =20 > #endif /* ARP_H */ > diff --git a/dhcp.c b/dhcp.c > index 6b9c2e3b9e5a..dd3c67f52724 100644 > --- a/dhcp.c > +++ b/dhcp.c > @@ -296,11 +296,12 @@ static void opt_set_dns_search(const struct ctx *c,= size_t max_len) > /** > * dhcp() - Check if this is a DHCP message, reply as needed > * @c: Execution context > + * @qpair: Queue pair on which to send the reply > * @data: Single packet with Ethernet buffer > * > * Return: 0 if it's not a DHCP message, 1 if handled, -1 on failure > */ > -int dhcp(const struct ctx *c, struct iov_tail *data) > +int dhcp(const struct ctx *c, int qpair, struct iov_tail *data) > { > char macstr[ETH_ADDRSTRLEN]; > size_t mlen, dlen, opt_len; > @@ -471,7 +472,7 @@ int dhcp(const struct ctx *c, struct iov_tail *data) > else > dst =3D c->ip4.addr; > =20 > - tap_udp4_send(c, c->ip4.our_tap_addr, 67, dst, 68, &reply, dlen); > + tap_udp4_send(c, qpair, c->ip4.our_tap_addr, 67, dst, 68, &reply, dlen); > =20 > return 1; > } > diff --git a/dhcp.h b/dhcp.h > index cd50c99b8856..a96991633e58 100644 > --- a/dhcp.h > +++ b/dhcp.h > @@ -6,7 +6,7 @@ > #ifndef DHCP_H > #define DHCP_H > =20 > -int dhcp(const struct ctx *c, struct iov_tail *data); > +int dhcp(const struct ctx *c, int qpair, struct iov_tail *data); > void dhcp_init(void); > =20 > #endif /* DHCP_H */ > diff --git a/dhcpv6.c b/dhcpv6.c > index e4df0db562e6..b1b792612615 100644 > --- a/dhcpv6.c > +++ b/dhcpv6.c > @@ -369,12 +369,13 @@ notonlink: > /** > * dhcpv6_send_ia_notonlink() - Send NotOnLink status > * @c: Execution context > + * @qpair: Queue pair on which to send the reply > * @ia_base: Non-appropriate IA_NA or IA_TA base > * @client_id_base: Client ID message option base > * @len: Client ID length > * @xid: Transaction ID for message exchange > */ > -static void dhcpv6_send_ia_notonlink(struct ctx *c, > +static void dhcpv6_send_ia_notonlink(struct ctx *c, int qpair, > const struct iov_tail *ia_base, > const struct iov_tail *client_id_base, > int len, uint32_t xid) > @@ -404,7 +405,7 @@ static void dhcpv6_send_ia_notonlink(struct ctx *c, > =20 > resp_not_on_link.hdr.xid =3D xid; > =20 > - tap_udp6_send(c, src, 547, tap_ip6_daddr(c, src), 546, > + tap_udp6_send(c, qpair, src, 547, tap_ip6_daddr(c, src), 546, > xid, &resp_not_on_link, n); > } > =20 > @@ -539,13 +540,14 @@ static size_t dhcpv6_client_fqdn_fill(const struct = iov_tail *data, > /** > * dhcpv6() - Check if this is a DHCPv6 message, reply as needed > * @c: Execution context > + * @qpair: Queue pair on which to send the reply > * @data: Single packet starting from UDP header > * @saddr: Source IPv6 address of original message > * @daddr: Destination IPv6 address of original message > * > * Return: 0 if it's not a DHCPv6 message, 1 if handled, -1 on failure > */ > -int dhcpv6(struct ctx *c, struct iov_tail *data, > +int dhcpv6(struct ctx *c, int qpair, struct iov_tail *data, > const struct in6_addr *saddr, const struct in6_addr *daddr) > { > const struct opt_server_id *server_id =3D NULL; > @@ -627,7 +629,7 @@ int dhcpv6(struct ctx *c, struct iov_tail *data, > =20 > if (dhcpv6_ia_notonlink(data, &c->ip6.addr)) { > =20 > - dhcpv6_send_ia_notonlink(c, data, &client_id_base, > + dhcpv6_send_ia_notonlink(c, qpair, data, &client_id_base, > ntohs(client_id->l), mh->xid); > =20 > return 1; > @@ -677,7 +679,7 @@ int dhcpv6(struct ctx *c, struct iov_tail *data, > =20 > resp.hdr.xid =3D mh->xid; > =20 > - tap_udp6_send(c, src, 547, tap_ip6_daddr(c, src), 546, > + tap_udp6_send(c, qpair, src, 547, tap_ip6_daddr(c, src), 546, > mh->xid, &resp, n); > c->ip6.addr_seen =3D c->ip6.addr; > =20 > diff --git a/dhcpv6.h b/dhcpv6.h > index c706dfdbb2ac..420caf8b7169 100644 > --- a/dhcpv6.h > +++ b/dhcpv6.h > @@ -6,7 +6,7 @@ > #ifndef DHCPV6_H > #define DHCPV6_H > =20 > -int dhcpv6(struct ctx *c, struct iov_tail *data, > +int dhcpv6(struct ctx *c, int qpair, struct iov_tail *data, > struct in6_addr *saddr, struct in6_addr *daddr); > void dhcpv6_init(const struct ctx *c); > =20 > diff --git a/fwd.c b/fwd.c > index 68bb11663c46..60c6ec3b6af9 100644 > --- a/fwd.c > +++ b/fwd.c > @@ -147,9 +147,9 @@ void fwd_neigh_table_update(const struct ctx *c, cons= t union inany_addr *addr, > return; > =20 > if (inany_v4(addr)) > - arp_announce(c, inany_v4(addr), e->mac); > + arp_announce(c, 0, inany_v4(addr), e->mac); > else > - ndp_unsolicited_na(c, &addr->a6); > + ndp_unsolicited_na(c, 0, &addr->a6); > } > =20 > /** > diff --git a/icmp.c b/icmp.c > index 35faefb91870..a9f0518c2f61 100644 > --- a/icmp.c > +++ b/icmp.c > @@ -132,12 +132,14 @@ void icmp_sock_handler(const struct ctx *c, union e= poll_ref ref) > const struct in_addr *daddr =3D inany_v4(&ini->eaddr); > =20 > ASSERT(saddr && daddr); /* Must have IPv4 addresses */ > - tap_icmp4_send(c, *saddr, *daddr, buf, pingf->f.tap_omac, n); > + tap_icmp4_send(c, 0, *saddr, *daddr, buf, > + pingf->f.tap_omac, n); > } else if (pingf->f.type =3D=3D FLOW_PING6) { > const struct in6_addr *saddr =3D &ini->oaddr.a6; > const struct in6_addr *daddr =3D &ini->eaddr.a6; > =20 > - tap_icmp6_send(c, saddr, daddr, buf, pingf->f.tap_omac, n); > + tap_icmp6_send(c, 0, saddr, daddr, buf, > + pingf->f.tap_omac, n); > } > return; > =20 > diff --git a/ndp.c b/ndp.c > index a33239d4aa81..0963a6392655 100644 > --- a/ndp.c > +++ b/ndp.c > @@ -175,25 +175,27 @@ struct ndp_ns { > /** > * ndp_send() - Send an NDP message > * @c: Execution context > + * @qpair: Queue pair on which to send the message > * @dst: IPv6 address to send the message to > * @buf: ICMPv6 header + message payload > * @l4len: Length of message, including ICMPv6 header > */ > -static void ndp_send(const struct ctx *c, const struct in6_addr *dst, > +static void ndp_send(const struct ctx *c, int qpair, const struct in6_ad= dr *dst, > const void *buf, size_t l4len) > { > const struct in6_addr *src =3D &c->ip6.our_tap_ll; > =20 > - tap_icmp6_send(c, src, dst, buf, c->our_tap_mac, l4len); > + tap_icmp6_send(c, qpair, src, dst, buf, c->our_tap_mac, l4len); > } > =20 > /** > * ndp_na() - Send an NDP Neighbour Advertisement (NA) message > * @c: Execution context > + * @qpair: Queue pair on which to send the NA > * @dst: IPv6 address to send the NA to > * @addr: IPv6 address to advertise > */ > -static void ndp_na(const struct ctx *c, const struct in6_addr *dst, > +static void ndp_na(const struct ctx *c, int qpair, const struct in6_addr= *dst, > const struct in6_addr *addr) > { > union inany_addr tgt; > @@ -217,25 +219,28 @@ static void ndp_na(const struct ctx *c, const struc= t in6_addr *dst, > inany_from_af(&tgt, AF_INET6, addr); > fwd_neigh_mac_get(c, &tgt, na.target_l2_addr.mac); > =20 > - ndp_send(c, dst, &na, sizeof(na)); > + ndp_send(c, qpair, dst, &na, sizeof(na)); > } > =20 > /** > * ndp_unsolicited_na() - Send unsolicited NA > * @c: Execution context > + * @qpair: Queue pair on which to send the RA > * @addr: IPv6 address to advertise > */ > -void ndp_unsolicited_na(const struct ctx *c, const struct in6_addr *addr) > +void ndp_unsolicited_na(const struct ctx *c, int qpair, > + const struct in6_addr *addr) > { > - ndp_na(c, &in6addr_ll_all_nodes, addr); > + ndp_na(c, qpair, &in6addr_ll_all_nodes, addr); > } > =20 > /** > * ndp_ra() - Send an NDP Router Advertisement (RA) message > * @c: Execution context > + * @qpair: Queue pair on which to send the RA > * @dst: IPv6 address to send the RA to > */ > -static void ndp_ra(const struct ctx *c, const struct in6_addr *dst) > +static void ndp_ra(const struct ctx *c, int qpair, const struct in6_addr= *dst) > { > struct ndp_ra ra =3D { > .ih =3D { > @@ -341,18 +346,19 @@ static void ndp_ra(const struct ctx *c, const struc= t in6_addr *dst) > memcpy(&ra.source_ll.mac, c->our_tap_mac, ETH_ALEN); > =20 > /* NOLINTNEXTLINE(clang-analyzer-security.PointerSub) */ > - ndp_send(c, dst, &ra, ptr - (unsigned char *)&ra); > + ndp_send(c, qpair, dst, &ra, ptr - (unsigned char *)&ra); > } > =20 > /** > * ndp() - Check for NDP solicitations, reply as needed > * @c: Execution context > + * @qpair: Queue pair on which to send replies > * @saddr: Source IPv6 address > * @data: Single packet with ICMPv6 header > * > * Return: 0 if not handled here, 1 if handled, -1 on failure > */ > -int ndp(const struct ctx *c, const struct in6_addr *saddr, > +int ndp(const struct ctx *c, int qpair, const struct in6_addr *saddr, > struct iov_tail *data) > { > struct icmp6hdr ih_storage; > @@ -381,13 +387,13 @@ int ndp(const struct ctx *c, const struct in6_addr = *saddr, > =20 > info("NDP: received NS, sending NA"); > =20 > - ndp_na(c, saddr, &ns->target_addr); > + ndp_na(c, qpair, saddr, &ns->target_addr); > } else if (ih->icmp6_type =3D=3D RS) { > if (c->no_ra) > return 1; > =20 > info("NDP: received RS, sending RA"); > - ndp_ra(c, saddr); > + ndp_ra(c, qpair, saddr); > } > =20 > return 1; > @@ -445,7 +451,7 @@ void ndp_timer(const struct ctx *c, const struct time= spec *now) > =20 > info("NDP: sending unsolicited RA, next in %llds", (long long)interval); > =20 > - ndp_ra(c, &in6addr_ll_all_nodes); > + ndp_ra(c, 0, &in6addr_ll_all_nodes); > =20 > first: > next_ra =3D now->tv_sec + interval; > @@ -468,5 +474,5 @@ void ndp_send_init_req(const struct ctx *c) > .target_addr =3D c->ip6.addr > }; > debug("Sending initial NDP NS request for guest MAC address"); > - ndp_send(c, &c->ip6.addr, &ns, sizeof(ns)); > + ndp_send(c, 0, &c->ip6.addr, &ns, sizeof(ns)); As for arp_send_init_req(), would the 0 here make more sense in the caller? > } > diff --git a/ndp.h b/ndp.h > index 56b756d8400b..927e69eb4649 100644 > --- a/ndp.h > +++ b/ndp.h > @@ -8,10 +8,11 @@ > =20 > struct icmp6hdr; > =20 > -int ndp(const struct ctx *c, const struct in6_addr *saddr, > +int ndp(const struct ctx *c, int qpair, const struct in6_addr *saddr, > struct iov_tail *data); > void ndp_timer(const struct ctx *c, const struct timespec *now); > void ndp_send_init_req(const struct ctx *c); > -void ndp_unsolicited_na(const struct ctx *c, const struct in6_addr *addr= ); > +void ndp_unsolicited_na(const struct ctx *c, int qpair, > + const struct in6_addr *addr); > =20 > #endif /* NDP_H */ > diff --git a/tap.c b/tap.c > index d098061ed559..a842104687b7 100644 > --- a/tap.c > +++ b/tap.c > @@ -125,10 +125,12 @@ unsigned long tap_l2_max_len(const struct ctx *c) > /** > * tap_send_single() - Send a single frame > * @c: Execution context > + * @qpair: Queue pair on which to send the frame > * @data: Packet buffer > * @l2len: Total L2 packet length > */ > -void tap_send_single(const struct ctx *c, const void *data, size_t l2len) > +void tap_send_single(const struct ctx *c, int qpair, const void *data, > + size_t l2len) > { > uint32_t vnet_len =3D htonl(l2len); > struct iovec iov[2]; > @@ -147,7 +149,7 @@ void tap_send_single(const struct ctx *c, const void = *data, size_t l2len) > tap_send_frames(c, iov, iovcnt, 1); > break; > case MODE_VU: > - vu_send_single(c, data, l2len); > + vu_send_single(c, qpair, data, l2len); > break; > } > } > @@ -250,6 +252,7 @@ void *tap_push_uh4(struct udphdr *uh, struct in_addr = src, in_port_t sport, > /** > * tap_udp4_send() - Send UDP over IPv4 packet > * @c: Execution context > + * @qpair: Queue pair on which to send packet > * @src: IPv4 source address > * @sport: UDP source port > * @dst: IPv4 destination address > @@ -257,7 +260,7 @@ void *tap_push_uh4(struct udphdr *uh, struct in_addr = src, in_port_t sport, > * @in: UDP payload contents (not including UDP header) > * @dlen: UDP payload length (not including UDP header) > */ > -void tap_udp4_send(const struct ctx *c, struct in_addr src, in_port_t sp= ort, > +void tap_udp4_send(const struct ctx *c, int qpair, struct in_addr src, i= n_port_t sport, > struct in_addr dst, in_port_t dport, > const void *in, size_t dlen) > { > @@ -268,20 +271,22 @@ void tap_udp4_send(const struct ctx *c, struct in_a= ddr src, in_port_t sport, > char *data =3D tap_push_uh4(uh, src, sport, dst, dport, in, dlen); > =20 > memcpy(data, in, dlen); > - tap_send_single(c, buf, dlen + (data - buf)); > + tap_send_single(c, qpair, buf, dlen + (data - buf)); > } > =20 > /** > * tap_icmp4_send() - Send ICMPv4 packet > * @c: Execution context > + * @qpair: Queue pair on which to send packet > * @src: IPv4 source address > * @dst: IPv4 destination address > * @in: ICMP packet, including ICMP header > * @src_mac: MAC address to be used as source for message > * @l4len: ICMP packet length, including ICMP header > */ > -void tap_icmp4_send(const struct ctx *c, struct in_addr src, struct in_a= ddr dst, > - const void *in, const void *src_mac, size_t l4len) > +void tap_icmp4_send(const struct ctx *c, int qpair, struct in_addr src, > + struct in_addr dst, const void *in, const void *src_mac, > + size_t l4len) > { > char buf[USHRT_MAX]; > struct iphdr *ip4h =3D tap_push_l2h(c, buf, src_mac, ETH_P_IP); > @@ -291,7 +296,7 @@ void tap_icmp4_send(const struct ctx *c, struct in_ad= dr src, struct in_addr dst, > memcpy(icmp4h, in, l4len); > csum_icmp4(icmp4h, icmp4h + 1, l4len - sizeof(*icmp4h)); > =20 > - tap_send_single(c, buf, l4len + ((char *)icmp4h - buf)); > + tap_send_single(c, qpair, buf, l4len + ((char *)icmp4h - buf)); > } > =20 > /** > @@ -355,6 +360,7 @@ void *tap_push_uh6(struct udphdr *uh, > /** > * tap_udp6_send() - Send UDP over IPv6 packet > * @c: Execution context > + * @qpair: Queue pair on which to send packet > * @src: IPv6 source address > * @sport: UDP source port > * @dst: IPv6 destination address > @@ -363,7 +369,7 @@ void *tap_push_uh6(struct udphdr *uh, > * @in: UDP payload contents (not including UDP header) > * @dlen: UDP payload length (not including UDP header) > */ > -void tap_udp6_send(const struct ctx *c, > +void tap_udp6_send(const struct ctx *c, int qpair, > const struct in6_addr *src, in_port_t sport, > const struct in6_addr *dst, in_port_t dport, > uint32_t flow, void *in, size_t dlen) > @@ -376,19 +382,20 @@ void tap_udp6_send(const struct ctx *c, > char *data =3D tap_push_uh6(uh, src, sport, dst, dport, in, dlen); > =20 > memcpy(data, in, dlen); > - tap_send_single(c, buf, dlen + (data - buf)); > + tap_send_single(c, qpair, buf, dlen + (data - buf)); > } > =20 > /** > * tap_icmp6_send() - Send ICMPv6 packet > * @c: Execution context > + * @qpair: Queue pair on which to send packet > * @src: IPv6 source address > * @dst: IPv6 destination address > * @in: ICMP packet, including ICMP header > * @src_mac: MAC address to be used as source for message > * @l4len: ICMP packet length, including ICMP header > */ > -void tap_icmp6_send(const struct ctx *c, > +void tap_icmp6_send(const struct ctx *c, int qpair, > const struct in6_addr *src, const struct in6_addr *dst, > const void *in, const void *src_mac, size_t l4len) > { > @@ -400,7 +407,7 @@ void tap_icmp6_send(const struct ctx *c, > memcpy(icmp6h, in, l4len); > csum_icmp6(icmp6h, src, dst, icmp6h + 1, l4len - sizeof(*icmp6h)); > =20 > - tap_send_single(c, buf, l4len + ((char *)icmp6h - buf)); > + tap_send_single(c, qpair, buf, l4len + ((char *)icmp6h - buf)); > } > =20 > /** > @@ -727,7 +734,7 @@ resume: > if (!eh) > continue; > if (ntohs(eh->h_proto) =3D=3D ETH_P_ARP) { > - arp(c, &data); > + arp(c, 0, &data); > continue; > } > =20 > @@ -788,7 +795,7 @@ resume: > struct iov_tail eh_data; > =20 > packet_get(pool_tap4, i, &eh_data); > - if (dhcp(c, &eh_data)) > + if (dhcp(c, 0, &eh_data)) > continue; > } > =20 > @@ -954,7 +961,7 @@ resume: > continue; > =20 > ndp_data =3D data; > - if (ndp(c, saddr, &ndp_data)) > + if (ndp(c, 0, saddr, &ndp_data)) > continue; > =20 > tap_packet_debug(NULL, ip6h, NULL, proto, NULL, 1); > @@ -973,7 +980,7 @@ resume: > if (proto =3D=3D IPPROTO_UDP) { > struct iov_tail uh_data =3D data; > =20 > - if (dhcpv6(c, &uh_data, saddr, daddr)) > + if (dhcpv6(c, 0, &uh_data, saddr, daddr)) > continue; > } > =20 > diff --git a/tap.h b/tap.h > index 1864173cc9b0..92d3e5446991 100644 > --- a/tap.h > +++ b/tap.h > @@ -87,24 +87,25 @@ void *tap_push_ip6h(struct ipv6hdr *ip6h, > const struct in6_addr *src, > const struct in6_addr *dst, > size_t l4len, uint8_t proto, uint32_t flow); > -void tap_udp4_send(const struct ctx *c, struct in_addr src, in_port_t sp= ort, > +void tap_udp4_send(const struct ctx *c, int qpair, struct in_addr src, i= n_port_t sport, > struct in_addr dst, in_port_t dport, > const void *in, size_t dlen); > -void tap_icmp4_send(const struct ctx *c, struct in_addr src, struct in_a= ddr dst, > - const void *in, const void *src_mac, size_t l4len); > +void tap_icmp4_send(const struct ctx *c, int qpair, struct in_addr src, > + struct in_addr dst, const void *in, const void *src_mac, > + size_t l4len); > const struct in6_addr *tap_ip6_daddr(const struct ctx *c, > const struct in6_addr *src); > void *tap_push_ip6h(struct ipv6hdr *ip6h, > const struct in6_addr *src, const struct in6_addr *dst, > size_t l4len, uint8_t proto, uint32_t flow); > -void tap_udp6_send(const struct ctx *c, > +void tap_udp6_send(const struct ctx *c, int qpair, > const struct in6_addr *src, in_port_t sport, > const struct in6_addr *dst, in_port_t dport, > uint32_t flow, void *in, size_t dlen); > -void tap_icmp6_send(const struct ctx *c, > +void tap_icmp6_send(const struct ctx *c, int qpair, > const struct in6_addr *src, const struct in6_addr *dst, > const void *in, const void *src_mac, size_t l4len); > -void tap_send_single(const struct ctx *c, const void *data, size_t l2len= ); > +void tap_send_single(const struct ctx *c, int qpair, const void *data, s= ize_t l2len); > size_t tap_send_frames(const struct ctx *c, const struct iovec *iov, > size_t bufs_per_frame, size_t nframes); > void eth_update_mac(struct ethhdr *eh, > diff --git a/tcp.c b/tcp.c > index 3202d3385a63..76f3273bb93f 100644 > --- a/tcp.c > +++ b/tcp.c > @@ -1985,6 +1985,7 @@ static void tcp_conn_from_sock_finish(const struct = ctx *c, > /** > * tcp_rst_no_conn() - Send RST in response to a packet with no connecti= on > * @c: Execution context > + * @qpair: Queue pair on which to send the reply > * @af: Address family, AF_INET or AF_INET6 > * @saddr: Source address of the packet we're responding to > * @daddr: Destination address of the packet we're responding to > @@ -1992,7 +1993,7 @@ static void tcp_conn_from_sock_finish(const struct = ctx *c, > * @th: TCP header of the packet we're responding to > * @l4len: Packet length, including TCP header > */ > -static void tcp_rst_no_conn(const struct ctx *c, int af, > +static void tcp_rst_no_conn(const struct ctx *c, int qpair, int af, > const void *saddr, const void *daddr, > uint32_t flow_lbl, > const struct tcphdr *th, size_t l4len) > @@ -2050,7 +2051,7 @@ static void tcp_rst_no_conn(const struct ctx *c, in= t af, > =20 > tcp_update_csum(psum, rsth, &payload); > rst_l2len =3D ((char *)rsth - buf) + sizeof(*rsth); > - tap_send_single(c, buf, rst_l2len); > + tap_send_single(c, qpair, buf, rst_l2len); > } > =20 > /** > @@ -2109,7 +2110,8 @@ int tcp_tap_handler(const struct ctx *c, uint8_t pi= f, sa_family_t af, > tcp_conn_from_tap(c, af, saddr, daddr, th, > opts, optlen, now); > else > - tcp_rst_no_conn(c, af, saddr, daddr, flow_lbl, th, l4len); > + tcp_rst_no_conn(c, 0, af, saddr, daddr, flow_lbl, th, > + l4len); > return 1; > } > =20 > diff --git a/udp.c b/udp.c > index 9c00950250a0..2c74b42a3d95 100644 > --- a/udp.c > +++ b/udp.c > @@ -384,13 +384,14 @@ static void udp_tap_prepare(const struct mmsghdr *m= mh, > /** > * udp_send_tap_icmp4() - Construct and send ICMPv4 to local peer > * @c: Execution context > + * @qpair: Queue pair on which to send the ICMPv4 packet > * @ee: Extended error descriptor > * @toside: Destination side of flow > * @saddr: Address of ICMP generating node > * @in: First bytes (max 8) of original UDP message body > * @dlen: Length of the read part of original UDP message body > */ > -static void udp_send_tap_icmp4(const struct ctx *c, > +static void udp_send_tap_icmp4(const struct ctx *c, int qpair, > const struct sock_extended_err *ee, > const struct flowside *toside, > struct in_addr saddr, > @@ -426,13 +427,14 @@ static void udp_send_tap_icmp4(const struct ctx *c, > /* Try to obtain the MAC address of the generating node */ > saddr_any =3D inany_from_v4(saddr); > fwd_neigh_mac_get(c, &saddr_any, tap_omac); > - tap_icmp4_send(c, saddr, eaddr, &msg, tap_omac, msglen); > + tap_icmp4_send(c, qpair, saddr, eaddr, &msg, tap_omac, msglen); > } > =20 > =20 > /** > * udp_send_tap_icmp6() - Construct and send ICMPv6 to local peer > * @c: Execution context > + * @qpair: Queue pair on which to send the ICMPv6 packet > * @ee: Extended error descriptor > * @toside: Destination side of flow > * @saddr: Address of ICMP generating node > @@ -440,7 +442,7 @@ static void udp_send_tap_icmp4(const struct ctx *c, > * @dlen: Length of the read part of original UDP message body > * @flow: IPv6 flow identifier > */ > -static void udp_send_tap_icmp6(const struct ctx *c, > +static void udp_send_tap_icmp6(const struct ctx *c, int qpair, > const struct sock_extended_err *ee, > const struct flowside *toside, > const struct in6_addr *saddr, > @@ -474,7 +476,7 @@ static void udp_send_tap_icmp6(const struct ctx *c, > =20 > /* Try to obtain the MAC address of the generating node */ > fwd_neigh_mac_get(c, (union inany_addr *) saddr, tap_omac); > - tap_icmp6_send(c, saddr, eaddr, &msg, tap_omac, msglen); > + tap_icmp6_send(c, qpair, saddr, eaddr, &msg, tap_omac, msglen); > } > =20 > /** > @@ -634,12 +636,12 @@ static int udp_sock_recverr(const struct ctx *c, in= t s, flow_sidx_t sidx, > if (hdr->cmsg_level =3D=3D IPPROTO_IP && > (o4 =3D inany_v4(&otap)) && inany_v4(&toside->eaddr)) { > dlen =3D MIN(dlen, ICMP4_MAX_DLEN); > - udp_send_tap_icmp4(c, ee, toside, *o4, data, dlen); > + udp_send_tap_icmp4(c, 0, ee, toside, *o4, data, dlen); > return 1; > } > =20 > if (hdr->cmsg_level =3D=3D IPPROTO_IPV6 && !inany_v4(&toside->eaddr)) { > - udp_send_tap_icmp6(c, ee, toside, &otap.a6, data, dlen, > + udp_send_tap_icmp6(c, 0, ee, toside, &otap.a6, data, dlen, > FLOW_IDX(uflow)); > return 1; > } > diff --git a/vu_common.c b/vu_common.c > index b13b7c308fd8..040ad067ffbf 100644 > --- a/vu_common.c > +++ b/vu_common.c > @@ -235,23 +235,26 @@ void vu_kick_cb(struct vu_dev *vdev, union epoll_re= f ref, > } > =20 > /** > - * vu_send_single() - Send a buffer to the front-end using the RX virtqu= eue > + * vu_send_single() - Send a buffer to the front-end using a specified v= irtqueue > * @c: execution context > + * @qpair: Queue pair on which to send the buffer > * @buf: address of the buffer > * @size: size of the buffer > * > * Return: number of bytes sent, -1 if there is an error > */ > -int vu_send_single(const struct ctx *c, const void *buf, size_t size) > +int vu_send_single(const struct ctx *c, int qpair, const void *buf, size= _t size) > { > struct vu_dev *vdev =3D c->vdev; > - struct vu_virtq *vq =3D &vdev->vq[VHOST_USER_RX_QUEUE]; > struct vu_virtq_element elem[VIRTQUEUE_MAX_SIZE]; > struct iovec in_sg[VIRTQUEUE_MAX_SIZE]; > + struct vu_virtq *vq; > size_t total; > int elem_cnt; > int i; > =20 > + vq =3D &vdev->vq[qpair << 1]; > + > trace("vu_send_single size %zu", size); > =20 > if (!vu_queue_enabled(vq) || !vu_queue_started(vq)) { > diff --git a/vu_common.h b/vu_common.h > index f538f237790b..25b824c51d1d 100644 > --- a/vu_common.h > +++ b/vu_common.h > @@ -56,6 +56,7 @@ void vu_flush(const struct vu_dev *vdev, struct vu_virt= q *vq, > struct vu_virtq_element *elem, int elem_cnt); > void vu_kick_cb(struct vu_dev *vdev, union epoll_ref ref, > const struct timespec *now); > -int vu_send_single(const struct ctx *c, const void *buf, size_t size); > +int vu_send_single(const struct ctx *c, int qpair, const void *buf, > + size_t size); > =20 > #endif /* VU_COMMON_H */ > --=20 > 2.51.0 >=20 --=20 David Gibson (he or they) | I'll have my music baroque, and my code david AT gibson.dropbear.id.au | minimalist, thank you, not the other way | around. http://www.ozlabs.org/~dgibson --ePe/xjREjcEZppOR Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEO+dNsU4E3yXUXRK2zQJF27ox2GcFAmkmZ3AACgkQzQJF27ox 2GdTzA/8DHFsjph5NmgRwyK1XXdjjdB6Rxv8P972MaaLbnhnTk+jVkhWG3DMRlWm AZenshAHS/vSZKQUjsVip7Qpjn7zXw5tt7M41yPOB2o4r0fQdEdFMriecCVLFppF YKWwU4fVYulLX3/7jIRe09f0MQrJoD+Iq/hQx/j2I9pgDv8/XAcRYoJmtNwJtxw9 hVdiP4DgwdAj1eeTLP9mNCM/NHeqyOMAbe5P7cHxoBmD/KUr/ZN4CwsNKFyxU1it asxzgvjzVoJrUnFm+9XN4+OCB8YBed7BvgcInBnode9v4ZXngk0mLVxRlojZ5qc+ 7J7Fa7MnbOGA8tg2EmpSrsIywNVAyui5JWf/q02ZUZS+9dVyHe1waRyEkMLsY4wr GFcBv11G7NdfoHaPMugdxxDrnzx6kXkJQAnKOMtvjQ4Oi5ZSkvyTL4jakW18mRI8 zdW50EHFXWFB3LTzm9EYT4m/NxQfD6HjfjAmR+y9J9t4Hs4+Ys0Np9Hduqm3pGFF e+B9NRCEGTUO7PV0DVowpWXI953D5HrkfS91Gmtn3rjI/ehwGyc1D+aiLLjEIHqN kpBfKujUgaSbwxNg+x51ki8amG4O5h5WbTJ4g/4nnvvU8v2uly3daQ2nav1y71Vf qGfJODMWfrSxeCA5mZQBhKXSnAkYkbPjoighxKZeXi9hmC+ixHo= =SCic -----END PGP SIGNATURE----- --ePe/xjREjcEZppOR--