From: Laurent Vivier <lvivier@redhat.com>
To: David Gibson <david@gibson.dropbear.id.au>
Cc: passt-dev@passt.top
Subject: Re: [PATCH] checksum: fix checksum with odd base address
Date: Fri, 10 Jan 2025 09:19:17 +0100 [thread overview]
Message-ID: <2e4def34-e7ac-49f7-92f7-b88e494fb205@redhat.com> (raw)
In-Reply-To: <Z4CInOg6BB8A_0M-@zatzit>
On 10/01/2025 03:40, David Gibson wrote:
> On Thu, Jan 09, 2025 at 02:06:48PM +0100, Laurent Vivier wrote:
>> csum_unfolded() must call csum_avx2() with a 32byte aligned base address.
>>
>> To be able to do that if the buffer is not correctly aligned,
>> it splits the buffers in 2 parts, the second part is 32byte aligned and
>> can be used with csum_avx2(), the first part is the remaining part, that
>> is not 32byte aligned and we use sum_16b() to compute the checksum.
>>
>> A problem appears if the length of the first part is odd because
>> the checksum is using 16bit words to do the checksum.
>>
>> If the length is odd, when the second part is computed, all words are
>> shifted by 1 byte, meaning weight of upper and lower byte is swapped.
>>
>> For instance a 13 bytes buffer:
>>
>> bytes:
>>
>> aa AA bb BB cc CC dd DD ee EE ff FF gg
>>
>> 16bit words:
>>
>> AAaa BBbb CCcc DDdd EEee FFff 00gg
>>
>> If we don't split the sequence, the checksum is:
>>
>> AAaa + BBbb + CCcc + DDdd + EEee + FFff + 00gg
>>
>> If we split the sequence with an even length for the first part:
>>
>> (AAaa + BBbb) + (CCcc + DDdd + EEee + FFff + 00gg)
>>
>> But if the first part has an odd length:
>>
>> (AAaa + BBbb + 00cc) + (ddCC + eeDD + ffEE + ggFF)
>>
>> To avoid the problem, do not call csum_avx2() if the first part cannot
>> have an even length, and compute the checksum of all the buffer using
>> sum_16b().
>>
>> This is slower but it can only happen if the buffer base address is odd,
>> and this can only happen if the binary is built using '-Os', and that
>> means we have chosen to prioritize size over speed.
>>
>> Link: https://bugs.passt.top/show_bug.cgi?id=108
>> Signed-off-by: Laurent Vivier <lvivier@redhat.com>
>
> Reviewed-by: David Gibson <david@gibson.dropbear.id.au>
>
> In that it's a real bug and we need to fix it quickly.
>
> That said, I think we can do a bit better long term: I believe it
> should be possible to correct the value from the of-by-one
> csum_avx2(), I think with just an unconditional byteswap. The TCP/UDP
> checksum has the curious property that it doesn't matter if you
> compute it big-endian or little-endian, as long as you're consistent.
> We already rely on this. Having one odd byte piece essentially means
> we're using inconsistent endianness between the two pieces.
>
Yes, I spent my afternoon trying to understand that, but we must use same endianness
between sum_16b() and csum_avx2(), and I found this:
diff --git a/checksum.c b/checksum.c
index 1c4354d35734..0543e86b0e67 100644
--- a/checksum.c
+++ b/checksum.c
@@ -458,8 +458,13 @@ uint32_t csum_unfolded(const void *buf, size_t len, uint32_t init)
if (pad)
init += sum_16b(buf, pad);
- if (len > pad)
- init = csum_avx2((void *)align, len - pad, init);
+ if (len > pad) {
+ if (pad & 1)
+ init = __bswap_32(csum_avx2((void *)align, len - pad,
+ __bswap_32(init)));
+ else
+ init = csum_avx2((void *)align, len - pad, init);
+ }
return init;
}
Thanks,
Laurent
next prev parent reply other threads:[~2025-01-10 8:19 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-01-09 13:06 [PATCH] checksum: fix checksum with odd base address Laurent Vivier
2025-01-09 15:36 ` Stefano Brivio
2025-01-09 16:47 ` Laurent Vivier
2025-01-09 17:17 ` Stefano Brivio
2025-01-10 2:40 ` David Gibson
2025-01-10 8:19 ` Laurent Vivier [this message]
2025-01-10 8:55 ` Stefano Brivio
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=2e4def34-e7ac-49f7-92f7-b88e494fb205@redhat.com \
--to=lvivier@redhat.com \
--cc=david@gibson.dropbear.id.au \
--cc=passt-dev@passt.top \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://passt.top/passt
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for IMAP folder(s).