]> git.itanic.dy.fi Git - linux-stable/commit
wifi: rtlwifi: rtl8821ae: phy: fix an undefined bitwise shift behavior
authorSu Hui <suhui@nfschina.com>
Mon, 27 Nov 2023 01:35:13 +0000 (09:35 +0800)
committerKalle Valo <kvalo@kernel.org>
Thu, 30 Nov 2023 19:22:06 +0000 (21:22 +0200)
commitbc8263083af60e7e57c6120edbc1f75d6c909a35
tree766b7c7513ae67c010a0e33e1547c639dc69a1e7
parentcda37445718d917c22fe1f2cf7ab1f501e6f84b2
wifi: rtlwifi: rtl8821ae: phy: fix an undefined bitwise shift behavior

Clang static checker warns:

drivers/net/wireless/realtek/rtlwifi/rtl8821ae/phy.c:184:49:
The result of the left shift is undefined due to shifting by '32',
which is greater or equal to the width of type 'u32'.
[core.UndefinedBinaryOperatorResult]

If the value of the right operand is negative or is greater than or
equal to the width of the promoted left operand, the behavior is
undefined.[1][2]

For example, when using different gcc's compilation optimization options
(-O0 or -O2), the result of '(u32)data << 32' is different. One is 0, the
other is old value of data. Let _rtl8821ae_phy_calculate_bit_shift()'s
return value less than 32 to fix this problem. Warn if bitmask is zero.

[1] https://stackoverflow.com/questions/11270492/what-does-the-c-standard-say-about-bitshifting-more-bits-than-the-width-of-type
[2] https://www.open-std.org/jtc1/sc22/wg14/www/docs/n1256.pdf

Fixes: 21e4b0726dc6 ("rtlwifi: rtl8821ae: Move driver from staging to regular tree")
Signed-off-by: Su Hui <suhui@nfschina.com>
Acked-by: Ping-Ke Shih <pkshih@realtek.com>
Signed-off-by: Kalle Valo <kvalo@kernel.org>
Link: https://lore.kernel.org/r/20231127013511.26694-2-suhui@nfschina.com
drivers/net/wireless/realtek/rtlwifi/rtl8821ae/phy.c