Re: [PATCH 10/24] preempt: Introduce HAS_SEPARATE_PREEMPT_RESCHED_BITS

Peter Zijlstra <[email protected]> Mon, 3 Aug 2026 13:38:17 +0200
Newsgroups org.kernel.vger.rust-for-linux,org.kernel.vger.linux-kernel
Message-ID <[email protected]>
On Fri, Jul 31, 2026 at 01:30:11PM -0700, Boqun Feng wrote:

> diff --git a/arch/x86/include/asm/preempt.h b/arch/x86/include/asm/preempt.h
> index 1220656f3370..12353eeebc52 100644
> --- a/arch/x86/include/asm/preempt.h
> +++ b/arch/x86/include/asm/preempt.h

> @@ -24,18 +34,26 @@ DECLARE_PER_CPU_CACHE_HOT(int, __preempt_count);
>   */
>  static __always_inline int preempt_count(void)
>  {
> -	return raw_cpu_read_4(__preempt_count) & ~PREEMPT_NEED_RESCHED;
> +	return __pc_op(read, __preempt_count) & ~PREEMPT_NEED_RESCHED;
>  }
>  
> -static __always_inline void preempt_count_set(int pc)
> +/*
> + * unsigned long preempt count parameter works for both 32bit and 64bit cases:
> + *
> + * - For 32bit, "int" (the return of preempt_count()) and "unsigned long" have
> + *   the same size.
> + * - For 64bit, the effective bits of a preempt count sits in 32bit, and we
> + *   reserve the NEED_RESCHED bit from the old count.
> + */

The 64bit comment doesn't really make sense to me.

> +static __always_inline void preempt_count_set(unsigned long pc)
>  {
> -	int old, new;
> +	unsigned long old, new;
>  
> -	old = raw_cpu_read_4(__preempt_count);
> +	old = __pc_op(read, __preempt_count);
>  	do {
>  		new = (old & PREEMPT_NEED_RESCHED) |
>  			(pc & ~PREEMPT_NEED_RESCHED);
> -	} while (!raw_cpu_try_cmpxchg_4(__preempt_count, &old, new));
> +	} while (!__pc_op(try_cmpxchg, __preempt_count, &old, new));
>  }

> diff --git a/include/linux/preempt.h b/include/linux/preempt.h
> index 33fc4c814a9f..87d5367f986c 100644
> --- a/include/linux/preempt.h
> +++ b/include/linux/preempt.h
> @@ -30,18 +30,20 @@
>   * NMI nesting depth is tracked in a separate per-CPU variable
>   * (nmi_nesting) to save bits in preempt_count.
>   *
> - *         PREEMPT_MASK:	0x000000ff
> - *         SOFTIRQ_MASK:	0x0000ff00
> - * HARDIRQ_DISABLE_MASK:	0x00ff0000
> - *         HARDIRQ_MASK:	0x0f000000
> - *             NMI_MASK:	0x10000000
> - * PREEMPT_NEED_RESCHED:	0x80000000
> + *				32bit		HAS_SEPARATE_PREEMPT_RESCHED_BITS
> + *
> + *         PREEMPT_MASK:	0x000000ff	0x00000000000000ff
> + *         SOFTIRQ_MASK:	0x0000ff00	0x000000000000ff00
> + * HARDIRQ_DISABLE_MASK:	0x00ff0000	0x0000000000ff0000
> + *         HARDIRQ_MASK:	0x0f000000	0x000000000f000000
> + *             NMI_MASK:	0x10000000	0x00000000f0000000
> + * PREEMPT_NEED_RESCHED:	0x80000000	0x8000000000000000
>   */

Perhaps add a comment about how HAS_SEPARATE_PREEMPT_RESCHED_BITS really
is about having PREEMPT_NEED_RESCHED in its own word, rather than
preempt_count() being 64bit.

Because as presented it is very easy to confuse these two options.
Ideally it would explain the LOAD-STORE issue with NEED_RESCHED and
point to ARM64 or something.