Re: [PATCH v4 01/16] mm: hugetlb: Track used_hpages when getting/putting pages from subpool

Ackerley Tng via B4 Relay <[email protected]>
writes:

> From: Ackerley Tng <[email protected]>
>
> hugepage_subpool_put_pages() currently has two distinct responsibilities
> that conflict:
>
> 1. When size is specified for the mount, max_hpages !=3D -1: Keep track o=
f
>    total active pages (allocated + reserved) and decrement this count
>    (used_hpages) when a page is freed or allocation fails.
> 2. When min_size is specified for the mount, min_hpages !=3D -1: Ensure w=
e
>    don't drop below the guaranteed minimum, and restore a reservation
>    (rsv_hpages) if we do.
>
> This causes trouble because when allocation fails (refer to
> alloc_hugetlb_folio()) if gbl_chg =3D 1 (i.e. no subpool reservation was
> taken):
>
> + To keep used_hpages consistent, HugeTLB needs to call
>   hugepage_subpool_put_pages() to restore undo used_hpages being
>   incremented
> + But can't call hugepage_subpool_put_pages() if no reservation was
>   consumed.
>
> One option would be to conditionally do subpool tracking updates outside =
of
> the hugepage_subpool_put_pages() function, but that would spread logic al=
l
> over.
>
> Instead, always track used_hpages, regardless of whether a max_size was
> requested for the mount, so that the subpool always knows how many pages
> were allocated through it. Every page allocated through the subpool
> increments used_hpages, regardless of whether a reservation was taken fro=
m
> it.
>
> Conceptually, now, every allocation involving a subpool uses a page from
> the subpool, which must be returned to the subpool. Every page taken from
> the subpool tries to use a subpool reservation. Restoring a page to the
> subpool reservations only if the page was taken from subpool
> reservations. (If used_hpages >=3D min_hpages, the page must have not hav=
e
> been taken from the reservations.)
>
> Always tracking used_hpages provides the subpool with information of both
> used and reserved counts to make the correct decision for both max_size a=
nd
> min_size correctly.
>
> With used_hpages always tracked,
>
> + subpool_is_free() can be simplified, such that the subpool can be
>   declared free if there are no more pages in use.
> + open-coding in hugetlb_reserve_pages() can be removed.
>
> Also update the
>
> + Documentation for used_hpages in the subpool struct, since it no longer
>   matters whether the used pages count against the maximum.
> + Docstring for hugepage_subpool_{get,put}_pages
> + Documentation to use active voice, and remove some details in favor of
>   having details documented in the docstring
>
> Also update statfs reporting. Previously, if max_hpages is negative,
> used_hpages is static at 0, so returning max_hpages - used_hpages returns
> -1 and is always correct. Now, if the subpool doesn't have a maximum
> requested size, indicate no limit for free pages (-1). If it does have a
> maximum size, report the difference between the requested size and the
> number of used pages. This difference is always positive, because if the
> mount does have a maximum size, hugepage_subpool_get_pages() ensures that
> the subpool usage never exceeds the maximum.
>
> This fixes a bug in hugetlb_unreserve_pages(), where pages are returned t=
o
> the subpool regardless of whether it consumed a reservation. The
> corresponding bug in the failure handling path of alloc_hugetlb_folio() w=
as
> fixed in a833a693a490e.
>
> Fixes: 1c5ecae3a93fa ("hugetlbfs: add minimum size accounting to subpools=
")
> Cc: [email protected]
> Signed-off-by: Ackerley Tng <[email protected]>
> ---
>  Documentation/mm/hugetlbfs_reserv.rst              |  17 +--
>  .../translations/zh_CN/mm/hugetlbfs_reserv.rst     |  11 +-
>  fs/hugetlbfs/inode.c                               |   8 +-
>  include/linux/hugetlb.h                            |   4 +-
>  mm/hugetlb.c                                       | 118 +++++++++++----=
------
>  5 files changed, 75 insertions(+), 83 deletions(-)
>
> diff --git a/Documentation/mm/hugetlbfs_reserv.rst b/Documentation/mm/hug=
etlbfs_reserv.rst
> index a49115db18c76..d244583fdcbc3 100644
> --- a/Documentation/mm/hugetlbfs_reserv.rst
> +++ b/Documentation/mm/hugetlbfs_reserv.rst
> @@ -314,21 +314,8 @@ huge pages.  If they can not be reserved, the mount =
fails.
>  The routines hugepage_subpool_get/put_pages() are called when pages are
>  obtained from or released back to a subpool.  They perform all subpool
>  accounting, and track any reservations associated with the subpool.
> -hugepage_subpool_get/put_pages are passed the number of huge pages by wh=
ich
> -to adjust the subpool 'used page' count (down for get, up for put).  Nor=
mally,
> -they return the same value that was passed or an error if not enough pag=
es
> -exist in the subpool.
> -
> -However, if reserves are associated with the subpool a return value less
> -than the passed value may be returned.  This return value indicates the
> -number of additional global pool adjustments which must be made.  For ex=
ample,
> -suppose a subpool contains 3 reserved huge pages and someone asks for 5.
> -The 3 reserved pages associated with the subpool can be used to satisfy =
part
> -of the request.  But, 2 pages must be obtained from the global pools.  T=
o
> -relay this information to the caller, the value 2 is returned.  The call=
er
> -is then responsible for attempting to obtain the additional two pages fr=
om
> -the global pools.
> -
> +hugepage_subpool_get/put_pages() use the number of huge pages passed to =
adjust
> +the subpool 'used page' count.
>
>  COW and Reservations
>  =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> diff --git a/Documentation/translations/zh_CN/mm/hugetlbfs_reserv.rst b/D=
ocumentation/translations/zh_CN/mm/hugetlbfs_reserv.rst
> index 20947f8bd0654..ae1f1f31477fc 100644
> --- a/Documentation/translations/zh_CN/mm/hugetlbfs_reserv.rst
> +++ b/Documentation/translations/zh_CN/mm/hugetlbfs_reserv.rst
> @@ -246,15 +246,8 @@ hugepage_subpool=E7=9A=84min_hpages=E5=AD=97=E6=AE=
=B5=E4=B8=AD=E8=A2=AB=E8=B7=9F=E8=B8=AA=E3=80=82=E5=9C=A8=E6=8C=82=E8=BD=BD=
=E6=97=B6=EF=BC=8Chugetlb_acct_me
>  =E8=A2=AB=E8=B0=83=E7=94=A8=E4=BB=A5=E9=A2=84=E7=95=99=E6=8C=87=E5=AE=9A=
=E6=95=B0=E9=87=8F=E7=9A=84=E5=B7=A8=E9=A1=B5=E3=80=82=E5=A6=82=E6=9E=9C=E5=
=AE=83=E4=BB=AC=E4=B8=8D=E8=83=BD=E8=A2=AB=E9=A2=84=E7=95=99=EF=BC=8C=E6=8C=
=82=E8=BD=BD=E5=B0=B1=E4=BC=9A=E5=A4=B1=E8=B4=A5=E3=80=82
>
>  =E5=BD=93=E4=BB=8E=E5=AD=90=E6=B1=A0=E4=B8=AD=E8=8E=B7=E5=8F=96=E6=88=96=
=E9=87=8A=E6=94=BE=E9=A1=B5=E9=9D=A2=E6=97=B6=EF=BC=8C=E4=BC=9A=E8=B0=83=E7=
=94=A8hugepage_subpool_get/put_pages()=E5=87=BD=E6=95=B0=E3=80=82
> -hugepage_subpool_get/put_pages=E8=A2=AB=E4=BC=A0=E9=80=92=E7=BB=99=E5=B7=
=A8=E9=A1=B5=E6=95=B0=E9=87=8F=EF=BC=8C=E4=BB=A5=E6=AD=A4=E6=9D=A5=E8=B0=83=
=E6=95=B4=E5=AD=90=E6=B1=A0=E7=9A=84 =E2=80=9C=E5=B7=B2=E7=94=A8=E9=A1=B5=
=E9=9D=A2=E2=80=9D =E8=AE=A1=E6=95=B0
> -=EF=BC=88get=E4=B8=BA=E4=B8=8B=E9=99=8D=EF=BC=8Cput=E4=B8=BA=E4=B8=8A=E5=
=8D=87=EF=BC=89=E3=80=82=E9=80=9A=E5=B8=B8=E6=83=85=E5=86=B5=E4=B8=8B=EF=BC=
=8C=E5=A6=82=E6=9E=9C=E5=AD=90=E6=B1=A0=E4=B8=AD=E6=B2=A1=E6=9C=89=E8=B6=B3=
=E5=A4=9F=E7=9A=84=E9=A1=B5=E9=9D=A2=EF=BC=8C=E5=AE=83=E4=BB=AC=E4=BC=9A=E8=
=BF=94=E5=9B=9E=E4=B8=8E=E4=BC=A0=E9=80=92=E7=9A=84=E7=9B=B8=E5=90=8C=E7=9A=
=84=E5=80=BC=E6=88=96
> -=E4=B8=80=E4=B8=AA=E9=94=99=E8=AF=AF=E3=80=82
> -
> -=E7=84=B6=E8=80=8C=EF=BC=8C=E5=A6=82=E6=9E=9C=E9=A2=84=E7=95=99=E4=B8=8E=
=E5=AD=90=E6=B1=A0=E7=9B=B8=E5=85=B3=E8=81=94=EF=BC=8C=E5=8F=AF=E8=83=BD=E4=
=BC=9A=E8=BF=94=E5=9B=9E=E4=B8=80=E4=B8=AA=E5=B0=8F=E4=BA=8E=E4=BC=A0=E9=80=
=92=E5=80=BC=E7=9A=84=E8=BF=94=E5=9B=9E=E5=80=BC=E3=80=82=E8=BF=99=E4=B8=AA=
=E8=BF=94=E5=9B=9E=E5=80=BC=E8=A1=A8=E7=A4=BA=E5=BF=85=E9=A1=BB=E8=BF=9B=E8=
=A1=8C=E7=9A=84=E9=A2=9D=E5=A4=96=E5=85=A8=E5=B1=80
> -=E6=B1=A0=E8=B0=83=E6=95=B4=E7=9A=84=E6=95=B0=E9=87=8F=E3=80=82=E4=BE=8B=
=E5=A6=82=EF=BC=8C=E5=81=87=E8=AE=BE=E4=B8=80=E4=B8=AA=E5=AD=90=E6=B1=A0=E5=
=8C=85=E5=90=AB3=E4=B8=AA=E9=A2=84=E7=95=99=E7=9A=84=E5=B7=A8=E9=A1=B5=EF=
=BC=8C=E6=9C=89=E4=BA=BA=E8=A6=81=E6=B1=825=E4=B8=AA=E3=80=82=E4=B8=8E=E5=
=AD=90=E6=B1=A0=E7=9B=B8=E5=85=B3=E7=9A=843=E4=B8=AA=E9=A2=84=E7=95=99=E9=
=A1=B5=E5=8F=AF=E4=BB=A5=E7=94=A8=E6=9D=A5
> -=E6=BB=A1=E8=B6=B3=E9=83=A8=E5=88=86=E8=AF=B7=E6=B1=82=E3=80=82=E4=BD=86=
=E6=98=AF=EF=BC=8C=E5=BF=85=E9=A1=BB=E4=BB=8E=E5=85=A8=E5=B1=80=E6=B1=A0=E4=
=B8=AD=E8=8E=B7=E5=BE=972=E4=B8=AA=E9=A1=B5=E9=9D=A2=E3=80=82=E4=B8=BA=E4=
=BA=86=E5=90=91=E8=B0=83=E7=94=A8=E8=80=85=E8=BD=AC=E8=BE=BE=E8=BF=99=E4=B8=
=80=E4=BF=A1=E6=81=AF=EF=BC=8C=E5=B0=86=E8=BF=94=E5=9B=9E=E5=80=BC2=E3=80=
=82=E7=84=B6=E5=90=8E=EF=BC=8C=E8=B0=83=E7=94=A8
> -=E8=80=85=E8=A6=81=E8=B4=9F=E8=B4=A3=E4=BB=8E=E5=85=A8=E5=B1=80=E6=B1=A0=
=E4=B8=AD=E8=8E=B7=E5=8F=96=E5=8F=A6=E5=A4=96=E4=B8=A4=E4=B8=AA=E9=A1=B5=E9=
=9D=A2=E3=80=82
> -
> +=E5=AE=83=E4=BB=AC=E8=B4=9F=E8=B4=A3=E6=89=80=E6=9C=89=E5=AD=90=E6=B1=A0=
=E7=9A=84=E7=BB=9F=E8=AE=A1=E6=A0=B8=E7=AE=97=EF=BC=8C=E5=B9=B6=E8=B7=9F=E8=
=B8=AA=E4=B8=8E=E5=AD=90=E6=B1=A0=E7=9B=B8=E5=85=B3=E8=81=94=E7=9A=84=E9=A2=
=84=E7=95=99=E3=80=82
> +hugepage_subpool_get/put_pages()=E5=87=BD=E6=95=B0=E4=BD=BF=E7=94=A8=E4=
=BC=A0=E5=85=A5=E7=9A=84=E5=B7=A8=E9=A1=B5=E6=95=B0=E9=87=8F=E6=9D=A5=E8=B0=
=83=E6=95=B4=E5=AD=90=E6=B1=A0=E7=9A=84=E2=80=9C=E5=B7=B2=E7=94=A8=E9=A1=B5=
=E9=9D=A2=E2=80=9D=E8=AE=A1=E6=95=B0=E3=80=82
>
>  COW=E5=92=8C=E9=A2=84=E7=95=99
>  =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> diff --git a/fs/hugetlbfs/inode.c b/fs/hugetlbfs/inode.c
> index 216e1a0dd0b23..26c0187340636 100644
> --- a/fs/hugetlbfs/inode.c
> +++ b/fs/hugetlbfs/inode.c
> @@ -1109,8 +1109,12 @@ static int hugetlbfs_statfs(struct dentry *dentry,=
 struct kstatfs *buf)
>
>  			spin_lock_irq(&sbinfo->spool->lock);
>  			buf->f_blocks =3D sbinfo->spool->max_hpages;
> -			free_pages =3D sbinfo->spool->max_hpages
> -				- sbinfo->spool->used_hpages;
> +			if (sbinfo->spool->max_hpages =3D=3D -1) {
> +				free_pages =3D -1;
> +			} else {
> +				free_pages =3D sbinfo->spool->max_hpages -
> +					     sbinfo->spool->used_hpages;
> +			}
>  			buf->f_bavail =3D buf->f_bfree =3D free_pages;
>  			spin_unlock_irq(&sbinfo->spool->lock);
>  			buf->f_files =3D sbinfo->max_inodes;
> diff --git a/include/linux/hugetlb.h b/include/linux/hugetlb.h
> index 2abaf99321e90..34b9a3e1be0fa 100644
> --- a/include/linux/hugetlb.h
> +++ b/include/linux/hugetlb.h
> @@ -38,8 +38,8 @@ struct hugepage_subpool {
>  	spinlock_t lock;
>  	long count;
>  	long max_hpages;	/* Maximum huge pages or -1 if no maximum. */
> -	long used_hpages;	/* Used count against maximum, includes */
> -				/* both allocated and reserved pages. */
> +	long used_hpages;	/* Used page count, includes both */
> +				/* allocated and reserved pages. */
>  	struct hstate *hstate;
>  	long min_hpages;	/* Minimum huge pages or -1 if no minimum. */
>  	long rsv_hpages;	/* Pages reserved against global pool to */
> diff --git a/mm/hugetlb.c b/mm/hugetlb.c
> index 571212b80835e..36fa3fb3945d8 100644
> --- a/mm/hugetlb.c
> +++ b/mm/hugetlb.c
> @@ -129,12 +129,8 @@ static inline bool subpool_is_free(struct hugepage_s=
ubpool *spool)
>  {
>  	if (spool->count)
>  		return false;
> -	if (spool->max_hpages !=3D -1)
> -		return spool->used_hpages =3D=3D 0;
> -	if (spool->min_hpages !=3D -1)
> -		return spool->rsv_hpages =3D=3D spool->min_hpages;
>
> -	return true;
> +	return spool->used_hpages =3D=3D 0;
>  }
>
>  static inline void unlock_or_release_subpool(struct hugepage_subpool *sp=
ool,
> @@ -187,13 +183,18 @@ void hugepage_put_subpool(struct hugepage_subpool *=
spool)
>  	unlock_or_release_subpool(spool, flags);
>  }
>
> -/*
> - * Subpool accounting for allocating and reserving pages.
> - * Return -ENOMEM if there are not enough resources to satisfy the
> - * request.  Otherwise, return the number of pages by which the
> - * global pools must be adjusted (upward).  The returned value may
> - * only be different than the passed value (delta) in the case where
> - * a subpool minimum size must be maintained.
> +/**
> + * hugepage_subpool_get_pages - Get pages from a subpool
> + * @spool: pointer to subpool structure (may be NULL)
> + * @delta: number of pages to allocate or reserve
> + *
> + * Check and update subpool page usage counts when allocating or
> + * reserving @delta hugepages.
> + *
> + * Context: Takes spool->lock using spin_lock_irq().
> + * Return: Non-negative number of reservations that cannot be
> + *         satisfied by the subpool, or -ENOMEM if the subpool maximum
> + *         limit would be exceeded.
>   */
>  static long hugepage_subpool_get_pages(struct hugepage_subpool *spool,
>  				      long delta)
> @@ -205,15 +206,14 @@ static long hugepage_subpool_get_pages(struct hugep=
age_subpool *spool,
>
>  	spin_lock_irq(&spool->lock);
>
> -	if (spool->max_hpages !=3D -1) {		/* maximum size accounting */
> -		if ((spool->used_hpages + delta) <=3D spool->max_hpages)
> -			spool->used_hpages +=3D delta;
> -		else {
> -			ret =3D -ENOMEM;
> -			goto unlock_ret;
> -		}
> +	if (spool->max_hpages !=3D -1 &&
> +	    spool->used_hpages + delta > spool->max_hpages) {
> +		ret =3D -ENOMEM;
> +		goto unlock_ret;
>  	}
>
> +	spool->used_hpages +=3D delta;
> +
>  	/* minimum size accounting */
>  	if (spool->min_hpages !=3D -1 && spool->rsv_hpages) {
>  		if (delta > spool->rsv_hpages) {
> @@ -234,11 +234,19 @@ static long hugepage_subpool_get_pages(struct hugep=
age_subpool *spool,
>  	return ret;
>  }
>
> -/*
> - * Subpool accounting for freeing and unreserving pages.
> - * Return the number of global page reservations that must be dropped.
> - * The return value may only be different than the passed value (delta)
> - * in the case where a subpool minimum size must be maintained.
> +/**
> + * hugepage_subpool_put_pages - Release pages back to a subpool
> + * @spool: pointer to subpool structure (may be NULL)
> + * @delta: number of pages to free or unreserve
> + *
> + * Check and update subpool page usage counts when freeing or
> + * unreserving @delta hugepages.
> + *
> + * Context: Takes spool->lock using spin_lock_irqsave(). May release
> + *          and free @spool if its usage count and references reach
> + *          zero.
> + * Return: Non-negative number of reservations that the subpool cannot
> + *         absorb.
>   */
>  static long hugepage_subpool_put_pages(struct hugepage_subpool *spool,
>  				       long delta)
> @@ -251,19 +259,24 @@ static long hugepage_subpool_put_pages(struct hugep=
age_subpool *spool,
>
>  	spin_lock_irqsave(&spool->lock, flags);
>
> -	if (spool->max_hpages !=3D -1)		/* maximum size accounting */
> -		spool->used_hpages -=3D delta;
> +	spool->used_hpages -=3D delta;
>
>  	 /* minimum size accounting */
>  	if (spool->min_hpages !=3D -1 && spool->used_hpages < spool->min_hpages=
) {
> -		if (spool->rsv_hpages + delta <=3D spool->min_hpages)
> +		/*
> +		 * limit is the maximum number of reservations that
> +		 * can be restored to this subpool.
> +		 */
> +		long limit =3D spool->min_hpages - spool->used_hpages;
> +
> +		if (spool->rsv_hpages + delta <=3D limit)
>  			ret =3D 0;
>  		else
> -			ret =3D spool->rsv_hpages + delta - spool->min_hpages;
> +			ret =3D spool->rsv_hpages + delta - limit;
>
>  		spool->rsv_hpages +=3D delta;
> -		if (spool->rsv_hpages > spool->min_hpages)
> -			spool->rsv_hpages =3D spool->min_hpages;
> +		if (spool->rsv_hpages > limit)
> +			spool->rsv_hpages =3D limit;
>  	}
>
>  	/*
> @@ -6542,7 +6555,7 @@ long hugetlb_reserve_pages(struct inode *inode,
>  		struct vm_area_struct *vma,
>  		vma_flags_t vma_flags)
>  {
> -	long chg =3D -1, add =3D -1, spool_resv, gbl_resv;
> +	long chg =3D -1, add =3D -1, gbl_resv;
>  	struct hstate *h =3D hstate_inode(inode);
>  	struct hugepage_subpool *spool =3D subpool_inode(inode);
>  	struct resv_map *resv_map;
> @@ -6622,9 +6635,9 @@ long hugetlb_reserve_pages(struct inode *inode,
>  	 * the subpool has a minimum size, there may be some global
>  	 * reservations already in place (gbl_reserve).
>  	 */
> -	gbl_reserve =3D hugepage_subpool_get_pages(spool, chg);
> -	if (gbl_reserve < 0) {
> -		err =3D gbl_reserve;
> +	gbl_resv =3D hugepage_subpool_get_pages(spool, chg);
> +	if (gbl_resv < 0) {
> +		err =3D gbl_resv;
>  		goto out_uncharge_cgroup;
>  	}
>
> @@ -6632,7 +6645,7 @@ long hugetlb_reserve_pages(struct inode *inode,
>  	 * Check enough hugepages are available for the reservation.
>  	 * Hand the pages back to the subpool if there are not
>  	 */
> -	err =3D hugetlb_acct_memory(h, gbl_reserve);
> +	err =3D hugetlb_acct_memory(h, gbl_resv);
>  	if (err < 0)
>  		goto out_put_pages;
>
> @@ -6651,7 +6664,7 @@ long hugetlb_reserve_pages(struct inode *inode,
>  		add =3D region_add(resv_map, from, to, regions_needed, h, h_cg);
>
>  		if (unlikely(add < 0)) {
> -			hugetlb_acct_memory(h, -gbl_reserve);
> +			hugetlb_acct_memory(h, -gbl_resv);
>  			err =3D add;
>  			goto out_put_pages;
>  		} else if (unlikely(chg > add)) {
> @@ -6687,26 +6700,21 @@ long hugetlb_reserve_pages(struct inode *inode,
>  	}
>  	return chg;
>
> -out_put_pages:
> -	spool_resv =3D chg - gbl_reserve;
> -	if (spool_resv) {
> -		/* put sub pool's reservation back, chg - gbl_reserve */
> -		gbl_resv =3D hugepage_subpool_put_pages(spool, spool_resv);
> -		/*
> -		 * subpool's reserved pages can not be put back due to race,
> -		 * return to hstate.
> -		 */
> -		hugetlb_acct_memory(h, -gbl_resv);
> -	}
> -	/* Restore used_hpages for pages that failed global reservation */
> -	if (gbl_reserve && spool) {
> -		unsigned long flags;
> + out_put_pages:
> +	/*
> +	 * Return all that was requested from the subpool, let subpool
> +	 * tell us the new number of reservations that need to be
> +	 * returned to the global pool.
> +	 */
> +	gbl_reserve =3D hugepage_subpool_put_pages(spool, chg);
> +	/*
> +	 * There may be a difference between the number of
> +	 * reservations to consume and the number to restore now if
> +	 * there are multiple threads interacting with the subpool -
> +	 * restore the difference.
> +	 */
> +	hugetlb_acct_memory(h, gbl_resv - gbl_reserve);

Sashiko had a few comments on this patch, the following is the only one
that isn't addressed in a later patch in this same series:

  [Severity: Critical]
  Does this code leave the subpool with phantom global reservations if
  hugetlb_acct_memory() fails?

  If hugetlb_acct_memory() is called with a positive delta here (meaning th=
e
  subpool absorbed some reservations) and it returns -ENOMEM because the gl=
obal
  pool is exhausted, the return value is ignored.

  Could this artificially inflate the subpool's rsv_hpages without backing
  global pages, which would then inflate free_huge_pages out of thin air wh=
en
  the subpool is eventually destroyed?

This is true, but this is a failure path and I'm not really sure how
best to handle an error from hugetlb_acct_memory() in this case. Other
callers of hugetlb_acct_memory() don't handle failures either.


>
> -		spin_lock_irqsave(&spool->lock, flags);
> -		if (spool->max_hpages !=3D -1)
> -			spool->used_hpages -=3D gbl_reserve;
> -		unlock_or_release_subpool(spool, flags);
> -	}
>  out_uncharge_cgroup:
>  	hugetlb_cgroup_uncharge_cgroup_rsvd(hstate_index(h),
>  					    chg * pages_per_huge_page(h), h_cg);
>
> --
> 2.55.0.229.g6434b31f56-goog