Re: [PATCH] mm/gup: fix always draining LRU caches in collect_longterm_unpinnable_folios()
"David Hildenbrand (Arm)" <[email protected]> Mon, 3 Aug 2026 11:19:19 +0200
| Newsgroups | org.kvack.linux-mm,org.kernel.vger.linux-kernel,org.kernel.vger.stable |
|---|---|
| Message-ID | <[email protected]> |
On 8/3/26 11:17, Barry Song wrote: > On Sat, Aug 1, 2026 at 4:28 AM David Hildenbrand (Arm) <[email protected]> wrote: >> >> folio_may_be_lru_cached() is currently only true for small folios, and >> for small folios FOLL_PIN adds GUP_PIN_COUNTING_BIAS references instead >> of 1 in try_grab_folio()/try_grab_folio_fast(). >> >> Consequently, our >> >> folio_ref_count(folio) != folio_expected_ref_count(folio) + 1 >> >> check in collect_longterm_unpinnable_folios() will currently always >> identify "reference mismatch" and first drain the local LRU cache to then >> drain the LRU cache on all CPUs, as collect_longterm_unpinnable_folios() >> is really called after pinning the folios with FOLL_PIN. >> >> Add a comment because the current code is not quite intuitive: we used to >> drain only to make sure the folio_isolate_lru() would succeed. But then we >> also started draining to make later migration more reliable. >> >> We'll refactor that code soon a bit, to also make it usable in other >> context where we really want to remove any references from LRU caches. >> >> Let's add CC stable, because having an easy way for excessive LRU cache >> draining on all CPUs does not sound right. In common scenarios we >> don't expect to every have to drain. >> >> Fixes: 98c6d259319e ("mm/gup: check ref_count instead of lru before migration") >> Fixes: a09a8a1fbb37 ("mm/gup: local lru_add_drain() to avoid lru_add_drain_all()") >> Cc: [email protected] >> Signed-off-by: David Hildenbrand (Arm) <[email protected]> >> --- >> Found by code inspection. If someone has a testcase that can easily >> trigger this and result in migration problems, please test! But this >> change seems to be "obvious the right thing to do". >> --- >> mm/gup.c | 10 ++++++++-- >> 1 file changed, 8 insertions(+), 2 deletions(-) >> >> diff --git a/mm/gup.c b/mm/gup.c >> index 99902c15703b0..41c3317e0f0f4 100644 >> --- a/mm/gup.c >> +++ b/mm/gup.c >> @@ -2273,6 +2273,7 @@ static unsigned long collect_longterm_unpinnable_folios( >> >> for (folio = pofs_get_folio(pofs, i); folio; >> folio = pofs_next_folio(folio, pofs, &i)) { >> + const int pin_refs = folio_has_pincount(folio) ? 1 : GUP_PIN_COUNTING_BIAS; >> >> if (folio_is_longterm_pinnable(folio)) >> continue; >> @@ -2287,15 +2288,20 @@ static unsigned long collect_longterm_unpinnable_folios( >> continue; >> } >> >> + /* >> + * We drain not only to make the folio_isolate_lru() succeed, >> + * but also to remove any other folio references from LRU >> + * caches. >> + */ >> if (drained == 0 && folio_may_be_lru_cached(folio) && >> folio_ref_count(folio) != >> - folio_expected_ref_count(folio) + 1) { >> + folio_expected_ref_count(folio) + pin_refs) { >> lru_add_drain(); >> drained = 1; >> } >> if (drained == 1 && folio_may_be_lru_cached(folio) && >> folio_ref_count(folio) != >> - folio_expected_ref_count(folio) + 1) { >> + folio_expected_ref_count(folio) + pin_refs) { >> lru_add_drain_all(); >> drained = 2; >> } > > Not regarding the fix itself, I agree that the fix is correct. I am > just a bit curious why we cannot simply do: > > if (folio_may_be_lru_cached(folio) && !folio_test_lru(folio)) { > lru_add_drain(); > if (!folio_test_lru(folio)) > lru_add_drain_all(); > } > > Or at least the following diff? Best to read 98c6d259319e, which documents why this is required. -- Cheers, David