Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
MIME-Version: 1.0
References: <20230415000818.1955007-1-surenb@google.com> <ZD2gsbN2K66oXT69@x1n>
 <ZD3Nk0u+nxOT4snZ@casper.infradead.org> <CAJuCfpFPziNK65qpzd5dEYSnoE-94UHAsM-CX080VTTJC5ZZKA@mail.gmail.com>
 <ZD6oVgIi/yY1+t1L@casper.infradead.org> <CAJuCfpFJ0owZELS2COukb0rHCOpqNMW-x9vVonkhknReZb=Zsg@mail.gmail.com>
 <ZD6yirD6Ob+1xG32@casper.infradead.org> <ZD6/805XpvfZde0Y@x1n> <CAJuCfpGZAALQbPFGymJOgkMp2knKoos697L8jd1v2jDyBSbdYA@mail.gmail.com>
In-Reply-To: <CAJuCfpGZAALQbPFGymJOgkMp2knKoos697L8jd1v2jDyBSbdYA@mail.gmail.com>
From:   Suren Baghdasaryan <surenb@google.com>
Date:   Tue, 18 Apr 2023 14:48:58 -0700
Message-ID: <CAJuCfpFFsKkdnHLSojSo0pP-=nQFiY408tpVDHVy6TpGSv1B9g@mail.gmail.com>
Subject: Re: [PATCH v2 1/1] mm: do not increment pgfault stats when page fault
 handler retries
To:     Peter Xu <peterx@redhat.com>
Cc:     Matthew Wilcox <willy@infradead.org>, akpm@linux-foundation.org,
        hannes@cmpxchg.org, mhocko@suse.com, josef@toxicpanda.com,
        jack@suse.cz, ldufour@linux.ibm.com, laurent.dufour@fr.ibm.com,
        michel@lespinasse.org, liam.howlett@oracle.com, jglisse@google.com,
        vbabka@suse.cz, minchan@google.com, dave@stgolabs.net,
        punit.agrawal@bytedance.com, lstoakes@gmail.com,
        linux-mm@kvack.org, linux-kernel@vger.kernel.org,
        kernel-team@android.com
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Precedence: bulk

On Tue, Apr 18, 2023 at 10:17=E2=80=AFAM Suren Baghdasaryan <surenb@google.=
com> wrote:
>
> On Tue, Apr 18, 2023 at 9:06=E2=80=AFAM Peter Xu <peterx@redhat.com> wrot=
e:
> >
> > On Tue, Apr 18, 2023 at 04:08:58PM +0100, Matthew Wilcox wrote:
> > > On Tue, Apr 18, 2023 at 07:54:01AM -0700, Suren Baghdasaryan wrote:
> > > > On Tue, Apr 18, 2023 at 7:25=E2=80=AFAM Matthew Wilcox <willy@infra=
dead.org> wrote:
> > > > >
> > > > > On Mon, Apr 17, 2023 at 04:17:45PM -0700, Suren Baghdasaryan wrot=
e:
> > > > > > On Mon, Apr 17, 2023 at 3:52=E2=80=AFPM Matthew Wilcox <willy@i=
nfradead.org> wrote:
> > > > > > >
> > > > > > > On Mon, Apr 17, 2023 at 03:40:33PM -0400, Peter Xu wrote:
> > > > > > > > >     /*
> > > > > > > > > -    * We don't do accounting for some specific faults:
> > > > > > > > > -    *
> > > > > > > > > -    * - Unsuccessful faults (e.g. when the address wasn'=
t valid).  That
> > > > > > > > > -    *   includes arch_vma_access_permitted() failing bef=
ore reaching here.
> > > > > > > > > -    *   So this is not a "this many hardware page faults=
" counter.  We
> > > > > > > > > -    *   should use the hw profiling for that.
> > > > > > > > > -    *
> > > > > > > > > -    * - Incomplete faults (VM_FAULT_RETRY).  They will o=
nly be counted
> > > > > > > > > -    *   once they're completed.
> > > > > > > > > +    * Do not account for incomplete faults (VM_FAULT_RET=
RY). They will be
> > > > > > > > > +    * counted upon completion.
> > > > > > > > >      */
> > > > > > > > > -   if (ret & (VM_FAULT_ERROR | VM_FAULT_RETRY))
> > > > > > > > > +   if (ret & VM_FAULT_RETRY)
> > > > > > > > > +           return;
> > > > > > > > > +
> > > > > > > > > +   /* Register both successful and failed faults in PGFA=
ULT counters. */
> > > > > > > > > +   count_vm_event(PGFAULT);
> > > > > > > > > +   count_memcg_event_mm(mm, PGFAULT);
> > > > > > > >
> > > > > > > > Is there reason on why vm events accountings need to be exp=
licitly
> > > > > > > > different from perf events right below on handling ERROR?
> > > > > > >
> > > > > > > I think so.  ERROR is quite different from RETRY.  If we are,=
 for
> > > > > > > example, handling a SIGSEGV (perhaps a GC language?) that sho=
uld be
> > > > > > > accounted.  If we can't handle a page fault right now, and ne=
ed to
> > > > > > > retry within the kernel, that should not be accounted.
> > > > > >
> > > > > > IIUC, the question was about the differences in vm vs perf acco=
unting
> > > > > > for errors, not the difference between ERROR and RETRY cases. M=
atthew,
> > > > > > are you answering the right question or did I misunderstand you=
r
> > > > > > answer?
> > > > >
> > > > > Maybe I'm misunderstanding what you're proposing.  I thought the
> > > > > proposal was to make neither ERROR nor RETRY increment the counte=
rs,
> > > > > but if the proposal is to make ERROR increment the perf counters
> > > > > instead, then that's cool with me.
> > > >
> > > > Oh, I think now I understand your answer. You were not highlighting
> > > > the difference between the who but objecting to the proposal of not
> > > > counting both ERROR and RETRY. Am I on the same page now?
> > >
> > > I think so.  Let's see your patch and then we can be sure we're talki=
ng
> > > about the same thing ;-)
> >
> > IMHO if there's no explicit reason to differenciate the events, we shou=
ld
> > always account them the same way for vm,perf,... either with ERROR
> > accounted or not.
> >
> > I am not sure whether accounting ERROR faults would matter for a mprote=
ct()
> > use case, because they shouldn't rely on the counter to work but the SI=
GBUS
> > itself to be generated on page accesses with the sighandler doing work.
>
> For that example with GC, these are valid page faults IIUC and current
> PGFAULT counters do register them. Do we want to change that and
> potentially break assumptions about these counters?
>
> >
> > One trivial benefit of keep accounting ERROR is we only need to modify =
vm
> > account ABI so both RETRY & ERROR will be adjusted to match perf,task
> > counters.  OTOH we can also change all to take ERROR into account, but =
then
> > we're modifying ABI for all counters.
>
> So, not accounting them in both vm and perf would be problematic for
> that GC example and similar cases.
> Are we left with only two viable options?:
> 1. skip RETRY for vm and skip ERROR for both vm and perf (this patch)
> 2. skip RETRY for both vm and perf, account ERROR for both
>
> #2 would go against the comment in mm_account_fault() saying that we
> don't account for unsuccessful faults. I guess there must have been
> some reason we were not accounting for them (such as access to a
> faulty address is neither major nor minor fault)?

I did some digging in the history and looks like the check for ERROR
was added after this discussion:
https://lore.kernel.org/all/20200624203412.GB64004@xz-x1/ and IIUC the
reason was that previous code also skipped VM_FAULT_ERROR. Peter, is
that correct?

It seems this discussion is becoming longer than it should be. How
about we keep the behavior of all counters as they are to avoid
breaking any possible usecases and just fix the double-counting issue
for RETRY cases?

>
> >
> > --
> > Peter Xu
> >
> > --
> > To unsubscribe from this group and stop receiving emails from it, send =
an email to kernel-team+unsubscribe@android.com.
> >