Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   Liam Howlett <liam.howlett@oracle.com>
To:     Luigi Rizzo <lrizzo@google.com>
CC:     Jason Gunthorpe <jgg@ziepe.ca>, Jann Horn <jannh@google.com>,
        linux-kernel <linux-kernel@vger.kernel.org>,
        Andrew Morton <akpm@linux-foundation.org>,
        David Rientjes <rientjes@google.com>,
        "linux-mm@kvack.org" <linux-mm@kvack.org>
Subject: Re: [PATCH] Add mmap_assert_locked() annotations to find_vma*()
Thread-Topic: [PATCH] Add mmap_assert_locked() annotations to find_vma*()
Thread-Index: AQHXhjmoYtMFsOr1JUGtL1OdK4dvaath9waAgABfMgCAABX5gIAAB+cAgAAGLQCAAFfUgA==
Date:   Wed, 4 Aug 2021 05:12:17 +0000
Message-ID: <20210804051209.movpl4ubatcekakz@revolver>
References: <20210731175341.3458608-1-lrizzo@google.com>
 <20210803160803.GG543798@ziepe.ca>
 <CAMOZA0JKjRFUHbs3zc4kiGcuXxR0arCN=oPZZsLCa4qHvRrH_A@mail.gmail.com>
 <20210803230725.ao3i2emejyyor36n@revolver> <20210803233542.GH543798@ziepe.ca>
 <CAMOZA0Lk_aLSyu8MyY-xxfPafF-U9Zwo85H=qh=yMqPNcZdT=w@mail.gmail.com>
In-Reply-To: <CAMOZA0Lk_aLSyu8MyY-xxfPafF-U9Zwo85H=qh=yMqPNcZdT=w@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?gC/0bTHhY0CzqnhF9AqGOa9qnK6V2uAlhbY0PPS/N2tqcLr1q7gti11/LtNG?=
 =?us-ascii?Q?4hTijrOxWmm+tQ3IfVNHGPLST5IS9LSYvn17DyNH+2MOODWXYt4lxDBcV8A5?=
 =?us-ascii?Q?mOltX4Pb1qjdztfti5/6+YPN4sy3OZrjk/iHqSc2nuEpbd9lrS3GDDro3OEb?=
 =?us-ascii?Q?hqxLNuFtb7+5qpkMrNzGiL/yOVPwGRPzIimwQB0NzURoP+4KdoK+c3oyGrL6?=
 =?us-ascii?Q?fY7HSixtDe1cuN5Ul9M67vUx5m3J6btW0gwCcrLduMBlXM6OE540uFR7+fiy?=
 =?us-ascii?Q?j3qmjLAMyT14kTbZRszlyeeoOciozfS4ZCLKEf8Q/TDA3qe4KYl+m3oYJBRT?=
 =?us-ascii?Q?iHKxcWQFHmKfaZtHQxfbpRyVxhOLv1DAUoFNhn7m600f3r2/0XF/UPrNn9bn?=
 =?us-ascii?Q?qDjs5DRNCJSKGBkbi9jP4rAIfiX8/mIxXh8XcpqfiwI5MO5FGBfwOGVhIwMG?=
 =?us-ascii?Q?w4VMgYUpov28cWplb8Uk7fk1YR0dF7/wkXf8GJUwMMpC41yHlVoLNov7J7GT?=
 =?us-ascii?Q?iW2wBbDzdWjFntMgRU/Uc/NpJi0DsYHrOgia4GQr8q2/s2xSClfZCKS/46Kv?=
 =?us-ascii?Q?CZYB4b4jcfTxX1DFsa1iu8MIFlWL5EDBOpz4toFAnPv2/sXKXoX3q526P2hO?=
 =?us-ascii?Q?GG/wENIYEqSZm47F0vGkTLT11JfEH5WnxUV5Ax3BTBcz2STfv+h5HVVlw6o+?=
 =?us-ascii?Q?QrYj2DWPEppFUbp65GayEg/Ae0R5PK+J6AD1XXIetKTLueB8MGLJFonTMOkZ?=
 =?us-ascii?Q?b0Btx//SXoVsMqdeh6jXzMfDbl/5l41yTDWKc8jlhQo0LLuqKYAA7INodOdb?=
 =?us-ascii?Q?lWCmQyO3k4uehv/TfGcgV112C5WWr0c4gtuOgP4F0YPuzFB4PHOM9ulTYXyj?=
 =?us-ascii?Q?AaPiMiE4L/GblJTynheLxy7exi6N3Arj9RpkxleQ0wAZCeW9EYOVzcrz5BHv?=
 =?us-ascii?Q?u0v8vs8O5EOMOqS7RZMpHinlnjZqZA+BH/vb5D26Vc9NwJxBsV+eah0nqMo/?=
 =?us-ascii?Q?R6swixQdd7D8iCVAUfrso6L1HS/gVLWCrRM+oNtPopWEfIm/q+hqCC7Xt5DO?=
 =?us-ascii?Q?PBGd0g1dor32bqzpLgFiuInbufx7TGyLjRMLRjhC7vY4AklEMyiut8fkNEK1?=
 =?us-ascii?Q?Z+YAbReZE3jBrpajZojS79qtrJRNkRjMTu7aX4RI8w0SlwJyi13C6bDirwWu?=
 =?us-ascii?Q?npzZUhsh76J2GgQf7seGhwp8IUVCsGVAz2bH8qdk4hDQnkBmuHy9UAPE/Hhg?=
 =?us-ascii?Q?EoyseY4mQB85TVmdbKGgIqxhG79aUxwmjcdDl+PyTvvaeFfztJmOjB2oxwuy?=
 =?us-ascii?Q?pwYMb334kCbGgxW36OVd7lgl?=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="us-ascii"
Content-ID: <3CF26834B86C3E46A0574144228E2D76@namprd10.prod.outlook.com>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DM6PR10MB4380.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 003295eb-75d6-40be-cbae-08d957066dd4
X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Aug 2021 05:12:17.2453
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: WL5w5BPona4AXtefjPFLmBNpW2dw72cqr6zhtjloSdLE3aiUnOUCckVzMbRzVxkxayZ8EusxhrrC+gmwptFq9Q==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR10MB5181
X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=10065 signatures=668682
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxscore=0 malwarescore=0 phishscore=0
 spamscore=0 adultscore=0 suspectscore=0 mlxlogscore=999 bulkscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2107140000
 definitions=main-2108040028
X-Proofpoint-GUID: hOfBMGSbRXPz4IFnvwZrVtGizODpLXRI
X-Proofpoint-ORIG-GUID: hOfBMGSbRXPz4IFnvwZrVtGizODpLXRI
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

* Luigi Rizzo <lrizzo@google.com> [210803 19:58]:
> On Wed, Aug 4, 2021 at 1:35 AM Jason Gunthorpe <jgg@ziepe.ca> wrote:
> >
> > On Tue, Aug 03, 2021 at 11:07:35PM +0000, Liam Howlett wrote:
> > > * Luigi Rizzo <lrizzo@google.com> [210803 17:49]:
> > > > On Tue, Aug 3, 2021 at 6:08 PM Jason Gunthorpe <jgg@ziepe.ca> wrote=
:
> > > > >
> > > > > On Sat, Jul 31, 2021 at 10:53:41AM -0700, Luigi Rizzo wrote:
> > > > > > find_vma() and variants need protection when used.
> > > > > > This patch adds mmap_assert_lock() calls in the functions.
> > > > > >
> > > > > > To make sure the invariant is satisfied, we also need to add a
> > > > > > mmap_read_loc() around the get_user_pages_remote() call in
> > > > > > get_arg_page(). The lock is not strictly necessary because the =
mm
> > > > > > has been newly created, but the extra cost is limited because
> > > > > > the same mutex was also acquired shortly before in __bprm_mm_in=
it(),
> > > > > > so it is hot and uncontended.
> > > > > >
> > > > > > Signed-off-by: Luigi Rizzo <lrizzo@google.com>
> > > > > >  fs/exec.c | 2 ++
> > > > > >  mm/mmap.c | 2 ++
> > > > > >  2 files changed, 4 insertions(+)
> > > > > >
> > > > > > diff --git a/fs/exec.c b/fs/exec.c
> > > > > > index 38f63451b928..ac7603e985b4 100644
> > > > > > +++ b/fs/exec.c
> > > > > > @@ -217,8 +217,10 @@ static struct page *get_arg_page(struct li=
nux_binprm *bprm, unsigned long pos,
> > > > > >        * We are doing an exec().  'current' is the process
> > > > > >        * doing the exec and bprm->mm is the new process's mm.
> > > > > >        */
> > > > > > +     mmap_read_lock(bprm->mm);
> > > > > >       ret =3D get_user_pages_remote(bprm->mm, pos, 1, gup_flags=
,
> > > > > >                       &page, NULL, NULL);
> > > > > > +     mmap_read_unlock(bprm->mm);
> > > > > >       if (ret <=3D 0)
> > > > > >               return NULL;
> > > > >
> > > > > Wasn't Jann Horn working on something like this too?
> > > > >
> > > > > https://lore.kernel.org/linux-mm/20201016225713.1971256-1-jannh@g=
oogle.com/
> > > > >
> > > > > IIRC it was very tricky here, are you sure it is OK to obtain thi=
s lock
> > > > > here?
> > > >
> > > > I cannot comment on Jann's patch series but no other thread knows
> > > > about this mm at this point in the code so the lock is definitely
> > > > safe to acquire (shortly before there was also a write lock acquire=
d
> > > > on the same mm, in the same conditions).
> > >
> > > If there is no other code that knows about this mm, then does one nee=
d
> > > the lock at all?  Is this just to satisfy the new check you added?
> > >
> > > If you want to make this change, I would suggest writing it in a way =
to
> > > ensure the call to expand_downwards() in the same function also holds
> > > the lock.  I believe this is technically required as well?  What do y=
ou
> > > think?
> >
> > This is essentially what Jann was doing. Since the mm is newly created
> > we can create it write locked and then we can add proper locking tests
> > to many of the functions called along this path.

That sounds good.  Jann has left the patch as pending a fix since
November 2020.  Can't the removal of the lock/unlock be added to the
next iteration of the patch?  Was there a v4 of that patch?

> >
> > Adding useless locks around each troublesome callsite just seems
> > really confusing to me.
>=20
> Uhm... by that reasoning, even creating the mm locked (and unlocking
> at the end) is equally unnecessary.

I think taking the lock is more clear than leaving it the way it's
currently written.  It is actually confusing to see the lock taken after
calling expand_downwards() which explicitly mentions the lock as
required in the comments though.  This should at least have a comment
about early creation not requiring the lock.

>=20
> My goal was to add asserts and invariants that are easy
> to understand and get right, rather than optimize a path
> that does not appear to be critical.
>=20
> Adding one read lock pair around the one function we annotate
> is easy to understand and clearly a leaf lock.
>=20
> Having alloc_bprm return a locked object is a bit unconventional,
> and also passing it to other methods raises the question of whether
> they take other lock possibly causing lock order reversals
> in the future.

We are (probably?) okay as the usual order right now is to take the mmap
sem before the pte and interval tree.  It's also just for the set up, so
unless there is a special case that could cause trouble... or maybe I
should ask which cases will cause trouble?

Thanks,
Liam