Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Thu, 11 Aug 2022 17:11:22 -0700
From:   Ira Weiny <ira.weiny@intel.com>
To:     Kees Cook <keescook@chromium.org>
CC:     "Fabio M. De Francesco" <fmdefrancesco@gmail.com>,
        <ebiederm@xmission.com>, <linux-fsdevel@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>, <linux-mm@kvack.org>,
        <linux-next@vger.kernel.org>, <sfr@canb.auug.org.au>,
        <syzkaller-bugs@googlegroups.com>, <viro@zeniv.linux.org.uk>,
        syzbot <syzbot+3250d9c8925ef29e975f@syzkaller.appspotmail.com>
Subject: Re: [syzbot] linux-next boot error: BUG: unable to handle kernel
 paging request in kernel_execve
Message-ID: <YvWaqhLGsBp9ynIq@iweiny-desk3>
References: <0000000000008c0ba505e5f22066@google.com>
 <202208110830.8F528D6737@keescook>
 <YvU+0UHrn9Ab4rR8@iweiny-desk3>
 <YvVPtuel8NMmiTKk@iweiny-desk3>
 <202208111356.97951D32@keescook>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <202208111356.97951D32@keescook>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?qrMoW/YS1R1M6aP+D/hrCEkP2HlRwtDAeb4muJnA25Yhdhy+pvXuzgFQjQy5?=
 =?us-ascii?Q?gzC18t+5faUqFtf9aJw0PnWgqm3ORgCZV90yuiewCyb0F5hGYjfQPmJ79VQE?=
 =?us-ascii?Q?EYA75heZoPDQ8xDNSTbA9EqTGib+t5k1fQPVF5P0wH53mRYY/i/AVJzoC2bV?=
 =?us-ascii?Q?S6kgU+Be/395QZ3Ui3enB0YrRWH6zZlY5bwuMmcyufQqq76LvXMEm3OePMmf?=
 =?us-ascii?Q?IZLPOrHLHEK5XrJLwbmvU6W1Yt4uTOjcFrrR6ifhxr7c/DfAUrF4LUJYsj5A?=
 =?us-ascii?Q?QyXsyG7MhFPptbH4KdDr+ZGFHKQd+rAqok7FzhvxPLULoi+slZAIptWZOZ9F?=
 =?us-ascii?Q?EhuHK6cBSlfug+nYtYWPOmpTfuFwwQ9WBVAMExD7HQabXaSS7YHb/tGMFCeU?=
 =?us-ascii?Q?NWdoGpVFjIyc1w7aDwuYZUgJ4Y5nwi7zJm+Ps+AV+Ixg85Moo3LeRLtoi6mk?=
 =?us-ascii?Q?xY/QdbER04QH8dqClhGdPK4AAPxDSRg6axV0iKz0apph0Lpnsmf9iXH8uacQ?=
 =?us-ascii?Q?O/FhVNr0nLPGlWw9nY+nCnFYVVATAt19iyTKRlj0+yyzsgR5uGf+R9fDG9Ni?=
 =?us-ascii?Q?4LBNvI8QjIm+KKRl5sNmRbtFlEesTWq7ckCPlCEBOidWdHnw0wA8a1UcaY40?=
 =?us-ascii?Q?xxzuEMiYrvLL/AFDjvdlmq828Z+7ct9+xM1B+9GNuZmyVLeZ/9f5l5oltAup?=
 =?us-ascii?Q?zFciI2afurmV+MamkG+rfHJL4Vldfbe9xB8Sm3+T6qd4/lS/r0vt7SDkRBP1?=
 =?us-ascii?Q?4dcJaWQ2F5brFQZOcddcw88bnsaGmcPc8mxjOB55e6pAvk/xQ4D7W8CGbFMT?=
 =?us-ascii?Q?Skc702tjeyke5dtEHKZ5g5v3LILn/QGN4jOSxdc+ch8WHYilgn5NTFrG4o03?=
 =?us-ascii?Q?DG5BEVuI4/+wOj5MV1kkD+O4b4FEAXgRWX/VjLeXTBOaFOPfMYN7fIV4sJWz?=
 =?us-ascii?Q?igMDYjN8dDaQxgb0fczZnSR2ZZEZ+83YZg73Suky1GqhWv9KHEqIuy6z6dJb?=
 =?us-ascii?Q?2/or6BL5q93H5g5PXUHnGNKHjgg1AiyEIMpjKowXux09PbNbmVQfHAIgsOol?=
 =?us-ascii?Q?dg01cSlm4bfQ8qiv1V0Ta4Xi828e+tGCmhYW5+Fre1+Tqhjr5AwjMVHcO+7e?=
 =?us-ascii?Q?z94pwNcuGAuvYcAQF4wXYK/plWL5WDtujOnv2xrBw8aBiFQE/uZhp6c3Br0u?=
 =?us-ascii?Q?VMETXUF4Qm9SAFSUXDGBGb6kqwhoq8QAFXM3dg0nrBHyJ7gD0FGMhoUy5FC1?=
 =?us-ascii?Q?+QjX1uz6WLVuPqpYFuAUdeOU8fn93d13j5iliZHhS7gLYZjDXLS7lekNMntJ?=
 =?us-ascii?Q?yvybgbKDmmwDnP0B/EIoJrptp7JfU1T3IZJ2yxiHziBrEdvRaqJzJaTeJqbu?=
 =?us-ascii?Q?vyV9QYUxN34l9CsteYMx+CIFyo3SnwFdKVXIWJP2IhUgpPIXnOl9lz5rIvqv?=
 =?us-ascii?Q?6n4EYpxvuqAchSpnhKF+UG29Z1YcKHc0gB2FV4S4xHCeq5KDRbR+qUuPOibc?=
 =?us-ascii?Q?MoBde6ClhYVVg+Uuj98hZeExVCz1Nb/UJB1YsUPmhrrL/oxv5LQA6RYTR25e?=
 =?us-ascii?Q?C+Qfz2v1vSB4OmVIW64kwwFNyjVCI/oFMu5nRzSs?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 000bb078-9de0-438c-b6b5-08da7bf7324c
X-MS-Exchange-CrossTenant-AuthSource: DM4PR11MB6311.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Aug 2022 00:11:25.8623
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: WKgIsbnwHXc1Nl+BvmxYjUxBpbAcOc27u+GTL/j5TXC527TTHDlBFRQGXEq2I8tKcwUpQCVtBNdudEJher3o1A==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN9PR11MB5452
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-5.0 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,
        SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On Thu, Aug 11, 2022 at 02:00:59PM -0700, Kees Cook wrote:
> On Thu, Aug 11, 2022 at 11:51:34AM -0700, Ira Weiny wrote:
> > On Thu, Aug 11, 2022 at 10:39:29AM -0700, Ira wrote:
> > > On Thu, Aug 11, 2022 at 08:33:16AM -0700, Kees Cook wrote:
> > > > Hi Fabio,
> > > > 
> > > > It seems likely that the kmap change[1] might be causing this crash. Is
> > > > there a boot-time setup race between kmap being available and early umh
> > > > usage?
> > > 
> > > I don't see how this is a setup problem with the config reported here.
> > > 
> > > CONFIG_64BIT=y
> > > 
> > > ...and HIGHMEM is not set.
> > > ...and PREEMPT_RT is not set.
> > > 
> > > So the kmap_local_page() call in that stack should be a page_address() only.
> > > 
> > > I think the issue must be some sort of race which was being prevented because
> > > of the preemption and/or pagefault disable built into kmap_atomic().
> > > 
> > > Is this reproducable?
> > > 
> > > The hunk below will surely fix it but I think the pagefault_disable() is
> > > the only thing that is required.  It would be nice to test it.
> > 
> > Fabio and I discussed this.  And he also mentioned that pagefault_disable() is
> > all that is required.
> 
> Okay, sounds good.
> 
> > Do we have a way to test this?
> 
> It doesn't look like syzbot has a reproducer yet, so its patch testing
> system[1] will not work. But if you can send me a patch, I could land it
> in -next and we could see if the reproduction frequency drops to zero.
> (Looking at the dashboard, it's seen 2 crashes, most recently 8 hours
> ago.)

Patch sent.

https://lore.kernel.org/lkml/20220812000919.408614-1-ira.weiny@intel.com/

But I'm more confused after looking at this again.

Ira

> 
> -Kees
> 
> [1] https://github.com/google/syzkaller/blob/master/docs/syzbot.md#testing-patches
> 
> > > > > syzbot found the following issue on:
> > > > > 
> > > > > HEAD commit:    bc6c6584ffb2 Add linux-next specific files for 20220810
> > > > > git tree:       linux-next
> > > > > console output: https://syzkaller.appspot.com/x/log.txt?x=115034c3080000
> > > > > kernel config:  https://syzkaller.appspot.com/x/.config?x=5784be4315a4403b
> > > > > dashboard link: https://syzkaller.appspot.com/bug?extid=3250d9c8925ef29e975f
> > > > > compiler:       gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2
> > > > > 
> > > > > IMPORTANT: if you fix the issue, please add the following tag to the commit:
> > > > > Reported-by: syzbot+3250d9c8925ef29e975f@syzkaller.appspotmail.com
> > > > > 
> > > > > BUG: unable to handle page fault for address: ffffdc0000000000
> > > > > #PF: supervisor read access in kernel mode
> > > > > #PF: error_code(0x0000) - not-present page
> > > > > PGD 11826067 P4D 11826067 PUD 0 
> > > > > Oops: 0000 [#1] PREEMPT SMP KASAN
> > > > > CPU: 0 PID: 1100 Comm: kworker/u4:5 Not tainted 5.19.0-next-20220810-syzkaller #0
> > > > > Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 07/22/2022
> > > > > RIP: 0010:strnlen+0x3b/0x70 lib/string.c:504
> > > > > Code: 74 3c 48 bb 00 00 00 00 00 fc ff df 49 89 fc 48 89 f8 eb 09 48 83 c0 01 48 39 e8 74 1e 48 89 c2 48 89 c1 48 c1 ea 03 83 e1 07 <0f> b6 14 1a 38 ca 7f 04 84 d2 75 11 80 38 00 75 d9 4c 29 e0 48 83
> > > > > RSP: 0000:ffffc90005c5fe10 EFLAGS: 00010246
> > > > > RAX: ffff000000000000 RBX: dffffc0000000000 RCX: 0000000000000000
> > > > > RDX: 1fffe00000000000 RSI: 0000000000020000 RDI: ffff000000000000
> > > > > RBP: ffff000000020000 R08: 0000000000000005 R09: 0000000000000000
> > > > > R10: 0000000000000006 R11: 0000000000000000 R12: ffff000000000000
> > > > > R13: ffff88814764cc00 R14: ffff000000000000 R15: ffff88814764cc00
> > > > > FS:  0000000000000000(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
> > > > > CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > > > > CR2: ffffdc0000000000 CR3: 000000000bc8e000 CR4: 00000000003506f0
> > > > > DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> > > > > DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
> > > > > Call Trace:
> > > > >  <TASK>
> > > > >  strnlen include/linux/fortify-string.h:119 [inline]
> > > > >  copy_string_kernel+0x26/0x250 fs/exec.c:616
> > > > >  copy_strings_kernel+0xb3/0x190 fs/exec.c:655
> > > > >  kernel_execve+0x377/0x500 fs/exec.c:1998
> > > > >  call_usermodehelper_exec_async+0x2e3/0x580 kernel/umh.c:112
> > > > >  ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:306
> > > > >  </TASK>
> > [...]
> > > > > ---
> > > > > This report is generated by a bot. It may contain errors.
> > > > > See https://goo.gl/tpsmEJ for more information about syzbot.
> > > > > syzbot engineers can be reached at syzkaller@googlegroups.com.
> > > > > 
> > > > > syzbot will keep track of this issue. See:
> > > > > https://goo.gl/tpsmEJ#status for how to communicate with syzbot.
> 
> -- 
> Kees Cook