Received: by 2002:a05:6a10:1d13:0:0:0:0 with SMTP id pp19csp234235pxb; Sat, 21 Aug 2021 00:51:49 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwcji++9HuPDeU5aiv1egYlblCZX6CIgtroO1X3wuF78/mujb7HBCNh8AEKoq8IS1Q0LbZW X-Received: by 2002:a17:906:85d0:: with SMTP id i16mr25946964ejy.552.1629532309360; Sat, 21 Aug 2021 00:51:49 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1629532309; cv=none; d=google.com; s=arc-20160816; b=dKc7CvY6l+KkJhqfRi4JpuEvCuwlsxzay5EOvGRUaWTqE038/xtHXEq5STusrEv+eo stJd4OSMNO3WkuKtyNmsc0tGrT7K49hnnb0vPRC1pJKD1H/fND5ZUVzhDpu+L3MBaqQZ 5lKNZIcBzaxqcBEUOmlI4xgjvmp5ioSN2arkJPIOuy6LrkdRs2mIhwH0WouIASkqm4vL NVU9G067SfPvNtMYtKxN9qpUSipe/TsB65szjvwb4ADn/35GDMGGCCU7aWOViiU7Ucxx WRh+uV7C6Iu2FVaWE234/N5Ft2z2mVxl+HEXXXIilABAAbrF74CjEvkNN9qhnWdPTumY fLaQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=EeUhPgKQkrozlr2RNO/SOJCvPJI+D/541J+Hmw4ZTKo=; b=ynXYgXFBo81tFUMbpxlKGt5RAHqpFBECIhr946zdUZAAdBudHpi0lUMZdQDNewTVD5 t9wF+SGVId9JzqXyV3vBro3Ig7GPyxeavYcHNF1ZMEFjA49x1/cD5S+bSPWp0yUkjFj1 B7xu8DMnl2e4ACJyfaQ1jGM2+vUjuEl/aK95++4Jc3VSv6KAx3aiShsXgXCCaz7FVocM g/uPqOcPByKITW+Vx6TiLSU8WaXqRf/curTqcjql2Ne7ov4FtOzkUrisDmAdoBdBZ/J8 S+su4AN4oZcVq/p8gvsKM7zfMwflNku0pXXRtWwYlTv35fAJQeB8T++Mc9nSRenOGz2C 4wVA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=RsK1JN8q; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id w17si10483566ejb.398.2021.08.21.00.50.55; Sat, 21 Aug 2021 00:51:49 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=RsK1JN8q; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232195AbhHUHs5 (ORCPT + 99 others); Sat, 21 Aug 2021 03:48:57 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:44329 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232469AbhHUHsz (ORCPT ); Sat, 21 Aug 2021 03:48:55 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1629532095; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=EeUhPgKQkrozlr2RNO/SOJCvPJI+D/541J+Hmw4ZTKo=; b=RsK1JN8qV3MHiXzx8cBlYZMaIhw22Esm5/IZ7+c4+ctOFMjBy434Owzhk0KSfe3Fgffds3 YW0qRbx2XdvOfr+MF1pNUquZMHb5Oukyz5JT2In7qpW0YCiLKGiBBi/2oGp6F/PP2fjtZ9 cWdFOk3VmJTKnVfW0D4nCrjbzJNjUK0= Received: from mail-yb1-f197.google.com (mail-yb1-f197.google.com [209.85.219.197]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-589-w5uDMSSzOJOYJW4nmZaqYA-1; Sat, 21 Aug 2021 03:48:14 -0400 X-MC-Unique: w5uDMSSzOJOYJW4nmZaqYA-1 Received: by mail-yb1-f197.google.com with SMTP id b127-20020a25e485000000b005943f1efa05so11934246ybh.15 for ; Sat, 21 Aug 2021 00:48:14 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=EeUhPgKQkrozlr2RNO/SOJCvPJI+D/541J+Hmw4ZTKo=; b=jiBrVYKFZbNWZ4OLB5Y5eSn1q+2vgisxShr0WRTAgI0aDdOsnpBb5QjxwxYtxfrEKy xKC/vTsUXPmso7qrbQZAE8+J6LFfTGtW7y775/KpWV3o5X3HzATngpIB3jwJMancU6Qv KKia45BxoLDLT76Bb89HnAsDwqztZxsIqH6WTJdIJSOSiiLQFCkprr1sH5YsNP6FSyBn 6CdV1p+CoK6BEVVATXvX9WWco5SJpy3ZxHn/6/wogONSTzWS40ixqSc0OUBlvo4RFnS/ jwPAJKJbRMBCvHwCrBut4GG2AMaj0o0kfmbSRGwzAZimC0zV/8WhUoUtQYiTnq100MN/ GknQ== X-Gm-Message-State: AOAM531d+T4l0z3yh06ao3S+By97tXVyJl/65JxZKZxt2TX2NOP/Btqr Xduq6gRxOSiRWCD5OTPWSOdcWx6Lu3jmUZs1XjtxNzoc7Fo1XLfUHHVd6mJQV+VfSIbix9Yn2tm 7os8dgcAXGVcovYlkzRY4VtcHcg6NDUQHvmnFR6e/ X-Received: by 2002:a25:4d1:: with SMTP id 200mr30174281ybe.438.1629532093731; Sat, 21 Aug 2021 00:48:13 -0700 (PDT) X-Received: by 2002:a25:4d1:: with SMTP id 200mr30174264ybe.438.1629532093498; Sat, 21 Aug 2021 00:48:13 -0700 (PDT) MIME-Version: 1.0 References: <00000000000072e53a05c983ab22@google.com> <20210816091041.3313-1-hdanton@sina.com> <20210816093336.GA3950@lst.de> <20210819090510.GA12194@lst.de> <20210819135308.GB3395@lst.de> In-Reply-To: <20210819135308.GB3395@lst.de> From: Yi Zhang Date: Sat, 21 Aug 2021 15:48:01 +0800 Message-ID: Subject: Re: [syzbot] general protection fault in wb_timer_fn To: Christoph Hellwig Cc: Sven Schnelle , Hillf Danton , syzbot , Jens Axboe , linux-block , linux-kernel@vger.kernel.org, syzkaller-bugs@googlegroups.com Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Aug 19, 2021 at 9:53 PM Christoph Hellwig wrote: > > On Thu, Aug 19, 2021 at 03:10:37PM +0200, Sven Schnelle wrote: > > Christoph Hellwig writes: > > > > > On Thu, Aug 19, 2021 at 11:03:42AM +0200, Sven Schnelle wrote: > > >> I'm seeing a similar crash in our CI: > > > > > > This series: > > > > > > https://lore.kernel.org/linux-block/20210816131910.615153-1-hch@lst.de/T/#t > > > > > > should fi it. Can you give it a spin? > > > > I tested it without your patchset and it crashed around every second > > try. With that patchset, i wasn't able to reproduce it. > > Can you send a Tested-by: for the last patch which should fix this? > Hi Christoph I also met similar issue with blktests, I tried to apply the patchset but with no luck to apply them, any suggestions to fix it. [ 2464.154898] run blktests nvme/012 at 2021-08-20 21:20:29 [ 2464.192252] loop0: detected capacity change from 0 to 2097152 [ 2464.309275] nvmet: adding nsid 1 to subsystem blktests-subsystem-1 [ 2464.396464] nvmet: creating controller 1 for subsystem blktests-subsystem-1 for NQN nqn.2014-08.org.nvmexpress:uuid:a43453b4c0df4cb7bd2303f547ca0f22. [ 2464.410162] nvme nvme0: creating 128 I/O queues. [ 2464.425839] nvme nvme0: new ctrl: "blktests-subsystem-1" [ 2465.483434] XFS (nvme0n1): Mounting V5 Filesystem [ 2465.493142] XFS (nvme0n1): Ending clean mount [ 2465.498278] xfs filesystem being mounted at /mnt/blktests supports timestamps until 2038 (0x7fffffff) [ 2488.544383] XFS (nvme0n1): Unmounting Filesystem [ 2488.559652] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1" [ 2488.625086] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000308 [ 2488.633871] Mem abort info: [ 2488.636655] ESR = 0x96000004 [ 2488.639698] EC = 0x25: DABT (current EL), IL = 32 bits [ 2488.645000] SET = 0, FnV = 0 [ 2488.648044] EA = 0, S1PTW = 0 [ 2488.651173] FSC = 0x04: level 0 translation fault [ 2488.656039] Data abort info: [ 2488.658908] ISV = 0, ISS = 0x00000004 [ 2488.662732] CM = 0, WnR = 0 [ 2488.665689] user pgtable: 4k pages, 48-bit VAs, pgdp=00000008fd3a0000 [ 2488.672119] [0000000000000308] pgd=0000000000000000, p4d=0000000000000000 [ 2488.678903] Internal error: Oops: 96000004 [#1] SMP [ 2488.683770] Modules linked in: nvme_loop nvme_fabrics nvmet nvme_core loop dm_log_writes dm_flakey rfkill mlx5_ib ib_uverbs ib_core sunrpc coresight_etm4x i2c_smbus coresight_tpiu coresight_replicator coresight_tmc joydev mlx5_core mlxfw psample tls acpi_ipmi ipmi_ssif ipmi_devintf ipmi_msghandler coresight_funnel coresight thunderx2_pmu vfat fat fuse zram ip_tables xfs crct10dif_ce ast ghash_ce i2c_algo_bit drm_vram_helper drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops cec drm_ttm_helper ttm drm gpio_xlp i2c_xlp9xx uas usb_storage aes_neon_bs [last unloaded: nvme_core] [ 2488.735491] CPU: 41 PID: 0 Comm: swapper/41 Not tainted 5.14.0-rc5 #1 [ 2488.751647] pstate: 20400009 (nzCv daif +PAN -UAO -TCO BTYPE=--) [ 2488.757641] pc : latency_exceeded+0x30/0x304 [ 2488.761905] lr : wb_timer_fn+0x48/0x1fc [ 2488.765730] sp : ffff800012b83d00 [ 2488.769031] x29: ffff800012b83d00 x28: ffff800011dc7000 x27: ffff800012b83e80 [ 2488.776156] x26: ffff800011886000 x25: 00000000000000e0 x24: 0000000000000028 [ 2488.783280] x23: ffffffffffffffff x22: ffff0008097ac900 x21: ffff0008097ade80 [ 2488.790404] x20: 0000000000000000 x19: ffff00080adfb300 x18: 0000000000000000 [ 2488.797528] x17: ffff800f4ac9a000 x16: ffff800012b84000 x15: 0000000000004000 [ 2488.804652] x14: 0000000000000000 x13: 0000000000000038 x12: 0000000000000040 [ 2488.811776] x11: 0000000000036e09 x10: ffff0008097ade80 x9 : ffff80001073074c [ 2488.818901] x8 : fffffbffec7ec0b0 x7 : 000000000000003f x6 : 0000000000000000 [ 2488.826024] x5 : 0000000000000000 x4 : 0000000000000000 x3 : 0000000000000000 [ 2488.833148] x2 : 0000000000000000 x1 : ffff0008097ade80 x0 : 0000000000000000 [ 2488.840273] Call trace: [ 2488.842707] latency_exceeded+0x30/0x304 [ 2488.846618] wb_timer_fn+0x48/0x1fc [ 2488.850095] blk_stat_timer_fn+0x170/0x190 [ 2488.854183] call_timer_fn+0x3c/0x17c [ 2488.857835] __run_timers.part.0+0x290/0x330 [ 2488.862092] run_timer_softirq+0x48/0x80 [ 2488.866002] __do_softirq+0x128/0x380 [ 2488.869653] __irq_exit_rcu+0x154/0x160 [ 2488.873482] irq_exit+0x1c/0x30 [ 2488.876612] handle_domain_irq+0x70/0x9c [ 2488.880525] gic_handle_irq+0x58/0xd8 [ 2488.884174] call_on_irq_stack+0x2c/0x38 [ 2488.888086] do_interrupt_handler+0x5c/0x70 [ 2488.892257] el1_interrupt+0x30/0x50 [ 2488.895824] el1h_64_irq_handler+0x18/0x24 [ 2488.899908] el1h_64_irq+0x7c/0x80 [ 2488.903297] arch_cpu_idle+0x18/0x2c [ 2488.906861] default_idle_call+0x4c/0x160 [ 2488.910860] cpuidle_idle_call+0x14c/0x1a0 [ 2488.914947] do_idle+0xbc/0x110 [ 2488.918077] cpu_startup_entry+0x30/0x8c [ 2488.921988] secondary_start_kernel+0xec/0x110 [ 2488.926422] __secondary_switched+0x94/0x98 [ 2488.930596] Code: aa0103f5 f9403000 f9401674 f9404800 (f9418400) [ 2488.936789] ---[ end trace 8d092c5fdd268b3c ]--- [ 2488.941394] Kernel panic - not syncing: Oops: Fatal exception in interrupt [ 2488.948283] SMP: stopping secondary CPUs [ 2488.952240] Kernel Offset: disabled [ 2488.955715] CPU features: 0x00600051,a3200840 [ 2488.960059] Memory Limit: none [ 2488.963125] ---[ end Kernel panic - not syncing: Oops: Fatal exception in interrupt ]--- -- Best Regards, Yi Zhang