Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
MIME-Version: 1.0
References: <CA+QYu4rPbfH-4wNR06Vn=31RCGKFFEB-KRskn52Jtig_UugYzg@mail.gmail.com>
 <Yu0TdPm3CUT6gq/J@FVFF77S0Q05N>
In-Reply-To: <Yu0TdPm3CUT6gq/J@FVFF77S0Q05N>
From:   Bruno Goncalves <bgoncalv@redhat.com>
Date:   Fri, 5 Aug 2022 15:28:50 +0200
Message-ID: <CA+QYu4rVHTa29uhaC+yzYc=GKN7ZXxKUx0skvhwsyghxg81=Sg@mail.gmail.com>
Subject: Re: [5.19.0] [aarch64] WARNING: CPU: 0 PID: 1 at mm/page_alloc.c:5407 __alloc_pages+0x1a0/0x290
To:     Mark Rutland <mark.rutland@arm.com>
Cc:     linux-arm-kernel@lists.infradead.org,
        LKML <linux-kernel@vger.kernel.org>,
        CKI Project <cki-project@redhat.com>,
        Sudeep Holla <sudeep.holla@arm.com>
Content-Type: text/plain; charset="UTF-8"
Precedence: bulk

On Fri, 5 Aug 2022 at 14:57, Mark Rutland <mark.rutland@arm.com> wrote:
>
> On Fri, Aug 05, 2022 at 11:47:57AM +0200, Bruno Goncalves wrote:
> > Hello,
> >
> > Since commit "c1c76700a0d6" we started to hit the following call trace
> > on aarch64 VMs when looking at journalctl log
>
> For everyone else's benefit that's commit:
>
>   c1c76700a0d6 ("Merge tag 'spdx-6.0-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/spdx")
>
> Could you please include the commit title when citing a patch?

Thanks for the extra information.

>
> ... did you try to bisect this?

No, I didn't bisect it.

To add more context here I meant that c1c76700a0d6 ("Merge tag
'spdx-6.0-rc1' of
git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/spdx") is the
first commit that we tested that hit the problem.

The last commit that we tested without this problem is b44f2fd87919
("Merge tag 'drm-next-2022-08-03' of
git://anongit.freedesktop.org/drm/drm")
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=b44f2fd87919b5ae6e1756d4c7ba2cbba22238e1

>
> > kernel: Mountpoint-cache hash table entries: 16384 (order: 5, 131072
> > bytes, linear)
> > kernel: ACPI PPTT: No PPTT table found, CPU and cache topology may be inaccurate
> > kernel: ------------[ cut here ]------------
> > kernel: WARNING: CPU: 0 PID: 1 at mm/page_alloc.c:5407 __alloc_pages+0x1a0/0x290
>
> IIUC that's:
>
>   WARN_ON_ONCE_GFP(order >= MAX_ORDER, gfp)
>
> ... and IIUC that's fixed by commit:
>
>   11969d698f8cda31 ("cacheinfo: Use atomic allocation for percpu cache attributes")

I believe this commit is already included in the tree.

We've also reproduced it using latest commit "b2a88c212e65" ("Merge
tag 'xfs-5.20-merge-6' of
git://git.kernel.org/pub/scm/fs/xfs/xfs-linux")
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=b2a88c212e652e94f1e4b635910972ac57ba4e97

Thanks,
Bruno

> Thanks,
> Mark.
>
> > kernel: Modules linked in:
> > kernel: CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.19.0 #1
> > kernel: pstate: 20400005 (nzCv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
> > kernel: pc : __alloc_pages+0x1a0/0x290
> > kernel: lr : alloc_page_interleave+0x24/0xbc
> > kernel: sp : ffff80000803bb90
> > kernel: x29: ffff80000803bb90 x28: 0000000000000000 x27: 0000000000000000
> > kernel: x26: 0000000000000000 x25: 0000000000000000 x24: 0000000000000000
> > kernel: x23: 000000000000001e x22: 0000000000000000 x21: 000000000000001e
> > kernel: x20: 000000000000001e x19: 0000000000040b20 x18: 0000000000000014
> > kernel: x17: 6e69206562207961 x16: 6d2079676f6c6f70 x15: 6f74206568636163
> > kernel: x14: 20646e6120555043 x13: 6574617275636361 x12: 6e69206562207961
> > kernel: x11: 6d2079676f6c6f70 x10: 6f74206568636163 x9 : ffffa4f6617fd5e8
> > kernel: x8 : ffffa4f663ed0440 x7 : 0000000000000007 x6 : 0000000000000000
> > kernel: x5 : 0000000000000000 x4 : 0000000000000001 x3 : 0000000000000000
> > kernel: x2 : 0000000000000000 x1 : 0000000000000000 x0 : ffffa4f663c53532
> > kernel: Call trace:
> > kernel:  __alloc_pages+0x1a0/0x290
> > kernel:  alloc_page_interleave+0x24/0xbc
> > kernel:  alloc_pages+0x10c/0x16c
> > kernel:  kmalloc_order+0x3c/0xc0
> > kernel:  kmalloc_order_trace+0x38/0x130
> > kernel:  __kmalloc+0x2e8/0x350
> > kernel:  detect_cache_attributes+0x9c/0x110
> > kernel:  update_siblings_masks+0x34/0x270
> > kernel:  store_cpu_topology+0x7c/0xc0
> > kernel:  smp_prepare_cpus+0x34/0x108
> > kernel:  kernel_init_freeable+0x108/0x1b8
> > kernel:  kernel_init+0x30/0x150
> > kernel:  ret_from_fork+0x10/0x20
> > kernel: ---[ end trace 0000000000000000 ]---
> > kernel: Early cacheinfo failed, ret = -12
> > kernel: cblist_init_generic: Setting adjustable number of callback queues.
> > kernel: cblist_init_generic: Setting shift to 2 and lim to 1.
> >
> > test logs: https://datawarehouse.cki-project.org/kcidb/tests/4712644
> > cki issue tracker: https://datawarehouse.cki-project.org/issue/1485
> >
> > kernel config: https://s3.amazonaws.com/arr-cki-prod-trusted-artifacts/trusted-artifacts/605193135/build%20aarch64/2816138306/artifacts/kernel-mainline.kernel.org-redhat_605193135_aarch64.config
> > kernel build: https://s3.amazonaws.com/arr-cki-prod-trusted-artifacts/trusted-artifacts/605193135/publish%20aarch64/2816138315/artifacts/kernel-mainline.kernel.org-redhat_605193135_aarch64.tar.gz
> >
> > Thanks,
> > Bruno Goncalves
> >
>