Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Tue, 10 Jan 2023 21:53:55 +0800
From:   Oliver Sang <oliver.sang@intel.com>
To:     Vlastimil Babka <vbabka@suse.cz>
CC:     Hyeonggon Yoo <42.hyeyoo@gmail.com>, <oe-lkp@lists.linux.dev>,
        <lkp@intel.com>, Mike Rapoport <rppt@linux.ibm.com>,
        Christoph Lameter <cl@linux.com>,
        <linux-kernel@vger.kernel.org>, <linux-mm@kvack.org>,
        Matthew Wilcox <willy@infradead.org>
Subject: Re: [linus:master] [mm, slub] 0af8489b02:
 kernel_BUG_at_include/linux/mm.h
Message-ID: <Y71t89JMgtRoNHM/@xsang-OptiPlex-9020>
References: <202212312021.bc1efe86-oliver.sang@intel.com>
 <41276905-b8a5-76ae-8a17-a8ec6558e988@suse.cz>
 <Y7Qxucg5le7WOzr7@xsang-OptiPlex-9020>
 <Y7VBFLHY/PMbb4XS@hyeyoo>
 <Y7Yr3kEkDEd51xns@xsang-OptiPlex-9020>
 <3f7fa3b3-9623-5c4c-94b1-a41dea6eaaf2@suse.cz>
 <Y7weKyxIY+QFYq6j@xsang-OptiPlex-9020>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <Y7weKyxIY+QFYq6j@xsang-OptiPlex-9020>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?roJBT3RICc8DNZmNRHNcnWDYn1hYBp/Cosy6oTq/tV7a9XjC08tZLebrIbeD?=
 =?us-ascii?Q?wjqiAPX2opBMcWxmYQE1KVWYs07EJ1TWeLmc114mqR9Dj8Mz8l4KodR4qCCU?=
 =?us-ascii?Q?laD+8gVahgxm6kKHjA7sFa/K6/at7arECQch7fQWzZ1JXOcoy5fknl7PvXe4?=
 =?us-ascii?Q?OV8X9UUUSWBygTnUk2LgnGcSHTwOfEvo6N2vsRkkonkDI9VGgXNDMIc2knOs?=
 =?us-ascii?Q?lHpWtEz/NQSlRh7O5ibQZNvgSnpFwfzYaqqBC1UI/grOPuDO35CagOYfpit6?=
 =?us-ascii?Q?lhMcvvqEVczG32BzV0YrbIDDTxx0DUI2ueiDHDe8LhxpfcFFEzazLNzHBawj?=
 =?us-ascii?Q?wvefoChDrONenzVVZw7V5Z11Z9AiHdyN87ebpSi2aQ1oAPrkZ7P6oueeMoWE?=
 =?us-ascii?Q?819PMPQquaxB26xZKr+UvyhvOmB3AFuRhBH8SXq73WwN8Zw+w+XkDZDqqtjF?=
 =?us-ascii?Q?13CRBjoU9YUKq7qdYVy7ogszC8yxepCZP7l6RviXIDeJDbA//mT0tV1MF2UY?=
 =?us-ascii?Q?7J+YDaerGZPgTiGRwFt9ImR4Ifhflbnqayqt1r1DYxE4WjFtiza0Xt6CSWtL?=
 =?us-ascii?Q?PStL8t4nZjZbaP7E2EIV1aOgWKpeX9gk2jO50tLCI11T227ATkt7SJsuyWbh?=
 =?us-ascii?Q?GCtxftQ+AJNNiNch5cU1XJkO4Yr+8S2McyV5EGYUt+TYvzmkNrW6reATpN+c?=
 =?us-ascii?Q?5lpLONLng4P5/1y/uaNrhw/6L/e7cT1HQtEIw2Z+mfmoNF0YC3dlZbj61LS9?=
 =?us-ascii?Q?UTZXXhAm20TygbvrklvB4vhgQrE4mfcI6FRnlwTn6YXtnglbBW9cZ7D2yLmp?=
 =?us-ascii?Q?r1Q+IvNxiIAklT7HwYJ6w9HZwgIT5RDwcoHHB+EIN9XWEG4yA4PUuL2ds0t9?=
 =?us-ascii?Q?FKghaFKADJcFkBR8Jz2i+UqSudVK9hpBUZzn3Vk9YJ00D6VfPs12ZLxlo9Hk?=
 =?us-ascii?Q?gYZ59oqI8wlLKGyWE3Snq9rbylYaaEj4fOSZ0+W4E+W8x6fPRme1AmehhUtC?=
 =?us-ascii?Q?sJh6c+/LT5I1hC9VXvqJh1gJAUj5dvNAOv2FHHtQb4CUXrSj0NPmy8nyANSa?=
 =?us-ascii?Q?G7eUs7qe8+cH3wv0kJ1puoM2rUKU4u3sj7uuBjnWbU3vDs6gfEr8bIB9P+/D?=
 =?us-ascii?Q?di1xcK8kwx1z7lUZ8wm6d4NVL+0AkECs0o8bll1O+X9u/aYsGXA7mBKZsdsr?=
 =?us-ascii?Q?5xBQPxlK5LEKOrWg3ZIt2ggMcE6FLxnmV161hP/SxsDLZJADhKm6wnFqFTaS?=
 =?us-ascii?Q?kVJhb20LdiM4ganV13Q5qKA0TJgvPi8QzUjTAzFguZgtqSsyaDNvnvbGl85R?=
 =?us-ascii?Q?e0OzgahwlkNMDUo2BW52sMHZs+k5K1OamNt8FbUe1fEOFA0BorGAyNNkjDgr?=
 =?us-ascii?Q?Wx6X3p/e7RNnHKwaLIWIQNsgohp2ftN/DyBDVgqQmP/wXW+3kBtZX5ughika?=
 =?us-ascii?Q?KZC7JUr2PX3+P+yv1diOUlYzOFLPY8/Hp49adUrIT1C3bJg+BNJVCVJJDI4j?=
 =?us-ascii?Q?dj31kn9h9NewjW0S3bPO5ZFr992wpQHXTqnPhdBG+gd4zx5zKuGYLZjARDho?=
 =?us-ascii?Q?HCP6RruWluv+Hvy1CM/H/GjAa1RcgrdpDZagi+ZUjUEt94rf95ycaBzTNbBP?=
 =?us-ascii?Q?DA=3D=3D?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 12c060ea-edde-460b-31ae-08daf3122385
X-MS-Exchange-CrossTenant-AuthSource: PH8PR11MB6779.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Jan 2023 13:54:05.9113
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 3PRTgpDg2pUD8IPtT1lXlezwH4gOT6f7nWKLwYnp41FzRdOPMErAJ9CNXKoQojXjgFmIlkYLS+AjSXQbSgaP7Q==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR11MB5197
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,
        RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

hi all,

On Mon, Jan 09, 2023 at 10:01:15PM +0800, Oliver Sang wrote:
> 
> On Fri, Jan 06, 2023 at 11:13:15AM +0100, Vlastimil Babka wrote:
> 
> > And if the rate at the parent (has it increased thanks to the
> > DEBUG_PAGEALLOC?) is sufficient to bisect to the truly first bad commit. Thanks!
> 
> got it. Thanks for suggestion!
> 
> since 0af8489b02 is based on v6.1-rc2, we will test (both rectorture and boot)
> with same config upon v6.1-rc2 to see if it's really clean there.
> if so we will use dmesg.invalid_opcode:#[##] to trigger new bisect.
> 
> will keep you updated. Thanks

by more tests, we cannot make sure the v6.1-rc2 is clean, so we also checked
v6.1-rc1 and v6.0. from results, we have low confidence that we can make a
successful bisection based on them [1][2]. could you suggest?

a further information not sure if it's helpful, [1][2] are both i386 based.
we also tried to run boot tests on x86_64 upon commit 0af8489b02, whatever
with or without CONFIG_DEBUG_PAGEALLOC/CONFIG_DEBUG_PAGEALLOC_ENABLE_DEFAULT,
we never obseve similar issues (also run 999 times).


[1]
boot results:
=========================================================================================
compiler/kconfig/rootfs/sleep/tbox_group/testcase:
  gcc-11/i386-randconfig-a012-20221226+CONFIG_DEBUG_PAGEALLOC+CONFIG_DEBUG_PAGEALLOC_ENABLE_DEFAULT/debian-11.1-i386-20220923.cgz/1/vm-snb/boot

            v6.0                    v6.1-rc1                    v6.1-rc2 56d5a2b9ba85a390473e86b4fe4 0af8489b0216fa1dd83e264bef8
---------------- --------------------------- --------------------------- --------------------------- ---------------------------
       fail:runs  %reproduction    fail:runs  %reproduction    fail:runs  %reproduction    fail:runs  %reproduction    fail:runs
           |             |             |             |             |             |             |             |             |
           :999          0%           2:999          0%           1:999          1%          11:999         21%         208:999   dmesg.invalid_opcode:#[##]
           :999          0%            :999          0%            :999          0%           2:999          5%          51:999   dmesg.kernel_BUG_at_include/linux/mm.h
           :999          0%           1:999          0%            :999          0%           4:999          4%          40:999   dmesg.kernel_BUG_at_include/linux/page-flags.h
           :999          0%           1:999          0%           1:999          0%           4:999         11%         111:999   dmesg.kernel_BUG_at_lib/list_debug.c
           :999          0%            :999          0%            :999          0%            :999          0%           2:999   dmesg.kernel_BUG_at_mm/page_alloc.c
           :999          0%            :999          0%            :999          0%           1:999          0%           3:999   dmesg.kernel_BUG_at_mm/usercopy.c

[2]
rcutorture results:
=========================================================================================
compiler/kconfig/rootfs/runtime/tbox_group/test/testcase/torture_type:
  gcc-11/i386-randconfig-a012-20221226+CONFIG_DEBUG_PAGEALLOC+CONFIG_DEBUG_PAGEALLOC_ENABLE_DEFAULT/debian-11.1-i386-20220923.cgz/300s/vm-snb/default/rcutorture/tasks-tracing

            v6.0                    v6.1-rc1                    v6.1-rc2 56d5a2b9ba85a390473e86b4fe4 0af8489b0216fa1dd83e264bef8
---------------- --------------------------- --------------------------- --------------------------- ---------------------------
       fail:runs  %reproduction    fail:runs  %reproduction    fail:runs  %reproduction    fail:runs  %reproduction    fail:runs
           |             |             |             |             |             |             |             |             |
           :999          0%           3:999          0%            :999          1%           8:998         20%         200:999   dmesg.invalid_opcode:#[##]
           :999          0%            :999          0%            :999          0%            :998          5%          51:999   dmesg.kernel_BUG_at_include/linux/mm.h
           :999          0%            :999          0%            :999          0%           3:998          4%          42:999   dmesg.kernel_BUG_at_include/linux/page-flags.h
           :999          0%           3:999          0%            :999          0%           4:998         10%         102:999   dmesg.kernel_BUG_at_lib/list_debug.c
           :999          0%            :999          0%            :999          0%            :998          0%           2:999   dmesg.kernel_BUG_at_mm/page_alloc.c
           :999          0%            :999          0%            :999          0%           1:998          0%           3:999   dmesg.kernel_BUG_at_mm/usercopy.c

> 
> > 
> >