Received: by 2002:a05:6358:701b:b0:131:369:b2a3 with SMTP id 27csp1473449rwo; Sat, 22 Jul 2023 14:31:52 -0700 (PDT) X-Google-Smtp-Source: APBJJlEqLcUH/D3EdshbdC7+gwDIykhVGCk69Ox+BMA+tKA4knhsBOfEVYKPZ4V0HvoPeS/52N/N X-Received: by 2002:aa7:cd13:0:b0:522:2711:863 with SMTP id b19-20020aa7cd13000000b0052227110863mr277901edw.1.1690061511966; Sat, 22 Jul 2023 14:31:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1690061511; cv=none; d=google.com; s=arc-20160816; b=0NuZcXTtfmR1durf5paGqxY/3XZGF3d1kyYz2CFoE40O9gFvOVdCFZvGjQ/bxNK2nJ haCzFwCEveXalENybwaLtk9048hm8okn6cm37W/8joSb6ds6d9uHi5Oy7etPO6l2pXLu MP3WnQWeYnoucXxyHHGMVfira5zGyJHU6KGfbS468fIYqoCZzLFehFjTFda48TT+u0Y/ uWwPAK9eD0cvOYjQ/szvXcWGqYQiUAeUd5CCRuL14ADR3QyTfeOckS2kgDLv/yqZHVEO LaRPxsqdbe01iw36PwzzgPe9ToEw39PjoAwaTHgCzCO2yxeHMXdxPROT4JKESLpgDPoH Q+5w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=0ixQhs2X4vjX3pi+8gNVGbrpZnMGa0J5cq/4REUBQks=; fh=zu2+R1XxcFHYsHEnWxVeP9D2b4xmxOubugUbsc6Dlqo=; b=e0NuKCjnIFdajQ51LwBjEZAFdgSmcObWOQjP3ysXcEMQQtrLMzkO+ZNgKE+YTsXCnp p+3HdYBJLonu2SNM5H+a6w4l5hIVuaNfkm0wSzcBIYQKSsmzBd9fw7yEXDlWidziMDzm +aa9BcQCCxB1HAxqHTz4DidOpeLwmabKuQMwQ/mJwh9k5xtuwHGWfwi1j9ozcYVxR8TI yd6Dg0/cFfolQgSdTZ0yQjNxIrI4VbJYD2wCVzCz+R+QgLuU9RKYzGJdlPIvYiH/ZW49 n8kf31DESrfiRgOd3+tDQhyAdI3tm28nlNO2pd2uoaRfp2VMBCF0C+d6uleuaRQEpV7G wZUQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=XeLTy1KD; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id l7-20020aa7c307000000b0051e7235b2e8si4121723edq.542.2023.07.22.14.31.28; Sat, 22 Jul 2023 14:31:51 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=XeLTy1KD; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229883AbjGVUVV (ORCPT + 99 others); Sat, 22 Jul 2023 16:21:21 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37438 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229491AbjGVUVU (ORCPT ); Sat, 22 Jul 2023 16:21:20 -0400 Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 01E82E53; Sat, 22 Jul 2023 13:21:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1690057280; x=1721593280; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=w3wkQwxgDff1pIzMxFu0mHCGE5IrK6AXlVJ/ZMqnjZA=; b=XeLTy1KDeyONeLg3Hr5XZs2/pNSE2RmABfZJPBLJJJQQ9IdXZ8H0hpK+ GvCzJRSFiw3pTsW2rsCbjDW2P7/t4Z6ovTS4Y01e1rs0RIN/bqX85FWv2 ItzTr9d7UxCjN4EU3r5ZzTri2EpouKcy/4w/PG6RdA82DuJnJ+W4liaWj JO9oUsZKSYS8htJ7wjopnHbELad5mLN6o1m7NQOrFB8Xk0+PBMw0ibhFw f9qVSBWoPGMy6rQFOSJOpZ9Rtz4mvGyD4ligYnYpdUksR5DkouJewRHBJ HGPSELDdAwRLPIxxvM9JEuT8VjpRmVLpXpv2IyA8KYUhFGcKbD7s5C5Y7 A==; X-IronPort-AV: E=McAfee;i="6600,9927,10779"; a="453599899" X-IronPort-AV: E=Sophos;i="6.01,224,1684825200"; d="scan'208";a="453599899" Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by fmsmga105.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 22 Jul 2023 13:21:19 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10779"; a="815378869" X-IronPort-AV: E=Sophos;i="6.01,224,1684825200"; d="scan'208";a="815378869" Received: from agluck-desk3.sc.intel.com (HELO agluck-desk3) ([172.25.222.74]) by fmsmga003-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 22 Jul 2023 13:21:19 -0700 Date: Sat, 22 Jul 2023 13:21:18 -0700 From: Tony Luck To: "Shaopeng Tan (Fujitsu)" Cc: Fenghua Yu , Reinette Chatre , Peter Newman , Jonathan Corbet , Shuah Khan , "x86@kernel.org" , James Morse , Jamie Iles , Babu Moger , Randy Dunlap , "linux-kernel@vger.kernel.org" , "linux-doc@vger.kernel.org" , "patches@lists.linux.dev" Subject: Re: [PATCH v3 0/8] x86/resctrl: Add support for Sub-NUMA cluster (SNC) systems Message-ID: References: <20230713163207.219710-1-tony.luck@intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF, RCVD_IN_DNSWL_BLOCKED,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE, URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Jul 19, 2023 at 02:43:20AM +0000, Shaopeng Tan (Fujitsu) wrote: > Hi tony, > > I ran selftest/resctrl in my environment, > the test result is "not ok". > > Processer in my environment: > Intel(R) Xeon(R) Gold 6254 CPU @ 3.10GHz > > kernel: > $ uname -r > 6.5.0-rc1+ > > Result : > Sub-NUMA enable: > xxx@xxx:~/linux_v6.5_rc1l$ sudo make -C tools/testing/selftests/resctrl run_tests > make: Entering directory '/.../tools/testing/selftests/resctrl' I see most tests pass. Just one fail on my most recent run with the v4 patch series: # # Fail: Check MBA diff within 5% for schemata 10 # # avg_diff_per: 7% # # avg_bw_imc: 883 # # avg_bw_resc: 815 # # Fail: Check schemata change using MBA But just missed the 5% target by a small amount, not the near total failures that you see. I wonder if there is a cross-SNC node memory allocation issue. Can you try running the test bound to a CPU in one node: $ taskset -c 1 sudo make -C tools/testing/selftests/resctrl run_tests Try with different "-c" arguments to bind to different nodes. Do you see different results on differnt nodes? -Tony