Received: by 2002:a05:6a10:9afc:0:0:0:0 with SMTP id t28csp2435625pxm; Fri, 25 Feb 2022 01:46:05 -0800 (PST) X-Google-Smtp-Source: ABdhPJyjOkGmzvGAIMK9GXqUpIO0x3yeB/ozn70mSE1Tzsmiqp8DUJrjOTJmXYFnBxAKUuYTuJbA X-Received: by 2002:aa7:da51:0:b0:410:84fd:613a with SMTP id w17-20020aa7da51000000b0041084fd613amr6249862eds.390.1645782365028; Fri, 25 Feb 2022 01:46:05 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1645782365; cv=none; d=google.com; s=arc-20160816; b=hD8+dYxjZc9FSpKQUXOL/I0cRMsgZEWThEEOWJdI6w1N9GOddDqq5d2KYMjkvvQmtT 1v85RcG43Tw6J/tQrZysR+twlZXRE9GcLoGhc/5pBRFNB+IaERFVPKu6ptI5iXlwUWX8 4f00zel6ZyseZhe4/2pY31LQkBEYVVvsGN1+eBfcr7E/1sGoK/eXi7kbG/fny0g2Otke SHW45xQ4ecmy1OiX1ewSKTa7V54qCQVy7UrScsBucTVJ0qXSzSscxOs+ClO1OZp0Cc34 hycQWZ/jCVRvkJf/hm8FglUiybdqNq32KyPRH8k1appwDEfDUwTn+kb0lS0wTba2ARWt 1uTQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:subject :from:references:cc:to:content-language:user-agent:mime-version:date :message-id:dkim-signature; bh=ik2dVfnAes5t/5cfOboWObGlj9A+ov4VN6s4NcZ4k6s=; b=jelIQAGZN+KI/KCxjaPitbvBiWKvYzf9zkuEaPvaOYCorgQOIvOxyx7YwBd5jvTJgO h0MOMQt5lVUsoqwPrLvnmQGcNJdXp8XTdQL+Iui/9lbR2wfkUHlTB8pi8VtCJQFwKT/n H9piOL6w/3XvPPTn89rsM3ae08ht7utocmFxDUwV49Tb8fb9c9SKRn2DGD16PwOIHsG3 g7rGn7ufv2zuMc8SFipHBGCzzNb7CrgtVlYMbqMXAsJGcOtKlHdlAaIK+5qsnTDgpS9k 55K/3MEQot0vfwpxnEdXiUk2FectrgJmoeiySu9xm89lAALijjWsNcVBEs4hz78RadRT POYQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=e2JYhnOh; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id nd12-20020a170907628c00b006b763b95b7dsi1461889ejc.79.2022.02.25.01.45.39; Fri, 25 Feb 2022 01:46:05 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=e2JYhnOh; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236161AbiBYAuX (ORCPT + 99 others); Thu, 24 Feb 2022 19:50:23 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:38628 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S235626AbiBYAuS (ORCPT ); Thu, 24 Feb 2022 19:50:18 -0500 Received: from mga03.intel.com (mga03.intel.com [134.134.136.65]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 65E7B2556CE for ; Thu, 24 Feb 2022 16:49:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1645750188; x=1677286188; h=message-id:date:mime-version:to:cc:references:from: subject:in-reply-to:content-transfer-encoding; bh=EgGx5qIAw7Tb4rEPAO2/54qSHMC2QYlZA6qYHpBBk3k=; b=e2JYhnOhiPDcNHDigfycZN8n7kNekkgvnLObf2BZ1CKEDdXqNAWA+Z3o 4VX1ng/FvgblEs2rqsCCEAdIzLRN7jMlAWNScB9ovifBev120/i3ZP7mc HdOwndPdxi01aMTWBZwKmt982LMZhDJCaGQDrS62hruD4DSKMj/G34uxn zctXNVGFRfO5b5n3frd4StaDxDsiUTolX0HE6HM08dDzSA60oobCK4mXp bakK4/2T1dTVjmPwdu3bTmSKVkVuR+0VX9BXijC79W+P3o8C/ab+O2ALY 5zdi4koo8qYDw5GKGE/8ahvKmkmd5lhdIJs9GEQkdngSwDDmP9dxwP8vK A==; X-IronPort-AV: E=McAfee;i="6200,9189,10268"; a="252307394" X-IronPort-AV: E=Sophos;i="5.90,134,1643702400"; d="scan'208";a="252307394" Received: from orsmga004.jf.intel.com ([10.7.209.38]) by orsmga103.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 24 Feb 2022 16:49:48 -0800 X-IronPort-AV: E=Sophos;i="5.90,134,1643702400"; d="scan'208";a="639938510" Received: from hthen-mobl2.amr.corp.intel.com (HELO [10.209.48.194]) ([10.209.48.194]) by orsmga004-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 24 Feb 2022 16:49:47 -0800 Message-ID: <4d3c777e-20bd-b1f2-12ba-6af9d08cca45@intel.com> Date: Thu, 24 Feb 2022 16:49:43 -0800 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Content-Language: en-US To: Abhishek Goel , Dave Hansen Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, Zi Yan , David Hildenbrand , Yang Shi , Huang Ying , Andrew Morton References: <20210721063926.3024591-1-ying.huang@intel.com> <20210721063926.3024591-2-ying.huang@intel.com> <4e8067e1-0574-c9d2-9d6c-d676d32071bd@linux.vnet.ibm.com> From: Dave Hansen Subject: Re: [PATCH -V11 2/9] mm/migrate: update node demotion order on hotplug events In-Reply-To: <4e8067e1-0574-c9d2-9d6c-d676d32071bd@linux.vnet.ibm.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A, RCVD_IN_DNSWL_MED,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2/24/22 15:37, Abhishek Goel wrote: > > On 24/02/22 05:35, Dave Hansen wrote: >> On 2/23/22 15:02, Abhishek Goel wrote: >>> If needed, I will provide experiment results and traces that were used >>> to conclude this. >> It would be great if you can provide some more info.  Even just a CPU >> time profile would be helpful. > > Average total time taken for SMT=8 to SMT=1 in v5.14 : 20s > > Average total time taken for SMT=8 to SMT=1 in v5.15 : 36s > > (Observed in system with 150+ CPUs ) I was kinda thinking of: perf record / perf report output. Not wall clock time. We need to know what the kernel is doing during those extra 16 seconds.