Received: by 2002:a05:6a10:206:0:0:0:0 with SMTP id 6csp1170293pxj; Fri, 21 May 2021 08:03:30 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyzajPvaNGZHf+G/pxy105FH40iLkdRxpj8Yg8YRcsMaIXuvaQdkYpXy7X/6R1ELWxBYWy3 X-Received: by 2002:a05:6402:1719:: with SMTP id y25mr11721914edu.304.1621609410451; Fri, 21 May 2021 08:03:30 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1621609410; cv=none; d=google.com; s=arc-20160816; b=qKsfi2v3AX/4iA1Kcpip9YpeTlPIXc0TTOm42aWFU6gRWwnZAIEf+2ssPrc3PiGvLE ABmy1i6O4JDMB0GrQQ49BqaYfPwt3ASknSY0hEpemcxdrp0zqaaT370jH6eTJgE5DQjG zYYe2O0gouWjfdE7NduGADFJprGq5cmWXVdMPcnef7Z378FOf/Mqq8i577+WH1Of8cEU WzC0/M10maqHyOckT1EgRd0B0Pthd4e6gT8suLU/INiEfhKSy1dEm4dt+qTSwoyXo15h 4+8amn2qUtW7nGqwFolaJVVPbumfDSHhmSL66BtIBYTquUpbNvWfIGPaR8NVT8ZOiT2I I52Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=pQGY4jNTts+73SN3k2bYuXF2IcfoCawtUPZI0Dx9pCg=; b=KGmE32vcFKm45ZnnFOQlwhvj66IXEGQ5KB12dD6Cxuv7aQV1sd0x2jcpUh4c4/HSCt qb0QfO6QitxYZ156mVAQitnsYgOkI6dAfsk2qDzq/YxpEHqGYe/n/+l1Gegn88x6A8TU Zvg/86eb6ZKPlZqN8UZGdXeAE/iRCdK2tOmu5kk9aJTzUl//C4E/4eYQpkE6Zmfi7a04 ho0FN4YsGw8sa/P7zi19L+dNBG6jk/lCvw/L0A/ZHnJfRCZvbXc8p20bYBEd2jxKC7yj iUWWAVw00Y6Qh7HceJEx5SiDireXz5efT8UW1Rw2ixXDNTyoVXLZpm1tnIaIPRPFN/3s c4EA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=ZfM3R+Jr; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id d4si5900700ejz.692.2021.05.21.08.03.06; Fri, 21 May 2021 08:03:30 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=ZfM3R+Jr; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=ibm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237448AbhETPqo (ORCPT + 99 others); Thu, 20 May 2021 11:46:44 -0400 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:34712 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S232881AbhETPqi (ORCPT ); Thu, 20 May 2021 11:46:38 -0400 Received: from pps.filterd (m0098416.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.43/8.16.0.43) with SMTP id 14KFY5hV043013; Thu, 20 May 2021 11:44:53 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding; s=pp1; bh=pQGY4jNTts+73SN3k2bYuXF2IcfoCawtUPZI0Dx9pCg=; b=ZfM3R+JrFcJOdpl3oP3lZEIlvRXy+BCdemIWLZWvRFT6ZWefZuDHga1VlOC2xaKhH6eL YbxlPC4RppKP4JsBPiOARHQGzPapVaqgSXolzF1sIwQPyRPYMvRVFpPW6GTMI5t5Teg5 TkNXQDDr4yfSgknbBzLVqVI2fo2WLKLIfKIIjbyYhIgEa5wuG00TcLsoxyzJ8Go+An3O fdbXQfqoMYYfLTQuk01bSBpWMuDwW+znl9PSf2/b/o0X/RQYtbb//VJrN+hDWiYxPwGw 5amcAv+lrogxm2YmAG0l2IRzMec11eru0lba3GJ+yyXfxcL5lq9qzg1efg+vi4rUb/fW xg== Received: from ppma06fra.de.ibm.com (48.49.7a9f.ip4.static.sl-reverse.com [159.122.73.72]) by mx0b-001b2d01.pphosted.com with ESMTP id 38nsh32ppn-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 20 May 2021 11:44:53 -0400 Received: from pps.filterd (ppma06fra.de.ibm.com [127.0.0.1]) by ppma06fra.de.ibm.com (8.16.0.43/8.16.0.43) with SMTP id 14KFa9b6030159; Thu, 20 May 2021 15:44:51 GMT Received: from b06cxnps4074.portsmouth.uk.ibm.com (d06relay11.portsmouth.uk.ibm.com [9.149.109.196]) by ppma06fra.de.ibm.com with ESMTP id 38j5jh1gvq-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 20 May 2021 15:44:51 +0000 Received: from d06av23.portsmouth.uk.ibm.com (d06av23.portsmouth.uk.ibm.com [9.149.105.59]) by b06cxnps4074.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 14KFimVt29098334 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 20 May 2021 15:44:48 GMT Received: from d06av23.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 4E2ADA4040; Thu, 20 May 2021 15:44:48 +0000 (GMT) Received: from d06av23.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 72D18A4053; Thu, 20 May 2021 15:44:45 +0000 (GMT) Received: from saptagiri.in.ibm.com (unknown [9.77.198.25]) by d06av23.portsmouth.uk.ibm.com (Postfix) with ESMTP; Thu, 20 May 2021 15:44:45 +0000 (GMT) From: Srikar Dronamraju To: Ingo Molnar , Peter Zijlstra Cc: LKML , Mel Gorman , Rik van Riel , Srikar Dronamraju , Thomas Gleixner , Valentin Schneider , Vincent Guittot , Dietmar Eggemann , linuxppc-dev@lists.ozlabs.org, Nathan Lynch , Michael Ellerman , Scott Cheloha , Gautham R Shenoy , Geetika Moolchandani Subject: [PATCH 3/3] sched/topology: Skip updating masks for non-online nodes Date: Thu, 20 May 2021 21:14:27 +0530 Message-Id: <20210520154427.1041031-4-srikar@linux.vnet.ibm.com> X-Mailer: git-send-email 2.26.3 In-Reply-To: <20210520154427.1041031-1-srikar@linux.vnet.ibm.com> References: <20210520154427.1041031-1-srikar@linux.vnet.ibm.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-TM-AS-GCONF: 00 X-Proofpoint-GUID: beR8I2y4bAIXHz4b5IfZsaQD4o1I6Gff X-Proofpoint-ORIG-GUID: beR8I2y4bAIXHz4b5IfZsaQD4o1I6Gff X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391,18.0.761 definitions=2021-05-20_04:2021-05-20,2021-05-20 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 clxscore=1015 mlxscore=0 suspectscore=0 mlxlogscore=999 phishscore=0 lowpriorityscore=0 bulkscore=0 impostorscore=0 malwarescore=0 spamscore=0 priorityscore=1501 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2104190000 definitions=main-2105200104 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Currently scheduler doesn't check if node is online before adding CPUs to the node mask. However on some architectures, node distance is only available for nodes that are online. Its not sure how much to rely on the node distance, when one of the nodes is offline. If said node distance is fake (since one of the nodes is offline) and the actual node distance is different, then the cpumask of such nodes when the nodes become becomes online will be wrong. This can cause topology_span_sane to throw up a warning message and the rest of the topology being not updated properly. Resolve this by skipping update of cpumask for nodes that are not online. Cc: LKML Cc: linuxppc-dev@lists.ozlabs.org Cc: Nathan Lynch Cc: Michael Ellerman Cc: Ingo Molnar Cc: Peter Zijlstra Cc: Valentin Schneider Cc: Scott Cheloha Cc: Gautham R Shenoy Cc: Dietmar Eggemann Cc: Mel Gorman Cc: Vincent Guittot Cc: Rik van Riel Cc: Geetika Moolchandani Reported-by: Geetika Moolchandani Signed-off-by: Srikar Dronamraju --- kernel/sched/topology.c | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/kernel/sched/topology.c b/kernel/sched/topology.c index ccb9aff59add..ba0555e83548 100644 --- a/kernel/sched/topology.c +++ b/kernel/sched/topology.c @@ -1731,6 +1731,9 @@ void sched_init_numa(void) sched_domains_numa_masks[i][j] = mask; for_each_node(k) { + if (!node_online(j)) + continue; + if (sched_debug() && (node_distance(j, k) != node_distance(k, j))) sched_numa_warn("Node-distance not symmetric"); @@ -1793,6 +1796,9 @@ void sched_domains_numa_masks_set(unsigned int cpu) for (i = 0; i < sched_domains_numa_levels; i++) { for (j = 0; j < nr_node_ids; j++) { + if (!node_online(j)) + continue; + if (node_distance(j, node) <= sched_domains_numa_distance[i]) cpumask_set_cpu(cpu, sched_domains_numa_masks[i][j]); } -- 2.27.0