Received: by 2002:a05:7412:5112:b0:fa:6e18:a558 with SMTP id fm18csp465273rdb; Tue, 23 Jan 2024 05:19:28 -0800 (PST) X-Google-Smtp-Source: AGHT+IEuasvDujE1CRFX9u3jf4QXN6A9TsIFSZER/vrls2vhN9S0M1KGTH8rGdmZcCEGA+n/7MMm X-Received: by 2002:a05:600c:5682:b0:40e:51cf:ec50 with SMTP id jt2-20020a05600c568200b0040e51cfec50mr98558wmb.229.1706015967856; Tue, 23 Jan 2024 05:19:27 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1706015967; cv=pass; d=google.com; s=arc-20160816; b=avf5iUPDhNJ+hSXLlGYHfI+DEmor0ht+AG2wIumJaG4Tq9Z6X377dEF+w9Lei+NCDb dMl8ppyjt1LVx3Xyome7gpQVO3v5mKgrGK5pg2VhHi9v9ozn4UiAuxZBDF4hrDXlHeWk nKLpU5pnm6AGSlC1JQcAEDVB50JKRzOWTgtukQminz/qrMB2G97Fz+Pws0MUbFyJmAZd E/pWW4TszrP+oP8B4LRor8kWPrvZSQ9Ta66gjtFCf4cbdmA2Pfi8raaDNbjtmVxFBy5p Caxz/IznEKpKuawi9BoadKnSYx1OkyDkih/AocIEbPS56ZVXrAlrOpFYv9BpPOcVKN+v TrNw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=date:mime-version:list-unsubscribe:list-subscribe:list-id :precedence:references:subject:cc:to:from:dkim-signature :dkim-signature:message-id; bh=/3oc2ZLZMtT1GGSM+F50BJRwamFMmJoEtBLGA//oVEY=; fh=Te0fDPJ/sd+7p881M6fa/oF213lBbJvGdEFWr/TLqNA=; b=VXyUVjMjxdzRIKWTG0ClLYhvDB/81MROSf26tbrJVMnEy1lBQ21sPGtZKhwfn8YT9J Jvqd/A2UEEdRjWWQ88mK0Vae/wLAzifC2/wrXsWJxg4WYj2txEj+BwbA03utPxz6QuX3 0lzztuQdVrOtDT+sZtpGwS3MY/pLn+rMfQHO5vHxx547wB3WUuzKrpcPuBzymmLSb5+J quNJOh0w0xPpLtQgHjOrkHpoXA/MXeHNAXYojkrgQzRMtIndlljR/eSm/R870gqLxpiI rmZ/epsIJl8KyIqg601WFODuq7clYz/sJeFo06+HnqkA6O5bMX+9uy+Gegu+Hh61ahSC EbnA== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=LGCvFzQd; dkim=neutral (no key) header.i=@linutronix.de header.s=2020e; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-35354-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) smtp.mailfrom="linux-kernel+bounces-35354-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [2604:1380:4601:e00::3]) by mx.google.com with ESMTPS id q36-20020a05640224a400b0055c991abdd6si141759eda.116.2024.01.23.05.19.27 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 23 Jan 2024 05:19:27 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-35354-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) client-ip=2604:1380:4601:e00::3; Authentication-Results: mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=LGCvFzQd; dkim=neutral (no key) header.i=@linutronix.de header.s=2020e; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-35354-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) smtp.mailfrom="linux-kernel+bounces-35354-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 745751F2193D for ; Tue, 23 Jan 2024 13:19:27 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id A7F716351E; Tue, 23 Jan 2024 13:11:12 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="LGCvFzQd"; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="7yl43YI7" Received: from galois.linutronix.de (Galois.linutronix.de [193.142.43.55]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 1863B6341D for ; Tue, 23 Jan 2024 13:11:10 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=193.142.43.55 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706015471; cv=none; b=TB16r72hVdmTicb7TLe7zPycZcLalrqWAeYnRAFL3uKoHxeacaOmvBZ5Kt6XT1VFMs69LgWL0jZkogYT8mcSAuDv/e2Kqd/mewjHpQOB+Dy9b7IxzMEZsZWAlLs/1OW02lIMW06dFrrUbLR1m2zaQ9ybN/e+8yDTiSa8MTeg3ws= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706015471; c=relaxed/simple; bh=FUTIECry+bQ8RFAh9yFkdIi5+DkzHs3f3p6NIjEa5cs=; h=Message-ID:From:To:Cc:Subject:References:MIME-Version: Content-Type:Date; b=DLqZRyQ8i2SQRb0NVk2FG0IalVL0pw/mO4BCz8ENf0MDuBvKQEJQcdIYCRTnIC8JG9AB+vGr3DmqiK1fg6x2T5X+K/r3KTosNfT54FEUCBusY+Vfa3I/AwCnk5HaDxT5bEwz8ADVV51sK7Actds1tyKvp8s4yGLEJtuXYJ8x3wI= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de; spf=pass smtp.mailfrom=linutronix.de; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=LGCvFzQd; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=7yl43YI7; arc=none smtp.client-ip=193.142.43.55 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linutronix.de Message-ID: <20240118123649.174566214@linutronix.de> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1706015468; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: references:references; bh=/3oc2ZLZMtT1GGSM+F50BJRwamFMmJoEtBLGA//oVEY=; b=LGCvFzQdipix4lYAMkP64YXKblLZ0oE1+UmXNAMOr4NQjyA1/Ef5jqXmba3WkYuCOlXYB1 dUZ7lqIRF0Gua20ldNVYUo2Nm9b4bBipmWba3Y3ZVzNqmX9QvuZaA9BkxOama3ADlh7h2O fEFQZdHKGRw+rmYTlEXJVyPEj8P72VEmAnT/Cv7nIztGbQaGJTIb6xHBA64I9FJr8w+Kl7 n/MpnIacIX5b3u95wws6JWH7Ee8y+AmO7vFFjXNe0yBKSI1AiMI1Bkq4kfA+/TDfl+7LBe YKpn5xsXAaPLSPlPamvfZPj9VARaCNALKN9/PsHSGr6wA8sG5Vbs21knCgL9cA== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1706015468; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: references:references; bh=/3oc2ZLZMtT1GGSM+F50BJRwamFMmJoEtBLGA//oVEY=; b=7yl43YI79rGp6vymn3HGbqztV+AblmSSKw4IFL/BdnI0SgIWs46yXnSIZ5R+Z17GJIXbko q850XISawTCaB1Bw== From: Thomas Gleixner To: LKML Cc: x86@kernel.org, Tom Lendacky , Andrew Cooper , Arjan van de Ven , Huang Rui , Juergen Gross , Dimitri Sivanich , Sohil Mehta , K Prateek Nayak , Kan Liang , Zhang Rui , "Paul E. McKenney" , Feng Tang , Andy Shevchenko , Michael Kelley , "Peter Zijlstra (Intel)" Subject: [patch v2 11/30] x86/cpu/topology: Use a data structure for topology info References: <20240118123127.055361964@linutronix.de> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Date: Tue, 23 Jan 2024 14:11:07 +0100 (CET) From: Thomas Gleixner Put the processor accounting into a data structure, which will gain more topology related information in the next steps, and sanitize the accounting. Signed-off-by: Thomas Gleixner --- arch/x86/kernel/cpu/topology.c | 59 ++++++++++++++++++++--------------------- 1 file changed, 29 insertions(+), 30 deletions(-) --- --- a/arch/x86/kernel/cpu/topology.c +++ b/arch/x86/kernel/cpu/topology.c @@ -23,25 +23,24 @@ DECLARE_BITMAP(phys_cpu_present_map, MAX u32 cpuid_to_apicid[] __read_mostly = { [0 ... NR_CPUS - 1] = BAD_APICID, }; /* + * Keep track of assigned, disabled and rejected CPUs. Present assigned + * with 1 as CPU #0 is reserved for the boot CPU. + */ +static struct { + unsigned int nr_assigned_cpus; + unsigned int nr_disabled_cpus; + unsigned int nr_rejected_cpus; +} topo_info __read_mostly = { + .nr_assigned_cpus = 1, +}; + +/* * Processor to be disabled specified by kernel parameter * disable_cpu_apicid=, mostly used for the kdump 2nd kernel to * avoid undefined behaviour caused by sending INIT from AP to BSP. */ static u32 disabled_cpu_apicid __ro_after_init = BAD_APICID; -static unsigned int num_processors; -static unsigned int disabled_cpus; - -/* - * The number of allocated logical CPU IDs. Since logical CPU IDs are allocated - * contiguously, it equals to current allocated max logical CPU ID plus 1. - * All allocated CPU IDs should be in the [0, nr_logical_cpuids) range, - * so the maximum of nr_logical_cpuids is nr_cpu_ids. - * - * NOTE: Reserve 0 for BSP. - */ -static int nr_logical_cpuids = 1; - bool arch_match_cpu_phys_id(int cpu, u64 phys_id) { return phys_id == (u64)cpuid_to_apicid[cpu]; @@ -75,7 +74,7 @@ static int __init smp_init_primary_threa return 0; } - for (cpu = 0; cpu < nr_logical_cpuids; cpu++) + for (cpu = 0; cpu < topo_info.nr_assigned_cpus; cpu++) cpu_mark_primary_thread(cpu, cpuid_to_apicid[cpu]); return 0; } @@ -89,7 +88,7 @@ static int topo_lookup_cpuid(u32 apic_id int i; /* CPU# to APICID mapping is persistent once it is established */ - for (i = 0; i < nr_logical_cpuids; i++) { + for (i = 0; i < topo_info.nr_assigned_cpus; i++) { if (cpuid_to_apicid[i] == apic_id) return i; } @@ -107,22 +106,21 @@ static int allocate_logical_cpuid(u32 ap if (cpu >= 0) return cpu; - cpuid_to_apicid[nr_logical_cpuids] = apic_id; - return nr_logical_cpuids++; + return topo_info.nr_assigned_cpus++; } -static void cpu_update_apic(int cpu, u32 apicid) +static void cpu_update_apic(unsigned int cpu, u32 apic_id) { #if defined(CONFIG_SMP) || defined(CONFIG_X86_64) - early_per_cpu(x86_cpu_to_apicid, cpu) = apicid; + early_per_cpu(x86_cpu_to_apicid, cpu) = apic_id; #endif + cpuid_to_apicid[cpu] = apic_id; set_cpu_possible(cpu, true); - set_bit(apicid, phys_cpu_present_map); + set_bit(apic_id, phys_cpu_present_map); set_cpu_present(cpu, true); - num_processors++; if (system_state != SYSTEM_BOOTING) - cpu_mark_primary_thread(cpu, apicid); + cpu_mark_primary_thread(cpu, apic_id); } static int generic_processor_info(int apicid) @@ -137,18 +135,18 @@ static int generic_processor_info(int ap return 0; if (disabled_cpu_apicid == apicid) { - int thiscpu = num_processors + disabled_cpus; + int thiscpu = topo_info.nr_assigned_cpus + topo_info.nr_disabled_cpus; pr_warn("APIC: Disabling requested cpu. Processor %d/0x%x ignored.\n", thiscpu, apicid); - disabled_cpus++; + topo_info.nr_rejected_cpus++; return -ENODEV; } - if (num_processors >= nr_cpu_ids) { + if (topo_info.nr_assigned_cpus >= nr_cpu_ids) { pr_warn_once("APIC: CPU limit of %d reached. Ignoring further CPUs\n", nr_cpu_ids); - disabled_cpus++; + topo_info.nr_rejected_cpus++; return -ENOSPC; } @@ -178,14 +176,16 @@ static int __initdata setup_possible_cpu */ __init void prefill_possible_map(void) { + unsigned int num_processors = topo_info.nr_assigned_cpus; + unsigned int disabled_cpus = topo_info.nr_disabled_cpus; int i, possible; i = setup_max_cpus ?: 1; if (setup_possible_cpus == -1) { - possible = num_processors; + possible = topo_info.nr_assigned_cpus; #ifdef CONFIG_HOTPLUG_CPU if (setup_max_cpus) - possible += disabled_cpus; + possible += num_processors; #else if (possible > i) possible = i; @@ -238,7 +238,7 @@ void __init topology_register_apic(u32 a } if (!present) { - disabled_cpus++; + topo_info.nr_disabled_cpus++; return; } @@ -295,7 +295,6 @@ void topology_hotunplug_apic(unsigned in per_cpu(x86_cpu_to_apicid, cpu) = BAD_APICID; clear_bit(apic_id, phys_cpu_present_map); set_cpu_present(cpu, false); - num_processors--; } #endif