Received: by 2002:a05:6358:9144:b0:117:f937:c515 with SMTP id r4csp508388rwr; Wed, 26 Apr 2023 02:25:59 -0700 (PDT) X-Google-Smtp-Source: AKy350aW8F57XHfG8NUjGpqQ0yHXDG1wlTfNmYE9gplhUKLl+ATqT5Z4mCR5/DMTlvf+QfeV3frp X-Received: by 2002:a17:90a:31c8:b0:240:d093:7274 with SMTP id j8-20020a17090a31c800b00240d0937274mr20316508pjf.14.1682501159601; Wed, 26 Apr 2023 02:25:59 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1682501159; cv=none; d=google.com; s=arc-20160816; b=ZcXPP+UN6xn5e/ufrcpsGIUnbFvyan8WGU+IHFeOrvpx2aOze5K/rgI+YPLzfx6FSi fFGAC8z0FA2ZkO/BsgPTpykjjypevtNmUXhOnnF6uB7l/wQ225DwrUyCkRo7v+SL2fVL yRNWGsjUUM4Wwk0Y62L1RlHqSLR5YyIGuJoAdZAzrjlc8ONWQMsQ3u2iBTPUIGod0WGL ckyXi7FYML2lAUYmNWRaBgKDSsVtcrGf8cU53+Dh05CXEgmDICelB3FqFUMFrzpFm9Qx dzg40t3usncK4hQ23fImfBHiFxejgfaOdWTl2PuoTfn1VZfdO6WTl1amnZIBzQrTL/Gi GZyA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:dkim-signature; bh=hb1p3qZAdlHU1l6iLXytZzmouo7Dtxmm/TUeo1IcTKg=; b=NW2SGjnF0qbMMLkYGd/b48F8+hYG32hva+ENiUi3jTegni+/tb0gtljMFkrKQxS31e heZafKFoul/gBIjOaMUnQaoRTudiWLjOjvp9BlN+t1Oy4v0FnY79W3+vS/TA8MCp90Ub SsG4rdMkLTAXgt/ABgvKvdYGsiRgNkk3i6pChf2CjfV4U9Bns+xicRd6FsflFohQ6hLT Rq1POK5OceyCIIGm8DPr5noAzAEmFmj+x7UZ9/JAFCkCAS2R+Y4Fq3v+EGmasceSzRI1 hbADo6AmxtdXrfJdiAxTLdS/b0yxsY0j0ZBHKzaetWQz95+oHgsw8DRcvsRsi/9rcaP3 PygQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=Lxc3P81e; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id mt16-20020a17090b231000b0023d53736026si15734804pjb.125.2023.04.26.02.25.48; Wed, 26 Apr 2023 02:25:59 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=Lxc3P81e; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S240233AbjDZJUk (ORCPT + 99 others); Wed, 26 Apr 2023 05:20:40 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:43450 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S240253AbjDZJTm (ORCPT ); Wed, 26 Apr 2023 05:19:42 -0400 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C302DE9 for ; Wed, 26 Apr 2023 02:18:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1682500637; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=hb1p3qZAdlHU1l6iLXytZzmouo7Dtxmm/TUeo1IcTKg=; b=Lxc3P81e82oYm64+dua7XbyM0l28CMF9QApg69pbfMfW620209soE3IMZ+vN2fsgyS6cMi Nm9+EPEY9oRtfidzW/FN5o5IiJMtxlDRxhDYErjCxdbOAmRtCfs+gBv3Ksf29iVigyHaAD zauIwGOhRXPVYsjz86OioHWzDSzcwFU= Received: from mail-wm1-f72.google.com (mail-wm1-f72.google.com [209.85.128.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-643-79dgo1xEPIyYAk4qsEktSw-1; Wed, 26 Apr 2023 05:17:15 -0400 X-MC-Unique: 79dgo1xEPIyYAk4qsEktSw-1 Received: by mail-wm1-f72.google.com with SMTP id 5b1f17b1804b1-3f171d38db3so39801415e9.0 for ; Wed, 26 Apr 2023 02:17:15 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682500635; x=1685092635; h=mime-version:message-id:date:references:in-reply-to:subject:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=hb1p3qZAdlHU1l6iLXytZzmouo7Dtxmm/TUeo1IcTKg=; b=iZin3jfMbz2RwuVwys3WBtgTjre8ofwa40GeG+AJe7XEq5KMn1v9wIzSIOiSTvnCme NuHl5sawZM8ZtsBXdjeCwc8n88A78+Nl5y9lDOJiigoV08Fsr+xirLjcEVBjHxsPrNz2 rXq8t7/W6bP+votTQ/KTA/kYYBzalwPZZBHVRlfMGYp7sgptuFSLPRuy1rE2r4ZqM4bX 0bxnU7YcPtHaftiWsBd1tSQY7c4d17j/ZhFA+m7rHjRB+XgNMamjUYlKgZm6zpV+ugp7 04UBxD6X3qqDMVXx4jV5EVzPMr8jj1D2i3rimU7L7hV8In/ZD0U31lHbR+SaW3g31r+e pBqA== X-Gm-Message-State: AAQBX9fP2GaTD4cEUB1OhBXwhj8QAs6Yto1hD952H6W/3lmjo6v7ZEO5 cG8jPSCVkmLFFH0t/QIbBzJTgwj+zhBut9VV9lL8ZaT/VpxB64lFP0xq5KVvg85sLumWB26MCV1 7so6hAWRwbufWiVklOI9cs8Dg X-Received: by 2002:a05:600c:d6:b0:3f1:75b0:dc47 with SMTP id u22-20020a05600c00d600b003f175b0dc47mr13169975wmm.15.1682500634753; Wed, 26 Apr 2023 02:17:14 -0700 (PDT) X-Received: by 2002:a05:600c:d6:b0:3f1:75b0:dc47 with SMTP id u22-20020a05600c00d600b003f175b0dc47mr13169945wmm.15.1682500634432; Wed, 26 Apr 2023 02:17:14 -0700 (PDT) Received: from vschneid.remote.csb ([154.57.232.159]) by smtp.gmail.com with ESMTPSA id l20-20020a05600c16d400b003f19bca8f03sm10736304wmn.43.2023.04.26.02.17.13 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 26 Apr 2023 02:17:13 -0700 (PDT) From: Valentin Schneider To: Yury Norov Cc: Jakub Kicinski , netdev@vger.kernel.org, linux-rdma@vger.kernel.org, linux-kernel@vger.kernel.org, Saeed Mahameed , Pawel Chmielewski , Leon Romanovsky , "David S. Miller" , Eric Dumazet , Paolo Abeni , Andy Shevchenko , Rasmus Villemoes , Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Daniel Bristot de Oliveira , Tariq Toukan , Gal Pressman , Greg Kroah-Hartman , Heiko Carstens , Barry Song Subject: Re: [PATCH v2 2/8] sched/topology: introduce sched_numa_find_next_cpu() In-Reply-To: References: <20230420051946.7463-1-yury.norov@gmail.com> <20230420051946.7463-3-yury.norov@gmail.com> Date: Wed, 26 Apr 2023 10:17:12 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain X-Spam-Status: No, score=-2.3 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 25/04/23 22:26, Yury Norov wrote: > On Tue, Apr 25, 2023 at 10:54:56AM +0100, Valentin Schneider wrote: >> On 19/04/23 22:19, Yury Norov wrote: >> > +/* >> > + * sched_numa_find_next_cpu() - given the NUMA topology, find the next cpu >> > + * cpumask: cpumask to find a cpu from >> > + * cpu: current cpu >> > + * node: local node >> > + * hop: (in/out) indicates distance order of current CPU to a local node >> > + * >> > + * The function searches for next cpu at a given NUMA distance, indicated >> > + * by hop, and if nothing found, tries to find CPUs at a greater distance, >> > + * starting from the beginning. >> > + * >> > + * Return: cpu, or >= nr_cpu_ids when nothing found. >> > + */ >> > +int sched_numa_find_next_cpu(const struct cpumask *cpus, int cpu, int node, unsigned int *hop) >> > +{ >> > + unsigned long *cur, *prev; >> > + struct cpumask ***masks; >> > + unsigned int ret; >> > + >> > + if (*hop >= sched_domains_numa_levels) >> > + return nr_cpu_ids; >> > + >> > + masks = rcu_dereference(sched_domains_numa_masks); >> > + cur = cpumask_bits(masks[*hop][node]); >> > + if (*hop == 0) >> > + ret = find_next_and_bit(cpumask_bits(cpus), cur, nr_cpu_ids, cpu); >> > + else { >> > + prev = cpumask_bits(masks[*hop - 1][node]); >> > + ret = find_next_and_andnot_bit(cpumask_bits(cpus), cur, prev, nr_cpu_ids, cpu); >> > + } >> > + >> > + if (ret < nr_cpu_ids) >> > + return ret; >> > + >> > + *hop += 1; >> > + return sched_numa_find_next_cpu(cpus, 0, node, hop); >> >> sched_domains_numa_levels is a fairly small number, so the recursion depth >> isn't something we really need to worry about - still, the iterative >> variant of this is fairly straightforward to get to: > > This is a tail recursion. Compiler normally converts it into the loop just > as well. At least, my GCC does. I'd hope so in 2023! I still prefer the iterative approach as I find it more readable, but I'm not /too/ strongly attached to it.