Received: by 2002:ac0:da4c:0:0:0:0:0 with SMTP id a12csp2035275imi; Sun, 24 Jul 2022 05:21:21 -0700 (PDT) X-Google-Smtp-Source: AGRyM1u4gP2TLjbrLPl4heRjbwyQ4COGKH+9HMQJS23lAg4iAY8nzZa4FgklTHRMWauTz8/9XnzZ X-Received: by 2002:a63:60d:0:b0:41a:d6cb:33dd with SMTP id 13-20020a63060d000000b0041ad6cb33ddmr4193259pgg.496.1658665280843; Sun, 24 Jul 2022 05:21:20 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1658665280; cv=none; d=google.com; s=arc-20160816; b=kOR6iZdGYmSBpLbF5W6kEJ3lVCLSLxnZ18OCuRpQn7csWZPBJZ692cYxqQhg9HvvzU +JBwHtZ9DxysY0ZtnohoP0JWagKF2f0+weFVRb/bDRYv1qbrvJj4PvunDQ74xhG1vYIe 197nog83m7SBwTJkmxv7Bx6NbTnKJvca8k3wWjzBe2xJM/RuJ9H7zF3fKpLsXqPJh5MU lc9ijoqakZMMc67hGbB0kYFaB15PnLmEoIjEo1BXABvUQuOzu2IzY+XuXbW7uD6PrYOi 0FVflMdGF4a569OooNa7JtXTA3GvApIC1tKJmF4iEp7nYluroVsLbNOcvm2aTrll0b0b zhCQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:from :references:cc:to:content-language:subject:user-agent:mime-version :date:message-id:dkim-signature; bh=TuaZlSjI8Gr3uFZtjKix4F/O72z/L1CxsKBvamkDb9g=; b=UN7E7dMqNwzNWvpemFab1/eZoeAgjN1QiFLW9AEflnwQOTGq/MZ3CqgKsfHzsaSpFV JHJwi+k8/dr2sac1pr6qG2foVLC1hgh5gjjcACxFKWsilzIam8Co58ET6Gh8BG+wFzJA F41R0ZokxO0y3yuiBsHjyO0SY83x6I4w1TsbdE+510VJMQ2If+sEyQf5wuhrFrHUWaQ9 dmJIHEFjn04SGF0UCiV9JT+E3cx3/mjj5cKop1/WjnKMJsKFf6dAvF2UvxQL1DlcXEhp 2gD79gPDGTYPrixISCkb+umiNifvwdcBWNTs9JeG6an1AUJV+mGM9gYxTXbQnp5n5wbo 6DQw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=CIczQQVH; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id s18-20020a056a00195200b0050d80e4935fsi12792165pfk.256.2022.07.24.05.20.57; Sun, 24 Jul 2022 05:21:20 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=CIczQQVH; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231318AbiGXMJT (ORCPT + 99 others); Sun, 24 Jul 2022 08:09:19 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34272 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229450AbiGXMJR (ORCPT ); Sun, 24 Jul 2022 08:09:17 -0400 Received: from mail-wm1-x331.google.com (mail-wm1-x331.google.com [IPv6:2a00:1450:4864:20::331]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 360AC175B1; Sun, 24 Jul 2022 05:09:16 -0700 (PDT) Received: by mail-wm1-x331.google.com with SMTP id u14-20020a05600c00ce00b003a323062569so4825085wmm.4; Sun, 24 Jul 2022 05:09:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=message-id:date:mime-version:user-agent:subject:content-language:to :cc:references:from:in-reply-to:content-transfer-encoding; bh=TuaZlSjI8Gr3uFZtjKix4F/O72z/L1CxsKBvamkDb9g=; b=CIczQQVHcpEMDUwb1mJxLsQHu5bxF1+/HtkEgx98+M5WdLQDNxUccwaY44QO0VZHkl oDe8+ugM9HUAdQ8vdSgfMAijNDqKQScCoQMGJb+UYylC8v482tzvLHlm421BeqTdREeu ViDLkDKh0fNpEqQDDjBMR4tHyvWVC5Q5YCVSnAx+fNki/tvMmxU8tut0vvWAwpfHiesi vx/p4IUwPN0dwiuOcI4n3NCzCqnJzra+JAM9EPAcwmxT7gHZF9mzfYu8rpssZQIYr9pF 3QnNMCnG3qap0FvpW7MgniWsUrzAS7T3JMOqkMesuv+fK5l1cZBPNf5TCKVQ6TiayHJU BEWg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent:subject :content-language:to:cc:references:from:in-reply-to :content-transfer-encoding; bh=TuaZlSjI8Gr3uFZtjKix4F/O72z/L1CxsKBvamkDb9g=; b=sdAMGrFmkDUzYJy5t22xJB51HB/mdSxtkE6PB/BudMsvSQwLPf9UTBhMWndBQCOwdI 6fq/MzcUJBjX+p2kFjWP77FnCdRGBjTd20Wz1uat9Iq/Usta8TfDShISgN54xgCEjojJ HgFIDNRvs3g8SmnKRfD8sEXH9R26+jfKSmPrEYwN6Wd1fg0hmzz3u7FHiit6frkKcZ25 D8SMXheUOPPuQqSTneN30ol8K/bq1gMB/6wLiwZuTUNGi3apiSLKtGWPGXPUPw/um8Iz Zv6UyF7iq1KB/3o7Vxlxv+Xxe8vIcJmRG6lWPs3S53S8JIdcj+AWGTk8qdlCAN+j6Hlr lL2A== X-Gm-Message-State: AJIora/FSsfzrseKr9pW1heZCBrVggcaEhvPvIKbu5AN7zdPqo/5jvh6 LH4l06moNpuep8hevGLkmXM= X-Received: by 2002:a05:600c:3582:b0:3a3:3b00:cb25 with SMTP id p2-20020a05600c358200b003a33b00cb25mr5374622wmq.170.1658664554661; Sun, 24 Jul 2022 05:09:14 -0700 (PDT) Received: from [192.168.0.104] ([77.126.166.31]) by smtp.gmail.com with ESMTPSA id n186-20020a1ca4c3000000b003a32438c518sm14509967wme.6.2022.07.24.05.09.12 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 24 Jul 2022 05:09:14 -0700 (PDT) Message-ID: <09038324-65ed-8529-2f6c-671a15a8fb84@gmail.com> Date: Sun, 24 Jul 2022 15:09:11 +0300 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.11.0 Subject: Re: [PATCH net-next V3 0/3] Introduce and use NUMA distance metrics Content-Language: en-US To: Tariq Toukan , "David S. Miller" , Saeed Mahameed , Jakub Kicinski , Ingo Molnar , Peter Zijlstra , Juri Lelli Cc: Eric Dumazet , Paolo Abeni , netdev@vger.kernel.org, Gal Pressman , Vincent Guittot , linux-kernel@vger.kernel.org References: <20220719162339.23865-1-tariqt@nvidia.com> From: Tariq Toukan In-Reply-To: <20220719162339.23865-1-tariqt@nvidia.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM,NICE_REPLY_A, RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 7/19/2022 7:23 PM, Tariq Toukan wrote: > Hi, > > Implement and expose CPU spread API based on the scheduler's > sched_numa_find_closest(). Use it in mlx5 and enic device drivers. This > replaces the binary NUMA preference (local / remote) with an improved one > that minds the actual distances, so that remote NUMAs with short distance > are preferred over farther ones. > > This has significant performance implications when using NUMA-aware > memory allocations, improving the throughput and CPU utilization. > > Regards, > Tariq > > v3: > - Introduce the logic as a common API instead of being mlx5 specific. > - Add implementation to enic device driver. > - Use non-atomic version of __cpumask_clear_cpu. > Comments on V2 were addressed. Please let me now of any other comments on this V3.