Received: by 2002:a05:6358:1087:b0:cb:c9d3:cd90 with SMTP id j7csp2562143rwi; Fri, 21 Oct 2022 05:27:17 -0700 (PDT) X-Google-Smtp-Source: AMsMyM71xTpVOo5GwJEMf1E9JwbtEz0NuJ2L4bcTM8rIcyP/InTU+QS2cDPF7YSTSPqznkPJru0+ X-Received: by 2002:a17:907:2d2c:b0:78d:d289:7efd with SMTP id gs44-20020a1709072d2c00b0078dd2897efdmr15274211ejc.166.1666355226438; Fri, 21 Oct 2022 05:27:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1666355226; cv=none; d=google.com; s=arc-20160816; b=RonsFLQn2vf0wv2CqD5boppdviegKVH1puMIc1zwTedGKeiTxE0Rl1jrKl+5vin5w/ EBkQdxFyGthIXvLt1poIoP+LcjC9oK2ayIAx/JcWVpAwmPEfDGDGAQCnR6W0sTWFJqS/ z/x3zhPllKMkONaQjyImQkbOxPqClgLGrNPfCHCq4aS4y/R+09nzLCCspywC88MtxdMa cthK4QbyjBC81L+2R6X60Cufw0WRM+IFYwjIzCZdLED1V1gwm7+rJhS48s5Ds0tdWgbt zhKIXf8UXCGzen847Vg/3rMnGeo++q61bE+JHp/eNsHl8tvKJSi+GAUqzuUjuEjWI+PG YShA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=z4zs9DcE+EGj5FW34Ff1HzR3Ff8P/pBL+yrwgJmUEeQ=; b=RlNLOYFxS1ydtJpe9qM274qyIYfM9iCQgAy8wxU2gSjcn9lZcb12tGNaeN5s0bVzx5 Ym02vgXJqf8+gnQI9JVdvQDsG0sc+4T9bZd0Sb8SNcy5qnDIVyCwrcbQW+f8KfW1++rn jkXwcRsngcsTmsHLB3buOpP8sBiLhQYhosKU3gmLXM3r7MGN/lnbwkd+HmsexHE44RQ8 MasMYvmZziRUYvi72aP7LeMfCjkXnbbNMqZAMcu7BJZFhiKncKEeCwjteW+FJ36sq1uI owIBWmdLiaL51ngYur/BmVJwNpq4RTA8e/LDn0Bbh3/rgukmUn6pX20mhMXAssUHED4Z QKJg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=DyxA9kVg; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id o19-20020a170906975300b00787b0b0a96esi12780235ejy.131.2022.10.21.05.26.41; Fri, 21 Oct 2022 05:27:06 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=DyxA9kVg; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229876AbiJUMTr (ORCPT + 99 others); Fri, 21 Oct 2022 08:19:47 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42882 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229652AbiJUMTm (ORCPT ); Fri, 21 Oct 2022 08:19:42 -0400 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 2A3EB2654B for ; Fri, 21 Oct 2022 05:19:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1666354779; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=z4zs9DcE+EGj5FW34Ff1HzR3Ff8P/pBL+yrwgJmUEeQ=; b=DyxA9kVggiJdM9FkE76Gw7nTaxAJe6wCbJVjia/k9trA9QrLgYT22jx+FGdOUqMtZH43ar ILs7D0SvVr7t7X7iN98Q17D7pW9qEvKVOD49wZtnYOJ28qoLJB1QIuWZ5a749BUHmuktfT kPuIhYHw/L8mMf3K44rQhSmM47701M4= Received: from mail-qv1-f69.google.com (mail-qv1-f69.google.com [209.85.219.69]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_128_GCM_SHA256) id us-mta-62-7-kK2cBxMl-XauEFAvadKg-1; Fri, 21 Oct 2022 08:19:38 -0400 X-MC-Unique: 7-kK2cBxMl-XauEFAvadKg-1 Received: by mail-qv1-f69.google.com with SMTP id kr13-20020a0562142b8d00b004b1d5953a2cso2232348qvb.3 for ; Fri, 21 Oct 2022 05:19:38 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=z4zs9DcE+EGj5FW34Ff1HzR3Ff8P/pBL+yrwgJmUEeQ=; b=zZaJAMosPGrqOgq7EtPiSmysSfxln1ZbWqU0Gv2q9Kjwa9aKC8wmdMElr67R9jPyVW rTWLfOfx0LGrOxFF0wfl27G2Y37qdklmjSyOJ9DV0MuSybiRFNhCcbGsFjwjcV/6kfpD lv3fEOK46K9dKiNa0OU3VtueUpgL5RUvHVnNJqxQMxVqXB7Q4KRWmZOj/xgyglidpAir scileRAc8bpy+wV3X7FBZcddFJJ78OR+FiEb1DWtRRZBWq+TQ4PGWKLDU01/wOGhuzbT 5LyW5i9OEkuIzQbCrONMQN45+LieBmwgUvTBjMu/uxiZH5NIw5xLKsDRjKAdsJfB6rev haSw== X-Gm-Message-State: ACrzQf1Rx9tcyHJ0SqO8IoA2DxNOsVNRo2pG0mafq3mzqoDI39bHhkso dhYSvhTRqgscdJ9owWIVUNvIFlOs2PklJYyAY/tGisgcvDq6e+RVspg9xKmkSasRgrXSNlMqpoD CIKie8uS+1aRmaSBkXfQOuC5t X-Received: by 2002:a05:6214:629:b0:4b1:bfde:b8f3 with SMTP id a9-20020a056214062900b004b1bfdeb8f3mr15577315qvx.116.1666354777755; Fri, 21 Oct 2022 05:19:37 -0700 (PDT) X-Received: by 2002:a05:6214:629:b0:4b1:bfde:b8f3 with SMTP id a9-20020a056214062900b004b1bfdeb8f3mr15577292qvx.116.1666354777512; Fri, 21 Oct 2022 05:19:37 -0700 (PDT) Received: from vschneid.remote.csb ([149.71.65.94]) by smtp.gmail.com with ESMTPSA id i9-20020ac85c09000000b0039a610a04b1sm8043410qti.37.2022.10.21.05.19.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 21 Oct 2022 05:19:36 -0700 (PDT) From: Valentin Schneider To: netdev@vger.kernel.org, linux-rdma@vger.kernel.org, linux-kernel@vger.kernel.org Cc: Saeed Mahameed , Leon Romanovsky , "David S. Miller" , Eric Dumazet , Jakub Kicinski , Paolo Abeni , Yury Norov , Andy Shevchenko , Rasmus Villemoes , Ingo Molnar , Peter Zijlstra , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Mel Gorman , Greg Kroah-Hartman , Heiko Carstens , Tony Luck , Jonathan Cameron , Gal Pressman , Tariq Toukan , Jesse Brandeburg Subject: [PATCH v5 0/3] sched, net: NUMA-aware CPU spreading interface Date: Fri, 21 Oct 2022 13:19:24 +0100 Message-Id: <20221021121927.2893692-1-vschneid@redhat.com> X-Mailer: git-send-email 2.31.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-2.3 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi folks, Tariq pointed out in [1] that drivers allocating IRQ vectors would benefit from having smarter NUMA-awareness (cpumask_local_spread() doesn't quite cut it). The proposed interface involved an array of CPUs and a temporary cpumask, and being my difficult self what I'm proposing here is an interface that doesn't require any temporary storage other than some stack variables (at the cost of one wild macro). [1]: https://lore.kernel.org/all/20220728191203.4055-1-tariqt@nvidia.com/ Revisions ========= v4 -> v5 ++++++++ o Rebased onto 6.1-rc1 o Ditched the CPU iterator, moved to a cpumask iterator (Yury) v3 -> v4 ++++++++ o Rebased on top of Yury's bitmap-for-next o Added Tariq's mlx5e patch o Made sched_numa_hop_mask() return cpu_online_mask for the NUMA_NO_NODE && hops=0 case v2 -> v3 ++++++++ o Added for_each_cpu_and() and for_each_cpu_andnot() tests (Yury) o New patches to fix issues raised by running the above o New patch to use for_each_cpu_andnot() in sched/core.c (Yury) v1 -> v2 ++++++++ o Split _find_next_bit() @invert into @invert1 and @invert2 (Yury) o Rebase onto v6.0-rc1 Cheers, Valentin Tariq Toukan (1): net/mlx5e: Improve remote NUMA preferences used for the IRQ affinity hints Valentin Schneider (2): sched/topology: Introduce sched_numa_hop_mask() sched/topology: Introduce for_each_numa_hop_mask() drivers/net/ethernet/mellanox/mlx5/core/eq.c | 18 +++++++++-- include/linux/topology.h | 32 ++++++++++++++++++++ kernel/sched/topology.c | 31 +++++++++++++++++++ 3 files changed, 79 insertions(+), 2 deletions(-) -- 2.31.1