Received: by 2002:a05:6a10:1287:0:0:0:0 with SMTP id d7csp2900692pxv; Sun, 18 Jul 2021 05:01:59 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxyE6f5eJgoPGpffY41bR0N0oYANSpEo/7Fd/eNiKSbxLnauIL3aSsliSOiZ9HIQKpxTmjS X-Received: by 2002:a6b:e009:: with SMTP id z9mr4890845iog.56.1626609719456; Sun, 18 Jul 2021 05:01:59 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1626609719; cv=none; d=google.com; s=arc-20160816; b=Pt7KZ7kfuI91gIIoRkla2wQPwoAHFlJdPScMRwCEqkczVhxyhW1rAGyQYXgXQANpjG lO3hpXMbiqlfuMaInU053WNo97NVmHrVOssr6gpC/guHOCyJvuhWL9wl1Pz1RYS7d9QF nf14Hlsjm3MQfA2dIuwzGEwXPRNCiU1Zfc+PvRlDnlruF+xHVpIeogXdaCcc9MIRcmpw HZOUwsQMlqBXs9v+Z2FBT8X5vGtftCPnfCqGgwPgT7OOn6AJv8sizlxgcVNwO5flZhZT /ZguefPRnQz4PX1vhK4/OfVZxNbjzG5QT0a3CF36m1IhIcG9KBiM9cIT5qzEXOdwlZ1D bwGw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=zJsaL07rkhBQ9vrmg1w3/H7QTig+e72N3vRro8m6ulU=; b=qjRBsWHF2Oq8PTs45AvHOMaYr5LFf9avMxqtr3OidD22KoQQCSVQS8d/1L3TcM8Ctu cXb3GVw9hCVWam4OaENgZnGcziUvj1/q45duLrm7I1+AYV0094uZd4gjEMsVTVJFYvg+ rxGK22ZYSf2WnmbrIqYkZDcAj29J/5GnBZ2tNTfXqbVb0C24eczf083TP+UXSC8yh2qh 9rKst1SFkIqQNt3swpk3G/H9rpZf5W3KG6OIh7nFhj0+LkExvJNqTL1cDJSmZ5DEz4vt ZpOFNaEgbfsw1XmuzSn2CCCab6JLOmPHSSmFHBvV5ayqZpI6ATTpl2/DWXIIB8piCsCl 4alA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=DRSLBE4n; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id j3si12709503ilu.69.2021.07.18.05.01.46; Sun, 18 Jul 2021 05:01:59 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=DRSLBE4n; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233039AbhGRMED (ORCPT + 99 others); Sun, 18 Jul 2021 08:04:03 -0400 Received: from mail.kernel.org ([198.145.29.99]:43640 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232685AbhGRMEC (ORCPT ); Sun, 18 Jul 2021 08:04:02 -0400 Received: by mail.kernel.org (Postfix) with ESMTPSA id D1D1F6108B; Sun, 18 Jul 2021 12:01:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1626609664; bh=/spI8vZJgOx7Hs/83Yoh38VeyXJQKdnrhpEDBIKz6po=; h=From:To:Cc:Subject:Date:From; b=DRSLBE4n25jljqBDXpb1gcTVJ8DsbHAQG/jS9pP4qjiZXPSYGpT93xOuVLIdCNRL1 sy66tLe6TgEr03s5ih8zXvBb15hlaKA216RZoeGNR1nLL6AzsSo27mvgX6ABORbQN5 YgSqAxfgE3SX/NYYG1DXmbKnLm2S7xUfctDIaI6IZHE6Xmdm0mpCuYTvx+pDFZs+32 86uckcWXWj81BQ5I9NCL9ydYK8cX8YxbtoIKWsWtGcfljjdbDFdKhg0gaR5k2kIvbn iPZmG3cr3GJDDZjYkvrpRPTBmx605WhZjXrqa7+fDRaeMMuQq91eEaXnEtkmwpRlDu ALZBvugkArycg== From: Leon Romanovsky To: Doug Ledford , Jason Gunthorpe Cc: Leon Romanovsky , Adit Ranadive , Ariel Elior , Bernard Metzler , Christian Benvenuti , Dennis Dalessandro , Gal Pressman , linux-kernel@vger.kernel.org, linux-rdma@vger.kernel.org, Michal Kalderon , Mike Marciniszyn , Mustafa Ismail , Naresh Kumar PBS , Nelson Escobar , Potnuri Bharat Teja , Selvin Xavier , Shiraz Saleem , Steve Wise , VMware PV-Drivers , Weihang Li , Wenpeng Liang , Yishai Hadas , Zhu Yanjun Subject: [PATCH rdma-next 0/9] QP allocation changes Date: Sun, 18 Jul 2021 15:00:50 +0300 Message-Id: X-Mailer: git-send-email 2.31.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Leon Romanovsky Hi, This series convert IB/core to use core allocation scheme for the QP objects. @Dennis, rdmavt is slightly changed from the previous variant and preserves the node-aware allocation now. @hns, please double check the changes in your driver, the mlx4 driver clearly showed me that XRC flow needs serious rethinking. Thanks Leon Romanovsky (9): RDMA/hns: Don't skip IB creation flow for regular RC QP RDMA/hns: Don't overwrite supplied QP attributes RDMA/efa: Remove double QP type assignment RDMA/mlx5: Cancel pkey work before destroying device resources RDMA/mlx5: Delete device resource mutex that didn't protect anything RDMA/mlx5: Rework custom driver QP type creation RDMA/rdmavt: Decouple QP and SGE lists allocations RDMA: Globally allocate and release QP memory RDMA/mlx5: Drop in-driver verbs object creations drivers/infiniband/core/core_priv.h | 27 +++- drivers/infiniband/core/device.c | 2 + drivers/infiniband/core/restrack.c | 2 +- drivers/infiniband/core/verbs.c | 47 +++--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 26 ++-- drivers/infiniband/hw/bnxt_re/ib_verbs.h | 7 +- drivers/infiniband/hw/bnxt_re/main.c | 1 + drivers/infiniband/hw/cxgb4/iw_cxgb4.h | 5 +- drivers/infiniband/hw/cxgb4/provider.c | 1 + drivers/infiniband/hw/cxgb4/qp.c | 37 ++--- drivers/infiniband/hw/efa/efa.h | 5 +- drivers/infiniband/hw/efa/efa_main.c | 1 + drivers/infiniband/hw/efa/efa_verbs.c | 29 ++-- drivers/infiniband/hw/hns/hns_roce_device.h | 5 +- drivers/infiniband/hw/hns/hns_roce_hw_v1.c | 6 +- drivers/infiniband/hw/hns/hns_roce_main.c | 1 + drivers/infiniband/hw/hns/hns_roce_qp.c | 34 ++--- drivers/infiniband/hw/irdma/utils.c | 3 - drivers/infiniband/hw/irdma/verbs.c | 31 ++-- drivers/infiniband/hw/mlx4/main.c | 1 + drivers/infiniband/hw/mlx4/mlx4_ib.h | 5 +- drivers/infiniband/hw/mlx4/qp.c | 25 ++-- drivers/infiniband/hw/mlx5/gsi.c | 51 ++----- drivers/infiniband/hw/mlx5/main.c | 135 ++++++------------ drivers/infiniband/hw/mlx5/mlx5_ib.h | 7 +- drivers/infiniband/hw/mlx5/qp.c | 62 +++----- drivers/infiniband/hw/mthca/mthca_provider.c | 77 ++++------ drivers/infiniband/hw/ocrdma/ocrdma_main.c | 1 + drivers/infiniband/hw/ocrdma/ocrdma_verbs.c | 25 ++-- drivers/infiniband/hw/ocrdma/ocrdma_verbs.h | 5 +- drivers/infiniband/hw/qedr/main.c | 1 + drivers/infiniband/hw/qedr/qedr_roce_cm.c | 13 +- drivers/infiniband/hw/qedr/qedr_roce_cm.h | 5 +- drivers/infiniband/hw/qedr/verbs.c | 49 ++----- drivers/infiniband/hw/qedr/verbs.h | 4 +- drivers/infiniband/hw/usnic/usnic_ib_main.c | 1 + drivers/infiniband/hw/usnic/usnic_ib_qp_grp.c | 34 ++--- drivers/infiniband/hw/usnic/usnic_ib_qp_grp.h | 10 +- drivers/infiniband/hw/usnic/usnic_ib_verbs.c | 69 +++++---- drivers/infiniband/hw/usnic/usnic_ib_verbs.h | 5 +- .../infiniband/hw/vmw_pvrdma/pvrdma_main.c | 1 + drivers/infiniband/hw/vmw_pvrdma/pvrdma_qp.c | 53 +++---- .../infiniband/hw/vmw_pvrdma/pvrdma_verbs.h | 5 +- drivers/infiniband/sw/rdmavt/qp.c | 102 ++++++------- drivers/infiniband/sw/rdmavt/qp.h | 5 +- drivers/infiniband/sw/rdmavt/vt.c | 9 ++ drivers/infiniband/sw/rxe/rxe_pool.c | 2 +- drivers/infiniband/sw/rxe/rxe_verbs.c | 48 +++---- drivers/infiniband/sw/rxe/rxe_verbs.h | 2 +- drivers/infiniband/sw/siw/siw_main.c | 1 + drivers/infiniband/sw/siw/siw_qp.c | 2 - drivers/infiniband/sw/siw/siw_verbs.c | 54 +++---- drivers/infiniband/sw/siw/siw_verbs.h | 5 +- include/rdma/ib_verbs.h | 30 +++- include/rdma/rdmavt_qp.h | 2 +- 55 files changed, 480 insertions(+), 696 deletions(-) -- 2.31.1