Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp520875imu; Thu, 20 Dec 2018 00:31:02 -0800 (PST) X-Google-Smtp-Source: AFSGD/UL3nKG/+/oSO9akFghMllMrSXX7HoXnE20v9pKtXyxAdRGu9iwm5pzJengUoffQPHQFSXY X-Received: by 2002:a63:f412:: with SMTP id g18mr19225633pgi.262.1545294662763; Thu, 20 Dec 2018 00:31:02 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1545294662; cv=none; d=google.com; s=arc-20160816; b=D5eCOKnSo8IQezQVRbS7dFKPnv8pXg9nSiEzD3qLxK4iXFStEyiPFgslRUCAthrV8l US/r1+BPL8ULpc3Vox1a7UDJEiGqHNIY1zFDzhASZbzYn9RdBg/WPo95sEWzb6hVegdZ bWAD260USKLffa6KZD4+4x9fQenMAQM1J+x9BBS85sDoFjFf7SshDwuOqTgaxkKA+MdL GUHGX6RCfmX+nwAOdRwBqoHe4hTJoiCjCcah/BGCET9tv1zS5n2YYV4Mx6JG7sWdLFCr 2Uq5UXRoY2gjlgCwWxBfrmvM04C6vRn5GpKP5zIYHGL7UqpIgcT1UW46DXPYedO4xnYS AXYA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from; bh=EyD3gzvKGtGodCCgpGk621r1ldxrI/bDQ2GGJqOHKcM=; b=fmYWJnWLnDOPPA6l2o5rTL9SClU2aqykgxWDZoLxKfkPvkCPt5yTQK9I/UhgsWSVhU 8tfh+uc3152+W4ASOpc9kO1ktNdjqlJgixQ4GkqdIX0Kn4DDRvdB+Kpid9APMkTVvtfI sp1kZMCI4FPpKQnjztAF5uwbydVEOAp4RZnzJppxyPaDlpI25goRwAaQEFtHVjcf4b9n /BtsalxHZdqkixVjLM5v1o5J5y4UtbVZPu92IVoN1GjCedndjA0z5AR4mwH8Zr+iNiUA sPlp1OAGxSAViFTNdbP7xwclvXvyENvjXCUZtBKfZkgiTCENNNxeCynw4Tlbcq2RIaw2 C8fg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id y22si3409762pfa.6.2018.12.20.00.30.47; Thu, 20 Dec 2018 00:31:02 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730554AbeLTIX6 (ORCPT + 99 others); Thu, 20 Dec 2018 03:23:58 -0500 Received: from ozlabs.ru ([107.173.13.209]:53898 "EHLO ozlabs.ru" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727667AbeLTIX6 (ORCPT ); Thu, 20 Dec 2018 03:23:58 -0500 Received: from fstn1-p1.ozlabs.ibm.com (localhost [IPv6:::1]) by ozlabs.ru (Postfix) with ESMTP id 101C2AE8001E; Thu, 20 Dec 2018 03:23:53 -0500 (EST) From: Alexey Kardashevskiy To: linuxppc-dev@lists.ozlabs.org Cc: Alexey Kardashevskiy , David Gibson , kvm-ppc@vger.kernel.org, kvm@vger.kernel.org, Alistair Popple , Reza Arbab , Sam Bobroff , Piotr Jaroszynski , =?UTF-8?q?Leonardo=20Augusto=20Guimar=C3=A3es=20Garcia?= , Jose Ricardo Ziviani , Daniel Henrique Barboza , Alex Williamson , Paul Mackerras , linux-kernel@vger.kernel.org, Christoph Hellwig Subject: [PATCH kernel v7 00/20] powerpc/powernv/npu, vfio: NVIDIA V100 + P9 passthrough Date: Thu, 20 Dec 2018 19:23:30 +1100 Message-Id: <20181220082350.58113-1-aik@ozlabs.ru> X-Mailer: git-send-email 2.17.1 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org My bad, I was not cc-ing everyone but now with v7 I am, sorry about that. This is for passing through NVIDIA V100 GPUs on POWER9 systems. 20/20 has the details of hardware setup. This implements support for NVIDIA V100 GPU with coherent memory and NPU/ATS support available in the POWER9 CPU. The aim is to support unmodified vendor driver in the guest. This is pushed to (both guest and host kernels): https://github.com/aik/linux/tree/nv2 Matching qemu is pushed to github: https://github.com/aik/qemu/tree/nv2 Skiboot bits are here: https://github.com/aik/skiboot/tree/nv2 The individual patches have changelogs. v7 fixes compile warning and updates a VFIO capability comment in 20/20. Please comment. Thanks. Alexey Kardashevskiy (20): powerpc/ioda/npu: Call skiboot's hot reset hook when disabling NPU2 powerpc/mm/iommu/vfio_spapr_tce: Change mm_iommu_get to reference a region powerpc/vfio/iommu/kvm: Do not pin device memory powerpc/powernv: Move npu struct from pnv_phb to pci_controller powerpc/powernv/npu: Move OPAL calls away from context manipulation powerpc/pseries/iommu: Use memory@ nodes in max RAM address calculation powerpc/pseries/npu: Enable platform support powerpc/pseries: Remove IOMMU API support for non-LPAR systems powerpc/powernv/pseries: Rework device adding to IOMMU groups powerpc/iommu_api: Move IOMMU groups setup to a single place powerpc/powernv: Reference iommu_table while it is linked to a group powerpc/powernv/npu: Move single TVE handling to NPU PE powerpc/powernv/npu: Convert NPU IOMMU helpers to iommu_table_group_ops powerpc/powernv/npu: Add compound IOMMU groups powerpc/powernv/npu: Add release_ownership hook powerpc/powernv/npu: Check mmio_atsd array bounds when populating powerpc/powernv/npu: Fault user page into the hypervisor's pagetable vfio_pci: Allow mapping extra regions vfio_pci: Allow regions to add own capabilities vfio_pci: Add NVIDIA GV100GL [Tesla V100 SXM2] subdriver drivers/vfio/pci/Makefile | 1 + arch/powerpc/include/asm/iommu.h | 17 +- arch/powerpc/include/asm/mmu_context.h | 15 +- arch/powerpc/include/asm/pci-bridge.h | 1 + arch/powerpc/include/asm/pci.h | 4 + arch/powerpc/platforms/powernv/pci.h | 30 +- drivers/vfio/pci/trace.h | 102 ++++ drivers/vfio/pci/vfio_pci_private.h | 20 + include/uapi/linux/vfio.h | 37 ++ arch/powerpc/kernel/iommu.c | 69 +-- arch/powerpc/kvm/book3s_64_vio.c | 18 +- arch/powerpc/mm/mmu_context_iommu.c | 110 +++- arch/powerpc/platforms/powernv/npu-dma.c | 549 +++++++++++++++--- arch/powerpc/platforms/powernv/pci-ioda-tce.c | 3 +- arch/powerpc/platforms/powernv/pci-ioda.c | 237 ++++---- arch/powerpc/platforms/powernv/pci.c | 43 +- arch/powerpc/platforms/pseries/iommu.c | 88 ++- arch/powerpc/platforms/pseries/pci.c | 22 + drivers/vfio/pci/vfio_pci.c | 42 +- drivers/vfio/pci/vfio_pci_nvlink2.c | 482 +++++++++++++++ drivers/vfio/vfio_iommu_spapr_tce.c | 64 +- drivers/vfio/pci/Kconfig | 6 + 22 files changed, 1569 insertions(+), 391 deletions(-) create mode 100644 drivers/vfio/pci/trace.h create mode 100644 drivers/vfio/pci/vfio_pci_nvlink2.c -- 2.17.1