Received: by 2002:ab2:687:0:b0:1f4:6588:b3a7 with SMTP id s7csp158967lqe; Tue, 9 Apr 2024 19:12:03 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCWPWsGXYnEZRetnQnjfFLK+4P8dA65iI1dG7C8/VPxwbcqMUUR+jZstwYrMQt3FZ/dyoxJ6DgNP563Bi0HuNB5hM4/vZP4ifDK+q8UAiQ== X-Google-Smtp-Source: AGHT+IFrkrbgJt6swyjK7no+jg8VobmuZAgwNpkSbuZ+N0HfFT0MPSF98cC04LSNBei/K/gsvzW7 X-Received: by 2002:a05:6808:a9b:b0:3c5:e81a:b5b6 with SMTP id q27-20020a0568080a9b00b003c5e81ab5b6mr1164331oij.59.1712715123170; Tue, 09 Apr 2024 19:12:03 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1712715123; cv=pass; d=google.com; s=arc-20160816; b=cIqARNh9tyWCYyWfdtS4IkL4eg8BFQW9c5ZCcZfj/Zq2ePeR0+H+fLrtCGtlxB66t2 2l/8i3/lbC+SZqsQDG8Q2P552QNS3ErsxeryB2O+U672Jqy8Ub9r9yp/szOuYMdD0J3v wS+rKpga+Ue38XKvOdyQCTuccWlxBQeyy3saK6Bmonaljt0iBB3+wC6ruJRiTzcEisAq mOWUx+RrNmql1ZyjrooBD48R4rM2qm5GlnCjEZLUfoqAI1OK0NtvgU5Diu/Ytovbq+V1 9esegK9Wh2H0/qp9zTxCMtQlBUa2BSVil36F3kfzloC4Fix8QpeJ1D51hytVcLRuyN+V 7m8w== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=37GDhz6Q2kto2L6upj1rqmX5AOB7oPOYvykvtu2KMhw=; fh=bewSQvuA0/GMLNkXZCY6BVvXowY1LyW/Ro23JMfVQ8s=; b=VUE0mtPl88Cril6ADuAf8uD3Mhlq758QImVj8y7T5qvdlsanus+QBb0sNH/NW8qMrW ogE6GnSlrrSX1CgNpivkfOJRRse2AsS1gD0Wj20TM4nXVDN3l6R//3pvkfVuZsgRZ6zS GEqUhOwIJmVJhpplx3AIwSjyc5EY9MujtwxQfxSjGnmTDGstfYuuNdt0nYc7H6BqNkoD fx28DSjKo4qPN0vfDbMw5OrexRK85RQ3fUhGDoB/S43hFja1HgvHDEBcIb8xbpjGL7C9 /eTP70unkutu2VtwUI2us69vVIkSDzRhGtqdjkaBoKTud36rB+8o5du8jEeVHessQvYa VDIg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=gbzeY6cn; arc=pass (i=1 dkim=pass dkdomain=intel.com dmarc=pass fromdomain=linux.intel.com); spf=pass (google.com: domain of linux-kernel+bounces-137824-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) smtp.mailfrom="linux-kernel+bounces-137824-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [139.178.88.99]) by mx.google.com with ESMTPS id v27-20020aa799db000000b006e69296296fsi9607903pfi.400.2024.04.09.19.12.02 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 Apr 2024 19:12:03 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-137824-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=gbzeY6cn; arc=pass (i=1 dkim=pass dkdomain=intel.com dmarc=pass fromdomain=linux.intel.com); spf=pass (google.com: domain of linux-kernel+bounces-137824-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) smtp.mailfrom="linux-kernel+bounces-137824-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id B2F7B284B9A for ; Wed, 10 Apr 2024 02:12:02 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 760C522301; Wed, 10 Apr 2024 02:10:25 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b="gbzeY6cn" Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 378DA20304 for ; Wed, 10 Apr 2024 02:10:23 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=198.175.65.20 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712715024; cv=none; b=Sjr7PjqiyzLHcoDMXVkuNb59DAhA/tVXAUqI0YFtY+Whi5HgC2wo3Adk3kxsVbrxZ6k/2GuHYSfB0lz03Ay7OFsH9Zwtj52EPNtITxPGoXl5DAW+fwXJPrdDyM1bwCgcISthWnSXNgVRi6Gi5vlO0osu2rMqlh/TNsq/PbcYbjw= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712715024; c=relaxed/simple; bh=jYNsXY9ExG8M0Ob2c88oOkriVnbsWsmB8tTBDVSAhSU=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=EtCYXJbwG0m2epev4Fyiz/3sxUeAfYvTpAAEnRncX7RA59M1f+Qmnvwt2z8YWLx+Lx5rCnjtik+dxefeM+SRNOERP92veAK9DBfUxeqGTjsR0fI7spHqB2p5WgEoIbBrm6AgW9jQgw2Z96Jh3x60wxLQPHpZrwbUMgF0jhGHdAo= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.intel.com; spf=none smtp.mailfrom=linux.intel.com; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b=gbzeY6cn; arc=none smtp.client-ip=198.175.65.20 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.intel.com Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=linux.intel.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1712715024; x=1744251024; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=jYNsXY9ExG8M0Ob2c88oOkriVnbsWsmB8tTBDVSAhSU=; b=gbzeY6cnW/Lz8CP5dCcv7iy9/V0VorLmj4wdn2JFzhwP7OJA5fxRpTzm cPv1liE/pEVzQNxGj36VLTYUX/Q6c0kjkODEdLbW/KDwoLa1kIVx124/R EoRcO6pnWW6NFB67BMOp45ht9Ill44l8KVAxt5mFlli5TPh+vgqLmrm7y yogAWSxrD6+KjOhvGZg239fW6UhBSDxzapTVB1WU80D0qEsxaj2XAfW2a /928ZRfeTUwGGa0Ei9+GO70N4ocKcJLymJR90vdZnVPzmq/2RjmVAn878 dHo/kUpEUliYWvLxC5S9elsbwKEH4szjLyJgAg8yPzp5EMLwfx5wh7/R2 w==; X-CSE-ConnectionGUID: djnmZpSWRoCZW2CuiyhpqA== X-CSE-MsgGUID: swP7iLRCTBukrc60DsadhA== X-IronPort-AV: E=McAfee;i="6600,9927,11039"; a="7918597" X-IronPort-AV: E=Sophos;i="6.07,190,1708416000"; d="scan'208";a="7918597" Received: from fmviesa007.fm.intel.com ([10.60.135.147]) by orvoesa112.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 Apr 2024 19:10:23 -0700 X-CSE-ConnectionGUID: 4YiX2TjaS0i9jr50F3hCPA== X-CSE-MsgGUID: mdlYYQcDTZ63xNocZDOROw== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.07,190,1708416000"; d="scan'208";a="20478915" Received: from unknown (HELO allen-box.sh.intel.com) ([10.239.159.127]) by fmviesa007.fm.intel.com with ESMTP; 09 Apr 2024 19:10:20 -0700 From: Lu Baolu To: Joerg Roedel , Will Deacon , Robin Murphy , Kevin Tian , Jason Gunthorpe Cc: Tina Zhang , Yi Liu , iommu@lists.linux.dev, linux-kernel@vger.kernel.org, Lu Baolu Subject: [PATCH v2 08/12] iommu/vt-d: Use cache_tag_flush_range() in cache_invalidate_user Date: Wed, 10 Apr 2024 10:08:40 +0800 Message-Id: <20240410020844.253535-9-baolu.lu@linux.intel.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240410020844.253535-1-baolu.lu@linux.intel.com> References: <20240410020844.253535-1-baolu.lu@linux.intel.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit The cache_invalidate_user callback is called to invalidate a range of caches for the affected user domain. Use cache_tag_flush_range() in this callback. Signed-off-by: Lu Baolu --- drivers/iommu/intel/iommu.h | 6 +++++ drivers/iommu/intel/nested.c | 50 +++--------------------------------- 2 files changed, 9 insertions(+), 47 deletions(-) diff --git a/drivers/iommu/intel/iommu.h b/drivers/iommu/intel/iommu.h index 700574421b51..90a300665962 100644 --- a/drivers/iommu/intel/iommu.h +++ b/drivers/iommu/intel/iommu.h @@ -1050,6 +1050,12 @@ static inline unsigned long aligned_nrpages(unsigned long host_addr, size_t size return PAGE_ALIGN(host_addr + size) >> VTD_PAGE_SHIFT; } +/* Return a size from number of VTD pages. */ +static inline unsigned long nrpages_to_size(unsigned long npages) +{ + return npages << VTD_PAGE_SHIFT; +} + /* Convert value to context PASID directory size field coding. */ #define context_pdts(pds) (((pds) & 0x7) << 9) diff --git a/drivers/iommu/intel/nested.c b/drivers/iommu/intel/nested.c index 85c744099558..ffbd8d98a3b8 100644 --- a/drivers/iommu/intel/nested.c +++ b/drivers/iommu/intel/nested.c @@ -90,50 +90,6 @@ static void intel_nested_domain_free(struct iommu_domain *domain) kfree(dmar_domain); } -static void nested_flush_dev_iotlb(struct dmar_domain *domain, u64 addr, - unsigned int mask) -{ - struct device_domain_info *info; - unsigned long flags; - u16 sid, qdep; - - spin_lock_irqsave(&domain->lock, flags); - list_for_each_entry(info, &domain->devices, link) { - if (!info->ats_enabled) - continue; - sid = info->bus << 8 | info->devfn; - qdep = info->ats_qdep; - qi_flush_dev_iotlb(info->iommu, sid, info->pfsid, - qdep, addr, mask); - quirk_extra_dev_tlb_flush(info, addr, mask, - IOMMU_NO_PASID, qdep); - } - spin_unlock_irqrestore(&domain->lock, flags); -} - -static void intel_nested_flush_cache(struct dmar_domain *domain, u64 addr, - u64 npages, bool ih) -{ - struct iommu_domain_info *info; - unsigned int mask; - unsigned long i; - - xa_for_each(&domain->iommu_array, i, info) - qi_flush_piotlb(info->iommu, - domain_id_iommu(domain, info->iommu), - IOMMU_NO_PASID, addr, npages, ih); - - if (!domain->has_iotlb_device) - return; - - if (npages == U64_MAX) - mask = 64 - VTD_PAGE_SHIFT; - else - mask = ilog2(__roundup_pow_of_two(npages)); - - nested_flush_dev_iotlb(domain, addr, mask); -} - static int intel_nested_cache_invalidate_user(struct iommu_domain *domain, struct iommu_user_data_array *array) { @@ -166,9 +122,9 @@ static int intel_nested_cache_invalidate_user(struct iommu_domain *domain, break; } - intel_nested_flush_cache(dmar_domain, inv_entry.addr, - inv_entry.npages, - inv_entry.flags & IOMMU_VTD_INV_FLAGS_LEAF); + cache_tag_flush_range(dmar_domain, inv_entry.addr, + inv_entry.addr + nrpages_to_size(inv_entry.npages) - 1, + inv_entry.flags & IOMMU_VTD_INV_FLAGS_LEAF); processed++; } -- 2.34.1