Received: by 2002:a05:7412:31a9:b0:e2:908c:2ebd with SMTP id et41csp6174413rdb; Mon, 18 Sep 2023 06:26:23 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGNK+yfv/0KwJIY6kdJ431Z+CtmPGaFmhSlvTyIt+vXwbTvIbl/RcDD+DnUoqroEGv2pQIW X-Received: by 2002:a05:6808:278f:b0:3a9:ed67:5220 with SMTP id es15-20020a056808278f00b003a9ed675220mr2694823oib.24.1695043583443; Mon, 18 Sep 2023 06:26:23 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1695043583; cv=none; d=google.com; s=arc-20160816; b=0a80sBAaTQq4x/B5hY1QauZVNpRnbvQcad2o7mdqT1oZ5MyIEFaaeuzHB4WglLtIkO EhTD719LL/696y0s86tJn5pwh72wVwfD3n1rjb77zXK8VAtjThxBltv/LI9UAKChE3ji Ivl6U3a5AXjtuQHQ/Kc/W+soJJXpBnmZJgJebgV7qxdDbVB0pe2MCXC98sS3EZeemco0 W5X25DoRg7yyU/dBdLhlimg4nYljp+hdgLsg4EatzNuDp9+LAuESx4FHWtz8ChPFSWGl UlrOvipklY+cO+xCepRK1CMfUhQM2ZZZTAGiiNirCeo3diJQTVa0zGbHe+sgLLUoQQWl ojxw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:content-transfer-encoding:cc:to :in-reply-to:references:message-id:subject:date:from:dkim-signature; bh=S7l4oCz3CN9sIQ+C3C1TlbBopkTjD4JFHrUqpeIImB4=; fh=Z2RVczOfYjKxGADmNuHiv0N3ipoKjYSBu2F5P0bHIRY=; b=wEyiImiDcJuZWfT0QSMKefZoL4IWTdn3dliFGNnsjT4oKvLhjU1SFlp6z7/QTp7xGI jIKx22xdStQvkdDyRgXkksOiJrVGl8bL4XjLZuJCBcI/ch+HS4Ou3MZfKgYhmD8sVG3D ILN4xqJK7NXxLQqJICwhe8MgM6U2asTtnhgu52egHH12hztZ/pjW8Bzw0e1PDhsORzCQ aj1bwqrBSEWPM8XqeZ8PSGI+2v4xUZ6voKY3XW3x7oiKYhbBgyKwcH2Km6VhNBy+Lxde Bkgjrf/SwBIr9Oo76eaLdkg9B4gLRFXy30WRepCP2WlJm/rV09xa7UbQEKihNIjN4VkK 9JBw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=lJhUXSTs; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:2 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from agentk.vger.email (agentk.vger.email. [2620:137:e000::3:2]) by mx.google.com with ESMTPS id y62-20020a638a41000000b00565f8704191si8012474pgd.635.2023.09.18.06.26.23 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 18 Sep 2023 06:26:23 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:2 as permitted sender) client-ip=2620:137:e000::3:2; Authentication-Results: mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=lJhUXSTs; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:2 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=ibm.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by agentk.vger.email (Postfix) with ESMTP id E0D6481B4541; Mon, 18 Sep 2023 04:53:09 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at agentk.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S241603AbjIRLwh (ORCPT + 99 others); Mon, 18 Sep 2023 07:52:37 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42986 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S241749AbjIRLwc (ORCPT ); Mon, 18 Sep 2023 07:52:32 -0400 Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 46B13E6 for ; Mon, 18 Sep 2023 04:52:27 -0700 (PDT) Received: from pps.filterd (m0356517.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 38IBbfLK008464; Mon, 18 Sep 2023 11:52:08 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : date : subject : content-type : message-id : references : in-reply-to : to : cc : content-transfer-encoding : mime-version; s=pp1; bh=S7l4oCz3CN9sIQ+C3C1TlbBopkTjD4JFHrUqpeIImB4=; b=lJhUXSTs7GRWSbWARv91oH7qiq2PxArNkhxZAvgJA18DQ/jEgpPRyeOYuXayZ7l0PMLq MpamHoPfnk5Fp/U0WdEa0cdHvfeS6eYukATvvXh7qlQalC9PLymGKaw0DRQyn1R/6qgX ACHwJkOOwnLjUJn582gGeamSnUrF/iHENOUUGbsSOY8ElxGZYFyKEafjdR2QQHq+E99a jHzu12yZ6FheiahqHz1fPHkw18zpQw7CFr3/LGlTNc9mAq/k8lfVKNS/NF73I7vDXQQ2 zK5mjMHxy2FywPwaed9zInaqQEZYRclS/haJY0/E/Yag7spqoEg++Kh1Pppw6KLgZ7SY Xg== Received: from ppma22.wdc07v.mail.ibm.com (5c.69.3da9.ip4.static.sl-reverse.com [169.61.105.92]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3t6nks8htw-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 18 Sep 2023 11:52:07 +0000 Received: from pps.filterd (ppma22.wdc07v.mail.ibm.com [127.0.0.1]) by ppma22.wdc07v.mail.ibm.com (8.17.1.19/8.17.1.19) with ESMTP id 38I9UGNM005625; Mon, 18 Sep 2023 11:52:06 GMT Received: from smtprelay01.fra02v.mail.ibm.com ([9.218.2.227]) by ppma22.wdc07v.mail.ibm.com (PPS) with ESMTPS id 3t5q2yajud-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 18 Sep 2023 11:52:06 +0000 Received: from smtpav02.fra02v.mail.ibm.com (smtpav02.fra02v.mail.ibm.com [10.20.54.101]) by smtprelay01.fra02v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 38IBq4A913173290 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 18 Sep 2023 11:52:04 GMT Received: from smtpav02.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id A381520040; Mon, 18 Sep 2023 11:52:04 +0000 (GMT) Received: from smtpav02.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 7671720043; Mon, 18 Sep 2023 11:52:04 +0000 (GMT) Received: from tuxmaker.boeblingen.de.ibm.com (unknown [9.152.85.9]) by smtpav02.fra02v.mail.ibm.com (Postfix) with ESMTP; Mon, 18 Sep 2023 11:52:04 +0000 (GMT) From: Niklas Schnelle Date: Mon, 18 Sep 2023 13:51:44 +0200 Subject: [PATCH v2 2/2] iommu/virtio: Add ops->flush_iotlb_all and enable deferred flush Content-Type: text/plain; charset="utf-8" Message-Id: <20230918-viommu-sync-map-v2-2-f33767f6cf7a@linux.ibm.com> References: <20230918-viommu-sync-map-v2-0-f33767f6cf7a@linux.ibm.com> In-Reply-To: <20230918-viommu-sync-map-v2-0-f33767f6cf7a@linux.ibm.com> To: Jean-Philippe Brucker , Joerg Roedel , Will Deacon , Robin Murphy Cc: virtualization@lists.linux-foundation.org, iommu@lists.linux.dev, linux-kernel@vger.kernel.org, Niklas Schnelle X-Mailer: b4 0.12.3 X-Developer-Signature: v=1; a=openpgp-sha256; l=1894; i=schnelle@linux.ibm.com; h=from:subject:message-id; bh=upC1g4Fnu/iYtsn6wk97A7klYWVGcSCe9jbIua7krSA=; b=owGbwMvMwCH2Wz534YHOJ2GMp9WSGFI5LO9N22yyT5l1n+BSiQbdi2JFVxW83qxm1BNoyeXZ8 dDuzKeIjlIWBjEOBlkxRZZFXc5+6wqmmO4J6u+AmcPKBDKEgYtTACai3c7wP/Ki8bV/C28aNB+5 V2F/+rfCh7fGPoEWnLK7EuZFmFxMdWFkOH7bUn/W4WATr4u9XRZyM054aYmXFR+7ekw6YYNX7M8 jHAA= X-Developer-Key: i=schnelle@linux.ibm.com; a=openpgp; fpr=9DB000B2D2752030A5F72DDCAFE43F15E8C26090 X-TM-AS-GCONF: 00 X-Proofpoint-GUID: NQSOylXlbSs1IxTybC6OPNSLWoeCBIxG X-Proofpoint-ORIG-GUID: NQSOylXlbSs1IxTybC6OPNSLWoeCBIxG Content-Transfer-Encoding: 7bit X-Proofpoint-UnRewURL: 0 URL was un-rewritten MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.267,Aquarius:18.0.980,Hydra:6.0.601,FMLib:17.11.176.26 definitions=2023-09-18_04,2023-09-18_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 adultscore=0 phishscore=0 suspectscore=0 priorityscore=1501 mlxlogscore=833 malwarescore=0 lowpriorityscore=0 impostorscore=0 mlxscore=0 bulkscore=0 clxscore=1015 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2308100000 definitions=main-2309180101 X-Spam-Status: No, score=-0.8 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on agentk.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (agentk.vger.email [0.0.0.0]); Mon, 18 Sep 2023 04:53:10 -0700 (PDT) Add ops->flush_iotlb_all operation to enable virtio-iommu for the dma-iommu deferred flush scheme. This results in a significant increase in performance in exchange for a window in which devices can still access previously IOMMU mapped memory when running with CONFIG_IOMMU_DEFAULT_DMA_LAZY. The previous strict behavior can be achieved with iommu.strict=1 on the kernel command line or CONFIG_IOMMU_DEFAULT_DMA_STRICT. Link: https://lore.kernel.org/lkml/20230802123612.GA6142@myrica/ Signed-off-by: Niklas Schnelle --- drivers/iommu/virtio-iommu.c | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/drivers/iommu/virtio-iommu.c b/drivers/iommu/virtio-iommu.c index 3649586f0e5c..4dd330fbcbdd 100644 --- a/drivers/iommu/virtio-iommu.c +++ b/drivers/iommu/virtio-iommu.c @@ -926,6 +926,13 @@ static int viommu_iotlb_sync_map(struct iommu_domain *domain, return viommu_sync_req(vdomain->viommu); } +static void viommu_flush_iotlb_all(struct iommu_domain *domain) +{ + struct viommu_domain *vdomain = to_viommu_domain(domain); + + viommu_sync_req(vdomain->viommu); +} + static void viommu_get_resv_regions(struct device *dev, struct list_head *head) { struct iommu_resv_region *entry, *new_entry, *msi = NULL; @@ -1051,6 +1058,8 @@ static bool viommu_capable(struct device *dev, enum iommu_cap cap) switch (cap) { case IOMMU_CAP_CACHE_COHERENCY: return true; + case IOMMU_CAP_DEFERRED_FLUSH: + return true; default: return false; } @@ -1071,6 +1080,7 @@ static struct iommu_ops viommu_ops = { .map_pages = viommu_map_pages, .unmap_pages = viommu_unmap_pages, .iova_to_phys = viommu_iova_to_phys, + .flush_iotlb_all = viommu_flush_iotlb_all, .iotlb_sync = viommu_iotlb_sync, .iotlb_sync_map = viommu_iotlb_sync_map, .free = viommu_domain_free, -- 2.39.2