Received: by 2002:ab2:6857:0:b0:1ef:ffd0:ce49 with SMTP id l23csp859128lqp; Thu, 21 Mar 2024 19:19:02 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCWlZJf1l4QREZUjWejhWWEJGyeY5/YeQbU73SC5a2kKlRZ5AzFLw0VwTvSnY3Oyp5tSMWKCWUXv8aIGj1bCvv0yQyTzNJtpWxYdDA/i3Q== X-Google-Smtp-Source: AGHT+IFPqF1yb7NAQA3gx9UcAbiCjDSTMvwXwOSuiKHGbnfeXf7P/q2L16E3VJh2R+LZxNqlnCNc X-Received: by 2002:a05:6a20:3c8c:b0:1a3:55d2:1483 with SMTP id b12-20020a056a203c8c00b001a355d21483mr1571492pzj.5.1711073942570; Thu, 21 Mar 2024 19:19:02 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1711073942; cv=pass; d=google.com; s=arc-20160816; b=bCOHL8pBhxCz+ooPxEG3/1MBE60hlKoVVtLESsZgnLNHd9XOZ0y7kRGU1YWKK/HCWk do5UmFNhsxE9QzMdEh3PRrbM/jCuUmhGZwRyowAyLIiZhTbsoFZ9juySnSw0ggWRsBcy CcSd2hBcdP5FbaQFyQo+aayD8yt7GcSEgsRF+hepDM2IFoS0EYPLrUbJ8LgDVTJQdIJR dPZDnzRUB1EZcCN1QK4cLXquv0//Bxg3pobSnc0lYThb/jC9Mh1bkvtAA4TJbTDB69Ue a8wEFvCTxQumKJAf6sluU8+ofJBS8Ay3FM0GejK08+/dpB3Z8jY/fR8yd7W88Byzu6Qw 2Q2g== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:date:message-id:dkim-signature; bh=gyNfZfB9tx4ZZFyJsl1JO4dpsnj0e/paAcTjDX/w/us=; fh=+34HJyaGlskx6DwLoI7ILcsZs60IPd3H2wzsKwO1y+c=; b=aQq7ZMfGdl3PKxspoFteIug+Ewu+hmkbSwaNkGrySfb7z277UXE8/VCpukbtIk4QFv 2zs8Ho5KBwbJwHvNj1u/YodMJ7wlR7frZIjAAzmNKt3Qruqfr49yUQbmeGBsw8t0iWjm 9hYhV8HNlEpT2pW/SiBq8h1TCWbnN8aLFWRTXr2lTob6ecBMO7GzBQ0YPNjQsFqKMdVr +DcB4txBmJwgNWzrE6StaPyK9EPvTKZooUAh4P5VI6XZupc3Z/USJPj8MklBUT4RGp/D L+ucqvb86Pz+/gizzMsKxFadicypwAuhFW+IQOTXhpFYCAm902yDOE7j6NdtgT/NJrkM jzfA==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@quicinc.com header.s=qcppdkim1 header.b=OSHsTN1x; arc=pass (i=1 spf=pass spfdomain=quicinc.com dkim=pass dkdomain=quicinc.com dmarc=pass fromdomain=quicinc.com); spf=pass (google.com: domain of linux-kernel+bounces-110880-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-110880-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=quicinc.com Return-Path: Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org. [2604:1380:45e3:2400::1]) by mx.google.com with ESMTPS id x17-20020a17090a8a9100b002a038bbd178si576261pjn.6.2024.03.21.19.19.02 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 21 Mar 2024 19:19:02 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-110880-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1; Authentication-Results: mx.google.com; dkim=pass header.i=@quicinc.com header.s=qcppdkim1 header.b=OSHsTN1x; arc=pass (i=1 spf=pass spfdomain=quicinc.com dkim=pass dkdomain=quicinc.com dmarc=pass fromdomain=quicinc.com); spf=pass (google.com: domain of linux-kernel+bounces-110880-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-110880-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=quicinc.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sv.mirrors.kernel.org (Postfix) with ESMTPS id 0A63628466F for ; Fri, 22 Mar 2024 02:18:08 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 0038015BB; Fri, 22 Mar 2024 02:18:00 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=quicinc.com header.i=@quicinc.com header.b="OSHsTN1x" Received: from mx0b-0031df01.pphosted.com (mx0b-0031df01.pphosted.com [205.220.180.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4B3971396; Fri, 22 Mar 2024 02:17:56 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=205.220.180.131 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1711073878; cv=none; b=PWtlLRj7+zpCz64kMDQI57k515fUbzLPBU2grLFt1gLV4yVgwkT9KQ1YigQ37lCVaGkCDgmITi5WEabO8knb15/m9vRQyF4nUO0atLikOwQYvGP6TIZSpJ4OlmivLIAg1f2Gwy8ugyhWGXw6kr2+HcL6g4IbbvUnafUa22venqo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1711073878; c=relaxed/simple; bh=ZpEdFU526BvvXv540yWk79h+emOJcRxV5fBZN8BCVgw=; h=Message-ID:Date:MIME-Version:Subject:To:References:From: In-Reply-To:Content-Type; b=WRn5mnP0pNlQKKcW9FFTU08Ozfcg1YZAiHD46MVrXGjxIMdojD1FOcZd50wBlyYdR6Sa+7QQXY5dXuwxUgC7v+NLLxk5YZxiAQoYSbGjxylyLJ53VFME3oqiZLrWtOUFH2mIJ4TNL2ZZmHmDPbhipFfWZTBGTpfVNv/9o5uo5kQ= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=quicinc.com; spf=pass smtp.mailfrom=quicinc.com; dkim=pass (2048-bit key) header.d=quicinc.com header.i=@quicinc.com header.b=OSHsTN1x; arc=none smtp.client-ip=205.220.180.131 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=quicinc.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=quicinc.com Received: from pps.filterd (m0279868.ppops.net [127.0.0.1]) by mx0a-0031df01.pphosted.com (8.17.1.24/8.17.1.24) with ESMTP id 42M1AsQQ006067; Fri, 22 Mar 2024 02:17:34 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=quicinc.com; h= message-id:date:mime-version:subject:to:references:from :in-reply-to:content-type:content-transfer-encoding; s= qcppdkim1; bh=gyNfZfB9tx4ZZFyJsl1JO4dpsnj0e/paAcTjDX/w/us=; b=OS HsTN1xgIoKZdw2tNbsJvFUKygiu7aVYEOIExFGxkhBp2ueo5pI5dMTw38A3aUqag 162IMl4fkfwdfh+1Gw1fnurs39+iebWEgB/1eCAtCytWfVPRd3N9wa18TiIuuQ7S GXQMC/L61YQRDuWk0kpaUcMI/bQv5XH6MEuEa3R0oYQj94+6wgdbZjZGpu9s9LbK rphfRYlO3Zo4iiQKcQJOzeA4pVb4iW67/GoXzEeTj/7tYqVEs7XEokL4RXiLLXb0 bJBWkRUTiGG+KXCdUo806ztkfPa1MeU6xlF3iuN+M9+mk93nTaNJ+0effyt4PhBJ jFIOSBv4znp7xn7WVyrg== Received: from nalasppmta04.qualcomm.com (Global_NAT1.qualcomm.com [129.46.96.20]) by mx0a-0031df01.pphosted.com (PPS) with ESMTPS id 3x0wy9rcpj-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 22 Mar 2024 02:17:33 +0000 (GMT) Received: from nalasex01a.na.qualcomm.com (nalasex01a.na.qualcomm.com [10.47.209.196]) by NALASPPMTA04.qualcomm.com (8.17.1.5/8.17.1.5) with ESMTPS id 42M2HWNJ020002 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 22 Mar 2024 02:17:32 GMT Received: from [10.231.195.68] (10.80.80.8) by nalasex01a.na.qualcomm.com (10.47.209.196) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.40; Thu, 21 Mar 2024 19:17:27 -0700 Message-ID: Date: Fri, 22 Mar 2024 10:17:25 +0800 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH] wifi: ath11k: workaround to use VMs Content-Language: en-US To: Jeff Johnson , Jose Ignacio Tornos Martinez , , , , , , "kernel@quicinc.com" References: <20240321172402.346191-1-jtornosm@redhat.com> From: Baochen Qiang In-Reply-To: Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: nasanex01a.na.qualcomm.com (10.52.223.231) To nalasex01a.na.qualcomm.com (10.47.209.196) X-QCInternal: smtphost X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=5800 signatures=585085 X-Proofpoint-ORIG-GUID: 1vMN0i_wMLC1wzG1AkdyfzHVu4v6MM8Q X-Proofpoint-GUID: 1vMN0i_wMLC1wzG1AkdyfzHVu4v6MM8Q X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2024-03-21_14,2024-03-21_02,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 mlxlogscore=999 impostorscore=0 priorityscore=1501 lowpriorityscore=0 clxscore=1015 phishscore=0 bulkscore=0 adultscore=0 spamscore=0 suspectscore=0 malwarescore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2403210001 definitions=main-2403220015 On 3/22/2024 4:13 AM, Jeff Johnson wrote: > On 3/21/2024 10:23 AM, Jose Ignacio Tornos Martinez wrote: >> Currently, this driver is not working when the device is handled in a >> Virtual Machine (PCI pass-through), as it was already reported here: >> https://lore.kernel.org/all/fc6bd06f-d52b-4dee-ab1b-4bb845cc0b95@quicinc.com/T/ >> Baochen Qiang focused the problem and described how to have it working >> for a specific real MSI vector from host that needs to be used in VM too. >> And this value, as it was commented, can change. >> >> The problem seems complex to me and I don't know if there is any easy way >> to solve it. Meanwhile and using the information from Baochen Qiang, >> since the use of VMs is very interesting for testing procedures, >> I would like to just add this workaround that consists on adding a >> parameter to pass the real MSI vector from host to the VM. In that way, >> checking the 'lscpi' command output from host, it could be handled manually >> or with some user tool in order to have the VM with the driver working. >> Of course, if this parameter is not configured (zero value and default), >> we will have the same behavior as always. >> >> Signed-off-by: Jose Ignacio Tornos Martinez >> --- >> drivers/net/wireless/ath/ath11k/pci.c | 20 ++++++++++++++++++++ >> 1 file changed, 20 insertions(+) >> >> diff --git a/drivers/net/wireless/ath/ath11k/pci.c b/drivers/net/wireless/ath/ath11k/pci.c >> index be9d2c69cc41..0e322956b10f 100644 >> --- a/drivers/net/wireless/ath/ath11k/pci.c >> +++ b/drivers/net/wireless/ath/ath11k/pci.c >> @@ -31,6 +31,11 @@ >> >> #define TCSR_SOC_HW_SUB_VER 0x1910010 >> >> +static ulong ath11k_host_msi_addr = 0; >> +module_param_named(host_msi_addr, ath11k_host_msi_addr, ulong, 0644); >> +MODULE_PARM_DESC(host_msi_addr, >> + "Workaround to configure the MSI address that is used from host in order to be used in VM"); >> + >> static const struct pci_device_id ath11k_pci_id_table[] = { >> { PCI_VDEVICE(QCOM, QCA6390_DEVICE_ID) }, >> { PCI_VDEVICE(QCOM, WCN6855_DEVICE_ID) }, >> @@ -443,6 +448,18 @@ static int ath11k_pci_alloc_msi(struct ath11k_pci *ab_pci) >> >> ath11k_pci_msi_disable(ab_pci); >> >> + if (ath11k_host_msi_addr) { >> + ab_pci->ab->pci.msi.ep_base_data = 0; >> + ab->pci.msi.addr_hi = (u32)(ath11k_host_msi_addr >> 32); >> + ab->pci.msi.addr_lo = (u32)(ath11k_host_msi_addr & 0xffffffff); >> + >> + ath11k_dbg(ab, ATH11K_DBG_PCI, "msi addr hi 0x%x lo 0x%x base data is %d\n", >> + ab->pci.msi.addr_hi, >> + ab->pci.msi.addr_lo, >> + ab->pci.msi.ep_base_data); >> + return 0; >> + } >> + >> msi_desc = irq_get_msi_desc(ab_pci->pdev->irq); >> if (!msi_desc) { >> ath11k_err(ab, "msi_desc is NULL!\n"); >> @@ -482,6 +499,9 @@ static int ath11k_pci_config_msi_data(struct ath11k_pci *ab_pci) >> { >> struct msi_desc *msi_desc; >> >> + if (ath11k_host_msi_addr) >> + return 0; >> + >> msi_desc = irq_get_msi_desc(ab_pci->pdev->irq); >> if (!msi_desc) { >> ath11k_err(ab_pci->ab, "msi_desc is NULL!\n"); > > + kernel@quicinc.com to make sure the Qualcomm VM experts are aware of this > issue and to see if they have any additional suggestions. > If limit the fix/WAR to be within ath11k, not touching vfio or any other related module, I was imagining that if hardware could map the standard MSI registers in config space to some private MMIO registers so VM ath11k could read, or that if firmware could read them and send to VM ath11k via QMI interface? don't know if it is feasible to hardware/firmware. >