Received-SPF: pass (google.com: domain of linux-kernel+bounces-19740-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
From: Frank Li <Frank.Li@nxp.com>
To: mani@kernel.org
Cc: Frank.Li@nxp.com,
	allenbh@gmail.com,
	bhelgaas@google.com,
	dave.jiang@intel.com,
	imx@lists.linux.dev,
	jdmason@kudzu.us,
	kishon@kernel.org,
	kw@linux.com,
	linux-kernel@vger.kernel.org,
	linux-pci@vger.kernel.org,
	lpieralisi@kernel.org,
	ntb@lists.linux.dev
Subject: [PATCH v4 1/1] PCI: endpoint: pci-epf-vntb: Fix transfer failure for fixed size BARs
Date: Mon,  8 Jan 2024 10:10:15 -0500
Message-Id: <20240108151015.2030469-1-Frank.Li@nxp.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?us-ascii?Q?6uCIz6vtVOEfdEno3xMOPbO6gLZ/iQsdDt2X/+0yEExWZAKvlUoFOcfliyL0?=
 =?us-ascii?Q?V+bO3W5O4BTHSvcBGykVruUJz6cgAiB3pmIHwRcNDQneEuKdLzmVCT3p4xf1?=
 =?us-ascii?Q?EPvVOB6oUv4lvV3D6SIcaSsRpVm3ud4nrft51G0HHGVih/QApMkSEx/DY0Pb?=
 =?us-ascii?Q?q/n+zXnO19lHXGZD8QGi2keNp9T3lYoOwWgWpl2J0qz7OZkO2g8CSERSd4Sf?=
 =?us-ascii?Q?dFUrqvwNhYRcjOPUriEWvOHKK77JzSyt8cRLWLWa9CPsqTZv344Ka+VOYkxI?=
 =?us-ascii?Q?JKwu5PAMbxRe09kCZVSEGlQKabf+SlHnw7MrfGgDxwTZSvHUOqdkeRJMHcVg?=
 =?us-ascii?Q?GCrReDOk/n0mdMzJy4oUNrTyatJYsYmkTwwY4ont3nfHwHjzEW41ezm3A0iR?=
 =?us-ascii?Q?HwYITKO2yIWyLXVZVO0Q59o3lnuIz5Hiw+MqoEGeH05hG/z8MtjZPuxCnp65?=
 =?us-ascii?Q?ca7Hh8dEya4IKbDKv8UoR0amR69FRxTufNO5/BdMTq2JYTVGrLpHY1hOTn+4?=
 =?us-ascii?Q?n4B6jnhoq2WKCQMY/2afn4AWN/hwnDLOmA2bQoJbEl1LDAWxP/7Ry2rBJcMM?=
 =?us-ascii?Q?LEffsSGiVDhpUBd+qoVSidSlEXBEvf7vS0btKTX/gqHa73zJeNPn37IRal9r?=
 =?us-ascii?Q?tCslt8yGJNpT/1uMMO2ox4chiNxmikyLFOZjGWxYnNV1hoYd9KMFuKTWrVir?=
 =?us-ascii?Q?SKHCW4UyYRnBmT8XEzUWl3nQKYOKQuGmrcHF2ckYaNLJmPQmPLgHNyp1evrn?=
 =?us-ascii?Q?8Lrg0a1uwRzN5uLN3h/eSuC7U6twm3NiHXbJXykFyD8R9meUBJ6acgn06jwr?=
 =?us-ascii?Q?AdUy30igie2RE2gfz7knJ4L7Y7r7e+eoP7eVB8SGGsHA4+Oo/Xc8uEoZbtEJ?=
 =?us-ascii?Q?VG8PNTLc05NHZ5tp/RC+lipqOG+x6JrsIswhqESoq8DZVp6Y9jGNhQ/hiOTG?=
 =?us-ascii?Q?qSLxRtddKUm0KQmVIkBzZE6kvs123V1ZxytSJXdnadJOz/kuwyE8UqVgANd8?=
 =?us-ascii?Q?x/TuUCWcA+ryYSPrh9kjUUBYvj+WANT3c2eKCEb+/oDdLprMRoUFb2OsCVgU?=
 =?us-ascii?Q?Oc2HH1IN/Nl5fD8+WnO6RaqCyUK5v8I/9bTJn936Mf8cRh6KRW9gyCCoAij9?=
 =?us-ascii?Q?CtGb5iqWNVFd5srwpJDyUUUNgofscTWrfy/Yl/2vLMd2TOYwwXVIszO2venC?=
 =?us-ascii?Q?n511AcMnHhSRIv+aiEUwaJtmXWA1/S1EXUWVfoMGVZaxdqKxq+Ftq5+1gsoK?=
 =?us-ascii?Q?X4uM58RlElCQ5SpiPK9cuwgGIWx/glxP0zzNATVJAzcCvCF6vhB7eoB/NLzF?=
 =?us-ascii?Q?ppkEFs36Y0pBrFnnJTq5EeW1mC2RqZVOUf5dhx+Yg8EGy+XxeDAAYtE3XH0g?=
 =?us-ascii?Q?T5Ycmh4vx8lwvPze1kMB5zl1mtnzf+crxq4XAdWoQBgg+iLPq/qWGlbR/ofw?=
 =?us-ascii?Q?iry96r9x4jn21aty/OhY9LKxOUk125Qy/Qu3Y1JL3VR1jgwfj+12qbv1sfZp?=
 =?us-ascii?Q?e06O/Pjy3gdpbBMXLPsxRiMhkTkGc5QoeBCH4YFPTz3sPi3f09iItzc313pj?=
 =?us-ascii?Q?2haTu5m7h+EjYIVVLIg=3D?=
X-OriginatorOrg: nxp.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 3809a201-9dee-43c2-5462-08dc105bf71b
X-MS-Exchange-CrossTenant-AuthSource: AS8PR04MB7511.eurprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Jan 2024 15:10:35.5436
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: gP4ANU1DfqUFrh7zlpmufk9L+IqYL4hvV2z0/TxomKfmFLX2TlrHwCtUTnASZi+TEv5I4WwiJMxsyxd+lPZkLA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAXPR04MB8670

For the inbound MEM/IO TLPs, iATU on the endpoint expects the target
address to be aligned to the size of the BAR. For configurable BARs, there
is no issue because both host and endpoint will know the exact size of the
BAR region. But for fixed size BARs available in some controllers, if the
BAR size advertised by the endpoint is not same as of the actual BAR size
used in the controller, then the MEM/IO TLPs generated by the host will not
be translated properly by the endpoint iATU.

So if the fixed size BARs are available in endpoint controllers, always use
the actual BAR size.

This only fixes doorbell (DB) BAR. A similar fix is needed for memory map
windows(MW) BARs.

Fixes: e35f56bb0330 ("PCI: endpoint: Support NTB transfer between RC and EP")
Cc: stable@vger.kernel.org
Reviewed-by: Manivannan Sadhasivam <manivannan.sadhasivam@linaro.org>
Signed-off-by: Frank Li <Frank.Li@nxp.com>
---

Notes:
    Change from v3 to v4
    - add notes: fixing the issue only for DB BAR and a similar fix is needed
    for other MW BARs
    - Add Manivannan Sadhasivam's review tag
    
    Change from v2 to v3
    - rework commti message
    - add fixes and cc stable
    - return -ENOMEN when request size > fix bar size
    Change from v1 to v2
    - Remove unnessary set align when fix_bar_size.

 drivers/pci/endpoint/functions/pci-epf-vntb.c | 8 ++++++++
 1 file changed, 8 insertions(+)

diff --git a/drivers/pci/endpoint/functions/pci-epf-vntb.c b/drivers/pci/endpoint/functions/pci-epf-vntb.c
index 3f60128560ed0..85120978fb8c9 100644
--- a/drivers/pci/endpoint/functions/pci-epf-vntb.c
+++ b/drivers/pci/endpoint/functions/pci-epf-vntb.c
@@ -550,6 +550,14 @@ static int epf_ntb_db_bar_init(struct epf_ntb *ntb)
 
 	barno = ntb->epf_ntb_bar[BAR_DB];
 
+	if (epc_features->bar_fixed_size[barno]) {
+		if (size > epc_features->bar_fixed_size[barno]) {
+			dev_err(dev, "Fixed BAR%d is too small for doorbell\n", barno);
+			return -ENOMEM;
+		}
+		size = epc_features->bar_fixed_size[barno];
+	}
+
 	mw_addr = pci_epf_alloc_space(ntb->epf, size, barno, align, 0);
 	if (!mw_addr) {
 		dev_err(dev, "Failed to allocate OB address\n");
-- 
2.34.1