Received-SPF: pass (google.com: domain of linux-kernel+bounces-19460-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) client-ip=2604:1380:4601:e00::3;
Message-ID: <d8ccc4ea-385a-4def-bc71-574a99538e34@nvidia.com>
Date: Mon, 8 Jan 2024 17:28:31 +0530
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH V1] PCI/MSI: Fix MSI hwirq truncation
To: Kuppuswamy Sathyanarayanan <sathyanarayanan.kuppuswamy@linux.intel.com>,
 bhelgaas@google.com, rdunlap@infradead.org, ilpo.jarvinen@linux.intel.com,
 tglx@linutronix.de
Cc: linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org,
 treding@nvidia.com, jonathanh@nvidia.com, sdonthineni@nvidia.com,
 kthota@nvidia.com, mmaddireddy@nvidia.com, sagar.tv@gmail.com
References: <20240105134339.3091497-1-vidyas@nvidia.com>
 <e529aafc-7d97-4e38-b994-26ce99f2715d@linux.intel.com>
Content-Language: en-US
From: Vidya Sagar <vidyas@nvidia.com>
In-Reply-To: <e529aafc-7d97-4e38-b994-26ce99f2715d@linux.intel.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?utf-8?B?djNJTVBNbzNCa3g5eVFSVzk0RGRlU3dYeE9MOTl1cm90UkNvRjhCZlNneFQx?=
 =?utf-8?B?dkttRGVESWpQS1dlbklEeGtwWnpRaUZjWDc3SDlyaTJuVXNWUGdyVlF1ODRD?=
 =?utf-8?B?UG90Nll2MlVXZlpnY1JBUkxjU3FUN2FhRVdrUWZteXJFSmZwb2ZVZ1RjK1N3?=
 =?utf-8?B?MDNFa3p2eUJUTTJ0YjJCM3ZMZ050ek1oTUswc2kvR0ZhVi9STDdhZnlwZTUr?=
 =?utf-8?B?YWNmUVRKTzdOSktzZlFHVVUzNXc0cGVBdWRMc2U5blFDUXIzc3hwZW03cVBs?=
 =?utf-8?B?aG1IVUVKZW4rbHBWQUZFeVl4V0xZSnFUN1hRV21UdGo0OXpHbjJoQlFOVVVY?=
 =?utf-8?B?NmxsMnNFdnovT3cyUEdpTzRmN0UxTlNmempkcTgrZHdmb2QzN3NCZkFvVDhs?=
 =?utf-8?B?dkpWbTNxV1ZDdlkzTU1GRUpXM3J4M2U2dUM5ZHYvQkZJWjJTQ0lFc2x5T0p0?=
 =?utf-8?B?My84d045Y1QyOGNRTWppSXNXMjRaeHA0VU8wVFpDZmZYUGMyYndsZU11OG1j?=
 =?utf-8?B?NnlMZFdLSWhaNm5rc0VtL2QyanhRUmN5ZkFERXpqR21CQVM5ZFFsMUNaekJl?=
 =?utf-8?B?SGJSQTEzL2NGVlJSTU1ZSHV3M1hLcCs0cE5icXFXc0NUSDdXbE5KTGlhNFY4?=
 =?utf-8?B?MXBhZmVxSUJWTU5ER202OUszd1AwcDY3YVluVE81TitVUHZTSU5QdWx1bXFl?=
 =?utf-8?B?bWtEdWhrUEdHcGtqZjZHaUtEMW15TTNFVFNNaEtJVkRMV21lc1pXZjU2cjFy?=
 =?utf-8?B?a2I1RTZYYzBHRTVuRE8vU0RqT1oyVUoyN2Y4YUlvQmczTW1CTmE5TWpMcU43?=
 =?utf-8?B?YTVpemFVL1krVFFTRTBBQWk0Y01sYi9zMnpUS1VwUnZzS0JjT0lBdS9Ob1Jq?=
 =?utf-8?B?R2lzVWFGcTBRajFVOTgyRlpBL0ZqajBTSml5MW0yalVqeGxUM0o1dElCeXBp?=
 =?utf-8?B?Rm81ejIvdmlIcThaeGdzU0RVWFJNSTNoRGtzdXRDemVZT2VZWlFmUm9ONUww?=
 =?utf-8?B?VXJzQmp1K1NWR01mMDZkNW5vY1lvem01elM5OTVFODlEVVI1b2pwTThxcFh3?=
 =?utf-8?B?Ty9qTHYyNmZaUHd2KzVSeXhVUXdGR0kzZ3VYVmFvQTE1cXJ2U3RRNjU1UVFM?=
 =?utf-8?B?czVxcGhEa2hwQTNNdWUvYTJBS3BUQUt3eFdCQUcwMGIxZjFoZkVPZzlHVkJv?=
 =?utf-8?B?eitJc1ZMOUhlekdmWUw1Z1ZHTVc0aGZXWjVyMW5yWTROT3dBTU1Oc1J2c1lv?=
 =?utf-8?B?UVkzMnRoYjI5Z1hNQ0VqMmtEdEFhV25KRjRQQjVsSHJPS3NCVmU1RDRsM0Qr?=
 =?utf-8?B?cHo0aUc4ZWdOekNTMTRiaW0yRi9Sa1hkeXQ4ZlhNUkM4YnUyRzZHdWlqN3oz?=
 =?utf-8?B?K0lROGpuUmhNRWkrZzR0M2diWDEvTGF6eXV5ay96MzFvd3JlQ1FCQmtTWWcw?=
 =?utf-8?B?S2JuL1k4SnRCcEV5MEFKa1ZJRUVGTm00anJMNnN3cC80b0VhSHgwTWNSbzNs?=
 =?utf-8?B?anRydGtoSjZiQmVQcW80ZnYrd21QdlprZHZNdjNhMnV6b3FVSzExUkxSaE1E?=
 =?utf-8?B?Wk5iYUdnRXB4UURQRytUdndEKzVJbk9KQjdyRmtUbC9EL0ViZDBxdHV5UHg5?=
 =?utf-8?B?RGxnSmwwVGtjRWxTbTgwcUdCSXBhVG4yWk9oY012SXNhUndjcnBoZEgrNGJp?=
 =?utf-8?B?Z1B5Q1VGZFZOTlBNbXZ0VHVTMkI1UUo3SEVSTktERVlqRm9OaFRHZnZSZGsx?=
 =?utf-8?B?ZzhuN095YXN6bUk2UTRQWVA5dlBzOVlnZmZCRVQ2TUdBdGREaWQ2emlFbm1o?=
 =?utf-8?B?M2I0OUhtZjZxSmdUalBHdjBnM1BQazU3ajV6WnhrVUFOL3lPcC9zSUhab3Ra?=
 =?utf-8?B?MWVFZEN6SHM2SGw3U2dSbGxqLzlpai8yd1pjVy90U013RFhCZ1h1TXNrSmtv?=
 =?utf-8?B?TnpDMHM2aDNVMDhvOGl1RWxPQWJCT2V0THVxNWJabWpRUXYxanYycUtVbU00?=
 =?utf-8?B?b3REQ2NQOHhVMFF0R3IwNUhmckhjTlRpQWN4a0hPSVUvN0RkNjJQYUd2a2h2?=
 =?utf-8?B?NFR5TncxbnZpSHZrRzB4Mi9GWmx0cGJndWx4WEVrRnBIWTMzZldTNlB3VTZ3?=
 =?utf-8?Q?YWYKXPxRLY15Wppad//cpy+qt?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 7f6dbd60-da96-4a7e-cb82-08dc104127b7
X-MS-Exchange-CrossTenant-AuthSource: PH8PR12MB6674.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Jan 2024 11:58:40.8750
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 76+pMmAOC2DI1Bg9rP/Gt2JxZuk+Hse/i4H+L3ZZHF5Ni7MdA4qa9lHC4xdnwbmOLv2LEgJ/Kuqcb0F3FZhhtA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW3PR12MB4490


On 1/5/2024 10:32 PM, Kuppuswamy Sathyanarayanan wrote:
> External email: Use caution opening links or attachments
> 
> 
> On 1/5/2024 5:43 AM, Vidya Sagar wrote:
>> While calculating the hwirq number for an MSI interrupt, the higher
>> bits (i.e. from bit-5 onwards a.k.a domain_nr >= 32) of the PCI domain
>> number gets truncated because of the shifted value casting to u32. This
>> for example is resulting in same hwirq number for devices 0019:00:00.0
>> and 0039:00:00.0.
>>
>> So, cast the PCI domain number to u64 before left shifting it to
>> calculate hwirq number.
> 
> This seems like a bug fix. Why not add Fixes: tag?
This doesn't seem to be introduced by any recent change as such. It has
been from the time the original change appeared in the mainline. I'll
give the commit ID of the original change for 'Fixes'.

> 
> Is this issue detected in a platform test? Maybe including the relevant
> details about it will help reproduce the issue.
The issue is detected while running ARM's ACS test suite. But, I
couldn't give that info as there was some bug in the test suite itself
for which I raised an issue at 
https://gitlab.arm.com/linux-arm/linux-acs/-/issues/2

> 
>>
>> Signed-off-by: Vidya Sagar <vidyas@nvidia.com>
>> ---
>>   drivers/pci/msi/irqdomain.c | 2 +-
>>   1 file changed, 1 insertion(+), 1 deletion(-)
>>
>> diff --git a/drivers/pci/msi/irqdomain.c b/drivers/pci/msi/irqdomain.c
>> index c8be056c248d..cfd84a899c82 100644
>> --- a/drivers/pci/msi/irqdomain.c
>> +++ b/drivers/pci/msi/irqdomain.c
>> @@ -61,7 +61,7 @@ static irq_hw_number_t pci_msi_domain_calc_hwirq(struct msi_desc *desc)
>>
>>        return (irq_hw_number_t)desc->msi_index |
>>                pci_dev_id(dev) << 11 |
>> -             (pci_domain_nr(dev->bus) & 0xFFFFFFFF) << 27;
>> +             ((irq_hw_number_t)(pci_domain_nr(dev->bus) & 0xFFFFFFFF)) << 27;
>>   }
>>
>>   static void pci_msi_domain_set_desc(msi_alloc_info_t *arg,
> 
> --
> Sathyanarayanan Kuppuswamy
> Linux Kernel Developer