Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <6dd142f8-5a8e-b62c-c629-a3a5859e73b3@amd.com>
Date:   Wed, 10 May 2023 19:34:47 +0530
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.10.0
Subject: Re: [PATCH] cdx: add MSI support for CDX bus
Content-Language: en-US
To:     Thomas Gleixner <tglx@linutronix.de>,
        "gregkh@linuxfoundation.org" <gregkh@linuxfoundation.org>,
        "maz@kernel.org" <maz@kernel.org>, "jgg@ziepe.ca" <jgg@ziepe.ca>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Cc:     "git (AMD-Xilinx)" <git@amd.com>,
        "Anand, Harpreet" <harpreet.anand@amd.com>,
        "Jansen Van Vuuren, Pieter" <pieter.jansen-van-vuuren@amd.com>,
        "Agarwal, Nikhil" <nikhil.agarwal@amd.com>,
        "Simek, Michal" <michal.simek@amd.com>,
        "Gangurde, Abhijit" <abhijit.gangurde@amd.com>,
        "Cascon, Pablo" <pablo.cascon@amd.com>
References: <20230508140950.12717-1-nipun.gupta@amd.com> <874jom2ash.ffs@tglx>
 <CH3PR12MB83081FC5F89386EA9C54B4A7E8769@CH3PR12MB8308.namprd12.prod.outlook.com>
 <87bkityxk3.ffs@tglx>
From:   Nipun Gupta <nipun.gupta@amd.com>
In-Reply-To: <87bkityxk3.ffs@tglx>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?UjZxTzdGVGpTU1FMTWdVbUk0ejZlV2FMM1BZbHJIbEFkU3Y0WjI2VFJLZ1N5?=
 =?utf-8?B?MmY0Myt6c29MNXI5bVBSSGQyY0JLaXdudlpUcnRub0I0UXFYR2greUZjVlZ1?=
 =?utf-8?B?ZTZLUml4MVNCTENMeEhSb0xZaTRrdW1zb0o4UGNmVUhMa1NqNHY2RnRrNE5Y?=
 =?utf-8?B?V2F3T2dpNzA5VzhUcVlsKzJ1Ti8xaEFCWk8wT1llRGZ2RDdTVWZsR0lqZ2Yr?=
 =?utf-8?B?eHRia1Nnd0pNMGxucDEwVFZzaHpxNnFqUUVsUThPUmhtM084MlFsL1JwUGZE?=
 =?utf-8?B?b2IzY2NFeVBaK1c1RWltN1NSVDhKT05LU3FmVm9mcEVyKzgvRlFOUEl2clUz?=
 =?utf-8?B?bmt1Y08zSWxqcTRpbjNVODI5OFpyMng1MGNnOTU0UmlFVTdGTFEyZUxUVWZB?=
 =?utf-8?B?MU42T2xZRFRSUS8rQjJGaEV0UThpNlhzakpnQjA5ODRMekpNTFVHV1IrZFoy?=
 =?utf-8?B?aHZ1VHNFaENCQkVBdVA0U2p3K2YrTWZVQmI2cldObmExOUQyVmpEL2h5c3RV?=
 =?utf-8?B?K1hya2pZYnYxQmhieC9Cc3puMnhNdE96WHlYb0tzTzV1S25GMER4T015eEUv?=
 =?utf-8?B?aGlOVjY1SWZHdHR4Vy9zbUtUSmc5dFU5cUxsaVJrNDc2ckE4YndMVXhZVW1i?=
 =?utf-8?B?TWRXd0lMeE0xTE9Ka3dVK1p2RDFXVUZIVzRlUExDS3lGTXlsalFkMjZBZTYv?=
 =?utf-8?B?V3JzcTNkV0I4bElucW80Mk5tSzNzbVRTUkVaM3RaeUQ3c2hXeHdySS9HYWE3?=
 =?utf-8?B?b1B0TDZSYlhjQ011Mk4yQSsyRlZJQklCWXVudUlQbVIyeUI4OC9LTEdleGto?=
 =?utf-8?B?bUZYSzd1Zk9UODAzekNNdjAxTU9JbW1mbGx0dzh3dmdKWkYzaE5KdHExVXhL?=
 =?utf-8?B?c1F1VCs3U0xIdVZvYlZ5MkcrWFVwd0tQMG4rZmJZaEc2cGNZS1gyQWRPZ3Ay?=
 =?utf-8?B?cXNGT2NScFluNGcyclJnNDVOaUlqb21IU3lTdk5BbEJhOGwyV0ZDZEpybnJM?=
 =?utf-8?B?bG05WkFkR3RSaHU3cmxOSmp0aEQ3YjFXRzFRem9mcE5zYWpXVjN1QjNNSENI?=
 =?utf-8?B?bVFUcjdxdnVMYnBrdjdSYlJOL1k0bkplbGVQL3liOExDUHlxZldoYkNETkRJ?=
 =?utf-8?B?Tm8reW9LeEpWRGNvbnFWVGVYZkNNRnU1YWJHRTBTREtmRnFDWXlJbHdmOGx5?=
 =?utf-8?B?azZjQnpITjVlV0JDVGNBWGsyVEZreXRZMlliN1NvSithdTBPc3dmc2o4MHRU?=
 =?utf-8?B?RSsxZENmSzh3S1h5OXRkV0JtdlJlajJUZFZQZ0R4eVpDMyt1SnVkbnpWVEI4?=
 =?utf-8?B?aTNKSzQ0OXNLTmdCTWwvRU9WeTZsZ3MvRWtrZ3pJMGVjRmF5L01nOHRZWWJK?=
 =?utf-8?B?dTFBZXZNdjdZbWM4cGVUQ3I4UDNHaGpiQmtXbHJONE94SzVyUEZCWW1NM3hS?=
 =?utf-8?B?Tm95aVRnV052VnI1eVpDZkZYanZ2WUtUUFhGem9zaE92N0xMaW1udFFPZGZP?=
 =?utf-8?B?dWl0KzNvaXhxcFdEUlR6UGxFK21NbEZtLzEvOUQ0b3J2TTRnSnhJdC9LQ3NN?=
 =?utf-8?B?a1duOEVsVWE1Sld1WnlYWnV4Nkt2MWtCa2hnVHJKNCtuTXhseTQ3NTQxNE9P?=
 =?utf-8?B?RDI2clZUTGhzdXBHWUpjRlVYWm5NK0grNDN5eHZWZlB1R2JxNXJDYUp5ZHBU?=
 =?utf-8?B?MUhKbXI5dWVVbUQ0b1hkamRmbnBxTEJja09CMDJLQ2J0S3FoS1p2Tk95V3Zl?=
 =?utf-8?B?ZmoxSy94TE5ubVpPM2tYT0VHaDV2VnJNQTFNNWtrTEtXSmluUUpUdXdNc3FF?=
 =?utf-8?B?ZHNlam5uY2JBek1WcE5CeFExUUk2WUVjSm1TYldtT3VUOUJxeFVNUmRSaHBN?=
 =?utf-8?B?cUpBVzc0ZWlUbHgyd0ZpQnlpei8wWTZhMWJPckplYmFPc0VHMlplcnNoak05?=
 =?utf-8?B?ZkdmamszamFEd0lPSUEvYW5hbDg3VUJCWmZ6alBjajdjSGo4cm9vbjVBeTQ1?=
 =?utf-8?B?N0tzdjRBQVdxSU5zNDJMeFhDejNhOHhzZ3pDbUpTb2UvRkZRTWZwOEVtKzFK?=
 =?utf-8?B?VkJGVEtnQkxBTUZhdWFnSTdOL3dQdStwL09DQnZOcTVOaDFqc20zRkMrSFlt?=
 =?utf-8?Q?o4Aiq1Ehpgr++NPj0r3pik+Nc?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f72a773f-6896-47b7-b263-08db515f8b93
X-MS-Exchange-CrossTenant-AuthSource: CH3PR12MB8308.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 May 2023 14:05:01.3044
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: jiXL/e8l2HgnPMP4ZP/U2JhyWT1P0fO8O4pYoz49H3x3QpglOcyH906TqnUZiXRr
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH3PR12MB8909
X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,NICE_REPLY_A,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE,
        T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED autolearn=ham autolearn_force=no
        version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


On 5/10/2023 3:31 AM, Thomas Gleixner wrote:
> 
> Nipun!
> 
> On Tue, May 09 2023 at 11:06, Nipun Gupta wrote:
>>> -----Original Message-----
>>> From: Thomas Gleixner <tglx@linutronix.de>
>>> Sent: Tuesday, May 9, 2023 1:32 PM
>>> To: Gupta, Nipun <Nipun.Gupta@amd.com>; gregkh@linuxfoundation.org;
>>> maz@kernel.org; jgg@ziepe.ca; linux-kernel@vger.kernel.org
> 
> Can you please fix your mail client to not copy half of the mail header
> into your reply?

Sure. Got it fixed.

> 
>>> Caution: This message originated from an External Source. Use proper
>>> caution when opening attachments, clicking links, or responding.
> 
> That's also relevant information for me, right?

Sorry to submit with this text, have already contacted concerned 
internal team regarding removal of this text. Have removed it manually 
for now.

> 
>>> The only real CDX specific functionality here is a CDX specific
>>> irq_write_msi_msg() callback, right?
>>>
>>> And I gave you a pointer how this should be handled, but instead of
>>> helping this effort along you go off and implement it differently just
>>> because. Sigh!
>>
>> As you rightly mentioned the irq_chip has only irq_write_msi_msg() as
>> callback, but there is also cdx_msi_prepare() in msi_domain_ops which
>> needs to fetch device ID from CDX device, due to which we are currently
>> using separate CDX domain.
> 
> Sure. But where is that information in the changelog?
> 
>> IIUC, as per your suggestion we should have CDX bus token added into
>> its_init_dev_msi_info() of
>> https://git.kernel.org/pub/scm/linux/kernel/git/tglx/devel.git/tree/drivers/irqchip/irq-gic-v3-its-msi-parent.c?h=devmsi-arm,
>> and register CDX specific 'msi_prepare' here; so that we can use
>> msi_create_device_irq_domain() to create a per device domain?
> 
> Correct.
> 
> I'm not insisting on that, but you could at least have had the courtesy
> of responding to my review reply and explain to me why you want to solve
> it differently and why my suggestion is not the right solution.
> 
> Alternatively you could have added that information in the changelog or
> cover letter.
> 
> So in summary you ignored _all_ review comments I made, went off and did
> something different and provided a slightly different useless changelog
> with the extra add on of a broken Signed-off-by chain.
> 
> Feel free to ignore my reviews and the documentation which we put out
> there to make collaboration feasible for both sides, but please don't be
> upset when I ignore you and your patches in return.

Sincere apology for not responding to the earlier comments. Intention 
was never to ignore the review comments. Appreciate your vast changes 
regarding the MSI, and the patch series you shared took time to 
understand (provided other things as well), and it was quite late to 
reply. I understand that even in this case atleast I should have added 
this as part of the cover-letter.

IMHO, use-case for MSI in CDX subsystem is a bit different from per 
device MSI domain. Here we are trying to create a domain per CDX 
controller which is attached to a MSI controller, and all devices on a 
particular CDX controller will have same mechanism of write MSI message. 
Also, the current CDX controller that we have added has a different 
mechanism for MSI prepare (it gets requester ID from firmware).

In your opinion is there any advantage in moving to a per device domain 
for CDX devices? We can definitely rethink the implementation of MSI in 
CDX subsystem.

Thanks,
Nipun

> 
> Thanks,
> 
>          tglx
> 
>