Received-SPF: pass (google.com: domain of linux-kernel+bounces-103076-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161;
Message-ID: <32111520-7006-442a-8ff3-83fc9eb02997@amd.com>
Date: Thu, 14 Mar 2024 15:22:04 +0530
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 2/2] drm:amdgpu: add firmware information of all IP's
To: "Sharma, Shashank" <shashank.sharma@amd.com>,
 Alex Deucher <alexdeucher@gmail.com>, Sunil Khatri <sunil.khatri@amd.com>
Cc: Alex Deucher <alexander.deucher@amd.com>,
 =?UTF-8?Q?Christian_K=C3=B6nig?= <christian.koenig@amd.com>,
 amd-gfx@lists.freedesktop.org, dri-devel@lists.freedesktop.org,
 linux-kernel@vger.kernel.org
References: <20240312124148.257067-1-sunil.khatri@amd.com>
 <20240312124148.257067-2-sunil.khatri@amd.com>
 <CADnq5_ON0NfcpmnHKjNYWgxfvfz-J3tgjX92DaaN63iKb+FOZg@mail.gmail.com>
 <498b87fb-727c-4ea2-9633-6ecbff436eba@amd.com>
 <0ee30d3b-0dbc-3eb6-a19c-abeb85cbc883@amd.com>
Content-Language: en-US
From: "Khatri, Sunil" <sukhatri@amd.com>
In-Reply-To: <0ee30d3b-0dbc-3eb6-a19c-abeb85cbc883@amd.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?utf-8?B?ZGNoaVZSQU1EM0cxcVN4TkFmcnlNaFZUQ2V3T0tPY1ZHSjhYUVJnRjB6TDVx?=
 =?utf-8?B?QkFyc2FLRG1WeHhsWGViQ0Izcjh5bHA1dnJ5Nzc4Z2ZRM2tKTFpxa0ZlZFhm?=
 =?utf-8?B?eitBNkhjMmxLK1YycVdXc2FpSWpMNGlSVGRSYjgvZ3MzY0FmS2ZjdHptbms2?=
 =?utf-8?B?akxlVVBoWm1DM0pPYzRMNyt1djU2YUoyNElpdVk4eDdwdDl5UlZvamg4L1dw?=
 =?utf-8?B?aWxaYnljVUFrWEsrOGNLSXpleVdockhJOWJ2YzNLNkpISmpmTmNrSVFHck1M?=
 =?utf-8?B?Yk00dlpxakllUFZYRFUzOEdMUWtBbzc3K1hqYUUzamNOWGcvWlNuY1ZPSUxz?=
 =?utf-8?B?Ny9KUXFsYTNHQWlZZGJoOTJ3ZkRpSUJWT0RkWXpUSldXQyswOHhwRWUyYXR5?=
 =?utf-8?B?T0t1THhUYnhxNTVyQnVSL1hPL0krTTV2TGFBTGVEaXhkTzN3WVpDcktTNG9F?=
 =?utf-8?B?L0pienlTckNQWWhqcHZHQ09jd1R3ZlV2TWYxSXJhVjROVDM3NzMvTnd2VjF1?=
 =?utf-8?B?RDU4QWN4ckNrdytnNHpSbzNJcDBneFdrRnB4Tkc0bDFZbmszTG9YdncrcUhG?=
 =?utf-8?B?K2ZRM2wwQ2dpeW5aSHhuUUpZblN6Z1NRTGVYd0VIeEFsaFVHVkJiaXFyeC9t?=
 =?utf-8?B?ejRIN2dDTVQzWDI5ZjduN0VqeUhMT2NtU1I3Y3JLUkd0SnVxbGNaSGdBRGtu?=
 =?utf-8?B?VnlLNm5lNy9SNitEcFdhWllOY3JkVVRMdFg4Nmc3Q1R3ODJSNG9oUG0wY1k3?=
 =?utf-8?B?RDZWc1VWc1g4TUZRQTJ0TlBuQ2pHOVQ0REJSRStTbGFmaE4yVHhGblM2U3FH?=
 =?utf-8?B?TUpNc2UxQlFHSVRZejFYZ0pyUXVlM3pZNVVCWjVQcm8vTHM2bTd5eW9TZTRW?=
 =?utf-8?B?c0hyRVFmc2UxVWtEMXVjNGZSRWRDcmlhZDhYVUtqd29mU1JuTHZDVkRXUm1R?=
 =?utf-8?B?WE41dGozWlVUazU3cmR3QUd3WC9qRi9wdFdjQmM4VlFiV2IxL0FZeS9sUG1Z?=
 =?utf-8?B?WVJtYTh3a1RxZWVzWkhxbVFXYmtxZmxjVTB2eGhaSTBRamlqeXFKSkFjWEFj?=
 =?utf-8?B?RkJnSjVQQkJQbGFKTnJQSFR3dW5oV0RwSENwL3dUcnpwcnV3VDBCSUgwcU9y?=
 =?utf-8?B?WnBxQVpQQ1pZZ1YvZVVsZHYvQUoxbG92dUloNTZlMi9Pbm96aDlGajNqTVN1?=
 =?utf-8?B?TmdyRXp5cDFIM0N2TmI0bWFqaGRRR1VNYlBYam5kNWk0SVVxNEkvRnQvY3V6?=
 =?utf-8?B?bGNXSHNTUkdsem9BOFhBREpGVitxNXVIWG1ZcW9HRGNvWkdxU1dpYWZYYkxx?=
 =?utf-8?B?d25jalorZGVKdXpyMk4rM3lxMThXYkU0Y3FBck5PWFBUM3BnNThsRk41U1lm?=
 =?utf-8?B?TUJ0dWJQZmE5ejlxcGRZdGs2UGYzOXVKNVhaL2NTLzFQQ3YycEZBeFEwWS9T?=
 =?utf-8?B?bENmUmFGZ2RRdHpzWjhQU1BKdmpXc0VDbFp4akN3WG1ldktlemlWWjAzNENx?=
 =?utf-8?B?U1hPb2d3aklBa0hzODkySkRCTU5lblVYdkRTMzhpUWo0WDNXUW10dXcrbG5W?=
 =?utf-8?B?TVZWbk5PR0trMWZhbUpmaVBPT1EvMjRRSDAyUkVqM3IxWm1hVkZicEpFakVN?=
 =?utf-8?B?UDZscTA4UXhGVFVVNVdlZVdSc25iN2VYREZ4bmIxR2ZmV09EQWxJTXBoMmlF?=
 =?utf-8?B?NmZwQmZEYVkxRzZ1OXBsaWJOaFJoV2tlTEV4d2pic1E4WlM3dTlycHNoMGFR?=
 =?utf-8?B?WDVLUnVLUDZKOEVXYjJJRmY3UC9Ydy81SzA1bWtid1dpbDgvenkrMWFxN1M3?=
 =?utf-8?B?Z0VaNXo0WmlLdFdTZUdUWUNiUHhqQzRTSGNwQWNEVVovMEcySWt2K1JLdnkw?=
 =?utf-8?B?VWJMMVRHekUxcGwwelQxMkpQVmVZTmpnL0swZXZJWk9mR3pBNGF4cGFyVW5H?=
 =?utf-8?B?R0NSaDBFd29OMk0wMG9ScGJvKzRDM3UzaTZORHFTbzhuczZocmpTbTJXZldH?=
 =?utf-8?B?R004ZVFNOGxtWnNqRFZUUnJnL1I0eU1BSndzY3RLR0Q2M0FaR2R1Wms5NTMy?=
 =?utf-8?B?QmVHRW4renVJNXFjcjVPd3JHWm9zK0gvSk83anJMbXN6ekdOZit3TmMxZk1t?=
 =?utf-8?Q?7ygVYIzFJIZrZVeJm4Nl5pXki?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 43fc916b-c7bd-4dd9-218b-08dc440c6c43
X-MS-Exchange-CrossTenant-AuthSource: PH7PR12MB5596.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Mar 2024 09:52:12.9902
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: xfYmv720lUWeTkDEMEOcqljIHziJwqUxZP26Z28RefjcV9eAQZjGBc1yL5rGqpIccav77vW6aKcdgSRWHPy34g==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR12MB8052


On 3/14/2024 11:40 AM, Sharma, Shashank wrote:
>
> On 14/03/2024 06:58, Khatri, Sunil wrote:
>>
>> On 3/14/2024 2:06 AM, Alex Deucher wrote:
>>> On Tue, Mar 12, 2024 at 8:42 AM Sunil Khatri <sunil.khatri@amd.com> 
>>> wrote:
>>>> Add firmware version information of each
>>>> IP and each instance where applicable.
>>>>
>>> Is there a way we can share some common code with devcoredump,
>>> debugfs, and the info IOCTL?  All three places need to query this
>>> information and the same logic is repeated in each case.
>>
>> Hello Alex,
>>
>> Yes you re absolutely right the same information is being retrieved 
>> again as done in debugfs. I can reorganize the code so same function 
>> could be used by debugfs and devcoredump but this is exactly what i 
>> tried to avoid here. I did try to use minimum functionality in 
>> devcoredump without shuffling a lot of code here and there.
>>
>> Also our devcoredump is implemented in amdgpu_reset.c and not all the 
>> information is available here and there we might have to include lot 
>> of header and cross functions in amdgpu_reset until we want a 
>> dedicated file for devcoredump.
>
>
> I think Alex is suggesting to have one common backend to generate all 
> the core debug info, and then different wrapper functions which can 
> pack this raw info into the packets aligned with respective infra like 
> devcore/debugfs/info IOCTL, which seems like a good idea to me.
>
> If you think you need a new file for this backend it should be fine.
My suggestion was on same lines that if we want to use the same infra to 
access information from different parts of the code then we need to 
reorganize. And at same time since there is quite some data we are 
planning to add in devcoredump so i recommend to have a dedicated .c/.h 
instead of using amdgpu_reset.c so a clean include is easy to maintain.

Once Alex confirms it i can start working on design and what all 
information we need on this.

Regards
Sunil

>
> something like:
>
> amdgpu_debug_core.c::
>
> struct amdgpu_core_debug_info {
>
> /* Superset of all the info you are collecting from HW */
>
> };
>
> - amdgpu_debug_generate_core_info
>
> {
>
> /* This function collects the core debug info from HW and saves in 
> amdgpu_core_debug_info,
>
>   we can update this periodically regardless of a request */
>
> }
>
> and then:
>
> devcore_info *amdgpu_debug_pack_for_devcore(core_debug_info)
>
> {
>
> /* convert core debug info into devcore aligned format/data */
>
> }
>
> ioctl_info *amdgpu_debug_pack_for_info_ioctl(core_debug_info)
>
> {
>
> /* convert core debug info into info IOCTL aligned format/data */
>
> }
>
> debugfs_info *amdgpu_debug_pack_for_debugfs(core_debug_info)
>
> {
>
> /* convert core debug info into debugfs aligned format/data */
>
> }
>
> - Shashank
>
>>
>>
>>
>> Info IOCTL does have a lot of information which also is in pipeline 
>> to be dumped but this if we want to reuse the functionality of IOCTL 
>> we need to reorganize a lot of code.
>>
>> If that is the need of the hour i could work on that. Please let me 
>> know.
>>
>> This is my suggestion if it makes sense:
>>
>> 1. If we want to reuse a lot of functionality then we need to 
>> modularize some of the functions further so they could be consumed 
>> directly by devcoredump.
>> 2. We should also have a dedicated file for devcoredump.c/.h so its 
>> easy to include headers of needed functionality cleanly and easy to 
>> expand devcoredump.
>> 3. based on the priority and importance of this task we can add 
>> information else some repetition is a real possibility.
>>
>>>
>>> Alex
>>>
>>>
>>>> Signed-off-by: Sunil Khatri <sunil.khatri@amd.com>
>>>> ---
>>>>   drivers/gpu/drm/amd/amdgpu/amdgpu_reset.c | 122 
>>>> ++++++++++++++++++++++
>>>>   1 file changed, 122 insertions(+)
>>>>
>>>> diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_reset.c 
>>>> b/drivers/gpu/drm/amd/amdgpu/amdgpu_reset.c
>>>> index 611fdb90a1fc..78ddc58aef67 100644
>>>> --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_reset.c
>>>> +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_reset.c
>>>> @@ -168,6 +168,123 @@ void amdgpu_coredump(struct amdgpu_device 
>>>> *adev, bool vram_lost,
>>>>   {
>>>>   }
>>>>   #else
>>>> +static void amdgpu_devcoredump_fw_info(struct amdgpu_device *adev, 
>>>> struct drm_printer *p)
>>>> +{
>>>> +       uint32_t version;
>>>> +       uint32_t feature;
>>>> +       uint8_t smu_program, smu_major, smu_minor, smu_debug;
>>>> +
>>>> +       drm_printf(p, "VCE feature version: %u, fw version: 0x%08x\n",
>>>> +                  adev->vce.fb_version, adev->vce.fw_version);
>>>> +       drm_printf(p, "UVD feature version: %u, fw version: 0x%08x\n",
>>>> +                  0, adev->uvd.fw_version);
>>>> +       drm_printf(p, "GMC feature version: %u, fw version: 0x%08x\n",
>>>> +                  0, adev->gmc.fw_version);
>>>> +       drm_printf(p, "ME feature version: %u, fw version: 0x%08x\n",
>>>> +                  adev->gfx.me_feature_version, 
>>>> adev->gfx.me_fw_version);
>>>> +       drm_printf(p, "PFP feature version: %u, fw version: 0x%08x\n",
>>>> +                  adev->gfx.pfp_feature_version, 
>>>> adev->gfx.pfp_fw_version);
>>>> +       drm_printf(p, "CE feature version: %u, fw version: 0x%08x\n",
>>>> +                  adev->gfx.ce_feature_version, 
>>>> adev->gfx.ce_fw_version);
>>>> +       drm_printf(p, "RLC feature version: %u, fw version: 0x%08x\n",
>>>> +                  adev->gfx.rlc_feature_version, 
>>>> adev->gfx.rlc_fw_version);
>>>> +
>>>> +       drm_printf(p, "RLC SRLC feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  adev->gfx.rlc_srlc_feature_version,
>>>> +                  adev->gfx.rlc_srlc_fw_version);
>>>> +       drm_printf(p, "RLC SRLG feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  adev->gfx.rlc_srlg_feature_version,
>>>> +                  adev->gfx.rlc_srlg_fw_version);
>>>> +       drm_printf(p, "RLC SRLS feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  adev->gfx.rlc_srls_feature_version,
>>>> +                  adev->gfx.rlc_srls_fw_version);
>>>> +       drm_printf(p, "RLCP feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  adev->gfx.rlcp_ucode_feature_version,
>>>> +                  adev->gfx.rlcp_ucode_version);
>>>> +       drm_printf(p, "RLCV feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  adev->gfx.rlcv_ucode_feature_version,
>>>> +                  adev->gfx.rlcv_ucode_version);
>>>> +       drm_printf(p, "MEC feature version: %u, fw version: 0x%08x\n",
>>>> +                  adev->gfx.mec_feature_version,
>>>> +                  adev->gfx.mec_fw_version);
>>>> +
>>>> +       if (adev->gfx.mec2_fw)
>>>> +               drm_printf(p,
>>>> +                          "MEC2 feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> + adev->gfx.mec2_feature_version,
>>>> +                          adev->gfx.mec2_fw_version);
>>>> +
>>>> +       drm_printf(p, "IMU feature version: %u, fw version: 0x%08x\n",
>>>> +                  0, adev->gfx.imu_fw_version);
>>>> +       drm_printf(p, "PSP SOS feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  adev->psp.sos.feature_version,
>>>> +                  adev->psp.sos.fw_version);
>>>> +       drm_printf(p, "PSP ASD feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> + adev->psp.asd_context.bin_desc.feature_version,
>>>> + adev->psp.asd_context.bin_desc.fw_version);
>>>> +
>>>> +       drm_printf(p, "TA XGMI feature version: 0x%08x, fw version: 
>>>> 0x%08x\n",
>>>> + adev->psp.xgmi_context.context.bin_desc.feature_version,
>>>> + adev->psp.xgmi_context.context.bin_desc.fw_version);
>>>> +       drm_printf(p, "TA RAS feature version: 0x%08x, fw version: 
>>>> 0x%08x\n",
>>>> + adev->psp.ras_context.context.bin_desc.feature_version,
>>>> + adev->psp.ras_context.context.bin_desc.fw_version);
>>>> +       drm_printf(p, "TA HDCP feature version: 0x%08x, fw version: 
>>>> 0x%08x\n",
>>>> + adev->psp.hdcp_context.context.bin_desc.feature_version,
>>>> + adev->psp.hdcp_context.context.bin_desc.fw_version);
>>>> +       drm_printf(p, "TA DTM feature version: 0x%08x, fw version: 
>>>> 0x%08x\n",
>>>> + adev->psp.dtm_context.context.bin_desc.feature_version,
>>>> + adev->psp.dtm_context.context.bin_desc.fw_version);
>>>> +       drm_printf(p, "TA RAP feature version: 0x%08x, fw version: 
>>>> 0x%08x\n",
>>>> + adev->psp.rap_context.context.bin_desc.feature_version,
>>>> + adev->psp.rap_context.context.bin_desc.fw_version);
>>>> +       drm_printf(p, "TA SECURE DISPLAY feature version: 0x%08x, 
>>>> fw version: 0x%08x\n",
>>>> + adev->psp.securedisplay_context.context.bin_desc.feature_version,
>>>> + adev->psp.securedisplay_context.context.bin_desc.fw_version);
>>>> +
>>>> +       /* SMC firmware */
>>>> +       version = adev->pm.fw_version;
>>>> +
>>>> +       smu_program = (version >> 24) & 0xff;
>>>> +       smu_major = (version >> 16) & 0xff;
>>>> +       smu_minor = (version >> 8) & 0xff;
>>>> +       smu_debug = (version >> 0) & 0xff;
>>>> +       drm_printf(p, "SMC feature version: %u, program: %d, fw 
>>>> version: 0x%08x (%d.%d.%d)\n",
>>>> +                  0, smu_program, version, smu_major, smu_minor, 
>>>> smu_debug);
>>>> +
>>>> +       /* SDMA firmware */
>>>> +       for (int i = 0; i < adev->sdma.num_instances; i++) {
>>>> +               drm_printf(p, "SDMA%d feature version: %u, firmware 
>>>> version: 0x%08x\n",
>>>> +                          i, adev->sdma.instance[i].feature_version,
>>>> + adev->sdma.instance[i].fw_version);
>>>> +       }
>>>> +
>>>> +       drm_printf(p, "VCN feature version: %u, fw version: 0x%08x\n",
>>>> +                  0, adev->vcn.fw_version);
>>>> +       drm_printf(p, "DMCU feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  0, adev->dm.dmcu_fw_version);
>>>> +       drm_printf(p, "DMCUB feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  0, adev->dm.dmcub_fw_version);
>>>> +       drm_printf(p, "PSP TOC feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  adev->psp.toc.feature_version, 
>>>> adev->psp.toc.fw_version);
>>>> +
>>>> +       version = adev->mes.kiq_version & AMDGPU_MES_VERSION_MASK;
>>>> +       feature = (adev->mes.kiq_version & 
>>>> AMDGPU_MES_FEAT_VERSION_MASK)
>>>> +                                       >> 
>>>> AMDGPU_MES_FEAT_VERSION_SHIFT;
>>>> +       drm_printf(p, "MES_KIQ feature version: %u, fw version: 
>>>> 0x%08x\n",
>>>> +                  feature, version);
>>>> +
>>>> +       version = adev->mes.sched_version & AMDGPU_MES_VERSION_MASK;
>>>> +       feature = (adev->mes.sched_version & 
>>>> AMDGPU_MES_FEAT_VERSION_MASK)
>>>> +                                       >> 
>>>> AMDGPU_MES_FEAT_VERSION_SHIFT;
>>>> +       drm_printf(p, "MES feature version: %u, fw version: 0x%08x\n",
>>>> +                  feature, version);
>>>> +
>>>> +       drm_printf(p, "VPE feature version: %u, fw version: 0x%08x\n",
>>>> +                  adev->vpe.feature_version, adev->vpe.fw_version);
>>>> +
>>>> +}
>>>> +
>>>>   static ssize_t
>>>>   amdgpu_devcoredump_read(char *buffer, loff_t offset, size_t count,
>>>>                          void *data, size_t datalen)
>>>> @@ -215,6 +332,11 @@ amdgpu_devcoredump_read(char *buffer, loff_t 
>>>> offset, size_t count,
>>>>                  }
>>>>          }
>>>>
>>>> +       if (coredump->adev) {
>>>> +               drm_printf(&p, "IP Firmwares\n");
>>>> + amdgpu_devcoredump_fw_info(coredump->adev, &p);
>>>> +       }
>>>> +
>>>>          if (coredump->ring) {
>>>>                  drm_printf(&p, "\nRing timed out details\n");
>>>>                  drm_printf(&p, "IP Type: %d Ring Name: %s\n",
>>>> -- 
>>>> 2.34.1
>>>>