Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19;
Message-ID: <1f003356-3cf9-7237-501e-950d0aa124d1@amd.com>
Date:   Thu, 17 Mar 2022 11:08:35 -0400
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101
 Thunderbird/91.5.0
Subject: Re: [PATCH 1/1] drm/amdkfd: Protect the Client whilst it is being
 operated on
Content-Language: en-US
To:     Lee Jones <lee.jones@linaro.org>
Cc:     David Airlie <airlied@linux.ie>,
        "Pan, Xinhui" <Xinhui.Pan@amd.com>, linux-kernel@vger.kernel.org,
        dri-devel@lists.freedesktop.org, amd-gfx@lists.freedesktop.org,
        Alex Deucher <alexander.deucher@amd.com>,
        =?UTF-8?Q?Christian_K=c3=b6nig?= <christian.koenig@amd.com>
References: <20220317131610.554347-1-lee.jones@linaro.org>
 <8702f8a5-62a1-c07e-c7b7-e9378be069b6@amd.com> <YjNNCXc8harOvwqe@google.com>
From:   Felix Kuehling <felix.kuehling@amd.com>
In-Reply-To: <YjNNCXc8harOvwqe@google.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?K2pBS1QzQ3VxdWNxMzdzd0FiMVc3Vi9nb09Id2w4K0xuUitvdmJqekVFWHla?=
 =?utf-8?B?NnJya0dCYzNSMUJsR0ZGamxUVGZTN3RJbmhTbXRDeU5VT2Y5S3A4VWl5Tjl0?=
 =?utf-8?B?Vm16WTF2N3ViU3E1YlpZRFgyZjlEMzV0aDJIWjNYV2FMYjJNY1h1MW1jOVh1?=
 =?utf-8?B?anhLcXZlaGJuR3hDdVhtWVZNNVZudU5VZy8yampZaHVvbTFwdzcwdUhuSnJ3?=
 =?utf-8?B?Y3h0NEpWaTJucmwyYWRjTnFhaXJ1NXl0c2JYRmxPaElUWmEvREV3c1NRNnRh?=
 =?utf-8?B?MXJ0cEJERTRJbUh4UWhtUi81bTVQczNvVlVZSzFEdk1GbUp5ZDhLblRRZU4w?=
 =?utf-8?B?UDFaa21lcGhiajVmeUhUQ1pHVjNMaDA3WmlMOUNnV2ZHdU9QbTdTcHVkVm1E?=
 =?utf-8?B?bHg4dWNkd2JiRUtZYWdmZE9UeGo4N1BKbnJqQlQzM1VsQmVoMUtxM01mVk1k?=
 =?utf-8?B?dlZna1V6dWxhb2ZLeUM1TFFwWG5YckJnSXJZZ2s2em80alRKWERxb1QvL3ha?=
 =?utf-8?B?QWdLVU9tdXY0TEhiWTViUmlSNStvUWJDa2FDcHVtb0N2WldJa3FhQTJhYmQ2?=
 =?utf-8?B?Y01HbDlPMmQrSElPOHNINEdrMnd6K2lBUjcxdEFLcmo4ZHBoRGQraFl1WFFz?=
 =?utf-8?B?RXZkTUtLb3g1YnUzWHVmOEhZTWZzWk02a3VpaUhBWFBid3RrcUp5SFJONGdC?=
 =?utf-8?B?Q2o5UEcycUhKdTAwZXYzRDNFNmNlSEdlU2F5WWFXMWdmaFRTbW5qSkpjbU9r?=
 =?utf-8?B?Q3dTaVk2SmZMR3ZhbmRzTWpRalBMRS91MGpuR3QxQlpnajFNL0RIUlJDTFR2?=
 =?utf-8?B?cEk1RERUV1hlaVNQWVRqS3BLdE9YQUp0bHpydWhKSGNVcFp0Q2FJdHVJR3lW?=
 =?utf-8?B?Y3FsdGZrTDV0cjc0L1NXQVF2WG1xOEhEaDdqeSt5MStTSTdyR1ZzSTdkTDN5?=
 =?utf-8?B?NG04Ym56RlQ1TXNoOElhK1BlTUpiNTdmdWkvNkRhT2lPUWxibEg3Ulhid0hK?=
 =?utf-8?B?bDNHWWF6MUtJbU9wc0lneVhFY3JMVTdPZlkzek1RYUM3S2JFdWp4SHQxTUlv?=
 =?utf-8?B?OGZiS04xRVhmUnNJbzFrV0Zldnh6eExvQ0VUNjZqY0pGN3h5MmtBa3NDOGhy?=
 =?utf-8?B?M0QwNkFqcTZDSnE3SnJjS1h6cTVCNFRxQzI0c2JJWUNlNjYvNjM5dXNQdnV3?=
 =?utf-8?B?MVVjbExyVHFkQis2QTNLeG1VZ1VDMFhBZXU5dGtjaFg5aXZXNXB4SE5HU051?=
 =?utf-8?B?ZURmcTlxRXVKUVVCWC81TVRWbzdmb01JdkpvZXV4Rjc0SG9sY1JMUFpOTm45?=
 =?utf-8?B?YUV0bDBiK0RPc3k1NlU5YWk5RzdtTEx0YU1hYmo0b3c0MDlGSkVnQVpQSWI3?=
 =?utf-8?B?dS9RMmRnWWZLUC9VblVkT0hrUTRFWW5VQWZZeEJrRmZZbHdydjdaUUxpK01K?=
 =?utf-8?B?NDZ0RjN0dU5ISHMxSnNSV041R3Y1WnNJNHplRFZ1SHUrN3Frc0s1Ynlnc2Ir?=
 =?utf-8?B?ZFIyZFBoNVZROUJPMUY3cVI1NWNzWDQrUmtUdG42d3BXTlo2ejVrWGJ1ajlY?=
 =?utf-8?B?U0UxN29YU241V2lqNGJEQVN4eW9IQTZvZEpmSFNDTk45d0NqQzFPU0crTis2?=
 =?utf-8?B?elpzVTJ6YlY1MXhEaWkwWStrdkpSSHpoUXducjluNmxzYW85QVhPTlNDRFRR?=
 =?utf-8?B?cFVLTk1ua3o0VDk4S0htWWFaemZyLzVNVmhYZ1F3dmVzOGFUZERFZTV0RE1D?=
 =?utf-8?B?Lys1RS8xbVZCZXlCTElXRUFaUENMVkxDUFU3d01raVpqMjF0SEZkQ2plemdI?=
 =?utf-8?B?TzU3ZGJ2Wm9EQ2Y3M2hoekhhZFdzVlZHVXk2Z3paZHhxZW5RR083Wm5WaGtB?=
 =?utf-8?B?RTNWUU1WU01FNnU0WmRMTS9tQkNoZHR0SktMd21kbkhMMzhWb21xWlFFaCsr?=
 =?utf-8?Q?VkzY7pANMKSJDx0UWCaeo0c+zXBC/tDU?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 3eb8443c-1c34-4995-1f99-08da08280359
X-MS-Exchange-CrossTenant-AuthSource: BN9PR12MB5115.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Mar 2022 15:08:37.5482
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: tI6O5GAJgdnJ/BX9WKC1ARRH2T32cQeDHkVMPFXY8uvAE2si6Dn96cKfIYlI5xtD33/NVbTAiarnfjc3PP9NUw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4533
X-Spam-Status: No, score=-2.0 required=5.0 tests=BAYES_00,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,NICE_REPLY_A,RDNS_NONE,SPF_HELO_NONE,
	T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
	lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


Am 2022-03-17 um 11:00 schrieb Lee Jones:
> Good afternoon Felix,
>
> Thanks for your review.
>
>> Am 2022-03-17 um 09:16 schrieb Lee Jones:
>>> Presently the Client can be freed whilst still in use.
>>>
>>> Use the already provided lock to prevent this.
>>>
>>> Cc: Felix Kuehling <Felix.Kuehling@amd.com>
>>> Cc: Alex Deucher <alexander.deucher@amd.com>
>>> Cc: "Christian König" <christian.koenig@amd.com>
>>> Cc: "Pan, Xinhui" <Xinhui.Pan@amd.com>
>>> Cc: David Airlie <airlied@linux.ie>
>>> Cc: Daniel Vetter <daniel@ffwll.ch>
>>> Cc: amd-gfx@lists.freedesktop.org
>>> Cc: dri-devel@lists.freedesktop.org
>>> Signed-off-by: Lee Jones <lee.jones@linaro.org>
>>> ---
>>>    drivers/gpu/drm/amd/amdkfd/kfd_smi_events.c | 6 ++++++
>>>    1 file changed, 6 insertions(+)
>>>
>>> diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_smi_events.c b/drivers/gpu/drm/amd/amdkfd/kfd_smi_events.c
>>> index e4beebb1c80a2..3b9ac1e87231f 100644
>>> --- a/drivers/gpu/drm/amd/amdkfd/kfd_smi_events.c
>>> +++ b/drivers/gpu/drm/amd/amdkfd/kfd_smi_events.c
>>> @@ -145,8 +145,11 @@ static int kfd_smi_ev_release(struct inode *inode, struct file *filep)
>>>    	spin_unlock(&dev->smi_lock);
>>>    	synchronize_rcu();
>>> +
>>> +	spin_lock(&client->lock);
>>>    	kfifo_free(&client->fifo);
>>>    	kfree(client);
>>> +	spin_unlock(&client->lock);
>> The spin_unlock is after the spinlock data structure has been freed.
> Good point.
>
> If we go forward with this approach the unlock should perhaps be moved
> to just before the kfree().
>
>> There
>> should be no concurrent users here, since we are freeing the data structure.
>> If there still are concurrent users at this point, they will crash anyway.
>> So the locking is unnecessary.
> The users may well crash, as does the kernel unfortunately.
We only get to kfd_smi_ev_release when the file descriptor is closed. 
User mode has no way to use the client any more at this point. This 
function also removes the client from the dev->smi_cllients list. So no 
more events will be added to the client. Therefore it is safe to free 
the client.

If any of the above were not true, it would not be safe to kfree(client).

But if it is safe to kfree(client), then there is no need for the locking.

Regards,
   Felix


>
>>>    	return 0;
>>>    }
>>> @@ -247,11 +250,13 @@ int kfd_smi_event_open(struct kfd_dev *dev, uint32_t *fd)
>>>    		return ret;
>>>    	}
>>> +	spin_lock(&client->lock);
>> The client was just allocated, and it wasn't added to the client list or
>> given to user mode yet. So there can be no concurrent users at this point.
>> The locking is unnecessary.
>>
>> There could be potential issues if someone uses the file descriptor by dumb
>> luck before this function returns. So maybe we need to move the
>> anon_inode_getfd to the end of the function (just before list_add_rcu) so
>> that we only create the file descriptor after the client structure is fully
>> initialized.
> Bingo.  Well done. :)
>
> I can move the function as suggested if that is the best route forward?
>