Message-ID: <92e5a001-a17f-9d05-5412-355e1c436b30@oracle.com>
Date:   Sun, 5 Feb 2023 20:53:30 -0800
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.6.1
Subject: Re: [PATCH v3 5/6] vdpa/mlx5: conditionally show MTU and STATUS in
 config space
Content-Language: en-US
To:     Eli Cohen <elic@nvidia.com>, mst@redhat.com, jasowang@redhat.com,
        parav@nvidia.com
Cc:     virtualization@lists.linux-foundation.org,
        linux-kernel@vger.kernel.org
References: <1675400523-12519-1-git-send-email-si-wei.liu@oracle.com>
 <1675400523-12519-6-git-send-email-si-wei.liu@oracle.com>
 <d6265719-a423-2798-4cd0-b4b57a34878b@nvidia.com>
From:   Si-Wei Liu <si-wei.liu@oracle.com>
Organization: Oracle Corporation
In-Reply-To: <d6265719-a423-2798-4cd0-b4b57a34878b@nvidia.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?Tjhka2Z4VGhNOEVBTXk4cnozNlpUdXVEZEVsbm9MYU96MTlCWUNtVjROV3o5?=
 =?utf-8?B?QjcxQ002Umc3YS95VlRTMG0wWkd0TFg1ZGFCR2FQTVJIZloyempBNmxXUmU1?=
 =?utf-8?B?U1dPdy8yWFBQL2RtWkthK1Z0eXZ0R2o2c3ZUTGpkdVF2cjFjWmhpZGZuQVJJ?=
 =?utf-8?B?MnkvdGdmUXJBL0NTbm9mNUgrYkhCcGppTGUvdXdsSzY0UWlTSy94YVUzTDVM?=
 =?utf-8?B?bTAyaVFXRVIwRUMyRDdxcXJQdDkvaWcxMXRhUkY2R2p5ejF6cFZ2ZGtBNzc2?=
 =?utf-8?B?SHdQRWRIcTlpOHNPdmNGdnIxdW9QWU4yVjZRelZ4dnc0czhHVWFEdEdsYUxH?=
 =?utf-8?B?TllGV2ZaakwxRlcwcDNHbXBzalBHQzJ3NW5idUljMGNhcTY3TStYaFU1M3cv?=
 =?utf-8?B?OTV0anRJZ2d5RWFYU0E0aWJJOWhJOE5zZzdiemJ5NlVSZ1hDU1pyT2x4RkxD?=
 =?utf-8?B?RFBGdlRKem5HRFJEVXhRUldFM0JpUE1qQ3ZnRjZNWVI2MEVVb3RrM2ZzYXBO?=
 =?utf-8?B?b0ZYZXM1aHJYR3JIZnpUbU5uc3c1SVp4TWhyMDNWQ1lMRXFzenhYbmVUVmd2?=
 =?utf-8?B?RFBlN3djbGVlOWxoSlFEK0NzUVlpU0pXWWtjQ0Q1UHl0cUh2UVUydVhlclAx?=
 =?utf-8?B?dXVUaG9oWFlsbHN3elQvZjVsaC9sLzJrNDRoNnFNRGV2MFp2NXJnbUt5dUx2?=
 =?utf-8?B?RGNHdDcrOVB4T1FEOXNxMUd5ZUQwUnFlQ280a0xlWUVOdGs2V3kvY3dmZDZE?=
 =?utf-8?B?bnRpbXg4ZmtqeTBrUHBsTW9xOUlVUldMMDhPajlySE5FVUNxUFVLNUhyMHZu?=
 =?utf-8?B?M0FWM1NjYkNWVGhpazRFL0xLS0RWUE84eCsranl6U2l3MjcrVDBmTFloUXVE?=
 =?utf-8?B?RlNCYmtSakduN1ZUUlBMVVdodXVna1hUb29Wa2p6bk41RXZ1cUQ2RElvQlVr?=
 =?utf-8?B?dXZrSXNUWU1kOW5Vekd5ZjlFUWNGNDJnT3lPVnVmWlgyYnlyOG5RVkZTS0dY?=
 =?utf-8?B?cEZ5UHpyaVlxZ25ROHNmVlByNzlVdmRHaVpUYkNQZDArcUJZSlB5bGpQRTZo?=
 =?utf-8?B?azVVQmowbXBLeVVyZVUwelEvaUZMeTFnVVpTU2grN0hRYVQzWGh1L3hVajFi?=
 =?utf-8?B?VGxrRWJDdmFjcVlzd0xsWjk1ajg2OXJNcktuN3pJWVJ5UU9saFhETU5MTkZa?=
 =?utf-8?B?QWZsbUNpTlB3ejNxV3NiQ29zdzloOHRNN3ltYWpSWXBidmgvcmtqUW8rU25n?=
 =?utf-8?B?SXk4RHRPaVVwbmVsVFBmNzAwNXRnZXRSUnpvaEFBYU56Z2pTZGdqYXNSQjBF?=
 =?utf-8?B?TWZQRmdFUFdleVNhTmJMcHErNU05R3d5TTJqeUtVdmFkU0VYWTB2OExxcDVp?=
 =?utf-8?B?b29rL2tjZ3I3M2NYd1hDNjk1NkllKzVPNzhweWk0VURvQjRXZG45bWZ6ZWdH?=
 =?utf-8?B?eHR4MlhYSnZWVHY0UVJGTVpnY1NCU09EekR6WjBLd1EwazhtbXp5b1FCZTRx?=
 =?utf-8?B?YzMwbU44U2IwMUM4Yit4Mzl6YUFvWjJaTkE1OHBYajZJa281NWhEVGFrV0da?=
 =?utf-8?B?M3hRdG4ycEZ2VzlWY0paaS9waUZrUk1aeUI4V09EcVoyWXhSUDJiT0p3MW1T?=
 =?utf-8?B?SzRMK2czRWNoeWFLSkJGM2g5VzdjZHBhbTdZTm5MK0xtWEV2elBGT3Q4d1hr?=
 =?utf-8?B?dGdUVzJ6MzRJM0c3dHJ6MG4vYUtPTU9VeG1YQ2FuUkswc3VKejBpVmNaL245?=
 =?utf-8?B?bEpqd1VrQWdWZmhsdmwrUTZWRWxKSkpjN01XUTlrMTAxYUlETTVKb3FiWFla?=
 =?utf-8?B?elVpTklXVEJPUnZHd1lOMnRIS1YyR2hqQVpxUHBPbHNUSzd2TUJacXNmZTl0?=
 =?utf-8?B?bDhIQmRZR1BaMmtGWTBxcjZ2c3VJTmVzUmc3K05XOENhRmR5WlhjcjloWnZ6?=
 =?utf-8?B?T0Z4NmVyWXFmeFEydmpiY1BsNTY3djZVWWwyb05USVMzbTlUalAzQjlIcmdV?=
 =?utf-8?B?aXRpazM2YStDNEVrMTZHRzgxTnVLNC9yRG5hOXRBQjY0WTgrWjR0UG9mbVd3?=
 =?utf-8?B?QzkwVWRPTXFKcGVOOHZwRWdzbEVQTmFxU0xRRHAxNnZYRFZJNFlzRjRYa1JJ?=
 =?utf-8?Q?wxlFzZJbGVc7tq+Y6uTJNcpVP?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: mosFwjzI8peUKJ/rJ9tExlx+BKvwjkQM99VlaWr3bYgHTg09CBPObpMK556fHlHdUxBBCDJAYhA9u4E6AVdvGX7NChznz/yJeWNEIKFk8E7JkiJjN6pXSNApfNPI6ovFUnoEiTy4As/HiOVoBXk97VddOANQqkkjsen0E3yHQVt8MgaQHtuhHePv5zJgkaKWs6ippa9lBU/kdb3XufTkrnK2ADX0JI9ATzVr/wWfpmmaylDjtHWorN4Zz4OK5yyeCUpzT4oJMkGoDm0J3fzIX+V596Gm+YBt14onsle0MKja30QZT5EkZrWrsm+xAz5k41bSwkJ8j1rGXpyvfnNoo+/UvN6FNKVS1EpdM3Sm9mtWEXxoCNQr59S9NRhOyi+h4bk7cbL4Ovb1JgU7HoZzQdWBPQRz4UY1ICFjpf9vMUdg6rHmUAbyS50D5a65KiNEmf2PYgqhaOMHd4hc4HM1dC9NXAnooM2u3yrfk/L6p18gPcr4Ejh2Q19GNNGYOq7MfU7037SuP24kp8QvgfArioGLITpycq+c/OtibjIPIv3IitKujrxnH9NcD1P2mz0v3wNPE3ZrhyViWTTaGU4R/8eY/lQJ430GxAWMoTryLyg0by4D7YoWiOm/mXAP5V0s59AIrztrnCXFUtMHIanzYwCU66ec4SjBR4yoT3hl8HKIveYtzsPu49QNlrC6/Wl0YJzhMzcUWy/II2pdI3dP2w6yAAZoZqjI7s/GZKqoG8+1mdpDxsJ4bPQKKUWJjND9IK2TX63fjyyQkSxi3up3WvjX5jtFf1iHawRwYb7Dn0DBtVnkPIBDNQjCaiknrXXs/R+uYUx3X7FqgYC5vMV6YVBz3Rd23+bTLg+JX6iPyrlfEbGOkFM9BsNTs7ta+9GinISBx0HiIfNuXWABu/gSvA==
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 34df053b-7bc8-4940-5fc5-08db07fe1989
X-MS-Exchange-CrossTenant-AuthSource: MW4PR10MB6535.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Feb 2023 04:53:33.5672
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: M292CBFVAfK+29VnKDHXbSu8cNcdbklYjCs0YTAYW7ZNAGu4kd8dbtyyfpHOKuysneyrTrdfn3Efa9Cmp8Ib1A==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL3PR10MB6164
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1
 definitions=2023-02-06_02,2023-02-03_01,2022-06-22_01
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 bulkscore=0 phishscore=0 spamscore=0
 malwarescore=0 suspectscore=0 mlxscore=0 mlxlogscore=999 adultscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2212070000
 definitions=main-2302060042
X-Proofpoint-GUID: EmNh2jID1gTdsgNxnl0GtEEf_zmFsyfT
X-Proofpoint-ORIG-GUID: EmNh2jID1gTdsgNxnl0GtEEf_zmFsyfT
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


On 2/5/2023 1:36 AM, Eli Cohen wrote:
>
> On 03/02/2023 7:02, Si-Wei Liu wrote:
>> The spec says:
>>      mtu only exists if VIRTIO_NET_F_MTU is set
>>      status only exists if VIRTIO_NET_F_STATUS is set
>>
>> We should only show MTU and STATUS conditionally depending on
>> the feature bits.
>>
>> Signed-off-by: Si-Wei Liu <si-wei.liu@oracle.com>
>> ---
>>   drivers/vdpa/mlx5/net/mlx5_vnet.c | 22 ++++++++++++++--------
>>   1 file changed, 14 insertions(+), 8 deletions(-)
>>
>> diff --git a/drivers/vdpa/mlx5/net/mlx5_vnet.c 
>> b/drivers/vdpa/mlx5/net/mlx5_vnet.c
>> index 3a6dbbc6..867ac18 100644
>> --- a/drivers/vdpa/mlx5/net/mlx5_vnet.c
>> +++ b/drivers/vdpa/mlx5/net/mlx5_vnet.c
>> @@ -3009,6 +3009,8 @@ static int event_handler(struct notifier_block 
>> *nb, unsigned long event, void *p
>>       struct mlx5_vdpa_wq_ent *wqent;
>>         if (event == MLX5_EVENT_TYPE_PORT_CHANGE) {
>> +        if (!(ndev->mvdev.actual_features & 
>> BIT_ULL(VIRTIO_NET_F_STATUS)))
>> +            return NOTIFY_DONE;
>>           switch (eqe->sub_type) {
>>           case MLX5_PORT_CHANGE_SUBTYPE_DOWN:
>>           case MLX5_PORT_CHANGE_SUBTYPE_ACTIVE:
>> @@ -3118,16 +3120,20 @@ static int mlx5_vdpa_dev_add(struct 
>> vdpa_mgmt_dev *v_mdev, const char *name,
>>               goto err_alloc;
>>       }
>>   -    err = query_mtu(mdev, &mtu);
>> -    if (err)
>> -        goto err_alloc;
>> +    if (ndev->mvdev.mlx_features & BIT_ULL(VIRTIO_NET_F_MTU)) {
>
> VIRTIO_NET_F_MTU is offered by the device. So conditional is always true. 
With the next patch in series that selectively provisions device 
features to mlx5_vdpa, this conditional will not be always true. That 
was the reason why I made patch 5 and 6 in a single commit, as this 
conditional will only be needed until feature provisioning is supported. 
Basically patch 5 and 6 are logically connected and technically should 
be separated out. I'm now puzzled, what was your thought then the change 
in patch 5 shouldn't be part of patch 6?

> We are not done with feature negotiation at this stage so you
'You' are who? device, driver or guest user?

> may still set a value to device mtu if MTU won't be negotiated 
> eventually. But that is not a problem because the spec says:
>
>  VIRTIO_NET_F_MTU(3) Device maximum MTU reporting is supported. If 
> offered by the device, device
> advises driver about the value of its maximum MTU. If negotiated, the 
> driver uses mtu as the maximum
>
> MTU value.
>
> So the driver will use whatever value is there only if negotiated.
My understanding is that 'vdpa dev config' now displays user provisioned 
config, or default config value advertised by the device, rather than 
what config driver will actually use.

>
>> +        err = query_mtu(mdev, &mtu);
>> +        if (err)
>> +            goto err_alloc;
>>   -    ndev->config.mtu = cpu_to_mlx5vdpa16(mvdev, mtu);
>> +        ndev->config.mtu = cpu_to_mlx5vdpa16(mvdev, mtu);
>> +    }
>>   -    if (get_link_state(mvdev))
>> -        ndev->config.status |= cpu_to_mlx5vdpa16(mvdev, 
>> VIRTIO_NET_S_LINK_UP);
>> -    else
>> -        ndev->config.status &= cpu_to_mlx5vdpa16(mvdev, 
>> ~VIRTIO_NET_S_LINK_UP);
>> +    if (ndev->mvdev.mlx_features & BIT_ULL(VIRTIO_NET_F_STATUS)) {
>> +        if (get_link_state(mvdev))
>> +            ndev->config.status |= cpu_to_mlx5vdpa16(mvdev, 
>> VIRTIO_NET_S_LINK_UP);
>> +        else
>> +            ndev->config.status &= cpu_to_mlx5vdpa16(mvdev, 
>> ~VIRTIO_NET_S_LINK_UP);
>> +    }
> Same thing here. Feature negotiation is not complete yet and if
>
> VIRTIO_NET_F_STATUS ends up not being negotiated, the driver will 
> ignore this value.
See above. With feature provisioning, whether the VIRTIO_NET_F_STATUS 
feature is advertised by device is subject to the device_features value 
provisioned by the host admin users.

-Siwei

>
>>         if (add_config->mask & (1 << VDPA_ATTR_DEV_NET_CFG_MACADDR)) {
>>           memcpy(ndev->config.mac, add_config->net.mac, ETH_ALEN);