Received-SPF: pass (google.com: domain of linux-kernel+bounces-138593-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1;
Message-ID: <f4874ba7-4933-474a-b5d1-c00e6ec25bbd@intel.com>
Date: Wed, 10 Apr 2024 15:12:10 +0200
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH net-next v9 7/9] libeth: add Rx buffer management
Content-Language: en-US
To: Alexander Lobakin <aleksander.lobakin@intel.com>
CC: "David S. Miller" <davem@davemloft.net>, Eric Dumazet
	<edumazet@google.com>, Jakub Kicinski <kuba@kernel.org>, Paolo Abeni
	<pabeni@redhat.com>, Alexander Duyck <alexanderduyck@fb.com>, Yunsheng Lin
	<linyunsheng@huawei.com>, Jesper Dangaard Brouer <hawk@kernel.org>, "Ilias
 Apalodimas" <ilias.apalodimas@linaro.org>, Christoph Lameter <cl@linux.com>,
	Vlastimil Babka <vbabka@suse.cz>, Andrew Morton <akpm@linux-foundation.org>,
	<nex.sw.ncis.osdt.itp.upstreaming@intel.com>, <netdev@vger.kernel.org>,
	<intel-wired-lan@lists.osuosl.org>, <linux-mm@kvack.org>,
	<linux-kernel@vger.kernel.org>
References: <20240404154402.3581254-1-aleksander.lobakin@intel.com>
 <20240404154402.3581254-8-aleksander.lobakin@intel.com>
 <45eb2bf1-e7b0-4045-82b3-93b9f81b7988@intel.com>
 <bebf1a1a-e4ec-4ec0-9d01-57a51bcf14ca@intel.com>
 <9d389192-63c4-44e8-b863-6323b45aec0f@intel.com>
 <36a067fa-75c0-4e7d-b704-229deea2d440@intel.com>
 <61a952aa-1b3e-43c7-9f35-ab53e492305a@intel.com>
 <b1438638-a6f9-4a88-b8fe-7bec28ba124f@intel.com>
From: Przemek Kitszel <przemyslaw.kitszel@intel.com>
In-Reply-To: <b1438638-a6f9-4a88-b8fe-7bec28ba124f@intel.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?N1huRUZ6NjhOT2JuZGYzMmI2Zjh6TVEydXdkZm8xY1pEekh0dTcvZTFpYXky?=
 =?utf-8?B?cWp5ZUJiN2Vwc0c5MzhidUZIdTJZVFBQV0JNQkNqclFyZHd1aDI1clVseUtz?=
 =?utf-8?B?VmhISDJzTzgxWWxyZFVueHo3bFQrSUhIaDBtUmR5RDBndEFrWjlxSUM1blU5?=
 =?utf-8?B?OHpSRTRScGxpdVNyY25BQjk4bUUrOFVLbnU5RFk4ZHYzM25OTFhxczNYS1or?=
 =?utf-8?B?Z0V1MVU1MUNQc0pkQWxlbVBSYmthM1NoZnI3QkdWOWFZOTlLUHNhanNpcDd2?=
 =?utf-8?B?T0N6SklxQjI2c2tNRUFXd2puVVZLelcvUU1WZUhZM3RhNnhCaCttVHdtaWNZ?=
 =?utf-8?B?dzczeUFQa2ErUEdEU09UUXJzWFJ4aXFWZ3ZoY0xjWHE4c2ZTdVB6ZzJVNjNt?=
 =?utf-8?B?N3dMc2RheUtWMlllWTdtcGtoQk9tOEVsTnBiWVZEM3pURlJIZWNXTVJORW0z?=
 =?utf-8?B?cGdIV1FmeXZ1MUNBd0FCNW00T3V0Q0N2cWFKVHQ3TDM2K2c0em40Z1N1Z2c5?=
 =?utf-8?B?QkRhR3hhNDY5TWxLTUpFT0UrQmFxVG5pbnhkWVhnT0RYZ0VQWHp6Z1M4Tks2?=
 =?utf-8?B?WVFBeEJHWi9pb0p5MUdZK3N4SXh6Q2dQQndJUUZIbWR2K2xuZFBzZTFHYllU?=
 =?utf-8?B?NXgyVFR0b2hVWEF1Y3UwV0gzM1MzTzJTZENBcEdaS1ZOcExCSGJOc0hHVVhi?=
 =?utf-8?B?YjgzTHRoNHB3dEltSjFWQ1lkSGkrQVF1dmVYRWlIU3NNMUdjckNVQjBYTTR6?=
 =?utf-8?B?R1BicFUxSDdOb2FQL3BEWmVJM1VmMVBxVThMaUFKUHRCM29mVUU5NkRGR1gv?=
 =?utf-8?B?TDRzemlxeEJNU0NEVGJLanVoVmo3QWIvZWJDSERhbWZNOUdMOHRvamRIU1pH?=
 =?utf-8?B?VVVtT09IM3RBWmRUNmduL3JHVHBES1RyTHZUdjhaZDdSbEthZE9hYXlLcHdm?=
 =?utf-8?B?TmZYWS9jM0VkN2kzeFBsZGlkQnFTY2VtWkFUbVdzZTRteFlIZkFTMEhCQlU3?=
 =?utf-8?B?Smw4YjA0M2xpQVYybjQ3SkVlZGRWNXpzR1lDMkFFTkIveExHNXdCaG5qc2Mz?=
 =?utf-8?B?aE12cUNXVVNvaUVDaGtSbVFmdE5ROWFNZTkrMkFjTW0rcmdNZmZaY0xlb3hz?=
 =?utf-8?B?TGl6UFlXd2h3dmFEUHNRa2tHT1JaNkhFdDUxZ3RtZkdtalMxS25sT0F4NlB2?=
 =?utf-8?B?ajZacXZOdzJMd1ZPdWR3cExYYTJlL3FtbzBIVHNQcnhPcmR2ellWRGRmdEc5?=
 =?utf-8?B?U2lqTXo3a1lhemFKRXFpQXBSaWdnTTFuZlFnSEUzemFpb21MN0IyUDd4cGNq?=
 =?utf-8?B?bTdIalNsTTB6SnNycW9yb1dRNmRLSVdsemdUNXBEcytyRUhFby9TUHB1d1Vr?=
 =?utf-8?B?VHJXVHNBQUdTYkREOXRmVytySmJmbXlQYkhrbFZOR2RRVGdjbm9yQTg3MnpU?=
 =?utf-8?B?cy9DNS9iYmlCcWp4eTRwdVZYdGlZOTBNUml4L2dwWEF3aXZNb0VKZnAwVjdH?=
 =?utf-8?B?cW5DRlY4eUthNDhFTVFDNVUzdTdwN1BmUjlyOVUwL3M3SnJLVGR6a3M2eXU1?=
 =?utf-8?B?bXI0QU5nWENEeXpiSyttQ0dod3ZrMzBZbzhZQXFnQ0VWYmFUYW5XaC85WEdk?=
 =?utf-8?B?ZGhFdlJrLzNkQWt5ZXNhcUlwTDNSbVpoK0VLd3JLaWhvWEthNmR2SmlrMFFK?=
 =?utf-8?B?WmkvU2JQK3hNWmJLbWw1dWlocmtLcklLTHhzcENBSzBQVlBVK2g1SVlYRjU5?=
 =?utf-8?B?YVlhTTdDYS9ZZWk3K3EzeTUrK2hVTWsxNzA3SnVSemtZbERYRHRqc0xIM3pM?=
 =?utf-8?B?YlhKSE52WFUvVm9FdXlYdGFOMldwRys1ckd0TVdtRFp2bnIxV0xZdzRZR1Ns?=
 =?utf-8?B?UXppZ3JnQ1ZoY1dSNm1ZWklQMDVvb0V3V3hYTUk2ZUpRWkNaWFY3OTlQV2dY?=
 =?utf-8?B?QS84R0pWcEgyKzZzbDltRHdnK2IxZHBPdUo1WGtGeEdtR29KdTJnYlhYTXdX?=
 =?utf-8?B?VXFNSXJRcWJtWEE2dThDVmZCWXNrY1c3N3hkRlFJQlFySFppRE5yYmJKRi9z?=
 =?utf-8?B?elErbkpOeG1NVXIwaWMzR05zSWJLOE05STlJL3BvZ01reXhyNXV4TkVCMWVu?=
 =?utf-8?B?aS9lODJUcjRDZlpEVGRCVklTWDNuSjAveUQwbjFzK0JMYVluanQ3K3Rwckxp?=
 =?utf-8?B?Q3c9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: cc26b9b1-65de-4dc0-3c91-08dc595fd7c1
X-MS-Exchange-CrossTenant-AuthSource: MN6PR11MB8102.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Apr 2024 13:12:15.7293
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: dWdf/wsJX8HpqkXn4a6w5sdVKeretFqRN2ZNl32pwR9s8e+6TXNT0QT462g05+DDX2d3dA6svhoMYHjpMG4R0ahphVZDAFnAnRz8hITZQaU=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR11MB6650
X-OriginatorOrg: intel.com

On 4/10/24 15:01, Alexander Lobakin wrote:
> From: Przemek Kitszel <przemyslaw.kitszel@intel.com>
> Date: Wed, 10 Apr 2024 15:01:32 +0200
> 
>> On 4/10/24 13:49, Alexander Lobakin wrote:
>>> From: Przemek Kitszel <przemyslaw.kitszel@intel.com>
>>> Date: Tue, 9 Apr 2024 12:58:33 +0200
>>>
>>>> On 4/8/24 11:09, Alexander Lobakin wrote:
>>>>> From: Przemek Kitszel <przemyslaw.kitszel@intel.com>
>>>>> Date: Fri, 5 Apr 2024 12:32:55 +0200
>>>>>
>>>>>> On 4/4/24 17:44, Alexander Lobakin wrote:
>>>>>>> Add a couple intuitive helpers to hide Rx buffer implementation
>>>>>>> details
>>>>>
>>>>> [...]
>>>>>
>>>>>>> +struct libeth_fqe {
>>>>>>> +    struct page        *page;
>>>>>>> +    u32            offset;
>>>>>>> +    u32            truesize;
>>>>>>> +} __aligned_largest;
>>>>>>> +
>>>>>>> +/**
>>>>>>> + * struct libeth_fq - structure representing a buffer queue
>>>>>>> + * @fp: hotpath part of the structure
>>>>>>> + * @pp: &page_pool for buffer management
>>>>>>> + * @fqes: array of Rx buffers
>>>>>>> + * @truesize: size to allocate per buffer, w/overhead
>>>>>>> + * @count: number of descriptors/buffers the queue has
>>>>>>> + * @buf_len: HW-writeable length per each buffer
>>>>>>> + * @nid: ID of the closest NUMA node with memory
>>>>>>> + */
>>>>>>> +struct libeth_fq {
>>>>>>> +    struct_group_tagged(libeth_fq_fp, fp,
>>>>>>> +        struct page_pool    *pp;
>>>>>>> +        struct libeth_fqe    *fqes;
>>>>>>> +
>>>>>>> +        u32            truesize;
>>>>>>> +        u32            count;
>>>>>>> +    );
>>>>>>> +
>>>>>>> +    /* Cold fields */
>>>>>>> +    u32            buf_len;
>>>>>>> +    int            nid;
>>>>>>> +};
>>>>>>
>>>>>> [...]
>>>>>>
>>>>>> Could you please unpack the meaning of `fq` and `fqe` acronyms here?
>>>>>
>>>>> Rx:
>>>>>
>>>>> RQ -- receive queue, on which you get Rx DMA complete descriptors
>>>>> FQ -- fill queue, the one you fill with free buffers
>>>>>      FQE -- fill queue element, i.e. smth like "iavf_rx_buffer" or
>>>>> whatever
>>>>>
>>>>> Tx:
>>>>>
>>>>> SQ -- send queue, the one you fill with buffers to transmit
>>>>>      SQE -- send queue element, i.e. "iavf_tx_buffer"
>>>>> CQ -- completion queue, on which you get Tx DMA complete descriptors
>>>>>
>>>>> XDPSQ, XSkRQ etc. -- same as above, but for XDP / XSk
>>>>>
>>>>> I know that rxq, txq, bufq, complq is more common since it's been used
>>>>> for years, but I like these "new" ones more :>
>>>>>
>>>>
>>>> Thank you, that sounds right. If you happen to sent v10, a bit of code
>>>> comment with this info would be useful ;)
>>>
>>> The current kdoc in front of each struct and function declaration is not
>>> enough? :D
>>>
>>> Thanks,
>>> Olek
>>
>> I've asked my initial question just after reading it thrice, without
>> your reply `FQE` was as meaningful as `ABC`
> 
> In the commit:
> 
> + * struct libeth_fqe - structure representing an Rx buffer
> 
> :z
> 
> or you want me to expand FQ, FQE etc. abbrevs in the kdoc?

yes, please very much!

could be as an additional comment at the top of the file too,
with that you could reuse the naming convention later in the file

> 
> Thanks,
> Olek