Date:   Fri, 17 Feb 2023 13:34:04 -0500
From:   "Liam R. Howlett" <Liam.Howlett@Oracle.com>
To:     Danilo Krummrich <dakr@redhat.com>
Cc:     airlied@gmail.com, daniel@ffwll.ch, tzimmermann@suse.de,
        mripard@kernel.org, corbet@lwn.net, christian.koenig@amd.com,
        bskeggs@redhat.com, matthew.brost@intel.com,
        boris.brezillon@collabora.com, alexdeucher@gmail.com,
        ogabbay@kernel.org, bagasdotme@gmail.com, willy@infradead.org,
        jason@jlekstrand.net, dri-devel@lists.freedesktop.org,
        nouveau@lists.freedesktop.org, linux-doc@vger.kernel.org,
        linux-mm@kvack.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH drm-next v2 03/16] maple_tree: split up MA_STATE() macro
Message-ID: <20230217183404.jmjew5lrduts6cpo@revolver>
Mail-Followup-To: "Liam R. Howlett" <Liam.Howlett@Oracle.com>,
        Danilo Krummrich <dakr@redhat.com>, airlied@gmail.com,
        daniel@ffwll.ch, tzimmermann@suse.de, mripard@kernel.org,
        corbet@lwn.net, christian.koenig@amd.com, bskeggs@redhat.com,
        matthew.brost@intel.com, boris.brezillon@collabora.com,
        alexdeucher@gmail.com, ogabbay@kernel.org, bagasdotme@gmail.com,
        willy@infradead.org, jason@jlekstrand.net,
        dri-devel@lists.freedesktop.org, nouveau@lists.freedesktop.org,
        linux-doc@vger.kernel.org, linux-mm@kvack.org,
        linux-kernel@vger.kernel.org
References: <20230217134422.14116-1-dakr@redhat.com>
 <20230217134422.14116-4-dakr@redhat.com>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20230217134422.14116-4-dakr@redhat.com>
User-Agent: NeoMutt/20220429
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?y3p5892yfFsD/wp3wuxAFE2BjAfh4T8ZFvjHjQAq55rZcRbvbEzAI6V0JSL9?=
 =?us-ascii?Q?LiumwkJy+yh/ir6q0ff4whgWeLvW+d+2mt9O5ZbFXg5hUM/+Eqa9Bk3Yj8Nb?=
 =?us-ascii?Q?Gm/4Kh8sb0BFxeyMhooBCzgIM5XbnVNcx2GTQgwBD/jB4Xo+d+X2Xx/aPPhU?=
 =?us-ascii?Q?v3Kij1TIHCr9NqbH9lAiCWEnKPO+Rb7mIBkfQH9AOGMAtsxOzwtwhWt2RMZH?=
 =?us-ascii?Q?0Bt2L2F88c/cZfLHMS7x/xcY23WXCOIankcX4fGQIEEMTGKZXz5WyiymRxqT?=
 =?us-ascii?Q?QcWpG2jke+r23lztnxnbzS88Dn4Bz6FNcg+9uetR60e/6XhbvHMVxQdfvCdg?=
 =?us-ascii?Q?0H2Xyh4+y4OZiVtGRxvB+2Bmm80wxr4dx0Ro8XNEF0jeHOug7Utvb6wME1MG?=
 =?us-ascii?Q?VQAXnA7hXj08Raj3JoOTfVeVDgk2eCYTLteqhiF14BQrueBYwNlPFZV1LK17?=
 =?us-ascii?Q?o7DEp46yQ6FWfkHQUVG1mEMNk1Mcqj5UUhWXhlh3lF4CWQodk4bxDCWlnSkF?=
 =?us-ascii?Q?uJhad6CNVFddRa+AZGVtaItQn2PM5pB1dYM3VORtb3lO+HWOVs8cqcMrXMHr?=
 =?us-ascii?Q?tLeS2P9jkSWWjW+dUlJ09lOgpdDEl8aNSkYWCRx2FL/AHABVxvIxmZQwoPxH?=
 =?us-ascii?Q?SiFmBn0w2rNfRxifZuuPuTQ6WCwY+9isOVYBtgMy7sOlGzdYsOziIVmPFS66?=
 =?us-ascii?Q?GkrBstn955E3FlIbvxK9qYiWgqiyO1CZT0UD+4l6CIHoYqNeajANecsx4VZu?=
 =?us-ascii?Q?jfpAGWMbCihYPOb9UrZ0merRA8UJ4BfpiyJuLONl7l9sWF8Lt/4J+KD8+UjN?=
 =?us-ascii?Q?pID0aYmz0Ks8KLhWxZa53YIBj0a7Yx2khl/1g9XvJzapSpj2beXf55MRvwWC?=
 =?us-ascii?Q?GMi1AqROqSXAKxhalf8O7Nl/JnfFomZ7NJ2IYsC0TKNxX4okCEl+v1jy25PK?=
 =?us-ascii?Q?aXOeMrTDLI6cVBhdkcMjX2jEArLU5GorTwMOzYEja0Dt3umVPBWEIlI62aI4?=
 =?us-ascii?Q?Pd/shjqeAc9feywhujUGxrSBOaVnahPKMEtpP+YBXsKsplGlQVh86EGphOCo?=
 =?us-ascii?Q?7+lcjKyE65fY1A2Ps5ILdqvaKRf1M1zkzQbd1Tpx3cBRCrFPMeWwxUV9lW4L?=
 =?us-ascii?Q?CWCrC0WqeBFgvhHJ16H4NND/fxUXqZWbeeC6/Xs3ppN1Vd8alqD1R2XxObff?=
 =?us-ascii?Q?77Prw4iSDN3uGvCHPEPjElYRAHBSFyE+U5khP6alQgJqvf9xqE6BrXyqkNtk?=
 =?us-ascii?Q?Q9ecfE7L6tnnkBba08bf9VbD9og0yd3Ev1Ti2+iwam1NDrgbf2Cdm7u7KJlA?=
 =?us-ascii?Q?NvfGm9EPp86DgrM/Nsbvui81tDskQI8Ntii+09PlvQxXUXQzc+Ms2bTQiHnQ?=
 =?us-ascii?Q?XvYzQK5pVE9V9r+CVwBInXtl/2kxYdCMW+4wrFpzkXvZfuryaqGcoE4iMUw7?=
 =?us-ascii?Q?NrcL8jJFicxRyDVPrGteQV0t+IbpHkB2USXYyy8tfl1K/YViZKcznacRfBA8?=
 =?us-ascii?Q?OS9LYmFHp3RSzNGIZMJGF0cKAtOGdQPqXlH6u1s2+IasmdAargtbWxfTJrvC?=
 =?us-ascii?Q?9SdVYyjlwU0AyOEF02l0pbvGnCFqMlFJ0utlhvR8/iKn1l2brBJZgMLf7rST?=
 =?us-ascii?Q?cQ=3D=3D?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: =?us-ascii?Q?/SmYmeCspYEwGFnVJX8CoXNl55p/NKaOy53WpO3g+0Fe+xSHkZSiizyLqY7u?=
 =?us-ascii?Q?vSHNsMIGDjpPDbCY4rcFfU/khOhJTLfZIqdHc2rSImAs0lHmy6V88+AeIbb3?=
 =?us-ascii?Q?lbr4TQsQybgG5aBuG+SgtblPGQi5rtqYQnORAQiv5SN6ODWKBC+g70b5+yMn?=
 =?us-ascii?Q?krYEVwH8nTZmuXB+SpBlGxSU2epifblQ9qXfbB6WIWdA7z7OUZK0hMXZnimm?=
 =?us-ascii?Q?moiYUtDAb++2zm6bnwokSZfEamBKnMVunYnIBsRcUYyJuzJ32zkRW3kcviQ6?=
 =?us-ascii?Q?sIgAr/ml/tNDmj0iMYr7IZHwh5HtrzEiVkxCalQvdK9vPtRFeIZf2Al+KPeI?=
 =?us-ascii?Q?PoS1gdxZKvbRNOIkwWjgsSYTgerYbFSCPKatMot1VJV6EQOCe+cEB7RZmhQX?=
 =?us-ascii?Q?bku1Giribvc5T4Cq5LnE4y3cJr4VXhyz2Anfdy02dK/ltqj8Y3ilGTSNXWWa?=
 =?us-ascii?Q?sNWNX1N1Hhhf/1iO33/PccGQRlHxjrx6CIYWTVwCXBHgzdPnnj11g+5zQuiI?=
 =?us-ascii?Q?DfgiLbs5NTQ1p8nRyo8t1HFcoEGDpUZU9WR/VwKa7zhQQTH2hh2mgZl0sINe?=
 =?us-ascii?Q?9KE7CSmTQeHeID3/3FZFbp3Btllovvagj6cgeN5ixhrVZVj+yEwKAmAGQUvR?=
 =?us-ascii?Q?zO8vSN1ePwulWrzIjJHz6EUSPiFdKOG2InsSHp1e7ZvMDQ0hgumDEym8P76x?=
 =?us-ascii?Q?V+A2wKOj6TWbsbjO4A1t6QaS3rHxONp30Rea20MJW58OdNxd6dBUDIeXlM8H?=
 =?us-ascii?Q?PsqhbIo8TFxKcxOJP9pYzTCd9XWK9y7veSwGiUv8oikhMxxorq7DcSQs2m3P?=
 =?us-ascii?Q?4Gs3XyJyWpJgP6vZY+RYNFLhtcHbk5b5iX4ARgY/3jBm6tBvhHYN7FAJCZi3?=
 =?us-ascii?Q?JuukIM8/Sn1cKR6pMoZx+jGPdN4B19TqURd0pGIF48rQ8ostgQFsETIHUGHj?=
 =?us-ascii?Q?TxM/RyKi7hxx8ppkyEVBV73KIaF4+NYU9Vy21Jd68wVzOGRtnm9NFU5zssm6?=
 =?us-ascii?Q?rbATHz43tCRvD2sL4MeiOO35d7wlc33r0BlmV6o6m/L8Zhs/CIFEYP2R0nr0?=
 =?us-ascii?Q?OM3dfipHqBxXbMHKtbdQkESibq2FNssHVLhGu97fLdviFIP8bDQ2R0H/nHMi?=
 =?us-ascii?Q?Sx8u+CjyNouBqrmLRsSDZHZFylgHi9AmBg=3D=3D?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: c6d72be6-2dda-4768-5b91-08db11158e59
X-MS-Exchange-CrossTenant-AuthSource: SN6PR10MB3022.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Feb 2023 18:34:08.4357
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 8L0/lU3aoIc5Jf+giDsem9yp70PFXsjt7YNKpzJkyPCB88LAQ64qWGr4thdDNOwMU8SsJCQ0YFwQv+85gtFfdA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR10MB6362
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.170.22
 definitions=2023-02-17_12,2023-02-17_01,2023-02-09_01
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 bulkscore=0 adultscore=0
 mlxlogscore=999 phishscore=0 spamscore=0 mlxscore=0 suspectscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2212070000
 definitions=main-2302170164
X-Proofpoint-ORIG-GUID: YJQrBpErSkrSxc0hYjdb-CB5nKXv-kem
X-Proofpoint-GUID: YJQrBpErSkrSxc0hYjdb-CB5nKXv-kem
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

* Danilo Krummrich <dakr@redhat.com> [230217 08:44]:
> Split up the MA_STATE() macro such that components using the maple tree
> can easily inherit from struct ma_state and build custom tree walk
> macros to hide their internals from users.
> 
> Example:
> 
> struct sample_iter {
> 	struct ma_state mas;
> 	struct sample_mgr *mgr;
> 	struct sample_entry *entry;
> };
> 
> \#define SAMPLE_ITER(name, __mgr) \
> 	struct sample_iter name = { \
> 		.mas = __MA_STATE(&(__mgr)->mt, 0, 0),
> 		.mgr = __mgr,
> 		.entry = NULL,
> 	}

I see this patch is to allow for anonymous maple states, this looks
good.

I've a lengthy comment about the iterator that I'm adding here to head
off anyone that may copy your example below.

> 
> \#define sample_iter_for_each_range(it__, start__, end__) \
> 	for ((it__).mas.index = start__, (it__).entry = mas_find(&(it__).mas, end__ - 1); \
> 	     (it__).entry; (it__).entry = mas_find(&(it__).mas, end__ - 1))

I see you've added something like the above in your patch set as well.
I'd like to point out that the index isn't the only state information
that needs to be altered here, and in fact, this could go very wrong.

The maple state has a node and an offset within that node.  If you set
the index to lower than the current position of your iterator and call
mas_find() then what happens is somewhat undefined.  I expect you will
get the wrong value (most likely either the current value or the very
next one that the iterator is already pointing to).  I believe you have
been using a fresh maple state for each iterator in your patches, but I
haven't had a deep look into your code yet.

We have methods of resetting the iterator and set the range (mas_set()
and mas_set_range()) which are safe for what you are doing, but they
will start the walk from the root node to the index again.

So, if you know what you are doing is safe, then the way you have
written it will work, but it's worth mentioning that this could occur.

It is also worth pointing out that it would be much safer to use a
function to do the above so you get type safety.. and I was asked to add
this to the VMA interface by Linus [1], which is on its way upstream [2].

1. https://lore.kernel.org/linux-mm/CAHk-=wg9WQXBGkNdKD2bqocnN73rDswuWsavBB7T-tekykEn_A@mail.gmail.com/
2. https://lore.kernel.org/linux-mm/20230120162650.984577-1-Liam.Howlett@oracle.com/

> 
> Signed-off-by: Danilo Krummrich <dakr@redhat.com>
> ---
>  include/linux/maple_tree.h | 7 +++++--
>  1 file changed, 5 insertions(+), 2 deletions(-)
> 
> diff --git a/include/linux/maple_tree.h b/include/linux/maple_tree.h
> index e594db58a0f1..ca04c900e51a 100644
> --- a/include/linux/maple_tree.h
> +++ b/include/linux/maple_tree.h
> @@ -424,8 +424,8 @@ struct ma_wr_state {
>  #define MA_ERROR(err) \
>  		((struct maple_enode *)(((unsigned long)err << 2) | 2UL))
>  
> -#define MA_STATE(name, mt, first, end)					\
> -	struct ma_state name = {					\
> +#define __MA_STATE(mt, first, end)					\
> +	{								\
>  		.tree = mt,						\
>  		.index = first,						\
>  		.last = end,						\
> @@ -435,6 +435,9 @@ struct ma_wr_state {
>  		.alloc = NULL,						\
>  	}
>  
> +#define MA_STATE(name, mt, first, end)					\
> +	struct ma_state name = __MA_STATE(mt, first, end)
> +
>  #define MA_WR_STATE(name, ma_state, wr_entry)				\
>  	struct ma_wr_state name = {					\
>  		.mas = ma_state,					\
> -- 
> 2.39.1
>