Date:   Tue, 21 Feb 2023 11:52:19 -0500
From:   "Liam R. Howlett" <Liam.Howlett@Oracle.com>
To:     Danilo Krummrich <dakr@redhat.com>
Cc:     airlied@gmail.com, daniel@ffwll.ch, tzimmermann@suse.de,
        mripard@kernel.org, corbet@lwn.net, christian.koenig@amd.com,
        bskeggs@redhat.com, matthew.brost@intel.com,
        boris.brezillon@collabora.com, alexdeucher@gmail.com,
        ogabbay@kernel.org, bagasdotme@gmail.com, willy@infradead.org,
        jason@jlekstrand.net, dri-devel@lists.freedesktop.org,
        nouveau@lists.freedesktop.org, linux-doc@vger.kernel.org,
        linux-mm@kvack.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH drm-next v2 03/16] maple_tree: split up MA_STATE() macro
Message-ID: <20230221165219.omgbrjmow6hszzgt@revolver>
Mail-Followup-To: "Liam R. Howlett" <Liam.Howlett@Oracle.com>,
        Danilo Krummrich <dakr@redhat.com>, airlied@gmail.com,
        daniel@ffwll.ch, tzimmermann@suse.de, mripard@kernel.org,
        corbet@lwn.net, christian.koenig@amd.com, bskeggs@redhat.com,
        matthew.brost@intel.com, boris.brezillon@collabora.com,
        alexdeucher@gmail.com, ogabbay@kernel.org, bagasdotme@gmail.com,
        willy@infradead.org, jason@jlekstrand.net,
        dri-devel@lists.freedesktop.org, nouveau@lists.freedesktop.org,
        linux-doc@vger.kernel.org, linux-mm@kvack.org,
        linux-kernel@vger.kernel.org
References: <20230217134422.14116-1-dakr@redhat.com>
 <20230217134422.14116-4-dakr@redhat.com>
 <20230217183404.jmjew5lrduts6cpo@revolver>
 <3c9e368a-0ecb-fc60-dac4-f12fa23d8f60@redhat.com>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <3c9e368a-0ecb-fc60-dac4-f12fa23d8f60@redhat.com>
User-Agent: NeoMutt/20220429
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?sYzOBbRZUYxpN7ubFRGVyUp6GafDSHjMJe96DCL/wZ5SPsP2DX1ArgxUozDZ?=
 =?us-ascii?Q?fV2HOBEOjO76NoqV3FAGD1e2cbZWgSmMYfLudATb2QL4Lrkw9wYyHWqpWNpR?=
 =?us-ascii?Q?hL2CYc8oIu/1JkTg+eAnKEs5XG3PLtR8TU6MMDLleETb2px3h+bir1fPJYLF?=
 =?us-ascii?Q?hV8LMN6Vn55pl/IQXcoqPYyUY02l4vZKyBPlw97y1dW3/gjMUb3DQSq11DNh?=
 =?us-ascii?Q?W/+Q6orTCQPBoT8samt4/dhU6CFuQ6aF9NskvwGSOiBcYXPvEpGIQ5QHBuE0?=
 =?us-ascii?Q?SFwLbi2/YJJCorS6+LMcu/5DeyrQb/L4XujuCcJrYz32ol6DJCJKSEVNdju3?=
 =?us-ascii?Q?YPslbTY/FBq5A/STek4XSbF42ZBTqC88IwqC0UMPEQDj9lSJqkghWwczwA5z?=
 =?us-ascii?Q?JY7gHuTAiWCvApgLrz/dSz+oN0B+I1N5BD80S2dODUq9CsqiBTywCKxCvIIx?=
 =?us-ascii?Q?KBfVWIewd5oflcCKjjwMNutSXDwNMUHMvBYy4uxoq/TXgcgAVwYmtH3z921L?=
 =?us-ascii?Q?lIWGmx543Iv+Y/e/ZvYrI8/VDpH0EX6c4A/sA6mtC00N+OBdq46EQCT0qMHM?=
 =?us-ascii?Q?nR5OHid0kPyaG99lGs4P+bZGPVECWA9tRr4DavMYSOmxipBrAfA5MSqiPli/?=
 =?us-ascii?Q?E2zY42dvvc1cOwOzHClzIhGpTQgPKgIMw4tNZeN+PIC/+fb+dr6tlRtVdPtk?=
 =?us-ascii?Q?hGrjRMTh5nMFPe70gtSbjr6bHEtAFRly8SxjiZ5NjsReV9nn3sYSSi+gOIH7?=
 =?us-ascii?Q?8YgvltboniNG7OdJV7oDFrwa+jRZ2Pqmx7xSRRisptNmxguXiaVwc+2M+uZV?=
 =?us-ascii?Q?BfC0X99lk+GFa27kOaMEVB3dCADEW4w3QWCJVnkGhH6MzHapwhGA8X+Aocdu?=
 =?us-ascii?Q?tn9k6WnliGdeuPzJVCEi0R5dvkdtg3AgrCznlpSCOgZeX7PkVh7NxDp+t7aj?=
 =?us-ascii?Q?39QbQBGIKxY4YvEhEmyl1Bpk+tsgpJs/M8EvwFWOkQefbTbAs+tFzbcul7nK?=
 =?us-ascii?Q?QSY6q0XDJ4hV5/pAglMG9q7/EfrqBcaa0hkVDwBtvEvryvW33iY4JZcmdvRN?=
 =?us-ascii?Q?Ad0S/p3XYz+zHm6gxWE7hJUmNUuSuDD4DiP0mWes+arevsuPj4rsRsjvzqSN?=
 =?us-ascii?Q?op6IOm8WR0irvWw67RJnx1tbmSvrpN/W0MLWN7viE0YzUMVqgx3nTQE+B6E/?=
 =?us-ascii?Q?xtqbGP1Y3+LFBx0MImsP8Qx+2Yc3RzobVK4yzjeQA84u7qFdICa443jzwqYv?=
 =?us-ascii?Q?xd6I8ts0R7ha0ceTO6rVazI018QtBRvYYwn2hEx+9GLjBMuU16aK95vmyhrA?=
 =?us-ascii?Q?4PZbQ4WCdg5BjG+Aq+XAnnYnas5iTLISh4DKxi+7ZCOocLnUr1smTvF2OoJu?=
 =?us-ascii?Q?xyzhT/ic/1ZdgrgKkAtujJAHAM1H427xkWXz3ZbQXLiGKGV1N/IZ0cJ8s6fF?=
 =?us-ascii?Q?Cs14HwP0oQZ0ouDnvUoAUfK+BF1jS02P9jGtMaeZTwHxpoNluBic5WXFD6uO?=
 =?us-ascii?Q?hVP25rEu4DQLDsQOzJLCOkq0y76joJqIYi6aDbJEO/vK82p0GOAzu5xDUs0g?=
 =?us-ascii?Q?EO7yRUFFm8tGy5ziv63S5nt4ubgF9HPKZu6A5R0Pbw97gaC1+VxMjKaevpIA?=
 =?us-ascii?Q?xw=3D=3D?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: =?us-ascii?Q?9ipNMNeEoLxLFc8sKIRxG/vCzalyDSTRxVOjxQvi/RZVs73nrAgOBSJVWYbW?=
 =?us-ascii?Q?YpIwG7nmXHSheKsn7Uv8aA4vj0Y3E3OhmrwiIlnDRfKIVouKPWTg55Uhpvgz?=
 =?us-ascii?Q?jrz3qet7kXe5pigcA09NiRUeGAeMZCVG6TzZvIQ78nQBJt3FqF7NccgVRyrY?=
 =?us-ascii?Q?ilBaqh5Eayay4uO9sDDa3lghHX/DIxu6TsPJJYqiHZy0JWIKM297yfWLr3wj?=
 =?us-ascii?Q?tcRgd0ecJKWBjqODSr31rx5zv7i8neMKi1M+dIUL7trkMnSeP6auPd+t3C30?=
 =?us-ascii?Q?B90DTjPb93z6oYVZ2yHPjCOYlO1qST/n/WC5ExrTr0cQ3dxQdMB9OWlBbQnM?=
 =?us-ascii?Q?2jz7r60qjqKR4bq0p4sFg1HQXTqu/v+SgxQ1pfW8HWNXJI7DMTVR+RV2aw49?=
 =?us-ascii?Q?/XdymXlm4BH8h/X1Jc2iwsgN931kcEi9vwKrgE7HrawOM/3BOW7AAWi3tK3v?=
 =?us-ascii?Q?fKpr5p70gvOV4fLjBRT7BFhq4eN5EZVgRPmTd5q7p2o7GmKyOtemBdG/V1pe?=
 =?us-ascii?Q?twSrz4tPIQBQGqSOtUU7LaXv02tSvvzGpNYM6H9xq8e2Yq0Mr2+/+6NB5elF?=
 =?us-ascii?Q?+o4/r0x1ubiqKxjzz4cpm0EUXFZDZydSYafvPGHRTLuXP1faMszcp9Cywxij?=
 =?us-ascii?Q?A52VSKMqiVLyq/VqZXSARQzLAkxAYW66IwJ2zT78v3NdALDbJw4DeynqLuF+?=
 =?us-ascii?Q?hSZQyCHGMZbqzM4jMROkiuIB6Z8XetMcl2u/w4m/PwAbOEO55C3J/ZDtO/5N?=
 =?us-ascii?Q?h50f6xN7Y7GHRzlN5WiHpE7qxmAu81MStXS1uolCtVw0f0f0PwruFvw3hgVM?=
 =?us-ascii?Q?tvyi86TS9TASFkZXgRh1Ol0pDF1UWoAqBav/8+fhk2KdZ5rfwZ98R+M1bWNX?=
 =?us-ascii?Q?kC+7qZ03VuCErm5cW9O1OyN0EHqqrsi2W5GJnb4jNE4wZESJFJknfKBUzltK?=
 =?us-ascii?Q?/A4+uJTcrtQx8fThoq0lQZ0La0F2bxl3X58Y8W7yzqm5qhDlX3VV64B3szJh?=
 =?us-ascii?Q?ndhS5onQePfBLcMAct7uKyuUo0bJ3+uZ8sTogmfhNfg03NgUTdTGAtHXiDlf?=
 =?us-ascii?Q?GQqePOe54Tmo2hzf9MFjs3whoJrbUUB4XqzX0N5Q/jEHDG7YyVBfyE7/FXiH?=
 =?us-ascii?Q?aLtawVY2cY0c+euMLnWdB1KO3WooUpfMCw=3D=3D?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 2602b520-f277-474c-c470-08db142c010c
X-MS-Exchange-CrossTenant-AuthSource: SN6PR10MB3022.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Feb 2023 16:52:23.7880
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: /6Zn7a2MSM8il5auVRZIiSkFOiuDOpX6XkVHTC6zBuAxk3LSbos7a2D2iKUEvVSR//kuE9lrwE1nAwsdRoo9EQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR10MB4686
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.170.22
 definitions=2023-02-21_09,2023-02-20_02,2023-02-09_01
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 phishscore=0 suspectscore=0
 mlxlogscore=999 adultscore=0 mlxscore=0 bulkscore=0 malwarescore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2212070000
 definitions=main-2302210141
X-Proofpoint-GUID: 9H0BeSVfXWEtzpBzio8Cn1NXcozYxisL
X-Proofpoint-ORIG-GUID: 9H0BeSVfXWEtzpBzio8Cn1NXcozYxisL
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

* Danilo Krummrich <dakr@redhat.com> [230220 09:38]:
> On 2/17/23 19:34, Liam R. Howlett wrote:
> > * Danilo Krummrich <dakr@redhat.com> [230217 08:44]:
> > > Split up the MA_STATE() macro such that components using the maple tree
> > > can easily inherit from struct ma_state and build custom tree walk
> > > macros to hide their internals from users.
> > > 
> > > Example:
> > > 
> > > struct sample_iter {
> > > 	struct ma_state mas;
> > > 	struct sample_mgr *mgr;
> > > 	struct sample_entry *entry;
> > > };
> > > 
> > > \#define SAMPLE_ITER(name, __mgr) \
> > > 	struct sample_iter name = { \
> > > 		.mas = __MA_STATE(&(__mgr)->mt, 0, 0),
> > > 		.mgr = __mgr,
> > > 		.entry = NULL,
> > > 	}
> > 
> > I see this patch is to allow for anonymous maple states, this looks
> > good.
> > 
> > I've a lengthy comment about the iterator that I'm adding here to head
> > off anyone that may copy your example below.
> > 
> > > 
> > > \#define sample_iter_for_each_range(it__, start__, end__) \
> > > 	for ((it__).mas.index = start__, (it__).entry = mas_find(&(it__).mas, end__ - 1); \
> > > 	     (it__).entry; (it__).entry = mas_find(&(it__).mas, end__ - 1))
> > 
> > I see you've added something like the above in your patch set as well.
> > I'd like to point out that the index isn't the only state information
> > that needs to be altered here, and in fact, this could go very wrong.
> > 
> > The maple state has a node and an offset within that node.  If you set
> > the index to lower than the current position of your iterator and call
> > mas_find() then what happens is somewhat undefined.  I expect you will
> > get the wrong value (most likely either the current value or the very
> > next one that the iterator is already pointing to).  I believe you have
> > been using a fresh maple state for each iterator in your patches, but I
> > haven't had a deep look into your code yet.
> 
> Yes, I'm aware that I'd need to reset the whole iterator in order to re-use
> it.

Okay, good.  The way you have it written makes it unsafe to just call
without knowledge of the state and that will probably end poorly over
the long run.  If it's always starting from MAS_START then it's probably
safer to just initialize when you want to use it to the correct start
address.

> 
> Regarding the other considerations of the iterator design please see my
> answer to Matthew.
> 
> > 
> > We have methods of resetting the iterator and set the range (mas_set()
> > and mas_set_range()) which are safe for what you are doing, but they
> > will start the walk from the root node to the index again.
> > 
> > So, if you know what you are doing is safe, then the way you have
> > written it will work, but it's worth mentioning that this could occur.
> > 
> > It is also worth pointing out that it would be much safer to use a
> > function to do the above so you get type safety.. and I was asked to add
> > this to the VMA interface by Linus [1], which is on its way upstream [2].
> > 
> > 1. https://lore.kernel.org/linux-mm/CAHk-=wg9WQXBGkNdKD2bqocnN73rDswuWsavBB7T-tekykEn_A@mail.gmail.com/
> > 2. https://lore.kernel.org/linux-mm/20230120162650.984577-1-Liam.Howlett@oracle.com/
> 
> You mean having wrappers like sample_find() instead of directly using
> mas_find()?

I'm not sure you need to go that low level, but I would ensure I have a
store/load function that ensures the correct type being put in/read from
are correct on compile - especially since you seem to have two trees to
track two different sets of things.  That iterator is probably safe
since the type is defined within itself.

> 
> > 
> > > 
> > > Signed-off-by: Danilo Krummrich <dakr@redhat.com>
> > > ---
> > >   include/linux/maple_tree.h | 7 +++++--
> > >   1 file changed, 5 insertions(+), 2 deletions(-)
> > > 
> > > diff --git a/include/linux/maple_tree.h b/include/linux/maple_tree.h
> > > index e594db58a0f1..ca04c900e51a 100644
> > > --- a/include/linux/maple_tree.h
> > > +++ b/include/linux/maple_tree.h
> > > @@ -424,8 +424,8 @@ struct ma_wr_state {
> > >   #define MA_ERROR(err) \
> > >   		((struct maple_enode *)(((unsigned long)err << 2) | 2UL))
> > > -#define MA_STATE(name, mt, first, end)					\
> > > -	struct ma_state name = {					\
> > > +#define __MA_STATE(mt, first, end)					\
> > > +	{								\
> > >   		.tree = mt,						\
> > >   		.index = first,						\
> > >   		.last = end,						\
> > > @@ -435,6 +435,9 @@ struct ma_wr_state {
> > >   		.alloc = NULL,						\
> > >   	}
> > > +#define MA_STATE(name, mt, first, end)					\
> > > +	struct ma_state name = __MA_STATE(mt, first, end)
> > > +
> > >   #define MA_WR_STATE(name, ma_state, wr_entry)				\
> > >   	struct ma_wr_state name = {					\
> > >   		.mas = ma_state,					\
> > > -- 
> > > 2.39.1
> > > 
> > 
>