Received-SPF: pass (google.com: domain of linux-kernel+bounces-137975-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1;
Date: Tue, 9 Apr 2024 23:19:30 -0700
From: Ira Weiny <ira.weiny@intel.com>
To: fan <nifan.cxl@gmail.com>, <ira.weiny@intel.com>
CC: Dave Jiang <dave.jiang@intel.com>, Fan Ni <fan.ni@samsung.com>, "Jonathan
 Cameron" <Jonathan.Cameron@huawei.com>, Navneet Singh
	<navneet.singh@intel.com>, Dan Williams <dan.j.williams@intel.com>, Davidlohr
 Bueso <dave@stgolabs.net>, Alison Schofield <alison.schofield@intel.com>,
	Vishal Verma <vishal.l.verma@intel.com>, <linux-btrfs@vger.kernel.org>,
	<linux-cxl@vger.kernel.org>, <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH 14/26] cxl/region: Read existing extents on region
 creation
Message-ID: <66162f721d5a_e9f9f2943e@iweiny-mobl.notmuch>
References: <20240324-dcd-type2-upstream-v1-0-b7b00d623625@intel.com>
 <20240324-dcd-type2-upstream-v1-14-b7b00d623625@intel.com>
 <ZgRbTfmoU3HZPfrf@debian>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <ZgRbTfmoU3HZPfrf@debian>
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?IfBaQZ5zMC3REt4VRDJ0070ejd+VSaxZIGo1XCijs0ggZoxIrIkrxK6WOD+N?=
 =?us-ascii?Q?R3pXFEVN6abumndEYALy/535X8ocInzpUME/Nq+2sRy+UxCQoZS8jnE+BJZL?=
 =?us-ascii?Q?JYQe/FB16vxaKBhZqDdw+vr09kcUnvmkQGwoNRpBW1wT2bTwuRmbRSdZ8UM0?=
 =?us-ascii?Q?ASQjhIdOZ1paiuAbSPMvT0XNDJK7OBHLPppLgArsQDOfTqp1X1+VqJMPXuTq?=
 =?us-ascii?Q?z8pguyptd6RqM1gpr/MReUJJjztltThzYglMgLnewakvPAoz/6i71g5ZCOHD?=
 =?us-ascii?Q?Lr19bf4vRFwLdejNHLcVvDdMtgqOXUV8E4/e2fqmvpOURyoYz8oufJNb5Ekv?=
 =?us-ascii?Q?nnNErF/QH/onFK5m4dCFMV1PTEGQItkD3pQHGhABNt+GEONk+wLG5G+dOsUq?=
 =?us-ascii?Q?c6eGAQOHH7yOOkKPzYmrJUWp2XvQbJ/78BxJpCeRTXdONG6+IjrFjExNMwMW?=
 =?us-ascii?Q?IrDppuF6sCg1/0+K77ZdkWcyoqNgD/GWNyL1KYbbJOhcI1TjVYP/wJG498wV?=
 =?us-ascii?Q?nfJ4Y43jz7gqerbYaPoYr0FcPz7og0trGDRrkWLy9x5PuF4CJU4lWuMNplIt?=
 =?us-ascii?Q?DBsi8SGqQONmR+DkbDpMmpi8SW2Ji5n4chYLomCf9NGxd2ztIoqrov7naYEA?=
 =?us-ascii?Q?NyHSDv8yW7qJmxURdBTDgC5IerzvQzQ3IUbwPe5qz5QaorDQuEakP+8spfd6?=
 =?us-ascii?Q?Xg2IqmihgsexgKuvvZhqx8qYbSCgD95yfzz2IkbYr9ZtP3z1FLfS7FFpHQLu?=
 =?us-ascii?Q?8aE2qxYbI0v7AwDpXG9wykC2+kQO79UzpXkMC/HEeeTAc+fJyS0sv/gdgvgM?=
 =?us-ascii?Q?XTm1mOdj+bhG0d+nKN4xOoKTUNkjvih+y0XLSwG63mdcXnIv8es8xpW2nUkX?=
 =?us-ascii?Q?y7zZ9i2IcIic0sl4/KDpChrg1lzFFdrW/4JlHbrtN59Jhb0c0L8QPSPmRFuO?=
 =?us-ascii?Q?INLUv2+LjnaFdvnJ8oDxY43KZ3gS2k5gV2VCJbh0vElOG3WcrKjUueCd8MsR?=
 =?us-ascii?Q?rFJiFrc5OEPC/ATvAuFQ8JKahCBELJodGQ4am672tbgLg2NEDcyRkRzlB/VA?=
 =?us-ascii?Q?IfEW6aYFSs7Q6zLnCEgf/JUzVFuHzFr1STe3Cx3KPdZdu3Et1fEK26RVCbjB?=
 =?us-ascii?Q?NRQ2wyKol3Qap0mFcdJ/DK6RH0j0v7UFrrI/K6K7FQmmNFryrIlLn4PCWwfB?=
 =?us-ascii?Q?0uASnLRxSuXxKDzqXT+GbNKhPS7isa7l5C+86Ei+/5ZCJlGsGmgSMepkcPCv?=
 =?us-ascii?Q?S7z6JnaJogvlJWZIcwBZuFnffm7sU2k0HquKNP4lKhgpG6ftEgy3dDXGm49R?=
 =?us-ascii?Q?z76wMndqIiazfMLqO0C1QDdADu7fbjELqTpFVHj+/NHHX2QPf/1q7crTHfoe?=
 =?us-ascii?Q?ID129VIGFdYjlfoSJMCzwBCQ6nlq3fralDILmFF2bkNX+yXTl5yzlR5JvaeP?=
 =?us-ascii?Q?597SeKV4Y1E74/WRt9LtsV8pveHEWtZ+ilUvJBXSutseJfXNAF9Vh7yU4fip?=
 =?us-ascii?Q?2RmEVxG2trwtcs1WBzINkervcUY/lvrg1R/Q/H7kVgNqK6AnQvkC2F3RasyJ?=
 =?us-ascii?Q?olnOuQ9G+Zdy4tE6oWP4BhjfrWcGyQzjGK18ayWS?=
X-MS-Exchange-CrossTenant-Network-Message-Id: aaacc405-2006-494b-f94a-08dc5926302e
X-MS-Exchange-CrossTenant-AuthSource: SA1PR11MB6733.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Apr 2024 06:19:33.2883
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: lo4eFYh2dFCRjKVP3edcez/nP4XDOBtwF43tWwCLVy57wIcRvYJskEwvfVafeHSafP4YXH86G07GTVa6K2amqA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR11MB7524
X-OriginatorOrg: intel.com

fan wrote:
> On Sun, Mar 24, 2024 at 04:18:17PM -0700, ira.weiny@intel.com wrote:
> > From: Navneet Singh <navneet.singh@intel.com>
> > 

[snip]

> > +
> > +/**
> > + * cxl_read_dc_extents() - Read any existing extents
> > + * @cxled: Endpoint decoder which is part of a region
> > + *
> > + * Issue the Get Dynamic Capacity Extent List command to the device
> > + * and add any existing extents found which belong to this decoder.
> > + *
> > + * Return: 0 if command was executed successfully, -ERRNO on error.
> > + */
> > +int cxl_read_dc_extents(struct cxl_endpoint_decoder *cxled)
> > +{
> > +	struct cxl_memdev_state *mds = cxled_to_mds(cxled);
> > +	struct device *dev = mds->cxlds.dev;
> > +	unsigned int extent_gen_num;
> > +	int rc;
> > +
> > +	if (!cxl_dcd_supported(mds)) {
> > +		dev_dbg(dev, "DCD unsupported\n");
> > +		return 0;
> > +	}
> > +
> > +	rc = cxl_dev_get_dc_extent_cnt(mds, &extent_gen_num);
> > +	dev_dbg(mds->cxlds.dev, "Extent count: %d Generation Num: %d\n",
> > +		rc, extent_gen_num);
> > +	if (rc <= 0) /* 0 == no records found */
> > +		return rc;
> > +
> > +	return cxl_dev_get_dc_extents(cxled, extent_gen_num, rc);
> 
> Not sure about the behaviour here. From the cxl_dev_get_dc_extents
> implementation below, if gen_num changed or the expected extent count
> changed, it will return error. 

yep.

> If I understand it correctly, if the above two values change, it means
> the extent list has been updated due to extent add/release since last
> time we read the extent list info (cxl_dev_get_dc_extent_cnt), do we
> need to fail the operation or try again?

The original series was safe to fail the operation because the list was read on
memory device driver load and not when the regions were created.  This is an
oversight with the new architecture.  Now that regions query for the list
independent of other regions being active the list could indeed change during
this operation.  :-/  So a retry is necessary.

Let me work on the retry because some of the extents may have been surfaced
during the list processing which means a re-read of the list will need to
properly ignore those already found.  Or some other tracking needs to be put in
place.

Ira