Date:   Fri, 10 Dec 2021 08:31:09 -0400
From:   Jason Gunthorpe <jgg@nvidia.com>
To:     Jean-Philippe Brucker <jean-philippe@linaro.org>
Cc:     Jacob Pan <jacob.jun.pan@linux.intel.com>,
        iommu@lists.linux-foundation.org,
        LKML <linux-kernel@vger.kernel.org>,
        Joerg Roedel <joro@8bytes.org>,
        Christoph Hellwig <hch@infradead.org>,
        Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
        Jean-Philippe Brucker <jean-philippe@linaro.com>,
        Jacob Pan <jacob.jun.pan@intel.com>,
        Lu Baolu <baolu.lu@linux.intel.com>,
        Raj Ashok <ashok.raj@intel.com>,
        "Kumar, Sanjay K" <sanjay.k.kumar@intel.com>,
        Dave Jiang <dave.jiang@intel.com>,
        Tony Luck <tony.luck@intel.com>, Yi Liu <yi.l.liu@intel.com>,
        "Tian, Kevin" <kevin.tian@intel.com>,
        Barry Song <21cnbao@gmail.com>,
        "Zanussi, Tom" <tom.zanussi@intel.com>,
        Dan Williams <dan.j.williams@intel.com>
Subject: Re: [PATCH 1/4] ioasid: Reserve a global PASID for in-kernel DMA
Message-ID: <20211210123109.GE6385@nvidia.com>
References: <1638884834-83028-1-git-send-email-jacob.jun.pan@linux.intel.com>
 <1638884834-83028-2-git-send-email-jacob.jun.pan@linux.intel.com>
 <YbHie/Z4bIXwTInx@myrica>
 <20211209101404.6aefbe1c@jacob-builder>
 <YbMYkKZBktlrB2CR@myrica>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <YbMYkKZBktlrB2CR@myrica>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?Q5TOKNoc7uO1pCI0guVFTbLiqz82+QLMh6elql1eZw0AtRhocNtLPq1RAiAX?=
 =?us-ascii?Q?p1jz4YLvHE9hIuAK5v8vQysX9s5EqOkBblNq+2TR+VQ4827P0lPG2jr5zfdx?=
 =?us-ascii?Q?Hw+pcugKppfQP9f32jxyWFeFK1IfFdPIwAHTwp3NTPpfvg8M3BvFumLUYmlP?=
 =?us-ascii?Q?w9yH1lz94SMJtYa6IOHdDGEi1J/UYvvXAT18G5Dahc+9fvu1r1ZApimmuOBa?=
 =?us-ascii?Q?kHXW3EhK0I01t9Ll4ZVoxzrszWFnxj1wldyXo1MSzNRM6bljQ43r/OqWCxNG?=
 =?us-ascii?Q?0XAEImiHvOalD4VPFLmCrFmKkXEV21MRgCiwng/xYVTQHsDhE7AfjiZRzVt0?=
 =?us-ascii?Q?fwR5ZupM7uRcGmjwTfUI34RqnL9vzgYZmFp5X2G2MAhXmKk2rh3Q1/+IDTMU?=
 =?us-ascii?Q?ki6nplYBLGnlQ8ZCeiIMbMnCZtZ0GRLW177oAAsTJu2fXawRKWy7CZDujJoc?=
 =?us-ascii?Q?E69Ux5Hnb2QpbtopVQh/3sWxWJRn+1gJwquM8CdOCvzc85qJbc+imumNZFrZ?=
 =?us-ascii?Q?P5TjkSMjP9jd+DOSd46t4ISkpg+jSV/Gvl4z7VyEdsQ2sOgUpg5yFoU+GqWJ?=
 =?us-ascii?Q?UXUeaZL54ULCKbofMjHwu7gnm78h/tft7Kb2uqfRThFv9ZEHHNFsSiT982jW?=
 =?us-ascii?Q?3pJdTrmM+0SY76mwbPKuqJ5GIJfsC8aW7XT9L+ArRT4GlXc+6GbctJrFKZ36?=
 =?us-ascii?Q?3wZLoqquxmLoz+1UDhbj7p3nID6DdnYWVd0a0kHuidxMfZDFncFvjf8N9uZ0?=
 =?us-ascii?Q?ViA8V5ldjLf7c0I3FO1K0CBqxZwJ008WnXgvoyX+HCwUH1Mpw140tba6ltkQ?=
 =?us-ascii?Q?ra0ssB+J0EbcfIS2EGzY5jsdGmjHPeCg+z1qD1PP6PdJ+wUs/oQgojkGCL/T?=
 =?us-ascii?Q?49vd7MEbhVcyPa7AI1UgtXzUc+gF4SD5/eZmMxYdN0wMJs2jfBgxbWSBiInW?=
 =?us-ascii?Q?6zmlsAg4HIi7J2AAJt7A/tOy4/bhvGr1fS327Us+F/S6G0qcjRg+y4XHikXI?=
 =?us-ascii?Q?FUIIJ3TGIExTXByCmpge40bTt8ezwf3QZzjAsRj6dijDfxebKNAgGxAkmZtq?=
 =?us-ascii?Q?bPu1GNMvLmp3CdwOrPjV8p+1xIxpf2Iyo0Je6DFGJ2veXTXTOWsb/jsQFFhD?=
 =?us-ascii?Q?kE2wxxoywnafnb+TIhLVTv0cbQ/U4/UJVSNTdf0i2YSpzxpncOfhOgdbD8wL?=
 =?us-ascii?Q?tm/zwR7GSy8WEWTOqNGhfRlL7OP1G1m+Ezs4CwZpI6anIg3o5OfGjhlBQYR8?=
 =?us-ascii?Q?hSDEO4zQ7O2fPorZTUkdewZVnofnQ30kFWXczvvOp4/aLaCv1qsUAjoyReqd?=
 =?us-ascii?Q?EUli4RvrMfFF91Bw3JDWLpJeOR6YOtpBno+e4N0nAnh/reJn5cFwYU2/9Azd?=
 =?us-ascii?Q?5FowE8CgJDSaCR8kiWEgF/LN+hnFF2uBPqDo7roIeYyc4xCicUuRGR9vUZ+o?=
 =?us-ascii?Q?hlmrTJSn3Dx2WDKzxMN3Rb6AIPvScDcVORc19urTBXESGa+SiKK+uAOr+zif?=
 =?us-ascii?Q?EbtY7cNmo/SvXd8L9as8CNiQiVfMoJ9ASZtvIYyotJfcVJE8mMgHpHNcHBIy?=
 =?us-ascii?Q?EX2u7zQ9qUm2vWSBNs4=3D?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 8b4c6d9d-6f8f-405a-dc0e-08d9bbd8f2c0
X-MS-Exchange-CrossTenant-AuthSource: BL0PR12MB5506.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Dec 2021 12:31:11.1265
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: gj8FQNzGVf6no+7EY2cnCCpc5shqBGhmw929B9OXslJYxp97BfLQsP8Zb1V0ortx
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL1PR12MB5046
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On Fri, Dec 10, 2021 at 09:06:24AM +0000, Jean-Philippe Brucker wrote:
> On Thu, Dec 09, 2021 at 10:14:04AM -0800, Jacob Pan wrote:
> > > This looks like we're just one step away from device drivers needing
> > > multiple PASIDs for kernel DMA so I'm trying to figure out how to evolve
> > > the API towards that. It's probably as simple as keeping a kernel IOASID
> > > set at first, but then we'll probably want to optimize by having multiple
> > > overlapping sets for each device driver (all separate from the SVA set).
> > Sounds reasonable to start with a kernel set for in-kernel DMA once we need
> > multiple ones. But I am not sure what *overlapping* sets mean here, could
> > you explain?
> 
> Given that each device uses a separate PASID table, we could allocate the
> same set of PASID values for different device drivers. We just need to
> make sure that those values are different from PASIDs allocated for user
> SVA.

Why does user SVA need global values anyhow?

Jason