Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Mon, 8 Aug 2022 14:55:28 -0300
From:   Jason Gunthorpe <jgg@nvidia.com>
To:     Greg Kroah-Hartman <gregkh@linuxfoundation.org>
Cc:     Oded Gabbay <oded.gabbay@gmail.com>,
        Dave Airlie <airlied@gmail.com>,
        dri-devel <dri-devel@lists.freedesktop.org>,
        Yuji Ishikawa <yuji2.ishikawa@toshiba.co.jp>,
        Jiho Chu <jiho.chu@samsung.com>, Arnd Bergmann <arnd@arndb.de>,
        "Linux-Kernel@Vger. Kernel. Org" <linux-kernel@vger.kernel.org>
Subject: Re: New subsystem for acceleration devices
Message-ID: <YvFOEPdC9r8QBH11@nvidia.com>
References: <CAPM=9tzWuoWAOjHJdJYVDRjoRq-4wpg2KGiCHjLLd+OfWEh5AQ@mail.gmail.com>
 <CAFCwf12N6DeJAQVjY7PFG50q2m405e=XCCFvHBn1RG65BGbT8w@mail.gmail.com>
 <CAPM=9txSKv_xwZJ6SndtqsdQm6aK1KJVF91dB5Odhc_Xv6Qdrw@mail.gmail.com>
 <CAFCwf10CsLgt+_qT7dT=8DVXsL0a=w=uXN6HC=CpP5EfitvLfQ@mail.gmail.com>
 <YuvctaLwRi+z0Gw4@nvidia.com>
 <CAFCwf12wD3uEhr+kxwN9ROXApHzGh_n1je5susZV5NgGR9fCcQ@mail.gmail.com>
 <Yuxi1eRHPN36Or+1@nvidia.com>
 <CAFCwf13QF_JdzNcpw==zzBoEQUYChMXfechotH31qmAfYZUGmg@mail.gmail.com>
 <CAFCwf107tLxHKxkPqSRsOHVVp5s2tDEFOOy2oDZUz_KGmv-rDg@mail.gmail.com>
 <YvCozvgodIY19LSr@kroah.com>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <YvCozvgodIY19LSr@kroah.com>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?WNHAsvAbbO6AxzW6DGoDugeaqLsaLfHkhSELErAaLHg8xdAhx/CtID1HAvsG?=
 =?us-ascii?Q?oNrHhD0lSC+uMmUjh1qQS8shZackS2Sd9K/4lxCReRUpVWy7MZ7UlZU5Byqe?=
 =?us-ascii?Q?zP89Yq+qVH9KAxqK1cEVgzZbmoMhtRChi+FLTTBEYlyndgRZHK2YfArkFBy+?=
 =?us-ascii?Q?ZSTOapqr1Umi49lrt0O5gxch0UFqiCXBySY8R1cg8N05bm5XTDHEhGgjYx/r?=
 =?us-ascii?Q?6kN8HoccTUR6S9fWgJBzMtP+Bbeajy8ljWi52Rrhvj8qO63eRDv70STRSoPj?=
 =?us-ascii?Q?ydx3XIusr3x5ykUIFlNUWz/9wy92afUumlHQQmiyooQQefG8NDe5Wjda7sJZ?=
 =?us-ascii?Q?hxV0aCnQxIwyu+KQ//6Pw7h4zhcyX8KFT3ec/6kWBGYDXnbNmRFPSn8CLs5t?=
 =?us-ascii?Q?Vauczrif0jLsn5M7cRYK1702gONDXb8Dn2ZJhRxEgfCdz555xkGYyA+VgPA9?=
 =?us-ascii?Q?eQcyzX5XOijyW4o5B8IbtZwaxM7JT6wXFtOndgtbb6f7Um46FjGaEawpjtOK?=
 =?us-ascii?Q?pVG7kE5at4WdLMWjgA3t114hIHBl8zOzFrSuG7fjdr88xtMvAywSwf9JdWCV?=
 =?us-ascii?Q?ZrTJTZaMT3SUR5mUXjCEhtBe9ZDst6eDk+VTwPyEMPOyZ14aj1dF8wMJRcxx?=
 =?us-ascii?Q?bfROhEQTT8ESPQXRGN7lMOuqAmNylp9x7pdzLC12HnGBm7Ps7D+fl/yAa5Pu?=
 =?us-ascii?Q?HvdTZfLwCfTBOP0b/kThmzfe54n4QHwViNm3gm+k6/UoRn7GrSg2Qo0ixOL9?=
 =?us-ascii?Q?F2cxaFUiou4G7A6ppS/hMNPPwnNa3Styl7xhZzP3F+Fi8+837LkYwY9ZbbLM?=
 =?us-ascii?Q?X+rlewVaufEYQvFf1TzVPCE+SgK7UZxCCYJYbGeOa3geSKc3iOrImwV6n3Hd?=
 =?us-ascii?Q?cSnA9tJtd1gpynkljBrLfB0iDuHp1ME6esdZ2/vNUGPrGNkLIvdaLvtmFR29?=
 =?us-ascii?Q?94OEEKAoyPs59fQ7dmFNoDdIso0zgmEUDlDwJgoBFCIkF10r3Z0Yrnaos2cG?=
 =?us-ascii?Q?r+SYAinwojVGqQQgW2TPs34CFe8VKLrTwN/2Gh/QiowSydXL9JKU72QyP08S?=
 =?us-ascii?Q?122GyD/j/0yjEmNE2wL8vFnDFgMNre9PS/YPISXyvP2IGWPc3ttWAvkJ+7Ei?=
 =?us-ascii?Q?KNUDqIrU3Mvh6lAazj0a/X7ONHzZObkM9PZbAOcAQq0XsjDH3BuVL5sz7CYu?=
 =?us-ascii?Q?rCgxtBXBoUCdA170QAgpDQppw2ZxaiyLyXT7yu5rw8JBssukqOnzlLkT3UaM?=
 =?us-ascii?Q?MrbXhHYoLj9q/wPYyF6/7ANyJqtZVT3B3m01Oi/MU16Tm8LWMyhEihme25p8?=
 =?us-ascii?Q?8fIgnNekWCTG9gEZgOxrrMlwjZDRYsUkDhh2INlRBfdlobzBZGEhdmurEbQ8?=
 =?us-ascii?Q?KOqXSkObUf8zBYvCokZZhHp9u3n/ckRCOoG7MR+jrhVyFJK8HeMnOLBHgdGo?=
 =?us-ascii?Q?bAdO71RM8m83ECSf/p4drZM2iW2V42xDik3SXv0XWKj8rrPeC9deMZB9L+o9?=
 =?us-ascii?Q?qq1rkPLEwtKUa0kg+F/aabhSv2+Pmq+ozBUwfPvljrJ6vuHt3fcPCee5NiRS?=
 =?us-ascii?Q?GOAtMasbm+tlv6ciOcnJ8lvP5Xb4Ly+IUH3b53bF?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: fbff7d45-2677-4b30-bcc7-08da79672e1e
X-MS-Exchange-CrossTenant-AuthSource: MN2PR12MB4192.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Aug 2022 17:55:29.0267
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: MQItklN0/FBhiIlAZlEfvBSAvW2taMqc3HeoEoco9ghUulvf/Shy9/wCQj09Fmmw
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR12MB4679
X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE,
        T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On Mon, Aug 08, 2022 at 08:10:22AM +0200, Greg Kroah-Hartman wrote:
> On Sun, Aug 07, 2022 at 02:25:33PM +0300, Oded Gabbay wrote:
> > 2. Common code to handle drivers that want to allow a single user at a
> > time to run open the device char file.
> 
> Note, that's an impossible request, and one that the kernel should never
> worry about, so don't even try it.  Think about userspace doing an call
> to dup() on an open char file descriptor and then passing that off
> somewhere else.

Oded is talking about a model like VFIO has where the HW has a limited
number of concurrent state registers - lets say in this case the ASID
translation mapping the accelerator into DMA.

Each 'struct file' that is created owns one of those HW state
registers, and each struct file is completely isolated from all
others. eg someone controlling the accelerator through struct file A
cannot access memory mapped into the accelerator through struct file
B.

So, the number of struct files that can be created is capped at the
number of HW state registers the device can support (eg one for
Habana).

This is different from the number of FDs pointing at the struct file.
Userpsace can open a HW state and point a lot of FDs at it, that is
userspace's problem. From a kernel view they all share one struct file
and thus one HW state.

Jason