Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   Mike Christie <michael.christie@oracle.com>
To:     geert@linux-m68k.org, vverma@digitalocean.com, hdanton@sina.com,
        hch@infradead.org, stefanha@redhat.com, jasowang@redhat.com,
        mst@redhat.com, sgarzare@redhat.com,
        virtualization@lists.linux-foundation.org,
        christian.brauner@ubuntu.com, axboe@kernel.dk,
        linux-kernel@vger.kernel.org
Subject: [PATCH V3 0/9] Use copy_process/create_io_thread in vhost layer
Date:   Mon,  4 Oct 2021 14:21:19 -0500
Message-Id: <20211004192128.381453-1-michael.christie@oracle.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?9YdVZp/c4SO5vO1ddrLbxqjVGxvwuFwl+jbckYji3jhw7VskwglSnD3gb5uk?=
 =?us-ascii?Q?3HPxp/MiRwutSo3weBy89eQiYemQhhi0O7QaSyy7d7ZtLzfTw5z/E2p2Y6Py?=
 =?us-ascii?Q?MiF8yOZ35xAVShRyRhmTmrYVfH/rn+UDAp+GggHO1I+xc1tOQ3UnQTZBZjrk?=
 =?us-ascii?Q?/+Hm8agW471TPODn21KBIWgsL1+usds2FRYiUQ3847bghmmRUQiAa4dfhvrN?=
 =?us-ascii?Q?e+SHe0wB4RooGvdgCqI7N+dN8+E0IqJS9KOtYsTBoRw3VdD61VtumCa3eGiJ?=
 =?us-ascii?Q?9WZLw+JVB/SDqGUf0wkGVgJk4xMQi8l3YchDYrw8vUKO7lUQ9EiW65EBrgKe?=
 =?us-ascii?Q?k30yER0g4neQ3rU5cLWkdwIPjW4o2XRNboRRX7g8OSHK/wuSFVEURpU/VFry?=
 =?us-ascii?Q?Hm/cCK2CVhANFF1e77Oi2SFjNJ7X/D6DQr1HA+R3oYib0YyLqFtwx4+7hhDV?=
 =?us-ascii?Q?tv7tHZc9YHUHvo3MwaRVtuMv6Uo40uRR+n1bwi3jy7K/Pt8FeU9AY9UB6Sm7?=
 =?us-ascii?Q?PHDuP746YTlMY6pavJu6Vy/Iz2v9GG+REkLdixCIgcsbARLHc4ya8kpKNIWe?=
 =?us-ascii?Q?eP8qZ9n7Y1q+wS7nUhMjuArsW/DIvmOJGH/sKc2bOHEnjZDkQl6UvslFCfVh?=
 =?us-ascii?Q?7NwcsQqS/kILBk41bfkJ8+LzPLQhkxcsVrO68WS/XTMxaUOX7DCI0GV6Ti4/?=
 =?us-ascii?Q?yCaqwncEM56KTw9lKEfBHfmErQ4R8yHa7ZEa8Pz6T9kq80Ek4xEPj6mVdDrT?=
 =?us-ascii?Q?m/uqd7mnpihKoEPCapkiNwp2JkoLIkDidi3D8JwI9SCkSWArVcjZK8a7gRlI?=
 =?us-ascii?Q?u6lxupbAJJLo0Hs5w7PwnUkqCKvMy9AifmEquM/+hiZS1zxdJmR1+RsJffcV?=
 =?us-ascii?Q?U7CTiqNN+xqeRZwxIOOxdjKRToEhmosnX1fms+l1Fz2zpp08REIfW9iUF4tL?=
 =?us-ascii?Q?lHL74TdN0dsZWXAweMgG9Wo8VeQqSrNdIXMH4NFahWAdSD5JoIySrnwgMe+b?=
 =?us-ascii?Q?5minH+VTm9oTR30aNOfdlDC1zEw4saYUWIk91Sdi85tCopu0mFGPjR6QD0L8?=
 =?us-ascii?Q?yejJWGw8YcGnQZiXP19vFUQkK+DhadzVl0OCq2LmvS/2xgXoTdNoTmejkgkL?=
 =?us-ascii?Q?8FzlZjDl7RKyRQFXqx21oDvC2qnYcl/zkh3N0RWPS6rQ3CyjfGbk5w4xRql8?=
 =?us-ascii?Q?pCtv/8fh5Ufu6nGsRe7S6NABLfu2Re0SvHaavAIkIi+24L14li7TlncYIz5P?=
 =?us-ascii?Q?f0DW6DiQ6Mu6Tbr1n1JNMEys+BQ0MND/quAkEan8mFo7mWQgaUpjLUnn+fci?=
 =?us-ascii?Q?qldQP6wBBTGAZMsoPYrYCulh?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: c883166e-3d45-42b4-d8a2-08d9876c2f48
X-MS-Exchange-CrossTenant-AuthSource: DM5PR10MB1466.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Oct 2021 19:21:37.0436
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 7AKlLKrrrvjQ2bUj9/bhZEoZG/GDwZBS3GXIAMEoxwGN7kawv/ZKIN4ZfXMQRWoHnIdbBftUQie4lJBqxVSQqFHWC2cvEwRO8l9mwOwsRK8=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR10MB3307
X-Proofpoint-Virus-Version: vendor=nai engine=6300 definitions=10127 signatures=668683
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 adultscore=0
 phishscore=0 malwarescore=0 bulkscore=0 mlxlogscore=742 mlxscore=0
 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2109230001 definitions=main-2110040131
X-Proofpoint-ORIG-GUID: iYXouoBwAWr0NiGn5bI0lpR5eOoiC33r
X-Proofpoint-GUID: iYXouoBwAWr0NiGn5bI0lpR5eOoiC33r
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

The following patches were made over Linus's tree but also apply over
Jens's for-next io_uring branch and Michaels' vhost/next branch.

This is V3 of the patchset. It should handle all the review comments
posted in V1 and V2. If I missed a comment, please let me know.

This patchset allows the vhost layer to do a copy_process on the thread
that does the VHOST_SET_OWNER ioctl like how io_uring does a copy_process
against its userspace app (Jens, the patches make create_io_thread more
generic so that's why you are cc'd). This allows the vhost layer's worker
threads to inherit cgroups, namespaces, address space, etc and this worker
thread will also be accounted for against that owner/parent process's
RLIMIT_NPROC limit.

If you are not familiar with qemu and vhost here is more detailed
problem description:

Qemu will create vhost devices in the kernel which perform network, SCSI,
etc IO and management operations from worker threads created by the
kthread API. Because the kthread API does a copy_process on the kthreadd
thread, the vhost layer has to use kthread_use_mm to access the Qemu
thread's memory and cgroup_attach_task_all to add itself to the Qemu
thread's cgroups.

The problem with this approach is that we then have to add new functions/
args/functionality for every thing we want to inherit. I started doing
that here:

https://lkml.org/lkml/2021/6/23/1233

for the RLIMIT_NPROC check, but it seems it might be easier to just
inherit everything from the beginning, becuase I'd need to do something
like that patch several times. For example, the current approach does not
support cgroups v2 so commands like virsh emulatorpin do not work. The
qemu process can go over its RLIMIT_NPROC. And for future vhost interfaces
where we export the vhost thread pid we will want the namespace info.

V3:
- Add parentheses in p->flag and work_flags check in copy_thread.
- Fix check in arm/arm64 and xtensa which were doing the reverse of other
  archs in their check for PF_IO_WORKER.
V2:
- Rename kernel_copy_process to kernel_worker.
- Instead of exporting functions, make kernel_worker() a proper
  function/API that does common work for the caller.
- Instead of adding new fields to kernel_clone_args for each option
  make it flag based similar to CLONE_*.
- Drop unused completion struct in vhost.
- Fix compile warnings by merging vhost cgroup cleanup patch and
  vhost conversion patch.