From:   Mike Christie <michael.christie@oracle.com>
To:     geert@linux-m68k.org, vverma@digitalocean.com, hdanton@sina.com,
        hch@infradead.org, stefanha@redhat.com, jasowang@redhat.com,
        mst@redhat.com, sgarzare@redhat.com,
        virtualization@lists.linux-foundation.org,
        christian.brauner@ubuntu.com, axboe@kernel.dk,
        linux-kernel@vger.kernel.org
Cc:     Mike Christie <michael.christie@oracle.com>,
        Christoph Hellwig <hch@lst.de>
Subject: [PATCH V6 06/10] fork: add helpers to clone a process for kernel use
Date:   Mon, 29 Nov 2021 13:47:03 -0600
Message-Id: <20211129194707.5863-7-michael.christie@oracle.com>
In-Reply-To: <20211129194707.5863-1-michael.christie@oracle.com>
References: <20211129194707.5863-1-michael.christie@oracle.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?LHze2e7wItqVtPubH7gwF+YrHPIUXrQAB1nmnVuDYIMaB7L8UiUfAumdc2K6?=
 =?us-ascii?Q?0T4Gt8rKIuIhXaGU5Q9zIRuqCTKswl9oXG6B4FgxlbbwWEHe7KzVtvtECtSm?=
 =?us-ascii?Q?J2lzy9Kv9UJk/fDhD+reMo9lhG2sgHPrFZUvKclgh88pWex3BaIA3KBFhg7a?=
 =?us-ascii?Q?yxQ0TWXXrH/gpc6+2yvHjsLBmmyL00lyQx4jPrGyEag9b21XdwznNRjztMih?=
 =?us-ascii?Q?IWxcAdH5Xj5zLugvkFl0hvIhu2j4Ij82LsPVXii5puFmaAyHL+/Ttnkhb3ZB?=
 =?us-ascii?Q?seThvJ81muSoWpkI/+EP+fO39ljkf1TaByrwSpzf7UewEvJO48XWnV+tFYfz?=
 =?us-ascii?Q?I4hwbzrtkUTpqOHHDLH6yco1L1Z1XXzqArWOny1om+cURycnGdpV2WgDG/HZ?=
 =?us-ascii?Q?VgHzjKlD1BXelqM2geEtkTcmUqF3YXOCn9kJHsOM8H9h/m/vhDhQoAYKu2nW?=
 =?us-ascii?Q?JRtJKO2cnY2jA6xmWu7OL1jTK+0TyQXZbSZQfEX+OifSWUyqluP8lzTKVlXA?=
 =?us-ascii?Q?Q/rms0McOKdT3QFUTPG33MvVhFlhWYuaB5dILTg1MjrPZ4nyBOONkz3bCP43?=
 =?us-ascii?Q?7N80PzyrqFIWbmtxhTe1PSr4naSMBYK3rZFJxVym/mHgcwbqDtwbBiKN6Z61?=
 =?us-ascii?Q?HzHhZ7r9euYlzFDrLnlS6fbWg8gwt0uQ0/nRBuvza3W2a5Q9qK4WDVKW1P84?=
 =?us-ascii?Q?0K0Sj1pZ1Rk2VBLScTlpmFH4wde9OKg4TgHjko1FBuEh9utHgiK4ZVFebPb2?=
 =?us-ascii?Q?sM4htbAzsWJ1hYG6DQG4lUf8E62bMdaocr7xMnZgGaPSxTct+6qOI3QaVo5x?=
 =?us-ascii?Q?FpauDj8oEyA6wjxIDOAPSoA5XH9M4u4L2X3WMBgOJZGR7uTZZOulEQGkcyzZ?=
 =?us-ascii?Q?99WorFSG419cE9nx+JtcK1hEf4aI/PhYiD/7Iif/UhcS8LzeIFB6QjeDJ5N8?=
 =?us-ascii?Q?NN8R+ZL5mlf1cQxe/IukREfUSVYxVEExUlTwbMPusNW+RoJgW6BvpT7K+y07?=
 =?us-ascii?Q?hVTXOpPI1Hv5oGnjlX6vUsjxPVjyt/FcElAy5Th0hRiDRxeeHTM5X9f+9qL1?=
 =?us-ascii?Q?bd6wTtvjzoHyoGELQVLf9gmHheXYAdX+ysey8R9euUP+MnDrho/cS7U/4FRc?=
 =?us-ascii?Q?1b9sjyCTsYrYlYCuq0idNjvgd6F6Kq/G1ys7w9ilCdhZLdU7B7KfnrmU/LfP?=
 =?us-ascii?Q?yeh04FcGXx0WPReo4t9wpsTCwOUs5p51AFME1pG4/iY/z7h9U+3ahXr06kJH?=
 =?us-ascii?Q?jXJQvKuQUtYDb1im0XUdc/tsj0jvxKA1F2XvSk3pMutNMCAvsXbBRQ+sSjlv?=
 =?us-ascii?Q?0ozFHs9cbVx4BfclXoULHyyAqZ0X0IHOqkOkjvvQ12bjmhXZp/swNrVZVKVU?=
 =?us-ascii?Q?XHsolcr5PO6TkRHWBcS7hgPkM5L/CkBk0eocinNZ8b4KkGKba061Rlbe/Ya+?=
 =?us-ascii?Q?7K17lTcSyXi4+wTNk8NnNYm9DcB6G6Z+Es254QV1JFB2PUT/OCJdZTz1R89z?=
 =?us-ascii?Q?5GysldKLIlov5A6UYldiB9vX0o+suEa3LsoyMAWysw+rU0p/NWs8InOLeUN+?=
 =?us-ascii?Q?dvxujbA6SYlpqKoflY0t8N67YnnJC8E7drsO/bjS4hDvpufOES9XjTfJjaiC?=
 =?us-ascii?Q?rlHVclgwcAH5ZR0kjmedhjLR3MyMkdbVuLbpRMPh8/mayVk4d8mjypzi0fC6?=
 =?us-ascii?Q?kpgA6Q=3D=3D?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 5facb12a-68da-4563-30d8-08d9b3710f14
X-MS-Exchange-CrossTenant-AuthSource: DM5PR10MB1466.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 29 Nov 2021 19:47:21.8552
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: qomYUTXlHTnrO7qf9Q5WqLiBEXnb3lb5MazjnJMNGCIgNKdpfqOTmcGnyX1J9+0BcdnAa3nVw5F4f3CNryn9jTC/VjGyDBhQk53bqrDdV/g=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR10MB1307
X-Proofpoint-Virus-Version: vendor=nai engine=6300 definitions=10183 signatures=668683
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 malwarescore=0 mlxscore=0
 suspectscore=0 mlxlogscore=999 spamscore=0 phishscore=0 bulkscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2110150000
 definitions=main-2111290092
X-Proofpoint-ORIG-GUID: QbnHTMBfw-pyGM3x7IlABlbLco3vE3r3
X-Proofpoint-GUID: QbnHTMBfw-pyGM3x7IlABlbLco3vE3r3
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

The vhost layer is creating kthreads to execute IO and management
operations. These threads need to share a mm with a userspace thread,
inherit cgroups, and we would like to have the thread accounted for
under the userspace thread's rlimit nproc value so a user can't overwhelm
the system with threads when creating VMs.

We have helpers for cgroups and mm but not for the rlimit nproc and in
the future we will probably want helpers for things like namespaces. For
those two items and to allow future sharing/inheritance, this patch adds
two helpers, user_worker_create and user_worker_start that allow callers
to create threads that copy or inherit the caller's attributes like mm,
cgroups, namespaces, etc, and are accounted for under the callers rlimits
nproc value similar to if the caller did a clone() in userspace. However,
instead of returning to userspace the thread is usable in the kernel for
modules like vhost or layers like io_uring.

[added flag validation code from Christian Brauner's SIG_IGN patch]
Signed-off-by: Mike Christie <michael.christie@oracle.com>
Acked-by: Christian Brauner <christian.brauner@ubuntu.com>
Reviewed-by: Christoph Hellwig <hch@lst.de>
---
 include/linux/sched/task.h |  5 +++
 kernel/fork.c              | 72 ++++++++++++++++++++++++++++++++++++++
 2 files changed, 77 insertions(+)

diff --git a/include/linux/sched/task.h b/include/linux/sched/task.h
index f8a658700075..ecb21c0d95ce 100644
--- a/include/linux/sched/task.h
+++ b/include/linux/sched/task.h
@@ -95,6 +95,11 @@ struct mm_struct *copy_init_mm(void);
 extern pid_t kernel_thread(int (*fn)(void *), void *arg, unsigned long flags);
 extern long kernel_wait4(pid_t, int __user *, int, struct rusage *);
 int kernel_wait(pid_t pid, int *stat);
+struct task_struct *user_worker_create(int (*fn)(void *), void *arg, int node,
+				       unsigned long clone_flags,
+				       u32 worker_flags);
+__printf(2, 3)
+void user_worker_start(struct task_struct *tsk, const char namefmt[], ...);
 
 extern void free_task(struct task_struct *tsk);
 
diff --git a/kernel/fork.c b/kernel/fork.c
index c9152596a285..e72239ae1e08 100644
--- a/kernel/fork.c
+++ b/kernel/fork.c
@@ -2543,6 +2543,78 @@ struct task_struct *create_io_thread(int (*fn)(void *), void *arg, int node)
 	return copy_process(NULL, 0, node, &args);
 }
 
+static bool user_worker_flags_valid(struct kernel_clone_args *kargs)
+{
+	/* Verify that no unknown flags are passed along. */
+	if (kargs->worker_flags & ~(USER_WORKER_IO | USER_WORKER |
+				    USER_WORKER_NO_FILES | USER_WORKER_SIG_IGN))
+		return false;
+
+	/*
+	 * If we're ignoring all signals don't allow sharing struct sighand and
+	 * don't bother clearing signal handlers.
+	 */
+	if ((kargs->flags & (CLONE_SIGHAND | CLONE_CLEAR_SIGHAND)) &&
+	    (kargs->worker_flags & USER_WORKER_SIG_IGN))
+		return false;
+
+	return true;
+}
+
+/**
+ * user_worker_create - create a copy of a process to be used by the kernel
+ * @fn: thread stack
+ * @arg: data to be passed to fn
+ * @node: numa node to allocate task from
+ * @clone_flags: CLONE flags
+ * @worker_flags: USER_WORKER flags
+ *
+ * This returns a created task, or an error pointer. The returned task is
+ * inactive, and the caller must fire it up through user_worker_start(). If
+ * this is an PF_IO_WORKER all singals but KILL and STOP are blocked.
+ */
+struct task_struct *user_worker_create(int (*fn)(void *), void *arg, int node,
+				       unsigned long clone_flags,
+				       u32 worker_flags)
+{
+	struct kernel_clone_args args = {
+		.flags		= ((lower_32_bits(clone_flags) | CLONE_VM |
+				   CLONE_UNTRACED) & ~CSIGNAL),
+		.exit_signal	= (lower_32_bits(clone_flags) & CSIGNAL),
+		.stack		= (unsigned long)fn,
+		.stack_size	= (unsigned long)arg,
+		.worker_flags	= USER_WORKER | worker_flags,
+	};
+
+	if (!user_worker_flags_valid(&args))
+		return ERR_PTR(-EINVAL);
+
+	return copy_process(NULL, 0, node, &args);
+}
+EXPORT_SYMBOL_GPL(user_worker_create);
+
+/**
+ * user_worker_start - Start a task created with user_worker_create
+ * @tsk: task to wake up
+ * @namefmt: printf-style format string for the thread name
+ * @arg: arguments for @namefmt
+ */
+void user_worker_start(struct task_struct *tsk, const char namefmt[], ...)
+{
+	char name[TASK_COMM_LEN];
+	va_list args;
+
+	WARN_ON(!(tsk->flags & PF_USER_WORKER));
+
+	va_start(args, namefmt);
+	vsnprintf(name, sizeof(name), namefmt, args);
+	set_task_comm(tsk, name);
+	va_end(args);
+
+	wake_up_new_task(tsk);
+}
+EXPORT_SYMBOL_GPL(user_worker_start);
+
 /*
  *  Ok, this is the main fork-routine.
  *
-- 
2.25.1