Received: by 2002:a05:6a11:4021:0:0:0:0 with SMTP id ky33csp68862pxb; Tue, 21 Sep 2021 19:01:02 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyJXAOGk0s1RTx2UO+ao1y455plGhK8VQwdaUvVuwPhRfwq4FjiiC3n/R9DDe7M5SEUBwms X-Received: by 2002:a05:6638:d03:: with SMTP id q3mr2705298jaj.64.1632276062671; Tue, 21 Sep 2021 19:01:02 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1632276062; cv=pass; d=google.com; s=arc-20160816; b=XP+w3TalYkxMMmkyM3ANfQuNtmbzwg0Ax95VXgl2luI9kJ59IF6Wb5WsN0I2fVP9No 8Wn+yLEo1S0YVTtyr9BhDfis7p7B3wGhMZbDihP0Qluw+BSqfZpRAG9JfhUbwxft38wE IgUbQhtaF0Qld/g+IijY746doohxtIiL349EvrS3HgxipobbBO3p/zKIzYfmG7ND5sLh CnyBkcm3b7Sr6KNX+oZUazVd6BljpJUlu/B6cuvNH6KZ2o1frW+PeRL8InqwPjqV8Tis adGSuBkUekPNMh5Est/cSqMMvGlbygHDqgNZdj1YsP1n+Ujapv2ymDZqD7hwgt3+zW3J Kiow== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:content-transfer-encoding :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature:dkim-signature; bh=grzrkheUf/AUTax6MwLoWRaJA0vx9VV75WXR4SB9qdg=; b=NyAhmSsTT/Za1ib65SiGo03v0zHXVjaOS74KtNzZnhnLtwjyneJ/ZCnrklc1nPLZGH IInvZ2eWgICED+s5v1dNcVHP+5stGJeniS1guIp0IJPx8FM6umo32a398f/38adyvGNu z0lwmfiRl9RTji7aAG6mgceUv7Bj4jVrm3auOmbX+METJ5Fzh2agcmLO0DKp3yIyxIBh Q6LSl4aBh9xbjzROt9Jsjj2JyRGYF+dAHaEIPY7fxLyvjOPN39++AmgOWZWOtO5JeSjq bKrqlMWawb1ze412NPTgBkvFv82TMsC/wKPuuklxNY6+4GzsNDNqMHyMejg5M+oFYqBz sy+A== ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2021-07-09 header.b=vGdIxXcQ; dkim=pass header.i=@oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=WaAqs2Xw; arc=pass (i=1 spf=pass spfdomain=oracle.com dkim=pass dkdomain=oracle.com dmarc=pass fromdomain=oracle.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id i16si731535jaq.106.2021.09.21.19.00.51; Tue, 21 Sep 2021 19:01:02 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2021-07-09 header.b=vGdIxXcQ; dkim=pass header.i=@oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=WaAqs2Xw; arc=pass (i=1 spf=pass spfdomain=oracle.com dkim=pass dkdomain=oracle.com dmarc=pass fromdomain=oracle.com); spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235753AbhIUVyz (ORCPT + 99 others); Tue, 21 Sep 2021 17:54:55 -0400 Received: from mx0a-00069f02.pphosted.com ([205.220.165.32]:15404 "EHLO mx0a-00069f02.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S235670AbhIUVyk (ORCPT ); Tue, 21 Sep 2021 17:54:40 -0400 Received: from pps.filterd (m0246629.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.16.1.2/8.16.1.2) with SMTP id 18LLEEea013587; Tue, 21 Sep 2021 21:52:36 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : content-transfer-encoding : content-type : mime-version; s=corp-2021-07-09; bh=grzrkheUf/AUTax6MwLoWRaJA0vx9VV75WXR4SB9qdg=; b=vGdIxXcQwBHZthoAi8ONqfnBLP1/oHaMHZgBpGwreSIzgc1DnY0ADl+Kyz++ogEEvs6Z aCveL1iS1SNNUKnQ4zeKDPxwng1ID8NwIp0njJBRnBnQKuFV4Gk0YYr8s3ZG+CRPAHSS 7L+xl5EHOmib4aHxKYLv90K1aINQCYxMiDxiksid+IMWRbYAlVi3d64TKWDizsmTnR5W 4QKPEykSD8CgmMuyHtWhafzjkmuFQ6mqhT6m1LE4rFF08gOHs8iG/iXf3SCiSZK2oTAk /bnp+B3D4LmETrg9H+LoFzU06zKFE+I9iXZvmM+FYzJlBYJQF4yuxeqS+gKkmn2EEyGJ iQ== Received: from aserp3020.oracle.com (aserp3020.oracle.com [141.146.126.70]) by mx0b-00069f02.pphosted.com with ESMTP id 3b7q4s04xy-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 21 Sep 2021 21:52:36 +0000 Received: from pps.filterd (aserp3020.oracle.com [127.0.0.1]) by aserp3020.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 18LLomVf154016; Tue, 21 Sep 2021 21:52:35 GMT Received: from nam12-bn8-obe.outbound.protection.outlook.com (mail-bn8nam12lp2173.outbound.protection.outlook.com [104.47.55.173]) by aserp3020.oracle.com with ESMTP id 3b7q59s7my-2 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 21 Sep 2021 21:52:34 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=er4+0h0mu3ohXHJreX2InOYC156Z58kGAy67pNm7FtNLKktqI2002s65fGkIBsJI33ba9MiZiyUOtCkfTUioLlxh+gbV3zTzg8MHyQ3hKaKBNjCxDrYwnCLVkvh4jRI76sdNeQHdc/0FsVrjiDKU2wkTuDLL3IlzRHHji4lJn8tg9rz39NylJyvkihqlQHbtGlc1jA4YUK/xGCUMwKC5SbfHLGgDvdYT75rrfGrzD1LiJZ6CjGkavCxRnew1reb0lhvJIaODrmD0AeUrkd/pY+6C0rgWpV5MqqZRapU73kYwr6JAUOgA1VihHlRzVjk4g9GPzLczFNRi2NpGOrqc4g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=grzrkheUf/AUTax6MwLoWRaJA0vx9VV75WXR4SB9qdg=; b=R+z8dTOCAyfKvugPh5VZkQO0erJlfpujwvjqI5/dBs+VGfv+nRbkIRvQv2pdmgzzl20dnmKTjTs/Oa75LWJKFUJhTgePRuR9d0isXvGROLEWJCD65k271qcDwMBar/DlVtcIWx+XZ3v/kT6RzW1MvcVRd7511/EgounLu4RC7NI/avnWop8SsuX662Op+BdNioDzW+cSm0siZTsz3laWup3itAVIh2h4b6kxmX3n5odiFSp06duY7XEwUZ1qx3DKvdx5bg5wtmC1aifK2AZkdb2IujMoqcJW6w8pxJs4o9m9ENLydlTjYidRZRJURAZISiOs90gwbkM/tsFxI+F9bQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=grzrkheUf/AUTax6MwLoWRaJA0vx9VV75WXR4SB9qdg=; b=WaAqs2XwCunEFis9/dzN+Ur8WGxekrn19LFhSmyUr5v627jUvpxQNoJGgC6Tavxy4teiRV/xpxb/k9e0dqHhbZR5gByh7fyFpiqikSykLF5rVyKb0dVUgEYrF3WjnKgf8+wBnStOAnudXbzgU62G2DJvPrh69wKCjLcdF4l74Ak= Authentication-Results: sina.com; dkim=none (message not signed) header.d=none;sina.com; dmarc=none action=none header.from=oracle.com; Received: from BYAPR10MB3573.namprd10.prod.outlook.com (2603:10b6:a03:11e::32) by BY5PR10MB3892.namprd10.prod.outlook.com (2603:10b6:a03:1fb::29) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4523.14; Tue, 21 Sep 2021 21:52:33 +0000 Received: from BYAPR10MB3573.namprd10.prod.outlook.com ([fe80::5881:380c:7098:5701]) by BYAPR10MB3573.namprd10.prod.outlook.com ([fe80::5881:380c:7098:5701%6]) with mapi id 15.20.4523.018; Tue, 21 Sep 2021 21:52:33 +0000 From: Mike Christie To: hdanton@sina.com, hch@infradead.org, stefanha@redhat.com, jasowang@redhat.com, mst@redhat.com, sgarzare@redhat.com, virtualization@lists.linux-foundation.org, christian.brauner@ubuntu.com, axboe@kernel.dk, linux-kernel@vger.kernel.org Cc: Mike Christie Subject: [PATCH V2 4/9] fork: add option to not clone or dup files Date: Tue, 21 Sep 2021 16:52:13 -0500 Message-Id: <20210921215218.89844-5-michael.christie@oracle.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20210921215218.89844-1-michael.christie@oracle.com> References: <20210921215218.89844-1-michael.christie@oracle.com> Content-Transfer-Encoding: 8bit Content-Type: text/plain X-ClientProxiedBy: DM5PR1101CA0021.namprd11.prod.outlook.com (2603:10b6:4:4c::31) To BYAPR10MB3573.namprd10.prod.outlook.com (2603:10b6:a03:11e::32) MIME-Version: 1.0 Received: from localhost.localdomain (73.88.28.6) by DM5PR1101CA0021.namprd11.prod.outlook.com (2603:10b6:4:4c::31) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4544.13 via Frontend Transport; Tue, 21 Sep 2021 21:52:32 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 522ab1ab-8f8b-4131-662d-08d97d4a1dc0 X-MS-TrafficTypeDiagnostic: BY5PR10MB3892: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:6790; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: JWW17t885MZfU+f5yricMEvlytVqjgWbpUYMtC11W1MxP/v8vp5Yd4RYSq2c/0NHf0JdroQnGGj7CJhpifU8dyexrEDZ4V4Ggo9OTYiTvJNnMSMlBG8+EF4eR+8rFOGgd4UKAko1kmBQq6VeQAHa+XQlM35OLYqKtm0vVruJ3sBzYvQh7QVk5TGUa8f4jtJJ/Oua7+taofn90E2gOkpPNik8X9wIPEArSV2SmWUppYuWmXswK5DMeayuLDfis3aPxZ7oYfkze0LMGyP6Stk+M8/3c42j4h8EJ8hmy1+v9jmEe/zx80oZOMbvomAUuzThXWY57bR+iQXBtn8tbmu62JFBSCmz3RMd7/wKdjLTBUnzruV3onpoqjD5DnjyZ0Ul2KlWJwNq/EUSh+5HJDYerG7UbaJWtdZ2UDfQnxAbg8a3SWCoEUTSOAMsIE3OFainpdDa7JRgDHP1x9uYQo85bF7fu0oxVSvjRHO5lDBKwsEdQxAJAoECiDhLvRVZhK2I+HPeMnZAMy3ZamMgcAjqU3tcjkf/ifOKTVxm8RunT1jgYcHR4FRiqdVjzoloN0L8HD5/PZyRep52qt7v9hXXt1IgWfLJNnTCRGbQ44h1t1HCKLstQSlpaTmDgqkahrrrwgLhPvePabOjEms69/oiqhe676o7PsA+Jmzk6Fxrc/XhJpDmBiM/vwbBTzhx+qLe9ExWq1VHV+qLjYTVg+JZ3gexd+1OUhQr5X38qCcj3aI= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR10MB3573.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(366004)(6506007)(52116002)(107886003)(956004)(66946007)(26005)(4326008)(7416002)(66556008)(2616005)(66476007)(86362001)(6486002)(8676002)(6666004)(508600001)(316002)(2906002)(6512007)(8936002)(38100700002)(1076003)(5660300002)(83380400001)(186003)(38350700002)(921005)(36756003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?/HHjmEW4e6QMHl0tfu0ScS7ASz+saGWsbFMVcQlpRtTy3r/v4h0V4vo9FZzX?= =?us-ascii?Q?T56zG+qmgDBC9Wj/SWXXxEg4KSYlHUO+pRA8sWRrZhl/wfK+6in6STbRSo+y?= =?us-ascii?Q?wiKzJ5JAfRgwz38wayS8OWNTqFbbwDvBsrgVnY6cJ8fCicC2/01y6sI0qWXT?= =?us-ascii?Q?fNnJZiDv5hGu6Pdt6HCrzb6S4RgbutaqHrPB7SmCK3eonW/fHofilZ6dr7Po?= =?us-ascii?Q?UPC2V8x+ut6WUqrracgV/HAl/3QoMhQ6EAISjJj7megHpGKPfu3PqeYrj6V8?= =?us-ascii?Q?n0yvTGQrpQizZxgXyCXM3Ll0ywrb2TgLj6C1T7xl3/PVG2nJqxlV3tGwV/xZ?= =?us-ascii?Q?T0fUeh6dz4oWSmrRcQmNNomfFQHYw6bCvb5D1qzb2hl75WJbUNE6jgHovLaQ?= =?us-ascii?Q?GFtSgnekzmrab+amHoapUh8N6sG3+8V/A+CikShWIqW1lmYsPWxgVW+EkhQT?= =?us-ascii?Q?VHniUFxWqT0Jq1qV3i7dAxcOsjiXpY4acg08uNsF1MNMuR+ykqZmmRRSVjeq?= =?us-ascii?Q?RZJaW4puATb0SYnAvrorLeod8SNYwQy++wphZGdMkfY+hc1aD5unlt74Tqry?= =?us-ascii?Q?jU2JgHCL3SXRqFlme5cndFZreVGKLhYs2eLFPv2HUXbtFRjt4woFhnyFBukB?= =?us-ascii?Q?g0bMpzI7U4km2sq6yoBEbcpvZLCgxuAjTjZyRACNBVZBharTv2aDujW0xTE4?= =?us-ascii?Q?OL4IPao5I7rqKUYP3JrJf4U7Z2kpvWcnkpLJv4mzJVG7YLEyQM6b+pXi9LWg?= =?us-ascii?Q?vIPXcxr1Y1AZHyftsVYKbUm67cLz03OVmKuj8xaAM9KGtdTuJsdce2Hpy+8t?= =?us-ascii?Q?/CE950xuvGe/MdI3yrVNzFxzdZxuI/rJkCOXXDz/Wu16rRTh125Wdg6b5kU1?= =?us-ascii?Q?MImkByWDSV5sBIS/rfgV/wPgJAr/vUlo4J709oFJz4M3VrAFL/MD3icEW3hk?= =?us-ascii?Q?cexmvOfsJK6iedrC8eg5Lgoh3ots+nVaBL9JPMNetBK4pINDzPIoGwynJRIL?= =?us-ascii?Q?4mmZt0FjTaaSvQfHXZWjhvLy1BYeZ2cKqvofiIp/llRkoKY3NL5V+ZEQa8Yg?= =?us-ascii?Q?oqWEEo53aedlb1Ci8jd5Q6x6ttkWu57N30VGos8a4NMwLAtevlydFAKvnCdZ?= =?us-ascii?Q?vQzjb38fwYpFwqUeMuk6VclQ12t/D/iXHoPea5gHbvUItii0VaPR9WAJAcIA?= =?us-ascii?Q?meKoITrPLFNsGbq/WAfUXPscbL7VzowTvlDDveLRJvuPJOFhAW7nzZdQ2A2Q?= =?us-ascii?Q?H22Q6bshPdKIh7DuIsumbio61UwdH5EfYpBPMmCqsIAKYjbA5SxkXlzlKH5c?= =?us-ascii?Q?ygXdb641is6ZAORwH6HgIz5+?= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: 522ab1ab-8f8b-4131-662d-08d97d4a1dc0 X-MS-Exchange-CrossTenant-AuthSource: BYAPR10MB3573.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Sep 2021 21:52:33.1525 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: tmCIvL0nysQSH7Mc9Yuwp+XTMXac8gMMoI1Y5jgtpo/QKWP04hpChtCSseKFucSvri1FFMnyjzaNxwtaorjDiInhpIMS+VYpN3YQbsWcQXo= X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR10MB3892 X-Proofpoint-Virus-Version: vendor=nai engine=6300 definitions=10114 signatures=668682 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 spamscore=0 suspectscore=0 phishscore=0 mlxlogscore=999 bulkscore=0 mlxscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2109200000 definitions=main-2109210130 X-Proofpoint-GUID: sjf9ewVuIzLs4ohUMjrlSPh_dOHpDvgp X-Proofpoint-ORIG-GUID: sjf9ewVuIzLs4ohUMjrlSPh_dOHpDvgp Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Each vhost device gets a thread that is used to perform IO and management operations. Instead of a thread that is accessing a device, the thread is part of the device, so when it calls the kernel_worker() function added in the next patch we can't dup or clone the parent's files/FDS because it would do an extra increment on ourself. Later, when we do: Qemu process exits: do_exit -> exit_files -> put_files_struct -> close_files we would leak the device's resources because of that extra refcount on the fd or file_struct. This patch adds a no_files option so these worker threads can prevent taking an extra refcount on themselves. Signed-off-by: Mike Christie --- include/linux/sched/task.h | 1 + kernel/fork.c | 11 +++++++++-- 2 files changed, 10 insertions(+), 2 deletions(-) diff --git a/include/linux/sched/task.h b/include/linux/sched/task.h index cf7c9fffc839..e165cc67fd3c 100644 --- a/include/linux/sched/task.h +++ b/include/linux/sched/task.h @@ -20,6 +20,7 @@ struct css_set; #define KERN_WORKER_IO BIT(0) #define KERN_WORKER_USER BIT(1) +#define KERN_WORKER_NO_FILES BIT(2) struct kernel_clone_args { u64 flags; diff --git a/kernel/fork.c b/kernel/fork.c index 4b0e8257993b..98264cf1d6a6 100644 --- a/kernel/fork.c +++ b/kernel/fork.c @@ -1532,7 +1532,8 @@ static int copy_fs(unsigned long clone_flags, struct task_struct *tsk) return 0; } -static int copy_files(unsigned long clone_flags, struct task_struct *tsk) +static int copy_files(unsigned long clone_flags, struct task_struct *tsk, + int no_files) { struct files_struct *oldf, *newf; int error = 0; @@ -1544,6 +1545,11 @@ static int copy_files(unsigned long clone_flags, struct task_struct *tsk) if (!oldf) goto out; + if (no_files) { + tsk->files = NULL; + goto out; + } + if (clone_flags & CLONE_FILES) { atomic_inc(&oldf->count); goto out; @@ -2179,7 +2185,8 @@ static __latent_entropy struct task_struct *copy_process( retval = copy_semundo(clone_flags, p); if (retval) goto bad_fork_cleanup_security; - retval = copy_files(clone_flags, p); + retval = copy_files(clone_flags, p, + args->worker_flags & KERN_WORKER_NO_FILES); if (retval) goto bad_fork_cleanup_semundo; retval = copy_fs(clone_flags, p); -- 2.25.1