Received: by 2002:a25:b794:0:0:0:0:0 with SMTP id n20csp46257ybh; Fri, 2 Aug 2019 17:43:10 -0700 (PDT) X-Google-Smtp-Source: APXvYqxfY6ipyBrwGCrIHLmv6985PLEDE+k6zIR0CReaysUp4r2D+4t+pXJ6TCfw8r/g5oyCKNnr X-Received: by 2002:a63:e62:: with SMTP id 34mr124952499pgo.331.1564792990477; Fri, 02 Aug 2019 17:43:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1564792990; cv=none; d=google.com; s=arc-20160816; b=W6BJ1ih6YOXZu5qVRppv0qFzU3LORZ4Nto4pZ1fkMEc1s/pSH7XeUf8D+PY9FL0n4i xRjfgfAMAxd8X6flKOTUp085pyapAMWyYDgkBF97zmZdtHkU0LfS7wKFEanMsie0d8jH M4ncCjVSrKb16qJLB8oXIp7lWlb+GUf+k2JKo1+5UAy6HfE7J9gMZBOmQW66G92MIi6e JhSuiT7EDg9GE1j/nsaRQEpG2Jq2/iNaN9bDj/iijT0+brw2gh/v/7fZI2zcMQxZDO1e ohW8rhyPz3aJZc+BdOwZNflLyjF3g+jG/3X1l+7yRwR1OwCB93KquNonDpxeMZ+SMXAS BLKg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=xBC7gfQraRndRwf/ehhFfLHeHrp670+sEcUuBD1iJxU=; b=c4nalbSLVaxk1GmAazVo9mxw5dVFp1yBqtKLA3JIGRokJMrufp7vEDKQx5pRnqUIs5 3FMpOKO2opcXHgm3lO26xCzBBytGJp5xiAaJT54FfE5mgYaKsG0bas7hRqy6Kn7cb3mT gVEZqDpohRqTvDEEE9MMIuelHJH1s7D7aRIvYBNmboZD0p3fn11oAL78XodE8WhM4Ps3 Jaeb8rum3rmSrkPSOyYhqhAKX7U91X1ZfqcqnR6W8W9UgT149vNXxHRAovt2f0vegT0j 35UQ3jlxoEdBqffcNSoSaDqJ/QL1sYBoH5edRgJRw5GSNI3sJE3gCSZ4N+MyXLOqVZW5 /c6w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=O60CUC+r; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id w22si38767647pfn.118.2019.08.02.17.42.55; Fri, 02 Aug 2019 17:43:10 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=O60CUC+r; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2393904AbfHBNXH (ORCPT + 99 others); Fri, 2 Aug 2019 09:23:07 -0400 Received: from mail.kernel.org ([198.145.29.99]:33608 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1731794AbfHBNXF (ORCPT ); Fri, 2 Aug 2019 09:23:05 -0400 Received: from sasha-vm.mshome.net (c-73-47-72-35.hsd1.nh.comcast.net [73.47.72.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 6A298217D4; Fri, 2 Aug 2019 13:23:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1564752184; bh=FiM5YvIzCSvxAqFNHP7gBJ+hf6uOa38n0rEzatyP9WI=; h=From:To:Cc:Subject:Date:From; b=O60CUC+rGeSXycwlOIzIfEtsq8EJghQYe5ThkaUm0sndCwzdBYt6W3nXNLZsiJtj0 7n5V5MoTq76P7VrHmvVQsck5NyR+w9Fp/famuHasOXaZm3/SzahWnNxXRSVYNXzmuC LUKi+ie88VG8ZjuL6I+Wxjue0H7Lvpaoqu6i0HwQ= From: Sasha Levin To: linux-kernel@vger.kernel.org, stable@vger.kernel.org Cc: Florian Westphal , Thomas Jarosch , Juliana Rodrigueiro , Pablo Neira Ayuso , Sasha Levin , netfilter-devel@vger.kernel.org, coreteam@netfilter.org, netdev@vger.kernel.org Subject: [PATCH AUTOSEL 4.19 01/42] netfilter: nfnetlink: avoid deadlock due to synchronous request_module Date: Fri, 2 Aug 2019 09:22:21 -0400 Message-Id: <20190802132302.13537-1-sashal@kernel.org> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 X-stable: review X-Patchwork-Hint: Ignore Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Florian Westphal [ Upstream commit 1b0890cd60829bd51455dc5ad689ed58c4408227 ] Thomas and Juliana report a deadlock when running: (rmmod nf_conntrack_netlink/xfrm_user) conntrack -e NEW -E & modprobe -v xfrm_user They provided following analysis: conntrack -e NEW -E netlink_bind() netlink_lock_table() -> increases "nl_table_users" nfnetlink_bind() # does not unlock the table as it's locked by netlink_bind() __request_module() call_usermodehelper_exec() This triggers "modprobe nf_conntrack_netlink" from kernel, netlink_bind() won't return until modprobe process is done. "modprobe xfrm_user": xfrm_user_init() register_pernet_subsys() -> grab pernet_ops_rwsem .. netlink_table_grab() calls schedule() as "nl_table_users" is non-zero so modprobe is blocked because netlink_bind() increased nl_table_users while also holding pernet_ops_rwsem. "modprobe nf_conntrack_netlink" runs and inits nf_conntrack_netlink: ctnetlink_init() register_pernet_subsys() -> blocks on "pernet_ops_rwsem" thanks to xfrm_user module both modprobe processes wait on one another -- neither can make progress. Switch netlink_bind() to "nowait" modprobe -- this releases the netlink table lock, which then allows both modprobe instances to complete. Reported-by: Thomas Jarosch Reported-by: Juliana Rodrigueiro Signed-off-by: Florian Westphal Signed-off-by: Pablo Neira Ayuso Signed-off-by: Sasha Levin --- net/netfilter/nfnetlink.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/net/netfilter/nfnetlink.c b/net/netfilter/nfnetlink.c index 916913454624f..7f2c1915763f8 100644 --- a/net/netfilter/nfnetlink.c +++ b/net/netfilter/nfnetlink.c @@ -575,7 +575,7 @@ static int nfnetlink_bind(struct net *net, int group) ss = nfnetlink_get_subsys(type << 8); rcu_read_unlock(); if (!ss) - request_module("nfnetlink-subsys-%d", type); + request_module_nowait("nfnetlink-subsys-%d", type); return 0; } #endif -- 2.20.1