Received: by 2002:a05:6a10:a841:0:0:0:0 with SMTP id d1csp3905972pxy; Mon, 26 Apr 2021 12:39:23 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz+8C3W2T7fvtpen5jxEyCIu4JzGnOX6PGNLVHieyNuU3kGQLPcYe+Zy4lFPGTS/jdNEawh X-Received: by 2002:aa7:9806:0:b029:253:e613:4ada with SMTP id e6-20020aa798060000b0290253e6134adamr19220371pfl.65.1619465963666; Mon, 26 Apr 2021 12:39:23 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1619465963; cv=none; d=google.com; s=arc-20160816; b=RrwyOA/MOiaGzxWKwPdNBvJ4Sm3pSUXUYLxZURdVzvcjr8mx1tODQfHHCQXkdkKYUK igr2hBXuiXD2cSeSTa//sQiY9uGhIhEpA1CGpXzhfI/zNtFs85gbX3DKbaANN4RbXUUl LQc+q7QXOoYf28117MYyUe/kU4GVuZ7kbv3Y15LIFtPuAG+j4HeyAJ461Fk3gReb36ll 4EyH1Lj7KSD+VZD2jpyn0cgbW6GxqFq3i+pDyk7u7QvwPg2SFRMvOts72lk1z6BRpVJN K3sZL9QFE6qpZ900Mtj4Z+K0+YdeFdFGUM7HjHtflU1Yk9Sj8bV5e7ojCGg38er8xNY9 HrZQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:from:subject:cc:to:message-id:date; bh=n51Zp8cx4rarTAvGdnQi0RVZp7wzR5G6gsG11Bppgzc=; b=z2FpiN8g8hMEfjdTRWtlGC7+8F+839KQP/VlFA+IQw9TWkZwFfMuJmNASNenqSe8l+ LNlnqOHa1pOchry5Kwj0C+qeOzI8hNrNPrRMrI2ouh6R6kBS3aYE0T4iPwKsTW4uzuVt AMzB11JGFf6VCcrDr6Ivmmlk7I/yx3DuoK6Foe2nmQopgBzJABKqx1NU3HnZEPIMH+Qy 2rrc80zPq/7Q4KF8lA/LnwlydUGm2Iw2iWm58g7k8yqUhwhJ0+yfAqPOyDoCnCGCZgQD twbEdC4HGCHaIKh2/JkClgWLSsrJl1tf++jWCLxiZ4qOc5c0EGozL40DJ1z6AGdlmcBm OJig== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id s70si765388pfs.91.2021.04.26.12.39.11; Mon, 26 Apr 2021 12:39:23 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S240256AbhDZTJW (ORCPT + 99 others); Mon, 26 Apr 2021 15:09:22 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:53278 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S240229AbhDZTJK (ORCPT ); Mon, 26 Apr 2021 15:09:10 -0400 Received: from mail.monkeyblade.net (shards.monkeyblade.net [IPv6:2620:137:e000::1:9]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 98F8FC061574; Mon, 26 Apr 2021 12:08:28 -0700 (PDT) Received: from localhost (unknown [IPv6:2601:601:9f00:477::3d5]) by mail.monkeyblade.net (Postfix) with ESMTPSA id 99DD74F21C303; Mon, 26 Apr 2021 12:08:26 -0700 (PDT) Date: Mon, 26 Apr 2021 12:08:22 -0700 (PDT) Message-Id: <20210426.120822.232032630973964712.davem@davemloft.net> To: jay.vosburgh@canonical.com Cc: jinyiting@huawei.com, vfalico@gmail.com, andy@greyhouse.net, kuba@kernel.org, netdev@vger.kernel.org, security@kernel.org, linux-kernel@vger.kernel.org, xuhanbing@huawei.com, wangxiaogang3@huawei.com Subject: Re: [PATCH] bonding: 3ad: Fix the conflict between bond_update_slave_arr and the state machine From: David Miller In-Reply-To: <20034.1619450557@famine> References: <1618994301-1186-1-git-send-email-jinyiting@huawei.com> <20210423.130748.1071901004935481894.davem@davemloft.net> <20034.1619450557@famine> X-Mailer: Mew version 6.8 on Emacs 27.1 Mime-Version: 1.0 Content-Type: Text/Plain; charset=iso-2022-jp Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (mail.monkeyblade.net [0.0.0.0]); Mon, 26 Apr 2021 12:08:27 -0700 (PDT) Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Jay Vosburgh Date: Mon, 26 Apr 2021 08:22:37 -0700 > David Miller wrote: > >>From: jinyiting >>Date: Wed, 21 Apr 2021 16:38:21 +0800 >> >>> The bond works in mode 4, and performs down/up operations on the bond >>> that is normally negotiated. The probability of bond-> slave_arr is NULL >>> >>> Test commands: >>> ifconfig bond1 down >>> ifconfig bond1 up >>> >>> The conflict occurs in the following process: >>> >>> __dev_open (CPU A) >>> --bond_open >>> --queue_delayed_work(bond->wq,&bond->ad_work,0); >>> --bond_update_slave_arr >>> --bond_3ad_get_active_agg_info >>> >>> ad_work(CPU B) >>> --bond_3ad_state_machine_handler >>> --ad_agg_selection_logic >>> >>> ad_work runs on cpu B. In the function ad_agg_selection_logic, all >>> agg->is_active will be cleared. Before the new active aggregator is >>> selected on CPU B, bond_3ad_get_active_agg_info failed on CPU A, >>> bond->slave_arr will be set to NULL. The best aggregator in >>> ad_agg_selection_logic has not changed, no need to update slave arr. >>> >>> The conflict occurred in that ad_agg_selection_logic clears >>> agg->is_active under mode_lock, but bond_open -> bond_update_slave_arr >>> is inspecting agg->is_active outside the lock. >>> >>> Also, bond_update_slave_arr is normal for potential sleep when >>> allocating memory, so replace the WARN_ON with a call to might_sleep. >>> >>> Signed-off-by: jinyiting >>> --- >>> >>> Previous versions: >>> * https://lore.kernel.org/netdev/612b5e32-ea11-428e-0c17-e2977185f045@huawei.com/ >>> >>> drivers/net/bonding/bond_main.c | 7 ++++--- >>> 1 file changed, 4 insertions(+), 3 deletions(-) >>> >>> diff --git a/drivers/net/bonding/bond_main.c b/drivers/net/bonding/bond_main.c >>> index 74cbbb2..83ef62d 100644 >>> --- a/drivers/net/bonding/bond_main.c >>> +++ b/drivers/net/bonding/bond_main.c >>> @@ -4406,7 +4404,9 @@ int bond_update_slave_arr(struct bonding *bond, struct slave *skipslave) >>> if (BOND_MODE(bond) == BOND_MODE_8023AD) { >>> struct ad_info ad_info; >>> >>> + spin_lock_bh(&bond->mode_lock); >> >>The code paths that call this function with mode_lock held will now deadlock. > > No path should be calling bond_update_slave_arr with mode_lock > already held (it expects RTNL only); did you find one? > > My concern is that there's something else that does the opposite > order, i.e., mode_lock first, then RTNL, but I haven't found an example. > This patch is removing a lockdep assertion masking sure that mode_lock was held when this function was called. That should have been triggering all the time, right? Thanks.