Received: by 2002:a25:23cc:0:0:0:0:0 with SMTP id j195csp662911ybj; Thu, 7 May 2020 04:52:15 -0700 (PDT) X-Google-Smtp-Source: APiQypK0MaqySZAMtVhboQ/JVoEk6yTzCqqz6sz4mVsHJ+qwOrL594zENUDosLu46lMJjpa/apaT X-Received: by 2002:a17:906:1199:: with SMTP id n25mr12076265eja.30.1588852335067; Thu, 07 May 2020 04:52:15 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1588852335; cv=none; d=google.com; s=arc-20160816; b=Q19FE4idwq4IzZ06SzoBuNTFolv/y2nzSHcWBdc4ro14KCRHU398wGAKaWUgi7IeGx JX3+ttKF0d9IANkfaO8kAq4ogRdmPzEDMq6tROuvA5RL2kiQznF9XSyIdIDL/4Wv3Mtv IbViU5DN2i6gzCrmvFBIbSiJyARsEqniYB0+e2B6en1WE8K55pQYQV9jT8FRlphOwm9t azi9fyZaHGgMAiQZjQo6hKbLblItt0XmZroLwvakOtA22A1YRdMQLD5A+sZ1tDP1dwkT eADOtp4Uf+PbWtY5TmO3R5nyCt1frKHEmbKHs7i1Tt49csTnTMrF7d3kfztiN/TeQXzt JXZA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:organization:from:references:cc:to:subject:ironport-sdr :ironport-sdr; bh=JluJkpXkoDHKZs9atgMU9vvZBLIJiPRj7NAJJaQp/AM=; b=eseWTsroznCcULJb4BVpANct/wl1M819szvPtPoQ6n2tO72ifWLpboIXJZJBf5E3gz 9O3jHtLO3Ie/jckTH1rU5UuNVyTYjbMUdZWU8BcuYPcEKEBlaOSOLnvPrb3oCH1ATdz3 px59dPzBQ9JyZleuh2LkThljD7hLJdBlJ0j3FTGVJvqEDC52Zusr+2NW46ff1fuzlN/W R6WYHW0R+5zJ6hVn/sR6M6CbLDzF9tfpYZJJ5b48lqpKHQumn1mn9z9g1TPD2jOKJehC ed1W7qiaU3f1YBKYLbQLdj4swynJWnx0S78HQfhju/HXedoTLrVXrOwAiLp3eHRwOxFn ZXDw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id p9si265163edt.570.2020.05.07.04.51.51; Thu, 07 May 2020 04:52:15 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726575AbgEGLs1 (ORCPT + 99 others); Thu, 7 May 2020 07:48:27 -0400 Received: from mga06.intel.com ([134.134.136.31]:64619 "EHLO mga06.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725903AbgEGLs0 (ORCPT ); Thu, 7 May 2020 07:48:26 -0400 IronPort-SDR: 0WDD4SYlelv/CMqDGbsa+Qd1M0WI661zriOKiJ/LvooJuDx2HTCleMYzxo4s8Xh6kVqvsU8E99 JqfAMf+jr5cw== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga001.jf.intel.com ([10.7.209.18]) by orsmga104.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 07 May 2020 04:48:24 -0700 IronPort-SDR: i8kWrQpgWn75L4Fe2QfqwBPYtA7TVrOdZfwcIB8+RUtpWKVTAnVGtzTQxXUsavF0TyDLC53E6+ 81IX49BuWPHQ== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.73,363,1583222400"; d="scan'208";a="339328430" Received: from ahunter-desktop.fi.intel.com (HELO [10.237.72.157]) ([10.237.72.157]) by orsmga001.jf.intel.com with ESMTP; 07 May 2020 04:48:21 -0700 Subject: Re: [PATCH V1 2/2] mmc: core: Fix recursive locking issue in CQE recovery path To: Veerabhadrarao Badiganti , ulf.hansson@linaro.org Cc: stummala@codeaurora.org, linux-mmc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-msm@vger.kernel.org, Sarthak Garg , stable@vger.kernel.org, Baolin Wang , Yoshihiro Shimoda , Andreas Koop , Thomas Gleixner References: <1588775643-18037-1-git-send-email-vbadigan@codeaurora.org> <1588775643-18037-3-git-send-email-vbadigan@codeaurora.org> From: Adrian Hunter Organization: Intel Finland Oy, Registered Address: PL 281, 00181 Helsinki, Business Identity Code: 0357606 - 4, Domiciled in Helsinki Message-ID: Date: Thu, 7 May 2020 14:48:42 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: <1588775643-18037-3-git-send-email-vbadigan@codeaurora.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 6/05/20 5:34 pm, Veerabhadrarao Badiganti wrote: > From: Sarthak Garg > > Consider the following stack trace > > -001|raw_spin_lock_irqsave > -002|mmc_blk_cqe_complete_rq > -003|__blk_mq_complete_request(inline) > -003|blk_mq_complete_request(rq) > -004|mmc_cqe_timed_out(inline) > -004|mmc_mq_timed_out > > mmc_mq_timed_out acquires the queue_lock for the first > time. The mmc_blk_cqe_complete_rq function also tries to acquire > the same queue lock resulting in recursive locking where the task > is spinning for the same lock which it has already acquired leading > to watchdog bark. > > Fix this issue with the lock only for the required critical section. > > Cc: # v4.19+ > Suggested-by: Sahitya Tummala > Signed-off-by: Sarthak Garg > --- > drivers/mmc/core/queue.c | 11 ++++++----- > 1 file changed, 6 insertions(+), 5 deletions(-) > > diff --git a/drivers/mmc/core/queue.c b/drivers/mmc/core/queue.c > index 25bee3d..72bef39 100644 > --- a/drivers/mmc/core/queue.c > +++ b/drivers/mmc/core/queue.c > @@ -107,7 +107,7 @@ static enum blk_eh_timer_return mmc_cqe_timed_out(struct request *req) > case MMC_ISSUE_DCMD: > if (host->cqe_ops->cqe_timeout(host, mrq, &recovery_needed)) { > if (recovery_needed) > - __mmc_cqe_recovery_notifier(mq); > + mmc_cqe_recovery_notifier(mrq); > return BLK_EH_RESET_TIMER; > } > /* No timeout (XXX: huh? comment doesn't make much sense) */ > @@ -131,12 +131,13 @@ static enum blk_eh_timer_return mmc_mq_timed_out(struct request *req, > > spin_lock_irqsave(&mq->lock, flags); > > - if (mq->recovery_needed || !mq->use_cqe || host->hsq_enabled) > + if (mq->recovery_needed || !mq->use_cqe || host->hsq_enabled) { > ret = BLK_EH_RESET_TIMER; > - else > + spin_unlock_irqrestore(&mq->lock, flags); > + } else { > + spin_unlock_irqrestore(&mq->lock, flags); > ret = mmc_cqe_timed_out(req); > - > - spin_unlock_irqrestore(&mq->lock, flags); > + } This looks good, but I think there needs to be another change also. I will send a patch for that, but in the meantime maybe you could straighten up the code flow through the spinlock e.g. spin_lock_irqsave(&mq->lock, flags); ignore = mq->recovery_needed || !mq->use_cqe || host->hsq_enabled; spin_unlock_irqrestore(&mq->lock, flags); return ignore ? BLK_EH_RESET_TIMER : mmc_cqe_timed_out(req); And add a fixes tag. > > return ret; > } >