Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp570811ybz; Wed, 22 Apr 2020 03:58:10 -0700 (PDT) X-Google-Smtp-Source: APiQypIA1MRivwUgMgicxRAeykuRrW7vEl8D6xdDJ29tGK7QbBFbjuE08RubwOTb78yFNhY4BlW/ X-Received: by 2002:a17:906:560b:: with SMTP id f11mr23779371ejq.264.1587553089946; Wed, 22 Apr 2020 03:58:09 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1587553089; cv=none; d=google.com; s=arc-20160816; b=CHOli5r2rsALKHEui2x6F4AHQ8GoUY+UxSgH59h8lSZDhEFhCZ/9xjpZgNbFiadPyC raGHRe4GwH3taCMzFgytLcomyMft6205UDrTYAw7IipZyySqWMb5IMrFA2PsT+HsCixy k6RWJGzMIvUs5zE5cX0U9CTVXw8I57zu/jGWH1gKRnUgh8tOyxK119zWz03RJDTo22do +pWH/xc1OMRELPVKrXSoRjWEhxUlzDzbPvopnqgs06agBFRoyV6cOr0FjeS67fDGQx1n ipGpy9CdiDpCG+j72GWavfgiDJXjAUHFGhLoGPL010+ZXu6WAWyG1jpBjNH+yaTmTdHB chdw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :user-agent:references:in-reply-to:message-id:date:subject:cc:to :from:dkim-signature; bh=1J14R04DNj2IrtNbKGKfTjwkLzvYtw5MBolpIGInatU=; b=eZ0v2R9+YKN53AKztk1w9Aj7LXhvzPi5fRhQ4QgaBTrDDgffWZbgguuP5moHaGMacb BN7G6QhpmegFyKM+09ZVDvjUe7E83i8McCqbH0C/KSLV1zupD1S+VEa4DSwBjo2dNOgq a8ikctZuGtzVOYWMKshE6rT6cvW19hT6iXns3cC3VQvpKZ5PyvxoW0K2Sv7avp5MtfQh xQMhE6xfNiICUV7lHyiwk25Ejw7STn0Pf9bPdZ+2EB+U4+Sd+sU3vSSIUGHIfkBGFMBb v6sDS7un5IxgqXD0/5MWVLruy/J39OjVSJFC0OyS1bRRmOp7/Fkb/Jo21RWojOPbH3si 8nhA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=0i2jxsvq; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id x61si3270886ede.23.2020.04.22.03.57.47; Wed, 22 Apr 2020 03:58:09 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=0i2jxsvq; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728780AbgDVKI4 (ORCPT + 99 others); Wed, 22 Apr 2020 06:08:56 -0400 Received: from mail.kernel.org ([198.145.29.99]:34834 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728766AbgDVKIv (ORCPT ); Wed, 22 Apr 2020 06:08:51 -0400 Received: from localhost (83-86-89-107.cable.dynamic.v4.ziggo.nl [83.86.89.107]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 987702075A; Wed, 22 Apr 2020 10:08:50 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1587550131; bh=apxGS9wORaO6rpyZeP55Ya2+HXN69AzSilbDx3ckv/k=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=0i2jxsvq1KrYHSb3DfzWPZjM6fgv2JQv4Kk8S5kQLEzMnrrEns2JYkr3MbM+WHatH 8XEWJguvusmFvIvI0lemRki2fkh3vaO6wMw6m7PB5hJtBpK1gLQDy8OjFdw0Wfy6+F UKm8gLRtM5J6idHaCnXnjjm+rPkJsZg1nD0ZZypQ= From: Greg Kroah-Hartman To: linux-kernel@vger.kernel.org Cc: Greg Kroah-Hartman , stable@vger.kernel.org, Sahitya Tummala , Pradeep P V K , Jens Axboe , Sasha Levin Subject: [PATCH 4.14 022/199] block: Fix use-after-free issue accessing struct io_cq Date: Wed, 22 Apr 2020 11:55:48 +0200 Message-Id: <20200422095100.389321221@linuxfoundation.org> X-Mailer: git-send-email 2.26.2 In-Reply-To: <20200422095057.806111593@linuxfoundation.org> References: <20200422095057.806111593@linuxfoundation.org> User-Agent: quilt/0.66 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Sahitya Tummala [ Upstream commit 30a2da7b7e225ef6c87a660419ea04d3cef3f6a7 ] There is a potential race between ioc_release_fn() and ioc_clear_queue() as shown below, due to which below kernel crash is observed. It also can result into use-after-free issue. context#1: context#2: ioc_release_fn() __ioc_clear_queue() gets the same icq ->spin_lock(&ioc->lock); ->spin_lock(&ioc->lock); ->ioc_destroy_icq(icq); ->list_del_init(&icq->q_node); ->call_rcu(&icq->__rcu_head, icq_free_icq_rcu); ->spin_unlock(&ioc->lock); ->ioc_destroy_icq(icq); ->hlist_del_init(&icq->ioc_node); This results into below crash as this memory is now used by icq->__rcu_head in context#1. There is a chance that icq could be free'd as well. 22150.386550: <6> Unable to handle kernel write to read-only memory at virtual address ffffffaa8d31ca50 ... Call trace: 22150.607350: <2> ioc_destroy_icq+0x44/0x110 22150.611202: <2> ioc_clear_queue+0xac/0x148 22150.615056: <2> blk_cleanup_queue+0x11c/0x1a0 22150.619174: <2> __scsi_remove_device+0xdc/0x128 22150.623465: <2> scsi_forget_host+0x2c/0x78 22150.627315: <2> scsi_remove_host+0x7c/0x2a0 22150.631257: <2> usb_stor_disconnect+0x74/0xc8 22150.635371: <2> usb_unbind_interface+0xc8/0x278 22150.639665: <2> device_release_driver_internal+0x198/0x250 22150.644897: <2> device_release_driver+0x24/0x30 22150.649176: <2> bus_remove_device+0xec/0x140 22150.653204: <2> device_del+0x270/0x460 22150.656712: <2> usb_disable_device+0x120/0x390 22150.660918: <2> usb_disconnect+0xf4/0x2e0 22150.664684: <2> hub_event+0xd70/0x17e8 22150.668197: <2> process_one_work+0x210/0x480 22150.672222: <2> worker_thread+0x32c/0x4c8 Fix this by adding a new ICQ_DESTROYED flag in ioc_destroy_icq() to indicate this icq is once marked as destroyed. Also, ensure __ioc_clear_queue() is accessing icq within rcu_read_lock/unlock so that icq doesn't get free'd up while it is still using it. Signed-off-by: Sahitya Tummala Co-developed-by: Pradeep P V K Signed-off-by: Pradeep P V K Signed-off-by: Jens Axboe Signed-off-by: Sasha Levin --- block/blk-ioc.c | 7 +++++++ include/linux/iocontext.h | 1 + 2 files changed, 8 insertions(+) diff --git a/block/blk-ioc.c b/block/blk-ioc.c index f23311e4b201f..e56a480b6f929 100644 --- a/block/blk-ioc.c +++ b/block/blk-ioc.c @@ -87,6 +87,7 @@ static void ioc_destroy_icq(struct io_cq *icq) * making it impossible to determine icq_cache. Record it in @icq. */ icq->__rcu_icq_cache = et->icq_cache; + icq->flags |= ICQ_DESTROYED; call_rcu(&icq->__rcu_head, icq_free_icq_rcu); } @@ -230,15 +231,21 @@ static void __ioc_clear_queue(struct list_head *icq_list) { unsigned long flags; + rcu_read_lock(); while (!list_empty(icq_list)) { struct io_cq *icq = list_entry(icq_list->next, struct io_cq, q_node); struct io_context *ioc = icq->ioc; spin_lock_irqsave(&ioc->lock, flags); + if (icq->flags & ICQ_DESTROYED) { + spin_unlock_irqrestore(&ioc->lock, flags); + continue; + } ioc_destroy_icq(icq); spin_unlock_irqrestore(&ioc->lock, flags); } + rcu_read_unlock(); } /** diff --git a/include/linux/iocontext.h b/include/linux/iocontext.h index dba15ca8e60bc..1dcd9198beb7f 100644 --- a/include/linux/iocontext.h +++ b/include/linux/iocontext.h @@ -8,6 +8,7 @@ enum { ICQ_EXITED = 1 << 2, + ICQ_DESTROYED = 1 << 3, }; /* -- 2.20.1