Received: by 10.192.165.148 with SMTP id m20csp4960848imm; Tue, 8 May 2018 18:36:41 -0700 (PDT) X-Google-Smtp-Source: AB8JxZokqH+3MN+W+gwHYww5JtYxgYr5OgwW1RpQnTqeWEd7MeR7e6Q46M4QqvPnUzj1mVndzR0z X-Received: by 2002:a17:902:3181:: with SMTP id x1-v6mr44084863plb.198.1525829800994; Tue, 08 May 2018 18:36:40 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1525829800; cv=none; d=google.com; s=arc-20160816; b=GfRYsoFgpmDp21b3xbs5OpHpwlXkONT5YdmrQ1R1bxdNGG7I6AFydReHsTkxdys1lj XdegBH8RISeKyiBUr3k+MikcMooBhsAqwKVfUFyqc4QfeB5tF31Jkt81k6LNrp8QjCZw q+LyC5X6fGrtBbGiuPn49/OIjqZnqa6/gN6JlxT7tANI6XmCIlQls+gYfgCJgJaybwaa mM0IPE8GKTFbfeGFAhdZIpsq6pNtYXx7qysriufDO0BwjUqU4yginCBY54CFZQBMbpTr /ge2BjWxsLDuJkGusSeTCMJ7MCVCqIkKEt1a2jF09+hwCkAUUnJE1cgoHzdoZ/x+jkJH 4QUg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dkim-signature:arc-authentication-results; bh=sOaXvFMRxJ8wbH6KTtdYddcySDG7QIVvtK9vhH4NLIM=; b=jvEZpRTTtK+FP3Gykgx8gjvBG325G5h9TDUTuQ4Hf5QPpsz6/fuPxByBrTXrJuMXFF kdNbRTuTS4qkBLw+LTAcEKuKtsDAT6sg3+grGuCQm4xxI7ghbfY/cTnftTx38Rr755BN 3Dyx6CzQMx+LAlegqlCigiCfduLUA8ym4UFATrTqE2yhONX5vr3DecxpduAYKgfeD9Tr zOLMnNdaYgJHaUo94Lzgkn04m6GDurmgmI5Cb0fqY/mSvtwRoq4oo8DiSlpd9gwgMGyg S5qRsZnduj4baxmxUlbjzPsZaE1imlUQ8gXmf+pvkT0zB285Fx+A4g1rGiFuIo82PDEg AtUw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=S5zUSESW; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id p33-v6si25137280pld.318.2018.05.08.18.36.26; Tue, 08 May 2018 18:36:40 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=S5zUSESW; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S933550AbeEIBe3 (ORCPT + 99 others); Tue, 8 May 2018 21:34:29 -0400 Received: from mail-qt0-f195.google.com ([209.85.216.195]:47091 "EHLO mail-qt0-f195.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S933506AbeEIBe0 (ORCPT ); Tue, 8 May 2018 21:34:26 -0400 Received: by mail-qt0-f195.google.com with SMTP id m16-v6so43642040qtg.13; Tue, 08 May 2018 18:34:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=sOaXvFMRxJ8wbH6KTtdYddcySDG7QIVvtK9vhH4NLIM=; b=S5zUSESWies5B5AjU/JkfhzchVk9eqBzCP1b9ix/YJJqZB+TjDp8nZvOe+hjaNO1yz o21U1Z5YvtYyhIDQgh7uUrRSrzkFQttUY7igc/vkpoPuFpLWwjKY3PnI00hERhviH9gg Df7C2lJV8AsRGSirm0Samy5a+9QkgReC2KgU7XS94Fkz9oR7XSqZM5mo/6r5mcDT4UWV W5hBumloMNHF6Bmcizsn9OdQINofzqZ9rgZkBuvxa5ke0hYozAvHwA3RfwB5aeXYns4H 3qPias+rRT2/FLYOmDmLn/oTIPjNdLZOXZVaINDhVLd9g82Kyo746dJesXtqQcgRcJSc myQg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=sOaXvFMRxJ8wbH6KTtdYddcySDG7QIVvtK9vhH4NLIM=; b=sfJWPNMe5j8pXTeo/h3OuVu4brbIDNbIKTr7ODRVZP60iRqZFuhvHGw/HIeMp2ZNDK 7V1LmpjBcGNt5BcHySzO23OUbceEiTPlzwOIiALrkrffTzMnUBeF8Pe29D+K5D3ePCSr ADhpSCMxkWlHhs0E7IJbVMES50l6MlXJYSnDAbmH4V0FocmVtaVftj0JMjh3nsUqWzzc iqxo4lHfqFMRVnGybPZM1YjVAQ+T7uxDjHYygBoGeGrEG34sksgCZXTdwZBWBN51Be0E 9ouWHb277XNhtu6VrRhwcA39dxhFbZ4qJ/YYk7fqnFpgcQFFRIqL8XIHX8jAtnY3vShB /KwQ== X-Gm-Message-State: ALKqPwfteOC8pG6NkxsXneZADLBAe7JmvagDcJl+gydsElBhajjB+Mf0 xUTAJ3sZzpVdNZqYsAyVjlc+fMAXeA== X-Received: by 2002:ac8:2614:: with SMTP id u20-v6mr640785qtu.192.1525829664791; Tue, 08 May 2018 18:34:24 -0700 (PDT) Received: from localhost.localdomain (c-71-234-172-214.hsd1.vt.comcast.net. [71.234.172.214]) by smtp.gmail.com with ESMTPSA id x28-v6sm23719003qtx.95.2018.05.08.18.34.22 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 08 May 2018 18:34:23 -0700 (PDT) From: Kent Overstreet To: linux-kernel@vger.kernel.org, linux-block@vger.kernel.org, linux-mm@kvack.org, Jens Axboe , Ingo Molnar Cc: Kent Overstreet Subject: [PATCH 06/10] block: Split out bio_list_copy_data() Date: Tue, 8 May 2018 21:33:54 -0400 Message-Id: <20180509013358.16399-7-kent.overstreet@gmail.com> X-Mailer: git-send-email 2.17.0 In-Reply-To: <20180509013358.16399-1-kent.overstreet@gmail.com> References: <20180509013358.16399-1-kent.overstreet@gmail.com> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Found a bug (with ASAN) where we were passing a bio to bio_copy_data() with bi_next not NULL, when it should have been - a driver had left bi_next set to something after calling bio_endio(). Since the normal case is only copying single bios, split out bio_list_copy_data() to avoid more bugs like this in the future. Signed-off-by: Kent Overstreet --- block/bio.c | 83 +++++++++++++++++++++++++---------------- drivers/block/pktcdvd.c | 2 +- include/linux/bio.h | 5 ++- 3 files changed, 55 insertions(+), 35 deletions(-) diff --git a/block/bio.c b/block/bio.c index d7bd765e9e..c58544d4bc 100644 --- a/block/bio.c +++ b/block/bio.c @@ -971,32 +971,16 @@ void bio_advance(struct bio *bio, unsigned bytes) } EXPORT_SYMBOL(bio_advance); -void bio_copy_data_iter(struct bio *dst, struct bvec_iter dst_iter, - struct bio *src, struct bvec_iter src_iter) +void bio_copy_data_iter(struct bio *dst, struct bvec_iter *dst_iter, + struct bio *src, struct bvec_iter *src_iter) { struct bio_vec src_bv, dst_bv; void *src_p, *dst_p; unsigned bytes; - while (1) { - if (!src_iter.bi_size) { - src = src->bi_next; - if (!src) - break; - - src_iter = src->bi_iter; - } - - if (!dst_iter.bi_size) { - dst = dst->bi_next; - if (!dst) - break; - - dst_iter = dst->bi_iter; - } - - src_bv = bio_iter_iovec(src, src_iter); - dst_bv = bio_iter_iovec(dst, dst_iter); + while (src_iter->bi_size && dst_iter->bi_size) { + src_bv = bio_iter_iovec(src, *src_iter); + dst_bv = bio_iter_iovec(dst, *dst_iter); bytes = min(src_bv.bv_len, dst_bv.bv_len); @@ -1010,31 +994,66 @@ void bio_copy_data_iter(struct bio *dst, struct bvec_iter dst_iter, kunmap_atomic(dst_p); kunmap_atomic(src_p); - bio_advance_iter(src, &src_iter, bytes); - bio_advance_iter(dst, &dst_iter, bytes); + bio_advance_iter(src, src_iter, bytes); + bio_advance_iter(dst, dst_iter, bytes); } } EXPORT_SYMBOL(bio_copy_data_iter); /** - * bio_copy_data - copy contents of data buffers from one chain of bios to - * another - * @src: source bio list - * @dst: destination bio list - * - * If @src and @dst are single bios, bi_next must be NULL - otherwise, treats - * @src and @dst as linked lists of bios. + * bio_copy_data - copy contents of data buffers from one bio to another + * @src: source bio + * @dst: destination bio * * Stops when it reaches the end of either @src or @dst - that is, copies * min(src->bi_size, dst->bi_size) bytes (or the equivalent for lists of bios). */ void bio_copy_data(struct bio *dst, struct bio *src) { - bio_copy_data_iter(dst, dst->bi_iter, - src, src->bi_iter); + struct bvec_iter src_iter = src->bi_iter; + struct bvec_iter dst_iter = dst->bi_iter; + + bio_copy_data_iter(dst, &dst_iter, src, &src_iter); } EXPORT_SYMBOL(bio_copy_data); +/** + * bio_list_copy_data - copy contents of data buffers from one chain of bios to + * another + * @src: source bio list + * @dst: destination bio list + * + * Stops when it reaches the end of either the @src list or @dst list - that is, + * copies min(src->bi_size, dst->bi_size) bytes (or the equivalent for lists of + * bios). + */ +void bio_list_copy_data(struct bio *dst, struct bio *src) +{ + struct bvec_iter src_iter = src->bi_iter; + struct bvec_iter dst_iter = dst->bi_iter; + + while (1) { + if (!src_iter.bi_size) { + src = src->bi_next; + if (!src) + break; + + src_iter = src->bi_iter; + } + + if (!dst_iter.bi_size) { + dst = dst->bi_next; + if (!dst) + break; + + dst_iter = dst->bi_iter; + } + + bio_copy_data_iter(dst, &dst_iter, src, &src_iter); + } +} +EXPORT_SYMBOL(bio_list_copy_data); + struct bio_map_data { int is_our_pages; struct iov_iter iter; diff --git a/drivers/block/pktcdvd.c b/drivers/block/pktcdvd.c index c61d20c9f3..00ea788b17 100644 --- a/drivers/block/pktcdvd.c +++ b/drivers/block/pktcdvd.c @@ -1285,7 +1285,7 @@ static void pkt_start_write(struct pktcdvd_device *pd, struct packet_data *pkt) * Fill-in bvec with data from orig_bios. */ spin_lock(&pkt->lock); - bio_copy_data(pkt->w_bio, pkt->orig_bios.head); + bio_list_copy_data(pkt->w_bio, pkt->orig_bios.head); pkt_set_state(pkt, PACKET_WRITE_WAIT_STATE); spin_unlock(&pkt->lock); diff --git a/include/linux/bio.h b/include/linux/bio.h index 5a6ee955a8..98b175cc00 100644 --- a/include/linux/bio.h +++ b/include/linux/bio.h @@ -505,9 +505,10 @@ static inline void bio_flush_dcache_pages(struct bio *bi) } #endif -extern void bio_copy_data_iter(struct bio *dst, struct bvec_iter dst_iter, - struct bio *src, struct bvec_iter src_iter); +extern void bio_copy_data_iter(struct bio *dst, struct bvec_iter *dst_iter, + struct bio *src, struct bvec_iter *src_iter); extern void bio_copy_data(struct bio *dst, struct bio *src); +extern void bio_list_copy_data(struct bio *dst, struct bio *src); extern void bio_free_pages(struct bio *bio); extern struct bio *bio_copy_user_iov(struct request_queue *, -- 2.17.0