Received: by 2002:ac0:a5a6:0:0:0:0:0 with SMTP id m35-v6csp260692imm; Fri, 21 Sep 2018 13:57:33 -0700 (PDT) X-Google-Smtp-Source: ANB0VdainVytTFVHncwcJ20LLym9Xxgn+UZn6TJ5osJ0KGpdTEKW32xkO0Iz9NUlqjBmF4DUPRA5 X-Received: by 2002:a63:904a:: with SMTP id a71-v6mr42568378pge.339.1537563453311; Fri, 21 Sep 2018 13:57:33 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1537563453; cv=none; d=google.com; s=arc-20160816; b=fvCQ06N4x4s6s9YNZDiOMDPAuYgN8+XvNcAAqsX3I/fzwpu3JzTP2ZpflRxd2DXFJJ NJq7KbKzeA3dgfvHEylMnF+RB3TOTR5LS41BtfuxloxgPZaIAYdCGMNdm0/SmHV4HoaK GIeHYtn8WwCMBWoYP94ZRjeGYKLUBzFeJz8Mmi9COklct+ttugkPEGIUBtOU6jccPEIm ELuvI900vuy8iHN8PZW0PjyNzYs1lPPJqZT3oB2oAxpYH19T3St5tPiFLPlnMZtjCg4L 7AhOtY14WVQ8CPh5WJS/jNp/JRoizEO22xNSxDTy0ohNkCW01iVTpsqIU6z5iDmP4GUp pGyw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=jLr1Wi7Jq0DmlrBbAYR4iPsSYBPIP3Xirr6J/hLGHho=; b=WbVjx4Sbkb1D8IKkc92n16HKdaY2EXLc1/XAXW1HBMc47yBW1kMKLsuhX8+F/5ZfYw Qy/5XM27fw7yQanUMNE2mmJTPBT476gOyL2ds3g9TNmWDJ9P1WqRWgmni2a+KIn4sC4Z VkQOmeYTjIXmZzeJ8BVrNTbCgpj5ZdIVcz6AALyh/OzaK+Io8/76xo6p1q/vD2Z0GDpK F7+Ulvmb45AzUhujhchqv4KYPvoyWu5dfagPgCadcAvbsMYgVvvpf9mTIrZIRMWtYjPT CiLncEeGe+coLm1fDRUl15OYBg6HWppmY9oJQ1RuAE91VU/1L3h+gLEu/68m0QSgrBmv 7g7g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=V9Pr20YM; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id s36-v6si28202637pld.8.2018.09.21.13.56.50; Fri, 21 Sep 2018 13:57:33 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=V9Pr20YM; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2391467AbeIVCrV (ORCPT + 99 others); Fri, 21 Sep 2018 22:47:21 -0400 Received: from mail-yb1-f194.google.com ([209.85.219.194]:45832 "EHLO mail-yb1-f194.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2391251AbeIVCrU (ORCPT ); Fri, 21 Sep 2018 22:47:20 -0400 Received: by mail-yb1-f194.google.com with SMTP id d9-v6so5987686ybr.12; Fri, 21 Sep 2018 13:56:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=jLr1Wi7Jq0DmlrBbAYR4iPsSYBPIP3Xirr6J/hLGHho=; b=V9Pr20YMM6I5bm86UHGSJb+uGKi+gan7BoRfvp+Ez1XmdNB68MM2wzNZbm99qupNRP RxL5vl47XefNTqIZXzNtkUu0lCJCrDUcHhZMnqCACjCgJz6yYP3E/vyntSsDXG9eq+Kp BUDL9/s8X/80vKhplbuo+WSCa4VNaZH/xS0DSGcH0NeIYEh+DbF8jFO8wf5NkiO4q7wU tK0MruYZo5nsmicSXwLA8XakSVp8dvwzqdE1KOUKeHXGVXZ7yu152dS4mJSwW+VNkbLk UkVm7W6xFrm4I+DE1loGRiktoL3C2XhXcQ0IWEL83NY/MU1uX+v1cgBbr2gbJH4Ud9bp OUBA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=jLr1Wi7Jq0DmlrBbAYR4iPsSYBPIP3Xirr6J/hLGHho=; b=fQI8iNliiigbQ7nUhlVgyBXT1rwpF19oqdIRrA1b6IN0E6XtskItpiNEhvhHDiH7Wr WG/QghxrlYzaZdnh7nopQ/inOf+BDNeKwwBC/KoiBpZgqqsH0cKoLPaosOrEF4dfnWm2 zc+NlkruATN5sNEJd0AgIzO614l00FiRorFqKoLCtXWfiQcV2yJviRanm6ukvVA0Uxc9 TM5kwd1EjwxEMfn6HGQg3MOkogXCVI9sip3F5WphxhD+kzqv0on86Iz0fcjszdIy6oPi 3XSahmPGukSY/kEbq1yghzsP40L7EvNuiPn5xLSTZ1hO5fp90SyR4/YHQb18U/WPuezv R4og== X-Gm-Message-State: APzg51DjdwFQte1RkeUC/k7xniYMA8AiZIhOuCWi3vPF0uFRDUZeOCz3 MvU/vhPUeW24t8ZG+HEUAoo= X-Received: by 2002:a25:1005:: with SMTP id 5-v6mr21401035ybq.47.1537563404048; Fri, 21 Sep 2018 13:56:44 -0700 (PDT) Received: from dennisz-mbp.dhcp.thefacebook.com ([2620:10d:c091:200::1:9b8b]) by smtp.gmail.com with ESMTPSA id b185-v6sm4820657ywf.12.2018.09.21.13.56.42 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 21 Sep 2018 13:56:42 -0700 (PDT) Date: Fri, 21 Sep 2018 16:56:40 -0400 From: Dennis Zhou To: Jens Axboe Cc: Tejun Heo , Johannes Weiner , Josef Bacik , kernel-team@fb.com, linux-block@vger.kernel.org, cgroups@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH v3 00/12] block: always associate blkg and refcount cleanup Message-ID: <20180921205640.GA50648@dennisz-mbp.dhcp.thefacebook.com> References: <20180911184137.35897-1-dennisszhou@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180911184137.35897-1-dennisszhou@gmail.com> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Jens, On Tue, Sep 11, 2018 at 02:41:25PM -0400, Dennis Zhou wrote: > Hi everyone, > > v3: a few minor fixes. > 0003: Updated the comment to bio_associate_blkg to reflect closest > association. > Removed a return branch in __bio_lookup_create. > 0009: Removed an unnecessary rcu_read_(un)lock pair. > 0010: Fixed blkg null pointer... blkg->blkcg => blkcg. > > This is rebased onto axboe#for-4.20/block 902d53914f64. > > From v2 below (updated): > ------ > This is a followup to the patch series I sent out earlier [1] containing > the middle two points: > 1. always associate a bio with a blkg > 2. remove the extra css ref held by bios and utilize the blkg ref > > The major difference with v2 is that error handling on blkg creation > and association failure is handled more gracefully. Rather than having > the complex logic to fallback to root, failures walk up the blkg tree. > This seems more natural and less prone to error with the many possible > failure scenarios. > > Additionally, there are fixes for kbuild errors and some key details > overlooked by me in the first series that were pointed out in review. > > Modified from the first patchset: > First, both blk-throttle and blk-iolatency rely on blkg association > to enable their policies. Rather than each policy (and future policies) > implement this logic independently, this consolidates it such that > all bios are tagged with a blkg. > > Second, with the addition of always having a blkg reference, the blkcg > can now be referenced through it rather than maintaining an additional > pointer and reference. So let's clean this up. > > [1] https://lore.kernel.org/lkml/20180831015356.69796-1-dennisszhou@gmail.com/T > > This patchset contains the following 12 patches: > 0001-blkcg-fix-ref-count-issue-with-bio_blkcg-using-task_.patch > 0002-blkcg-update-blkg_lookup_create-to-do-locking.patch > 0003-blkcg-convert-blkg_lookup_create-to-find-closest-blk.patch > 0004-blkcg-always-associate-a-bio-with-a-blkg.patch > 0005-blkcg-consolidate-bio_issue_init-to-be-a-part-of-cor.patch > 0006-blkcg-associate-a-blkg-for-pages-being-evicted-by-sw.patch > 0007-blkcg-associate-writeback-bios-with-a-blkg.patch > 0008-blkcg-remove-bio-bi_css-and-instead-use-bio-bi_blkg.patch > 0009-blkcg-remove-additional-reference-to-the-css.patch > 0010-blkcg-cleanup-and-make-blk_get_rl-use-blkg_lookup_cr.patch > 0011-blkcg-change-blkg-reference-counting-to-use-percpu_r.patch > 0012-blkcg-rename-blkg_try_get-to-blkg_tryget.patch > > This patchset is on top of axboe#for-4.20/block 902d53914f64. > > diffstats below: > > Dennis Zhou (Facebook) (12): > blkcg: fix ref count issue with bio_blkcg using task_css > blkcg: update blkg_lookup_create to do locking > blkcg: convert blkg_lookup_create to find closest blkg > blkcg: always associate a bio with a blkg > blkcg: consolidate bio_issue_init to be a part of core > blkcg: associate a blkg for pages being evicted by swap > blkcg: associate writeback bios with a blkg > blkcg: remove bio->bi_css and instead use bio->bi_blkg > blkcg: remove additional reference to the css > blkcg: cleanup and make blk_get_rl use blkg_lookup_create > blkcg: change blkg reference counting to use percpu_ref > blkcg: rename blkg_try_get to blkg_tryget > > Documentation/admin-guide/cgroup-v2.rst | 8 +- > block/bfq-cgroup.c | 4 +- > block/bfq-iosched.c | 2 +- > block/bio.c | 158 ++++++++++++++++-------- > block/blk-cgroup.c | 123 ++++++++++++------ > block/blk-iolatency.c | 26 +--- > block/blk-throttle.c | 13 +- > block/bounce.c | 4 +- > block/cfq-iosched.c | 4 +- > drivers/block/loop.c | 5 +- > drivers/md/raid0.c | 2 +- > fs/buffer.c | 10 +- > fs/ext4/page-io.c | 2 +- > include/linux/bio.h | 23 ++-- > include/linux/blk-cgroup.h | 145 +++++++++++++++------- > include/linux/blk_types.h | 1 - > include/linux/cgroup.h | 2 + > include/linux/writeback.h | 5 +- > kernel/cgroup/cgroup.c | 48 +++++-- > kernel/trace/blktrace.c | 4 +- > mm/page_io.c | 2 +- > 21 files changed, 381 insertions(+), 210 deletions(-) > > Thanks, > Dennis I reran some basic test again for sanity and it seems to be fine on my end. There are at least acks, and some reviewed-by's on the series. Is there anything else you think needs to be done before we let this bake in for-4.20/for-next? Thanks, Dennis