Received: by 2002:a05:6358:f14:b0:e5:3b68:ec04 with SMTP id b20csp3160583rwj; Mon, 19 Dec 2022 14:05:41 -0800 (PST) X-Google-Smtp-Source: AA0mqf6gnmTpJ6zz4POgmPUXSwn5bpxIeY4w91uyRUmRw/aWT6/RmpOu58/j4j89nWdYPurJ1OxO X-Received: by 2002:a05:6a20:8e1a:b0:ad:c97f:1c1b with SMTP id y26-20020a056a208e1a00b000adc97f1c1bmr40021446pzj.0.1671487540985; Mon, 19 Dec 2022 14:05:40 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1671487540; cv=none; d=google.com; s=arc-20160816; b=NBzPA7+3F1I9yLwPC1HlqV9TVZGoRB7+7sbA0TZmCReb4hmK2tYtBO0gMxI1hSmmaz 5UM0qG1ga8zhvVSfzIplMm6ybT8dlm9fUq86i/k+N/DrL0mR9Thh7VBGQMwLuE9uHGDK MZTrz9qQhAvAXWYIOmdwbCXPaA0MwUcFpdsast+q/51dtLwOO5y3BLhaUAdGLe4W2yQG 9M84N6ejCKKCyvTY7rWjjCxkJ0r0QhxZukDDpwVSBVHW81k2hm6dBqKeLMqaQWSjPWzj jHdQNOiX9oSGA05W0K18d8RorrE0s+EqBJ9q5D+bWcsTbx4bzEeSRHp8/w0au0vXnou5 eCzA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:sender:dkim-signature; bh=BomEC32AM6ovoRGRoa2VDMC3YGhwNtq2L7oOB+Yvsps=; b=Tuuk7MkbILnE7OVWbQd5F5xUSScVRVmm7kUGJLbkaROnsB1YSY9UCAIygQZ4LzNqut G38rEAEaXsZJxclfoHHasuVq5Eplg6an5tuianJqcQvhntZh4eeWLJ2xo5snXpmGLCmC KGVXtRYGzo4H97R1oBJX54Z2bacQojKUi74H2wQug4cB79KHffpwHARqWjvRQquGEW+z 25ASr6O+FaweysPVABPjdOAzTf2Q/zpahRwhEd9NX2DZXuWCs/av15FeXvkLaSmyaJzS 8VYdWKojQ4x7sKA3mjadrPG5BY2TRO7nYVMyhts+pNDzwfcVRqVs/0UNxn+nyCfhPK7T G68w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=hCitRNCA; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id 62-20020a630941000000b00476ca041d89si11783266pgj.790.2022.12.19.14.05.31; Mon, 19 Dec 2022 14:05:40 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=hCitRNCA; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232758AbiLSVcC (ORCPT + 70 others); Mon, 19 Dec 2022 16:32:02 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52196 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232190AbiLSVbp (ORCPT ); Mon, 19 Dec 2022 16:31:45 -0500 Received: from mail-pj1-x102c.google.com (mail-pj1-x102c.google.com [IPv6:2607:f8b0:4864:20::102c]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 1211CDFB5; Mon, 19 Dec 2022 13:31:44 -0800 (PST) Received: by mail-pj1-x102c.google.com with SMTP id gt4so10438705pjb.1; Mon, 19 Dec 2022 13:31:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=BomEC32AM6ovoRGRoa2VDMC3YGhwNtq2L7oOB+Yvsps=; b=hCitRNCAgCMGc3lcKkdvYuqgyJSbzuhh31Zq8cJgEQT9EaoWFJ4aaOrosn+xToc3qi i1v64YtOXP8bUBG2wBWvL3mACkuvAEqwNgDKAG6u4/MgUwZ5ofzcTqTlTzO/cafayrhX uuoevjjPURg+Ytr/7jBe4iZ071G7h9or/VaEgqEhoC9cxHoQALhUfGrA6q/OK33NDmwW Nhvldk7qZX1BtpNwDwRXjvJsUUwiVSDEmZYFfa4e4fD9V7uRTWxS0fX7QN63JVA/ov7x wSFKzrHlRIyTMaFo/oCDtArYOtAWDuYathCiaB4iq0hsIW9+zQ8SamE8trjHALAgXHL6 aTNw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=BomEC32AM6ovoRGRoa2VDMC3YGhwNtq2L7oOB+Yvsps=; b=mfGwH3Pw9WvwKJ8c2ZuN2G4YCwOoPf1927N4UVmzm8PRy29659QJHQ/n6Np2cbIv7G gcMZ74T1M5HcyqpmtkXbyhbDf1IgeU0kkfyz/bado+t3q0YTcgcUk/l4VKy2rPjHDbxq +u8kRwE22et/ZpuhCbhirigWE92kBQAaTduf9OoPYFGkyyLeH3/jwD1M63+vC5CyLbfJ /aI65NNmc0PX8hj0Az7AifYshPdAeytBhoVO8APuJYh/tJhM/xrVjqu8vHR/wN+sgIVx mrl1wP9U0t2wA3gxyOHFF/rvTgbhybouPF/Rhpa/vFlvhgnGshcGFU5LvQlanRRzSwa1 XMzQ== X-Gm-Message-State: ANoB5pmN9wJWHsAmYPtrKO5utW/EjmrpGw7lnVjpOHgVQbC8/2ZwFnvg qI3a4J/AL7LgS1FBqB3cGFQ= X-Received: by 2002:a17:902:bb8a:b0:189:abdd:400a with SMTP id m10-20020a170902bb8a00b00189abdd400amr48029480pls.15.1671485503409; Mon, 19 Dec 2022 13:31:43 -0800 (PST) Received: from localhost (2603-800c-1a02-1bae-a7fa-157f-969a-4cde.res6.spectrum.com. [2603:800c:1a02:1bae:a7fa:157f:969a:4cde]) by smtp.gmail.com with ESMTPSA id y3-20020a655a03000000b00478b2d5d148sm6806566pgs.5.2022.12.19.13.31.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 19 Dec 2022 13:31:43 -0800 (PST) Sender: Tejun Heo Date: Mon, 19 Dec 2022 11:31:41 -1000 From: Tejun Heo To: Yu Kuai Cc: hch@infradead.org, josef@toxicpanda.com, axboe@kernel.dk, cgroups@vger.kernel.org, linux-block@vger.kernel.org, linux-kernel@vger.kernel.org, yukuai3@huawei.com, yi.zhang@huawei.com Subject: Re: [PATCH -next 3/4] blk-iocost: dispatch all throttled bio in ioc_pd_offline Message-ID: References: <20221217030527.1250083-1-yukuai1@huaweicloud.com> <20221217030527.1250083-4-yukuai1@huaweicloud.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20221217030527.1250083-4-yukuai1@huaweicloud.com> X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Sat, Dec 17, 2022 at 11:05:26AM +0800, Yu Kuai wrote: > From: Yu Kuai > > Currently, if cgroup is removed while some bio is still throttled, such > bio will still wait for timer to dispatch. On the one hand, it > doesn't make sense to throttle bio while cgroup is removed, on the other > hand, this behaviour makes it hard to guarantee the exit order for > iocg(in ioc_pd_free() currently). Yeah, idk about this. So, now if you're in a cgroup with IO restriction, you can create a sub-cgroup shove all the IOs in there and then kill the cgroup and escape control and do so repeatedly. The refcnting is rather complicated in blkcg world because it gets pulled from several different directions but the problem you're trying to address likely should be addressed through refcnting. Thanks. -- tejun