Received: by 10.223.185.116 with SMTP id b49csp1110576wrg; Sat, 3 Mar 2018 15:53:13 -0800 (PST) X-Google-Smtp-Source: AG47ELs1y+pSbjRkzmgDTao3ZeBdz+2gtPbGgnGhOYUPGy0grsTba7KOL3UjwqWptE9dCPfm1Tnd X-Received: by 10.101.93.82 with SMTP id e18mr8280381pgt.371.1520121193403; Sat, 03 Mar 2018 15:53:13 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1520121193; cv=none; d=google.com; s=arc-20160816; b=nMYBinwViYb0eYzDs543fda8Ojypq1e8+sVx+MJKEj4fbwbBoPG/QwGtOLGW0Xz34n 8T9bPrKs5oI3GkB6Uo1Yiefadg1ckg4Nn8QfUXT9YNssJSUOWmVHKlVcxjkFXLB4r2Ny wda36ZVEEdXefKyvzTVRiWszxESlz99xT0X372XVRORFCjJlaiJnxc2ywid4PFaVRP1G SVCc0PIshYomNRqRJADEWAXyJ3qiwknDNaUyuJTBfrxzO+UK18C0Jj7kDCNwAxYF/AXW augCfIvYajVXSL04OrEMcB528XZb97ezIIyB2SQWyrwtOduTZrwQ4M0UIDpYVlSZpoHk Yw6Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :spamdiagnosticmetadata:spamdiagnosticoutput:content-language :accept-language:in-reply-to:references:message-id:date:thread-index :thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=vZDg+DSnJPT3KrxiuPBECF8KTA66xzkcpo47cnITSyw=; b=RVm/iQtvjzeMEN6yVdPmEmVZXd4JNAtMuL+JVCCsevfx8w9IxMds1cTPZKIDibYrky 89ls7G9cjLuLPw10+AFdxEmKry2LIyLMI6rDeHpV4b7ZzETCMCywwFUd+P7NfdClM+lP XUbXRquyJUGboz8HK+BIg+n5E54JCCu11XxS9xGHTglECF8RtFMqcjizNVabrEdSPEff rkSP7YZD4VItZauh+l6BDtbb0BaHVrpvefcpXJfFwvLtBcgvCr/+QeFf9/BD/vywCc0q UZne78j3iTKqAUl/V6/3G3F2KyivdOefhAFmvGaTwD0jmX1oswkiFagKNT/YCMx62wqH zVUg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@microsoft.com header.s=selector1 header.b=OsbOteg6; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=microsoft.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id d88si7452292pfe.215.2018.03.03.15.52.59; Sat, 03 Mar 2018 15:53:13 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@microsoft.com header.s=selector1 header.b=OsbOteg6; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=microsoft.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S934138AbeCCXvT (ORCPT + 99 others); Sat, 3 Mar 2018 18:51:19 -0500 Received: from mail-by2nam01on0133.outbound.protection.outlook.com ([104.47.34.133]:49841 "EHLO NAM01-BY2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S933980AbeCCWdK (ORCPT ); Sat, 3 Mar 2018 17:33:10 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=vZDg+DSnJPT3KrxiuPBECF8KTA66xzkcpo47cnITSyw=; b=OsbOteg60Xmb+oConUKy3e/Xgjb7Iot4VfrqwWFEbMbJZXpQxHDM/g66kIBjRZ9REESZzfIEcloMBq8EnTrFBjTzQLirt9B7XNfCSpC+VxTpvpV+Z1tG5POA1Ae8F/Ci/12asaMOxxaVf1DWiy0D4j5YMc0CCplcJOaccMEh3wY= Received: from MW2PR2101MB1034.namprd21.prod.outlook.com (52.132.149.10) by MW2PR2101MB1097.namprd21.prod.outlook.com (52.132.149.26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.567.2; Sat, 3 Mar 2018 22:33:08 +0000 Received: from MW2PR2101MB1034.namprd21.prod.outlook.com ([fe80::1d56:338f:e2b:cec0]) by MW2PR2101MB1034.namprd21.prod.outlook.com ([fe80::1d56:338f:e2b:cec0%3]) with mapi id 15.20.0567.006; Sat, 3 Mar 2018 22:33:08 +0000 From: Sasha Levin To: "linux-kernel@vger.kernel.org" , "stable@vger.kernel.org" CC: Shaohua Li , Jens Axboe , Sasha Levin Subject: [PATCH AUTOSEL for 4.9 081/219] blk-throttle: make sure expire time isn't too big Thread-Topic: [PATCH AUTOSEL for 4.9 081/219] blk-throttle: make sure expire time isn't too big Thread-Index: AQHTsz78U8tMbQs0vEKotOQze1kDBQ== Date: Sat, 3 Mar 2018 22:28:42 +0000 Message-ID: <20180303222716.26640-81-alexander.levin@microsoft.com> References: <20180303222716.26640-1-alexander.levin@microsoft.com> In-Reply-To: <20180303222716.26640-1-alexander.levin@microsoft.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [52.168.54.252] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;MW2PR2101MB1097;7:pG14eeuoBninh2YAzAEp1QlmUY9OVw6CB/vk5Pidbx56QaUuGNo8qSHggpAO8MVtTG0PiEGQBiHP6txst9cGVjZgdoDszERARZHx4vrGFQZ5vKxnivRE5t6pRUbZ5cy1E1egQls4mYljgSAnq5gB2Vh9BmDb0OGeiHlR+LOBZbYRc4fFVajShYR+ZXuGfDPYXFsTfXXiPLvsDZoSLWx6A7OKoPpnp3ToroXP0qdag6R3FD0azakDowsI7KBuvR9H x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: eb171aaf-1c04-4f40-55b3-08d58156bd29 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(48565401081)(5600026)(4604075)(3008032)(2017052603307)(7193020);SRVR:MW2PR2101MB1097; x-ms-traffictypediagnostic: MW2PR2101MB1097: authentication-results: spf=none (sender IP is ) smtp.mailfrom=Alexander.Levin@microsoft.com; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(89211679590171)(67672495146484); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(8211001083)(61425038)(6040501)(2401047)(5005006)(8121501046)(10201501046)(3002001)(3231220)(944501244)(52105095)(93006095)(93001095)(6055026)(61426038)(61427038)(6041288)(20161123560045)(20161123558120)(20161123562045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123564045)(6072148)(201708071742011);SRVR:MW2PR2101MB1097;BCL:0;PCL:0;RULEID:;SRVR:MW2PR2101MB1097; x-forefront-prvs: 0600F93FE1 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(376002)(366004)(39380400002)(396003)(39860400002)(346002)(189003)(199004)(305945005)(105586002)(36756003)(3660700001)(86362001)(6666003)(66066001)(2900100001)(5660300001)(8676002)(10090500001)(81166006)(81156014)(8936002)(22452003)(10290500003)(2950100002)(4326008)(25786009)(5250100002)(2501003)(68736007)(7736002)(72206003)(14454004)(478600001)(186003)(110136005)(26005)(316002)(2906002)(97736004)(6512007)(99286004)(107886003)(54906003)(1076002)(6506007)(106356001)(53936002)(59450400001)(6116002)(3846002)(102836004)(6486002)(86612001)(3280700002)(6436002)(76176011)(22906009)(217873001);DIR:OUT;SFP:1102;SCL:1;SRVR:MW2PR2101MB1097;H:MW2PR2101MB1034.namprd21.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; received-spf: None (protection.outlook.com: microsoft.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: YdlM/snUv1M8ML5pUDcWKkJaTR3iekIiXME/wG0KsXGpv1XDOkgcWou1Pz000l+pfDyg5kSXjJmRRL3HBwhbQNCZGWYr2XMa209DBAedyHV0v8tPAHoPJX+RvfIrf+szjz2/dEgl3ArC8vFyxvTyLCk4meobbhNkghdfTIgHGTA= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-Network-Message-Id: eb171aaf-1c04-4f40-55b3-08d58156bd29 X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Mar 2018 22:28:43.0100 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW2PR2101MB1097 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Shaohua Li [ Upstream commit 06cceedcca67a93ac7f7aa93bbd9980c7496d14e ] cgroup could be throttled to a limit but when all cgroups cross high limit, queue enters a higher state and so the group should be throttled to a higher limit. It's possible the cgroup is sleeping because of throttle and other cgroups don't dispatch IO any more. In this case, nobody can trigger current downgrade/upgrade logic. To fix this issue, we could either set up a timer to wakeup the cgroup if other cgroups are idle or make sure this cgroup doesn't sleep too long. Setting up a timer means we must change the timer very frequently. This patch chooses the latter. Making cgroup sleep time not too big wouldn't change cgroup bps/iops, but could make it wakeup more frequently, which isn't a big issue because throtl_slice * 8 is already quite big. Signed-off-by: Shaohua Li Signed-off-by: Jens Axboe Signed-off-by: Sasha Levin --- block/blk-throttle.c | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/block/blk-throttle.c b/block/blk-throttle.c index a3ea8260c94c..3a4c9a3c1427 100644 --- a/block/blk-throttle.c +++ b/block/blk-throttle.c @@ -499,6 +499,17 @@ static void throtl_dequeue_tg(struct throtl_grp *tg) static void throtl_schedule_pending_timer(struct throtl_service_queue *sq, unsigned long expires) { + unsigned long max_expire =3D jiffies + 8 * throtl_slice; + + /* + * Since we are adjusting the throttle limit dynamically, the sleep + * time calculated according to previous limit might be invalid. It's + * possible the cgroup sleep time is very long and no other cgroups + * have IO running so notify the limit changes. Make sure the cgroup + * doesn't sleep too long to avoid the missed notification. + */ + if (time_after(expires, max_expire)) + expires =3D max_expire; mod_timer(&sq->pending_timer, expires); throtl_log(sq, "schedule timer. delay=3D%lu jiffies=3D%lu", expires - jiffies, jiffies); --=20 2.14.1