Received: by 2002:a25:c593:0:0:0:0:0 with SMTP id v141csp1361650ybe; Thu, 5 Sep 2019 14:26:40 -0700 (PDT) X-Google-Smtp-Source: APXvYqwJTxzgzGKX5bhJ0/VM2tMaNU7PoKn891PX/5Wj8W5/ONTxQkZ1HNEdHIy0xtlGY505eRyD X-Received: by 2002:a62:35c6:: with SMTP id c189mr6513649pfa.96.1567718800392; Thu, 05 Sep 2019 14:26:40 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1567718800; cv=none; d=google.com; s=arc-20160816; b=qOhoMtFXSu8i4r8330R251TES8+tYSluAi4bXTiAYgFR5oAZBDLmOPwu03b2gOkO7q M1YQIsLGv3MK5NHzGUcvgZ4v7Oi0ueD+I7lHUWYJkCCNpTj2Xkk5Ljku6sxjPCzU+h/w mR0aso5kaog4tz0TcrdDPTW82/ue9MCghQmtyqJvGiklqEn6b7WBDudea313RILNAJfq le4+068ffsfuhuaqRvjdMWJ7lQ4tQUuP3C54vj7f4JPJ+gXjUeMidF3x9wurSubAzJ++ PyJBKjCqhHJYpFsVCk8lxpp9RYdop42s3+DyryZS96iSJCL8L24ddI0WEdSKZWYKlwlM N2Aw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=U86ZblmgaF4eBV4iyqRJf/CbV9WbHkWYMeJ0zFkqIu0=; b=k8APFAtjuNoA9N5iqIh0+qUkBOBTFpHoyIqYDomxQKJzIbGaTUXwzt8ube21xXi15H oiKRgG8AvfxItRSa7NSEZDetYTkyqe79UbWLZZw5b6RcNBeuFYPB5wjJaUc1sypgs+CY i8M3ktozlTbvQXmahMKecS9CQkrNBj3nXdGZlR5/ToKkNHtnUfQBsP2+ahhUn8h0BJfh YaTEkCqRLV46pZByIXf01FljgIReBpBrXlbKnLCoD2XRAABTKmJmtshdlNcRhdYul/oV 1Q6kPpDrLqe8GS4BDL/jkvP4UOMRWaEwgJaZ6MT/2JTSB9/t164Wa8rSV3zN18RlnHoJ pmsQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@gmail.com header.s=20161025 header.b=TyUOTJJG; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id y10si3112287plk.291.2019.09.05.14.26.24; Thu, 05 Sep 2019 14:26:40 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=fail header.i=@gmail.com header.s=20161025 header.b=TyUOTJJG; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2390758AbfIEQzq (ORCPT + 99 others); Thu, 5 Sep 2019 12:55:46 -0400 Received: from mail-qt1-f169.google.com ([209.85.160.169]:39423 "EHLO mail-qt1-f169.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1731492AbfIEQzp (ORCPT ); Thu, 5 Sep 2019 12:55:45 -0400 Received: by mail-qt1-f169.google.com with SMTP id n7so3615939qtb.6; Thu, 05 Sep 2019 09:55:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=U86ZblmgaF4eBV4iyqRJf/CbV9WbHkWYMeJ0zFkqIu0=; b=TyUOTJJGoo8GODrCt/6YB1x/8aj4n9IE8jT/v+K7tCsOLINcESeyD/Ij4NXtMIB6Sy 17L6qDvWQyCyeC7XEmXxoOnrWrvCkDJaDG0IEmRd9h3bbbHGAAp7YN0Z5zIHZIZQLjXo e7R4fvWV6g6XW9aD+hLJiCg7Lmv5aeBV8tuo+o7VsPjG3fXt7UmiwBwDqQNJlFXWk3TH 5zwtfxF6mzHV0xMeRObFu3TfF099rR2GJ8US0yfbmsALUGRng05iBs5g6jzYHGRvKk8h FRvrTCHS5oUC5grWyibA9V7qghdaMk9oAmt6exGDzNOXAJpBRPdCLJ0cj/yBZJkPaFfd sbuQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=U86ZblmgaF4eBV4iyqRJf/CbV9WbHkWYMeJ0zFkqIu0=; b=AaGh5aAxS1kkttwlWW1hzOrtLI04mgCTsJuuHe/KUgC6l7CNGVlFoGPKxQY3ibD06M SCSC8X+4RRoEDzGI6q36Stpv+YyyKV2Uip9jN10hOteMbSMN4P1pZNZGw7QFRgg59SwG lXnKMoDmohrsgXZpwrR8m/HevTmN134AU2EUOwZnmsQ7A991TtHQV6s57IA0qwAxsZPQ UxuQzbK1g0M4j4KkjffyPFv0n9I4Wx/q3SDwH9sEG/K9kxBtUS9eQhBwEK9SwlspDL12 0qerDkdbz/MXVX3b/Sz5iRqqPsJSsN8d3e24K7YJKCr7n2AsR4efrlUbW4OlPTV0y/z+ PzTA== X-Gm-Message-State: APjAAAU9ptiZiNXOtCObdJWOrdGF8URMTjPe2nFnDjAm8y3UWh5M+8K2 n0vHJVdEe9NZbdwsc7zVwbY= X-Received: by 2002:ac8:2914:: with SMTP id y20mr4722757qty.150.1567702543675; Thu, 05 Sep 2019 09:55:43 -0700 (PDT) Received: from localhost ([2620:10d:c091:500::1:5196]) by smtp.gmail.com with ESMTPSA id e7sm1083953qto.43.2019.09.05.09.55.42 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 05 Sep 2019 09:55:42 -0700 (PDT) Date: Thu, 5 Sep 2019 09:55:40 -0700 From: Tejun Heo To: Paolo Valente Cc: Jens Axboe , newella@fb.com, clm@fb.com, Josef Bacik , dennisz@fb.com, Li Zefan , Johannes Weiner , linux-kernel , linux-block , kernel-team@fb.com, cgroups@vger.kernel.org, ast@kernel.org, daniel@iogearbox.net, kafai@fb.com, songliubraving@fb.com, yhs@fb.com, bpf@vger.kernel.org Subject: Re: [PATCHSET block/for-next] IO cost model based work-conserving porportional controller Message-ID: <20190905165540.GJ2263813@devbig004.ftw2.facebook.com> References: <20190614015620.1587672-1-tj@kernel.org> <20190614175642.GA657710@devbig004.ftw2.facebook.com> <5A63F937-F7B5-4D09-9DB4-C73D6F571D50@linaro.org> <20190820151903.GH2263813@devbig004.ftw2.facebook.com> <9EB760CE-0028-4766-AE9D-6E90028D8579@linaro.org> <20190831065358.GF2263813@devbig004.ftw2.facebook.com> <88C7DC68-680E-49BB-9699-509B9B0B12A0@linaro.org> <20190902155652.GH2263813@devbig004.ftw2.facebook.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hello, Paolo. So, I'm currently verifying iocost in the FB fleet. Around three thousand machines running v5.2 (+ some backports) with btrfs on a handful of different models of consumer grade SSDs. I haven't seen complete loss of control as you're reporting. Given that you're reporting the same thing on io.latency, which is deployed on multiple orders of magnitude more machines at this point, it's likely that there's something common affecting your test setup. Can you please describe your test configuration and if you aren't already try testing on btrfs? Thanks. -- tejun