Received: by 2002:a25:ad19:0:0:0:0:0 with SMTP id y25csp202041ybi; Fri, 26 Jul 2019 08:22:23 -0700 (PDT) X-Google-Smtp-Source: APXvYqx5+oudpF8L6Q86c7QTaaWTJwCgXmLKeH9Rjd5raNQWCIAzwhklumtOQP4/ERSLhiJi9qyp X-Received: by 2002:a65:4b89:: with SMTP id t9mr22677988pgq.55.1564154542937; Fri, 26 Jul 2019 08:22:22 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1564154542; cv=none; d=google.com; s=arc-20160816; b=TPIkEvv9P4idYg3wi7ryENt07HYrZR9Hqj3D6e0IpfWEFLM3pslcx6bo6s+Da/o0cb f1WZa69ORtnFTe0wzJd6pzdgbbDA1yIRKWvL4xpTIbW7TcB6/lGVcPG3TYd6Flzs+yXs B0qsGBjW6TPPuTFDqYhG2AY/Yrux1hy/Y0VURn1T5OZ+m0WP83cJtHuSzkgnrVhv9/xi EPVJ7YkfdPwhGezEZyOMc91zIQhg5fU4qQKDSq+sQa745ZvX2g0WAD2QaOwIdUvqUzSO DqfKkPRfRpeY/zpbPCZOnXgAnLzBL30TcGo0/jNigBrcb5ISBnV4d4Z/ffP0haxv5ClU nPtw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=io8KTwJRjBRf7t3xou4gVUXWk4KO93fqZyXX2l+iaRU=; b=gP1/vWdrqO/r48GUaldUXdfzrH9EEuZso3/xJ3gfsPyuNJBJ9munlYWPFfUyzKJHRa 4DYxcI2/lz4GhVCcmJJ4OT8ocOKXeU1plAhU22KDUz6eItO+EziyQ0HjjPrpYQ6ocQkR kaS5pW3xoqneGXsuKDtSBluc5gBtrxk6MAsXN13kZJfW7tx4pxHvu3ud+ti7cLrPSDLZ jwa9cEyxOmNrajnCqktxV1ToDFtkrwL22PhfwvXfsxc71dj+XNfGOp5QVGMbhypcQSn+ 7X/bPeJ99RAXVBMLHB1gildlj4yYrjMUJuXE/rGR+cK5PW4QkQwuel4GXYwM2RkGYCy5 BzSg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@digitalocean.com header.s=google header.b=EuiGUkPX; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=digitalocean.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id c127si25123505pga.569.2019.07.26.08.22.08; Fri, 26 Jul 2019 08:22:22 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@digitalocean.com header.s=google header.b=EuiGUkPX; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=digitalocean.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727552AbfGZPVK (ORCPT + 99 others); Fri, 26 Jul 2019 11:21:10 -0400 Received: from mail-qt1-f196.google.com ([209.85.160.196]:41533 "EHLO mail-qt1-f196.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726681AbfGZPVJ (ORCPT ); Fri, 26 Jul 2019 11:21:09 -0400 Received: by mail-qt1-f196.google.com with SMTP id d17so52845321qtj.8 for ; Fri, 26 Jul 2019 08:21:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=digitalocean.com; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=io8KTwJRjBRf7t3xou4gVUXWk4KO93fqZyXX2l+iaRU=; b=EuiGUkPXxYhe9DK67/TFLayUUSZTFp6sBDmksQmQX42kb8wbfVwzQLIA1oRix9Khre 3znGaKyZZwaM6j4N9BTzp0FB3eyYIaD+0EfXQAkuNsYoC0bftmdPBlmhWabsYPEpyETE 5wZqcWMt9LD4/YzYNR+NSikOr02X+VqSa7DbM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=io8KTwJRjBRf7t3xou4gVUXWk4KO93fqZyXX2l+iaRU=; b=gXfU8qUqjmXhzK8btnJD2yNiPfwwS1o2C5sHbjayi4uOZ7uXcLpYF1x0NH48yF7fVs 2zQLdqaG+ooAsup/DW2zO6B181/va/Xd70o5kQuO4xvQYDKR5Wv5Op+8TkL+AoCnBcAx F9zIPJXh7FG/CGtx5SHqqQzf4K9Z7bPZLypPchndvQ8fiTRd/m0rD6RONdbbmBRdJ+je z7XX8SK886bC1UDhlvkUrVBzLbO+xqb4N4a7M1WXWlZUjWwa/zHXsnygqhNWBlSm9V/5 oa9RcGBL5iYJUhihk8CEIgzoJ/8vvKHNvoY6Q3fCST088sd1j8iVJ0Lp57xo/mwJh+aS grEA== X-Gm-Message-State: APjAAAWlApqijo6FUvSULuQHRromxAac0oIoL6l7Fj8qX/W+tNKfeykK PUSE+22+1Llli8HVlg6z4pMcBQ== X-Received: by 2002:ac8:42d6:: with SMTP id g22mr61864611qtm.10.1564154468802; Fri, 26 Jul 2019 08:21:08 -0700 (PDT) Received: from sinkpad (192-222-189-155.qc.cable.ebox.net. [192.222.189.155]) by smtp.gmail.com with ESMTPSA id f132sm22257084qke.88.2019.07.26.08.21.06 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Fri, 26 Jul 2019 08:21:07 -0700 (PDT) Date: Fri, 26 Jul 2019 11:21:01 -0400 From: Julien Desfossez To: Aaron Lu Cc: Aubrey Li , Subhra Mazumdar , Vineeth Remanan Pillai , Nishanth Aravamudan , Peter Zijlstra , Tim Chen , Ingo Molnar , Thomas Gleixner , Paul Turner , Linus Torvalds , Linux List Kernel Mailing , =?iso-8859-1?Q?Fr=E9d=E9ric?= Weisbecker , Kees Cook , Greg Kerr , Phil Auld , Valentin Schneider , Mel Gorman , Pawan Gupta , Paolo Bonzini Subject: Re: [RFC PATCH v3 00/16] Core scheduling v3 Message-ID: <20190726152101.GA27884@sinkpad> References: <20190531210816.GA24027@sinkpad> <20190606152637.GA5703@sinkpad> <20190612163345.GB26997@sinkpad> <635c01b0-d8f3-561b-5396-10c75ed03712@oracle.com> <20190613032246.GA17752@sinkpad> <20190619183302.GA6775@sinkpad> <20190718100714.GA469@aaronlu> <20190725143003.GA992@aaronlu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190725143003.GA992@aaronlu> X-Mailer: Mutt 1.9.4 (2018-02-28) User-Agent: Mutt/1.9.4 (2018-02-28) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 25-Jul-2019 10:30:03 PM, Aaron Lu wrote: > > I tried a different approach based on vruntime with 3 patches following. [...] We have experimented with this new patchset and indeed the fairness is now much better. Interactive tasks with v3 were complete starving when there were cpu-intensive tasks running, now they can run consistently. With my initial test of TPC-C running in large VMs with a lot of background noise VMs, the results are pretty similar to v3, I will run more thorough tests and report the results back here. Instead of the 3/3 hack patch, we were already working on a different approach to solve the same problem. What we have done so far is create a very low priority per-cpu coresched_idle kernel thread that we use instead of idle when we can't co-schedule tasks. This gives us more control and accounting. It still needs some work, but the initial results are encouraging, I will post more when we have something that works well. Thanks, Julien