Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp1620575imu; Tue, 6 Nov 2018 01:23:41 -0800 (PST) X-Google-Smtp-Source: AJdET5dyUweDK6yVKny8mrwVMUd8E4++FUaR44oTSabzNIlL48vWwPFf0JbAd8umjlqMQkuhlGZt X-Received: by 2002:a62:de84:: with SMTP id h126-v6mr25286406pfg.129.1541496221508; Tue, 06 Nov 2018 01:23:41 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1541496221; cv=none; d=google.com; s=arc-20160816; b=hAegpnKpX90WJGbhqpIOKjPJxYFsrv/NwJLqsbzkhXlJ4OsnbsGCXJgxzqqJqqnO4s DbbH+If8vfv6R5wy8OS48BYoBiio6C96c41qKf1vCQmoLpXRLATrFjrgsrXnx1El/Qlr MPKM9cYHUmd1KHvg3YEpI+avth4ByopIxA0+QKHvdaUtNZiVKr0I8LnpLZis2rtQleR1 8MHTi7zFlo1vvQ4ZaoQlGm86+kckP3AooT6gXJvN5PzVrtsCz88WyswC2XkSZHDXTUHg 7nzctVW8JQAd91Eee9iZrNREzuxwqXzDwV3YkLosIFk5JwxocqSGV9DchDtpsj6v5v97 BOjg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=m4DWebijCNtfPdlhfdiEKngNGjaLLleSxuA1iTXfkYg=; b=KUYrf6HgT0eR6wR6N4NkzlxQuktLRqlpggTIF6LeivH28BIXIBMKB8MnTo+s74KhSK 8m0qYI/aFPaX57CxVw3cyG4/sjbU6p/yf6EEkbNwfrH/z3sh1zGbiSAcIvdr+hSEwHy8 CCDZhvRpsfaUtxVNV9GUIzf6RpvoHSHKC7y8syqvI+IXLb+l9hmvielaB58HV0pzOzI1 FrPrSEYn7XsCOD0X2vFR37qOr0bDxUlM4Btr9+SvCQLOZyskTBoC4IPIkvmKZx9mJGgs 6r8t5fJTQ1WMJamA1Xer8TZ2qHoG/cAwstqC22VNNpLfkcDICELsPtCgzzfafvz0PkwC 8WRw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id a17-v6si40136795pgf.443.2018.11.06.01.23.26; Tue, 06 Nov 2018 01:23:41 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729816AbeKFSqG (ORCPT + 99 others); Tue, 6 Nov 2018 13:46:06 -0500 Received: from mx2.suse.de ([195.135.220.15]:40310 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1729160AbeKFSqF (ORCPT ); Tue, 6 Nov 2018 13:46:05 -0500 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 89575B11D; Tue, 6 Nov 2018 09:21:46 +0000 (UTC) Date: Tue, 6 Nov 2018 10:21:45 +0100 From: Michal Hocko To: Daniel Jordan Cc: linux-mm@kvack.org, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, aarcange@redhat.com, aaron.lu@intel.com, akpm@linux-foundation.org, alex.williamson@redhat.com, bsd@redhat.com, darrick.wong@oracle.com, dave.hansen@linux.intel.com, jgg@mellanox.com, jwadams@google.com, jiangshanlai@gmail.com, mike.kravetz@oracle.com, Pavel.Tatashin@microsoft.com, prasad.singamsetty@oracle.com, rdunlap@infradead.org, steven.sistare@oracle.com, tim.c.chen@intel.com, tj@kernel.org, vbabka@suse.cz Subject: Re: [RFC PATCH v4 00/13] ktask: multithread CPU-intensive kernel work Message-ID: <20181106092145.GF27423@dhcp22.suse.cz> References: <20181105165558.11698-1-daniel.m.jordan@oracle.com> <20181105172931.GP4361@dhcp22.suse.cz> <20181106012955.br5swua3ykvolyjq@ca-dmjordan1.us.oracle.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181106012955.br5swua3ykvolyjq@ca-dmjordan1.us.oracle.com> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon 05-11-18 17:29:55, Daniel Jordan wrote: > On Mon, Nov 05, 2018 at 06:29:31PM +0100, Michal Hocko wrote: > > On Mon 05-11-18 11:55:45, Daniel Jordan wrote: > > > Michal, you mentioned that ktask should be sensitive to CPU utilization[1]. > > > ktask threads now run at the lowest priority on the system to avoid disturbing > > > busy CPUs (more details in patches 4 and 5). Does this address your concern? > > > The plan to address your other comments is explained below. > > > > I have only glanced through the documentation patch and it looks like it > > will be much less disruptive than the previous attempts. Now the obvious > > question is how does this behave on a moderately or even busy system > > when you compare that to a single threaded execution. Some numbers about > > best/worst case execution would be really helpful. > > Patches 4 and 5 have some numbers where a ktask and non-ktask workload compete > against each other. Those show either 8 ktask threads on 8 CPUs (worst case) or no ktask threads (best case). > > By single threaded execution, I guess you mean 1 ktask thread. I'll run the > experiments that way too and post the numbers. I mean a comparision of how much time it gets to accomplish the same amount of work if it was done singlethreaded to ktask based distribution on a idle system (best case for both) and fully contended system (the worst case). It would be also great to get some numbers on partially contended system to see how much the priority handover etc. acts under different CPU contention. -- Michal Hocko SUSE Labs