Received: by 2002:a4a:3008:0:0:0:0:0 with SMTP id q8-v6csp3594106oof; Mon, 10 Sep 2018 17:39:39 -0700 (PDT) X-Google-Smtp-Source: ANB0VdYwkZSmXfsNMb+0LEof0p7ufhShugUwyHdq20sU/PR8oJ06brzgNLwuejZogShvsdW6QQKY X-Received: by 2002:a63:4a09:: with SMTP id x9-v6mr24494890pga.34.1536626379468; Mon, 10 Sep 2018 17:39:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1536626379; cv=none; d=google.com; s=arc-20160816; b=qOsbl+ulbc4cGNU0PWrgYSRbsiNw11LlAS0b3hI36NQx6NSy83b9A6iVWP4EKt+9C7 UbrzOAmno6MM6pA6JOtLhxlMIv2n//FReJWhYcZq/uaUm2rLTSkL2hi3b832ma9P7dUV ruRSm+oKX5Vj+0CTMBMQV4heSBcYMUUsJK/V9pDQeMWqdVimW2iS5mi6vZiPqg9QqkhT kmqMdal3uffSHsogLHARJ7euSHUZJUReaeCi4SQ7CbJxuwADduZTfdq+9EYngx/Vv77H 6FDSD8+qDA4E3Cd77gRm+/hgicbJ6ayr7TCnfW5mmT+9ZXK8YuCNv3WUVAu2oa145y1z R0GA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=YZA/Cq+l3yBuMoAjxpcuIVFJlaNzR3dZ4jRE5uiip8I=; b=GtbXmF3YbyS9+QqYjuTQ7AyAMtsaXV8FK82tpi036hyVWYsXFZhJH6SlpwWz7IgJ4y pAyIGDDWCDuRco8Z7yfj8YWg/XFnHOr25xOO5YxUYk/B/3oPtnO+DPe8WK44W9bcPmXb +ZeQ0ENZcAXZEiwdc/+zYvd0JvTO9a9haBUBqVwVWXAdtq+sL3rjux/x2C7J5hVcP1g5 PyfzqrBRvZIuVowytcVNWC/fByYBCMwdQbW24ZkRCjIxZ3lbAEVDqoXw6HR72+9zbwsZ qrIp74o4n4hdQ30uLbqRSCTGPYofp1WcNu8+QCF3asUsTNvoFTZOIiwGNPpGvMMnqOSj oMyQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2018-07-02 header.b="zCBHge2/"; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id x63-v6si19527529pfb.299.2018.09.10.17.39.23; Mon, 10 Sep 2018 17:39:39 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2018-07-02 header.b="zCBHge2/"; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726423AbeIKFfs (ORCPT + 99 others); Tue, 11 Sep 2018 01:35:48 -0400 Received: from aserp2120.oracle.com ([141.146.126.78]:45916 "EHLO aserp2120.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725945AbeIKFfs (ORCPT ); Tue, 11 Sep 2018 01:35:48 -0400 Received: from pps.filterd (aserp2120.oracle.com [127.0.0.1]) by aserp2120.oracle.com (8.16.0.22/8.16.0.22) with SMTP id w8B0cgQS087625; Tue, 11 Sep 2018 00:38:42 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : mime-version : in-reply-to : content-type : content-transfer-encoding; s=corp-2018-07-02; bh=YZA/Cq+l3yBuMoAjxpcuIVFJlaNzR3dZ4jRE5uiip8I=; b=zCBHge2/zqGbMzuCO2kxnNq6BNkguAvynhh+Y04yB+ZWO546/Llj9ZVJMOaUfDyP6r6o wIntoEywUDKUslf26hSgdGK/lR0ZoSSAdXubbb+9b6D1VMPdZs8Q2VaekCQ4VRIxHPsI I08qIist2O9DbQKlcvLLJnKbHShQ/AxxyZCXOEeThNbAAYqA67gyyKfoLFGy2NZJV4EM +n3fcRPtPpyMndyNWvNK5FSvkuM17zabe2GxpTfJkKoztgpUXrtIb1SY1yiofZo1lpGZ kyRGkBZVibWq3pgfretm35BU6zn7Ces/8YNpGBl39ciNvGKFEihosuJ3omUA9e29M0sJ DA== Received: from userv0022.oracle.com (userv0022.oracle.com [156.151.31.74]) by aserp2120.oracle.com with ESMTP id 2mc6cph17t-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 11 Sep 2018 00:38:42 +0000 Received: from aserv0122.oracle.com (aserv0122.oracle.com [141.146.126.236]) by userv0022.oracle.com (8.14.4/8.14.4) with ESMTP id w8B0ceJ1024898 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 11 Sep 2018 00:38:41 GMT Received: from abhmp0017.oracle.com (abhmp0017.oracle.com [141.146.116.23]) by aserv0122.oracle.com (8.14.4/8.14.4) with ESMTP id w8B0cdTR023777; Tue, 11 Sep 2018 00:38:39 GMT Received: from [192.168.1.218] (/73.143.71.164) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Mon, 10 Sep 2018 17:38:39 -0700 Subject: Re: Plumbers 2018 - Performance and Scalability Microconference To: John Hubbard , linux-kernel@vger.kernel.org, "linux-mm@kvack.org" Cc: Aaron Lu , alex.kogan@oracle.com, akpm@linux-foundation.org, boqun.feng@gmail.com, brouer@redhat.com, dave@stgolabs.net, dave.dice@oracle.com, Dhaval Giani , ktkhai@virtuozzo.com, ldufour@linux.vnet.ibm.com, Pavel.Tatashin@microsoft.com, paulmck@linux.vnet.ibm.com, shady.issa@oracle.com, tariqt@mellanox.com, tglx@linutronix.de, tim.c.chen@intel.com, vbabka@suse.cz, longman@redhat.com, yang.shi@linux.alibaba.com, shy828301@gmail.com, Huang Ying , subhra.mazumdar@oracle.com, Steven Sistare , jwadams@google.com, ashwinch@google.com, sqazi@google.com, Shakeel Butt , walken@google.com, rientjes@google.com, junaids@google.com, Neha Agarwal References: <1dc80ff6-f53f-ae89-be29-3408bf7d69cc@oracle.com> <35c2c79f-efbe-f6b2-43a6-52da82145638@nvidia.com> From: Daniel Jordan Message-ID: <0f49f722-1759-f097-ff46-4ec7286dc69e@oracle.com> Date: Mon, 10 Sep 2018 20:38:35 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.0 MIME-Version: 1.0 In-Reply-To: <35c2c79f-efbe-f6b2-43a6-52da82145638@nvidia.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Proofpoint-Virus-Version: vendor=nai engine=5900 definitions=9012 signatures=668708 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1807170000 definitions=main-1809110006 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 9/8/18 12:13 AM, John Hubbard wrote: > I'm interested in the first 3 of those 4 topics, so if it doesn't conflict with HMM topics or > fix-gup-with-dma topics, I'd like to attend. Great, we'll add your name to the list. > GPUs generally need to access large chunks of > memory, and that includes migrating (dma-copying) pages around. > > So for example a multi-threaded migration of huge pages between normal RAM and GPU memory is an > intriguing direction (and I realize that it's a well-known topic, already). Doing that properly > (how many threads to use?) seems like it requires scheduler interaction. Yes, in past discussions of multithreading kernel work, there's been some discussion of a scheduler API that could answer "are there idle CPUs we could use to multithread?". Instead of adding an interface, though, we could just let the scheduler do something it already knows how to do: prioritize. Additional threads used to parallelize kernel work could run at the lowest priority (i.e. MAX_NICE). If the machine is heavily loaded, these extra threads simply won't run and other workloads on the system will be unaffected. There's the issue of priority inversion if one or more of those extra threads get started and are then preempted by normal-priority tasks midway through, but the main thread doing the job can just will its priority to each worker in turn once it's finished, so at most one thread will be active on a heavily loaded system, again leaving other workloads on the system undisturbed.