Received: by 2002:ac0:a5a6:0:0:0:0:0 with SMTP id m35-v6csp3934345imm; Wed, 5 Sep 2018 08:12:44 -0700 (PDT) X-Google-Smtp-Source: ANB0Vda0Rdp3j5jXVPfcdCB1vUB2eKnzlfSNNqibi8FXeXHMYJcvGi7Ietz8/8xs1zUJE1IY9FoM X-Received: by 2002:a17:902:a58c:: with SMTP id az12-v6mr39311511plb.339.1536160364030; Wed, 05 Sep 2018 08:12:44 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1536160364; cv=none; d=google.com; s=arc-20160816; b=e9FOZSvWXVd6F0k8JBtvvuotmD4WI07FSFiIQiC8N7KN/jxiFgZJzBXQUhsZ90+a/q 2OLU1ENWW1zWPvFa1HIxbFJ71+UG/MxxBL8Ue6/1XdqV8cnw8c2RGSCRaehGJFqIoiZT W9Gm7LK8+uEt5jZeYs9OoR7vz3wkmT+Y12w5lqqfVY6GxjZo7+4fD4CisZ4lasWOt4Ry jsXbGgoZQVjOFlkGxDfuVFEZdiVtO0EdI1iX9KeuFVX41KyS7icvJtryOyzgm08og32r cQyPD3DG5LuXtoqKy86SJfxIBxuPD8bIukegkmX8YpVNWUOvzuHmSkKVtg/cYLdgwkCD dsMw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:feedback-id:mime-version:user-agent :references:message-id:in-reply-to:subject:cc:to:from:date :dkim-signature; bh=HouzFEjVkhisBDDM3L910oBmdKfHoXBaRor/62d9Zzc=; b=n14xg2hEq84K8qhuFod9cF8SY6pgMyVYeyqcNJzoVnpmyTKVBk23Kt+tasJMXvuguy whE3uK51buZuclXaHLkx5b3iSQL5ODvcnXS2vOGZ0PVCYRJiZnuO37CbI/q8W7GlN2N3 2cvG6O02r4sVSmjIbYHm76dNA+1nXYmN+FJV358QNQhu6vXPzw9DoGXs6dxEj81pZDas v5kqa6SmrAclQOlCwvogq1ly0wTiSmWIm1sxHaD2XANoJDCPJulKkH8bBNN1iBhOA07F aLtO47cGuI5JjpEXDrpGCnUdrgpZbm4kSCZ4ElXXuB73/cPq2pv3NKZp9MJQVmkCjpAx QIpQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@amazonses.com header.s=ug7nbtf4gccmlpwj322ax3p6ow6yfsug header.b=YIL4BevO; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 1-v6si2137849plj.15.2018.09.05.08.12.26; Wed, 05 Sep 2018 08:12:43 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@amazonses.com header.s=ug7nbtf4gccmlpwj322ax3p6ow6yfsug header.b=YIL4BevO; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727621AbeIETlR (ORCPT + 99 others); Wed, 5 Sep 2018 15:41:17 -0400 Received: from a9-46.smtp-out.amazonses.com ([54.240.9.46]:45566 "EHLO a9-46.smtp-out.amazonses.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726046AbeIETlR (ORCPT ); Wed, 5 Sep 2018 15:41:17 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=ug7nbtf4gccmlpwj322ax3p6ow6yfsug; d=amazonses.com; t=1536160239; h=Date:From:To:cc:Subject:In-Reply-To:Message-ID:References:MIME-Version:Content-Type:Feedback-ID; bh=lsfLbHwBykz5/SXR183FmYEmB+8XC5HYqw0k1LBs37Q=; b=YIL4BevOO1zr6j4gYKlM3X6UYj97UxNgwqQQI81Mwtts1A2x25fBqaS70B8Yw//k QpUK3+i7FG1NfaJXIC/9pcLNaAGNcrO+xrrnjwSSyPgdzGUXy1N/TqBdL7G/TEA5uNQ iT64nzQKLRsE7RxMnp+IItQitrNlY4b0PXkWYuFM= Date: Wed, 5 Sep 2018 15:10:39 +0000 From: Christopher Lameter X-X-Sender: cl@nuc-kabylake To: Daniel Jordan cc: linux-kernel@vger.kernel.org, "linux-mm@kvack.org" , Aaron Lu , alex.kogan@oracle.com, akpm@linux-foundation.org, boqun.feng@gmail.com, brouer@redhat.com, dave@stgolabs.net, dave.dice@oracle.com, Dhaval Giani , ktkhai@virtuozzo.com, ldufour@linux.vnet.ibm.com, Pavel.Tatashin@microsoft.com, paulmck@linux.vnet.ibm.com, shady.issa@oracle.com, tariqt@mellanox.com, tglx@linutronix.de, tim.c.chen@intel.com, vbabka@suse.cz, longman@redhat.com, yang.shi@linux.alibaba.com, shy828301@gmail.com, Huang Ying , brouer@redhat.com, subhra.mazumdar@oracle.com, Steven Sistare , jwadams@google.com, ashwinch@google.com, sqazi@google.com, Shakeel Butt , walken@google.com, rientjes@google.com, junaids@google.com, Neha Agarwal Subject: Re: Plumbers 2018 - Performance and Scalability Microconference In-Reply-To: <1dc80ff6-f53f-ae89-be29-3408bf7d69cc@oracle.com> Message-ID: <01000165aa490dc9-64abf872-afd1-4a81-a46d-a50d0131de93-000000@email.amazonses.com> References: <1dc80ff6-f53f-ae89-be29-3408bf7d69cc@oracle.com> User-Agent: Alpine 2.21 (DEB 202 2017-01-01) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII X-SES-Outgoing: 2018.09.05-54.240.9.46 Feedback-ID: 1.us-east-1.fQZZZ0Xtj2+TD7V5apTT/NrT6QKuPgzCT/IC7XYgDKI=:AmazonSES Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, 4 Sep 2018, Daniel Jordan wrote: > - Promoting huge page usage: With memory sizes becoming ever larger, huge > pages are becoming more and more important to reduce TLB misses and the > overhead of memory management itself--that is, to make the system scalable > with the memory size. But there are still some remaining gaps that prevent > huge pages from being deployed in some situations, such as huge page > allocation latency and memory fragmentation. You forgot the major issue that huge pages in the page cache are not supported and thus we have performance issues with fast NVME drives that are now able to do 3Gbytes per sec that are only possible to reach with directio and huge pages. IMHO the huge page issue is just the reflection of a certain hardware manufacturer inflicting pain for over a decade on its poor users by not supporting larger base page sizes than 4k. No such workarounds needed on platforms that support large sizes. Things just zoom along without contortions necessary to deal with huge pages etc. Can we come up with a 2M base page VM or something? We have possible memory sizes of a couple TB now. That should give us a million or so 2M pages to work with. > - Reducing the number of users of mmap_sem: This semaphore is frequently > used throughout the kernel. In order to facilitate scaling this longstanding > bottleneck, these uses should be documented and unnecessary users should be > fixed. Large page sizes also reduce contention there. > If you haven't already done so, please let us know if you are interested in > attending, or have suggestions for other attendees. Certainly interested in attending but this overlaps supercomputing 2018 in Dallas Texas...