Received: by 2002:a25:ad19:0:0:0:0:0 with SMTP id y25csp7257995ybi; Mon, 8 Jul 2019 18:03:47 -0700 (PDT) X-Google-Smtp-Source: APXvYqzd+x7xblLNlbB4oeXlK5wbeDADJbYldU56t5DQMw/wTEkYTgMFvRTx1nVnlWmVR/BTbfQK X-Received: by 2002:a17:902:1e9:: with SMTP id b96mr28770981plb.277.1562634227121; Mon, 08 Jul 2019 18:03:47 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1562634227; cv=none; d=google.com; s=arc-20160816; b=1C9/sgP3O+GPh+TFHvGYKdihHoouqtt5eJDlQuSLG7NjE9je5ZTo3S9gZSH/ISXdx5 guSmHIyMuI/FEUEXUWG+9C3E28v60JFcC3cFJ8ge5gwaLRdd/aTpVeoJzWxD6cGOGkLa G5dXz+TekwxiRVnRHSuf4f1Rlqo86aqMmm1kKh2IGKXHL4pNa7kblHMsBTQHtkP0fSgc kaFQTwN/baOE9IFve4H4J46+BtYO4SE0nBpWVDLYHwtVJTT4o04bMIUHf91eBmyMQ/hc kq3IFarH74iD2StR72Y1dsCYAVjG9Dci0qu4sqSLh5//6U5658VV+mpk4eA6NSbm7NiW wyGA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:subject:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:cc:to:from; bh=ovdO2dAXSJ5Wwkhs3JuMnhD5oShPn5CWyqeCVw9N87c=; b=iSXQ4zMccksBE1qav5W3ScX4D4UraIPL8a3WwHORb6132AgsGMQ/VSoJETTGvVr/Vv JmSKzPGi2xRdQGm46O1g7RilTVV1gfL7XrKbVbSBmsRbpuyKVs6OgtJQcp8MxB3IGiKL F7lwArQp4HP26qJpMRqhY/mIkbnUJNd5Cx1Ic0krf4C1BGUvBYD/pRN3Rkvkkjbek0kB L+lOZS0h8YdZ26nbxAbha7K/atrf0rNOnmJcxuW/sZ4TnY9czoATjBL4f8LXb44Fw+iy vvqvdYZSEvqfg1I+O1Znws3KQglqqyfBpvGKIjyFLaQfN5Hb3tC/PZ/KAnxOTjfhyaYh Z4pw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id k22si21999357pfk.90.2019.07.08.18.03.31; Mon, 08 Jul 2019 18:03:47 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726258AbfGIBCb (ORCPT + 99 others); Mon, 8 Jul 2019 21:02:31 -0400 Received: from edison.jonmasters.org ([173.255.233.168]:59276 "EHLO edison.jonmasters.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725925AbfGIBCa (ORCPT ); Mon, 8 Jul 2019 21:02:30 -0400 X-Greylist: delayed 2192 seconds by postgrey-1.27 at vger.kernel.org; Mon, 08 Jul 2019 21:02:30 EDT Received: from boston.jonmasters.org ([50.195.43.97] helo=tonnant.bos.jonmasters.org) by edison.jonmasters.org with esmtpsa (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1hke0d-0003pR-Ii; Tue, 09 Jul 2019 00:29:27 +0000 From: Jon Masters To: "qi.fuli@fujitsu.com" , Will Deacon Cc: Will Deacon , "indou.takao@fujitsu.com" , "linux-doc@vger.kernel.org" , "peterz@infradead.org" , Catalin Marinas , Jonathan Corbet , "linux-kernel@vger.kernel.org" , "linux-arm-kernel@lists.infradead.org" References: <20190617143255.10462-1-indou.takao@jp.fujitsu.com> <20190617170328.GJ30800@fuggles.cambridge.arm.com> <20190627102724.vif6zh6zfqktpmjx@willie-the-truck> <5999ed84-72d0-9d42-bf7d-b8d56eaa4d4a@jp.fujitsu.com> <675313fe-007b-c850-d730-a629b82ccfc8@jonmasters.org> Message-ID: Date: Mon, 8 Jul 2019 20:29:26 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: <675313fe-007b-c850-d730-a629b82ccfc8@jonmasters.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 50.195.43.97 X-SA-Exim-Mail-From: jcm@jonmasters.org X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on edison.jonmasters.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=ham version=3.3.1 Subject: Re: [PATCH 0/2] arm64: Introduce boot parameter to disable TLB flush instruction within the same inner shareable domain X-SA-Exim-Version: 4.2.1 (built Sun, 08 Nov 2009 07:31:22 +0000) X-SA-Exim-Scanned: Yes (on edison.jonmasters.org) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 7/8/19 8:25 PM, Jon Masters wrote: > On 7/2/19 10:45 PM, qi.fuli@fujitsu.com wrote: > >> However, we found that with the increase of that the TLB flash was called, >> the noise was also increasing. Here we understood that the cause of this >> issue is the implementation of Linux's TLB flush for arm64, especially use of >> TLBI-is instruction which is a broadcast to all processor core on the system. > > Are you saying that for a microbenchmark in which very large numbers of > threads are created and destroyed rapidly there are a large number of > associated tlb range flushes which always use broadcast TLBIs? > > If that's the case, and the hardware doesn't do any ASID filtering and > each TLBI results in a DVM to every PE, would it make sense to look at > whether there are ways to improve batching/switch to an IPI approach > rather than relying on broadcasts, as a more generic solution? What I meant was a heuristic to do this automatically, rather than via a command line. Jon.