Received: by 2002:a25:ad19:0:0:0:0:0 with SMTP id y25csp7259444ybi; Mon, 8 Jul 2019 18:05:27 -0700 (PDT) X-Google-Smtp-Source: APXvYqwcXBrCLtXGDgfVxksmcisTjsgAUbugxvqreQ7d+qna2CNrjUOu/LOz3oiAXL89oXoz/Rko X-Received: by 2002:a65:4505:: with SMTP id n5mr5067751pgq.301.1562634327434; Mon, 08 Jul 2019 18:05:27 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1562634327; cv=none; d=google.com; s=arc-20160816; b=rFdbMRTI9bqWb9wzZh37bs0Ed7EFXDywfRdv2v/qD81MmE1Ta6r5AI8tMOavJpdIsM sjPKISivi79QF4a9ifj8+oQzBCytMB5z5dPfs9d8ZfrAuPqAC6x3aIJwjQJfym4C/Qcb i+bkRTepr+1Fm4wnvXa2yDw6LuZ0sklE1nSqyudJh+8WcXoSyJz69ZuvXogLEyTrPE/k fPNZ7IxZ+DFafaxNjwLVupZL9gwYkJ4qarJW60HUN/x9vwNwDVScTtb8bwIyj28LbF1m JiJjG3NyrQOfhhJ5mAjjb5+9EsyHpn7h8wXPNbTnHxWmd6aRnyUgWyZiOP4uES00ePEX JsiQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:subject:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to; bh=WZC81DWwgRkfTY5J6ferxTbu/LtY6NK19cJNecNrXoE=; b=LSSpt/xqlBqu1o/bMLjO+PG522UmNHYnbAhuz0mFepHtQs/trR2y+lbtIlwP4rxGem BfMLb/UkQY69RJt0Egknn9SJsOb8CFf7vpiXSKVT4Fv2ub6sIjsi9u3ckXPr5iyddhQs 42AiHVfujby/lQ96HM2v+AG++pyHzP2lXcfzPS6d5v89hEpeV1Lp4xukYEq1yNWSaVZe 4QqdmnnvbUgGcmFZRkS9/bpfqioFJW7qfDs7++coCbK59iBIlyekt54KxeEYAFofRiFF ZCGGa1FoVLP4br4XFEzQEHm81HEYA+DEYiZaw66+mN+wRiN0UPld7YFA5kMwqJXmbYZH 7J3w== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id y21si19250211plp.332.2019.07.08.18.05.12; Mon, 08 Jul 2019 18:05:27 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726486AbfGIBCe (ORCPT + 99 others); Mon, 8 Jul 2019 21:02:34 -0400 Received: from edison.jonmasters.org ([173.255.233.168]:59278 "EHLO edison.jonmasters.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726279AbfGIBCb (ORCPT ); Mon, 8 Jul 2019 21:02:31 -0400 Received: from boston.jonmasters.org ([50.195.43.97] helo=tonnant.bos.jonmasters.org) by edison.jonmasters.org with esmtpsa (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1hkdxB-0003Xo-BL; Tue, 09 Jul 2019 00:25:53 +0000 To: "qi.fuli@fujitsu.com" , Will Deacon Cc: Will Deacon , "indou.takao@fujitsu.com" , "linux-doc@vger.kernel.org" , "peterz@infradead.org" , Catalin Marinas , Jonathan Corbet , "linux-kernel@vger.kernel.org" , "linux-arm-kernel@lists.infradead.org" References: <20190617143255.10462-1-indou.takao@jp.fujitsu.com> <20190617170328.GJ30800@fuggles.cambridge.arm.com> <20190627102724.vif6zh6zfqktpmjx@willie-the-truck> <5999ed84-72d0-9d42-bf7d-b8d56eaa4d4a@jp.fujitsu.com> From: Jon Masters Message-ID: <675313fe-007b-c850-d730-a629b82ccfc8@jonmasters.org> Date: Mon, 8 Jul 2019 20:25:52 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: <5999ed84-72d0-9d42-bf7d-b8d56eaa4d4a@jp.fujitsu.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 50.195.43.97 X-SA-Exim-Mail-From: jcm@jonmasters.org X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on edison.jonmasters.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, URIBL_BLOCKED autolearn=ham version=3.3.1 Subject: Re: [PATCH 0/2] arm64: Introduce boot parameter to disable TLB flush instruction within the same inner shareable domain X-SA-Exim-Version: 4.2.1 (built Sun, 08 Nov 2009 07:31:22 +0000) X-SA-Exim-Scanned: Yes (on edison.jonmasters.org) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 7/2/19 10:45 PM, qi.fuli@fujitsu.com wrote: > However, we found that with the increase of that the TLB flash was called, > the noise was also increasing. Here we understood that the cause of this > issue is the implementation of Linux's TLB flush for arm64, especially use of > TLBI-is instruction which is a broadcast to all processor core on the system. Are you saying that for a microbenchmark in which very large numbers of threads are created and destroyed rapidly there are a large number of associated tlb range flushes which always use broadcast TLBIs? If that's the case, and the hardware doesn't do any ASID filtering and each TLBI results in a DVM to every PE, would it make sense to look at whether there are ways to improve batching/switch to an IPI approach rather than relying on broadcasts, as a more generic solution? Jon.