Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
IronPort-SDR: CCBGAt2ZWTRSjt0XvSBOr3TWCuciIrM4Tlx4qneWL0tusUituzUjwNHE+Ndya0JtXwtyZxhDt4
 vKeOoHh/6ismfz3S0hDHQLf7IG7rruTZ/qme0C6L5V9nz/4BIejr1zc1hMAegGAx7fnQasSyPV
 v1iAQ7ygPIJwRDwM3rAjLLCUCss8ipbZsmfajKl1JlT5R6Y88OuPXtoiVWbIaBiZ3wZ5uFmwjG
 2DIDGA03gh9Ab1cyDF+FnXBPktHyThq2pdLmTy/nocdZ1CA9qiHsDPskQvoBD6lX8UP1g19cGm
 7s8=
IronPort-SDR: 0fNsv38YaDBbY8ZH+03mSnEyDRakFjPrH4Q0S9jWSv/9REKX/i9J865Vu11N/nlY4j58EnnYnt
 oNNYPwsnQn00lIpvu+Oeg8JMVs0BJkvqbAUW4Qu9j/nw9JTWaJGJYVfd7EDNgIVOD5mkoTVoHg
 f7RseMVvZyBuaTD2BuNQxwM1/Y61nyj7jUikJ9nXZShLlYtJKdW8iiuMlcbS44hmbhkQr9G/Q4
 opvjp5bNBVJviOjCuaSsmEY1+1uD5vX2PqhRz+hewdsoIOlZQb4jxrK4CdU0UXCOHrcCHXUkQX
 b2Jccn2qLYewaawTbwF/a+6u
IronPort-SDR: K6C88eai+9nEsr+QmFtqCIfF3a0criYQcYq3mHZZ3xxksUkCfr2YySl9AbHVCM57uQ6msb+dVC
 j79MQ1hMD/OOjLr4e3ax8hRxpLMlU0QHV6VhB8U+KMUW1bbEAue0oeN2fX0MiNc5KM3kODsObA
 Ijq/o4JEBChVG+uJfuU39wARr6qvaejl49x6IjakcY9IxlKLAN61fkeeuzPOsQ+O0EiLw4fuA/
 Sxn0+Wn8l2Z63AmV/nB/LCN9T4jlUcZl5yiaCAgPlvnJJ8H70DrL8xnZdVOFKOq9M/AkcOkgm3
 6qQ=
WDCIronportException: Internal
From:   Atish Patra <atish.patra@wdc.com>
To:     linux-kernel@vger.kernel.org
Cc:     Atish Patra <atish.patra@wdc.com>,
        Albert Ou <aou@eecs.berkeley.edu>,
        linux-riscv@lists.infradead.org,
        Palmer Dabbelt <palmer@sifive.com>,
        Paul Walmsley <paul.walmsley@sifive.com>,
        Christoph Hellwig <hch@lst.de>,
        Anup Patel <Anup.Patel@wdc.com>,
        Andreas Schwab <schwab@linux-m68k.org>
Subject: [PATCH v3 1/3] RISC-V: Issue a local tlbflush if possible.
Date:   Wed, 21 Aug 2019 17:46:42 -0700
Message-Id: <20190822004644.25829-2-atish.patra@wdc.com>
In-Reply-To: <20190822004644.25829-1-atish.patra@wdc.com>
References: <20190822004644.25829-1-atish.patra@wdc.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk

In RISC-V, tlb flush happens via SBI which is expensive. If the local
cpu is the only cpu in cpumask, there is no need to invoke a SBI call.

Just do a local flush and return.

Signed-off-by: Atish Patra <atish.patra@wdc.com>
---
 arch/riscv/mm/tlbflush.c | 15 +++++++++++++++
 1 file changed, 15 insertions(+)

diff --git a/arch/riscv/mm/tlbflush.c b/arch/riscv/mm/tlbflush.c
index df93b26f1b9d..36430ee3bed9 100644
--- a/arch/riscv/mm/tlbflush.c
+++ b/arch/riscv/mm/tlbflush.c
@@ -2,6 +2,7 @@
 
 #include <linux/mm.h>
 #include <linux/smp.h>
+#include <linux/sched.h>
 #include <asm/sbi.h>
 
 void flush_tlb_all(void)
@@ -13,9 +14,23 @@ static void __sbi_tlb_flush_range(struct cpumask *cmask, unsigned long start,
 		unsigned long size)
 {
 	struct cpumask hmask;
+	unsigned int cpuid = get_cpu();
 
+	if (!cmask) {
+		riscv_cpuid_to_hartid_mask(cpu_online_mask, &hmask);
+		goto issue_sfence;
+	}
+
+	if (cpumask_test_cpu(cpuid, cmask) && cpumask_weight(cmask) == 1) {
+		local_flush_tlb_all();
+		goto done;
+	}
 	riscv_cpuid_to_hartid_mask(cmask, &hmask);
+
+issue_sfence:
 	sbi_remote_sfence_vma(hmask.bits, start, size);
+done:
+	put_cpu();
 }
 
 void flush_tlb_mm(struct mm_struct *mm)
-- 
2.21.0