Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp3242802ybz; Sun, 3 May 2020 21:45:52 -0700 (PDT) X-Google-Smtp-Source: APiQypLzVn8Ms28onH/nCgzA/ji/YtU4mY4Pi17nIN2naGxpv8bLkpZe3+20KFtLh5giSsevfmpV X-Received: by 2002:a05:6402:1d89:: with SMTP id dk9mr12842632edb.382.1588567552482; Sun, 03 May 2020 21:45:52 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1588567552; cv=none; d=google.com; s=arc-20160816; b=LipbXI352AZSSR08CJQe023ReT0ZXPsl5kBsiV1hIHZ6icvibGuzkzD7Ts7MIRaL6W EVfdTrZfPOuaLTidxnWTk4pD3PA2PG9Xp5bPrheS4A61Oq9lhuPt/PavIGgmGjxz0qVd zRd7r4afDIj4V3gHyJ/S3nnQ1WTaC3w3y3FZe2jRq3PkYE8g13dMmVKF9x6tDfk5N1/0 z3rUUhHFoAFhrxcNibQcYFxlknhhPmTFEsn4Yt/pEVLGi+2Pe0nAvXuXH3vKVgtq3xWA 73PeC2xyh92c/5S/ILyz6QkI8SuZ0WvAVzgwxk1OLo8Na4KbyErvlYqF+KIDkn9cz22Q r0Yw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:message-id:date:subject:cc :to:from:ironport-sdr:dkim-signature; bh=Yd+10rWQW4FomCOSZo0CIB/1DXTJzRoRxlZdKjs/E8c=; b=bZSTxyDMljzxvTZKZscbC7m4K1x4o7etoDdYNYpJUXan5PFMG3L+UQRG1heKAzu7mM 9/cxIfrK6T8VrQ28Vnz1Ljiis4z/U/jtJ+J4v405q/kkhudrR5jL6LAltU4dRXBvTyff vHn2QEx6FqJ8unsS5C+NJ9MaZl7xBswmAj1iNL1xrAmspAtFg41qpV1j5AgOb8z3KV/f dUYkbjezShgn5CozhTyswLCAhtbGkz3mB9SAac72NZjlTZgNdFEpu3XmT+OKY2jujafd RozLxCju2cU5d5u2eQPtcbr7YWga09uHn8ERYyNmxq3SgyTdeLPKu3AYz2CNr0kYVYaM jW7g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@amazon.com header.s=amazon201209 header.b=mlLHsuMp; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=amazon.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id 24si6261225ejv.109.2020.05.03.21.45.29; Sun, 03 May 2020 21:45:52 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@amazon.com header.s=amazon201209 header.b=mlLHsuMp; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=amazon.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726897AbgEDENx (ORCPT + 99 others); Mon, 4 May 2020 00:13:53 -0400 Received: from smtp-fw-9102.amazon.com ([207.171.184.29]:23055 "EHLO smtp-fw-9102.amazon.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726441AbgEDENx (ORCPT ); Mon, 4 May 2020 00:13:53 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1588565632; x=1620101632; h=from:to:cc:subject:date:message-id:mime-version; bh=Yd+10rWQW4FomCOSZo0CIB/1DXTJzRoRxlZdKjs/E8c=; b=mlLHsuMppIyV1Q6h0CTBBwRNnMhujtCyUkHX5T6GysCgu+J90DCCy9L/ q/M1FY/2WAv455nxWCb1AmCw7XLYRurMqA/yLxr4ZSetlcdFyqMTYbkjW LZyLx4QH0Qu32G4EuJcbMfzNI2Yyg7B+rOVR/Dd57P9NorZESLBpraM3o c=; IronPort-SDR: 70cVZn55GgC9eivLNLsWmZ0NFCEq7C6mFhqPHlBnYFeEzZcmdq3aJGvmlXleNTYWeyjl/2aYtk WwHvRH/tJY5w== X-IronPort-AV: E=Sophos;i="5.73,350,1583193600"; d="scan'208";a="40970428" Received: from sea32-co-svc-lb4-vlan3.sea.corp.amazon.com (HELO email-inbound-relay-2b-5bdc5131.us-west-2.amazon.com) ([10.47.23.38]) by smtp-border-fw-out-9102.sea19.amazon.com with ESMTP; 04 May 2020 04:13:51 +0000 Received: from EX13MTAUWA001.ant.amazon.com (pdx4-ws-svc-p6-lb7-vlan3.pdx.amazon.com [10.170.41.166]) by email-inbound-relay-2b-5bdc5131.us-west-2.amazon.com (Postfix) with ESMTPS id 83491A18E1; Mon, 4 May 2020 04:13:50 +0000 (UTC) Received: from EX13D01UWA004.ant.amazon.com (10.43.160.99) by EX13MTAUWA001.ant.amazon.com (10.43.160.58) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 4 May 2020 04:13:50 +0000 Received: from EX13MTAUEE002.ant.amazon.com (10.43.62.24) by EX13d01UWA004.ant.amazon.com (10.43.160.99) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 4 May 2020 04:13:50 +0000 Received: from localhost (10.85.6.15) by mail-relay.amazon.com (10.43.62.224) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Mon, 4 May 2020 04:13:48 +0000 From: Balbir Singh To: , CC: , , , , , , , Balbir Singh Subject: [PATCH v5 0/6] Optionally flush L1D on context switch Date: Mon, 4 May 2020 14:13:37 +1000 Message-ID: <20200504041343.9651-1-sblbir@amazon.com> X-Mailer: git-send-email 2.17.1 MIME-Version: 1.0 Content-Type: text/plain Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Provide a mechanism to flush the L1D cache on context switch. The goal is to allow tasks that are paranoid due to the recent snoop assisted data sampling vulnerabilites, to flush their L1D on being switched out. This protects their data from being snooped or leaked via side channels after the task has context switched out. Changelog v5: - Based on Tom's recommendation, restrict the patches to Intel CPUs only (thomas.lendacky@amd.com) - Update reviewed-by tags based on v4. Changelog v4: - Refactor the L1D flushing code even further, pages are now allocated once and never freed. Simplify the exported functions. - Change the name prefixs to be more consistent (l1d_flush_*) - Refactoring of the code done in the spirit of the comments, prctl still requires arch bits for get/set L1D flush and ofcourse in the arch switch_mm bits flushing the L1D cache. Changelog v3: - Refactor the return value of what flush_l1d_cache_hw() returns - Refactor the code, so that the generic setup bits come first (patch 3 from previous posting is now patches 3 and 4) - Move from arch_prctl() to the prctl() interface as recommend in the reviews. Changelog v2: - Fix a miss of mutex_unlock (caught by Borislav Petkov ) - Add documentation about the changes (Josh Poimboeuf ) Changelog: - Refactor the code and reuse cond_ibpb() - code bits provided by tglx - Merge mm state tracking for ibpb and l1d flush - Rename TIF_L1D_FLUSH to TIF_SPEC_FLUSH_L1D Changelog RFC: - Reuse existing code for allocation and flush - Simplify the goto logic in the actual l1d_flush function - Optimize the code path with jump labels/static functions The previous version of these patches are posted at: https://lore.kernel.org/lkml/20200423140125.7332-1-sblbir@amazon.com/ Balbir Singh (6): arch/x86/kvm: Refactor l1d flush lifecycle management arch/x86/kvm: Refactor tlbflush and l1d flush arch/x86/mm: Refactor cond_ibpb() to support other use cases arch/x86/kvm: Refactor L1D flushing Optionally flush L1D on context switch Documentation: Add L1D flushing Documentation Documentation/admin-guide/hw-vuln/index.rst | 1 + .../admin-guide/hw-vuln/l1d_flush.rst | 40 ++++++ arch/x86/include/asm/cacheflush.h | 8 ++ arch/x86/include/asm/thread_info.h | 7 +- arch/x86/include/asm/tlbflush.h | 2 +- arch/x86/kernel/Makefile | 1 + arch/x86/kernel/l1d_flush.c | 120 ++++++++++++++++++ arch/x86/kvm/vmx/vmx.c | 62 +-------- arch/x86/mm/tlb.c | 83 +++++++++--- include/uapi/linux/prctl.h | 4 + kernel/sys.c | 20 +++ 11 files changed, 266 insertions(+), 82 deletions(-) create mode 100644 Documentation/admin-guide/hw-vuln/l1d_flush.rst create mode 100644 arch/x86/kernel/l1d_flush.c -- 2.17.1