Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp1865865ybz; Thu, 23 Apr 2020 07:23:08 -0700 (PDT) X-Google-Smtp-Source: APiQypImyWlKQn4WPc/qw2fYrlpkh8dzFDicK3rxAK/EQ1woKtNWeogg+0uHSL3y3h/ykVXQr/2N X-Received: by 2002:a50:d308:: with SMTP id g8mr2860033edh.88.1587651788072; Thu, 23 Apr 2020 07:23:08 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1587651788; cv=none; d=google.com; s=arc-20160816; b=RpTtao5KjF2u89u7IZghAfJ0zkHI0dji6Q28w6g/FXZrM3HCQ1bjjlcEL1obTCGuR1 oBMai7rcwpb3luciDXxmaEXjXaXDMA+/8FLupOs/juzqvbmV408dv5yBuUlXTCajxG1X DePqgoS3Y385kP51hE0Nqmc5qki9zpxk9w0yXeuY5kyMiSZkKnFKtOo+9p1p9dJz+HSt KrbJinQg3xrzMnooYAy8sOdiCW8S3Z2JldZIcUhTr/QtQ0JpCvviMQAFJyJ6kaRz29/6 AK10pGAKIVTbBIj0oeSmo1ijBrQZlJho1iOGa31WggSkYvxmk8EiavsX0Ot7IDP90FQf Z71Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:message-id:date:subject:cc :to:from:ironport-sdr:dkim-signature; bh=GlXA8QYdbNJSlsP6IcydE++snKBjUDYw7I1a/xcR9BQ=; b=HgZdqP3LvEDEGm5hDAxIvanmhUX1WVbzC/7vIxd8+ZYEfpyAQT3qxcUwEO9SZd+kMc j6fE1NZjghMh88x27XwFy5OJrhk8KhRweyDbvOy9mlDNOYkyL2lbyt56ncsqCH3EpbAg F0glpMzdEEDiLgyiVahElyMvG+OFUMBgwYOKcyuK3vGO6pwcR/NlApXNqV/VApHXnC6R Fa6ZGEltDT++ZjgYR9k+lNAZ4UaNVgP0CBRn1xTcWiKyU2C+nGo7dVT2x5ClYwO9Ikfw wzUBSMii/kmMXs3kTgksctm0P0yiY0W/HOcSdvm44gycGVeLIoppC5a3E9PREoe0hNef AuCw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@amazon.com header.s=amazon201209 header.b=SL9CDGuh; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=amazon.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id p13si1284871ejb.235.2020.04.23.07.22.44; Thu, 23 Apr 2020 07:23:08 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@amazon.com header.s=amazon201209 header.b=SL9CDGuh; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=amazon.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728118AbgDWOBn (ORCPT + 99 others); Thu, 23 Apr 2020 10:01:43 -0400 Received: from smtp-fw-33001.amazon.com ([207.171.190.10]:6920 "EHLO smtp-fw-33001.amazon.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728014AbgDWOBk (ORCPT ); Thu, 23 Apr 2020 10:01:40 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1587650500; x=1619186500; h=from:to:cc:subject:date:message-id:mime-version; bh=GlXA8QYdbNJSlsP6IcydE++snKBjUDYw7I1a/xcR9BQ=; b=SL9CDGuhnkgfmezzVe1AzbI0SEkVp6TddNtqYvrBEwnc6tu1Ot/umMOE OZ4o4bPdAZ4BQCLqjmCZ33J6op7tGNNm0cJITVyuUpw3DdRpuClCRWNvx t++YBGmhrZLzV5apWS6BcIdTPss4z1/+ath7BIfIkNf2o0DRW+OddE5Gq k=; IronPort-SDR: Y2sPg+P8vTtT9NeP9g7kZM5zdL5sDKBNZw8fmnrzK0ZYUGM7Zi9GMEC4CuIiN8nDEo+Dcff9HW qo4BpHsi4MwQ== X-IronPort-AV: E=Sophos;i="5.73,307,1583193600"; d="scan'208";a="40451004" Received: from sea32-co-svc-lb4-vlan3.sea.corp.amazon.com (HELO email-inbound-relay-1d-38ae4ad2.us-east-1.amazon.com) ([10.47.23.38]) by smtp-border-fw-out-33001.sea14.amazon.com with ESMTP; 23 Apr 2020 14:01:37 +0000 Received: from EX13MTAUWB001.ant.amazon.com (iad55-ws-svc-p15-lb9-vlan3.iad.amazon.com [10.40.159.166]) by email-inbound-relay-1d-38ae4ad2.us-east-1.amazon.com (Postfix) with ESMTPS id 1055DA23D7; Thu, 23 Apr 2020 14:01:33 +0000 (UTC) Received: from EX13D01UWB003.ant.amazon.com (10.43.161.94) by EX13MTAUWB001.ant.amazon.com (10.43.161.249) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 23 Apr 2020 14:01:33 +0000 Received: from EX13MTAUEE002.ant.amazon.com (10.43.62.24) by EX13d01UWB003.ant.amazon.com (10.43.161.94) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 23 Apr 2020 14:01:33 +0000 Received: from localhost (10.143.207.46) by mail-relay.amazon.com (10.43.62.224) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Thu, 23 Apr 2020 14:01:31 +0000 From: Balbir Singh To: , CC: , , , , , , "Balbir Singh" Subject: [PATCH v4 0/6] Optionally flush L1D on context switch Date: Fri, 24 Apr 2020 00:01:19 +1000 Message-ID: <20200423140125.7332-1-sblbir@amazon.com> X-Mailer: git-send-email 2.17.1 MIME-Version: 1.0 Content-Type: text/plain Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Provide a mechanism to flush the L1D cache on context switch. The goal is to allow tasks that are paranoid due to the recent snoop assisted data sampling vulnerabilites, to flush their L1D on being switched out. This protects their data from being snooped or leaked via side channels after the task has context switched out. Changelog v4: - Refactor the L1D flushing code even further, pages are now allocated once and never freed. Simplify the exported functions. - Change the name prefixs to be more consistent (l1d_flush_*) - Refactoring of the code done in the spirit of the comments, prctl still requires arch bits for get/set L1D flush and ofcourse in the arch switch_mm bits flushing the L1D cache. Changelog v3: - Refactor the return value of what flush_l1d_cache_hw() returns - Refactor the code, so that the generic setup bits come first (patch 3 from previous posting is now patches 3 and 4) - Move from arch_prctl() to the prctl() interface as recommend in the reviews. Changelog v2: - Fix a miss of mutex_unlock (caught by Borislav Petkov ) - Add documentation about the changes (Josh Poimboeuf ) Changelog: - Refactor the code and reuse cond_ibpb() - code bits provided by tglx - Merge mm state tracking for ibpb and l1d flush - Rename TIF_L1D_FLUSH to TIF_SPEC_FLUSH_L1D Changelog RFC: - Reuse existing code for allocation and flush - Simplify the goto logic in the actual l1d_flush function - Optimize the code path with jump labels/static functions The previous version of these patches are posted at: https://lore.kernel.org/lkml/20200408090229.16467-1-sblbir@amazon.com/ Balbir Singh (6): arch/x86/kvm: Refactor l1d flush lifecycle management arch/x86/kvm: Refactor tlbflush and l1d flush arch/x86/mm: Refactor cond_ibpb() to support other use cases arch/x86/kvm: Refactor L1D flushing Optionally flush L1D on context switch Documentation: Add L1D flushing Documentation Documentation/admin-guide/hw-vuln/index.rst | 1 + .../admin-guide/hw-vuln/l1d_flush.rst | 40 ++++++ arch/x86/include/asm/cacheflush.h | 8 ++ arch/x86/include/asm/thread_info.h | 7 +- arch/x86/include/asm/tlbflush.h | 2 +- arch/x86/kernel/Makefile | 1 + arch/x86/kernel/l1d_flush.c | 117 ++++++++++++++++++ arch/x86/kvm/vmx/vmx.c | 62 +--------- arch/x86/mm/tlb.c | 83 +++++++++---- include/uapi/linux/prctl.h | 4 + kernel/sys.c | 20 +++ 11 files changed, 263 insertions(+), 82 deletions(-) create mode 100644 Documentation/admin-guide/hw-vuln/l1d_flush.rst create mode 100644 arch/x86/kernel/l1d_flush.c -- 2.17.1