Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp3288581pxk; Mon, 28 Sep 2020 13:19:42 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyIchNWW9GGxgH7sRRReY93J+Ehzg4OwYcrj2fpR2uEK4ZpYQcgW4ZmnsmgvItcnD+17d+/ X-Received: by 2002:a17:906:829a:: with SMTP id h26mr499282ejx.11.1601324382072; Mon, 28 Sep 2020 13:19:42 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1601324382; cv=none; d=google.com; s=arc-20160816; b=LIe/8Hcv1YjwwTjTFN2OAiA1OsjAeS5iNYEebd1FQst1V52lu23oiwXclUgxRV0Gk7 Yf8IP6UL0mIRaX2CzV9cKCu0MNGRgdu23bxTzybXBa3+L6z74yK4BXXztH+zmMB1CStI p1sHAKWgFi9TL8UQ74Upkn6awhfILR6xX4Lr/m5BTtX6lwWLNYaXqGRBi3K3cDBfOMOd tuG5Y4RcTreWI/m45OYvE/m5p2upF0qFd0nIhUA8PD9TL2ahhASs6ITjY46QrH4r1ZQv jrG4Ly5kraO8nhaPtDTWCRNl2fxb3XW1zgJkmWKlATOaW/29kLnpKyIjQKnqsJVmIU9Y fAQg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:ironport-sdr :ironport-sdr; bh=JYb9IAuMV0q2eDHxOlqrgrW34to+ln8w47uPynrLp7A=; b=Mnvl6emkD2mt6LWBFvToe9XxNrrWJY1+9mcU5l2n7fFSqLKOvHGV7hLZPwPwuKECls /ShM4bTY7AcqyF8iTezdVf2oGwvjG70e4jDOE4ZhFTOmbfGiHZ7VqDnWnqw+zz2LCxF3 8UDzozrhqeOZhO318J5agZgLOSKi/Vpb+UfZ5jB+/rAy858ZqzvYaDBv6xKVSt94ct0W eVsjkN+q/4MyCFr4sW8hsoTJJ+pNR2fIwhgNXG5f6GNy4XKI6pcDPvm4r228Z3I2TwPB EsllIN673s8Uig2Sm9XUCeH4jzSuEWs/Fvdrmo+Mmo6V00llA0BKqL/un6eDmpj9YH6F W8UA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id g17si1363062ejd.140.2020.09.28.13.19.19; Mon, 28 Sep 2020 13:19:42 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726827AbgI1USQ (ORCPT + 99 others); Mon, 28 Sep 2020 16:18:16 -0400 Received: from mga18.intel.com ([134.134.136.126]:45384 "EHLO mga18.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726328AbgI1USQ (ORCPT ); Mon, 28 Sep 2020 16:18:16 -0400 IronPort-SDR: he5hpQEjGBbU2ConpEwRz9vOQcW2crRbJc/8gvly4tUgjxkc0QEv1nKc2IaGiIPCYF7LgiZwBE emGFWl7GvTmw== X-IronPort-AV: E=McAfee;i="6000,8403,9758"; a="149831560" X-IronPort-AV: E=Sophos;i="5.77,315,1596524400"; d="scan'208";a="149831560" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga005.jf.intel.com ([10.7.209.41]) by orsmga106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 28 Sep 2020 13:18:15 -0700 IronPort-SDR: yCEYORjRSSyH25+eZkPWa0DC0aPy1qRfvOlbQBYHMk6M6CYhMU+zLAJcLZD+kX41qTvwXbzOlk xwPUv4MMXPKw== X-IronPort-AV: E=Sophos;i="5.77,315,1596524400"; d="scan'208";a="488745437" Received: from jlasecki-mobl2.ger.corp.intel.com (HELO localhost) ([10.252.49.78]) by orsmga005-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 28 Sep 2020 13:18:08 -0700 Date: Mon, 28 Sep 2020 23:18:06 +0300 From: Jarkko Sakkinen To: Dave Hansen Cc: Sean Christopherson , Haitao Huang , Andy Lutomirski , X86 ML , linux-sgx@vger.kernel.org, LKML , Linux-MM , Andrew Morton , Matthew Wilcox , Jethro Beekman , Darren Kenny , Andy Shevchenko , asapek@google.com, Borislav Petkov , "Xing, Cedric" , chenalexchen@google.com, Conrad Parker , cyhanish@google.com, "Huang, Haitao" , Josh Triplett , "Huang, Kai" , "Svahn, Kai" , Keith Moyer , Christian Ludloff , Neil Horman , Nathaniel McCallum , Patrick Uiterwijk , David Rientjes , Thomas Gleixner , yaozhangx@google.com Subject: Re: [PATCH v38 10/24] mm: Add vm_ops->mprotect() Message-ID: <20200928201806.GA3991@linux.intel.com> References: <20200924230501.GA20095@linux.intel.com> <20200925000052.GA20333@linux.intel.com> <32fc9df4-d4aa-6768-aa06-0035427b7535@intel.com> <20200925194304.GE31528@linux.intel.com> <230ce6da-7820-976f-f036-a261841d626f@intel.com> <20200928005347.GB6704@linux.intel.com> <6eca8490-d27d-25b8-da7c-df4f9a802e87@intel.com> <20200928161954.GB92669@linux.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Sep 28, 2020 at 09:48:10AM -0700, Dave Hansen wrote: > On 9/28/20 9:19 AM, Jarkko Sakkinen wrote: > > On Mon, Sep 28, 2020 at 07:04:38AM -0700, Dave Hansen wrote: > >> EMODPE is virtually irrelevant for this whole thing. The x86 PTE > >> permissions still specify the most restrictive permissions, which is > >> what matters the most. > >> > >> We care about the _worst_ the enclave can do, not what it imposes on > >> itself on top of that. > > > > AFAIK it is not, or what we are protecting against with this anyway > > then? > > > > Let say an LSM makes decision for the permissions based on origin. If we > > do not have this you can: > > > > 1. EMODPE > > 2. mprotect > > The thing that matters is that the enclave needs relaxed permissions > from the kernel. What it *ALSO* needs to do to *ITSELF* to get those > permissions is entirely irrelevant to the kernel. Lets try to find the root of misunderstanding, shall we? I'm assuming that your statement is encapsulated to: https://lore.kernel.org/linux-sgx/32fc9df4-d4aa-6768-aa06-0035427b7535@intel.com/ I do agree with this. And here is a direct quote: "It is also stashed off and then later compared with enclave PTEs to ensure that any future mmap()/mprotect() operations performed by the enclave creator or the enclave itself are consistent with the earlier declared permissions." Without the mprotect callback in place, by using EMODPE and mprotect, one could surpass the permisssions that we declared earlier. With the callback in place this is not possible. EMODPE can be freely used but mprotect() always caps the permissions. It enables us to *not care* about EMODPE. My problem is that I fully agree what you say in your description but disagree on that EMODPE should not be mentioned. > > There is no standard file format for enclaves. They are dynamically built > > and the ways how enclaves are deployed differ greatly. For an app you might > > want to have a simple static binary, but on the other hand for a container > > you might want to dynamically create the whole thing at run-time. Also, the > > existing ecosystem for SGX is already large, which would make the task very > > hard. > > I'm sorry I ever mentioned the file format. Please remove any mention > of it. It's irrelevant. This entire paragraph is irrelevant. Not sure if it is or not. It is merely to state that execve() path is possible. Perhaps should be toned down in some way. Should be like the a small remark at most. > > Finally, even if there was a standard format, one would still want a > > dynamic way to add pages to the enclave. One big reason for this is that > > enclaves have load time defined pages that represent entry points to the > > enclave. Each entry point can service one hardware thread at a time and > > you might want to run-time parametrize this depending on your environment. > > I also don't know what this paragraph has to do with the mprotect() > hook. Please remove it. Agreed. > > The consequence is that enclaves are best created with an ioctl API and the > > access control can be based only to the origin of the source file for the > > enclave data, i.e. on VMA file pointer and page permissions. For example, > > It's not strictly page permissions, though. It's actually VMA > permissions. The thing you copy from might be the zero page, and even > though it has Write=0 page permissions, apps are completely OK to write > to the address. This is the WRITE vs. MAY_WRITE semantic in the VMA flags. > > It's also not just about *files*. Anonymous memory might or might not > be a valid source for enclave data based on LSM hooks. Yes, this should be refined, agreed. Source can be either anonymous page or a file, I do of course understand that. > > this could be done with LSM hooks that are triggered in the appropriate > > ioctl's and they could make the access control decision based on this > > information. > > This "appropriate ioctl's" is not good changelog material. Please use > those bytes to convey actual information. > > ... this could be done with LSM hooks which restrict the source > of enclave page data > > I don't care that it's an ioctl(), really. What matters is what the > ioctl() does: copy data into enclave pages. Agreed. > > Unfortunately, there is ENCLS[EMODPE] that a running enclave can use to > > upgrade its permissions. If we do not limit mmap() and mprotect(), enclave > > could upgrade its permissions by using EMODPE followed by an appropriate > > mprotect() call. This would be completely hidden from the kernel. > > There's too much irrelevant info. > > I'll say it again: all that matters is that enclaves can legitimately, > safely, and securely have a need for the kernel to change page > permissions. That's *IT*. EMODPE just happens to be part of the > mechanism that makes these permission changes safe for enclaves. It's a > side show. Disagree on this. I wrote my statement about. Maybe it should not be driving argument but should be definitely part of the description. > > Add 'mprotect' hook to vm_ops, so that a callback can be implemeted for SGX > > that will ensure that {mmap, mprotect}() permissions do not surpass any of > > the original page permissions. This feature allows to maintain and refine > > sane access control for enclaves. > > Instead of "original", I'd stick to the "source" page nomenclature. > There are also "original" permissions with mprotect(). > > Also, it's literally OK for the enclave page permissions to surpass the > original (source) page permissions. That sentence is incorrect, or at > least misleadingly imprecise. Yes it is. It's fine to use EMODPE to upgrade the perms, and by having this hook, doing anything nasty with it is impossible. > > I'm mostly happy with this but am open for change suggestions. > > I wrote a pretty nice description of this. It was about 90% correct, > shorter, and conveyed more information. I'd suggest starting with that. I should have added a disclaimer that my description is not up to date. Just do not want to make anything final before this EMODPE discussion has some conclusion. I'm fine using your description as basis for the commit message if as long as these few details are settled. /Jarkko