Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <8d66f94f-9981-1456-9040-066e35c7ba1f@intel.com>
Date:   Fri, 2 Sep 2022 10:38:34 -0700
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Firefox/102.0 Thunderbird/102.2.0
Subject: Re: [PATCH v2 2/6] x86/sgx: Do not consider unsanitized pages an
 error
Content-Language: en-US
To:     Jarkko Sakkinen <jarkko@kernel.org>
CC:     <linux-sgx@vger.kernel.org>,
        Haitao Huang <haitao.huang@linux.intel.com>,
        Vijay Dhanraj <vijay.dhanraj@intel.com>,
        Dave Hansen <dave.hansen@linux.intel.com>,
        Paul Menzel <pmenzel@molgen.mpg.de>, <stable@vger.kernel.org>,
        Thomas Gleixner <tglx@linutronix.de>,
        Ingo Molnar <mingo@redhat.com>, Borislav Petkov <bp@alien8.de>,
        "maintainer:X86 ARCHITECTURE (32-BIT AND 64-BIT)" <x86@kernel.org>,
        "H. Peter Anvin" <hpa@zytor.com>,
        "open list:X86 ARCHITECTURE (32-BIT AND 64-BIT)" 
        <linux-kernel@vger.kernel.org>
References: <20220831173829.126661-1-jarkko@kernel.org>
 <20220831173829.126661-3-jarkko@kernel.org>
 <24906e57-461f-6c94-9e78-0d8507df01bb@intel.com>
 <YxEp8Ji+ukLBoNE+@kernel.org>
 <84b8eb06-7b77-675f-5bc8-292fe27dd2f5@intel.com>
 <YxFGykqMb+TD4L4l@kernel.org> <YxIEm4uHVvUY/rv6@kernel.org>
 <YxInD1m7rEnQ/yxW@kernel.org>
 <b418161b-2613-4bb9-9269-b4995de65794@intel.com>
 <YxIvr33xgjCbW6qu@kernel.org>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <YxIvr33xgjCbW6qu@kernel.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?bjVaaHZORFRaeGtURE1wYUN2MkJRSkRweHE3ZjduekhGNU9rVTVaL3BXNmtD?=
 =?utf-8?B?R2VCUzhhMVNqMmtkYmxPc0NGOEpvMkh4eEd2MVJZSVZyN2lOR3l2eDIyRXB3?=
 =?utf-8?B?aHowcEU1NHY2WVJzZzg2RklJbDU1OGJMd25zWWVaOFlWS1AyNkVrS0V3ZlZG?=
 =?utf-8?B?amlGcjB3SUpiQ241ZmoxV2NFM3B1S3ZwNVQ0eGgxSjNhRENVK1B5T2Z0N2x4?=
 =?utf-8?B?dEVDRTNPUHlmM29iY2RkeGhIbzNXdUdZMW0zR282RjNjc3o2OFd4czNja1JE?=
 =?utf-8?B?NDlzL0NmbTBHdFV0M2Uvd3Rvbm5SbUtrNWZVa1Uza0dRa2g0RjFSVEI1cmYw?=
 =?utf-8?B?TDlBeU1ENnhqTmRaaSt0TnJYQ1A4YnlsTzhFYXVJMGZLUGVCMnpIQ1BTMDNS?=
 =?utf-8?B?NmdxWk5nQ0hsSFRLOTVQcmRxUUxXS3p0WTJYZGxybmRJYUFxOHI5OERWUmRB?=
 =?utf-8?B?OC9XOE13M2ZpSmtmdDFiK3Y5dW5yS1B4a3N2b1FwRFlmTU0rb201VXZBUnA4?=
 =?utf-8?B?a1h2OXZhSkJ1eDhRd0MrMkx1b3czQTU4WmpNeEpQMCt3WktLSVROYXJ6dXEv?=
 =?utf-8?B?eUVCaWhhY1lJakp4cnNHd0E5SDJhcjJUZjZQSzlaMzF1TU1KdnNnRnpNVGFC?=
 =?utf-8?B?ck1Mcm8zY3laOXkvL2hwM2d6WHZXd25POUpHQkZuZ25EVWVpSUZOTldWSVd1?=
 =?utf-8?B?TUFqOWNTSUdoM3dXVFFWL3ZxOG9XKzdEdnE1ZXJsNHNzakw4YU9ha25Ca0ZN?=
 =?utf-8?B?cHM5azlTSUE5bUtud3ZlL21ad2FkSmEydkFiMjdKZllvczU3K2JaaFN2NDln?=
 =?utf-8?B?UXRXeFhtZHZQMlcvVFk4eUszZHhad2pUd2o3eXFLT1pveUhaTHk1L2ZtQTBt?=
 =?utf-8?B?OFlUWHFlckNqSHlBREg4RUc4cStvUXpyaUZRdXc5bWNRa3N3R3dCck52VlB6?=
 =?utf-8?B?OUs2L1cwMUptcEFmVExoc2MrSWhjeUV3WmtCQmsrYktHRmJXeVBWQmtmc3Zm?=
 =?utf-8?B?cWdpdTdqdEdrZ0FPNzBnVitud0pGMk1YUzhGMFBkL3p4Z1dNZVA3eFU2Uy8z?=
 =?utf-8?B?Tk9DT0dlLzYwVmQ2bjZDWlpoSXRac3NXci9rSzZ0a2xOVUxxc2hXaUd0SmlG?=
 =?utf-8?B?R2V6dkhzMStlSUsya2VTOTRrT3NzUkd0bGJCOXRzRS94RkVBNUFlYThhMkxo?=
 =?utf-8?B?a1ZYVjVDeEVjdGZaR1ZIWllMeFk4SFErV21XeFJYUkRyRE15eEVBQnRZQWx0?=
 =?utf-8?B?OTZJSjIrZ1RnWk9VK0l2S0poYlZrWVhlbXJyMGFMTlJLak10NEpZVTdBTGxE?=
 =?utf-8?B?UkNac2Fsc25DWWkvWVlVdWhvRHZRcG91M21YUmlianlFc1JscGdSakFpcTJY?=
 =?utf-8?B?OFg2Yk95M09JWi9zSW9JbDhmOWZGSU85K0h5L1RHdUN2K0xhL3N4aGJhcWxz?=
 =?utf-8?B?ZVE1eUhVZHhUY2lNZUc0U3JhRkVZcyt5SnJtL1dHcDhNVDRxK0p5TWF6Qktv?=
 =?utf-8?B?aW9nOFl2emFqNHpMTDk2bm1pZWtFSDNoL3dQbm1BTEwrM0xaTThUcno2cURL?=
 =?utf-8?B?Tk5CZVN3ZU14TUlmOGl0czRRNzJFaE85K1B5VXJ3VEMzQzVXRlRJZitOeWxS?=
 =?utf-8?B?Y2lvSmxmSXB4QU05dHc4aktyY1BKaFp4MUs1SnI3UlRXRGI3QURaYjdZTzhF?=
 =?utf-8?B?b21na3BKWm91RzNZbC80bEh0SGNQZG5XMTJqZ0VnUTN3a3U1dVZwTzhreDJU?=
 =?utf-8?B?SmFhY01WaFlBLzNjb01Fa0F3cDVjVVJzeHNoOTByNDd4MEhLWkU2T0IxbUVF?=
 =?utf-8?B?bXZvLzFPY05uejBsaVNPZFlRN2RPZkdZQlhIdENZakZ6K3ZaUTlUMWxzbnFT?=
 =?utf-8?B?bkUrcU9tVjM2MDE2L3FvSWpTYUpBZW9pS3QyNnNZaDdaTWo3VStRdkswMGZX?=
 =?utf-8?B?UVBGby9tNmdiWUgyTTBRbEg5N1RSZCtodnhia3g3anZBVHRnT3NLU2w5YzBG?=
 =?utf-8?B?czQwM1J4NzZPNnJTc0gwZ0FOTlNDeXVBSFQxcUFJNXVlb1dPT3VSL2twVHd2?=
 =?utf-8?B?RGp5a2hpblovVFQ4c0lhLzNsRVBybFBQb0RlWTU0UjVLZmJDV2xMMkFXWktx?=
 =?utf-8?B?WHo3MnNPU0NnTE1RZFpEekc0RHRpang4SVpuUnljTlkzZXhwS2k4VWEyUzFQ?=
 =?utf-8?B?MWc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 98d3c89e-3f46-4bfa-6ecc-08da8d0a015a
X-MS-Exchange-CrossTenant-AuthSource: CY4PR11MB1862.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Sep 2022 17:38:53.9645
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: dpsDYl9GCducMw3RJ752zbYigp12Lh2HI45UbkZEAgj9FaP/D2S4gx9lbIhWz8TL0QC+H/+r3QSH/nMYUCkWD8TSPrv3df9gjfFtNmcf9ik=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY5PR11MB6185
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,
        RCVD_IN_DNSWL_MED,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hi Jarkko,

On 9/2/2022 9:30 AM, Jarkko Sakkinen wrote:
> On Fri, Sep 02, 2022 at 09:08:23AM -0700, Reinette Chatre wrote:
>> Hi Jarkko,
>>
>> On 9/2/2022 8:53 AM, Jarkko Sakkinen wrote:
>>> On Fri, Sep 02, 2022 at 04:26:51PM +0300, Jarkko Sakkinen wrote:
>>>> +	if (ret)
>>>> +		pr_err("%ld unsanitized pages\n", left_dirty);
>>>
>>> Yeah, I know, should be 'left_dirty'. I just quickly drafted
>>> the patch for the email.
>>>
>>
>> No problem - you did mention that it was an informal patch.
>>
>> (btw ... also watch out for the long local parameter returned
>> as an unsigned long and the signed vs unsigned printing
>> format string.) I also continue to recommend that you trim
> 
> Point taken.
> 
>> that backtrace ... this patch is heading to x86 area where
>> this is required.
> 
> Should I just cut the whole stack trace, and leave the
> part before it?

The trace is printed because of a WARN_ON() in the code.
I do not think there is anything very helpful in that trace.
I think the only helpful parts are the WARN itself that includes
the line number and then information on which kernel it was
encountered on.

How about something like (please note the FIXME within):

"
Paul reported the following WARN while running kernel vFIXME:
  WARNING: CPU: 6 PID: 83 at arch/x86/kernel/cpu/sgx/main.c:401 ksgxd+0x1b7/0x1d0

This is the WARN_ON() within ksgxd() that is triggered when
sgx_dirty_page_list (the list containing unsanitized pages) is non-empty.

In sgx_init(), if misc_register() fails or misc_register() succeeds but
neither sgx_drv_init() nor sgx_vepc_init() succeeds, then ksgxd will be
prematurely stopped. This may leave some unsanitized pages, which does
not matter, because SGX will be disabled for the whole power cycle.

Ultimately this can crash the kernel, if the following is set:

	/proc/sys/kernel/panic_on_warn

In premature stop, print nothing, as the number is by practical means a
random number. Otherwise, it is an indicator of a bug in the driver, and
therefore print the number of unsanitized pages with pr_err().
"

Reinette