Received: by 2002:ab2:6816:0:b0:1f9:5764:f03e with SMTP id t22csp1094100lqo; Fri, 17 May 2024 10:24:16 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCWTRL4F5KxROh6a3UmUdM5PjXhnMDHYEXSZ6UODznOaVxWVYcLw/eyDXYJPyIX+U58neKFATQ5FlsoM+lTjc2hUpsKOonBylTFOAK1HBA== X-Google-Smtp-Source: AGHT+IGmLk+DI4jVu4BmoaiSgFbcUB6Ko3KG91VWorlBh1U32WaSkbF7gp8Rc+Ab10ZQRPstRWbS X-Received: by 2002:a05:6358:57a2:b0:18e:b042:3257 with SMTP id e5c5f4694b2df-193bb64984amr2199887855d.16.1715966656385; Fri, 17 May 2024 10:24:16 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1715966656; cv=pass; d=google.com; s=arc-20160816; b=RyDIA8RzcQpHoiUEtw7GMR33j9rgEtmYmOoRbpe82HtcteaIVLO6M3LxsG5KerJg8a FZvdwd+vEJU/SCeFpvCSRoMprLIvCh6jOkI9aa5dcEfgfdRzrJySp33XFpVpx+GMCNxG GULKjeCy1GszLZmsy9pI3/ULWhL2CxZnf1XDzEecpoRlALufaTTwimrhwqJ53un04Gh2 2TfGoCA3pIlaLlWyxcZsw/ClA3A2Po2YlF2IExKXfzPSEBlPoB6HYxk6IYA/wFAMspqn ixKY2HWYJL5tlPx8VNXgBObgs6AJ4IFPHuqytMmazHQfOlpFvo9TY8yIPUyqBydcjgOT Roog== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:autocrypt:content-language :from:references:cc:to:subject:user-agent:mime-version :list-unsubscribe:list-subscribe:list-id:precedence:date:message-id :dkim-signature; bh=5D/BuODvgTSHtgH5EheY9AS/OUK3ElIrLovrgvlOOfk=; fh=A7rRfcMuPiw3TBqBbCFyMtcv+/eir6WMQsVomUbJCUM=; b=Xy4kpkv5LLhhzpF+sJxXoqTersev4k2aM9iM10i/wvSQINnb8EeygRgwEVQiilqIgB g5PlULL+fVJVrNMNJNWcKwy7cPL5c921vpHsU4o5jJH5Dk/bg7JixoLc4C+wOkGMz7a0 dQvM2rv0OGEXy7zfkZD5PH31ZZusDbKn7D9yXbPZ9RyaR6PGwbkiqxyf17MHYyksh48L wG4WzQpgNZJ4deoMf7MAywOAO9zIIJOAr/YwpTfgA+wiPIxAgwHW0bCPWhRdOf7Wy9oT YmdE8b2oZUhQJlIzGvqvOkiALGCVt8N82t84wjKlKQW2jspCxpQgd/ouLoqPxkYJ4G90 TYPA==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b="WJ/eK2j8"; arc=pass (i=1 spf=pass spfdomain=intel.com dkim=pass dkdomain=intel.com dmarc=pass fromdomain=intel.com); spf=pass (google.com: domain of linux-kernel+bounces-182402-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-182402-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [147.75.48.161]) by mx.google.com with ESMTPS id 41be03b00d2f7-6596fde8f2csi3882648a12.360.2024.05.17.10.24.15 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 17 May 2024 10:24:16 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-182402-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b="WJ/eK2j8"; arc=pass (i=1 spf=pass spfdomain=intel.com dkim=pass dkdomain=intel.com dmarc=pass fromdomain=intel.com); spf=pass (google.com: domain of linux-kernel+bounces-182402-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-182402-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id E9EAAB23470 for ; Fri, 17 May 2024 17:23:36 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 3FB6713E419; Fri, 17 May 2024 17:22:36 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b="WJ/eK2j8" Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id E548013D89F; Fri, 17 May 2024 17:22:33 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=198.175.65.17 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1715966555; cv=none; b=elEPUTocQdV8cEN7sNKRbDrSeEtL3GuASFmgKiCMu+lJ5rOrQsdkQ2L0qYsAkAyENkzGxJ/k9OiHuKmFT8P/u5+V+ElFguzP6P9PGVa2McWAuOMdUmJW1uF538X7Fo8PB1kdx9CXJlzV8JQBFtanHlBVzmq+ol4UyVp6JcXxh1k= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1715966555; c=relaxed/simple; bh=NNIjgyuP1PQ3CYL1MR18HK3hcSvljejHJw+vczw4ZQY=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=aRl9buO/w1RFlavvx4EgVYzu8RbVJO1t3VyFndKo7txg5DrqEae8gPjvmcZ9lltszq+bn/ggHfwDEzIpiJ1kxiHx3I+u31I44fgFoLG0RpmVtBmhVmGKBvPjuIvXXaic6WJDtVFm/y0FP8gG0v0csY6NXdpGR5lhq8wbwYTfUVk= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com; spf=pass smtp.mailfrom=intel.com; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b=WJ/eK2j8; arc=none smtp.client-ip=198.175.65.17 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=intel.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1715966554; x=1747502554; h=message-id:date:mime-version:subject:to:cc:references: from:in-reply-to:content-transfer-encoding; bh=NNIjgyuP1PQ3CYL1MR18HK3hcSvljejHJw+vczw4ZQY=; b=WJ/eK2j8TexWkDrf6Y64U9sP2oWkk7hjxre58fEqgnMdG9RiAFyoCHnC QKPcIYripFTwEIMI9YjSMf1AUz6pQfyuhb+nK+Aj6X0Ztfi7AOa/OouOi nq000ZbxYJJgYsHB9RAMAUdnW1ZbqArWLgZuJAc3PikgACOGCLuKygLMT b7zyRxoZ5sYiM/oEeYeA16FD0E8Sedil2pd8pfRY88ZO7Zgp5uk/4XHQT Kzi2geCF05AcYtfpJC2D1PXqBKaxDDjSoJ2aQ2BgvYCwdMbgm7Utp+vEm RWhBAU2BhYUrU3I+hrL418SKyLRY8bJa+yNaYUc37hMlsLkZzSj3FXc28 w==; X-CSE-ConnectionGUID: xqUV+8QwRI2kvCDndR+Mog== X-CSE-MsgGUID: yOAty1MsRAquHTWaeBv2ZA== X-IronPort-AV: E=McAfee;i="6600,9927,11075"; a="12281942" X-IronPort-AV: E=Sophos;i="6.08,168,1712646000"; d="scan'208";a="12281942" Received: from orviesa009.jf.intel.com ([10.64.159.149]) by orvoesa109.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 17 May 2024 10:22:33 -0700 X-CSE-ConnectionGUID: qjnkzHB8Ry6MuM1fVrxMpA== X-CSE-MsgGUID: fzK0a9mjSI6DwKHRemDpgA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.08,168,1712646000"; d="scan'208";a="32011297" Received: from kinlongk-mobl1.amr.corp.intel.com (HELO [10.125.108.204]) ([10.125.108.204]) by orviesa009-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 17 May 2024 10:22:34 -0700 Message-ID: <35086bb6-ee11-4ac6-b8ba-5fab20065b54@intel.com> Date: Fri, 17 May 2024 10:22:32 -0700 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [regression] suspend stress test stalls within 30 minutes To: Kalle Valo , Borislav Petkov Cc: Pawan Gupta , Thomas Gleixner , Ingo Molnar , Dave Hansen , "Rafael J. Wysocki" , x86@kernel.org, linux-pm@vger.kernel.org, linux-kernel@vger.kernel.org, regressions@lists.linux.dev, Jeff Johnson References: <87o79cjjik.fsf@kernel.org> <20240511184847.GCZj-9j2sh1Akpt9iS@fat_crate.local> <20240511184945.GDZj-9yaOEWqf1ng8u@fat_crate.local> <87h6f4jdrq.fsf@kernel.org> <878r0djxgc.fsf@kernel.org> <874jb0jzx5.fsf@kernel.org> <20240514160555.GCZkOL41oB3hBt45eO@fat_crate.local> <87msoofjg1.fsf@kernel.org> From: Dave Hansen Content-Language: en-US Autocrypt: addr=dave.hansen@intel.com; keydata= xsFNBE6HMP0BEADIMA3XYkQfF3dwHlj58Yjsc4E5y5G67cfbt8dvaUq2fx1lR0K9h1bOI6fC oAiUXvGAOxPDsB/P6UEOISPpLl5IuYsSwAeZGkdQ5g6m1xq7AlDJQZddhr/1DC/nMVa/2BoY 2UnKuZuSBu7lgOE193+7Uks3416N2hTkyKUSNkduyoZ9F5twiBhxPJwPtn/wnch6n5RsoXsb ygOEDxLEsSk/7eyFycjE+btUtAWZtx+HseyaGfqkZK0Z9bT1lsaHecmB203xShwCPT49Blxz VOab8668QpaEOdLGhtvrVYVK7x4skyT3nGWcgDCl5/Vp3TWA4K+IofwvXzX2ON/Mj7aQwf5W iC+3nWC7q0uxKwwsddJ0Nu+dpA/UORQWa1NiAftEoSpk5+nUUi0WE+5DRm0H+TXKBWMGNCFn c6+EKg5zQaa8KqymHcOrSXNPmzJuXvDQ8uj2J8XuzCZfK4uy1+YdIr0yyEMI7mdh4KX50LO1 pmowEqDh7dLShTOif/7UtQYrzYq9cPnjU2ZW4qd5Qz2joSGTG9eCXLz5PRe5SqHxv6ljk8mb ApNuY7bOXO/A7T2j5RwXIlcmssqIjBcxsRRoIbpCwWWGjkYjzYCjgsNFL6rt4OL11OUF37wL QcTl7fbCGv53KfKPdYD5hcbguLKi/aCccJK18ZwNjFhqr4MliQARAQABzUVEYXZpZCBDaHJp c3RvcGhlciBIYW5zZW4gKEludGVsIFdvcmsgQWRkcmVzcykgPGRhdmUuaGFuc2VuQGludGVs LmNvbT7CwXgEEwECACIFAlQ+9J0CGwMGCwkIBwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEGg1 lTBwyZKwLZUP/0dnbhDc229u2u6WtK1s1cSd9WsflGXGagkR6liJ4um3XCfYWDHvIdkHYC1t MNcVHFBwmQkawxsYvgO8kXT3SaFZe4ISfB4K4CL2qp4JO+nJdlFUbZI7cz/Td9z8nHjMcWYF IQuTsWOLs/LBMTs+ANumibtw6UkiGVD3dfHJAOPNApjVr+M0P/lVmTeP8w0uVcd2syiaU5jB aht9CYATn+ytFGWZnBEEQFnqcibIaOrmoBLu2b3fKJEd8Jp7NHDSIdrvrMjYynmc6sZKUqH2 I1qOevaa8jUg7wlLJAWGfIqnu85kkqrVOkbNbk4TPub7VOqA6qG5GCNEIv6ZY7HLYd/vAkVY E8Plzq/NwLAuOWxvGrOl7OPuwVeR4hBDfcrNb990MFPpjGgACzAZyjdmYoMu8j3/MAEW4P0z F5+EYJAOZ+z212y1pchNNauehORXgjrNKsZwxwKpPY9qb84E3O9KYpwfATsqOoQ6tTgr+1BR CCwP712H+E9U5HJ0iibN/CDZFVPL1bRerHziuwuQuvE0qWg0+0SChFe9oq0KAwEkVs6ZDMB2 P16MieEEQ6StQRlvy2YBv80L1TMl3T90Bo1UUn6ARXEpcbFE0/aORH/jEXcRteb+vuik5UGY 5TsyLYdPur3TXm7XDBdmmyQVJjnJKYK9AQxj95KlXLVO38lczsFNBFRjzmoBEACyAxbvUEhd GDGNg0JhDdezyTdN8C9BFsdxyTLnSH31NRiyp1QtuxvcqGZjb2trDVuCbIzRrgMZLVgo3upr MIOx1CXEgmn23Zhh0EpdVHM8IKx9Z7V0r+rrpRWFE8/wQZngKYVi49PGoZj50ZEifEJ5qn/H Nsp2+Y+bTUjDdgWMATg9DiFMyv8fvoqgNsNyrrZTnSgoLzdxr89FGHZCoSoAK8gfgFHuO54B lI8QOfPDG9WDPJ66HCodjTlBEr/Cwq6GruxS5i2Y33YVqxvFvDa1tUtl+iJ2SWKS9kCai2DR 3BwVONJEYSDQaven/EHMlY1q8Vln3lGPsS11vSUK3QcNJjmrgYxH5KsVsf6PNRj9mp8Z1kIG qjRx08+nnyStWC0gZH6NrYyS9rpqH3j+hA2WcI7De51L4Rv9pFwzp161mvtc6eC/GxaiUGuH BNAVP0PY0fqvIC68p3rLIAW3f97uv4ce2RSQ7LbsPsimOeCo/5vgS6YQsj83E+AipPr09Caj 0hloj+hFoqiticNpmsxdWKoOsV0PftcQvBCCYuhKbZV9s5hjt9qn8CE86A5g5KqDf83Fxqm/ vXKgHNFHE5zgXGZnrmaf6resQzbvJHO0Fb0CcIohzrpPaL3YepcLDoCCgElGMGQjdCcSQ+Ci FCRl0Bvyj1YZUql+ZkptgGjikQARAQABwsFfBBgBAgAJBQJUY85qAhsMAAoJEGg1lTBwyZKw l4IQAIKHs/9po4spZDFyfDjunimEhVHqlUt7ggR1Hsl/tkvTSze8pI1P6dGp2XW6AnH1iayn yRcoyT0ZJ+Zmm4xAH1zqKjWplzqdb/dO28qk0bPso8+1oPO8oDhLm1+tY+cOvufXkBTm+whm +AyNTjaCRt6aSMnA/QHVGSJ8grrTJCoACVNhnXg/R0g90g8iV8Q+IBZyDkG0tBThaDdw1B2l asInUTeb9EiVfL/Zjdg5VWiF9LL7iS+9hTeVdR09vThQ/DhVbCNxVk+DtyBHsjOKifrVsYep WpRGBIAu3bK8eXtyvrw1igWTNs2wazJ71+0z2jMzbclKAyRHKU9JdN6Hkkgr2nPb561yjcB8 sIq1pFXKyO+nKy6SZYxOvHxCcjk2fkw6UmPU6/j/nQlj2lfOAgNVKuDLothIxzi8pndB8Jju KktE5HJqUUMXePkAYIxEQ0mMc8Po7tuXdejgPMwgP7x65xtfEqI0RuzbUioFltsp1jUaRwQZ MTsCeQDdjpgHsj+P2ZDeEKCbma4m6Ez/YWs4+zDm1X8uZDkZcfQlD9NldbKDJEXLIjYWo1PH hYepSffIWPyvBMBTW2W5FRjJ4vLRrJSUoEfJuPQ3vW9Y73foyo/qFoURHO48AinGPZ7PC7TF vUaNOTjKedrqHkaOcqB185ahG2had0xnFsDPlx5y In-Reply-To: <87msoofjg1.fsf@kernel.org> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit On 5/17/24 10:15, Kalle Valo wrote: > Borislav Petkov writes: >> There might be some #GP or so in the logs in case we've managed to f*ck >> up microcode application which emulates that IBRS MSR bit and the >> actual toggling or so when suspending... > So the weird part is that when the bug happens (ie. suspend stalls) I > can access the box normally using ssh and I don't see anything special > in dmesg. Below is a full copy of dmesg output after the suspend > stalled. Do note that I copied this dmesg before I updated microcode so > it will still show the old microcode version. > > Let me know if you need more info. Kalle, could you remind us what we're seeing here? Does this show 30 working rtcwake tests followed by a failure at "rtcwake test 31" where the system failed to suspend?