Subject: Re: [PATCH v3 0/9] Parallel CPU bringup for x86_64
To:     David Woodhouse <dwmw2@infradead.org>,
        Thomas Gleixner <tglx@linutronix.de>
Cc:     Ingo Molnar <mingo@redhat.com>, Borislav Petkov <bp@alien8.de>,
        Dave Hansen <dave.hansen@linux.intel.com>, x86@kernel.org,
        "H . Peter Anvin" <hpa@zytor.com>,
        Paolo Bonzini <pbonzini@redhat.com>,
        "Paul E . McKenney" <paulmck@kernel.org>,
        linux-kernel@vger.kernel.org, kvm@vger.kernel.org,
        rcu@vger.kernel.org, mimoja@mimoja.de, hewenliang4@huawei.com,
        hushiyuan@huawei.com, luolongjun@huawei.com, hejingxian@huawei.com
References: <20211215145633.5238-1-dwmw2@infradead.org>
From:   Tom Lendacky <thomas.lendacky@amd.com>
Message-ID: <761c1552-0ca0-403b-3461-8426198180d0@amd.com>
Date:   Thu, 16 Dec 2021 10:27:40 -0600
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101
 Thunderbird/78.14.0
In-Reply-To: <20211215145633.5238-1-dwmw2@infradead.org>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?cGhtUGxBR1g0S3pDNGJ2OTJ1NkNDRDhyenZHTFBvRlFDNEtNbTFXR1NrNXdy?=
 =?utf-8?B?ZVl2bGFmNitOM05ZVnd3MUdjRlVDR0pPZ2dIOUZrd2pleGZ0cGlZeHYzSjFl?=
 =?utf-8?B?YTUzcVlRZUlnRTBjbzBJVmpNanhWYVdJMmxySGVHb2tMNFhNaTVTWk5QanJU?=
 =?utf-8?B?c2JiQTc5cVpwci9oT3FrMlQ4TVJCMEdHOVo5Z1dEWVl6c1k1RUpWY2pZaTdp?=
 =?utf-8?B?MzluT3I2UXMwVUNTQ1E1SnBvY2Y1eGV2VTFQN3g5Q0xtRERoNHA4dTJTR3gr?=
 =?utf-8?B?bjV1WU03U01NK0pQWHlNVzNNbjB4RHV2Q0NiU003VE94OWt0MFBEM0JCaHN2?=
 =?utf-8?B?WVBTRU1TdlRtMUZMaStQNTFwWGlPb0VoTTROcUUwOThBbEtBTWcxb25GQ2xh?=
 =?utf-8?B?eUE2dkNwWnlGNDVGNFNNQ2xrK2FER2RkKzNmSldvbk9sbXgyK1JKMGZWUVA3?=
 =?utf-8?B?dk5RWlFqZkhyNXE1SHc2TVhTaVp0L1lvd3VtVmZ1c2xTOGJLTjcwYVpaVDVH?=
 =?utf-8?B?OEVpSjZrOUNudDZaakVWdHgyMEt6K25JVS9NcEJnM1dEdnRIUVpmSTRTdzd3?=
 =?utf-8?B?dXc4VncyQnUrWWRwa3JKUitTSWkzaGNUOTNFdTlQS3RudmwvVzVOcXd6M0lG?=
 =?utf-8?B?K1MwSGdvR21UVDdsbDdFOFQ1QmlJd2QzNUgyUjVUaHVTdnNDZ3ZsKzdZOWdn?=
 =?utf-8?B?QWVqV1dPcGlHZlkvZzg3U3MwR1d4a2h3ZGVYV09RT0xlR2Q4c09TdDI0V05V?=
 =?utf-8?B?RU5KTEErelhXZjVzckVRbUpzaGdJYW01Rk5pbUh3QThJOVJIYjZPT05Ub1Jl?=
 =?utf-8?B?NHVKYVBKSkRETGJqb05VQzZGQkdyMm9mS2hXNGYzQy9RY0tYWUQ2NnVFNklz?=
 =?utf-8?B?SFhTVWhSU0tHZmJYK1lFM25rb3ozRE43YWlQREw3WHV0OGFMbzJzajFqcFRO?=
 =?utf-8?B?d1ZlUFJIc1VvalR0bzllVm1wU1BNQ2tXdjdPTXA5cU9qLzFtSmNGY1U3ZHlt?=
 =?utf-8?B?Wkw1M2hDYkxqYXJDT21lYVRaNy9wb29VdWhid1JEV29MTDdyWDZ3bE4vVmZ5?=
 =?utf-8?B?aGZZbi9mTmVQLzdNdkZmSFZUb3g1bWpMbmcycUtnTmNvQm9UaVBGR0hxVEFp?=
 =?utf-8?B?QTY4ejVxSXU0RnBqZlEwckxXR0FhdHpFUUlMZ21IY1BPNkhrL3BsNHp6VEVj?=
 =?utf-8?B?RjBxamZCRG4yZ3Zvcm55dFI5RTFxU3pFRks3M2JGaDR3K2poeS85U3F0U1Jr?=
 =?utf-8?B?REVMNWE1V1QrQVk3Q2dzSm1mdnEvQzJOdi9iWmtyWkNQem91b29PUE1qYlpH?=
 =?utf-8?B?Vi8zNUJRZ1E5a2YwaFdXeFFnZVNNZS8zbmdZR3pyNllGdzdNV01rSFdkMEhu?=
 =?utf-8?B?bDF0QXVuOUI4NUZMRGFwdGFoV3dEMDYweDlBaVJpNmRDNlZHU0ZsRGFqSUJK?=
 =?utf-8?B?Q0RiREIrMzkvUHpZMlVwL0FIUFJDSHREb204c0RiMUdkMnlOKzZGYWxmNTBk?=
 =?utf-8?B?d1lMeFVhWURsdElhNWVVRXBEMjdscjZGUVliZFJIbCsxUlY4RW1WUUF4OEs2?=
 =?utf-8?B?Y0VuV1FrZjF6akM1YWxlZDNKczd1RzhodUVvd1pwcVBxT2ZNR1BqQ3V0TUpn?=
 =?utf-8?B?dXN6N0gvdWhiZlRqSzhjektTc3F3NjRCN1d4RXZRbXVJWVFmRGV2Z1JDWjZv?=
 =?utf-8?B?bjU4d3NGZjdyS1JJRTJWK2xJSGpXV3J0SHRtbmZrZWl6WWZ0Vi9sMit2OVNF?=
 =?utf-8?B?K3E5ZUNJNkpuM01oNVptNjRHRFRKUGFZSFZuSERRd0V2UnJjWG81cys0N0N0?=
 =?utf-8?B?TDJ0WWpxN21oZzhiYnNjTmtFOGFQUDlUWDAySzFjS21obXhRZ1U2ZGhMSldk?=
 =?utf-8?B?TUlIRW9lODN4SlFZcVlvSURNQzF2WERkOWNiOFdtWnd1bTR1Q21KazJKWnBs?=
 =?utf-8?B?Y3krYW1Bd2NjRHE4UkxpMm5ueHlkSjRXLy9TNjRicUVrZ1NUYk0zeGROT0V2?=
 =?utf-8?B?STBITGM0dE5UTlRJL0lJTDcrQ0VkNkFxb1hUOW1LNWRlTFMvWVZONVpJOE52?=
 =?utf-8?B?QXE5bGt6TlpnNDgrY3gvcXhiK2JIMW85ZzRQWVVtMmd1WDJmdXJoL2w3Ykhk?=
 =?utf-8?B?VUt5bC9LYi9MVmc4TnhPWjBCNENLYkJCUDRZQkRQYnRwZHhsMERMcldBc2tL?=
 =?utf-8?Q?lqCBnTwmtW7B1R8qMNTYOQY=3D?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 10dd47d3-3d66-4704-a329-08d9c0b0fc32
X-MS-Exchange-CrossTenant-AuthSource: DM4PR12MB5229.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Dec 2021 16:27:43.2667
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 53QM7m6gl1mYsl8NzKw6JzXcr9ysQbSRUACVtH2PN076MiD5UkLZvcxNTHTm6MBIaBwDGb9EUbjlB1GIKkJxMA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR12MB5135
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 12/15/21 8:56 AM, David Woodhouse wrote:
> Doing the INIT/SIPI/SIPI in parallel for all APs and *then* waiting for
> them shaves about 80% off the AP bringup time on a 96-thread socket
> Skylake box (EC2 c5.metal) — from about 500ms to 100ms.
> 
> There are more wins to be had with further parallelisation, but this is
> the simple part.

I applied this series and began booting a regular non-SEV guest and hit a 
failure at 39 vCPUs. No panic or warning, just a reset and OVMF was 
executing again. I'll try to debug what's going, but not sure how quickly 
I'll arrive at anything.

Thanks,
Tom