Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751912AbbKJTrd (ORCPT ); Tue, 10 Nov 2015 14:47:33 -0500 Received: from mail-bn1on0137.outbound.protection.outlook.com ([157.56.110.137]:11520 "EHLO na01-bn1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751379AbbKJTrc (ORCPT ); Tue, 10 Nov 2015 14:47:32 -0500 Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=gratian.crisan@ni.com; References: <1447099142-10220-1-git-send-email-gratian.crisan@ni.com> <20151109220232.GO17308@twins.programming.kicks-ass.net> User-agent: mu4e 0.9.13; emacs 24.3.1 From: Gratian Crisan To: Josh Hunt CC: Peter Zijlstra , , Thomas Gleixner , LKML , Ingo Molnar , "H . Peter Anvin" , , Borislav Petkov , Josh Cartwright , Subject: Re: [RFC PATCH] tsc: synchronize TSCs on buggy Intel Xeon E5 CPUs with offset error In-Reply-To: Date: Tue, 10 Nov 2015 13:47:24 -0600 Message-ID: <87mvultz5f.fsf@spline.amer.corp.natinst.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [130.164.62.191] X-ClientProxiedBy: SN1PR0501CA0018.namprd05.prod.outlook.com (25.163.126.156) To BLUPR04MB854.namprd04.prod.outlook.com (10.255.189.150) X-Microsoft-Exchange-Diagnostics: 1;BLUPR04MB854;2:R8KtsQXgcYg5R/TVdQfHgKDuxV3RnmYHCrBmZsLqLGo9TNE613fAWYmwPtn77GuPiutUGUL8q5wCJqgtwLIOOdjVBev+XF2BG8OE/q5njqpmVJHqR9FccUQ5Ju/hwwj561vaggpfrv9fQ0P29SG7U+wB8oKuu8uF0/LBudS1Q/4=;3:a8f9Nbge25EjNTIfZtTqo9q1LO97758EgpgDn9m0EEMQQYpn9Yh15x45rfrDhvKGVof3X3/QP4YgYEcxPf0NBWpNbBkjf1YCq67XcHH+a7zqjeTRh8Nt0rt66lXIAatrd++9XMQPiKspU1nnvb7RbA==;25:kHIRAea2cxrl+b1IX7XKiZKDpk9lfSpQFFnNnHWv7am+8oQJz9yZLfBMe3fCtydvzTnsHz3ctv2wihi6NU05gkUHwkb9WaFjw3ASb+wewxwwyED0OKvARijJ9ZDfKqgjbxN/68tIgDYowpqAhTVPYKPBvk44DeNlM5ceGcX7x2kXmPjSw8eB0abTOXhtRtDAcy6+XKfYYsel8x6koEr3znE8biZ/VUOW+Q5S0o+yT+YxbwVMw0TNR8JxFOXXsmpK8fFQBqgyegdZx/N9ES40RQ== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR04MB854; X-Microsoft-Exchange-Diagnostics: 1;BLUPR04MB854;20:eeBwXzwCFQNsRw6cbSmbCE8jNyR9Log8j/kR33iUXHdglEI6yv+vL7ldteahpebgNQdpCQVKdop2co6hUR2jcVd6T+kHcBAL1ET0RWcQmgKg/XQDebHw804WR6VLavnMMN9vmkaIWGtKQNU3HTcm9FD0jy2abQBA6+k41ZrWoeu1y7PDFtx4L3d6SWfnxiTpd8vhRevzRP98szS+37mcZRWo6TBF+v3gCfQuS5mvPaI0TM44up3C9kCLZP10KPdlyv2RLF14d4b/lgB/DD/aIyL6OuCy4a5Ltxvq+TG3rBft86S4NFy9FR6Nr9nZGoOAmt10CCr3MoUZtaWxZYuOd2/Rq8NvxnVf0k90WqE8QBA+iSgfFalCfK/Aj2CeNmDUXybhhQSHgzrbavGLoAxmYL8SDhzi0E2mWfw5KXXqAfX0fxuVHdfc80VWRqo4zIhWvfJOmmpWKHJoTvRNR+O/FSxhwvDxgTkdlkrP3l/2ujzLdlpx89nQhrJy/8LsLIbwFZ9Zy0hFUPfs64ktEk9FIrCQQiQZZQ1ZNSnDfDv/R/vexDkn1XlD3brjYNzKcloQ/AjG42a/LEppQpmmzNqpl5OzKfF3HS7r6heBPcOogIs= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(145744241990776); X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(601004)(2401047)(5005006)(520078)(8121501046)(3002001)(10201501046);SRVR:BLUPR04MB854;BCL:0;PCL:0;RULEID:;SRVR:BLUPR04MB854; X-Microsoft-Exchange-Diagnostics: 1;BLUPR04MB854;4:FCVYcU4PrwtoS4bM9q5IaNYeYMFPr5IcbXZ5/PTQAnh44F75y3yr9EogOZdcRhr+vRomJL4inPXLs2jcjuopGU/8I+OAdDlKRKqSFpbxl8qyga89FYHimn7Cpl7VbdixoMzBRImWCy4L7iaG4vFGNxaE1afsiWeFP0TUKLhWns4l9g19BEp5P2kRbt+2E0DugMTg98Ah0/Dfje0MNQNU4YjZPN4RBbudbC+ihkrIWt17D3clT572liBowtMklbMhxU1Knyalk9getj1oxmMP2Br8ArFIuOhlBo0t/8vuGVnUHtHw+5I5n7N1chCiy+EB9WYfQtX98E1NR0IcwbU2Zfu7no3ixzUoATNaiMGmqU25mAZE1DZFPmUHpYlsnKic X-Forefront-PRVS: 07562C22DA X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(6009001)(85644002)(377454003)(199003)(24454002)(189002)(83506001)(5004730100002)(19580405001)(106356001)(86362001)(77096005)(42186005)(5007970100001)(1411001)(81156007)(19580395003)(105586002)(33646002)(5003940100001)(2950100001)(4001350100001)(97736004)(101416001)(110136002)(5001960100002)(40100003)(93886004)(48376002)(92566002)(54356999)(50986999)(76176999)(50466002)(189998001)(5008740100001)(66066001)(87976001)(47776003)(122386002);DIR:OUT;SFP:1102;SCL:1;SRVR:BLUPR04MB854;H:spline.amer.corp.natinst.com;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1;BLUPR04MB854;23:+0bQ/hv+UvjZhzcygk6N1PU1v+tZH54lTLtkrdcaHH?= =?us-ascii?Q?Lox23audvokoxpKhcCnkaWUE3cIa5XyE3H7yxtbkMvJXMutOF8HvTite4+Kq?= =?us-ascii?Q?Algpt5YuQxcshFnHWJ5oqGON5d8g7u3ZuGgkzMpWT57K+y8QS4g5RkqMyeGx?= =?us-ascii?Q?VnXjhWz4D0BGQXKZiphqgTyg0uyPldIIJRHdCo4A5e24ZRzLvkQispa8wG/z?= =?us-ascii?Q?dIKRjkG8uaggdTWwObN7mHCWcxcex3Bvvq+MvwjDl4cFN6xKTwIs5gB9A/y+?= =?us-ascii?Q?GrIwmqd6czQRv/NzexaYxQwrsKq2PzJOsm+ml909/GKMIx7DdOShVpv0c1Qc?= =?us-ascii?Q?mhuSnnUe9x813nlQWjDYceWVLQhTMKwIb4+pFlxM6IFaj3HDJPzRa6Z37yjW?= =?us-ascii?Q?81aiFn/9r0BMhTZFA7BT28td3ufxYAxMCbpwkXXUHP5zB38cYG+tRccISA+e?= =?us-ascii?Q?+mbKBHgzXpgR8ahByk8SSXMnZPhnthtKDvErvKAwLEVeuVos7siLdzfctjjB?= =?us-ascii?Q?1qmfARf9mn+9jj9P4l7fXfYwECeB2FsCaKSYN6qg/3Y4JA2UN4JFmuikWO2F?= =?us-ascii?Q?dQClFTSPKlpawxGn8oyNmZUibKrjJirC8pX3OQEyOpnmsDxcSyuGCRYsTl97?= =?us-ascii?Q?I4D2MN66Pm+vpvUqSW0PDGjDhCuL67PSTmskUIl51xgq95ZfQDfx7QDMP0YH?= =?us-ascii?Q?AAleFyF58/TU+nKPrvUwb1shJMsQT1Lb/ttXAFqvcomqnxkGlu9V5wWs1u+o?= =?us-ascii?Q?/UBN9dqS89chnmEeNmpo5LfRsb7tg5gBKq1O9plQ9NmmTXJVdJFQujINWuGQ?= =?us-ascii?Q?R+EEBkJ/mZcZsE06TgkZdxl+cZe9OMTjPOEzv7bGXVRZKiQeo6gZ4BC7284C?= =?us-ascii?Q?QmwV2vDgNNkBRPCIaAtvjEozTlxuagww6R9A1epN9CrCcCkBOA0EJylrYYt8?= =?us-ascii?Q?aLh3O+hQVVzDW4+QFC0SJJRe7yLUbVfMnipgLSYDZh6uIkj2k9S5W0fMTMmh?= =?us-ascii?Q?Mo4fhRUIjFnSM7S5erCcCNegkGhCFTF1WF7HOvTKtkCaliEXEmSkDGuHc0R+?= =?us-ascii?Q?pZq5nJJpZwz4wEia5pkHshlDGJwoXnq5EqFTnFnpySeMscqg=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1;BLUPR04MB854;5:sDEmzOdXLzVu0M+9V0fGlstUD5PHfAP08cT+jKbL3P1Qjge2haj2J5VGnKzWqXQ4WqFSPzzH8ockc8MF3egQcyP2Uycn8qi7+jGw6e73sZg0el3Dpj/yQAP3vdw2fu15uUL80lduwmceNy+cob7sKw==;24:8YGwPUvCJVsNYbvxJ6XnOlbKnFobREyDVF5bar9qRHGVF8WqxVHnA0WXgjUVjl4Jf1fOv/kxKdqn8OtT+fmOaOvX80716HaBdqUm87AIpQw=;20:SufpL2yCGX/YTqTzUPnZaueqLnJSDTqPFmOnel/BjOMJQqoAmTfvrlgPfnUnEIR6tv3rEipRrU4cyxbFCsbczQ== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: ni.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Nov 2015 19:47:29.4692 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR04MB854 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2430 Lines: 67 Josh Hunt writes: > On Tue, Nov 10, 2015 at 12:24 PM, Josh Hunt wrote: >> >> On Mon, Nov 9, 2015 at 4:02 PM, Peter Zijlstra wrote: >>> >>> On Mon, Nov 09, 2015 at 01:59:02PM -0600, gratian.crisan@ni.com wrote: >>> >>> > The Intel Xeon E5 processor family suffers from errata[1] BT81: >>> >>> > +#ifdef CONFIG_X86_TSC >>> > + /* >>> > + * Xeon E5 BT81 errata: TSC is not affected by warm reset. >>> > + * The TSC registers for CPUs other than CPU0 are not cleared by a warm >>> > + * reset resulting in a constant offset error. >>> > + */ >>> > + if ((c->x86 == 6) && (c->x86_model == 0x3f)) >>> > + set_cpu_bug(c, X86_BUG_TSC_OFFSET); >>> > +#endif >>> >>> That's hardly a family, that's just one, Haswell server. >> >> >> Are you actually observing this problem on this processor? >> >> The document you've referenced and the x86_model # above do not match up. The errata should be for Intel processors with an x86_model value of 0x2d by my calculations: >> >> Model: 1101b >> Extended Model: 0010b >> >> The calc from cpu_detect() is: >> if (c->x86 >= 0x6) >> c->x86_model += ((tfms >> 16) & 0xf) << 4; >> >> 0x3f is a different CPU. The processor I am seeing the issue on is (according to /proc/cpuinfo): vendor_id : GenuineIntel cpu family : 6 model : 63 model name : Intel(R) Xeon(R) CPU E5-2618L v3 @ 2.30GHz stepping : 2 microcode : 0x2e The observed behavior does seem to match BT81 errata i.e. the TSC does not get reset on warm reboots and it is otherwise stable. However you are correct in pointing out that the errata CPU model number does not match. My apologies, decoding the x86 cpu info/model numbers is a new area for me and the title of the errata made it sound like it applies to the whole Intel Xeon E5 family. It was only in trying to reply to Peter's comment that I've noticed the discrepancy with regards to the model number. I am currently trying to figure out if there is an errata that specifically lists Xeon E5-2618L with TSC problems on warm resets and I will re-work this. Sorry again for not double checking. -Gratian -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/