Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754237AbbKQRD5 (ORCPT ); Tue, 17 Nov 2015 12:03:57 -0500 Received: from mail-by2on0111.outbound.protection.outlook.com ([207.46.100.111]:50816 "EHLO na01-by2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1753649AbbKQRDz (ORCPT ); Tue, 17 Nov 2015 12:03:55 -0500 X-Greylist: delayed 875 seconds by postgrey-1.27 at vger.kernel.org; Tue, 17 Nov 2015 12:03:55 EST Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=gratian.crisan@ni.com; References: <1447099142-10220-1-git-send-email-gratian.crisan@ni.com> <20151109220232.GO17308@twins.programming.kicks-ass.net> <56465279.2010502@intel.com> User-agent: mu4e 0.9.13; emacs 24.3.1 From: Gratian Crisan To: Dave Hansen CC: Peter Zijlstra , , Thomas Gleixner , , Ingo Molnar , "H . Peter Anvin" , , Borislav Petkov , Josh Cartwright , Subject: Re: [RFC PATCH] tsc: synchronize TSCs on buggy Intel Xeon E5 CPUs with offset error In-Reply-To: <56465279.2010502@intel.com> Date: Tue, 17 Nov 2015 10:49:13 -0600 Message-ID: <87poz8fu5y.fsf@spline.amer.corp.natinst.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [130.164.62.191] X-ClientProxiedBy: BLUPR0301CA0018.namprd03.prod.outlook.com (25.162.113.156) To BL2PR04MB852.namprd04.prod.outlook.com (10.242.197.16) X-Microsoft-Exchange-Diagnostics: 1;BL2PR04MB852;2:DNKDvJa9u1kG6+YDEvR7Qp27tsF8o/7e6z8fek3zUyoJ5GRyGhUClyLLLAIM51rigivF8RhTUcVP+nyANfonP4LFrIbbVs3La2jgw7POKAwvkGnw+17NTcmB1PELL3NQE9SopZS+6ulotkoVULuQTp6hoUE4esRiYCNKguTwEwI=;3:1Qc1rvBVUDWG0fP8Xd1TA0eOlgqFZq2HuT99mZXou18OU/mo/wrpOfb7yCw8+xOSbJ+k6W3g1I3srmCtj1rZTjnIvLYrz1k2dMH3nxHNCgGPR4NUTGtPjnMbr3L8hs4HHcaXTFf1vQS9d9ffukOFjQ==;25:xQhTZy22q8AOgCNcP0cOnVkCJK1yoyasCm7P3XsVP5Qcl8XJBQew1PkQ62OATAHBX+QzWggUb87vxOJtQB9QEzHy2O6dSD9YAxaClK1icI6xecsw47uZHb1/DBPVBgDDu9TkN+ZiVmQenliF6Fyu4j7BC5cZTbv5zcMsldch3a7NycCyC1VKWyea1JI4qVHFG6yJaWQonLNLeR0q5yhEMbQvt+LpA2kMMsApuIZzMghFS0VNPUubRKk+eq/ikEAXGesXv57qWXH3LZxLTGvENQ== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BL2PR04MB852; X-Microsoft-Exchange-Diagnostics: 1;BL2PR04MB852;20:aQwTNdVJTyAyWqVs69lcP3GEUTD9Hg53ukXMKsDM+e8K6WsGXBkpooW+qoYZ9vykGDVpO2IKHZoiOJpGxUSZCh1Boy7cth6d3a3RIFYPMBH5aI43KnQLT9ZuyhOo7DWgZJLIpB+Vx3vh8dpR23g+33gTJ75XjPuAOubPM7lX0f0Rk/QL/m6yrU4tIkR8pMi8Cjue26yMxcdu1Be2dNsx0miGEWt0DS2AoX7z+Cu+GbNfUlAmBx93nU+xVNuWf4GlrMM3W9kErHgWrAoABJtaRf8cOCtcWf4XJbKz+KRLa2XWQRrKNRNYbSSbQ9knGuAOzaP4IGGbYlpWyxALJj83aZY34QnZcR4Bp5jz3vSHEFpif9axRRAPr9PfWezeHBotSpv2If1Jt5QDaupxB3NzzlVnS+AkvWTIz+3lUY/ubPt+OUj4t0NYET605308RUK95kVEGWOwaguHYFnyg//t8HnsD4cJr2T9qfoDP3PaUWZch2la7VMoODpaRX/J2eP6AN7vBP5eF493qOVdKF2w9UmYpkz4jrY3/aumAjcIfXamLb8/1IrB9xNpTZosNGiOmcnuevLI7CuA8r4tSQiGxHk3OQ3M1+6UWSgYXOd6GgE= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(601004)(2401047)(8121501046)(5005006)(520078)(3002001)(10201501046);SRVR:BL2PR04MB852;BCL:0;PCL:0;RULEID:;SRVR:BL2PR04MB852; X-Microsoft-Exchange-Diagnostics: 1;BL2PR04MB852;4:MoyvkiOFRpRUNp8AdDx/4VG6YfLggo9Tfktw6g2VechqkvdL8PiJVlMy5SHhCKm6/Il02Og4owuxEiK+ze6JoWZokqs0X5/Nt3EFohfKB7AzvywKr39DAjWJM0bR++PVwUAS5xSD1PVs1huhNqoNlMvW9o+kBh7tR+nbvViDx2zcNxW9V0rcwui35/xDMkV0dGeA//663NrXuA+czIggTp7XcVzFlF9/GrixviqWCAv5YutS+VLWkJLCJvr7hcG9sazc0MnHTQ19bGftSu6YDNiXGIasv7bfDE2FiCeNQ3aZmhR+VOEeCo2iIv+mOzc/kp0OOMn9VmG1R6M+NR3slE6u1cu2PsUNzPb74EpxwqT75oNmi3bIKdcDo02gmGVJ X-Forefront-PRVS: 07630F72AD X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(6009001)(377454003)(189002)(199003)(479174004)(24454002)(55674003)(19580405001)(54356999)(105586002)(50466002)(76176999)(50986999)(4001350100001)(110136002)(189998001)(122386002)(5001960100002)(48376002)(19580395003)(40100003)(5004730100002)(5003940100001)(586003)(81156007)(97736004)(5007970100001)(5008740100001)(33646002)(87976001)(83506001)(42186005)(92566002)(47776003)(86362001)(101416001)(66066001)(106356001)(77096005)(2950100001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL2PR04MB852;H:spline.amer.corp.natinst.com;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1;BL2PR04MB852;23:zvZKaFd4wKdqxvZQyEc1kn/TgR3+h05x0TZuX9M+b3?= =?us-ascii?Q?nMhJVPEosk8xYPIw0vj+vGjGPdm9SfMe97noS3tBEvJlhChWCjy5HMEwY7px?= =?us-ascii?Q?682AJ/WlphM8cSPNvzJRJH7M02CkHS5e7XjeIi0cA7n3oc2P9TUan/1SEfXO?= =?us-ascii?Q?xDMrMunog+0KIJwRKJGibdqZqbwRUp74Xp2aM8MFdzTJNXxGUpSh/2Vnhx+r?= =?us-ascii?Q?VCMmT8VMQHEXejqdYIUZkxucMcqHueZhgJo5xb6iWojfcJmXBsImi8dVwVdX?= =?us-ascii?Q?boXBQ5U59eTA4j2lhNqJgkpLM11Wz1rUW5Ug9S5uhcBxvf4iFuufRcbhHtOQ?= =?us-ascii?Q?AfsqWMa7yjKFABJE6gy3Yuky+XFecxK0mQdBpo34m7b9kwmM7M03nUJStHue?= =?us-ascii?Q?MERYwiHFqQhn5L9Un7Cs0ROqv2RVX4fWnSqnEytxKJMuoEBiBhApUHDIkqRd?= =?us-ascii?Q?8aobq0vBkyT+FonYnCJTDwGD7W5tkTA+VbdYJGRpc2FaWn4eE+y1KUIFHTfW?= =?us-ascii?Q?kaEiOqeSpH7yyjFgUPRwfrPfkvlh7uC3F8W6wt1707d3x4ZTaC7FDMdnJ1kO?= =?us-ascii?Q?CdOsnr0zErWjDlMtxF2rh5WZFkogTF/j1JuDizj3pQHFw+7+HECNYDm+SAdm?= =?us-ascii?Q?+svUoGZbXbyFlgFtZEEI6ip+vIr8zO8pmplpYPr+9iIlBHC2MC3bIt1o0hEp?= =?us-ascii?Q?ioqunuvuUCFbfSpRmhz6XoDVDuFbfAz9YzqYeDyRwhqC/hb1uGaDo5hel+fV?= =?us-ascii?Q?C+FVaJXF0lOZm1eNG/hkkurGPEntTzCyOXcESuHtxJGVlX+sCN6rClCDhDEQ?= =?us-ascii?Q?wIKeBUkpkHOaHW7QaFDRNocNJFzRcoiCyZmmm6SACN41ibK1RpUt4b1OWlAv?= =?us-ascii?Q?H/bN3UVMln5u/w1qpO3FTwg0dXV/a0SIYVm0Mq5niR/gMmD0LG9nZGlOgExb?= =?us-ascii?Q?IPhIk97C45e6jj2kC30YCxZA00RaDQXya4pUDNXIWRf9TnaKObYz/p6tnqiM?= =?us-ascii?Q?TnwQiQ/jaV5107kxza2f4XvqzYlkH2ZSnEVdFA5Dw2Q+fGJCtba9aOasfTLh?= =?us-ascii?Q?Gf39fFobv9DcXLjYEAAvtv0MjKE6Q+EUsgDqMjOiiH5i4zwA=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1;BL2PR04MB852;5:SJFQTlgKZx0NuQ6GE1x8NPl78o0Ir3NVbDBvxKLN3ZE0mAmwvGltdjxQwRinjNObV7MRw8u82VTtsNZAClVjNh3IrPsYIFgiivwMzKYMvDvnE42vIiq1X6Wl9R5IvGxhfO0VqyWBx5XhLCgC8eH8UA==;24:G8JA1PsdA4+o1lpnPST1bk3+Jw6Y53olnJWYI03FOrs7zEimNLKsI0M3/5AY7YvNkiDRXcs6z8nscd0Np5rckNhnFlvChbGPMG2nit5Hk1k=;20:kNaqv8Ql58NV68U2j9Ayf2dNyXo8U6lVN1K3C+A6n61I4QANZYEmfj08n5bXgeBBlUmdagMj50tBZ4jx5ECkiQ== SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: ni.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Nov 2015 16:49:17.8507 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL2PR04MB852 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1564 Lines: 39 Dave Hansen writes: > On 11/09/2015 02:02 PM, Peter Zijlstra wrote: >> On Mon, Nov 09, 2015 at 01:59:02PM -0600, gratian.crisan@ni.com wrote: >>> The Intel Xeon E5 processor family suffers from errata[1] BT81: >> >>> +#ifdef CONFIG_X86_TSC >>> + /* >>> + * Xeon E5 BT81 errata: TSC is not affected by warm reset. >>> + * The TSC registers for CPUs other than CPU0 are not cleared by a warm >>> + * reset resulting in a constant offset error. >>> + */ >>> + if ((c->x86 == 6) && (c->x86_model == 0x3f)) >>> + set_cpu_bug(c, X86_BUG_TSC_OFFSET); >>> +#endif >> >> That's hardly a family, that's just one, Haswell server. > > How did you come up with that x86_model? The document you linked to > claimes that "Extended Model" is 0010b and "Model Number" is 1101b, so > the x86_model you are looking for should be 0x2d. Apologies. I've messed up. The observed behavior seemed to match the errata and it was a Xeon E5. I've used the model number I read of the machine exhibiting the behavior w/o properly matching it with the model number in the errata. In the meantime Peter Zijlstra pointed me in the right direction i.e. it looks like the BIOS is changing the TSC_ADJUST for CPU0 but not any of the other ones. I'll sort it out with our BIOS guys and drop this patch. Sorry again for the confusion. -Gratian -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/