Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751203AbdH1KpZ (ORCPT ); Mon, 28 Aug 2017 06:45:25 -0400 Received: from mail-db5eur01on0136.outbound.protection.outlook.com ([104.47.2.136]:55210 "EHLO EUR01-DB5-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1750825AbdH1KpW (ORCPT ); Mon, 28 Aug 2017 06:45:22 -0400 Subject: Re: [linux-next][ppc] kernel hung when running trinity fuzzer To: Abdul Haleem , linuxppc-dev Cc: Peter Zijlstra , Michal Hocko , linux-next , linux-kernel , sachinp References: <1503916099.3740.8.camel@abdul.in.ibm.com> From: Kirill Tkhai Message-ID: <54ce6db5-68c1-e8f3-3804-63efb31956bf@virtuozzo.com> Date: Mon, 28 Aug 2017 13:45:21 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <1503916099.3740.8.camel@abdul.in.ibm.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [195.214.232.6] X-ClientProxiedBy: AM5PR0602CA0019.eurprd06.prod.outlook.com (2603:10a6:203:a3::29) To HE1PR0801MB1339.eurprd08.prod.outlook.com (2603:10a6:3:3a::7) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 0d79ac70-27df-428e-142b-08d4ee01df88 X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(300000503095)(300135400095)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095);SRVR:HE1PR0801MB1339; X-Microsoft-Exchange-Diagnostics: 1;HE1PR0801MB1339;3:WGr8VgGG2CGYaIRNCEAV4zQ0SQ2JsKN2e4E09udJXaVRNYb648IqlFNL9sqDCTakGG1eHPudRut3/Ndc93FoRD54iCIUgu0DR/w6GdOrWNbpeM22U63zsicyriOWjFazvBLfb6aEaa56huaux+vEj3Byi6sKKsH4yHTeKjgFCL15gFGH6CEmRfdqWOxDX6t9dIwTKVyxYQoLBpTeu8ZBixKMTMgLhVOi9Lzq4HFAlGfI4v4r+bOD7wt4TodRr4W9;25:NOm1PYvkXa807Apc9f5hC98jHSFywNS/GqYdaue+IdDv1tZvRONeK4PHjq9sIkt8/gXM9g93nj8obE+b/67gkCudv+PAaFD3T398+OgR0Foxu0qNTWKLn9gFhcHygTkWhPnRRKc/BUhxNk0ujdtXDhDuA+KI2CyE7AVPs7ZM2FqE6DHXmofk2s43XKXeC/RgIuW77e+/I1KjojfJSGFSa+3DTDFs3vzUBwmb8p8OA++AtM4DpHIl4DVogIHjCZ6o0SP8aVjtYQXSJGVqALa/CBZpWOcZpkA2XBCsW4zuYwSzH9YZOG1XHdRkbwgNbSVdUCfJZiKjwHDoZ9qhwXHFoA==;31:VW+02FRNG1Ha+RQkaZPb3cVD2oRoCjXgTpffFKIrVn1uYlrcdCwy8FzEaa2a/8nPsGEKDLR3ObVWQMNgM4cA/+AK7uO0c3GQLJMS77u1ZHO6SzBFPcCNZ1jsQ+EMrhpchytslwVwkLPc7b5RwzKmm/WDzhgsbdeUetcIVCXO/wv2+6XXr1dGSh8SOsBZ5VLEy2rjC98JPs8RvcHyAgYdcNYW56TrDB5GdE2VgtCKYUo= X-MS-TrafficTypeDiagnostic: HE1PR0801MB1339: X-Microsoft-Exchange-Diagnostics: 1;HE1PR0801MB1339;20:FfdWPmgqtPQL5GEhKsd6yHCrW5seVeFOT2v7HDdgNUU4Rfm7Eh8m2l5FIbEnF2pnnhq1voUVY9wgU/ZiNQcImJqbRgpbJD4hXB5Vpw33ilcHsdgdaSjjxlzv/PS4j5N/Z41A2SOU5rPtw8VwGBCGDOwdIOrhnDUa7AdJWfsq1NzXnGdD3dbPNxYd0hZnx7FbJ55hHL/Q42g1OpWhmGNnoe0mc4PCqZ2LpFOgqut+ZPnCFsNxgXeuNzehZBbEoyJ7v7+I7oGnKH3FtQwSiSJkneIuu8QAuyRIqbv+RdUuxezZ38tsbQM4/ZVuD3su8z35F1UbQfLst2cOT6/wCUyA0ihhLu+FegU11+8Za9HM7LKRg5gM88YzS9k3ucQttd9eftazxRAEgYd6bUmP+tRvlFrTFp4GOQgfkWyueFYD4UQ=;4:i3fHSsSZ5o42mnuk8eg/EzGbSgAK+qovbtzFJjnMx5pewuAv0b1YfZSH7zPwPNhmPnVflLTZpvocAhGTogkAeNra0ba+9/J3wEwLkHZUZe6r41KLAuk29jRA39pk2Xy9fG+SpaM+u8rGuuwhwimHnOQVBokPbxp2lG4sZUCrNr/b4CEFkraDF8hzq7/ZhJYdcr6A/WGU7XYfeUL669OrgWeWXcyQBo77H3cA28QQq3PpbK56NnEzNndHn+p4Qyue X-Exchange-Antispam-Report-Test: UriScan:; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(601004)(2401047)(8121501046)(5005006)(10201501046)(100000703101)(100105400095)(93006095)(93001095)(3002001)(6041248)(20161123562025)(20161123555025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123560025)(20161123564025)(20161123558100)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095);SRVR:HE1PR0801MB1339;BCL:0;PCL:0;RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095);SRVR:HE1PR0801MB1339; X-Forefront-PRVS: 0413C9F1ED X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(4630300001)(7370300001)(6049001)(6009001)(39830400002)(199003)(24454002)(189002)(83506001)(42186005)(65806001)(8676002)(65956001)(31686004)(97736004)(5660300001)(50466002)(6666003)(229853002)(478600001)(65826007)(3846002)(101416001)(54906002)(230700001)(106356001)(33646002)(7350300001)(105586002)(6116002)(68736007)(25786009)(86362001)(7736002)(2950100002)(54356999)(76176999)(50986999)(189998001)(6246003)(4326008)(6486002)(53546010)(77096006)(36756003)(2906002)(66066001)(64126003)(81156014)(81166006)(23676002)(4001350100001)(47776003)(53936002)(31696002)(305945005);DIR:OUT;SFP:1102;SCL:1;SRVR:HE1PR0801MB1339;H:[172.16.24.149];FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=ktkhai@virtuozzo.com; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtIRTFQUjA4MDFNQjEzMzk7MjM6dnovcmRsMDFBZm8vbGJqOXdpM1V1M1ll?= =?utf-8?B?bCtXTEgycEN3TUFzbFUzMGYvblBMY0NwYTVBbGtBMUNsekJKd1NZM0RGd2t5?= =?utf-8?B?cW5tVWtUcHRXSzE3SzFGbmh4K1F2cFpwcDZHU2cvYXg3bm44RXozK2VBNjI1?= =?utf-8?B?b0lKMHpPRzlYRTI2a3ZyejlJWlRma2lrU2tSenJlNGQwNGQwVTBvaDcrMVEw?= =?utf-8?B?SlB2QTEyWGdzTEIxWFNVbjRYYlpBdk1JQndlQnVnVVl5RWtPYXlNTktFeEls?= =?utf-8?B?dE1ORE5xWWpKQXBoUDdtMklSemM0YzgxZk5HODRrdXZQNXVNTk5kQ0oxbjUy?= =?utf-8?B?RnpSTnBrSUhGWHpFaW1lSHNaYlIyQkNqSUxJVVp2VWdQZERHejA5V1VHUm5v?= =?utf-8?B?OTE4KzhwVFhBbXhCaDA2N1BuZDVsdFlIN3VFc1M3cW1iR1RJTjZFYlMybTl3?= =?utf-8?B?dUY3N21ZQzZYMGw3TXAweS9lSm1pdkZPWmU1UkxaUS9tVzY4MWp4ZHNoLzJE?= =?utf-8?B?QXhRVDdIVTBHYkxMcE1QK0ZuYXdweDdxSlQyOC82NTRWU0xxNllXMnBXVWJL?= =?utf-8?B?Uy95aXdKRE9jSUVHMzFYdU8yRFhkRWJQbHNURjFaUjhINEF5OEpxWVpkT0Mv?= =?utf-8?B?SlJSVFoyakE2QUJ1bFExOStrM0k4UWhyK1J0WlRZdmZLZjk2aGRyOXJibFNJ?= =?utf-8?B?dXRlNHY1cFZqZitnV1QyUHRabWhFdFkvdlNNWEhGeUl0d1prYVlKem5JanhR?= =?utf-8?B?eTZqc2VvMVBSWVBUeG5aK0UrQXBGMmFhekhlYlNWUXpKeGJqLzI3U1dVdjhP?= =?utf-8?B?b3RzcTQzUWhOSDN5bjcwSGdSaHNDaG1rWDE3OTA4aUNoNmtyNURyR2ZEL3lW?= =?utf-8?B?U3FkbzZlREtDdEd5aUpXU1U5WE14akpROU1RbVhjOW12M2NlK2xZNHhEMkdN?= =?utf-8?B?WHJyTk1wNy9naHI4aExFenZSZ1gyQmE1TkNubHJ4ZU8zTmFYSjc0V0o2SGp2?= =?utf-8?B?TjF4aFJPVWttTWpTcVRjUUQvMmlkY1JLZElKSU5HWnQwL0FON0NWSnFOYjdH?= =?utf-8?B?dU9CVWF4ODQyRDFKcnlseEc1UGN5cklJR0RFc2w1S0phWkdhMXBZK2NVbVBO?= =?utf-8?B?SlZCOStCVWVhT2VQS3MrQjBVam9oUHV1ZER2ay9SajdXYzZ6Ukt3YngydHBT?= =?utf-8?B?UzBZTFN0R09IdXRXMTlvVzZQRHBqdHUwT0ZnN1VnUnR4OERqT0J1UmRQZC9F?= =?utf-8?B?LzdGWkdQZlI5ZVNMWnpHTEU4U0w1ZTVTZjg1eXRHc1Z0QjZnVksxcVNVN2dh?= =?utf-8?B?QjJVSGxTZG5mcHorQVZ0dldWM0JYQjNXUHpwcU5DRndDM0JLSzdMMWU3eldK?= =?utf-8?B?bTVaNlJFWmRUejF3eGV3TS9WRGxycTJFMEUyMGdmMlFVSHVVNG44SXNMclNJ?= =?utf-8?B?cXlrUmxqZjIweUdMVFRMUEEwL2Uvc2xuNDJpei96Q2ZNYWlZeHdLdVZZdE5l?= =?utf-8?B?cnVBYmZMSzhGQ25QV1VKRk5zK1RNWVFmRHRtcUNjeUM1SE1YUTZJQXdoVnBT?= =?utf-8?B?QVliY0xNZmVzNDZtWVdTMmFrL3JNNHJMNjd1VHRXUkJhSDdtSW5sQ082YTYv?= =?utf-8?B?NUdFTWhJbGppWHM2RFZ5REhaNmpKdlAwaEcwMTcydytFaXhsaGc0UU5qNzhh?= =?utf-8?B?MnA0SDNPMjlaV09HMHgwQXBSY2ZxckphNDQ2dHRvTGlURjQyWW5qckNnRVNK?= =?utf-8?B?VU9SZHNNenEvNTJxTUF3VWVDNUJuVHVHckRGekNBSGlQWm5GRDNGZE1wNko4?= =?utf-8?B?bktpdVM5U1Q3UE1ZR2hjV3VIZ29oR2p0QzhhV1lDU1lHSmtUQT09?= X-Microsoft-Exchange-Diagnostics: 1;HE1PR0801MB1339;6:7XrzCxWNHj4DnSpELKHoU4XcjbcG3Ygml7fno5M77WLiQCqTlXlyxPQp6M6Fwh6Uk8fXgKxjeXM1M36wQbLulkswi1yRZ5Eh67wXOPamLx8b+GoqBEZBLIQ4LGLQm4zeIHOYHiJNVehP+/N/6K9FYquhZWKilqaUbmW9zOqNWRUB0dXhaxl/l0+ICLMikNJUocNQR/X2lmOLPU+hArVUp5pQJufecR3PSk2MIWQMrg0P5gR8orliaCX7afmFjp33OALR6lgYPX6ww58uPCPjThdHnwxqD+BrjYcSc4n0EhDza1fQrKNZjKFqDLvBH7vS65Oq3z/+Iok/ZTi3EHuc9w==;5:NNcOS/R8jsetHiPKFaIu2MUk7+KNHsWKSyiSEsTvqkOYG7blilgGCgVT3TghLWFXJSpZ2C5XZS19X0gvNVpKBRt3JSoC8tUshK4KPMSLb1dTkNaKgLCCnnyO8bas/fKttYr5witb/8c4Dcntb7X8Jg==;24:QEQxoPyQF+kagoGDmSDxjlnPLhi4w4qEdPgDSSSXdliX2ofaP7pIxwBCPFTkwbtPd4Evc8D227ngG3ftFAQnCPA6RST5mrrV3nWqafuwHN0=;7:J4qKu7eSyuCn5i1m2MEjEsMvtyfm+Txrpu6glUK1klFFIsm1jPam7B6dGODmP+glz4Waj3fwTAtCjasAnbh0dozuSbRCNIUG1HilDei0gHUfuM+6yWT181jckTqSXonbgDgBQkmd60xR1G74gLv7t2Z3qwXkuMFUKZg9PXujRVGWVwCnhoDI7uN95cJFCtF65KbxII8DqTg4O+b/vBzG5sR7yXXa1TcWY0jadwYMNgY= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;HE1PR0801MB1339;20:lqhu5fnTyydMd0dhP4Go4CnWlof2AGFpiZSPzWdX1CUjW9XQ8rSK+ey1tli1NXMzF1JKY4LWl0KZ/dhTryYJszFMjRHa1ON2HVYosvvMy9i2xhoUaWz/vdTZS6LcRZXQj/62SoOU2SwuufFdvlVUaz0YWZC0UhXmIcFncLf+vyE= X-OriginatorOrg: virtuozzo.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 28 Aug 2017 10:45:17.1197 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0801MB1339 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2124 Lines: 46 On 28.08.2017 13:28, Abdul Haleem wrote: > Hi, > > offlate we are seeing hung task call traces when running trinity fuzzer > test. kernel go hung and requires machine reboot. > > Machine Type : Power 8 > Kernel : 4.13.0-rc6-next-20170825 > config: Tul-VM-config > > > call traces: > ------------- > INFO: task systemd-timesyn:472 blocked for more than 120 seconds. > Not tainted 4.13.0-rc6-next-20170825 #3 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this > message. > systemd-timesyn D 0 472 1 0x00040000 > Call Trace: > [c000000775f2b750] [0000000b00000000] 0xb00000000 (unreliable) > [c000000775f2b920] [c00000000001c788] __switch_to+0x2a8/0x470 > [c000000775f2b980] [c000000000c16974] __schedule+0x394/0xa40 > [c000000775f2ba50] [c000000000c17068] schedule+0x48/0xc0 > [c000000775f2ba80] [c000000000c1b2e8] rwsem_down_read_failed+0x128/0x1b0 > [c000000775f2bae0] [c0000000001700c8] __percpu_down_read+0x108/0x110 > [c000000775f2bb10] [c00000000038fda8] __sb_start_write+0x118/0x130 > [c000000775f2bb50] [c0000000003c1768] mnt_want_write+0x38/0x80 > [c000000775f2bb80] [c0000000003a3328] path_openat+0x9c8/0x14b0 > [c000000775f2bc90] [c0000000003a579c] do_filp_open+0xfc/0x170 > [c000000775f2bdc0] [c000000000388618] do_sys_open+0x1b8/0x2e0 > [c000000775f2be30] [c00000000000b184] system_call+0x58/0x6c > INFO: task rs:main Q:Reg:624 blocked for more than 120 seconds. > Not tainted 4.13.0-rc6-next-20170825 #3 I'm in CC here, but it doesn't seem my commit 83ced169d9a0 "locking/rwsem-xadd: Add killable versions of rwsem_down_read_failed()" is involved. It introduces the code, which is unused at the moment: kirill$:~/linux-next$ git grep rwsem_down_read_failed_killable include/linux/rwsem.h:extern struct rw_semaphore *rwsem_down_read_failed_killable(struct rw_semaphore *sem); kernel/locking/rwsem-xadd.c:rwsem_down_read_failed_killable(struct rw_semaphore *sem) kernel/locking/rwsem-xadd.c:EXPORT_SYMBOL(rwsem_down_read_failed_killable); We still call rwsem_down_read_failed() with TASK_UNINTERRUPTIBLE argument, so "signal_pending_state()" branch is always dead.