Received: by 10.213.65.68 with SMTP id h4csp1084842imn; Wed, 28 Mar 2018 20:14:32 -0700 (PDT) X-Google-Smtp-Source: AIpwx4/MJ8FiuUO8VE9oZD/Iqtr3S9inmIWrv7w+uECXxO/3CvBMsvTj58jZCg1nlAw0+iUfzY8B X-Received: by 2002:a17:902:760e:: with SMTP id k14-v6mr6289866pll.292.1522293272263; Wed, 28 Mar 2018 20:14:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1522293272; cv=none; d=google.com; s=arc-20160816; b=AQULkXRyig5lgLwzuajLWOteUsV3q7933Hzo/Br6m9Z1t++erI2uNuOvaN34fUr/kk Lxq6doCJlcOp6p4HnzUSagx+GqDQlCTSwtPaI9xvMG0I7WAz26QRTDW0Dq/FVhQqkp/m 3xaTGn1gBAMAeTsRCotfl0rIHIdH1QbfoZToZftBmQ4+9geebalUSB+wCXSDVz7MWXgo yQzRgSotszwznfxVUEMZVUW29oOrJy8T8Fo577qyragQqAtsyQMurkDo/CfEZst/d+Fw 3DiQxJ70PvbI8mt6jMJXL6VUFwpT5ACMujR8VFMt3MnxOjgWs/u4pW5GpFWtjHqeHacj xLCQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:mime-version:user-agent:date :message-id:from:references:to:subject:arc-authentication-results; bh=StR5DwgmyL37sQ0WVdbKwAEYzK3M4a5r+h7ss5uWTHE=; b=BVwCJtgDq5gLuDTGbkx4M1lgMAv4qkOI/3o0UEQ3POfKqQG0jua1LBWDbAHf1nv5LV /Ed9h92qV5GlExDep4/eebQtPP69zYCCElWjNDUGpIbobQNgF0uSH9e4NoxxKLLFi+9x pAZVq684jkmJ/9s9Ir/br9vl9jhf7wqfNrrlldmdlOT66KSeGfL5I2yNcaDkpVDjGlOO l/kQYnLszmhl/ayb+wRTN328L5y5FVq9DWC8y4R7qc79+AKxN0NLC0y8Jb3BRfQ7dV/5 SNhMDd6RTakNMx8HX2w5X/FrYhVxxmeHO/osGasHb0LLIqX5lXYwdkfUxN2phu5/AW1T HXuQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id c1-v6si5056292pla.34.2018.03.28.20.14.18; Wed, 28 Mar 2018 20:14:32 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751223AbeC2DN3 (ORCPT + 99 others); Wed, 28 Mar 2018 23:13:29 -0400 Received: from eahe.aehallh.com ([50.116.20.20]:32924 "EHLO eahe.aehallh.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751077AbeC2DN1 (ORCPT ); Wed, 28 Mar 2018 23:13:27 -0400 Received: from localhost (localhost [127.0.0.1]) by eahe.aehallh.com (Postfix) with ESMTP id BAD4F2FEEB; Wed, 28 Mar 2018 22:13:26 -0500 (CDT) X-Virus-Scanned: Debian amavisd-new at eahe.aehallh.com Received: from eahe.aehallh.com ([127.0.0.1]) by localhost (eahe.aehallh.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eEjFcAyAOoK0; Wed, 28 Mar 2018 22:13:25 -0500 (CDT) Received: from [10.0.5.143] (24-113-71-69.wavecable.com [24.113.71.69]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: warp) by eahe.aehallh.com (Postfix) with ESMTPSA id D7E1E2FEEA; Wed, 28 Mar 2018 22:13:24 -0500 (CDT) Subject: Re: General protection fault with use_blk_mq=1. To: Jens Axboe , "Zephaniah E. Loss-Cutler-Hull" , linux-kernel@vger.kernel.org, linux-block@vger.kernel.org, linux-scsi@vger.kernel.org References: <7d8a9c62-7d3e-879c-5b5b-30707f04553e@aehallh.com> From: "Zephaniah E. Loss-Cutler-Hull" Message-ID: Date: Wed, 28 Mar 2018 20:13:08 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="jYhx2pfQ5AYdp8dKnU3XZ0LRR8oyJH6VJ" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --jYhx2pfQ5AYdp8dKnU3XZ0LRR8oyJH6VJ Content-Type: multipart/mixed; boundary="Qpjn4B0IU1D87juBCWkeHXN0q9fTJ2NrG"; protected-headers="v1" From: "Zephaniah E. Loss-Cutler-Hull" To: Jens Axboe , "Zephaniah E. Loss-Cutler-Hull" , linux-kernel@vger.kernel.org, linux-block@vger.kernel.org, linux-scsi@vger.kernel.org Message-ID: Subject: Re: General protection fault with use_blk_mq=1. References: <7d8a9c62-7d3e-879c-5b5b-30707f04553e@aehallh.com> In-Reply-To: --Qpjn4B0IU1D87juBCWkeHXN0q9fTJ2NrG Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 03/28/2018 06:02 PM, Jens Axboe wrote: > On 3/28/18 5:03 PM, Zephaniah E. Loss-Cutler-Hull wrote: >> I am not subscribed to any of the lists on the To list here, please CC= >> me on any replies. >> >> I am encountering a fairly consistent crash anywhere from 15 minutes t= o >> 12 hours after boot with scsi_mod.use_blk_mq=3D1 dm_mod.use_blk_mq=3D1= >=20 >> The crash looks like: >> >> >> Looking through the code, I'd guess that this is dying inside >> blkg_rwstat_add, which calls percpu_counter_add_batch, which is what R= IP >> is pointing at. >=20 > Leaving the whole thing here for Paolo - it's crashing off insertion of= > a request coming out of SG_IO. Don't think we've seen this BFQ failure > case before. >=20 > You can mitigate this by switching the scsi-mq devices to mq-deadline > instead. >=20 I'm thinking that I should also be able to mitigate it by disabling CONFIG_DEBUG_BLK_CGROUP. That should remove that entire chunk of code. Of course, that won't help if this is actually a symptom of a bigger problem. Regards, Zephaniah E. Loss-Cutler-Hull. --Qpjn4B0IU1D87juBCWkeHXN0q9fTJ2NrG-- --jYhx2pfQ5AYdp8dKnU3XZ0LRR8oyJH6VJ Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJavFnTAAoJEJMemkxvB+Y84YYQAK9zwn4t73WvBeROE0ox8WYW fXj2xtMHTxIBwS/jbveYhzEHGAoSm2OpUNhVSJUjLTyEWl6aXlbniyFP7ddjaxq+ ygE5kKPPsykI/HmAdztcgJJb3YfSqJec91768mvUA24h8SaDXG+yIxfpiVNQYPnh NqEr/m2j9KKnopx/0K7cEllyK7IqHcKZb5+FQoJC/jHT29eUeowNvhT6fg08C1iZ z+z85B981OCdFqSnc/2wQfJQvrCrN84PagVUydhieZF+MSwL3+BvjCv0o5kuknyc jwy2q8Gu36b/Y3dq/Ei2mRZGRfHLDYMqPC1oj/vajYnCxi8LiK6z89iei/+cKVVm zw/k04QBBih8GP7ZI/7sHOIC60qS2oxP4Ipm3hJle6H2d2Say5jtlXoOAzAbR5kN 94bVZwCjyX11Q62fXBlCKvc2HLFtv9vZYltc6R2MfBQQued3ya9dT4CSmZ5roZe/ epHEuTmYMG4JAcvJlOcaR83m/03UglZ6AP1mFnbc3p2U45ZneVAkHJyzsR0Qgzn4 FgJ2zkuTlmfcDNSjLGp0Zxvfv8VMoV5dRSUbXByE3W3neiXr92BTbiWxgBVqabw6 Yd1f5Hv/94HlqxdFs6VA6uUe8Y+hHdZPUaZsV+LPi69nGe4WagKDQ2yQrz5/031T tMsnmiWLLSDSOvN4H5cT =Rjz6 -----END PGP SIGNATURE----- --jYhx2pfQ5AYdp8dKnU3XZ0LRR8oyJH6VJ--