Received: by 2002:a05:6358:4e97:b0:b3:742d:4702 with SMTP id ce23csp32140rwb; Wed, 17 Aug 2022 22:05:10 -0700 (PDT) X-Google-Smtp-Source: AA6agR6uv2NmGEAXnYvx+IQZgI22j+hS/vZrRKPR8khAWoGyp/YCAc0aW/IoLB9Ta4vdaJf5jLb5 X-Received: by 2002:a17:906:98c9:b0:730:a23e:2785 with SMTP id zd9-20020a17090698c900b00730a23e2785mr780720ejb.622.1660799110064; Wed, 17 Aug 2022 22:05:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1660799110; cv=none; d=google.com; s=arc-20160816; b=yk17epDPrLO7YwrJsxnaiE3gKVwVFWZVjV1nxvbQf5wtF2P69KeudIOVvJAXUZCgNL TaxntIwXmXU+j5heIVI2zHAN7YrdPJMG+CAGiF0CVatjBLjMNAhrng6G16cTyns7sRvI 4Io3KhyqpMSMhautFpnJUj5tWNZXy5809Nt78wxN97RrnJ348uJQSSTY/198ZcdmYZX7 QpOFO/0qVuSY4eMGsGRggtdYXeDird+RdRDCAzdoX6/cMuIuj47FqI4Jmt/skEbGJf3x FuKs3gg0mzguKIs4oMRm+MgMrFxSNzBi2CBO+jqZDhZ1yMXR3jZRMXbecuPcLugiDKT3 KT9w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:message-id:date:subject:cc:to:from :dkim-signature; bh=ZA6GSbOg6/OVN3zBulWfK7wmYSnrjkBIdqp9oJj7Mkc=; b=WwN/1wQtbbMs8JVHZS8Cwioqkq+j2XkRJmJjQXiVWdB+vWumjZjR96bpY0iWRHDugx TF49rgPFUHrPS08jW+a4DTtGkt8KTUyZJSOfHAcIxSr53zui1S/nD+GqTejt3KE6tjEE FtBrALDLvnMtl7Klyr0SBq2M3suoDKg9XuIlu0URz/8Lb5Ip0iW1g7ZqcASL46Nu0AtP ynkNT80ItvHWVYwb98Z3QbjB1FYVrx8JoGReiIKFwTKSp+kFkBWr3LMO7vqga6lpVFSK GWDozeYzjxme1f0Yjprn8+qBRR8bBEYSzT5u30lCrV9fqEFySFtHhE38/AMlNGb0GtJ2 zaFw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@quicinc.com header.s=qcppdkim1 header.b=nao33Gg5; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=quicinc.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id w15-20020a056402268f00b0043ce8b2c72dsi559343edd.36.2022.08.17.22.04.44; Wed, 17 Aug 2022 22:05:10 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@quicinc.com header.s=qcppdkim1 header.b=nao33Gg5; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=quicinc.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S243277AbiHRESP (ORCPT + 99 others); Thu, 18 Aug 2022 00:18:15 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46842 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S243193AbiHRERp (ORCPT ); Thu, 18 Aug 2022 00:17:45 -0400 Received: from mx0b-0031df01.pphosted.com (mx0b-0031df01.pphosted.com [205.220.180.131]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C1B3D95AE5; Wed, 17 Aug 2022 21:17:32 -0700 (PDT) Received: from pps.filterd (m0279869.ppops.net [127.0.0.1]) by mx0a-0031df01.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 27HN9W9A005180; Thu, 18 Aug 2022 04:17:23 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=quicinc.com; h=from : to : cc : subject : date : message-id : mime-version : content-type; s=qcppdkim1; bh=ZA6GSbOg6/OVN3zBulWfK7wmYSnrjkBIdqp9oJj7Mkc=; b=nao33Gg5NwVaaJjgMJnrK/BbyLOsPgJ4aoWzXQDxUyc8sKObeeLRb8xw+y8leDOhzUWz 8/i1tA0edhEuAQEIIEmzxFgGGf/my5es1+eGSXpOJVPLkFcgqEh7aOAutk4JEVsFoIwJ IHiywl/3WO/NeQ8K0XREXrdkiIc5lRwIXNnUOl9ZB/TeNm4BFcmLOsW+CTYH8a4VGo3h VkxICeTe5PReQAobx4VHNqrj4qlvrzGk394bSgs3zzYMfRnzvidIc7ELxCCe/5tpEMzy bwYW+3jwgR1HjKKXYt4qtRNuQZGlaTsxsSsFy4lxSrkvoUfGiHnJEsojiY8UdwtpUUQw eA== Received: from nalasppmta03.qualcomm.com (Global_NAT1.qualcomm.com [129.46.96.20]) by mx0a-0031df01.pphosted.com (PPS) with ESMTPS id 3j0wynkv18-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 18 Aug 2022 04:17:22 +0000 Received: from nalasex01a.na.qualcomm.com (nalasex01a.na.qualcomm.com [10.47.209.196]) by NALASPPMTA03.qualcomm.com (8.17.1.5/8.17.1.5) with ESMTPS id 27I4HJl9018189 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 18 Aug 2022 04:17:21 GMT Received: from hyd-lnxbld559.qualcomm.com (10.80.80.8) by nalasex01a.na.qualcomm.com (10.47.209.196) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.22; Wed, 17 Aug 2022 08:14:29 -0700 From: Akhil P Oommen To: freedreno , , , Rob Clark , Bjorn Andersson , "Dmitry Baryshkov" CC: Matthias Kaehlcke , Jonathan Marek , Jordan Crouse , Douglas Anderson , Akhil P Oommen , "Abhinav Kumar" , Chia-I Wu , "Dan Carpenter" , Daniel Vetter , David Airlie , Philipp Zabel , Sean Paul , Wang Qing , Subject: [PATCH v4 0/7] Improve GPU Recovery Date: Wed, 17 Aug 2022 20:44:13 +0530 Message-ID: <1660749261-7602-1-git-send-email-quic_akhilpo@quicinc.com> X-Mailer: git-send-email 2.7.4 MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [10.80.80.8] X-ClientProxiedBy: nasanex01a.na.qualcomm.com (10.52.223.231) To nalasex01a.na.qualcomm.com (10.47.209.196) X-QCInternal: smtphost X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=5800 signatures=585085 X-Proofpoint-ORIG-GUID: LOQav7krhjtGmHFgyBz___NDZFi2EfAX X-Proofpoint-GUID: LOQav7krhjtGmHFgyBz___NDZFi2EfAX X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.883,Hydra:6.0.517,FMLib:17.11.122.1 definitions=2022-08-18_02,2022-08-16_02,2022-06-22_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 phishscore=0 adultscore=0 spamscore=0 malwarescore=0 clxscore=1011 impostorscore=0 suspectscore=0 lowpriorityscore=0 bulkscore=0 mlxlogscore=999 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2207270000 definitions=main-2208180014 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Recently, I debugged a few device crashes which occured during recovery after a hangcheck timeout. It looks like there are a few things we can do to improve our chance at a successful gpu recovery. First one is to ensure that CX GDSC collapses which clears the internal states in gpu's CX domain. First 5 patches tries to handle this. Rest of the patches are to ensure that few internal blocks like CP, GMU and GBIF are halted properly before proceeding for a snapshot followed by recovery. Also, handle 'prepare slumber' hfi failure correctly. These are A6x specific improvements. This series is rebased on top of v2 version of [1] which is based on linus's master branch. [1] https://patchwork.freedesktop.org/series/106860/ Changes in v4: - Keep active_submit lock across the suspend & resume (Rob) - Clear gpu->active_submits to silence a WARN() during runpm suspend (Rob) Changes in v3: - Use reset interface from gpucc driver to poll for cx gdsc collapse https://patchwork.freedesktop.org/series/106860/ - Use single pm refcount for all active submits Changes in v2: - Rebased on msm-next tip Akhil P Oommen (7): drm/msm: Remove unnecessary pm_runtime_get/put drm/msm: Take single rpm refcount on behalf of all submits drm/msm: Correct pm_runtime votes in recover worker drm/msm: Fix cx collapse issue during recovery drm/msm/a6xx: Ensure CX collapse during gpu recovery drm/msm/a6xx: Improve gpu recovery sequence drm/msm/a6xx: Handle GMU prepare-slumber hfi failure drivers/gpu/drm/msm/adreno/a6xx.xml.h | 4 ++ drivers/gpu/drm/msm/adreno/a6xx_gmu.c | 83 ++++++++++++++++++++++------------- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 43 ++++++++++++++++-- drivers/gpu/drm/msm/msm_gpu.c | 21 ++++++--- drivers/gpu/drm/msm/msm_gpu.h | 4 ++ drivers/gpu/drm/msm/msm_ringbuffer.c | 4 -- 6 files changed, 114 insertions(+), 45 deletions(-) -- 2.7.4