Received: by 10.192.165.148 with SMTP id m20csp4229434imm; Mon, 23 Apr 2018 22:13:45 -0700 (PDT) X-Google-Smtp-Source: AIpwx4+aab3ye1FSzC1Syz3wOw2PeJoulKxtMrmAknQVl1DVH5fWXxyKkL4UU65PMOKC1MMb1VOu X-Received: by 2002:a17:902:6086:: with SMTP id s6-v6mr23264212plj.307.1524546825821; Mon, 23 Apr 2018 22:13:45 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1524546825; cv=none; d=google.com; s=arc-20160816; b=Cn27nF0oBj1GvGehtmT0pZHlag1FeHZrGH4yhItTkSlB5CORWi2stPKfYCoelTbEph wcfO8ebjRVYLZrc2giJ0okIfcAs4yJH98Qd0FdNk0vS6oRyMQZZPCHjOCo0OPE+bJ4EN +SLdjveIsqa2/3BcuCMa8E/nzzEWCEPpURk2l1TwbO6adGnmkophc2fleKZiJ6t7AVg3 bBR5qK0fP337ngifj1kVt/jcDi88kR39A2KnASccqJxv7PuTe25oXAPCldzEBGG7fpl6 a0JAyn379VGsjIde78/eTFCa9RS4Ba5KpncIAdzk4c20n13v07IDUs8AUIsT7vBnkg65 uB7w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:mime-version:date:references :in-reply-to:subject:cc:to:from:arc-authentication-results; bh=AV0vBHAfc5Q4y6KVje/TIOsB8tFpwiTVDSsiXj6x1rg=; b=K+S5TaC7Gd7emjzncPDrJAy/wuaANCNWX58pQS5A4iFfRl2h/lJbGoaAcjUBBqXg8r ijpVUPfCsg24pKH6sVDgqWUytGXgAqjFqljkMPenHf7b6v5sNs2jRuKIsJrO5rtROpYE cwno86x2PbGtqjjFEYQe//9Og0J+sizlhiiDtm5Uy2YF7nsbHkgYhq+i1BS+WZTgcYQN wWCT7GgSOMCbAR/y118DbrsNh6ay1MpcC/LdroFr13i8DLDewROk0jPpcVwZFmeqT9HH J4W6jI6K/VhhMGWBIp6JlyTgL2y6lY7l/C4Q2wIxW1095UsqNOp4KelqmGzGexfHyw1b 9Atg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id n2si11105821pgs.500.2018.04.23.22.13.30; Mon, 23 Apr 2018 22:13:45 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755925AbeDXFKR (ORCPT + 99 others); Tue, 24 Apr 2018 01:10:17 -0400 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:47784 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1752207AbeDXFKP (ORCPT ); Tue, 24 Apr 2018 01:10:15 -0400 Received: from pps.filterd (m0098414.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.22/8.16.0.22) with SMTP id w3O55EnU104375 for ; Tue, 24 Apr 2018 01:10:15 -0400 Received: from e11.ny.us.ibm.com (e11.ny.us.ibm.com [129.33.205.201]) by mx0b-001b2d01.pphosted.com with ESMTP id 2hhuwfd3g8-1 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 24 Apr 2018 01:10:14 -0400 Received: from localhost by e11.ny.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Tue, 24 Apr 2018 01:10:14 -0400 Received: from b01cxnp22036.gho.pok.ibm.com (9.57.198.26) by e11.ny.us.ibm.com (146.89.104.198) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; Tue, 24 Apr 2018 01:10:11 -0400 Received: from b01ledav001.gho.pok.ibm.com (b01ledav001.gho.pok.ibm.com [9.57.199.106]) by b01cxnp22036.gho.pok.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id w3O5AB6B58065046; Tue, 24 Apr 2018 05:10:11 GMT Received: from b01ledav001.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id E52A42803A; Tue, 24 Apr 2018 01:09:34 -0400 (EDT) Received: from birb.localdomain (unknown [9.102.53.128]) by b01ledav001.gho.pok.ibm.com (Postfix) with SMTP id F2E542803D; Tue, 24 Apr 2018 01:09:31 -0400 (EDT) Received: by birb.localdomain (Postfix, from userid 1000) id 894894EC649; Tue, 24 Apr 2018 15:10:04 +1000 (AEST) From: Stewart Smith To: Shilpasri G Bhat , rjw@rjwysocki.net, viresh.kumar@linaro.org Cc: npiggin@gmail.com, benh@kernel.crashing.org, mpe@ellerman.id.au, linux-pm@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-kernel@vger.kernel.org, ppaidipe@linux.vnet.ibm.com, svaidy@linux.vnet.ibm.com, Shilpasri G Bhat Subject: Re: [PATCH] cpufreq: powernv: Fix the hardlockup by synchronus smp_call in timer interrupt In-Reply-To: <1524544906-31512-1-git-send-email-shilpa.bhat@linux.vnet.ibm.com> References: <1524544906-31512-1-git-send-email-shilpa.bhat@linux.vnet.ibm.com> Date: Tue, 24 Apr 2018 15:10:04 +1000 MIME-Version: 1.0 Content-Type: text/plain X-TM-AS-GCONF: 00 x-cbid: 18042405-2213-0000-0000-00000297F05F X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00008910; HX=3.00000241; KW=3.00000007; PH=3.00000004; SC=3.00000257; SDB=6.01022420; UDB=6.00521853; IPR=6.00801654; MB=3.00020741; MTD=3.00000008; XFM=3.00000015; UTC=2018-04-24 05:10:14 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 18042405-2214-0000-0000-000059DF4C7D Message-Id: <87y3hdb36b.fsf@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-04-24_01:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=1 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 impostorscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1709140000 definitions=main-1804240050 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Shilpasri G Bhat writes: > gpstate_timer_handler() uses synchronous smp_call to set the pstate > on the requested core. This causes the below hard lockup: > > [c000003fe566b320] [c0000000001d5340] smp_call_function_single+0x110/0x180 (unreliable) > [c000003fe566b390] [c0000000001d55e0] smp_call_function_any+0x180/0x250 > [c000003fe566b3f0] [c000000000acd3e8] gpstate_timer_handler+0x1e8/0x580 > [c000003fe566b4a0] [c0000000001b46b0] call_timer_fn+0x50/0x1c0 > [c000003fe566b520] [c0000000001b4958] expire_timers+0x138/0x1f0 > [c000003fe566b590] [c0000000001b4bf8] run_timer_softirq+0x1e8/0x270 > [c000003fe566b630] [c000000000d0d6c8] __do_softirq+0x158/0x3e4 > [c000003fe566b710] [c000000000114be8] irq_exit+0xe8/0x120 > [c000003fe566b730] [c000000000024d0c] timer_interrupt+0x9c/0xe0 > [c000003fe566b760] [c000000000009014] decrementer_common+0x114/0x120 > --- interrupt: 901 at doorbell_global_ipi+0x34/0x50 > LR = arch_send_call_function_ipi_mask+0x120/0x130 > [c000003fe566ba50] [c00000000004876c] arch_send_call_function_ipi_mask+0x4c/0x130 (unreliable) > [c000003fe566ba90] [c0000000001d59f0] smp_call_function_many+0x340/0x450 > [c000003fe566bb00] [c000000000075f18] pmdp_invalidate+0x98/0xe0 > [c000003fe566bb30] [c0000000003a1120] change_huge_pmd+0xe0/0x270 > [c000003fe566bba0] [c000000000349278] change_protection_range+0xb88/0xe40 > [c000003fe566bcf0] [c0000000003496c0] mprotect_fixup+0x140/0x340 > [c000003fe566bdb0] [c000000000349a74] SyS_mprotect+0x1b4/0x350 > [c000003fe566be30] [c00000000000b184] system_call+0x58/0x6c > > Fix this by using the asynchronus smp_call in the timer interrupt handler. > We don't have to wait in this handler until the pstates are changed on > the core. This change will not have any impact on the global pstate > ramp-down algorithm. > > Reported-by: Nicholas Piggin > Reported-by: Pridhiviraj Paidipeddi > Signed-off-by: Shilpasri G Bhat > --- > drivers/cpufreq/powernv-cpufreq.c | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/drivers/cpufreq/powernv-cpufreq.c b/drivers/cpufreq/powernv-cpufreq.c > index 0591874..7e0c752 100644 > --- a/drivers/cpufreq/powernv-cpufreq.c > +++ b/drivers/cpufreq/powernv-cpufreq.c > @@ -721,7 +721,7 @@ void gpstate_timer_handler(struct timer_list *t) > spin_unlock(&gpstates->gpstate_lock); > > /* Timer may get migrated to a different cpu on cpu hot unplug */ > - smp_call_function_any(policy->cpus, set_pstate, &freq_data, 1); > + smp_call_function_any(policy->cpus, set_pstate, &freq_data, 0); > } Should this have: Fixes: eaa2c3aeef83f and CC stable v4.7+ ? -- Stewart Smith OPAL Architect, IBM.