Received: by 2002:ac0:a5b6:0:0:0:0:0 with SMTP id m51-v6csp2954061imm; Mon, 28 May 2018 20:50:25 -0700 (PDT) X-Google-Smtp-Source: AB8JxZr4fr0rXV1SP9p5LaJNWNUPFwNVCHwFN0o3XeL0bv1dNNMlquHYgUOsSc9vP5bAC33hLGwK X-Received: by 2002:a17:902:781:: with SMTP id 1-v6mr16071182plj.150.1527565825497; Mon, 28 May 2018 20:50:25 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1527565825; cv=none; d=google.com; s=arc-20160816; b=halh409KvUbtyX3F8ZZXMLDCINCwcbX7+GEYh/bDi21zzmEOiVD2DGjbIgazgtbabf JrQh3eGI72OygLrqZ6C+OfZmUX92lMGLR3g5TPVhGZKibKLSUzZ+ZOiBktiGk1cxVwTq b9dw6omRzHNb9brP2roNbpIJnzGD/j7m0zh0Idbg38hLdkTZZk2DU6ztzSBVfRYcSf/Y MZcaeYEMe+7roApSJaj/mrQBHRqx7gghh1MarA7G/+Fvh8GMBsptIOFeqZGVaHcS9vga SYEf4HGDJjMpkhUMCJ/+Sn4Zav0ZIQGLbMoehdZKLE89J5lKkwtP62JXB1CBO5AEju7T rdoA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :dkim-signature:arc-authentication-results; bh=n1NncnezqX406f1+W15Br1aR7J9vUU82nx3yJAGn4lE=; b=dXW0/2K222H0jQs7Lewj2090dGZZbE5cQE3kDwu7TjdKWLPSWFoPU/N1ZRPkvEEwzZ +T2op3+ZA63ran13a/iJFK7DkNSqB/AeyO6xctlvY8qD69GMCbxRQE+AnLYf0W+um56i r1Vs1f3TV2r+GoThQXE1pNRTVrxy6f68gO7vJENcWb524ca6T9DeLC6rvFlhdOjv73nv rQ0qm5+I6xqJLAq+FzvdVYQNclgxKa39cYoXzkqScrI5KVgBWZqFaLxAsxcyf18uxLM4 EeiVR8PATJFv7N1IBBpuba/XS3uWkzqtgh7nViZJG8Ex+vOq34mUexlwoIQmcHT82dUB iARA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=ZMnqqbOU; dkim=pass header.i=@fb.onmicrosoft.com header.s=selector1-fb-com header.b=OKrvPNy5; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=fb.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id c21-v6si31614482plo.51.2018.05.28.20.50.10; Mon, 28 May 2018 20:50:25 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@fb.com header.s=facebook header.b=ZMnqqbOU; dkim=pass header.i=@fb.onmicrosoft.com header.s=selector1-fb-com header.b=OKrvPNy5; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=fb.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S933459AbeE1ShJ (ORCPT + 99 others); Mon, 28 May 2018 14:37:09 -0400 Received: from mx0b-00082601.pphosted.com ([67.231.153.30]:47990 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S933255AbeE1ShG (ORCPT ); Mon, 28 May 2018 14:37:06 -0400 Received: from pps.filterd (m0001255.ppops.net [127.0.0.1]) by mx0b-00082601.pphosted.com (8.16.0.22/8.16.0.22) with SMTP id w4SIawwU019411; Mon, 28 May 2018 11:36:58 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-id : content-transfer-encoding : mime-version; s=facebook; bh=n1NncnezqX406f1+W15Br1aR7J9vUU82nx3yJAGn4lE=; b=ZMnqqbOUEsgtwXCUpYB2dY6SFAZvGIWf5VbBiO8QyJfKwlGnOrjUEZLf/a9HfCVNropj FweQ+QrIgHAy0tnSeuif6hdJ4+LQontvHi0Uv63tqFch3bs4Fm6RUmeVcdVpK6lsKKA6 1aPG025di33KDV5W2449VmFClCZk2mESnY4= Received: from mail.thefacebook.com ([199.201.64.23]) by mx0b-00082601.pphosted.com with ESMTP id 2j8n6k071c-1 (version=TLSv1 cipher=ECDHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 May 2018 11:36:58 -0700 Received: from PRN-CHUB02.TheFacebook.com (2620:10d:c081:35::11) by PRN-CHUB03.TheFacebook.com (2620:10d:c081:35::12) with Microsoft SMTP Server (TLS) id 14.3.361.1; Mon, 28 May 2018 11:36:56 -0700 Received: from NAM03-BY2-obe.outbound.protection.outlook.com (192.168.54.28) by o365-in.thefacebook.com (192.168.16.12) with Microsoft SMTP Server (TLS) id 14.3.361.1; Mon, 28 May 2018 11:36:55 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.onmicrosoft.com; s=selector1-fb-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=n1NncnezqX406f1+W15Br1aR7J9vUU82nx3yJAGn4lE=; b=OKrvPNy5kKbK6XuS4QlKc6bXuZa4VDfbItipyvd7zPrOet0k2207FgyyDVCbkRaR82oY7azHGYRFyrJShrm32Oe3n5F/YCzF10tHvIu/P3okVtOiLQpcEMjK4SLOzJ6d6ErYr9N44VRCD1Ov9rtP5mVGeX83+xhrvjst4q65/Eo= Received: from MWHPR15MB1165.namprd15.prod.outlook.com (10.175.2.19) by MWHPR15MB1903.namprd15.prod.outlook.com (10.174.100.140) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.797.11; Mon, 28 May 2018 18:36:53 +0000 Received: from MWHPR15MB1165.namprd15.prod.outlook.com ([fe80::9485:7727:4b71:8cc0]) by MWHPR15MB1165.namprd15.prod.outlook.com ([fe80::9485:7727:4b71:8cc0%14]) with mapi id 15.20.0797.017; Mon, 28 May 2018 18:36:53 +0000 From: Song Liu To: Thomas Gleixner CC: Tariq Toukan , Song Liu , Dmitry Safonov <0x7f454c46@gmail.com>, open list , Maor Gottlieb , "Kernel Team" Subject: Re: WARNING and PANIC in irq_matrix_free Thread-Topic: WARNING and PANIC in irq_matrix_free Thread-Index: AQHT9GSPvVlQSgBGI0+pRnF2w/wY8aRE+2SAgAAGngCAADUVAIAARdAA Date: Mon, 28 May 2018 18:36:52 +0000 Message-ID: <095C8C48-56BC-43E0-8885-17D9F3F569FB@fb.com> References: <16f47fa4-1555-cddb-3dfb-7d56fb992ea1@mellanox.com> <1b4ded38-f217-fafa-d920-cddf980a685c@mellanox.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3445.6.18) x-originating-ip: [2620:10d:c090:180::1:be] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;MWHPR15MB1903;7:0aB8kP/ZoAvv1IIYK1lUxCQp2UvTUVrlVaOg5T3d+gkPr9sHLsgV8noYPrFjeAzeBog4WBwOnJTJuS/YISg+rNxg7dnQkCt3NDhYh9zR+lxOYW7t3tFgOVFLg/YJjzU7o5CNxIQzAavtAvWgVkHi4teGIyHy9MynPGiykjUpo4dVrX9zMKFQOleU3yCxiDAayu94icV02d/xoIqj9CgT13jAlDnh1moW7QURafhs284X+PFGvyoCofLoJ8Q3fJEv;20:EC2cnNIedRdrr7rPm5EC8l748USd9YB2bBZWF+d+k7Pwbn51Pw4uYKAiHAiWrvqdYYPtIXXQ+FB0cd72WPZ9PyAlgCniWmXIL3zFTwIdgEDsWuP753k3rMYviZp3Wun5lzHGMeuOii6a2goa+egkuO9FostvAMnU9Jh1H8GpSI4= x-ms-exchange-antispam-srfa-diagnostics: SOS; x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(5600026)(4534165)(4627221)(201703031133081)(201702281549075)(2017052603328)(7153060)(7193020);SRVR:MWHPR15MB1903; x-ms-traffictypediagnostic: MWHPR15MB1903: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(8211001083)(6040522)(2401047)(8121501046)(5005006)(93006095)(93001095)(3002001)(3231254)(11241501184)(944501410)(52105095)(10201501046)(149027)(150027)(6041310)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123562045)(20161123558120)(20161123564045)(6072148)(201708071742011)(7699016);SRVR:MWHPR15MB1903;BCL:0;PCL:0;RULEID:;SRVR:MWHPR15MB1903; x-forefront-prvs: 06860EDC7B x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(366004)(39380400002)(376002)(396003)(346002)(39860400002)(199004)(189003)(6436002)(8936002)(476003)(7736002)(305945005)(6486002)(229853002)(33656002)(2616005)(39060400002)(446003)(46003)(5250100002)(11346002)(36756003)(93886005)(57306001)(82746002)(8676002)(81166006)(86362001)(2900100001)(486006)(81156014)(316002)(54906003)(6916009)(5660300001)(478600001)(99286004)(106356001)(105586002)(50226002)(6512007)(83716003)(76176011)(6506007)(102836004)(53546011)(59450400001)(68736007)(25786009)(6246003)(6116002)(14454004)(53936002)(97736004)(2906002)(4326008)(3660700001)(3280700002)(186003);DIR:OUT;SFP:1102;SCL:1;SRVR:MWHPR15MB1903;H:MWHPR15MB1165.namprd15.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1; received-spf: None (protection.outlook.com: fb.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: oBLw3lSfeaZCg9zq+M0OrHaPTjozCs82rbLR5yasouuR5kFW0EzqwkoltYazz3QpNqxY6VTbdiElvtIPsMzcmkB68Ja+v7uBYo8wsEbLsU/gcqT2jdlI3E4wTT+qeLI0oHY6Dq4n8ExYBCwXcKdn6gYhqvudiBIjacWnHOt1F+DXIQk2d/xoq2fokZjEF9TP spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-ID: <2DA92A3CFE2A254BA5D847C0B52A2156@namprd15.prod.outlook.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: 08f11466-4257-4e79-8bc8-08d5c4c9fb86 X-MS-Exchange-CrossTenant-Network-Message-Id: 08f11466-4257-4e79-8bc8-08d5c4c9fb86 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 May 2018 18:36:52.9068 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 8ae927fe-1255-47a7-a2af-5f3a069daaa2 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR15MB1903 X-OriginatorOrg: fb.com X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-05-28_11:,, signatures=0 X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org > On May 28, 2018, at 7:27 AM, Thomas Gleixner wrote: >=20 > On Mon, 28 May 2018, Tariq Toukan wrote: >> On 28/05/2018 1:53 PM, Thomas Gleixner wrote: >>> On Fri, 25 May 2018, Song Liu wrote: >>>> On Wed, May 23, 2018 at 1:49 AM, Thomas Gleixner >>>> wrote: >>>>> On Wed, 23 May 2018, Tariq Toukan wrote: >>>>>> I have your patch merged into my internal branch, it prints the >>>>>> following: >>>>>>=20 >>>>>> [ 4898.226258] Trying to clear prev_vector: 0 >>>>>> [ 4898.226439] Trying to clear prev_vector: 0 >>>>>>=20 >>>>>> i.e. vector(0) is lower than FIRST_EXTERNAL_VECTOR. >>>>>=20 >>>>> Could you please enable the vector and irq matrix trace points and >>>>> capture >>>>> the trace when this happens? >>>=20 >>> Does the patch below fix it? >>>=20 >>> Thanks, >>>=20 >>> tglx >>>=20 >>> 8<------------------- >>> diff --git a/arch/x86/kernel/apic/vector.c b/arch/x86/kernel/apic/vecto= r.c >>> index bb6f7a2148d7..54af3d4884b1 100644 >>> --- a/arch/x86/kernel/apic/vector.c >>> +++ b/arch/x86/kernel/apic/vector.c >>> @@ -148,6 +148,7 @@ static void apic_update_vector(struct irq_data *irq= d, >>> unsigned int newvec, >>> * prev_vector for this and the offlined target case. >>> */ >>> apicd->prev_vector =3D 0; >>> + apicd->move_in_progress =3D false; >>> if (!apicd->vector || apicd->vector =3D=3D MANAGED_IRQ_SHUTDOWN_VECTO= R) >>> goto setnew; >>> /* >>>=20 >>=20 >> I took it into my internal branch. Will let you know. >=20 > Note, I'd still like to see a trace w/o the patch which shows which order > of events leads to this. Even if the patch cures it, it might just paper > over it and not fixing the root cause. >=20 > Thanks, >=20 > tglx I just checked trace without the patch. It looks the same as the one with the patch.=20 Thanks, Song