Received: by 2002:a19:ef0c:0:0:0:0:0 with SMTP id n12csp979766lfh; Thu, 27 Jan 2022 04:42:43 -0800 (PST) X-Google-Smtp-Source: ABdhPJzrLAd6OkXCudvMikCaUKGIT6D5Us3TOnVnvnKyWJnSTyX1KQH6jH78XgmvII3LLzm/gJCz X-Received: by 2002:a17:907:720e:: with SMTP id dr14mr2915594ejc.196.1643287362802; Thu, 27 Jan 2022 04:42:42 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1643287362; cv=none; d=google.com; s=arc-20160816; b=kA+uMsKVwy+eRNAkw1jCKBQsmWZyWqv0m7qy45Js5tp8Y1sh7EBCo/Efgf4gOTnA1A hJw2DSHWN3ARzUINgusXFp3NqdTdSiQ4wZVxXxWbUoa1Spbc1l2I/4kWIXuMSKZtDP3K yeOMCo0jtHYtFik2E0/XgLvqDYdknEQi2BFomlLswhLWRlkYn5zVeJpt9T72HAhLdgMD Wd86h87IIQokkbjTTg+e4KUDUobqj05jWAaWLOAbHbwmTCUXgADIdVpksMe0ko6Zo7QL G7jEoPDG4OeVsfTxcX69jeZfqrkSYlJpx5mVTZwa5QAVoI9NSIzx5Xon7dzlVtePTRXF rYow== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:organization:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature; bh=O+ANKA+yxN1KZYMJAW1kmAJbDa4gy4GQv3Gy4uchB/c=; b=racMi5iwxk8LKdxcqT4BHEgCMvneoB0n+LaInad3QuvN93dQ8tYKdGRIDl5z0uu6K1 Te84eLFkY4rqKAhrdU6JwVlaB9ZhES8KlSZY9xOZnAHfoQWdaFlS5CvH4AxftF9LDDW8 1jQko5hKwfaSZT0NRtb2xKPMz04Znej3/A33b4XXiVt3vZUWrzvChB6jGuV6JtTWOpVh zXacUVQYn9KoFZSryl4vBgxVoQjKKRtee/rPpP9/M6Gofk6oTssv8pJR5lCQCx7sSvCS RU8+M2FM08UJG6w6Mh3KI1G4kE5RFFr5yYIclFb4R3rybqCLdnfTVu1nYfx/BIPwIb8k LMQg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=BTN03Rbv; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id v4si1174862ejk.149.2022.01.27.04.41.54; Thu, 27 Jan 2022 04:42:42 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@intel.com header.s=Intel header.b=BTN03Rbv; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236714AbiA0G3X (ORCPT + 99 others); Thu, 27 Jan 2022 01:29:23 -0500 Received: from mga07.intel.com ([134.134.136.100]:58431 "EHLO mga07.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231461AbiA0G3W (ORCPT ); Thu, 27 Jan 2022 01:29:22 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1643264962; x=1674800962; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=JkOo36tz8YaoDuZXPsp9O8nW6ib1sRzLUQMQhkkfdUQ=; b=BTN03RbvFhT+b7H0V0o1ZxLRME0MvTjWJp0P7lgHx3ynzei1VDxw6r4I TKEz7Fttah+ee/HGoJoTdZ8gCwtl0r0EwMaK+txeqd1RpYivhI4HVodiL feZ0Iefw2k1I+16DvUngRSrzPjcUM2ovZJkqphaMc9++LTlI1fOIrxgs6 BjqYJVDvEoUC1fMSm57LTzPM/DSUeO94PXZKYZyBjJhNMFYjvExKMizJC FyVU69Pnyp5UT5GTulNBFspWygFY65vu88TsxLbqNf1PhsvWVuPRYsq6B h+CUH1DDz/96Q1EHzOw2CxFKJ91Zu/MO2m0rdtjAhqIS2W0YaLpUHInxH Q==; X-IronPort-AV: E=McAfee;i="6200,9189,10239"; a="310076972" X-IronPort-AV: E=Sophos;i="5.88,320,1635231600"; d="scan'208";a="310076972" Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by orsmga105.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jan 2022 22:29:22 -0800 X-IronPort-AV: E=Sophos;i="5.88,320,1635231600"; d="scan'208";a="618225100" Received: from lahna.fi.intel.com (HELO lahna) ([10.237.72.162]) by fmsmga003-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jan 2022 22:29:18 -0800 Received: by lahna (sSMTP sendmail emulation); Thu, 27 Jan 2022 08:29:15 +0200 Date: Thu, 27 Jan 2022 08:29:15 +0200 From: Mika Westerberg To: Kai-Heng Feng Cc: bhelgaas@google.com, koba.ko@canonical.com, Russell Currey , Oliver O'Halloran , Lalithambika Krishnakumar , Joerg Roedel , Lu Baolu , linuxppc-dev@lists.ozlabs.org, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH 1/2] PCI/AER: Disable AER when link is in L2/L3 ready, L2 and L3 state Message-ID: References: <20220126071853.1940111-1-kai.heng.feng@canonical.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Organization: Intel Finland Oy - BIC 0357606-4 - Westendinkatu 7, 02160 Espoo Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi, On Thu, Jan 27, 2022 at 10:21:35AM +0800, Kai-Heng Feng wrote: > On Wed, Jan 26, 2022 at 7:03 PM Mika Westerberg > wrote: > > > > Hi, > > > > On Wed, Jan 26, 2022 at 03:18:51PM +0800, Kai-Heng Feng wrote: > > > Commit 50310600ebda ("iommu/vt-d: Enable PCI ACS for platform opt in > > > hint") enables ACS, and some platforms lose its NVMe after resume from > > > S3: > > > [ 50.947816] pcieport 0000:00:1b.0: DPC: containment event, status:0x1f01 source:0x0000 > > > [ 50.947817] pcieport 0000:00:1b.0: DPC: unmasked uncorrectable error detected > > > [ 50.947829] pcieport 0000:00:1b.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Receiver ID) > > > [ 50.947830] pcieport 0000:00:1b.0: device [8086:06ac] error status/mask=00200000/00010000 > > > [ 50.947831] pcieport 0000:00:1b.0: [21] ACSViol (First) > > > [ 50.947841] pcieport 0000:00:1b.0: AER: broadcast error_detected message > > > [ 50.947843] nvme nvme0: frozen state error detected, reset controller > > > > > > It happens right after ACS gets enabled during resume. > > > > Is this really because of the above commit of due the fact that AER > > "service" never implemented the PM hooks in the first place ;-) > > >From what I can understand, all services other than PME should be > disabled during suspend. > > For example, should we convert commit a697f072f5da8 ("PCI: Disable PTM > during suspend to save power") to PM hooks in PTM service? Yes, I think that's the right thing to do. I wonder how it was not using the PM hooks in the first place.