Received: by 2002:a05:6a10:6d10:0:0:0:0 with SMTP id gq16csp833251pxb; Fri, 22 Apr 2022 12:09:38 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy8z3mP+/B3Ij95pWodw/woyTwoSZglC344G1UEg3J9MHZYvU24hHPbq8Tu2IjY0U7faJ0w X-Received: by 2002:a05:6a00:1484:b0:50b:f383:462b with SMTP id v4-20020a056a00148400b0050bf383462bmr6532048pfu.58.1650654578140; Fri, 22 Apr 2022 12:09:38 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1650654578; cv=none; d=google.com; s=arc-20160816; b=mb9YNJik6hJXCMW2sf68S2qaRMwCm5ydj6QYIi1r3k9rvX4DDvWiHC4z/vrGfROM61 mrTxy+/I/NzCzoUxduEZ4e259XYjl4g6BPPP4LAaGzNppnlspxC++3/k1ETT3NRhQloR V6QoOlp+HwnYcy6nX2MIIsPUyCtVhV6AbcpOvJB26RiPuJ96JLzivEz/P02lUECV+Sg9 zE+tMVuHPnfki45kP9bu/9YhazqeSoCQC6sIBafwKrBjwjh2qWik+GHPTVAa+3/RdxHJ tvdKcWxhYpncesQhvaxeOWj4dY+CLPBVSmPQCXcmid14mkyVM1J3mNFEd93/UTxPUk0v PJjg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:references:message-id:in-reply-to :subject:cc:to:reply-to:from:date:dkim-signature; bh=KBKVZdrDCzBfs5lBS81Nv6vsXeWlt45VTFKRuuZXp1o=; b=QSRrTqLQMYExMceT+7jelXpKfXH3GEf/K0DgNPbrA8jDoBNRYHsaImDeQ1gsxJ+Zhx BFynObkW1tTLN+9df6MTTtbeQjPh05bNLUwMjWgz+mOuDOWiTsRw3sTLC8/5iU0DtecM 4h9pZAeziB8INCVbVdWHZLQXBHoaLArPNGAvEgBkirn4MQIVvZIsy3qlpVAH0nbNc6ps bLak3ZqQzj4H2PoHtOxV5Ux0wmjCxyVncLXh1VZ14ak0v0qS+L3gdwjCdPV1JsJ0lKCT 7YyCDEmcYFFm+tVtdMvlxcsO/9tQn/fjVsMr0wd8/zsUuRCIDtCEt1V9me4a2SVCrDCA xtOg== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@panix.com header.s=panix header.b=j7RQKhZN; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=panix.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [23.128.96.19]) by mx.google.com with ESMTPS id x1-20020a654541000000b003a298545d5asi9187770pgr.323.2022.04.22.12.09.37 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 22 Apr 2022 12:09:38 -0700 (PDT) Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19; Authentication-Results: mx.google.com; dkim=fail header.i=@panix.com header.s=panix header.b=j7RQKhZN; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=panix.com Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 7B30C1A3252; Fri, 22 Apr 2022 11:27:58 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1392629AbiDUVC4 (ORCPT + 99 others); Thu, 21 Apr 2022 17:02:56 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:40354 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S244830AbiDUVCz (ORCPT ); Thu, 21 Apr 2022 17:02:55 -0400 X-Greylist: delayed 1184 seconds by postgrey-1.37 at lindbergh.monkeyblade.net; Thu, 21 Apr 2022 14:00:03 PDT Received: from l2mail1.panix.com (l2mail1.panix.com [166.84.1.75]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 782E76178; Thu, 21 Apr 2022 14:00:01 -0700 (PDT) Received: from mailbackend.panix.com (mailbackend.panix.com [166.84.1.89]) by l2mail1.panix.com (Postfix) with ESMTPS id 4KkqDL0Jm5zDQD; Thu, 21 Apr 2022 16:40:18 -0400 (EDT) Received: from [192.168.125.3] (ip98-164-213-246.oc.oc.cox.net [98.164.213.246]) by mailbackend.panix.com (Postfix) with ESMTPSA id 4KkqD52yctz18CR; Thu, 21 Apr 2022 16:40:05 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=panix.com; s=panix; t=1650573616; bh=3DLk127xG6VmBI2lKNf3p0IKGAxhZ0S9OZakATsgpqs=; h=Date:From:Reply-To:To:cc:Subject:In-Reply-To:References; b=j7RQKhZN/XZTnUPLR9x7uHijW3ePTAXL2PVcl0tnQxrNO+5FexNvT+UJa3k3nTW5V nU00sTmYdbkH720jliREH/mq6ycYwHiXmS7o4+fyGZtnInVPkpjUIYDfPrP6iDHKdJ SqqP4nAgxKSCuqqbmTO1r6kNbGoGlkCu3QXoMgfs= Date: Thu, 21 Apr 2022 13:40:02 -0700 (PDT) From: "Kenneth R. Crudup" Reply-To: "Kenneth R. Crudup" To: Kai-Heng Feng cc: Bjorn Helgaas , Vidya Sagar , bhelgaas@google.com, lorenzo.pieralisi@arm.com, hkallweit1@gmail.com, wangxiongfeng2@huawei.com, mika.westerberg@linux.intel.com, chris.packham@alliedtelesis.co.nz, yangyicong@hisilicon.com, treding@nvidia.com, jonathanh@nvidia.com, abhsahu@nvidia.com, sagupta@nvidia.com, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, kthota@nvidia.com, mmaddireddy@nvidia.com, sagar.tv@gmail.com, Ricky Wu , Rajat Jain , Prasad Malisetty , Victor Ding , "Kenneth R. Crudup" Subject: Re: [PATCH V1] PCI/ASPM: Save/restore L1SS Capability for suspend/resume In-Reply-To: Message-ID: <42f9a28-e67-ec2a-f6-9a8b58edd84d@panix.com> References: <20220415212533.GA844147@bhelgaas> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RDNS_NONE, SPF_HELO_NONE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, 21 Apr 2022, Kai-Heng Feng wrote: > I went through the whole discussion again, maybe Kenneth's case is > also the result of pcie_aspm_pm_state_change()? > Since Kenneth is using TLP to switch ASPM between performance and > powersaving/powersupersaving, that means 'aspm_disabled' is false. > Hence the KOXIA NVMe stops working post suspend and Realtek card > reader toggles L1ss post hibernation. > Kenneth, can you please see if removing pcie_aspm_pm_state_change() > from pci_raw_set_power_state() helps? > Anyway, this can be easier to spot if dmesg was attached. Well, I haven't had an issue with resume/return from hibernate for quite some time, and the patch I'd reported a long time ago is now in the Linus' master I've been running. I believe a BIOS change from Dell fixed it up for me. But if you're looking for information in any case, I could still do this and get back to the topic re: the results. -Kenny -- Kenneth R. Crudup / Sr. SW Engineer, Scott County Consulting, Orange County CA