Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752025AbdI0SUx (ORCPT ); Wed, 27 Sep 2017 14:20:53 -0400 Received: from mail-by2nam01on0081.outbound.protection.outlook.com ([104.47.34.81]:16112 "EHLO NAM01-BY2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751016AbdI0SUv (ORCPT ); Wed, 27 Sep 2017 14:20:51 -0400 Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Vadim.Lomovtsev@cavium.com; From: Vadim Lomovtsev To: bhelgaas@google.com, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org Cc: Wilson.Snyder@cavium.com, alex.williamson@redhat.com, Vadim Lomovtsev Subject: [PATCH v6] PCI: quirks: update Cavium ThunderX ACS quirk implementation Date: Wed, 27 Sep 2017 11:20:39 -0700 Message-Id: <1506536439-29318-1-git-send-email-Vadim.Lomovtsev@caviumnetworks.com> X-Mailer: git-send-email 2.4.11 In-Reply-To: <1506344920-24016-1-git-send-email-Vadim.Lomovtsev@caviumnetworks.com> References: <1506344920-24016-1-git-send-email-Vadim.Lomovtsev@caviumnetworks.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [50.233.148.156] X-ClientProxiedBy: BN6PR11CA0005.namprd11.prod.outlook.com (10.172.17.15) To CY4PR07MB3000.namprd07.prod.outlook.com (10.172.116.14) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 7b361384-85ba-436b-56a4-08d505d47abb X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001)(2017030254152)(2017052603199)(201703131423075)(201703031133081)(201702281549075);SRVR:CY4PR07MB3000; X-Microsoft-Exchange-Diagnostics: 1;CY4PR07MB3000;3:1Ld/Axbp+/6nSFcPEh79n1pf7YP0v0tIzROyyObLsd9FV7kdroiN6S6ApCkop7jbVJh3LJOrke81Ut64L4zdCr/mv7anq6CWCUn0qoZvesl2Ga9Q/WvdjamoMMoMP3Oy7bnR6lDe777qe9MRFebLhp0KZxQzg6EHMhJ19QsYydZ1e8ajP3ZjAW0rooeJRzHrBC4ZJ9LKDvuUz5KbS2f3//dzm2WWtBQ59aqTO1TChVaFoK40WScGl2PO06Vs31xE;25:awwNEDc2i3Bcsr/9zZdDYltmX8E0dU0HFJfhiwDdamh5Q060I2Lyu/aTLvYLaDpN3b7SHJz2MsBUtiWRkn2hAHLBBO0R3u0uGwV07gJykquA7E9BN4XkxaAF9fhmXJ8r5ABu9xKxO3YpI8O8RD0U5VkFzdOahwzorr688MZho18ASR2O/xoDkJMiplulhqjfIwcV9ZzaZQrM09zcZJyY0r4IVVBCoCMlXbr6UtvDEQTrjNqc3b6XTxbO0GC2WWwmHOjcmIKZKNoFYBTSL9BnNGFtAY33wagWjPbJ0hkCyq1sqqRckcjmhOgrW+u2AX0AM+yeNdwiG0yokDHlhnf/gw==;31:4rFMFpl1pz1VRnjw0n5AZDD9+42CHe25HTbCgxfXeeI2ne2NT6rXpc0D6bzVYyHQjeHwYMNSzHG7XPhUOgxXmB8p08jypHrDCrN9S/LnFKfotXFnrJWMX+Rwp8H8kULs+9njGXNYp8eZ31UsbjhzVXL9kSXMciXG/TO4woRBzC8n93uMUyl7Ph7oP/NJbHW3Sd+j1GHajQTGCV8S3KAMGMuMJ+NtvIRL1xvgjxIcnTo= X-MS-TrafficTypeDiagnostic: CY4PR07MB3000: X-Microsoft-Exchange-Diagnostics: 1;CY4PR07MB3000;20:Q2x0habjPjNxbSIeYJ2Jw5ieWzedzRgjqwPfpOLyOPjrTTQXtJ63kpjad1Wgxs5nbGsfXZ8KggzVmMxxlXyJ/Skp4Ui+w21rYuO0wbfLYoQIcGrl4qCYzXVARt/NN/M9sBggU8lQcCQDPpjyOzybxeF19GCWSaDLDNXuQmzFb/oDRtTdvMNYb7jXwD7/RzNZesp9rvGjqk+2i8kHAUDZkcxfz1NJtT2FvjtZhzfPZpfc5z4sApItvRBjXja2CnX3fJbC9zVUoBbfKETW/Xr7uSq5FMsdHJFiOVWCjNKhlGp3Xa/aexBuRXt6gkEvEE4Y29avUhgRHQ1G9/3QX11rwZK5O4BXC5uXv8qko/rAa7xtnNG9dR8EQ5IVvLwypkfqnl3iDKF5GwgIyafWCj34dRdTkdaqxU52wK8m95B8Dgnr47tNPgmD664pEytYyhaVmPFrdgChv8sdY/rVhI8mP58FmYpuf9+vNRapbRK8u3E2JZz4gSITMP8gC4Q7kZAvMgAas+jUAPwOdnbzgLdRWhacYDnLlbdzoDZTrpB0+hkrtwVDNhZ82JtD4vyoDgEHCgFtLEbK6ndapSqmBX1UQTRmiQuLfw74FleSOrs0Txk=;4:1UyzBMkNCsER7DMPclycyDZMDFION1B+o3S7eCZPjEjYf8huPTLaJ9LfKC2bDCEQ/YFLmzINb4K+1oTFu30c1mDeC8mWc3ZMIb7xbD/NT5G6rOg6mIRT20ahfCNsFc0D4t4v5hiegbAOnekPJ7NHLcoaHpdVnAnoR8bb3hmhVv1tVOpnyfjgcy19NavlECDQOopo+5YI9zUZI5QZHlVs8kPctgxdB6hcdXZWv5BXEk7G1h/7lfvvUfUmqbDhSfn7 X-Exchange-Antispam-Report-Test: UriScan:; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(8121501046)(5005006)(93006095)(10201501046)(3002001)(100000703101)(100105400095)(6041248)(20161123560025)(20161123555025)(20161123558100)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123564025)(20161123562025)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095);SRVR:CY4PR07MB3000;BCL:0;PCL:0;RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095);SRVR:CY4PR07MB3000; X-Forefront-PRVS: 04433051BF X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10009020)(6009001)(6069001)(376002)(346002)(189002)(199003)(81166006)(101416001)(69596002)(42882006)(478600001)(50226002)(48376002)(6486002)(66066001)(5660300001)(16526017)(2950100002)(106356001)(50466002)(53936002)(4326008)(6506006)(5003940100001)(316002)(105586002)(189998001)(8936002)(68736007)(36756003)(25786009)(76176999)(97736004)(72206003)(81156014)(16586007)(47776003)(6512007)(50986999)(15650500001)(575784001)(3846002)(6666003)(6116002)(107886003)(2906002)(7736002)(305945005)(53416004)(8676002);DIR:OUT;SFP:1101;SCL:1;SRVR:CY4PR07MB3000;H:localhost.localdomain.com;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1;CY4PR07MB3000;23:fKmMSLUGCxerj49TWnz4z0Aagy11gPgd4PDXO/u+j?= =?us-ascii?Q?snLy5o1ZswHcDuFrU4koNok5n7a1vGoRNvdkWuIwLUxInIogpcpGssgUVEVD?= =?us-ascii?Q?OYKyEH2kCLF88vumADbdVCi2XVaguTKlcZ0GqTAyd4oHygDUTZMi/dxhbNjy?= =?us-ascii?Q?voJVJeKLfHtO02oS5ExjXczXZHsHa3X1V/+/wmCxI1OCs8G9T/NR/6EXQ4go?= =?us-ascii?Q?41Zb00tyYrAg6xVx/HHl7bwwnhdi8y7NSwbtdOrtp/7w8PpsKKQzlEFx0v7s?= =?us-ascii?Q?WbQHvlwXPqc68f3k9H8LsUIVHktl7eD9JRKGRX7nd34idTZs+SnkRJgYv5xn?= =?us-ascii?Q?bkaoUDhtNGTJ6W3Ucgl2k3KGdm9p6TVuIY8lLpoON37l8pUq3vVXmllHipsA?= =?us-ascii?Q?IEnGUlsc58eIsTFPdFco4O6HuLi77aKwSnfG+sKvoWyl/fwrb/w9m4Tp9qNM?= =?us-ascii?Q?0nDZuOugtGefpBwxGuR3aiV0reXRcjbmWBcCjGW48JQNbfh7EEapCKyHqeA9?= =?us-ascii?Q?JIOC/iu/RmpwaIhts9D6Q6EOtLCuNpVNOVzZJy7rBzKo6aiC6j2RF2hV4gTo?= =?us-ascii?Q?1jt7Ui+eWR5fe8MrJHOZvYjyan5+RsSkLx+2XUmCQJvvQ6bfpbrBj5C3NXgE?= =?us-ascii?Q?VFEZKbp6dKinKF4tsXQfeCJqc745T2dts5j7+6m0gIcu9L3myTxjPHiilQZk?= =?us-ascii?Q?7JYCSyDj5Gig/EIjEUI0wvuKbK6kzVbIVeYL4UOvPoLh/XGmN1MbuPfj7tkI?= =?us-ascii?Q?GzOo1MD9FP6ovp6uuNLXn/eXnYgz+tlyVNs0xVqQhP/dyfhqIKy5E8DBPK+W?= =?us-ascii?Q?xRcmUw2FRuugYXJZpbnqomGwvnZCL6XrdfuIwML5j5xAe6U0ctmb0tkau+Ih?= =?us-ascii?Q?T1vdtncfvQinf8Dlf1bPv09tlvVU5zS6eToWV66wcoMVPTrTtu4ckSzie5K/?= =?us-ascii?Q?E9QYYLb9b7nFjDuhdbwvIe/+DjZ6iLLjQqdXdChBvLyt2Q7c2SEMMt2Q2/71?= =?us-ascii?Q?mDEPHBBT0pGhVP7gnhuvzeLBFTRmu6XN2PleAoJyXR8+/gUYzIrXdlBuCZ/N?= =?us-ascii?Q?Ns5WFcO28UmZ1589c7dik4HBSYgUVpCDihWotF/SSNx4Rf6XO43UnniYkfCK?= =?us-ascii?Q?2aKMOK9XtB6rT2grIV8zAUJIeQcATSHqhcnwizKwlX4O/WnqumTreCCWEOvH?= =?us-ascii?Q?pv6ch3eOfNd5no=3D?= X-Microsoft-Exchange-Diagnostics: 1;CY4PR07MB3000;6:Uxgsp4tiauz5EhxlNMaW3C+5LXY24fM40fKIQJUwR0Adhw42dDRmV5WkStvEd1LMmPLnm2031oPh2QJqvAuTV0fzqLogzvsKm0YvvbG83oJHaWJn/MPZSq8w1uU4t75ZTQsv6O6MuMl+ePjg0I65OyQ7I9QgG/GP9aAB+BSumxPGPknTpc7Au3yVE9gU7K3rVGRyVTimr8c0NF5nDT34CJxoaDbodM/Brv+hV94D8hPRFRiyU9rqzRf7e57Y6uUJf5U5f2RZfAmzvGAJgT/wVwD8+hmWsXs/8qUNpHa1XPiw7gy9cLgEK3BTtcvVszRLr7DAmBcg2EMTxhhufteGlg==;5:yALZUyUw+Z1pIfq38XAjo1mdw50GMnRm6X6w+dp1hcrf3/JS/s9hPSajJRKCZmGd6agCngaKGQyUH3RRAN94A4Z58JDrJf5bhB/63vyWBXSRhpVQZq6K+JbbPjYCBPijOOuhM0LU1Zk15S4YEvNNSg==;24:ljf/PEar3FZJCZn90jq76Gj/HxAqo5oeU2dQPVTm2FG3KKAPgmcZ5qPRn6EZ2dwi6r/HH+w5YzoJL7pl06bAhZh//uIkBfLcadhmZMLwM6E=;7:4dV/CB9pdVmV0y6leIbCVapkAkLbs2nTtLj4kmdBzMbNP5rkr+mY6Yh5PUgJn7o0uhlyjq9Tx16LR3q75An2tCbg68AND9//H3VmxgKEo0gMk0iTcr4EtqBubJJYNa7CY7Um9Ln2EMsHt+my3vsB1ChniID8VNNyi60BgqarWNRXCU58c0K1NsRaAcB7xe1sJjHRBU4ZuaNu95hZK/k/IDsISukM7oy3upYE/eQIFh0= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Sep 2017 18:20:48.3096 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 711e4ccf-2e9b-4bcf-a551-4094005b6194 X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR07MB3000 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2624 Lines: 65 This commit makes Cavium PCI ACS quirk applicable only to Cavium ThunderX (CN8XXX) family PCIE Root Ports which has limited PCI capabilities in terms of no ACS support advertisement. However, the RTL internally implements similar protection as if ACS had completion/request redirection, upstream forwarding and validation features enabled. Current quirk implementation doesn't take into account PCIERCs which also needs to be quirked. So the pci device id check mask is updated and check of device ID moved into separate function. Signed-off-by: Vadim Lomovtsev --- v5 -> v6: comment typo fix: change 0xa00 to 0xa000 drivers/pci/quirks.c | 29 +++++++++++++++++++++-------- 1 file changed, 21 insertions(+), 8 deletions(-) diff --git a/drivers/pci/quirks.c b/drivers/pci/quirks.c index a4d3361..ed6c76d 100644 --- a/drivers/pci/quirks.c +++ b/drivers/pci/quirks.c @@ -4211,20 +4211,33 @@ static int pci_quirk_amd_sb_acs(struct pci_dev *dev, u16 acs_flags) #endif } -static int pci_quirk_cavium_acs(struct pci_dev *dev, u16 acs_flags) +/* + * The Cavium downstream ports doesn't advertise their ACS capability registers. + * However, the RTL internally implements similar protection as if + * ACS had completion redirection, forwarding and validation features enabled. + * So by this flags we're asserting that the hardware implements and + * enables equivalent ACS functionality for these flags. + */ +#define CAVIUM_CN8XXX_ACS_FLAGS (PCI_ACS_RR | PCI_ACS_CR | PCI_ACS_SV | PCI_ACS_UF) + +static __inline__ bool pci_quirk_cavium_acs_match(struct pci_dev *dev) { /* - * Cavium devices matching this quirk do not perform peer-to-peer - * with other functions, allowing masking out these bits as if they - * were unimplemented in the ACS capability. + * Effectively selects all downstream ports for whole ThunderX 1 family + * by 0xa000 mask (which represents 8 SoCs), while the lower bits of device ID + * are used to indicate which subdevice is used within the SoC. */ - acs_flags &= ~(PCI_ACS_SV | PCI_ACS_TB | PCI_ACS_RR | - PCI_ACS_CR | PCI_ACS_UF | PCI_ACS_DT); + return (pci_is_pcie(dev) && + (pci_pcie_type(dev) == PCI_EXP_TYPE_ROOT_PORT) && + ((dev->device & 0xf800) == 0xa000)); +} - if (!((dev->device >= 0xa000) && (dev->device <= 0xa0ff))) +static int pci_quirk_cavium_acs(struct pci_dev *dev, u16 acs_flags) +{ + if (!pci_quirk_cavium_acs_match(dev)) return -ENOTTY; - return acs_flags ? 0 : 1; + return acs_flags & ~(CAVIUM_CN8XXX_ACS_FLAGS) ? 0 : 1; } static int pci_quirk_xgene_acs(struct pci_dev *dev, u16 acs_flags) -- 2.4.11