Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:4 as permitted sender) client-ip=2620:137:e000::3:4;
Received-SPF: Pass (protection.outlook.com: domain of arm.com designates
 63.35.35.123 as permitted sender) receiver=protection.outlook.com;
 client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com;
 pr=C
Authentication-Results-Original: dkim=none (message not signed)
 header.d=none;dmarc=none action=none header.from=arm.com;
Message-ID: <8f8a2e42-f6ed-4328-9457-5f986d761224@arm.com>
Date:   Thu, 26 Oct 2023 17:52:20 +0100
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v9 3/4] drivers/perf: add DesignWare PCIe PMU driver
Content-Language: en-GB
To:     Jonathan Cameron <Jonathan.Cameron@Huawei.com>,
        Shuai Xue <xueshuai@linux.alibaba.com>
Cc:     Will Deacon <will@kernel.org>, Bjorn Helgaas <helgaas@kernel.org>,
        Yicong Yang <yangyicong@huawei.com>,
        chengyou@linux.alibaba.com, kaishen@linux.alibaba.com,
        baolin.wang@linux.alibaba.com, linux-kernel@vger.kernel.org,
        linux-arm-kernel@lists.infradead.org, linux-pci@vger.kernel.org,
        rdunlap@infradead.org, mark.rutland@arm.com,
        zhuo.song@linux.alibaba.com, renyu.zj@linux.alibaba.com
References: <20231020134230.53342-1-xueshuai@linux.alibaba.com>
 <20231020134230.53342-4-xueshuai@linux.alibaba.com>
 <20231023123202.GA3515@willie-the-truck>
 <cf72afb6-44c7-45f0-bfaa-6881f6782ebf@arm.com>
 <5b695595-d243-4ea5-97bb-f4c74398fc27@linux.alibaba.com>
 <20231026144428.00005db8@Huawei.com>
From:   Robin Murphy <robin.murphy@arm.com>
In-Reply-To: <20231026144428.00005db8@Huawei.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
NoDisclaimer: true
X-Microsoft-Antispam-Message-Info-Original: aUMWRlZ5sQmQqTrvZQJmUBfRZ+3apZJSvP8RRwqBlJRIlo19Vrr3ppy0Hwp8aj6K14Wib91cVDgdgpIQcEIpFKk5ZJ0YKNU3pYslz0maodx+ezF88B9WibFT8O5R6JtbWOIUGWpzjPgG6oEnm7K5A1KfntgYAONGKVRkULTb1url5zSCPRLrZUpikzc7YZuZTIBJ98yJuLLW5D3VuVroCqBAks9JxgI73u11WNggfeDLWq9c5/uVUpaQtQxMC/lkguhpqJ56zyBorYKP+McyCOlpKOFBWghThIha0XO5ylMPSI3k5UmVBaRZCjBYyLqiudA4hnvGSlmiFVJB5OfSWK9xadB+F9VUrYLgCYu+tlWEDWnYNkcjkLr572M42QGAf5OAUy5gf2HW/TKCZUa0wdjd2+tSB/QHyTbv44eGEFljw/xQQmLUQFljWk+eQ4IGgwnSTBzLACFnwM1sGz+OJjf/Hl7hVa/dQ9IiuXF76CRJgArA409DRJdlEdFoPf0DgPFS++7//OJiZciAWcxKIf2V0HSbMCmeiYwyYDGiA3k9D9qphTwphgTdacehC6U8RB5hVvE7vp2Vsocy71wD9i4JC/Ot4Hd+bYOehe4H2WlLTcf9HiUEwJ3gf1midSf+MmoXr5+ikR0L6rimT3uq6Q==
X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DB9PR08MB6650.eurprd08.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(39860400002)(346002)(396003)(366004)(376002)(136003)(230922051799003)(451199024)(186009)(1800799009)(64100799003)(2616005)(38100700002)(6512007)(6506007)(53546011)(8936002)(41300700001)(83380400001)(26005)(478600001)(4326008)(6486002)(44832011)(4001150100001)(7416002)(66946007)(66476007)(110136005)(54906003)(316002)(66556008)(8676002)(5660300002)(36756003)(31696002)(86362001)(31686004)(6666004)(2906002)(43740500002)(45980500001);DIR:OUT;SFP:1101;
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB4PR08MB8104
Original-Authentication-Results: dkim=none (message not signed)
 header.d=none;dmarc=none action=none header.from=arm.com;
X-EOPAttributedMessage: 0
X-MS-Exchange-Transport-CrossTenantHeadersStripped: AMS0EPF0000019E.eurprd05.prod.outlook.com
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id-Prvs: 04d58bb7-c8bc-4be3-d65c-08dbd643ef31
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: QvoVajAucjru+FBp9WnXzWGLyJEwun2LstMbJIooouP6rfSW6HO5wIyK61JNXKQzLblSqtB2iTQb2D0YUxKvjQbc67NuQT9ZLzvqbahvrlebY0ZEKK2RIauykHZc8xTHXm1wtOpWDO3RFDoLxdSyFELH1DRdAaTn7j4FquxeOS6ZPa/NdDm+tJReYKArYuGfPSoYk+FaFkCueQFOrOU1EIBEZPJoF7t/89l8L7nxT/zDCi3+MabVdalWyNYaTH6RzX8wPhdFSuJwnB+7Ci1gOuIR53hSe3IoyMcNDc9+2/lR+3z02j3aUu5dVQFoNmwuN3Fx9HCSLGiOYFX7won5LM4gKuDB82gBa88zlmVytEROvNaj62IWkV/Df1gE/k44CdZufQ52o4CjcM7YRMsbiPmNJSm/6xrawTXGSmqXzy9c1kHEXa18+vX3TEwNoFJUKx0cqmvcH0/Havx1GwQm1NM00M6WOs2KPeBf6/2inQF/52qmb9huWENGrcX2bZgDQMsOMweZbLmtKv2TlTL22b5e8T7H+rMTPh2q2kBMRHxzq/Cvwx5YBtlyTtQU8/UxamPkOtwsr3Yv+ZhrZ4/T9Vfmp1GoptX2ojzwDEfBFTRFX5pouvT4eNcBSz39+pyGTlYF2usdA6wz1yAK1Ku9KmPRvTnZnSSyUIBrkNndKlAIBgV2ZTDE+dNp/Q1dClpQKcfS/L96tvr/P5imcCUOBhJrrT0HleThlOe//myVKE/7PrJZIgD6/vDB8M1YzJqILj7fFkF6mYtnXDu5XXwtAA==
X-Forefront-Antispam-Report: CIP:63.35.35.123;CTRY:IE;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:64aa7808-outbound-1.mta.getcheckrecipient.com;PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com;CAT:NONE;SFS:(13230031)(4636009)(136003)(396003)(346002)(376002)(39860400002)(230922051799003)(1800799009)(451199024)(186009)(64100799003)(82310400011)(36840700001)(46966006)(40470700004)(31686004)(40460700003)(26005)(47076005)(2906002)(8676002)(36860700001)(4326008)(44832011)(83380400001)(53546011)(6506007)(36756003)(6512007)(5660300002)(2616005)(6666004)(8936002)(107886003)(6486002)(41300700001)(40480700001)(86362001)(336012)(4001150100001)(110136005)(356005)(31696002)(54906003)(82740400003)(70206006)(478600001)(70586007)(316002)(81166007)(450100002)(43740500002);DIR:OUT;SFP:1101;
X-OriginatorOrg: arm.com
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Oct 2023 16:52:39.0247
 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: 5d835977-77fd-4ee9-3a38-08dbd643f695
X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d
X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d;Ip=[63.35.35.123];Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com]
X-MS-Exchange-CrossTenant-AuthSource: AMS0EPF0000019E.eurprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Anonymous
X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAXPR08MB7492
X-Spam-Status: No, score=-0.7 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,
	SPF_PASS,UNPARSEABLE_RELAY autolearn=unavailable autolearn_force=no
	version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on howler.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (howler.vger.email [0.0.0.0]); Thu, 26 Oct 2023 09:52:59 -0700 (PDT)

On 26/10/2023 2:44 pm, Jonathan Cameron wrote:
> On Tue, 24 Oct 2023 17:29:34 +0800
> Shuai Xue <xueshuai@linux.alibaba.com> wrote:
> 
>> + Will, Jonathan, Bjorn and Yicong for probe and hotplug handing.
>>
>> On 2023/10/24 02:51, Robin Murphy wrote:
>>> On 2023-10-23 13:32, Will Deacon wrote:
>>> [...]
>>>>> +
>>>>> +    /*
>>>>> +     * The Group#1 event measures the amount of data processed in 16-byte
>>>>> +     * units. Simplify the end-user interface by multiplying the counter
>>>>> +     * at the point of read.
>>>>> +     */
>>>>> +    if (event_id >= 0x20 && event_id <= 0x23)
>>>>> +        return (((u64)hi << 32) | lo) << 4;
>>>>> +    else
>>>>> +        return (((u64)hi << 32) | lo);
>>>>
>>>> nit, but I think it would be clearer to do:
>>>>
>>>>      ret = ((u64)hi << 32) | lo;
>>>>
>>>>      /* ... */
>>>>      if (event_id >= 0x20 && event_id <= 0x23)
>>>>          ret <<= 4;
>>>
>>> Nit: "ret *= 16;" since the comment says it's multiplying a value, not moving a bitfield. The compiler already knows the most efficient way to implement constant multiplication.
>>
>> Cool, will use multiplication directly.
>>
>>>    
>>>>
>>>>      return ret;
>>>>   
>>> [...]
>>>>> +static int __init dwc_pcie_pmu_init(void)
>>>>> +{
>>>>> +    int ret;
>>>>> +
>>>>> +    ret = cpuhp_setup_state_multi(CPUHP_AP_ONLINE_DYN,
>>>>> +                      "perf/dwc_pcie_pmu:online",
>>>>> +                      dwc_pcie_pmu_online_cpu,
>>>>> +                      dwc_pcie_pmu_offline_cpu);
>>>>> +    if (ret < 0)
>>>>> +        return ret;
>>>>> +
>>>>> +    dwc_pcie_pmu_hp_state = ret;
>>>>> +
>>>>> +    ret = platform_driver_register(&dwc_pcie_pmu_driver);
>>>>> +    if (ret)
>>>>> +        goto platform_driver_register_err;
>>>>> +
>>>>> +    dwc_pcie_pmu_dev = platform_device_register_simple(
>>>>> +                "dwc_pcie_pmu", PLATFORM_DEVID_NONE, NULL, 0);
>>>>> +    if (IS_ERR(dwc_pcie_pmu_dev)) {
>>>>> +        ret = PTR_ERR(dwc_pcie_pmu_dev);
>>>>> +        goto platform_device_register_error;
>>>>> +    }
>>>>
>>>> I'm a bit confused as to why you're having to create a platform device
>>>> for a PCI device -- is this because the main designware driver has already
>>>> bound to it? A comment here explaining why you need to do this would be
>>>> very helpful. In particular, is there any dependency on another driver
>>>> to make sure that e.g. config space accesses work properly? If so, we
>>>> probably need to enforce module load ordering or something like that.
>>>
>>> AFAICS the platform device/driver serve no purpose other than being a hilariously roundabout way to run the for_each_pci_dev() loop in dwc_pcie_pmu_probe() upon module init, and to save explicitly freeing the PMU name/data. Furthermore the devres action for dwc_pcie_pmu_remove_cpuhp_instance() is apparently going for even more style points at module exit by not even relying on the corresponding .remove callback of the tenuous platform driver to undo what its .probe did, but (ab)using the device's devres list to avoid having to keep track of an explicit list of PMU instances at all.
>>
>> You are right.
> 
> Also provides a (potential) parent for the PMU devices which is something
> we were trying to clean up for existing PMUs (which end up in the
> wrong directly in sysfs because they typically don't have parents).

Surely the relevant PCI device would be an even more appropriate parent, 
though, since that's the true topology?

Thanks,
Robin.