Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <b6a503b7-b421-a5c0-1cc8-4f1567b8d9de@amd.com>
Date:   Wed, 12 Oct 2022 10:34:47 +0530
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101
 Thunderbird/91.9.1
Subject: Re: Invalid event (cycles:pp) in per-thread mode, enable system wide
 with '-a'.
Content-Language: en-US
To:     Nick Desaulniers <ndesaulniers@google.com>
Cc:     Stephane Eranian <eranian@google.com>,
        Slade Watkins <srw@sladewatkins.net>,
        linux-perf-users <linux-perf-users@vger.kernel.org>,
        LKML <linux-kernel@vger.kernel.org>,
        Ian Rogers <irogers@google.com>,
        Namhyung Kim <namhyung@gmail.com>,
        Kees Cook <keescook@chromium.org>, sandipan.das@amd.com,
        Bill Wendling <morbo@google.com>,
        clang-built-linux <llvm@lists.linux.dev>,
        Yonghong Song <yhs@fb.com>,
        Peter Zijlstra <peterz@infradead.org>,
        Ravi Bangoria <ravi.bangoria@amd.com>
References: <CAKwvOdnrHErOK+w878izVauHUKaX3eD-HXgigq2Ogm3iSj-fHA@mail.gmail.com>
 <76CB17D0-5A66-4D49-A389-8F40EC830DC0@sladewatkins.net>
 <CAP-5=fXVgwMO_CpS-EHN6PFhLB-J5Ft7qHz7oQd-WOMnTj72Cw@mail.gmail.com>
 <CAM9d7chvZjZ4YVc6j3w7OkdHteyJ0GUZboieu9G7jAWBevoZqA@mail.gmail.com>
 <e553c4f8-ed3d-0755-cc8a-b5ffe43b2c2f@amd.com>
 <CAKwvOdk6TTNhu_+FdONTXPo9Z8u5D4-5kf-rMN8oK4+6fMyc-w@mail.gmail.com>
 <CABPqkBQVfQFJKCdHXEMGFcupzvy8zq14F52eLW5s9vr2Shmi6w@mail.gmail.com>
 <85822c3c-2254-52cc-e6b1-9c89adb63771@amd.com>
 <CAKwvOdkfEexsE07XXGW3FF+nMt-pR8uv2EA7QzsPbEZsSQBO-Q@mail.gmail.com>
 <85aabdc8-07cd-3285-1f3f-605f9ebbab18@amd.com>
From:   Ravi Bangoria <ravi.bangoria@amd.com>
In-Reply-To: <85aabdc8-07cd-3285-1f3f-605f9ebbab18@amd.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?SktYaDYwSVdPL3JpR1JtdmZIdlYrOUlTVkRyTHhENzl0SXhKaWg2cSsvZStY?=
 =?utf-8?B?bDVwZkM2a0pvaVcwRS9rbVk2clZwMEhDZGRuenRmc2pYM1V1TVl4RmdacUF2?=
 =?utf-8?B?WENlTjhURTFacS9ya1JZaWxvOGtPWlJLQVhEZ1VNVHNHSFFvR0pzS0EwMlZR?=
 =?utf-8?B?NFB3TlJ2WHZwdmhRcmszS2dNeHk1bmhqNGVuV0J3M2FtMDhmZWplWi9TZUwy?=
 =?utf-8?B?SUNCN2hUL1BXalBzSjl5cUUvWkQrc1dsZmFNSHBBZXNzNFRIZ2dRK3dFNFJz?=
 =?utf-8?B?NHFrQ2JmRWtBMm8yQVZtZmFVUFJVM09EOWpvUm9iTitadThRRnhOSE9sdit0?=
 =?utf-8?B?M0QrWU5tM2NxbTJsM3NzNU9MbjVia3o2UzIyVXF0bG9DL2pPWkhISkpoRkQ5?=
 =?utf-8?B?ejBpSUFaSGFWTGhBWUpDVDlFWUJvR092dktwQ3IyUU9id3FFNjRaRWtmelN3?=
 =?utf-8?B?UEI4RisvN2hiZUlRcmI1VFo5N0M5YWQxdGg0NFFlZ2FPaEZXVktaYXNWa2Vj?=
 =?utf-8?B?WkNxbUxlK0psM0xLeWJyajRVcUhhR1c5cVpZUTdGbWVNTU9lSDZEbXB2VDdm?=
 =?utf-8?B?aGN0UUQ4N0ZYaDNZaEZLNlV4RDcvN2J0K2JkYzc4RnNFM3pEUXAxckZUTHhy?=
 =?utf-8?B?a0dQZmhmWHE4QmlreEpSaEFaMG1EVURvcllZaW5CZ09UaEF0c1kzaUJsTFZm?=
 =?utf-8?B?M0RaNHBIVnk4Q0QrVjdvQUFwVVp0Um5KakZuUzc4ZS9ySCs2RG1TYnN2RFgy?=
 =?utf-8?B?azFoejZXTVJya1dXMnQ3MkRTUXlROHVIVHIzK1VEL2tnU3BIQWJGUU92TkRu?=
 =?utf-8?B?VGZPNk9LTGFXbWhoSjJwR09pVUVTUWZmeXJpRmk4TlF2TGtjU0owYjVLWStG?=
 =?utf-8?B?ZjNkMjJpSkVnVDNocmlYNTk3QWZjcG55dmxDZkpPK0l3YlNReXNRZk9sYUdR?=
 =?utf-8?B?T0xxNy83ekpYOFZhZFQ3Rmh4dldTZFlSc0pqRENwbWo5eHRSWVo5eUwzbGYx?=
 =?utf-8?B?L3l5LzdLZFAxSHRna29meWVweDlSTzdkNThNamFzWFVGTGtXMnRGb09jSlZE?=
 =?utf-8?B?U3BidnJ1WWV1a1gyT0tyRU9GcjZ2OUNCWEF3M1VFckoyK0dnbThWejBCUnkw?=
 =?utf-8?B?b0l4aHdjTnlIRWxGRENwMXZhb25iRUQrVjNFOWZlVkkreVU5eTQ3NmVXM3la?=
 =?utf-8?B?RVN2di85dUhCZmFFWlNjNmx3T3JnUGxPK3lmQWJaS2NLWDUvTENLTDhpL0ZX?=
 =?utf-8?B?RURuRnZvNjZKRFg4TWpsYlVuN21lcDduK0hpTUgzZnlGS0ZFUUxiR1JHQXV4?=
 =?utf-8?B?dG13SnZiRWF6SkFHdHIvWGRVUW95SHBYOE5QeUJPMVRNejNkTUxPS1UzbHlQ?=
 =?utf-8?B?VUVUalZHZGFFdkZzcEFpdittandna3pvWUZ2QkRnQnR3SnZxRXQxdkRyblcr?=
 =?utf-8?B?ZHZyTW5nb0RONEJiMExsc2JCRHdyZlBycE9iem44OGRGRGs5N2FidUVNOGtI?=
 =?utf-8?B?T05iU2JJd2xLSE96K3Ewd1R3TVdSMUlURWlEUmMyNE5LU05NRXhvbXJ6cW1R?=
 =?utf-8?B?ZzZEcHIzQ1NRRWxtSkhJM29mMWxNL2xEZTVQam1YT3BNUHN4RjdZWnFCdEY3?=
 =?utf-8?B?ZkZOaEJCanlaZHhLNjlldUtxRUErLzJKM2tJNks3bVYzaitaUDk0Qm9mRTdI?=
 =?utf-8?B?RTBPemFHeTZteVNaREErODVZOU9COXVDMEROUk5Lb0NWQm01dzJxZVg1aCtY?=
 =?utf-8?B?a3FoU3ZwUnFHTjFCMEZGMExtcEhCVFJMdnhxb3VwTnFCNEdJb3NyNmQ1djFq?=
 =?utf-8?B?QTIyMit5djlpUWR1d09UTDNxclJGRGtwWXY4ZE1lekJpeVJrV1RpUG0yQ3VF?=
 =?utf-8?B?NnJhQTdvUnk2NERMemlKR3Z0K1BDdzYzcWFXQzhCK0Mvbi9YMEdWOXF4MUxD?=
 =?utf-8?B?YzMrWm8zUWZselVHWXcwdG5YeFgyKythK1JvNHJ5ZWZLWDJGYysxSmhJdVFW?=
 =?utf-8?B?QVA2enBHNXlDcjN4MTdjWFVWMHlQWHJUQmxjMjNxcXVhTHNkeGJ4aGpIOTdI?=
 =?utf-8?B?UlR4K0hCZVRwTlNlTVJpZ1dtc3pTRE5PMUVuZUVidXRDWXNsNFhESHFQWndD?=
 =?utf-8?Q?WwGFT5jq0tS5bzDqndXyh1uuM?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: e00e6398-a5a1-4734-235c-08daac0f508d
X-MS-Exchange-CrossTenant-AuthSource: DS0PR12MB6584.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Oct 2022 05:05:00.5228
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 0tnpqLCuhrL8QYD4XhzdabFz7uXgAGVjb1oH2WPWz8dyMM2a2Ef5vqPk5ywpKOQRVRULGuGNWH9j2R7R/zvSgg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB4516
X-Spam-Status: No, score=-5.0 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 12-Oct-22 9:36 AM, Ravi Bangoria wrote:
> On 12-Oct-22 3:02 AM, Nick Desaulniers wrote:
>> On Thu, Oct 6, 2022 at 8:56 PM Ravi Bangoria <ravi.bangoria@amd.com> wrote:
>>>
>>> +cc: PeterZ
>>>
>>>>>>>> +Ravi who may be able to say if there are any issues with the precise
>>>>>>>> sampling on AMD.
>>>>>>>
>>>>>>> Afaik cvcles:pp will use IBS but it doesn't support per-task profiling
>>>>>>> since it has no task context.  Ravi is working on it..
>>>>>>
>>>>>> Right.
>>>>>> https://lore.kernel.org/lkml/20220829113347.295-1-ravi.bangoria@amd.com
>>>>>
>>>>> Cool, thanks for working on this Ravi.
>>>>>
>>>>> I'm not sure yet whether I may replace the kernel on my corporate
>>>>> provided workstation, so I'm not sure yet I can help test that patch.
>>>>>
>>>>> Can you confirm that
>>>>> $ perf record -e cycles:pp --freq=128 --call-graph lbr -- <command to profile>
>>>>>
>>>>> works with just that patch applied? Or is there more work required?
>>>>> What is the status of that patch?
>>>>>
>>>>> For context, we had difficulty upstreaming support for instrumentation
>>>>> based profile guided optimizations in the Linux kernel.
>>>>> https://lore.kernel.org/lkml/CAHk-=whqCT0BeqBQhW8D-YoLLgp_eFY=8Y=9ieREM5xx0ef08w@mail.gmail.com/
>>>>> We'd like to be able to use either instrumentation or sampling to
>>>>> optimize our builds.  The major barrier to sample based approaches are
>>>>> architecture / micro architecture issues with sample based profile
>>>>> data collection, and bitrot of data processing utilities.
>>>>> https://github.com/google/autofdo/issues/144
>>>>
>>>> On existing AMD Zen2, Zen3 the following cmdline:
>>>> $ perf record -e cycles:pp --freq=128 --call-graph lbr -- <command to profile>
>>>>
>>>> does not work. I see two reasons:
>>>>
>>>> 1. cycles:pp is likely converted into IBS op in cycle mode.
>>>>     Current kernels do not support IBS in per-thread mode.
>>>>     This is purely a kernel limitation
>>>
>>> Right, it's purely a kernel limitation. And below simple patch on top
>>> of event-context rewrite patch[1] should be sufficient to make cycles:pp
>>> working in per-process mode on AMD Zen.
>>>
>>> ---
>>> diff --git a/arch/x86/events/amd/ibs.c b/arch/x86/events/amd/ibs.c
>>> index c251bc44c088..de01b5d27e40 100644
>>> --- a/arch/x86/events/amd/ibs.c
>>> +++ b/arch/x86/events/amd/ibs.c
>>> @@ -665,7 +665,7 @@ static struct perf_ibs perf_ibs_fetch = {
>>>
>>>  static struct perf_ibs perf_ibs_op = {
>>>         .pmu = {
>>> -               .task_ctx_nr    = perf_invalid_context,
>>> +               .task_ctx_nr    = perf_hw_context,
>>>
>>>                 .event_init     = perf_ibs_init,
>>>                 .add            = perf_ibs_add,
>>> ---
>>>
>>> [1]: https://lore.kernel.org/lkml/20220829113347.295-1-ravi.bangoria@amd.com
>>
>> Hi Ravi,
>> I didn't see the above diff in
>> https://lore.kernel.org/lkml/20221008062424.313-1-ravi.bangoria@amd.com/
>> Was there another distinct patch you were going to send for the above?
> 
> Yes Nick. I was planning to send it once the rewrite stuff goes in.

Hi Nick,

Since you have practical use case, would it be possible to run your workflow
with perf rewrite and IBS patches applied? It will help us in finding/fixing
more bugs and upstreaming these changes.

Thanks,
Ravi