Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   "Zulkifli, Muhammad Husaini" <muhammad.husaini.zulkifli@intel.com>
To:     "Song, Yoong Siang" <yoong.siang.song@intel.com>,
        "Bezdeka, Florian" <florian.bezdeka@siemens.com>,
        "Brandeburg, Jesse" <jesse.brandeburg@intel.com>,
        "Nguyen, Anthony L" <anthony.l.nguyen@intel.com>,
        "David S . Miller" <davem@davemloft.net>,
        "Eric Dumazet" <edumazet@google.com>,
        Jakub Kicinski <kuba@kernel.org>,
        Paolo Abeni <pabeni@redhat.com>,
        Alexei Starovoitov <ast@kernel.org>,
        Daniel Borkmann <daniel@iogearbox.net>,
        Jesper Dangaard Brouer <hawk@kernel.org>,
        "John Fastabend" <john.fastabend@gmail.com>,
        "Fijalkowski, Maciej" <maciej.fijalkowski@intel.com>,
        Vedang Patel <vedang.patel@intel.com>,
        "Joseph, Jithu" <jithu.joseph@intel.com>,
        Andre Guedes <andre.guedes@intel.com>,
        "Brouer, Jesper" <brouer@redhat.com>,
        "Stanislav Fomichev" <sdf@google.com>,
        "Keller, Jacob E" <jacob.e.keller@intel.com>,
        David Laight <David.Laight@ACULAB.COM>
CC:     "xdp-hints@xdp-project.net" <xdp-hints@xdp-project.net>,
        "netdev@vger.kernel.org" <netdev@vger.kernel.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "stable@vger.kernel.org" <stable@vger.kernel.org>,
        "intel-wired-lan@lists.osuosl.org" <intel-wired-lan@lists.osuosl.org>,
        "bpf@vger.kernel.org" <bpf@vger.kernel.org>
Subject: RE: [PATCH net v3 1/1] igc: read before write to SRRCTL register
Thread-Topic: [PATCH net v3 1/1] igc: read before write to SRRCTL register
Thread-Index: AQHZcHX/ivZcm3VPRkiLBsOfvIXTYa8uyaLQ
Date:   Mon, 17 Apr 2023 02:53:13 +0000
Message-ID: <SJ1PR11MB618095F79E53B077E922F900B89C9@SJ1PR11MB6180.namprd11.prod.outlook.com>
References: <20230414154902.2950535-1-yoong.siang.song@intel.com>
 <ffa2551d-ca04-3fe9-944a-0383e1d079e3@siemens.com>
 <PH0PR11MB58306BDB63286338EABAF61AD89F9@PH0PR11MB5830.namprd11.prod.outlook.com>
In-Reply-To: <PH0PR11MB58306BDB63286338EABAF61AD89F9@PH0PR11MB5830.namprd11.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?RzY7t32d0EXu8SXzGXZeKIGd0ZcCoKOJSeYSaC6fyhst07oO4VnOioGrzx+m?=
 =?us-ascii?Q?tKjyryzFPRPjGSBvTBV04KNWPoTy0SihrL1kNOpc5YpWHrFBy7L0G7PDkHjp?=
 =?us-ascii?Q?DhMaLeZoAXJV4u8OZIfQ1XhDX2BfA8bl8BQTNuDkUpyHJbcqRiGOi4L6YVxb?=
 =?us-ascii?Q?KGH4aNI4ZGloJHU5d3S5wZTEMzu/vXlwTU6xX4YoGCrxTiDztyT5mg5P/sKT?=
 =?us-ascii?Q?FjmwPK/dlp6o98GueLdbaeCj0Lztb3kP+FRIZD9w0+wvRFqgHAxwDwX7otqL?=
 =?us-ascii?Q?fzb0oM66YqBvWtT7bDZIaXZQNL1Eg+l0qWAP5xmBlUOhC23pWGRkyGGejlQp?=
 =?us-ascii?Q?fa2jjuvPo1E42huMEeIB/sSmmN3MRgWODgiwZdZ9kDgrNnHj/4/pvYzZl0wI?=
 =?us-ascii?Q?G9+kAsbOchiIrK21XVic1WEmiMZ36FnEqgjhvWKF8M62SvqTqBGlF063lDjI?=
 =?us-ascii?Q?efA8z1aeaoFR4hR27IzOx2gtzdu8bwK0gPvuH+JwYT2dZstU0MaQPm+TymQI?=
 =?us-ascii?Q?Gb/wOu/+fKJY6Lyg8+QmiBNorbXdkrtOLhc95gR4cVNrSPwiv+QUcr0cTgqF?=
 =?us-ascii?Q?AkXSxVJRCXgFCT2m1MDLShDgz2M8Bb8ODrc24ICTmNjX6Ggl/EyLJ1S58oQx?=
 =?us-ascii?Q?54DgcwH/DLt1iuykeH7xE26n+d++SQ7/d4lfE9BXOsSme9kNP3IeHZwgbMD0?=
 =?us-ascii?Q?4DKjCuEf+hc4ywoUwcLEFlxA2i1HnGEIdCmoV5jzxf67NQIPMwEb7Fu7F8GD?=
 =?us-ascii?Q?WD1THsE1dtpL05AVuizsZWsxCKqBt8D9yXgv9KsQ7RewknC0LIesHRRm8iG8?=
 =?us-ascii?Q?hiKAQqG+5clzQCEjrjpbp3xO3mZUpmNQ5bzqa+4bVHYQ9NnHLKbKDy3EmQVt?=
 =?us-ascii?Q?aPxiFKH99RbeSzqQtRN3UMbZ8LyR4dpmgoOSAiK2a4Pi/R5GUbsv0W+cMUbw?=
 =?us-ascii?Q?teGU8SiKFcs2iKUQ0e5Q3nkdputkdANApkYiRvlG9aOJM/i+1woLplHxd6+6?=
 =?us-ascii?Q?dD0E92NJolDjWGt5qOSlkbeViz8S61c9fZJKuabI37KDsuCX303IKHLXeHc5?=
 =?us-ascii?Q?SBq9UxDyLtmoPPEkZd3r2Lse23VclF8hk4KUcwfmZUm9VCQXvNe1FXFJtSEZ?=
 =?us-ascii?Q?m4AvDzPOFC62Q1aj+nl1KLgetRbYOG86Vf0XVMkGf5VFlSwKTUeMNq5Lro2Q?=
 =?us-ascii?Q?f6PJLDQrAHxkWq6qCeHeXwUD/4TumGq5VmhgTL+0nqMOQ2NxBq1CW2zIB99z?=
 =?us-ascii?Q?dGOedv+Nwe0Kx7DlzgJlqpEwKW5f0a684VAVSd4V33z1kXoN8egcXAAXtDRL?=
 =?us-ascii?Q?ZUiL9Ws3kQndiEEkRiwXUzXKuBl3OkPSTcVI/gXCYRMc3ejXtOOYlgrVySDJ?=
 =?us-ascii?Q?4+rsJfR6XM1PDOcpJeHMRPTZgeabzU73vmALNfUMPjhaRCWXDHCbEbXbDt9Q?=
 =?us-ascii?Q?XaphrEuEB76hZZkfEYsASLRlBW7Kkk+3U/72BY4ooJewAIl4gT88nEvAxrj2?=
 =?us-ascii?Q?Y9vbeCK/T6c2bknysKeV2nmOOJER98jpH+pcfSzglBVai7TJBtbJ59T5zuQV?=
 =?us-ascii?Q?ZKf3N+Oen9Lsv1pa+FNanTFmoIDfVUor3GeBIipt0gXps3Gluqi/cQxFDlSO?=
 =?us-ascii?Q?LuIcE+fzNUYICmk8/SQrdRs=3D?=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: SJ1PR11MB6180.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 7bfad336-8a47-42f5-564e-08db3eeee2f6
X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Apr 2023 02:53:13.3402
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: Rmwht2gETBVs4NiYiL7E4tKqp/wAvvP8VHqAc0aJ8I6XRCWFe+Fjz+pjVxMyFyueUHdmDBbzg+bY43jvCfVke4JS75x0uYAeVrK41mjv3n85/fOkZQNukzkPi7nnWU0i
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW3PR11MB4747
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,
        SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hi Florian,

> -----Original Message-----
> From: Intel-wired-lan <intel-wired-lan-bounces@osuosl.org> On Behalf Of
> Song, Yoong Siang
> Sent: Sunday, 16 April, 2023 10:19 AM
> To: Bezdeka, Florian <florian.bezdeka@siemens.com>; Brandeburg, Jesse
> <jesse.brandeburg@intel.com>; Nguyen, Anthony L
> <anthony.l.nguyen@intel.com>; David S . Miller <davem@davemloft.net>;
> Eric Dumazet <edumazet@google.com>; Jakub Kicinski <kuba@kernel.org>;
> Paolo Abeni <pabeni@redhat.com>; Alexei Starovoitov <ast@kernel.org>;
> Daniel Borkmann <daniel@iogearbox.net>; Jesper Dangaard Brouer
> <hawk@kernel.org>; John Fastabend <john.fastabend@gmail.com>;
> Fijalkowski, Maciej <maciej.fijalkowski@intel.com>; Vedang Patel
> <vedang.patel@intel.com>; Joseph, Jithu <jithu.joseph@intel.com>; Andre
> Guedes <andre.guedes@intel.com>; Brouer, Jesper <brouer@redhat.com>;
> Stanislav Fomichev <sdf@google.com>; Keller, Jacob E
> <jacob.e.keller@intel.com>; David Laight <David.Laight@ACULAB.COM>
> Cc: xdp-hints@xdp-project.net; netdev@vger.kernel.org; linux-
> kernel@vger.kernel.org; stable@vger.kernel.org; intel-wired-
> lan@lists.osuosl.org; bpf@vger.kernel.org
> Subject: Re: [Intel-wired-lan] [PATCH net v3 1/1] igc: read before write =
to
> SRRCTL register
>=20
> On Saturday, April 15, 2023 5:20 PM, Florian Bezdeka
> <florian.bezdeka@siemens.com> wrote:
> >On 14.04.23 17:49, Song Yoong Siang wrote:
> >> igc_configure_rx_ring() function will be called as part of XDP
> >> program setup. If Rx hardware timestamp is enabled prio to XDP
> >> program setup, this timestamp enablement will be overwritten when
> >> buffer size is written into SRRCTL register.
> >>
> >
> >Hi all,
> >
> >I'm actually searching for the root cause of a similar problem (RX
> >timestamp lost) that I can reproduce here, but the setup is slightly
> different. The setup:
> >
> >- igc driver
> >- i225/226 network card
> >- When starting to transmit frames using XDP with zero copy enabled
> >  another application (ptp4l) complains about missing RX timestamps
> >- Loading the XDP program has already been removed (not needed for
> >  TX only)
> >- ptp4l is using the traditional socket API
> >- The RX timestamps seem to come back once we stop sending frames
> >  using XDP
> >
> >The "zero copy support" enabled part is important. If ZC support is not
> >requested everything works fine.
> >
> >Any ideas?

Are you observing similar issue like below?
ptp4l: timed out while polling for tx timestamp
ptp4l: increasing tx_timestamp_timeout may correct this issue

If yes, only TXSTAMPO register is used for both PTP and non-PTP packets in=
=20
the current driver code. There is a possibility that the time stamp=20
for a PTP packet will be lost when there is a lot of traffic when multiple=
=20
applications request for hardware transmission timestamps.=20
Few months back, I submitted a patch series to enable the DMA=20
Timestamp for non-ptp packet which can resolve the above issue.
https://lore.kernel.org/netdev/20221018010733.4765-1-muhammad.husaini.zulki=
fli@intel.com/T/
Will continuing back the activity soon.

But you might want to try with series submitted by Vinicius as well.
This patch series add support for four sets of timestamping register.
https://patchwork.ozlabs.org/project/intel-wired-lan/patch/20230228054534.1=
093483-2-vinicius.gomes@intel.com/
https://patchwork.ozlabs.org/project/intel-wired-lan/patch/20230228054534.1=
093483-3-vinicius.gomes@intel.com/
https://patchwork.ozlabs.org/project/intel-wired-lan/patch/20230228054534.1=
093483-4-vinicius.gomes@intel.com/

Would it be possible for you to try any of the above patch series
and see if that fixes your problem?

Thanks,
Husaini


> >
> >Best regards,
> >Florian
> >
>=20
> Hi Florian,
>=20
> You means this patch does not help on your issue?
> Need to understand more on the setup and behavior to tell.
> Are ptp4l and XDP ZC Tx apps running on same queue or separate queue?
> I suggest you to run " sudo hwstamp_ctl -i eth0 -r 1 " multiple times in =
the
> middle to check the behavior.
>=20
> Thanks & Regards
> Siang
> _______________________________________________
> Intel-wired-lan mailing list
> Intel-wired-lan@osuosl.org
> https://lists.osuosl.org/mailman/listinfo/intel-wired-lan