Received: by 2002:a05:6358:3188:b0:123:57c1:9b43 with SMTP id q8csp27752585rwd; Tue, 4 Jul 2023 07:23:17 -0700 (PDT) X-Google-Smtp-Source: APBJJlH+sQLbghlx2dJ6IhohXDuyjGE2fJxLNXh4CF4/zuRXY5MZ/eC/UQaY50T/ZJF8QsEPkSju X-Received: by 2002:a05:6a20:14a:b0:12d:23ba:55da with SMTP id 10-20020a056a20014a00b0012d23ba55damr10026850pzs.59.1688480597458; Tue, 04 Jul 2023 07:23:17 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1688480597; cv=none; d=google.com; s=arc-20160816; b=iYJw50NysoRN/9kvUzNbpMTY5rQilu57q2liPQeV/THwoQaQ9zm07DT3olZvvcfLkZ KUNMFDIYtYoWTj7DmMugNedNb/yWovJQRN6JVyRb9cKTuaHo/IHyvPbVbMw1EqS0VYN1 Qhdv8LbOjBVFQ8zny/Xk0DvwMTHD6FwY6Wpe8bxn1PTfEDSBLnEgFbIdxHd3zk3HZFhW WDdbRpisI7+TfH3Wsqx5PuabCUeIJuYoBlhY6CuJ4T3ylO+EcFlEV/T8PQPIstjeRQPC thY87UbeNXDosinDv1DtW80sFTD9pj7d7P8/MiIq02+ZTWCsWKPqWWR8734UMKASnuJk H6aw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:cc:to:subject :message-id:date:from:in-reply-to:references:mime-version :dkim-signature; bh=Pj5JGVPPeauGQvIpeFlKIni7HhsZGoS4BNs5ZO3Pxmo=; fh=f3jyR4bOAK/D05MneZqgs6jrZBaeveS2PlgVVUd5uJQ=; b=JqV2JxaIuwirxIsP7n6JP4rdHDao8qKTT/DsDyLLtT0nXx8c0Op7KzVCeroUw7bklY b6our08kA3bXhqmiMHpQwJBQByFg68SXQD0nNZ3dwxHAWID4xx8/YmkSTzKeJ1g6SSFQ wbHGb2AQ7ziuDP7/1nLrczPDXwtRsLwqpGmPqyXXaRJp3cCDnHAkB7rs2+/G1pdxvMjW r5bGLHK7v/9Eu45q6NRMXgIyvYOBvR5Ar72gr4Jc8wE2WbZriV2F5F6TIKsaxqSKB1cc iyQK9E43JCceBaLxebEkknhvoh2v274t0A4eHFEBP4Ij7Hdeu52Qc1wRdL9d6aWo3HA1 TPAQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20221208 header.b=hn28cFzP; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id f38-20020a631f26000000b00553828de1cbsi20182326pgf.791.2023.07.04.07.23.02; Tue, 04 Jul 2023 07:23:17 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20221208 header.b=hn28cFzP; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230300AbjGDOHO (ORCPT + 99 others); Tue, 4 Jul 2023 10:07:14 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37308 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229451AbjGDOHN (ORCPT ); Tue, 4 Jul 2023 10:07:13 -0400 Received: from mail-vs1-xe35.google.com (mail-vs1-xe35.google.com [IPv6:2607:f8b0:4864:20::e35]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 4DB38C9; Tue, 4 Jul 2023 07:07:11 -0700 (PDT) Received: by mail-vs1-xe35.google.com with SMTP id ada2fe7eead31-443628ee79dso1616745137.1; Tue, 04 Jul 2023 07:07:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1688479630; x=1691071630; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=Pj5JGVPPeauGQvIpeFlKIni7HhsZGoS4BNs5ZO3Pxmo=; b=hn28cFzPMECl6LNgOehfydKarGWRszOgkN4J5a7gUd5vmZLo2CQsUGFHlBCEIIRVVW h/MhsLmUAkU/ST/RsPiGNr1sybZKGP1i1NZJNSVn76l+m5V9+PDhJ/M6b6YKoqEY3MaY W3PqkQbyfj/Ai/EAiaINxJnCGKaYtQHBKconjODUGLUaT4mz5qKVWagR5RNdnH/v/RkP 511XSggaErLed2FYj89tK/iO1V/ikIfkKzh9/GomZhI8Ri7FXslVDVS8fhrUz3dWGrv1 VPXQJM8HU+mfKDy7jmqaX4AKOqRwns+zaI+BzufJx6DEh0Zdzpl3N6T272/QOdmy0vGG 8exg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1688479630; x=1691071630; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Pj5JGVPPeauGQvIpeFlKIni7HhsZGoS4BNs5ZO3Pxmo=; b=OdDBIJTHUtOLC3WBUR+k1ljx9tC8P0iwpQjtDlAUzbL7RDOl1c4JQe713gMqyidFxI 5ZP5KKvyTgGiL9zruYRiLLFO4+LQ/IuC46AKQ/vs+jAbeHwHSql/RM+dZFqxq+XpW3hL xJm1jNwHy7ajtlccIoMMj3XOQfCruBlWT2iZbFbod77ZfE+VGua+cgS4x1a6imawbo9V wHCUGAqvbgke24ArVtbOD9wwsMsSwJxO0f7tK95LjEqB+B6/Sx/SUBlIMIJjR1GKAWNn dxUlSUF0bqZbe5YiB8D7zca5SrRHo+x7ZUSUgT9Z6T//bCaMhtSjJ1EEfn2ped1xlk8A HhpQ== X-Gm-Message-State: ABy/qLYGkNLNDWnZl2G8xhkaWYJYf0WQ6r0dW+Bm30G8QTudf4AA/f+5 SF4CHU2yCvY5C1vVrew1UeUBDyYCl2MYqfMJeSs= X-Received: by 2002:a05:6102:2852:b0:444:c9b4:25bc with SMTP id az18-20020a056102285200b00444c9b425bcmr5391006vsb.17.1688479630313; Tue, 04 Jul 2023 07:07:10 -0700 (PDT) MIME-Version: 1.0 References: <22aad588-47d6-6441-45b2-0e685ed84c8d@intel.com> <0a040331995c072c56fce58794848f5e9853c44f.camel@redhat.com> <486ae2687cd2e2624c0db1ea1f3d6ca36db15411.camel@redhat.com> <5688456234f5d15ea9ca0f000350c28610ed2639.camel@redhat.com> <92a4d42491a2c219192ae86fa04b579ea3676d8c.camel@redhat.com> <062061fc4d4d3476e3b0255803b726956686eb19.camel@redhat.com> In-Reply-To: <062061fc4d4d3476e3b0255803b726956686eb19.camel@redhat.com> From: Ian Kumlien Date: Tue, 4 Jul 2023 16:06:58 +0200 Message-ID: Subject: Re: [Intel-wired-lan] bug with rx-udp-gro-forwarding offloading? To: Paolo Abeni Cc: Alexander Lobakin , intel-wired-lan , Jakub Kicinski , Eric Dumazet , "netdev@vger.kernel.org" , "linux-kernel@vger.kernel.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM, RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Jul 4, 2023 at 3:41=E2=80=AFPM Paolo Abeni wrot= e: > > On Tue, 2023-07-04 at 15:23 +0200, Ian Kumlien wrote: > > On Tue, Jul 4, 2023 at 2:54=E2=80=AFPM Paolo Abeni = wrote: > > > > > > On Tue, 2023-07-04 at 13:36 +0200, Ian Kumlien wrote: > > > > Propper bug this time: > > > > cat bug.txt | ./scripts/decode_stacktrace.sh vmlinux > > > > > > To be sure, is this with the last patch I shared? this one I mean: > > > > The current modifications I have, on top of v6.4.1, is: > > diff --git a/net/core/skbuff.c b/net/core/skbuff.c > > index cea28d30abb5..8552caa197f9 100644 > > --- a/net/core/skbuff.c > > +++ b/net/core/skbuff.c > > @@ -4272,6 +4272,11 @@ struct sk_buff *skb_segment_list(struct sk_buff = *skb, > > > > skb_shinfo(skb)->frag_list =3D NULL; > > > > + /* later code will clear the gso area in the shared info */ > > + err =3D skb_header_unclone(skb, GFP_ATOMIC); > > + if (err) > > + goto err_linearize; > > + > > while (list_skb) { > > nskb =3D list_skb; > > list_skb =3D list_skb->next; > > @@ -4328,6 +4333,9 @@ struct sk_buff *skb_segment_list(struct sk_buff *= skb, > > > > skb->prev =3D tail; > > > > + if (WARN_ON_ONCE(!skb->next)) > > + goto err_linearize; > > + > > if (skb_needs_linearize(skb, features) && > > __skb_linearize(skb)) > > goto err_linearize; > > --- > > > > > https://lore.kernel.org/netdev/92a4d42491a2c219192ae86fa04b579ea3676d= 8c.camel@redhat.com/ > > > > > > Could you please additionally enable CONFIG_DEBUG_NET in your build? > > > > Sure, will do > > > > > Could you please give a detailed description of your network topology > > > and the running traffic? > > > > This machine has two "real interfaces" and two interfaces that runs as > > bridges for virtual machines > > eno1 - real internal > > eno2 - bridge - internal > > eno3 - real external > > eno4 - bridge - external > > > > The bridges are used by three virtual machines, two of which are > > attached on both networks > > > > Traffic seemed to be video streaming, at least at first, now I don't > > really know. I do have a few smart devices so I assume there is > > a bit of multicast traffic as well - but not really anything unusual as= such. > > In there any XDP program running on the host side? Possibly changing > the packet hdr? Only systemd standard things, I haven't done anything and the normal nftables fw doesn't do anything special > Thanks! > > /P >