Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp715492pxk; Thu, 3 Sep 2020 10:45:07 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzz4neVDhsIh+Em16/K1Ctgw3bxfCNTi1ZVFFENwRBc9lq0qq3xgbF1O210WMx6dsgXSrto X-Received: by 2002:a50:fb99:: with SMTP id e25mr4291154edq.281.1599155106857; Thu, 03 Sep 2020 10:45:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1599155106; cv=none; d=google.com; s=arc-20160816; b=oyYEigxzoQTKjLj/zEqCWjByg7oAYgRY+fZ8i4aX4oQhNeiMNXp0gABRF8+L+dLnUE 8cHASt1wmQelBJORUuFzQvxHJ8WdrVyzHx5O/cROMzUuk8CXNHC07jQzJvYE1djmQsId TjEoLdjKWu2nCgqovdK8KpJttfVi0dY/4k9pDucIk+PZ7+wb6el3mIKYlGrJcnnLGvTG YPAwct78cbqsbkh0YLPDWCsQy6ykvYQGRzaBVhfw0KXzlcMNRThirmGKsdU3LqQWFzgg NHakFSc+tPG7dh6POua9ZQyQfrNLlWRrXgEMEDKargWnvK6LA7hK5FEJZamVVtgl5ghW kQIw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=vYFQYSTb/+17+Uuu6516MdUuM986Y6u14DKyOKGcWYc=; b=JsZW0lR3iKxAj2UpuFxzyjvKZKRiqdgx6KVtYcAZOCpES87cQkIVffqbjeDqt3dhb6 /N/31ONRLetBF0Z530OU9mkQSZQ7gHAnVYRiTDoRooHxNrbn2pBm/7IULXfmbQsCihKI CACn5cNLUZHp51rCC6lZQ7aQ0rbk7Cjfd7pdaeW2ia9PyUP5EnvDrZpU8tplDVnUkyJ4 9K+OQCIgAa8iM7ep2jqee4xUvCXdDxGaeJS2vaXeH7G0hTiy+XE1YnRDD8xgYsy6rQV3 mewBeehCIQxOnIrgAmrZHkiF81A7Lxh6HuuOQqu955ODXmfCbnp5mouGqPfWog3F9WYm oj/Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=lDIe7CF5; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id mf8si2374746ejb.197.2020.09.03.10.44.42; Thu, 03 Sep 2020 10:45:06 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=lDIe7CF5; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728458AbgICRnw (ORCPT + 99 others); Thu, 3 Sep 2020 13:43:52 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37970 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726025AbgICRnv (ORCPT ); Thu, 3 Sep 2020 13:43:51 -0400 Received: from mail-il1-x143.google.com (mail-il1-x143.google.com [IPv6:2607:f8b0:4864:20::143]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 14337C061244; Thu, 3 Sep 2020 10:43:50 -0700 (PDT) Received: by mail-il1-x143.google.com with SMTP id t16so3559401ilf.13; Thu, 03 Sep 2020 10:43:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=vYFQYSTb/+17+Uuu6516MdUuM986Y6u14DKyOKGcWYc=; b=lDIe7CF5KDUMWGocKm7G/UyV8gRmhYQGDRCGTIRYgdBTWVP2fg0DSI64zyl1Yz3HkQ zZWprpbGlgiLAhJ0Cj/FVEMcDQDo/2a/18ft6tpgWCivMWuEFKVIqqsQm45BWgLsVAAg VO+5qHy5uw0D4m8fLee46jmvFtq4FsPhV3wicZevOT+Fylc1KSGW2ZbYn3KqWl4kQq+3 9zj4maCKAJ1vxn1TTIM7yKmFX9ofN+p7Rzhxc6EzLUkZLn7v7q2V5eVpCZjtggAOw8q2 ZJ+irFc04GnA1cr4U17yqm8gbatsuwQwuJ0F9KGkn+WPyT9+ZfB4OwLNPIFn5V1d+nXG TKaA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=vYFQYSTb/+17+Uuu6516MdUuM986Y6u14DKyOKGcWYc=; b=p4zqLcCpNrTQ8Qv8JtieTmdGvgOHxe5o8RIkhyF2yyu1tVLN4VflDpnpd8cqmurb/z LEu435feT4dci3RlIH+YtniFmhthwS5ryLMBe5Uglqez+nvPg69CIx7ZWNOO9jVLxg1D BIMdnJVp81SDd1znP2ZaMp6sYn8HBMOJyf8EvfQqCxrLnluabI9Iz5efepUR6sIlTQPi VYqwNkHxJK7ZSsWeIvkYtH5RKaShGF0CzzRyHMpLnQHcaBfz6T1xAenvRmg2DdVppGHG g4yimHJsZ/IqOt9PBYlAnEk9syZMJiMD6EC0l8iVEHKy2saH+PSrEtMAKItV93Uxfr7Y urOw== X-Gm-Message-State: AOAM530FWGaTzbpPl+zpbpOUjPlMdHixnb/oHeGodeAc3LOrctMeD7Uc JIJARrHUmMb1AFftTOCVV1oVIwcmxpnNqhceyw4= X-Received: by 2002:a92:9145:: with SMTP id t66mr4170348ild.305.1599155030104; Thu, 03 Sep 2020 10:43:50 -0700 (PDT) MIME-Version: 1.0 References: <465a540e-5296-32e7-f6a6-79942dfe2618@netrounds.com> <20200623134259.8197-1-mzhivich@akamai.com> <1849b74f-163c-8cfa-baa5-f653159fefd4@akamai.com> <7fd86d97-6785-0b5f-1e95-92bc1da9df35@netrounds.com> <500b4843cb7c425ea5449fe199095edd5f7feb0c.camel@redhat.com> <25ca46e4-a8c1-1c88-d6a9-603289ff44c3@akamai.com> <20200822032800.16296-1-hdanton@sina.com> <20200825032312.11776-1-hdanton@sina.com> <20200825162329.11292-1-hdanton@sina.com> <5f46032e.1c69fb81.9880c.7a6cSMTPIN_ADDED_MISSING@mx.google.com> <20200827125747.5816-1-hdanton@sina.com> In-Reply-To: From: Cong Wang Date: Thu, 3 Sep 2020 10:43:38 -0700 Message-ID: Subject: Re: Packet gets stuck in NOLOCK pfifo_fast qdisc To: Paolo Abeni Cc: Kehuan Feng , Hillf Danton , Jike Song , Josh Hunt , Jonas Bonn , Michael Zhivich , David Miller , John Fastabend , LKML , Netdev Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Sep 3, 2020 at 1:40 AM Paolo Abeni wrote: > > On Wed, 2020-09-02 at 22:01 -0700, Cong Wang wrote: > > Can you test the attached one-line fix? I think we are overthinking, > > probably all > > we need here is a busy wait. > > I think that will solve, but I also think that will kill NOLOCK > performances due to really increased contention. Yeah, we somehow end up with more locks (seqlock, skb array lock) for lockless qdisc. What an irony... ;) > > At this point I fear we could consider reverting the NOLOCK stuff. > I personally would hate doing so, but it looks like NOLOCK benefits are > outweighed by its issues. I agree, NOLOCK brings more pains than gains. There are many race conditions hidden in generic qdisc layer, another one is enqueue vs. reset which is being discussed in another thread. Thanks.