Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp213327imu; Thu, 8 Nov 2018 00:19:23 -0800 (PST) X-Google-Smtp-Source: AJdET5fP2Zbfldb+7iJRyZUlu4aaWOjqnKvmLQSVxj4z0tjjYSJi2ApxjB2QGE2qw6V7zcSlM/q/ X-Received: by 2002:a63:495b:: with SMTP id y27mr3051417pgk.32.1541665163446; Thu, 08 Nov 2018 00:19:23 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1541665163; cv=none; d=google.com; s=arc-20160816; b=GN35lhoyc82W/CcjEbY6HnxiafexZDFepicY9nUWCG5KA/N/xvVOZSkTPdazdcx0Yj G6yPIK1mpXKTMkZbHCIz09ciP7iZKClfqULohAgd+ec2e4esvnRcvaZHT3bYg9RxLxrF Yb2igErGrlxXEyFeh8uCYwQBo6EAxt5DT0gZZoWJ7Pff45nsRRYnv+hnOEZ5EmdRtwa3 2ehq5KtzhTaHHgVHVfGrp/OJxXSRGE7q/BhasInj7liZa4bkjzgx7Af1iNUJWm53Rn7z PfWuFwQB7tIsdYbi1U+JDjh0I8HDjQXVpxBjw4P0m3Wtgbyww5pnaKoXd80Hxrxe0g6R m6+w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-language :content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject; bh=JvgLDXeXj4WqwkZvEGHogWkKR475F0SJ1W6qMUZjJaw=; b=QEqUiqMkkbMA9/B8KYGOUG1Yxwl64sAt2NRQZC+PIq1TAPywrGKxIVqCWh+x/zFe26 ORUgIT7pReribQZSAdFrIrZUViA9WLzhJXhO65WyHul8FSiLDLVCtrtfjGw4wyrBq9oO nnvYQXj1tFqOscu7EaZ/amOoWCklNm7ipirIm5pmblK0NmEWlESJRzqqPEiuKSz7eHSU 91sZpzTxnLshKKHoa4mr1904gVTYRv7+PykH8ILPLA7JNhmh2SDjmmJ4F4QcpzhOUSMK yCRs/f96I1eXjOmXfcxFwBzjHxWkSv+TAyzFfMC3K4r3NhUMOurPwt0m7WrV9bgypHr5 mpaQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id r29si2847626pga.477.2018.11.08.00.19.08; Thu, 08 Nov 2018 00:19:23 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726802AbeKHRw5 (ORCPT + 99 others); Thu, 8 Nov 2018 12:52:57 -0500 Received: from mx1.redhat.com ([209.132.183.28]:54632 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726509AbeKHRw4 (ORCPT ); Thu, 8 Nov 2018 12:52:56 -0500 Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id F329089ACD; Thu, 8 Nov 2018 08:18:36 +0000 (UTC) Received: from [10.72.12.31] (ovpn-12-31.pek2.redhat.com [10.72.12.31]) by smtp.corp.redhat.com (Postfix) with ESMTPS id CF39960C60; Thu, 8 Nov 2018 08:18:29 +0000 (UTC) Subject: Re: [PATCH net-next v2 3/5] virtio_ring: add packed ring support To: Tiwei Bie , "Michael S. Tsirkin" Cc: virtualization@lists.linux-foundation.org, linux-kernel@vger.kernel.org, netdev@vger.kernel.org, virtio-dev@lists.oasis-open.org, wexu@redhat.com, jfreimann@redhat.com References: <20180711022711.7090-1-tiwei.bie@intel.com> <20180711022711.7090-4-tiwei.bie@intel.com> <20181107123933-mutt-send-email-mst@kernel.org> <20181108013759.GA20591@debian> From: Jason Wang Message-ID: <2d46a41e-bc00-276a-e19a-105c9dffc75a@redhat.com> Date: Thu, 8 Nov 2018 16:18:25 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 In-Reply-To: <20181108013759.GA20591@debian> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Scanned-By: MIMEDefang 2.79 on 10.5.11.12 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.26]); Thu, 08 Nov 2018 08:18:37 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2018/11/8 上午9:38, Tiwei Bie wrote: >>> + >>> + if (vq->vq.num_free < descs_used) { >>> + pr_debug("Can't add buf len %i - avail = %i\n", >>> + descs_used, vq->vq.num_free); >>> + /* FIXME: for historical reasons, we force a notify here if >>> + * there are outgoing parts to the buffer. Presumably the >>> + * host should service the ring ASAP. */ >> I don't think we have a reason to do this for packed ring. >> No historical baggage there, right? > Based on the original commit log, it seems that the notify here > is just an "optimization". But I don't quite understand what does > the "the heuristics which KVM uses" refer to. If it's safe to drop > this in packed ring, I'd like to do it. According to the commit log, it seems like a workaround of lguest networking backend. I agree to drop it, we should not have such burden. But we should notice that, with this removed, the compare between packed vs split is kind of unfair. Consider the removal of lguest support recently, maybe we can drop this for split ring as well? Thanks > > commit 44653eae1407f79dff6f52fcf594ae84cb165ec4 > Author: Rusty Russell > Date: Fri Jul 25 12:06:04 2008 -0500 > > virtio: don't always force a notification when ring is full > > We force notification when the ring is full, even if the host has > indicated it doesn't want to know. This seemed like a good idea at > the time: if we fill the transmit ring, we should tell the host > immediately. > > Unfortunately this logic also applies to the receiving ring, which is > refilled constantly. We should introduce real notification thesholds > to replace this logic. Meanwhile, removing the logic altogether breaks > the heuristics which KVM uses, so we use a hack: only notify if there are > outgoing parts of the new buffer. > > Here are the number of exits with lguest's crappy network implementation: > Before: > network xmit 7859051 recv 236420 > After: > network xmit 7858610 recv 118136 > > Signed-off-by: Rusty Russell > > diff --git a/drivers/virtio/virtio_ring.c b/drivers/virtio/virtio_ring.c > index 72bf8bc09014..21d9a62767af 100644 > --- a/drivers/virtio/virtio_ring.c > +++ b/drivers/virtio/virtio_ring.c > @@ -87,8 +87,11 @@ static int vring_add_buf(struct virtqueue *_vq, > if (vq->num_free < out + in) { > pr_debug("Can't add buf len %i - avail = %i\n", > out + in, vq->num_free); > - /* We notify*even if* VRING_USED_F_NO_NOTIFY is set here. */ > - vq->notify(&vq->vq); > + /* FIXME: for historical reasons, we force a notify here if > + * there are outgoing parts to the buffer. Presumably the > + * host should service the ring ASAP. */ > + if (out) > + vq->notify(&vq->vq); > END_USE(vq); > return -ENOSPC; > } > >