Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp2879405ybt; Mon, 22 Jun 2020 09:14:09 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzsM+Dri8gYPhMWwH7yiE512vk1asQzaM//JLtjcJNu7sB6z7wyT63qdVsxX+2+vpMK2emV X-Received: by 2002:a17:906:dce:: with SMTP id p14mr2426847eji.442.1592842449828; Mon, 22 Jun 2020 09:14:09 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1592842449; cv=none; d=google.com; s=arc-20160816; b=onUz+glORRtcJgGJMPerdOfns+wVObOFMmmPf1hVJnpdOnVGxQvDgTj23CKcl/JnK7 yq1zXPnoW7LRAgKffYn8KmdPiYgFHhK8vITJXL4bTnWtIdQIa5KMaCVaWTTZl6VJ1+oU xbSs6iP4kOBTNNc3DK5l868vy1sTimU4WtjAGWGB5c4+qOh9dE901vh3Y7FwTHEaZIO/ S+6rAmhTUA8igbTg9v1Jr+zYJYYZtqYPliUJUje+9MBwqrLSUU6d4yqNbwpURoGj1F7I QJx/YSE6RHEZ5I5KPdvX0E4kDMsY0Htk/saXB7LojrN8FPM/qudtcAc3FYwTFaYVAw5C +KHQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=u9CuuDZWez1gPD7/EQaGB6uwPoIx9m3Z+Jr1eQeEOo4=; b=L3exyJ1jVdZxnIp+LUFQlmVCijEx0gv1JyeZliGNHdUW0c1PQ89JTvzGViSJdhnfXc YwRTqtx72K/gTLeagXjJhh/Nk9AzwsqokMhoBqrQN9R6fr35jtvEkJWy/FiHbeRyE5g7 a2HpFFDhS2XKauABTMLDXM8bS2k51u2l6OO4s9C1LallmIwqw70rfDFDVQNx7kpPmHU2 Bw5G3xYd0WAd50lb3GZFE/X5CpC/TascfBIgh56qC2/rSNisik/NFi+ygzZ3v75rIDZS 6mKeIj9aVHW/En3WpBolQlO/Ow3YCGnsNhzwlAdI71K7ZguxZ0jxRJdQO+an7ZgIua56 KIrg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b="OqG/YNjv"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id i25si8741945eja.118.2020.06.22.09.13.47; Mon, 22 Jun 2020 09:14:09 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b="OqG/YNjv"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729462AbgFVQMC (ORCPT + 99 others); Mon, 22 Jun 2020 12:12:02 -0400 Received: from us-smtp-1.mimecast.com ([207.211.31.81]:26402 "EHLO us-smtp-delivery-1.mimecast.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1729275AbgFVQMC (ORCPT ); Mon, 22 Jun 2020 12:12:02 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1592842320; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=u9CuuDZWez1gPD7/EQaGB6uwPoIx9m3Z+Jr1eQeEOo4=; b=OqG/YNjvJelR3an6wmWgRM/jTG+mG+3Q7x3IIzg/0mQg2aF6Fq0HlYvOJicBR5HIvrwsfr eo6YS54kbd+kH1HnNP5qNA7p0efawqR7H179wLDw9VWML5wii2KptQae0rGDhwmycHxvwL BTGNxizRF+jZ0fEffbR52h0LUAFsziE= Received: from mail-qt1-f199.google.com (mail-qt1-f199.google.com [209.85.160.199]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-463-Iqzdi2DYNmOKAnY7037Xhw-1; Mon, 22 Jun 2020 12:11:58 -0400 X-MC-Unique: Iqzdi2DYNmOKAnY7037Xhw-1 Received: by mail-qt1-f199.google.com with SMTP id i5so2884428qtw.3 for ; Mon, 22 Jun 2020 09:11:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=u9CuuDZWez1gPD7/EQaGB6uwPoIx9m3Z+Jr1eQeEOo4=; b=JeUYRaOiBHbOeskWhe/E/1gNxHm6WGNXksa2V/c4XnoM61u2s/Xgfjf4r7IHXf/b8/ 4lgcfygPqRbeTPDQb+FNc6cm5MEBhqvM5zrDayDfnR23yYR6TcX23/Rd/j4QnR/pameC VYIGdV2tqmtmA8bcnGozH0nZgo0gJQkL3CfTeb6zCSJhBnG95oGw2cbIqqTfFFvySFlQ ponQs/7tt+Ncj676TXG+hnpbvqQu2Iq6HDHSUAsff2j23GoPSX2hBey5fXNr4Dua9tdF 8zC3Bn9EMyIMojgZ6YM+CDP+coiN4+2YfZ+xTvCjy+Xo+V6SiTCnpNjuoG/LEOA1/2+K eBkQ== X-Gm-Message-State: AOAM532Y0meadEeEM7k6MlMqqmRvgc/bS4ml7cfRVCzYMP5ZX++WY99I S9BQmnJZfm2n2cNwFYNq0u+mMxC22DgV1hXTusB6td5jEC9ZbkC6mYqu/nzM/uFeOhPtYxEQySd EXPGuxRF1+rdQjL/rA6KyIpH0WlXwkjrognXXpHlb X-Received: by 2002:ac8:6897:: with SMTP id m23mr17079716qtq.379.1592842318276; Mon, 22 Jun 2020 09:11:58 -0700 (PDT) X-Received: by 2002:ac8:6897:: with SMTP id m23mr17079684qtq.379.1592842317963; Mon, 22 Jun 2020 09:11:57 -0700 (PDT) MIME-Version: 1.0 References: <20200611113404.17810-1-mst@redhat.com> <20200611113404.17810-3-mst@redhat.com> <20200611152257.GA1798@char.us.oracle.com> <20200622114622-mutt-send-email-mst@kernel.org> In-Reply-To: <20200622114622-mutt-send-email-mst@kernel.org> From: Eugenio Perez Martin Date: Mon, 22 Jun 2020 18:11:21 +0200 Message-ID: Subject: Re: [PATCH RFC v8 02/11] vhost: use batched get_vq_desc version To: "Michael S. Tsirkin" Cc: Konrad Rzeszutek Wilk , linux-kernel@vger.kernel.org, kvm list , virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, Jason Wang Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jun 22, 2020 at 5:55 PM Michael S. Tsirkin wrote: > > On Fri, Jun 19, 2020 at 08:07:57PM +0200, Eugenio Perez Martin wrote: > > On Mon, Jun 15, 2020 at 2:28 PM Eugenio Perez Martin > > wrote: > > > > > > On Thu, Jun 11, 2020 at 5:22 PM Konrad Rzeszutek Wilk > > > wrote: > > > > > > > > On Thu, Jun 11, 2020 at 07:34:19AM -0400, Michael S. Tsirkin wrote: > > > > > As testing shows no performance change, switch to that now. > > > > > > > > What kind of testing? 100GiB? Low latency? > > > > > > > > > > Hi Konrad. > > > > > > I tested this version of the patch: > > > https://lkml.org/lkml/2019/10/13/42 > > > > > > It was tested for throughput with DPDK's testpmd (as described in > > > http://doc.dpdk.org/guides/howto/virtio_user_as_exceptional_path.html) > > > and kernel pktgen. No latency tests were performed by me. Maybe it is > > > interesting to perform a latency test or just a different set of tests > > > over a recent version. > > > > > > Thanks! > > > > I have repeated the tests with v9, and results are a little bit different: > > * If I test opening it with testpmd, I see no change between versions > > > OK that is testpmd on guest, right? And vhost-net on the host? > Hi Michael. No, sorry, as described in http://doc.dpdk.org/guides/howto/virtio_user_as_exceptional_path.html. But I could add to test it in the guest too. These kinds of raw packets "bursts" do not show performance differences, but I could test deeper if you think it would be worth it. > > * If I forward packets between two vhost-net interfaces in the guest > > using a linux bridge in the host: > > And here I guess you mean virtio-net in the guest kernel? Yes, sorry: Two virtio-net interfaces connected with a linux bridge in the host. More precisely: * Adding one of the interfaces to another namespace, assigning it an IP, and starting netserver there. * Assign another IP in the range manually to the other virtual net interface, and start the desired test there. If you think it would be better to perform then differently please let me know. > > > - netperf UDP_STREAM shows a performance increase of 1.8, almost > > doubling performance. This gets lower as frame size increase. > > - rests of the test goes noticeably worse: UDP_RR goes from ~6347 > > transactions/sec to 5830 > > OK so it seems plausible that we still have a bug where an interrupt > is delayed. That is the main difference between pmd and virtio. > Let's try disabling event index, and see what happens - that's > the trickiest part of interrupts. > Got it, will get back with the results. Thank you very much! > > > > - TCP_STREAM goes from ~10.7 gbps to ~7Gbps > > - TCP_RR from 6223.64 transactions/sec to 5739.44 >