Received: by 2002:ac0:aed5:0:0:0:0:0 with SMTP id t21csp3884970imb; Tue, 5 Mar 2019 23:19:04 -0800 (PST) X-Google-Smtp-Source: APXvYqyZI9pgL445tyjpErSUA2523wWoCunvLFTWk5mpAmdZ/SjHkcgHrS6u1tBPZmacQ12/4cDQ X-Received: by 2002:a63:b14d:: with SMTP id g13mr5106481pgp.270.1551856743986; Tue, 05 Mar 2019 23:19:03 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1551856743; cv=none; d=google.com; s=arc-20160816; b=b6corC1J851M15wW86K6ys5cOl4cDk0/y/B3plW39zN6OpK94UbXBjGIg5u0EzHR1E FoCRhKYFkiPOGp7KfSMWmhQYFMRsUngDjeATybOX3qafGdt0QdB1F5yiNh5FCktNjKvK lYmL7izDjikkvCyaqkVwBOER+3VI21rSCKFHGbQM+gQLyZDa1owzlIFSAs6MbG5ffkGK i4BDKMlf1qcWPwaYEK728iIh6i7Ytycji2zNYUAOXZ2K6ERo7xyYCZPpFNanVJtCtSkj cA8jQJojBPS6kG62VJ8y0d8Ac8q1myIWPRkPYfNFJn3dHo3M+hcl3w+MUh4AS8d6mP3r VZUg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from; bh=uXLVwTU8htO++Si0CJHevlBV5WBu5W104sBZxBQhsAM=; b=Oc0D17dE2ukNDgyBVX0uvkwRnQv9P2XjfoPs+XWo7nKES36YjYGpLBkCSPhQ4eXPD4 ih3/u+k734ym2DJFU9Ly2mj4PfZhxaV+DkSyQr4msWjXmNPe3VzdVpgFJrWc4BQZBVkZ PhgkLAxUX1KHRb2t3ISr86viC/trVJZz+twGNr/Hi2n70Ew8SgpwG720wG4M898rWgmo X2TnM3grM4s8zPPUIDIZk5HJg/pCLw8AmI0Q/JMcSFY678qKPgEH16VTdx93Rt68qiJX x6HUpVPkSTm7n7rnvl6IAe3tE0PEuTx1ZyHGD27UJ08wJA+8sL4qZKx0drkNmJAVv9G7 NOmg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id m7si816272pgp.187.2019.03.05.23.18.49; Tue, 05 Mar 2019 23:19:03 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729085AbfCFHSV (ORCPT + 99 others); Wed, 6 Mar 2019 02:18:21 -0500 Received: from mx1.redhat.com ([209.132.183.28]:53940 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726159AbfCFHSV (ORCPT ); Wed, 6 Mar 2019 02:18:21 -0500 Received: from smtp.corp.redhat.com (int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 5867A3082E0E; Wed, 6 Mar 2019 07:18:21 +0000 (UTC) Received: from hp-dl380pg8-02.lab.eng.pek2.redhat.com (hp-dl380pg8-02.lab.eng.pek2.redhat.com [10.73.8.12]) by smtp.corp.redhat.com (Postfix) with ESMTP id 8E7FB600C5; Wed, 6 Mar 2019 07:18:14 +0000 (UTC) From: Jason Wang To: jasowang@redhat.com, mst@redhat.com, kvm@vger.kernel.org, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org Cc: peterx@redhat.com, linux-mm@kvack.org, aarcange@redhat.com Subject: [RFC PATCH V2 0/5] vhost: accelerate metadata access through vmap() Date: Wed, 6 Mar 2019 02:18:07 -0500 Message-Id: <1551856692-3384-1-git-send-email-jasowang@redhat.com> X-Scanned-By: MIMEDefang 2.79 on 10.5.11.11 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.46]); Wed, 06 Mar 2019 07:18:21 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This series tries to access virtqueue metadata through kernel virtual address instead of copy_user() friends since they had too much overheads like checks, spec barriers or even hardware feature toggling. This is done through setup kernel address through vmap() and resigter MMU notifier for invalidation. Test shows about 24% improvement on TX PPS. TCP_STREAM doesn't see obvious improvement. Thanks Changes from V4: - use invalidate_range() instead of invalidate_range_start() - track dirty pages Changes from V3: - don't try to use vmap for file backed pages - rebase to master Changes from V2: - fix buggy range overlapping check - tear down MMU notifier during vhost ioctl to make sure invalidation request can read metadata userspace address and vq size without holding vq mutex. Changes from V1: - instead of pinning pages, use MMU notifier to invalidate vmaps and remap duing metadata prefetch - fix build warning on MIPS Jason Wang (5): vhost: generalize adding used elem vhost: fine grain userspace memory accessors vhost: rename vq_iotlb_prefetch() to vq_meta_prefetch() vhost: introduce helpers to get the size of metadata area vhost: access vq metadata through kernel virtual address drivers/vhost/net.c | 6 +- drivers/vhost/vhost.c | 434 ++++++++++++++++++++++++++++++++++++++++++++------ drivers/vhost/vhost.h | 18 ++- 3 files changed, 407 insertions(+), 51 deletions(-) -- 1.8.3.1