Received: by 2002:ac0:bc90:0:0:0:0:0 with SMTP id a16csp803534img; Thu, 21 Mar 2019 09:14:57 -0700 (PDT) X-Google-Smtp-Source: APXvYqyl8mnVQOlOUchZ2kF8f259KAQMaTNDHgnAGnsOv5AQl3gLk6tPxpkNKkfdEZGFNDmCJxA9 X-Received: by 2002:a17:902:8c81:: with SMTP id t1mr4397309plo.309.1553184897631; Thu, 21 Mar 2019 09:14:57 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1553184897; cv=none; d=google.com; s=arc-20160816; b=uzHa3F0vTtwXMOqCaJ0yGQ11oIiiej3Qsj6o61TSaM4pVGbb+6tUm+PyNaXhhzkL/H yu9K+LLyiCJU7HD5XMmCPYELGdB1VtRJ0rAmCekitiGxTL6ztRwSzNmEs/XEUTTodjC3 UWYpgS8PPhkMioWs1wRJfaYrINVIxDbtK4w6dSwRJMTO/3Wx+uRs4kQiYMblZX6uDGr3 pk88eubX+nbmpK0UbY97tJGiZ1VSjxXix6Xftyz/TXLbkeg9kkmu/s5Jv8r+2o6fp4ld PWmNK2c+TXKh+T+LjBjczLMHY/h599vZyBlO8FoVQi9UkRS8utPtIxT3Vdv7r42kpoBw VScA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=jZ1hS5vK36AuUEQhYTZQUtCbAR5g+kx6r1fzc9KwmP0=; b=IEgK+fOmKjb8SwOLmrENHTycMe/V/tdssuEImy1mql7AoYmqm/zttSZGJOA+X5w9PZ tsrjjf9sTEuVGBJZsV0MpZtA9N57v87IZG7J3I4hkO/i8bApQTd+qHThvf85xu+uLLIy bmPVmdbq0bdpPNY/7L4K4rRGiL/Xy2v4OXw6NjMemFf4clu3xNXuky/ceNxpVCvAsL7v FblN1tY2ttZK3YcBoCh4B9W2Rwl6rNKaPVWf+IoHace04VrgiN79/c2PUSuoQQumedqb /TYcjOTbHXgXcegSh3si3XBsqNe0wtOiS1BYnwfJjEEyG+bH14lxAu+hxJy6WJyCAGB3 645Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=jeYilcsc; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id k13si4360051pgo.246.2019.03.21.09.14.42; Thu, 21 Mar 2019 09:14:57 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=jeYilcsc; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728460AbfCUQN5 (ORCPT + 99 others); Thu, 21 Mar 2019 12:13:57 -0400 Received: from mail-wm1-f67.google.com ([209.85.128.67]:50514 "EHLO mail-wm1-f67.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727829AbfCUQN5 (ORCPT ); Thu, 21 Mar 2019 12:13:57 -0400 Received: by mail-wm1-f67.google.com with SMTP id z11so3435439wmi.0; Thu, 21 Mar 2019 09:13:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=jZ1hS5vK36AuUEQhYTZQUtCbAR5g+kx6r1fzc9KwmP0=; b=jeYilcsczvY4bl4e88AMAQLzuFXPbsATlcwNFPfUrKoDNyRjk2jMVmcgNbZ1i07Qyl a3cdtVcxBBtV2cAC2G6BXE87DR86nj4fvU5YTYl7Wr0hlLZiqfUYemJUptyrd/bRUbqM pNg0ooVMZStASbnw0FVnXpWl06R345pReUPLAbEPgk4/LYaSYGnPZI9vQrFEYu40kIEN Urs5/zowBJBqP5JGhGI1B2O7PgTIJaWFo9xPpUPQbt0dDZru8NcBox6DFPa6ave+N46y 4lvQklCt/WmxSBQYJACZ/O8zFleQ9AC6ii0WZQsXRlEh69QT6mM/G/06d1Su4AcpFZj0 vbLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=jZ1hS5vK36AuUEQhYTZQUtCbAR5g+kx6r1fzc9KwmP0=; b=UeWm53AeqI8aWSoKS9jTJ18YGH02ES3COy9Eyxirc/LQfnx74nL1HksJNkfGNdugai 8v/LPjO3pZ2s4ynn+uyIIhqDmlFuFqILk2GOqJcaQi8LB+Y9G327Woo/NQh2I1IIySQm OVV/muYOtmuHN7iDrrUUm0L7KmlLpXjx9z/ghE3xMBT3VGgv6q3Fh4LsdJoYY4oKQjig deUTDRaMsuSuFPJ8M+0vtHYW8700fKTUYF5xQkDALpUPVyuE9xGj/fCiKJVaRnjWVEPi +sIrdzuHDcjv5xczbgEuujKWCKyAZf2eJkEBtUXKToFdfhXdhg341S6CTPYzhyXnm5cz vcLg== X-Gm-Message-State: APjAAAXGsNjgJi/SRbqwyibAetUHXwDYJqcMcrE8UR6I5NzdLVSoVfHz zffektc600T2LJNPxXDjQ4E= X-Received: by 2002:a05:600c:cd:: with SMTP id u13mr23433wmm.49.1553184834121; Thu, 21 Mar 2019 09:13:54 -0700 (PDT) Received: from localhost ([51.15.41.238]) by smtp.gmail.com with ESMTPSA id q2sm9739804wrd.46.2019.03.21.09.13.52 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Thu, 21 Mar 2019 09:13:53 -0700 (PDT) Date: Thu, 21 Mar 2019 16:13:52 +0000 From: Stefan Hajnoczi To: Maxim Levitsky Cc: linux-nvme@lists.infradead.org, linux-kernel@vger.kernel.org, kvm@vger.kernel.org, Jens Axboe , Alex Williamson , Keith Busch , Christoph Hellwig , Sagi Grimberg , Kirti Wankhede , "David S . Miller" , Mauro Carvalho Chehab , Greg Kroah-Hartman , Wolfram Sang , Nicolas Ferre , "Paul E . McKenney " , Paolo Bonzini , Liang Cunming , Liu Changpeng , Fam Zheng , Amnon Ilan , John Ferlan Subject: Re: your mail Message-ID: <20190321161352.GA21682@stefanha-x1.localdomain> References: <20190319144116.400-1-mlevitsk@redhat.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="45Z9DzgjV8m4Oswq" Content-Disposition: inline In-Reply-To: <20190319144116.400-1-mlevitsk@redhat.com> User-Agent: Mutt/1.11.3 (2019-02-01) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org --45Z9DzgjV8m4Oswq Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Mar 19, 2019 at 04:41:07PM +0200, Maxim Levitsky wrote: > Date: Tue, 19 Mar 2019 14:45:45 +0200 > Subject: [PATCH 0/9] RFC: NVME VFIO mediated device >=20 > Hi everyone! >=20 > In this patch series, I would like to introduce my take on the problem of= doing=20 > as fast as possible virtualization of storage with emphasis on low latenc= y. >=20 > In this patch series I implemented a kernel vfio based, mediated device t= hat=20 > allows the user to pass through a partition and/or whole namespace to a g= uest. >=20 > The idea behind this driver is based on paper you can find at > https://www.usenix.org/conference/atc18/presentation/peng, >=20 > Although note that I stared the development prior to reading this paper,= =20 > independently. >=20 > In addition to that implementation is not based on code used in the paper= as=20 > I wasn't being able at that time to make the source available to me. >=20 > ***Key points about the implementation:*** >=20 > * Polling kernel thread is used. The polling is stopped after a=20 > predefined timeout (1/2 sec by default). > Support for all interrupt driven mode is planned, and it shows promising = results. >=20 > * Guest sees a standard NVME device - this allows to run guest with=20 > unmodified drivers, for example windows guests. >=20 > * The NVMe device is shared between host and guest. > That means that even a single namespace can be split between host=20 > and guest based on different partitions. >=20 > * Simple configuration >=20 > *** Performance *** >=20 > Performance was tested on Intel DC P3700, With Xeon E5-2620 v2=20 > and both latency and throughput is very similar to SPDK. >=20 > Soon I will test this on a better server and nvme device and provide > more formal performance numbers. >=20 > Latency numbers: > ~80ms - spdk with fio plugin on the host. > ~84ms - nvme driver on the host > ~87ms - mdev-nvme + nvme driver in the guest You mentioned the spdk numbers are with vhost-user-nvme. Have you measured SPDK's vhost-user-blk? Stefan --45Z9DzgjV8m4Oswq Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJck7hAAAoJEJykq7OBq3PInk8IAIyLq251vi4RSs3LznDr+zKm vvruxYj2YImYO3vJoFuposfBU6M0D14WhyZQl7HiJNP4nLPsgS1pgqHfmu0w0U/W vyAay5ug64+5irJFKm+Uj0FbPUoyD/h4mV3qn4wvy6LVpQbHrPEOdiGnE+lBpwF1 whPXlnAAfhrJFTbrvUcK1ricmlmAqRRKxZjiH9N2bSFEfv4pVEkK0Yym7lH/S33e pqc02PlCB2s5fsOmbQEqg7q5qwNkzyWcGi1JsnbLOBrtRP+87nb5dM3zwIJ/JQne cgo+YPSOKShndq3BvayQfEs+QefQJlG2KV2x6BT061aPRp982CbGhymktWXoZ68= =8gYn -----END PGP SIGNATURE----- --45Z9DzgjV8m4Oswq--