Received: by 2002:ad5:474a:0:0:0:0:0 with SMTP id i10csp79026imu; Sun, 4 Nov 2018 19:23:53 -0800 (PST) X-Google-Smtp-Source: AJdET5cfgLaYMtbejDu15e3QmQoRozwGKPauNiqiM4F8Be16rGNW3kpaZy/iaPJ/59tEiPsyQ6JZ X-Received: by 2002:a63:d949:: with SMTP id e9mr11278465pgj.24.1541388233620; Sun, 04 Nov 2018 19:23:53 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1541388233; cv=none; d=google.com; s=arc-20160816; b=zeytK68AnOhHwByNxHNY5O61bH8z0LO0fPgmqsPn4xLIwmTK76VuDj9OHY/84Vap8Z n/beeLKf595mEjQKdmEpaCXXaBzO6uFpYa58WAcjvMGOkzz0OZ3mewXw4+h3PzVlesPo dWzScGM0D8hPMgI71bZPBlbULwRCKEjPgLbeY/zLJTq/zcyW5BxUHRB54JjCEBxV2zOB 3BfHm+GI/hKB+X2Qa9VXOlDrn017H/bWQ9mteVDAdXZFsdJVVLUA4hXsjGg6WY2DALaV Rr6P10ZTCDcoxcWopJ/3J/6wLWljczQKdR7h9GT30Hl+Db1wIyGUrGwG/gdrOGYKOF2g Vfxg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=ZPYWCGJbnd35ASLjxF4+ptBevLzINksqHn68zBUVvIU=; b=LRRWDVVsNhoxqdWF7/s23nj8wonfYdkR7ZGuhlN9IS2nqb5Pbk2nl79S0uhu8b8CLc UdsuHTkySEyg0HnMHEA4J76267eFCBj00tOQfOyf9eYbQ14AXnHGE+fy0vyi4Ds4HMSS WqwFWxzetwmQAVg7OrXZTo3+pWtIhh8+sqEDkWc+Glz/YLV8woM7x9Z3zUUT7fEbH5pN JVwX2sNb8n4k4HO3OhL5vuwCXRxuphEvGWNf/zP/RfPLXhL8SIrevX1mzHew/8O/LPo8 BpSzN+lfGOjAdYjuBFL6OQqH+8c93blbxnEyOcN4emFBaUBJYF4dGDp5jVB6Q71d8B2h lBXw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=a4mal7p+; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f62-v6si42629526plf.288.2018.11.04.19.23.37; Sun, 04 Nov 2018 19:23:53 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=a4mal7p+; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727351AbeKEMkq (ORCPT + 99 others); Mon, 5 Nov 2018 07:40:46 -0500 Received: from mail-qk1-f193.google.com ([209.85.222.193]:39587 "EHLO mail-qk1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726810AbeKEMkq (ORCPT ); Mon, 5 Nov 2018 07:40:46 -0500 Received: by mail-qk1-f193.google.com with SMTP id e4so12452917qkh.6; Sun, 04 Nov 2018 19:23:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ZPYWCGJbnd35ASLjxF4+ptBevLzINksqHn68zBUVvIU=; b=a4mal7p+CidlTno1yIKR9tcy90DoMJkCO4DtzBKf83exyL8xqRgKBEZ4NYtukzfPI7 6WVJjRPZnnik+usYPzAaobD2h71CoMsbmytFxWronrGY5jZlIUQCz8DhJLw6UcX/QnAJ qIzib8LJmt58rqeIrNxLgYNW3Ab4l0A3sRrN+eHzqS1wG7a3VROweiJdE3NE4chkgzQg DXNPMsLBwzVyNd+vGqyBZ6F0qCSN43ONgdRmDzW3sJVCz0kQHAt8B0wvCWdOnlJBbx+Q fwyQEe80CeIYUIZmlyUvftJ7tD/p+It5O6JK2ii8X5vWVXkknalWLLjkrKD9Cwdc+J/l PQzQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ZPYWCGJbnd35ASLjxF4+ptBevLzINksqHn68zBUVvIU=; b=UWx23rVmZj6DSb60gbSoPp5h01XnSflCooEM9bIR8kpYXfnzLAL5SjzWbGDEbQk1KE IDLW65PqpY5PJeP9RgnGktOE8gEuIxSqf42az34nlkyg4eyGsy07D3jn31a1PI8b0+Ka MsOElb6sMni3zWg/rTjujZ+rvBn4J1kf4umr8ARrzvaeWa6pEBgNnlTTjwrNYVj/tXgD mZuQTYBbK34sMyEQhqUtVMuhu6ZWo7etaDInRvD4It3nlndlqEGLw55/jWn4gmHhM/5I 7F8k3Y0Ej1xYKL0Q6Cj59o1KbqSmLt+ZFUp7ujqwnJlFjLmEi2mZPcyzXMadukPWhQhm CO/A== X-Gm-Message-State: AGRZ1gJuLdBGrHPD7XPBNDGQfV2nRnEb6YBlwqvYwoCxARhGWSJPDDM/ LvjGk6kLp+6iVtWFrFYul5OnEaWqagLv22TtHDA= X-Received: by 2002:a0c:a802:: with SMTP id w2mr17102381qva.198.1541388196761; Sun, 04 Nov 2018 19:23:16 -0800 (PST) MIME-Version: 1.0 References: <20181102182123.29420-1-v.mayatskih@gmail.com> <6a7f1668-bf2d-0caa-2efd-c8fab5f1db24@redhat.com> In-Reply-To: <6a7f1668-bf2d-0caa-2efd-c8fab5f1db24@redhat.com> From: Vitaly Mayatskih Date: Sun, 4 Nov 2018 22:23:04 -0500 Message-ID: Subject: Re: [PATCH 0/1] vhost: add vhost_blk driver To: Jason Wang Cc: "Michael S . Tsirkin" , Paolo Bonzini , kvm@vger.kernel.org, virtualization@lists.linux-foundation.org, linux-kernel@vger.kernel.org, stefanha@redhat.com Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Sun, Nov 4, 2018 at 10:00 PM Jason Wang wrote: > > # fio num-jobs > > # A: bare metal over block > > # B: bare metal over file > > # C: virtio-blk over block > > # D: virtio-blk over file > > # E: vhost-blk bio over block > > # F: vhost-blk kiocb over block > > # G: vhost-blk kiocb over file > > # > > # A B C D E F G > > 16 1480k 1506k 101k 102k 1346k 1202k 566k > Hi: > > Thanks for the patches. > > This is not the first attempt for having vhost-blk: > > - Badari's version: https://lwn.net/Articles/379864/ > > - Asias' version: https://lwn.net/Articles/519880/ > > It's better to describe the differences (kiocb vs bio? performance?). > E.g if my memory is correct, Asias said it doesn't give much improvement > compared with userspace qemu. > > And what's more important, I believe we tend to use virtio-scsi nowdays. > So what's the advantages of vhost-blk over vhost-scsi? Hi, Yes, I saw both. Frankly, my implementation is not that different, because the whole thing has only twice more LOC that vhost/test.c. I posted my numbers (see in quoted text above the 16 queues case), IOPS goes from ~100k to 1.2M and almost reaches the physical limitation of the backend. submit_bio() is a bit faster, but can't be used for disk images placed on a file system. I have that submit_bio implementation too. Storage industry is shifting away from SCSI, which has a scaling problem. I can compare vhost-scsi vs vhost-blk if you are curious. Thanks! -- wbr, Vitaly