Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932951AbbFIOVv (ORCPT ); Tue, 9 Jun 2015 10:21:51 -0400 Received: from aserp1040.oracle.com ([141.146.126.69]:31626 "EHLO aserp1040.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S932885AbbFIOVj (ORCPT ); Tue, 9 Jun 2015 10:21:39 -0400 Date: Tue, 9 Jun 2015 10:21:27 -0400 From: Konrad Rzeszutek Wilk To: Roger Pau =?iso-8859-1?Q?Monn=E9?= Cc: Paul Durrant , Bob Liu , "xen-devel@lists.xen.org" , David Vrabel , "justing@spectralogic.com" , Julien Grall , "linux-kernel@vger.kernel.org" , Marcus Granado , Rafal Mielniczuk Subject: Re: [PATCH 3/3] xen/block: add multi-page ring support Message-ID: <20150609142126.GJ15200@x230> References: <1433310003-13089-1-git-send-email-bob.liu@oracle.com> <1433310003-13089-3-git-send-email-bob.liu@oracle.com> <5576A8C0.8000804@oracle.com> <9AAE0902D5BC7E449B7C8E4E778ABCD0259410F3@AMSPEX01CL01.citrite.net> <20150609133938.GA15200@x230> <5576F325.5050304@citrix.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <5576F325.5050304@citrix.com> User-Agent: Mutt/1.5.23 (2014-03-12) X-Source-IP: userv0021.oracle.com [156.151.31.71] Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3562 Lines: 91 On Tue, Jun 09, 2015 at 04:07:33PM +0200, Roger Pau Monn? wrote: > El 09/06/15 a les 15.39, Konrad Rzeszutek Wilk ha escrit: > > On Tue, Jun 09, 2015 at 08:52:53AM +0000, Paul Durrant wrote: > >>> -----Original Message----- > >>> From: Bob Liu [mailto:bob.liu@oracle.com] > >>> Sent: 09 June 2015 09:50 > >>> To: Bob Liu > >>> Cc: xen-devel@lists.xen.org; David Vrabel; justing@spectralogic.com; > >>> konrad.wilk@oracle.com; Roger Pau Monne; Paul Durrant; Julien Grall; linux- > >>> kernel@vger.kernel.org > >>> Subject: Re: [PATCH 3/3] xen/block: add multi-page ring support > >>> > >>> > >>> On 06/03/2015 01:40 PM, Bob Liu wrote: > >>>> Extend xen/block to support multi-page ring, so that more requests can be > >>>> issued by using more than one pages as the request ring between blkfront > >>>> and backend. > >>>> As a result, the performance can get improved significantly. > >>>> > >>>> We got some impressive improvements on our highend iscsi storage cluster > >>>> backend. If using 64 pages as the ring, the IOPS increased about 15 times > >>>> for the throughput testing and above doubled for the latency testing. > >>>> > >>>> The reason was the limit on outstanding requests is 32 if use only one-page > >>>> ring, but in our case the iscsi lun was spread across about 100 physical > >>>> drives, 32 was really not enough to keep them busy. > >>>> > >>>> Changes in v2: > >>>> - Rebased to 4.0-rc6. > >>>> - Document on how multi-page ring feature working to linux io/blkif.h. > >>>> > >>>> Changes in v3: > >>>> - Remove changes to linux io/blkif.h and follow the protocol defined > >>>> in io/blkif.h of XEN tree. > >>>> - Rebased to 4.1-rc3 > >>>> > >>>> Changes in v4: > >>>> - Turn to use 'ring-page-order' and 'max-ring-page-order'. > >>>> - A few comments from Roger. > >>>> > >>>> Changes in v5: > >>>> - Clarify with 4k granularity to comment > >>>> - Address more comments from Roger > >>>> > >>>> Signed-off-by: Bob Liu > >>> > >>> Also tested the windows PV driver which also works fine when multi-page > >>> ring feature > >>> was enabled in Linux backend. > >>> http://www.xenproject.org/downloads/windows-pv-drivers.html > >>> > >> > >> Great! Thanks for verifying that :-) > > > > Woot! Bob, could you repost the blkif.h patch for the Xen tree > > pleas e and also mention the testing part in it please? I think this > > was the only big 'what if?!' question holding this up. > > > > > > Roger, I put them (patches) on devel/for-jens-4.2 on > > > > git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git > > > > I think these two patches: > > drivers: xen-blkback: delay pending_req allocation to connect_ring > > xen/block: add multi-page ring support > > > > are the only ones that haven't been Acked by you (or maybe they > > have and I missed the Ack?) > > Hello, > > I was waiting to Ack those because the XenServer storage performance > folks found out that these patches cause a performance regression on > some of their tests. I'm adding them to the conversation so they can This is with multi-page enabled or with the patches but multi-page disabled (baseline)? > provide more details about the issues they found, and whether we should > hold pushing this patches or not. Or surely fix whatever is causing this. > > Roger. > -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/