Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp2395905ybt; Sun, 28 Jun 2020 18:32:14 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwtGRIMkmamIeFBY7aHEt1xFN28q2eVkZ7oRSdm94ghdtaybQvqh3zOluWoQAzMB3nQcxvy X-Received: by 2002:a17:906:94c4:: with SMTP id d4mr11708634ejy.232.1593394334193; Sun, 28 Jun 2020 18:32:14 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1593394334; cv=none; d=google.com; s=arc-20160816; b=L9sD+B0gUk1igQRXurQHbW/kndC/jNN1K6QJ/rFxBLDi360euj7ZzTj9XYal3fnF7m lKjwaKevtJpR37b6ROyw728mHLjXl/gz4Q7p0XuMWzG/YVqKh3ZxEHD2PwMrY3BCwclu ZjEpM3jEDupcWsU/EfuYsqlIqwRm6npRCUye72laCSxwt9RwkVnm1X3BDoSiYdcVE+IR SghPBtf+s/Em/wQdSgHTXJNW8+lvCHpPo5xjxDhClvySSTvxjweEaq90yZovTq/oOFY5 YSNlSVUnS6D8IKf0arWI2PHUADHht0aW7AEh3gyFI9cUwW8cQRT1YVrje3BThRK5tIB+ /6qg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature; bh=Ixv42zagfGZIEDNq4U3wKAFoD1bkkegEHSprOtjQStI=; b=P7ubpESmgW9rTPzfszvU+UIFl0bIMpDTyLJulWLiZVF76pCO/WpoaZoKIwCY5LonLZ uSkNb/J89kbZsrgnSA/wz+TmvpeXePYkRkAnBXU850sx1T0L3Q4yO3+snlMT/EiR876K egcRqh8EHRojrkYGUoDLidoHBINvgZHXgIxIfjFfdEYnRTnMsSr17KY6tNANczbaQ64e Yc1jEXjuTOJhrzbEvAnhmXwD14dNWZfokMYemxfi7Z2qoyo4HxmvcAhKWH5huKq+vozC HzAWu/pKYFPdCOaTaRHSVg8jMYVkkV3SYgRi3i3/Q0gvN3JVYDAM6cSrQNUABz8MM8u8 1DIw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=NnGgTB+C; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id de9si986392edb.404.2020.06.28.18.31.49; Sun, 28 Jun 2020 18:32:14 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=NnGgTB+C; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726607AbgF2Bbq (ORCPT + 99 others); Sun, 28 Jun 2020 21:31:46 -0400 Received: from mail.kernel.org ([198.145.29.99]:47692 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726395AbgF2Bbq (ORCPT ); Sun, 28 Jun 2020 21:31:46 -0400 Received: from dhcp-10-100-145-180.wdl.wdc.com (unknown [199.255.45.60]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id CCE8320760; Mon, 29 Jun 2020 01:31:45 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1593394306; bh=Ixv42zagfGZIEDNq4U3wKAFoD1bkkegEHSprOtjQStI=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=NnGgTB+CbTXjBK1BNyUZr413XjFoQwM5KfaBVDPtkFkCulbx/2B84Ta+2Bxed110K O5Zv5LFdlBWLRzGQ92/bVSE5HXIKs4FhG2u1kQOseqmVLTht6nlsFUz5SB8TLYXuk5 j8tzwFrPCxT1RdyS9yV4hWloKGL/3fmSBF9l32A8= Date: Sun, 28 Jun 2020 18:31:43 -0700 From: Keith Busch To: Baolin Wang Cc: axboe@fb.com, hch@lst.de, sagi@grimberg.me, baolin.wang7@gmail.com, linux-nvme@lists.infradead.org, linux-kernel@vger.kernel.org Subject: Re: [RFC PATCH] nvme-pci: Move the sg table allocation/free into init/exit_request Message-ID: <20200629013143.GA1778220@dhcp-10-100-145-180.wdl.wdc.com> References: <4eedad1efab91f4529de19e14ba374da405aea3f.1593340208.git.baolin.wang@linux.alibaba.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4eedad1efab91f4529de19e14ba374da405aea3f.1593340208.git.baolin.wang@linux.alibaba.com> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Sun, Jun 28, 2020 at 06:34:46PM +0800, Baolin Wang wrote: > Move the sg table allocation and free into the init_request() and > exit_request(), instead of allocating sg table when queuing requests, > which can benefit the IO performance. If you want to pre-allocate something per-request, you can add the size to the tagset's cmd_size. But this is adding almost 4k per request. Considering how many requests we try to allocate, that's a bit too large to count on being available or sequestor for this driver.