Received: by 2002:a05:6358:1087:b0:cb:c9d3:cd90 with SMTP id j7csp853403rwi; Thu, 20 Oct 2022 06:06:45 -0700 (PDT) X-Google-Smtp-Source: AMsMyM5ZA0nRPRXVu77ZaxrPfdMDODaR+J4xqbdeJH9VY4jJnIHiNqc2WJx5sJyAsuogg8WPp+q5 X-Received: by 2002:aa7:c642:0:b0:458:e065:105b with SMTP id z2-20020aa7c642000000b00458e065105bmr12134455edr.354.1666271204737; Thu, 20 Oct 2022 06:06:44 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1666271204; cv=none; d=google.com; s=arc-20160816; b=CFPacDp1R2bz0OpAHlTGT2Huu9oIcho8lewFw9bv6KgGqHofVmFGGqnoEN5Lp2qkVF /+G24K+qqXydoY5TxEHt8BQPng+GMCAdGwgfGJQB2LQwm1paQrpEJcg/AyN0RBKg4Z+M Iw5/LjzgGLwryEcwCk5fmk9Xs6SIQIQFAngw/3swupxY8oN4b6xajPSqEMa5gmzW2vXY CKb0Iv/+Uy2KasWiYue7EqsgXbwZ/s4UqUZONIqVIMk55GUklplWriURuAR8V0/gQT9O u1jzUpAG4dSMsSWtN4DmpQBSrGAZ/bA5ymN1urLgGqEjjgu4i9wwwQDQkSQDDjaSu8x9 bI1Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:from :references:cc:to:content-language:subject:user-agent:mime-version :date:message-id:dkim-signature; bh=m1tSUOR0CGd4Km4WU9EABqtl9X4dWfnj8PpCfOdNXBc=; b=zfEA4ez9yQLUf4lIX8mUKFCTdA/6hhkgR8G6cvXHaDG9SoLbzx1BoyCYQpcRTYMpCk FgSKo6hEdPQS4EZdzioARxIf4Qx/pIWYTWWUcSe0PJsQGHvgRpYiEQIiQwZ94sS+I2Vp Rv7evMv97ajiwDjDjM/9YnaExIEI/ib9RkZjeOH8rKpuW/mFg3q8mmIt9UxOIYnq22h/ ObyaEfdtNceGtQ20n0whGH7EGCjXeYJl7neYIiPWkrjC3Dl67WQC1SR2McLg+wzId/K+ yKxgRo5ecf1HwRU6Fvu6xcBhWI1eHQ0INctFSxrj84DJNVszwM2A+rHC+OlvteRc6ZrR 4Zqw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel-dk.20210112.gappssmtp.com header.s=20210112 header.b=3Fin5tR+; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id hw9-20020a170907a0c900b00791a3dd01b1si5460098ejc.865.2022.10.20.06.06.18; Thu, 20 Oct 2022 06:06:44 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel-dk.20210112.gappssmtp.com header.s=20210112 header.b=3Fin5tR+; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230270AbiJTMxM (ORCPT + 99 others); Thu, 20 Oct 2022 08:53:12 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:33476 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230243AbiJTMxL (ORCPT ); Thu, 20 Oct 2022 08:53:11 -0400 Received: from mail-pf1-x434.google.com (mail-pf1-x434.google.com [IPv6:2607:f8b0:4864:20::434]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C839517F2A6 for ; Thu, 20 Oct 2022 05:53:09 -0700 (PDT) Received: by mail-pf1-x434.google.com with SMTP id y1so20177312pfr.3 for ; Thu, 20 Oct 2022 05:53:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=m1tSUOR0CGd4Km4WU9EABqtl9X4dWfnj8PpCfOdNXBc=; b=3Fin5tR+DxTOnCymWvNQXvC4DP5A9CvW/OpgGKccrmRGVFcE1OuUJQGkrqlo+ckrFh U+MGbaf9A8ztgk82880CFy4vbbjNXjhtqi5eSxxDu3XyziyuvWI7H9MeAMWY9hrAejxi 5j3rfjrvbU7Jl3E5wgG3nrBCZsTDZVxaUgfEZrWPMEwVm19q7lbCXQAV/HzVjWBqk9GO L885iNCloh3qLdmRxDaEq+Ev5GUBKwzDFWxEGiVCxKxZsoqeQIyFeiWyyAZSrDkSNbV9 FtkzOyVRIr86K6bOzCntYKwU4AnrmZYaZKMBUbcAFaKDCq/xXZjENs8qIFYfy1MYehUi L4Iw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=m1tSUOR0CGd4Km4WU9EABqtl9X4dWfnj8PpCfOdNXBc=; b=knASAZ4BE+HDiYvNLChAkFLl4fftW859Q2MKXn7NxSyGSU2XGuOmvISnCJB7oaSpzo G6Be/xrbLNmnRhELLwkzpVsAkJja+lgWu3UWhwoAaY2ISMAcnul5Q0ySHTiWsPUBrBpZ oaL4Nqf2qF0C0tBCUD0+EIvuqQMRl/G4xfz2uNFVcWI4zqy7CgziMit9noGNY6ke5IBh v2v5zyg5fVpA9pDcGK3RyOfJJUulC3UFBwh8ujljAW/3e5Q9kKlu363AJ8YFCGvhi7kG ALXa+/yFEcHKrBx4wP4Wi9DjM4MB42UI+5loPHoeOrz9uEEdXfw+XyIJQObJ3/ghtqNU hVsw== X-Gm-Message-State: ACrzQf0j5dY7PdaaXzS88IQmP6Na6v0I5Nis3bn3VAcGxmMLLMmfDb0I pSLIs3kHsEGTx7TMtasGcah1gg== X-Received: by 2002:a63:1612:0:b0:461:4180:d88b with SMTP id w18-20020a631612000000b004614180d88bmr11920615pgl.434.1666270389223; Thu, 20 Oct 2022 05:53:09 -0700 (PDT) Received: from [192.168.4.201] (cpe-72-132-29-68.dc.res.rr.com. [72.132.29.68]) by smtp.gmail.com with ESMTPSA id 186-20020a6215c3000000b005626ef1a48bsm13162954pfv.197.2022.10.20.05.53.08 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 20 Oct 2022 05:53:08 -0700 (PDT) Message-ID: <80702edc-3e81-441b-efe7-a746c36f1d01@kernel.dk> Date: Thu, 20 Oct 2022 05:53:07 -0700 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux aarch64; rv:102.0) Gecko/20100101 Thunderbird/102.3.3 Subject: Re: [RFC for-next v2 0/4] enable pcpu bio caching for IRQ I/O Content-Language: en-US To: Pavel Begunkov , Christoph Hellwig Cc: linux-block@vger.kernel.org, io-uring@vger.kernel.org, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org References: From: Jens Axboe In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,NICE_REPLY_A,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 10/20/22 5:40 AM, Pavel Begunkov wrote: > On 10/20/22 09:32, Christoph Hellwig wrote: >> On Tue, Oct 18, 2022 at 08:50:54PM +0100, Pavel Begunkov wrote: >>> This series implements bio pcpu caching for normal / IRQ-driven I/O >>> extending REQ_ALLOC_CACHE currently limited to iopoll. The allocation side >>> still only works from non-irq context, which is the reason it's not enabled >>> by default, but turning it on for other users (e.g. filesystems) is >>> as a matter of passing a flag. >>> >>> t/io_uring with an Optane SSD setup showed +7% for batches of 32 requests >>> and +4.3% for batches of 8. >> >> This looks much nicer to me than the previous attempt exposing the bio >> internals to io_uring, thanks. > > Yeah, I saw the one Jens posted before but I wanted this one to be more > generic, i.e. applicable not only to io_uring. Thanks for taking a look. It is indeed better like that, also because we can get rid of the alloc cache flag long term and just have it be the way that bio allocations work. -- Jens Axboe