Received: by 2002:a05:6a10:5bc5:0:0:0:0 with SMTP id os5csp3247710pxb; Wed, 13 Oct 2021 02:01:55 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxoAspDAiYyzvpshseOGaFkazqzE34TQMa+rnr5HpSBRrYQYY459ZYDgp0VKGxSDP4hWMWs X-Received: by 2002:a17:907:9889:: with SMTP id ja9mr41294278ejc.361.1634115715007; Wed, 13 Oct 2021 02:01:55 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1634115715; cv=none; d=google.com; s=arc-20160816; b=xwjZmn+Q0QC5XCBV/lEQz59yMv+LzgcfqQU4X0VAryhqPY3QY8PtEk4WgDuo/yXG6p SdNUaqY8VFLV2uxGoNTwAt0CXNdtFN/E64kprXoB00Qo6QAD2TiGQI6uAzI1xgT/c9Zr gqws8w/veqF4YKcOfDyXrwbq4OP97CgmI+EPBmcA8zW3/OyMsBAaqf0kfO2sCFl4FSIB e50Hb+Zx5CCkCrRZKxniTmfK5eubEiFvcZB+/ciaWZwIjFs1+iWdCjfbmPscrKeOmkt0 XTqWQ4k6/0EOkoGGHUbAYrHxXSjGlf6kbT/RkQO/ZemB2MJNCbVHi8vMpEIq0/agJjQ6 i9Cg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=13F9Cq930OG+GGXd8FQ0oaYzD/U3yoMN3sJ8Nxj0JZ0=; b=bwvoIrxO4qQO1NPy8Wf8syWY9b2LqM8+ommKCP2KMrLod85HgQSCs89IGz9ib4zhnm +ReNzg+0ya85hABYyBkpBVzRAaNLoBKSkEvrnu077/1BsxdRsWEYpa/jHUl0MqTz9Ltf 9DMeyHgXkdLzHeFpAysBAfIDWQXiGmqWEgsrPwXditIj4GjOnkcf1C6NuSqmUh+x+3ZC 3BcIGUhHyhiV2O2wWVrZ+1I3S5tq6NzgSX3D9KP+tsoYnOmFHacoKtPbGPD75yU9kbe/ YS8reyFpSC2f9i9//Piu8VwkUbzomGXsxZ/SCafJkytIcBVUuC703Qqbln29p6IzpDxw AtHg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=R2uUau2r; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id hr6si37827906ejc.711.2021.10.13.02.01.31; Wed, 13 Oct 2021 02:01:54 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=R2uUau2r; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S238986AbhJMJAJ (ORCPT + 99 others); Wed, 13 Oct 2021 05:00:09 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:57516 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S238942AbhJMJAG (ORCPT ); Wed, 13 Oct 2021 05:00:06 -0400 Received: from mail-wr1-x42f.google.com (mail-wr1-x42f.google.com [IPv6:2a00:1450:4864:20::42f]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 551FEC061570; Wed, 13 Oct 2021 01:58:03 -0700 (PDT) Received: by mail-wr1-x42f.google.com with SMTP id r10so5723571wra.12; Wed, 13 Oct 2021 01:58:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=13F9Cq930OG+GGXd8FQ0oaYzD/U3yoMN3sJ8Nxj0JZ0=; b=R2uUau2rwqw3lDLQTmYPAavTDo1r7hTGr675Vj+NsGITlkUXtV2ErxYpjSwisYnZj+ Lr1ieLVAAyDkPSgU/A4B57ZHYRgAKu40Gm+2ogdyQsF6eOTzjvMD+YUErjftgFSYuzVK n6Ck3Up0bacvQOvInLZE1wYyKON7wlqEG13fktrgpDifsVsQS1aRdxyLKwhWDP3XVSnX +oQ8aWiRS3iupKuCjbAjdpAkhWWV4KpjDqMydcJmHVbe3aAMZ8jQHS3FjTO2X9AD9BdI +o2bT9I13gYVFSpYZ7sSUbI3OWAvqbUQ3G1mAbzaNAQsXeBWFOIy2jRx6vTmkvIrVvIa BZ2A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=13F9Cq930OG+GGXd8FQ0oaYzD/U3yoMN3sJ8Nxj0JZ0=; b=wDjNMeDaqpjklIRtVK9ZzSpBxND5LABZQSkmt9QrLRhFAU9C42ssx+nz+FWwyig+pu F/zYTm2+EbkHN8jQ4Of2otoPiyzNWM52z1O03vp49pDsPZz9UCj4cyhkd9RYXiI9ks6u 5bRjK/dYNe/GJj9eIMM7WwSvDXnm7dANN1n9nQVAiq1lUar7vnVIm3FiDTIqROCFvYbH pmOux9cNOyF4XtufH9j5hLykbunLYh3m4bOuzmFkZmfyAQewGFsYxsHaMbHhcUwzi2YC xW1E5bwfTWhV/qoVcdJFYS7afxFlkRV/doS/Si+CIqMx4PQEf9v3WLjtgxVqvRqNLyQY bzsA== X-Gm-Message-State: AOAM531MUzJsdq8p3ylir01GO1/YG8FxrpQ+eRHZxBZk2U4lD0P57fcU pdR5rGMon6EBmLsXROiwyLLXKmxPNmk= X-Received: by 2002:adf:a1d7:: with SMTP id v23mr38295392wrv.171.1634115480568; Wed, 13 Oct 2021 01:58:00 -0700 (PDT) Received: from localhost.localdomain ([185.69.145.208]) by smtp.gmail.com with ESMTPSA id v1sm13187283wro.54.2021.10.13.01.57.59 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 13 Oct 2021 01:58:00 -0700 (PDT) From: Pavel Begunkov To: Jens Axboe , linux-block@vger.kernel.org, linux-kernel@vger.kernel.org Cc: Christoph Hellwig , asml.silence@gmail.com Subject: [PATCH v2 0/3] on top of for-5.16/block Date: Wed, 13 Oct 2021 09:57:10 +0100 Message-Id: X-Mailer: git-send-email 2.33.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org ./io_uring -d32 -s32 -c32 -b512 -p1 /dev/nullb0 ~3.3 MIOPS vs 3.5 MIOPS, so gives around extra ~4-5%. The main part is caching struct block_device + some inlining. v2: without applied patches, merge previous 6/6 into the second patch get rid of helpers (Jens, Christoph) kill bdev_inode and move inode into bdev (Christoph) Pavel Begunkov (3): block: cache bdev in struct file for raw bdev IO block: don't hide inode from block_device users blk-mq: optimise *end_request non-stat path block/bdev.c | 44 ++++++++++----------------------------- block/blk-mq.c | 18 +++++++--------- block/fops.c | 43 ++++++++++++++++---------------------- include/linux/blk_types.h | 1 + include/linux/blkdev.h | 8 +++++-- 5 files changed, 44 insertions(+), 70 deletions(-) -- 2.33.0