Received: by 2002:a05:7412:b995:b0:f9:9502:5bb8 with SMTP id it21csp635836rdb; Thu, 21 Dec 2023 23:35:00 -0800 (PST) X-Google-Smtp-Source: AGHT+IFKadyBb/QDU7QfTVduHuObgpyqL2Z4ynfLmIkozggx4Gosk24wBWlJl5xVJDML3QsiDkD/ X-Received: by 2002:a05:620a:17a9:b0:77e:fba3:a22a with SMTP id ay41-20020a05620a17a900b0077efba3a22amr1192228qkb.132.1703230500016; Thu, 21 Dec 2023 23:35:00 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1703230500; cv=none; d=google.com; s=arc-20160816; b=RReuT5ttEXwbqAZf1kOcj5vqFM6KGYHq1AMyj3vIPKDk8WkpzJZyVNt2eUXVh9HoNI gDEaQYJMT/9H5fQtmfvI79U85CLxzmyePmOoI4CsCAJnEmpQwWWe7vBOpPT84rHYNjpP DXr5z74u+th5lmImLbSdeEEboBnG6XTsuUYb03muSzcdmVq+zrpme06ZqyJ+WRiZ2buS /5+ibIS7oiefGFLDMG6KqVMUyRBwRleWhHMuG1tS/pA2ZF2tDvIKQpqJTzyA65x0BXPQ p7UZs/cHKE/0CSetQv5VYmlnhlOIOGv8D7Xu/5r/FXGnhFsTCMZSiK6TAYwCqqwPLTsu s+8w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=references:dlp-filter:cms-type:content-transfer-encoding :mime-version:list-unsubscribe:list-subscribe:list-id:precedence :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature :dkim-filter; bh=5DXoDTvrI2mWMm1I9eg06D4Nr/8IY38fu2o2A+1efIw=; fh=ynswjdvCI3+z3c9qNEmqaETRdNjcpsTGSRuF33qVHus=; b=gUYGHVvQNRM0dYH/FDmJsHT8DEI1TErxUpyiPC926JFDsWoXRtouiczUHWUXuCB7Pp N4YXCMdJuLCqdweKEUWwOvkFPi9YSNMsJ+Z5Q7B7PDHvvMK9+FTd4LoPnQQFEYILCgA8 8vlVpKjHtC5bDhjE1cBFatngaZsARYSsuQxtovTuJiHpBEl+n5Cj8EUXObH+KYQ0szcR AyoPAnv2oryRipuf1UTgK0ceuTy22I0pIctMI+pM7/BvTxMnkYHH7UVSwvXRNXKUKZ9x kh7UGRjOcOMrXELEYHgZ1Csuh/DHm29Zb6+9uzS08+jlw26ETl1i98H08Wbiw7aDCP21 w5Pg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@samsung.com header.s=mail20170921 header.b=dKhqRgVS; spf=pass (google.com: domain of linux-kernel+bounces-9448-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-9448-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=samsung.com Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [147.75.199.223]) by mx.google.com with ESMTPS id sq18-20020a05620a4ad200b007811ecd0405si2914580qkn.684.2023.12.21.23.34.59 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 21 Dec 2023 23:35:00 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-9448-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223; Authentication-Results: mx.google.com; dkim=pass header.i=@samsung.com header.s=mail20170921 header.b=dKhqRgVS; spf=pass (google.com: domain of linux-kernel+bounces-9448-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-9448-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=samsung.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id CC29D1C25177 for ; Fri, 22 Dec 2023 07:34:54 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id D73FAD527; Fri, 22 Dec 2023 07:32:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=samsung.com header.i=@samsung.com header.b="dKhqRgVS" X-Original-To: linux-kernel@vger.kernel.org Received: from mailout2.samsung.com (mailout2.samsung.com [203.254.224.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 96C4FC8CB for ; Fri, 22 Dec 2023 07:32:35 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=samsung.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=samsung.com Received: from epcas5p3.samsung.com (unknown [182.195.41.41]) by mailout2.samsung.com (KnoxPortal) with ESMTP id 20231222073234epoutp0203edd5cc7dd769004c8732be00c9fd91~jFvudWr-I1950219502epoutp02k for ; Fri, 22 Dec 2023 07:32:34 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 mailout2.samsung.com 20231222073234epoutp0203edd5cc7dd769004c8732be00c9fd91~jFvudWr-I1950219502epoutp02k DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsung.com; s=mail20170921; t=1703230354; bh=5DXoDTvrI2mWMm1I9eg06D4Nr/8IY38fu2o2A+1efIw=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=dKhqRgVSXcXQyiilTsaCkVy5pRIDAvEC7ErrwQ8xpx1l/xEBHZSgeYNCrucPei9Zo JqGj21zakV4ygG3C30OG52w6UAxMH5o4BsoakpX3f0WARVihgP7yK2q8JknhLTyrmw OYXbGZ8LkWaOxWMummLjDLgppUD0MrivG1m2VSCI= Received: from epsnrtp4.localdomain (unknown [182.195.42.165]) by epcas5p2.samsung.com (KnoxPortal) with ESMTP id 20231222073233epcas5p2c6275650c592fa37f2a425f2acec9f3e~jFvt4zDsg2130021300epcas5p2q; Fri, 22 Dec 2023 07:32:33 +0000 (GMT) Received: from epsmgec5p1-new.samsung.com (unknown [182.195.38.181]) by epsnrtp4.localdomain (Postfix) with ESMTP id 4SxJsq3yRfz4x9Q1; Fri, 22 Dec 2023 07:32:31 +0000 (GMT) Received: from epcas5p4.samsung.com ( [182.195.41.42]) by epsmgec5p1-new.samsung.com (Symantec Messaging Gateway) with SMTP id 4F.A9.19369.F8B35856; Fri, 22 Dec 2023 16:32:31 +0900 (KST) Received: from epsmtrp2.samsung.com (unknown [182.195.40.14]) by epcas5p4.samsung.com (KnoxPortal) with ESMTPA id 20231222062147epcas5p4353805c045bac87c459f488d0f5b8c86~jEx7MZwT80435204352epcas5p4J; Fri, 22 Dec 2023 06:21:47 +0000 (GMT) Received: from epsmgmc1p1new.samsung.com (unknown [182.195.42.40]) by epsmtrp2.samsung.com (KnoxPortal) with ESMTP id 20231222062147epsmtrp219873d3dc5f8da5a57edb2fc5bba60ce~jEx7KnPV21637116371epsmtrp2Q; Fri, 22 Dec 2023 06:21:47 +0000 (GMT) X-AuditID: b6c32a50-c99ff70000004ba9-12-65853b8f7f92 Received: from epsmtip2.samsung.com ( [182.195.34.31]) by epsmgmc1p1new.samsung.com (Symantec Messaging Gateway) with SMTP id 85.3D.07368.AFA25856; Fri, 22 Dec 2023 15:21:46 +0900 (KST) Received: from green245.sa.corp.samsungelectronics.net (unknown [107.99.41.245]) by epsmtip2.samsung.com (KnoxPortal) with ESMTPA id 20231222062143epsmtip29f2629f9af58673581da4b45db15f459~jEx3wdbaS0362603626epsmtip2P; Fri, 22 Dec 2023 06:21:43 +0000 (GMT) From: Nitesh Shetty To: Jens Axboe , Jonathan Corbet , Alasdair Kergon , Mike Snitzer , Mikulas Patocka , dm-devel@lists.linux.dev, Keith Busch , Christoph Hellwig , Sagi Grimberg , Chaitanya Kulkarni , Alexander Viro , Christian Brauner Cc: martin.petersen@oracle.com, linux-scsi@vger.kernel.org, nitheshshetty@gmail.com, anuj1072538@gmail.com, gost.dev@samsung.com, mcgrof@kernel.org, Nitesh Shetty , Hannes Reinecke , Anuj Gupta , linux-block@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, linux-nvme@lists.infradead.org, linux-fsdevel@vger.kernel.org Subject: [PATCH v19 06/12] fs, block: copy_file_range for def_blk_ops for direct block device Date: Fri, 22 Dec 2023 11:43:00 +0530 Message-Id: <20231222061313.12260-7-nj.shetty@samsung.com> X-Mailer: git-send-email 2.35.1.500.gb896f729e2 In-Reply-To: <20231222061313.12260-1-nj.shetty@samsung.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Brightmail-Tracker: H4sIAAAAAAAAA01Te1BUZRSf797L3bvmyuXh+LFMhhsMgcGyudCHCORozm1sAsfpHyiXHbg8 WvbR7pJoU0GwukosC0rlFg+BInk/xAFcxCB5GQkxrEARTbNgEygKLkwQGstC+d/v/M75fef8 zjeHwl2LOHwqRaFl1QppqoDcRlzr9vMPyAvTsUElfXxUP9CDo0e2VQJ9alzDUfVkHolmuxcA st48C1BpWRGBxm+2YchcVoChK9W3MFTQZQFoetSEoY6JvejymQoCmTv6CTTS/jWJSr6d5qCc u60kqux9gqEx4zRA+fpRDLVaMwG6tlqCo7rZeQL1TXiiO2u9Tq/xmTbTJIe581sjwYwMpjFN VedIprniE+bP5kuAuT6eQTLlhgtOTG7WA5J5ND1BMPM3RknGcLUKMM23P2QWm3YzTdb7WLRz jOxAMitNYNVerCJemZCiSAoXHD0uOSQJDgkSBYhC0asCL4VUzoYLDr8ZHXAkJXV9JQKvD6Sp aetUtFSjEQgjDqiVaVrWK1mp0YYLWFVCqkqsCtRI5Zo0RVKggtXuFwUFvRK8XhgnS+68P0So rjunj9wIzwC9288DLgVpMazp+xk/D7ZRrrQZwH5bjpMjWADwckU7xxEsAVjZcIuzJZmfadmU dABoKarEHIEOg82DmesZiiLpvfD2U8oucKdrcNjWKLLX4HQxDpv/6MXsCTdaAq16C7BjgvaB NvMwacc8ej/s/GGOY38H0kKYN+Vip7l0GLy3Uu7kKHGB/ZeshB3j9Aswq+WrjYEg3cyFdb+O Acekh+HCxQbCgd3gX71XNx3w4eKDDtKBT8IrF78jHeJsAE13TZviSKgbyNswg9N+sL5d6KCf h4UDdZij8Q6Yu2rFHDwPthZv4RdhTX3p5vse0LKcuYkZ+PvD4s2VGgAsX+gARuBlesaQ6RlD pv9blwK8CvBZlUaexMYHq0QBCvbkf98cr5Q3gY078Y9uBdUNa4FdAKNAF4AULnDnKV/OZl15 CdJTp1m1UqJOS2U1XSB4feP5OH9nvHL90BRaiUgcGiQOCQkRh+4LEQl28WZ1RQmudJJUy8pY VsWqt3QYxeVnYAcT9HMetntZsbldhf67BwrknYd8vjz2ud8vndXYTyMD7554R2dQxw7FZh/Z B6mlE88xS3UeGufajEnj9PsfxWHKmc8iwr+JyvMRJh7TF5wyxLho3y5t76z1fhpj22W0LMnc +bW8vPJhnSXWsCexrsQjSWYjz65E+Sq6/xn09T5YHKlddDsXVmOKP/pj0sMvvn9J3xdV6Nxk 2BN57vVJfdwM97F1xNzTlvP4Y8+w9PqS93h839MS73zZckP2UG5V1BR6429G17pCbWfkWfXK xuM7lmWSlpzVOS47bGbeShf5lD1xMkYoxJmeO6MkwgsFQv9YajxxLDtbPe/TM5V1hiMgNMlS kT+u1kj/BUBCJ9ewBAAA X-Brightmail-Tracker: H4sIAAAAAAAAA02Ra0hTYRjHec85Ho/W8rQpvdp9Isksa1Dx0o0Iq9PKyvoQFGIjjxp5WZsr MyVrlbVIlxfIqa3MJtpF28VZXlnW2iy01iql2QWX3VQs1FJntSzo25//7/c8PPBQOLeDCKL2 J6ey0mRxIp/0JWrv8ecuGhWcYpcUORGqtj3A0eDQGIFOqNw4uu7MJdHne18B6mnJBuhyWSmB OlvuYKihLA9DldfvYyjP/Bwgl0ONocauMHTldDmBGhqtBLLfLSGRRuvyRude1JGowjKBoZcq F0AXzjgwVNdzHKDaMQ2Obn0eINDDrpmo3W3xWhvE3FE7vZn27tsEY38sZ3RVZ0lGX36M+aAv Akx9ZxbJXM3J92LOK/pJZtDVRTADTQ6SyTFUAUbfdpT5ppvD6Hr6sO1+u31XxbKJ+w+x0sVr 9vomNPd1EJJ6vzR70+osYJmqBD4UpJfCgfdGXAl8KS5dD6DJ8chrEgRCrbsVn8w8WDnR6z0p KTA4PnbpN6Aokg6DbT8pT+9P1+Hwx00F5hnA6Rs4NJRyPA6PjobvtCJPTdAhcKjhCenJHHoF bG794u1RIL0Y5r6e7ql96JWwd/TqnxO4vxVrr/6vPh1ai3qIye1zocJYjKsArf4Pqf9DlwFW BQJZiSwpPmmfUCJMZg+Hy8RJMnlyfPi+lCQd+PN0QWgd6NZMhJsBRgEzgBTO9+ekLDzJcjmx 4iPprDQlRipPZGVmMJMi+DM4wovFsVw6XpzKHmBZCSv9RzHKJygLU/OqQ3abm/tWlnUctOnc ji2qYHdIxUiL5YC9MmbKsqcFG2rfpJovaoNfFWTGjkYN+y2/YQ5N31E4Q3Nf1FWSLR2xuXjP OGEBTTtFkraATy+pdKOrtdqoBLPdq05bC53guWBPBs+Urr40zdQWudWl9P8umjWqWT8vxzmh wq8dFa1Tx+/KN7QSmzvtt2SFJeMWXKN8ckUyRZC/LaO21zAsLx04F2yy2R9EhibO2RW0KUT7 vYK7jdvuFRe9MebN9rfCoULzx+Vu+jEZV6Oe/yg6Yrg/A1Z0K2wBCYbxExEf7taU57zO3dO4 OZcwRfkZ5TWzbbR2xBo1lLkAT9Ov4ROyBLFQgEtl4l80qWJJYwMAAA== X-CMS-MailID: 20231222062147epcas5p4353805c045bac87c459f488d0f5b8c86 X-Msg-Generator: CA Content-Type: text/plain; charset="utf-8" X-Sendblock-Type: REQ_APPROVE CMS-TYPE: 105P DLP-Filter: Pass X-CFilter-Loop: Reflected X-CMS-RootMailID: 20231222062147epcas5p4353805c045bac87c459f488d0f5b8c86 References: <20231222061313.12260-1-nj.shetty@samsung.com> For direct block device opened with O_DIRECT, use copy_file_range to issue device copy offload, or use generic_copy_file_range in case device copy offload capability is absent or the device files are not open with O_DIRECT. Reviewed-by: Hannes Reinecke Signed-off-by: Anuj Gupta Signed-off-by: Nitesh Shetty --- block/fops.c | 25 +++++++++++++++++++++++++ 1 file changed, 25 insertions(+) diff --git a/block/fops.c b/block/fops.c index 0abaac705daf..6ca46ea1f358 100644 --- a/block/fops.c +++ b/block/fops.c @@ -747,6 +747,30 @@ static ssize_t blkdev_read_iter(struct kiocb *iocb, struct iov_iter *to) return ret; } +static ssize_t blkdev_copy_file_range(struct file *file_in, loff_t pos_in, + struct file *file_out, loff_t pos_out, + size_t len, unsigned int flags) +{ + struct block_device *in_bdev = I_BDEV(bdev_file_inode(file_in)); + struct block_device *out_bdev = I_BDEV(bdev_file_inode(file_out)); + ssize_t copied = 0; + + if ((in_bdev == out_bdev) && bdev_max_copy_sectors(in_bdev) && + (file_in->f_iocb_flags & IOCB_DIRECT) && + (file_out->f_iocb_flags & IOCB_DIRECT)) { + copied = blkdev_copy_offload(in_bdev, pos_in, pos_out, len, + NULL, NULL, GFP_KERNEL); + if (copied < 0) + copied = 0; + } else { + copied = generic_copy_file_range(file_in, pos_in + copied, + file_out, pos_out + copied, + len - copied, flags); + } + + return copied; +} + #define BLKDEV_FALLOC_FL_SUPPORTED \ (FALLOC_FL_KEEP_SIZE | FALLOC_FL_PUNCH_HOLE | \ FALLOC_FL_ZERO_RANGE | FALLOC_FL_NO_HIDE_STALE) @@ -851,6 +875,7 @@ const struct file_operations def_blk_fops = { .splice_read = filemap_splice_read, .splice_write = iter_file_splice_write, .fallocate = blkdev_fallocate, + .copy_file_range = blkdev_copy_file_range, }; static __init int blkdev_init(void) -- 2.35.1.500.gb896f729e2