Received: by 2002:a05:6602:2086:0:0:0:0 with SMTP id a6csp4407508ioa; Wed, 27 Apr 2022 03:13:57 -0700 (PDT) X-Google-Smtp-Source: ABdhPJx/7e9CyV4mD/e76idGmuTmXH18G3f5A+EAceEuyfFSVeI1UQy4LqM6RFHU+1fj3eoSUvWE X-Received: by 2002:a17:90a:884:b0:1d9:531c:9cd6 with SMTP id v4-20020a17090a088400b001d9531c9cd6mr20043814pjc.211.1651054437609; Wed, 27 Apr 2022 03:13:57 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1651054437; cv=none; d=google.com; s=arc-20160816; b=BQ3xFvaZgQFaVLA3xCzxa26Y8d4Dd4uCQ/3Cet9VS1poCpUT3lugYzS9xAbL3M8yGd GnHwhSaliVbNeMOe/SFujGfnACeMF4qOGQzNziqyxUDjfEgG/QD/O3umfBIUBfKTKnuO M5LG5bVdgUbis6Cd2CTHOWW0MtAW45ZZcwkD+/x7rpiO+jxht2adHMPCDJ8d0+Xwdz2u OqRHVLUO+AfdJ6qZaD7JFqLmxsq1UhSjsxeCLdZ6nbx1w19TgR4LEX59EBJZzbX9Fskh vjtcXHUIujPvpZ9IaTyJZMh1CsTMWwkYj6jJWlv6XQnqznd3EMgzplUX4tEibarPkPV6 +7yA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to :organization:from:references:cc:to:content-language:subject :user-agent:mime-version:date:message-id:dkim-signature :wdcironportexception:ironport-sdr:ironport-sdr:dkim-signature; bh=Op6uHtFFc9QzUNIZNGAERglB4uN24+IxIpeVq08mEjw=; b=baao29drm+DZxwrzHhIXqZFKDWot50X2M8ZqVGwxHcokhgtey7O0EJTm670086fkS/ qpBmi6JjbYaro93u6kGRXYR3vF+JvpxsRxZ0+2yy/+sfnluTTJdUAvkNidpIwOMgi9gr zNr0D1xiblwfeVE4DujMLTl4RJHbpcNCrAgkgqygqGimV9xXbuEwc9Mq6f4+Pgxbdb+w JD7METtvCMtLpKMqFddOFwIbDI5w9edVmN5hBVeW3FCCkF/Ma5A5osK+2icE7O2ByHt6 6IZESxGy+jBpzwd309Me+wA5lGkSOjdP/S8GCT+ymOPagAkXPvtM2F8L3mrYkX2V5Lpn J+rw== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@wdc.com header.s=dkim.wdc.com header.b=BrV63yRS; dkim=pass header.i=@opensource.wdc.com header.s=dkim header.b=HLh3gOdI; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=opensource.wdc.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [23.128.96.19]) by mx.google.com with ESMTPS id o22-20020a17090a5b1600b001d96baff624si4505631pji.175.2022.04.27.03.13.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Apr 2022 03:13:57 -0700 (PDT) Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19; Authentication-Results: mx.google.com; dkim=fail header.i=@wdc.com header.s=dkim.wdc.com header.b=BrV63yRS; dkim=pass header.i=@opensource.wdc.com header.s=dkim header.b=HLh3gOdI; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=opensource.wdc.com Received: from out1.vger.email (out1.vger.email [IPv6:2620:137:e000::1:20]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 9A6023276F4; Wed, 27 Apr 2022 02:35:38 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1357145AbiD0CXM (ORCPT + 99 others); Tue, 26 Apr 2022 22:23:12 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35332 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1357143AbiD0CXK (ORCPT ); Tue, 26 Apr 2022 22:23:10 -0400 Received: from esa2.hgst.iphmx.com (esa2.hgst.iphmx.com [68.232.143.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A2AEF1134 for ; Tue, 26 Apr 2022 19:20:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=wdc.com; i=@wdc.com; q=dns/txt; s=dkim.wdc.com; t=1651026000; x=1682562000; h=message-id:date:mime-version:subject:to:cc:references: from:in-reply-to:content-transfer-encoding; bh=5TeQN5lhR4Ahp6383VgZCh7eErXQ5BHljxeq6DTkar0=; b=BrV63yRSdIXWT3fI7F7e4Dm1FzMcW1uUipwMJQUqAdabKsYg6NxMii6O zMJX7R5fI8oIk9x3LV390zYwIq2EriNr3gHCrl+cDWPadIpM48NlM/1iS Uv/1H3FTgHwsz3qGCvPbm+LP//NKBNJCY9ZgRE+IxoG/jtmdskxI8anVd N+kA9GayhohMHElPEXe814NYAecHx4Zp9U+17lowEUNmVwdfPCc/yFgqo w71v/hGfvU1JV73KmoKK9jOEALT8QEvmuQ6kEeJUeywKzpXVlopftgZdw XAbI44Jumu4Fj7ESK7GBjY0XTwIsfdisPjGL4+R/c9OrwpqJiQEm2crDm Q==; X-IronPort-AV: E=Sophos;i="5.90,292,1643644800"; d="scan'208";a="303120016" Received: from uls-op-cesaip02.wdc.com (HELO uls-op-cesaep02.wdc.com) ([199.255.45.15]) by ob1.hgst.iphmx.com with ESMTP; 27 Apr 2022 10:19:58 +0800 IronPort-SDR: O3jHDK5Qijs5R1Ipc0iIC9SlY6j2MrGj9fxw/Hebin2451Wu2L2WLO+PFOXOz/wJtniUtVX06w dFJ5AFJuClQ7iOt7XQdzNrilMLoeRVPSHklID/DgEaSozjOovYFFMNZTThpUIk9Z42BlH7jYsE 9eu50ggz9MqCU4Iox9x+Z5SoE5RFPnjUf8jpjjg2uKLiIt3RtahJlcFGdWsuaFK6pR+JXMQjcb kjyyU+dCoO0o87vShz5H6k0r3G6I4V7nfX4l35+UoQhXMBa5ddJy0hGrnXB99GXuHgVgD9kXOq yAMzHmtVlMxkRi7kUy2HeSr6 Received: from uls-op-cesaip02.wdc.com ([10.248.3.37]) by uls-op-cesaep02.wdc.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 26 Apr 2022 18:50:08 -0700 IronPort-SDR: FAJE0lZuyFETOFe9eGadjC5ras4GV0Nb1eQBDPCF6CIyD3/IgcY2v/x3z3EOFTn/IKuP+oYYvx g5sOKFLInR0yMndgOjwBHzC2At4EkWceeS7IxugD8dkDg8mKX81+183zG3p83XkLZKvy5+KSPX Mq53zmirIZNfYov2ke9kWS+Uyip/pAQhhr2RnRXkN/8rMtA9G2VK3x7b3M860JR6TBGRdIvSw+ pzMaxw/YqdeNJSDi6H5skyAvSQx6TF0x+0aC+iB9ikPxwwEUk7xBP0VVyqLfSgKdLvdCSJZVha mLU= WDCIronportException: Internal Received: from usg-ed-osssrv.wdc.com ([10.3.10.180]) by uls-op-cesaip02.wdc.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 26 Apr 2022 19:19:58 -0700 Received: from usg-ed-osssrv.wdc.com (usg-ed-osssrv.wdc.com [127.0.0.1]) by usg-ed-osssrv.wdc.com (Postfix) with ESMTP id 4Kp2Wx6krKz1SVnx for ; Tue, 26 Apr 2022 19:19:57 -0700 (PDT) Authentication-Results: usg-ed-osssrv.wdc.com (amavisd-new); dkim=pass reason="pass (just generated, assumed good)" header.d=opensource.wdc.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d= opensource.wdc.com; h=content-transfer-encoding:content-type :in-reply-to:organization:from:references:to:content-language :subject:user-agent:mime-version:date:message-id; s=dkim; t= 1651025996; x=1653617997; bh=5TeQN5lhR4Ahp6383VgZCh7eErXQ5BHljxe q6DTkar0=; b=HLh3gOdIoLSGUUyUMi7ugQ80WGd64u85fuvUH7mJ8KLbrYvw+n4 ZfEA4vmz1fIqGmNkLDTQnp/EARZTn46QbXeSk9AgyEeRoc7QmzuDr9+HSFQaGPS8 f1KVXkLxmHZEAFQGUY6AEqMMZEzD6CBczxJOM0lOCUAGFZdIHa4uWWiTNs+eHmga PvLhDA+WtojKoy1rBnwEqxVn9ie+kA361GS9CQqkEl2D2izLQHDP6fZUcMAJX4bG PN52+3YAVZz25etiQ45f0l/NwYQB1q3ZmAaDgflCx0DlZ/VOoK33B2u08wb5A2no P8lJfWB4SE71FKiYeaqRUK95YDBBPOWivdg== X-Virus-Scanned: amavisd-new at usg-ed-osssrv.wdc.com Received: from usg-ed-osssrv.wdc.com ([127.0.0.1]) by usg-ed-osssrv.wdc.com (usg-ed-osssrv.wdc.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id bNS6KAZ-J8_n for ; Tue, 26 Apr 2022 19:19:56 -0700 (PDT) Received: from [10.225.163.27] (unknown [10.225.163.27]) by usg-ed-osssrv.wdc.com (Postfix) with ESMTPSA id 4Kp2Wn4QZqz1Rvlc; Tue, 26 Apr 2022 19:19:49 -0700 (PDT) Message-ID: <6a85e8c8-d9d1-f192-f10d-09052703c99a@opensource.wdc.com> Date: Wed, 27 Apr 2022 11:19:48 +0900 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.8.0 Subject: Re: [PATCH v4 00/10] Add Copy offload support Content-Language: en-US To: Nitesh Shetty Cc: chaitanyak@nvidia.com, linux-block@vger.kernel.org, linux-scsi@vger.kernel.org, dm-devel@redhat.com, linux-nvme@lists.infradead.org, linux-fsdevel@vger.kernel.org, axboe@kernel.dk, msnitzer@redhat.com, bvanassche@acm.org, martin.petersen@oracle.com, hare@suse.de, kbusch@kernel.org, hch@lst.de, Frederick.Knight@netapp.com, osandov@fb.com, lsf-pc@lists.linux-foundation.org, djwong@kernel.org, josef@toxicpanda.com, clm@fb.com, dsterba@suse.com, tytso@mit.edu, jack@suse.com, nitheshshetty@gmail.com, gost.dev@samsung.com, Alasdair Kergon , Mike Snitzer , Sagi Grimberg , James Smart , Chaitanya Kulkarni , Naohiro Aota , Johannes Thumshirn , Alexander Viro , linux-kernel@vger.kernel.org References: <20220426101241.30100-1-nj.shetty@samsung.com> From: Damien Le Moal Organization: Western Digital Research In-Reply-To: <20220426101241.30100-1-nj.shetty@samsung.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-3.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,NICE_REPLY_A,RDNS_NONE,SPF_HELO_NONE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 4/26/22 19:12, Nitesh Shetty wrote: > The patch series covers the points discussed in November 2021 virtual c= all > [LSF/MM/BFP TOPIC] Storage: Copy Offload[0]. > We have covered the Initial agreed requirements in this patchset. > Patchset borrows Mikulas's token based approach for 2 bdev > implementation. >=20 > Overall series supports =E2=80=93 >=20 > 1. Driver > - NVMe Copy command (single NS), including support in nvme-target (for > block and file backend) It would also be nice to have copy offload emulation in null_blk for test= ing. >=20 > 2. Block layer > - Block-generic copy (REQ_COPY flag), with interface accommodating > two block-devs, and multi-source/destination interface > - Emulation, when offload is natively absent > - dm-linear support (for cases not requiring split) >=20 > 3. User-interface > - new ioctl > - copy_file_range for zonefs >=20 > 4. In-kernel user > - dm-kcopyd > - copy_file_range in zonefs >=20 > For zonefs copy_file_range - Seems we cannot levearge fstest here. Limi= ted > testing is done at this point using a custom application for unit testi= ng. >=20 > Appreciate the inputs on plumbing and how to test this further? > Perhaps some of it can be discussed during LSF/MM too. >=20 > [0] https://lore.kernel.org/linux-nvme/CA+1E3rJ7BZ7LjQXXTdX+-0Edz=3DzT1= 4mmPGMiVCzUgB33C60tbQ@mail.gmail.com/ >=20 > Changes in v4: > - added copy_file_range support for zonefs > - added documentaion about new sysfs entries > - incorporated review comments on v3 > - minor fixes >=20 >=20 > Arnav Dawn (2): > nvmet: add copy command support for bdev and file ns > fs: add support for copy file range in zonefs >=20 > Nitesh Shetty (7): > block: Introduce queue limits for copy-offload support > block: Add copy offload support infrastructure > block: Introduce a new ioctl for copy > block: add emulation for copy > nvme: add copy offload support > dm: Add support for copy offload. > dm: Enable copy offload for dm-linear target >=20 > SelvaKumar S (1): > dm kcopyd: use copy offload support >=20 > Documentation/ABI/stable/sysfs-block | 83 +++++++ > block/blk-lib.c | 358 +++++++++++++++++++++++++++ > block/blk-map.c | 2 +- > block/blk-settings.c | 59 +++++ > block/blk-sysfs.c | 138 +++++++++++ > block/blk.h | 2 + > block/ioctl.c | 32 +++ > drivers/md/dm-kcopyd.c | 55 +++- > drivers/md/dm-linear.c | 1 + > drivers/md/dm-table.c | 45 ++++ > drivers/md/dm.c | 6 + > drivers/nvme/host/core.c | 116 ++++++++- > drivers/nvme/host/fc.c | 4 + > drivers/nvme/host/nvme.h | 7 + > drivers/nvme/host/pci.c | 25 ++ > drivers/nvme/host/rdma.c | 6 + > drivers/nvme/host/tcp.c | 14 ++ > drivers/nvme/host/trace.c | 19 ++ > drivers/nvme/target/admin-cmd.c | 8 +- > drivers/nvme/target/io-cmd-bdev.c | 65 +++++ > drivers/nvme/target/io-cmd-file.c | 49 ++++ > fs/zonefs/super.c | 178 ++++++++++++- > fs/zonefs/zonefs.h | 1 + > include/linux/blk_types.h | 21 ++ > include/linux/blkdev.h | 17 ++ > include/linux/device-mapper.h | 5 + > include/linux/nvme.h | 43 +++- > include/uapi/linux/fs.h | 23 ++ > 28 files changed, 1367 insertions(+), 15 deletions(-) >=20 >=20 > base-commit: e7d6987e09a328d4a949701db40ef63fbb970670 --=20 Damien Le Moal Western Digital Research