Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp6003842pxb; Tue, 16 Feb 2021 13:17:36 -0800 (PST) X-Google-Smtp-Source: ABdhPJztyVhVmC3RaPkYVv/S3d1wTH7Gd67TPmd6TOrrT1Qd2KU6LR1xmW34gzPkRIPNwA7MnGm0 X-Received: by 2002:a50:9dcd:: with SMTP id l13mr23056555edk.220.1613510256505; Tue, 16 Feb 2021 13:17:36 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1613510256; cv=none; d=google.com; s=arc-20160816; b=Yz83hq+m4no4YIashjM3kLYDCNDdtnAN81tLU4Ds3mFRtpt5ZRE9+sta4wAhPbjYpv Fb7ew1s6i1+vATJdXqyCeXgZCtagSTNz3j17amzo64AKlOOaNOCzngP2j3+mcoL21I4c Wh/0QhC0qPMRR9e6kd5I5IksrLidp6CQIMQ3BXmU4iRNDzMHH/w9MJyfFSv1MIl/zvHl ZqLBUjOT4d4IZK0AUx8Fu3wwGXOe2Zk45y+qXfWyfL1jOzDxZ8uNpRTOcYuR0ByXm8vi HHxE48ErSYC0kVp2gfAfJ9cphMsGK88De/n1DXQMPPqjHOV1YuQNsGIHtd+WoZuSEVjF f1iA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=R9pJQdXCNVW4q6rZ/6zXfBrmEoa3xvKen1QyJUucPzI=; b=HXa3RVJZZyjkVIXHr017/ZMmDseQIfAMTD8UkDOCFgh4TEYrlayKkz6dX0rF7SicNI eLjpQyWO20XqJxPtEiXQlzyVrlF9X4hWDXdu+t3KrJmsl7ycOXwT2GR82Gc87eLQimRq KTD2S08Z9WJUzyJxWp8NRHeRXdgpjh36iHUW1xvxt06GrfAwQkz+xoNjGf3SDn5YWxkQ azn2QfqN6DAlptrb6M7n3Mk9GwksYiYXPxUfUE2VsfNenTFhfBBDWjPnO7kuEepqML8t OJTIy496l77UjvttR5Fw9AzYB6MoGx1qVHGqEG0lXBthAZ3ZGoD3g2KlRcu1nBa41lPy MDSQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=bIbljLq1; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id cd8si80605ejb.152.2021.02.16.13.17.03; Tue, 16 Feb 2021 13:17:36 -0800 (PST) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=bIbljLq1; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230201AbhBPVQC (ORCPT + 99 others); Tue, 16 Feb 2021 16:16:02 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:54070 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229577AbhBPVP7 (ORCPT ); Tue, 16 Feb 2021 16:15:59 -0500 Received: from mail-lj1-x229.google.com (mail-lj1-x229.google.com [IPv6:2a00:1450:4864:20::229]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B7D9AC061574; Tue, 16 Feb 2021 13:15:18 -0800 (PST) Received: by mail-lj1-x229.google.com with SMTP id e17so13614170ljl.8; Tue, 16 Feb 2021 13:15:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=R9pJQdXCNVW4q6rZ/6zXfBrmEoa3xvKen1QyJUucPzI=; b=bIbljLq1gKZZqu6Ih7d5RhNIa7jd+Gk1B/SaCOLrbCpw0RoZqpqV38oGmSWmWMOxCv bHdQKyPgLYhhDaZKGZ9HPOLZaj6ZwT9JRbJ8ny6IY7RpOkR7VM5LMeUvCafQC8D+fqR8 AhCQuf86Dlgp8m5FLHDO/Mv5c5bcvdABtzfXw1H6c/v9CnNvBmiMs7EuEGzqrpvmIkSE prR/5Te/N75jDo6xb9zHwPhEuE/B/RKzz9Z46STWGd2j0Gvha7kVam+XHGxPYbXv0uBI 6vRumFTNBa11qhK0xsS4U8e1uhGgM8lq0IUYU1tmAbUZW0PFDj3DlYn9PydCcq14AHLM m/Ag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=R9pJQdXCNVW4q6rZ/6zXfBrmEoa3xvKen1QyJUucPzI=; b=LgIwhG8TnRAUab/5OJlpx9pZ/i+QoUuztHaAZv7wOgaUfPRtySjd/gkiKIjWy6BhF+ kinM55PL9cnEG4OJNOmgbdgq0emDteblYUiW31Ha5i9AntteFYZTAqT2e6re5/mp2P5Q HCkNFqjyzDhctdW5yssND6Hw4bo7GdwuYEj1C2UvVq5aoEwo6aDM0dZjC93eydYxvJTW pgb55+4UH27JPoiwz9XDgcJMWCP8CnrqOWZfqpvqd7KtlipUetJSgJ1XtBnLOB8+Oyg2 7KTtZK4tG1genIKmDAhK+43hhEQ7fYzm7YtsLlFnXecgEZKIlPGhVItoppzAI9q/JKHI 8W7Q== X-Gm-Message-State: AOAM531Z3TsK8WvPSga9trN42AGCWD+6JvSwwnE4oFZoNDEe5E+p5a/f w1kyZ2iOghHo83oEe9mucP0scu3l5UiIN9fmKLo= X-Received: by 2002:a2e:9951:: with SMTP id r17mr9046188ljj.148.1613510117057; Tue, 16 Feb 2021 13:15:17 -0800 (PST) MIME-Version: 1.0 References: <20210215154317.8590-1-lhenriques@suse.de> <73ab4951f48d69f0183548c7a82f7ae37e286d1c.camel@hammerspace.com> <92d27397479984b95883197d90318ee76995b42e.camel@hammerspace.com> <87r1lgjm7l.fsf@suse.de> <87blckj75z.fsf@suse.de> <874kibkflh.fsf@suse.de> In-Reply-To: From: Steve French Date: Tue, 16 Feb 2021 15:15:06 -0600 Message-ID: Subject: Re: [PATCH v2] vfs: prevent copy_file_range to copy across devices To: Amir Goldstein Cc: Anna Schumaker , Luis Henriques , Trond Myklebust , "samba-technical@lists.samba.org" , "drinkcat@chromium.org" , "iant@google.com" , "linux-cifs@vger.kernel.org" , "darrick.wong@oracle.com" , "linux-kernel@vger.kernel.org" , "jlayton@kernel.org" , "llozano@chromium.org" , "linux-nfs@vger.kernel.org" , "miklos@szeredi.hu" , "viro@zeniv.linux.org.uk" , "dchinner@redhat.com" , "linux-fsdevel@vger.kernel.org" , "gregkh@linuxfoundation.org" , "sfrench@samba.org" , "ceph-devel@vger.kernel.org" Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Tue, Feb 16, 2021 at 1:40 PM Amir Goldstein wrote: > > On Tue, Feb 16, 2021 at 9:31 PM Steve French wrote: > > > > On Tue, Feb 16, 2021 at 1:29 PM Anna Schumaker > > wrote: > > > > > > On Tue, Feb 16, 2021 at 2:22 PM Amir Goldstein wrote: > > > > > > > > On Tue, Feb 16, 2021 at 8:54 PM Luis Henriques wrote: > > > > > > > > > > Amir Goldstein writes: > > > > > > > > > > > On Tue, Feb 16, 2021 at 6:41 PM Luis Henriques wrote: > > > > > >> > > > > > >> Amir Goldstein writes: > > > > > >> > > > > > >> >> Ugh. And I guess overlayfs may have a similar problem. > > > > > >> > > > > > > >> > Not exactly. > > > > > >> > Generally speaking, overlayfs should call vfs_copy_file_range() > > > > > >> > with the flags it got from layer above, so if called from nfsd it > > > > > >> > will allow cross fs copy and when called from syscall it won't. > > > > > >> > > > > > > >> > There are some corner cases where overlayfs could benefit from > > > > > >> > COPY_FILE_SPLICE (e.g. copy from lower file to upper file), but > > > > > >> > let's leave those for now. Just leave overlayfs code as is. > > > > > >> > > > > > >> Got it, thanks for clarifying. > > > > > >> > > > > > >> >> > This is easy to solve with a flag COPY_FILE_SPLICE (or something) that > > > > > >> >> > is internal to kernel users. > > > > > >> >> > > > > > > >> >> > FWIW, you may want to look at the loop in ovl_copy_up_data() > > > > > >> >> > for improvements to nfsd_copy_file_range(). > > > > > >> >> > > > > > > >> >> > We can move the check out to copy_file_range syscall: > > > > > >> >> > > > > > > >> >> > if (flags != 0) > > > > > >> >> > return -EINVAL; > > > > > >> >> > > > > > > >> >> > Leave the fallback from all filesystems and check for the > > > > > >> >> > COPY_FILE_SPLICE flag inside generic_copy_file_range(). > > > > > >> >> > > > > > >> >> Ok, the diff bellow is just to make sure I understood your suggestion. > > > > > >> >> > > > > > >> >> The patch will also need to: > > > > > >> >> > > > > > >> >> - change nfs and overlayfs calls to vfs_copy_file_range() so that they > > > > > >> >> use the new flag. > > > > > >> >> > > > > > >> >> - check flags in generic_copy_file_checks() to make sure only valid flags > > > > > >> >> are used (COPY_FILE_SPLICE at the moment). > > > > > >> >> > > > > > >> >> Also, where should this flag be defined? include/uapi/linux/fs.h? > > > > > >> > > > > > > >> > Grep for REMAP_FILE_ > > > > > >> > Same header file, same Documentation rst file. > > > > > >> > > > > > > >> >> > > > > > >> >> Cheers, > > > > > >> >> -- > > > > > >> >> Luis > > > > > >> >> > > > > > >> >> diff --git a/fs/read_write.c b/fs/read_write.c > > > > > >> >> index 75f764b43418..341d315d2a96 100644 > > > > > >> >> --- a/fs/read_write.c > > > > > >> >> +++ b/fs/read_write.c > > > > > >> >> @@ -1383,6 +1383,13 @@ ssize_t generic_copy_file_range(struct file *file_in, loff_t pos_in, > > > > > >> >> struct file *file_out, loff_t pos_out, > > > > > >> >> size_t len, unsigned int flags) > > > > > >> >> { > > > > > >> >> + if (!(flags & COPY_FILE_SPLICE)) { > > > > > >> >> + if (!file_out->f_op->copy_file_range) > > > > > >> >> + return -EOPNOTSUPP; > > > > > >> >> + else if (file_out->f_op->copy_file_range != > > > > > >> >> + file_in->f_op->copy_file_range) > > > > > >> >> + return -EXDEV; > > > > > >> >> + } > > > > > >> > > > > > > >> > That looks strange, because you are duplicating the logic in > > > > > >> > do_copy_file_range(). Maybe better: > > > > > >> > > > > > > >> > if (WARN_ON_ONCE(flags & ~COPY_FILE_SPLICE)) > > > > > >> > return -EINVAL; > > > > > >> > if (flags & COPY_FILE_SPLICE) > > > > > >> > return do_splice_direct(file_in, &pos_in, file_out, &pos_out, > > > > > >> > len > MAX_RW_COUNT ? MAX_RW_COUNT : len, 0); > > > > > >> > > > > > >> My initial reasoning for duplicating the logic in do_copy_file_range() was > > > > > >> to allow the generic_copy_file_range() callers to be left unmodified and > > > > > >> allow the filesystems to default to this implementation. > > > > > >> > > > > > >> With this change, I guess that the calls to generic_copy_file_range() from > > > > > >> the different filesystems can be dropped, as in my initial patch, as they > > > > > >> will always get -EINVAL. The other option would be to set the > > > > > >> COPY_FILE_SPLICE flag in those calls, but that would get us back to the > > > > > >> problem we're trying to solve. > > > > > > > > > > > > I don't understand the problem. > > > > > > > > > > > > What exactly is wrong with the code I suggested? > > > > > > Why should any filesystem be changed? > > > > > > > > > > > > Maybe I am missing something. > > > > > > > > > > Ok, I have to do a full brain reboot and start all over. > > > > > > > > > > Before that, I picked the code you suggested and tested it. I've mounted > > > > > a cephfs filesystem and used xfs_io to execute a 'copy_range' command > > > > > using /sys/kernel/debug/sched_features as source. The result was a > > > > > 0-sized file in cephfs. And the reason is thevfs_copy_file_range() > > > > > early exit in: > > > > > > > > > > if (len == 0) > > > > > return 0; > > > > > > > > > > 'len' is set in generic_copy_file_checks(). > > > > > > > > Good point.. I guess we will need to do all the checks earlier in > > > > generic_copy_file_checks() including the logic of: > > > > > > > > if (file_in->f_op->remap_file_range && > > > > file_inode(file_in)->i_sb == file_inode(file_out)->i_sb) > > > > > > > > > > > > > > > > > > This means that we're not solving the original problem anymore (probably > > > > > since v1 of this patch, haven't checked). > > > > > > > > > > Also, re-reading Trond's emails, I read: "... also disallowing the copy > > > > > from, say, an XFS formatted partition to an ext4 partition". Isn't that > > > > > *exactly* what we're trying to do here? I.e. _prevent_ these copies from > > > > > happening so that tracefs files can't be CFR'ed? > > > > > > > > > > > > > We want to address the report which means calls coming from > > > > copy_file_range() syscall. > > > > > > > > Trond's use case is vfs_copy_file_range() coming from nfsd. > > > > When he writes about copy from XFS to ext4, he means an > > > > NFS client is issuing server side copy (on same or different NFS mounts) > > > > and the NFS server is executing nfsd_copy_file_range() on a source > > > > file that happens to be on XFS and destination happens to be on ext4. > > > > > > NFS also supports a server-to-server copy where the destination server > > > mounts the source server and reads the data to be copied. Please don't > > > break that either :) > > > > As long as the copy is via nfsd_copy_file_range() and not from the syscall > it should not regress. > > > This is a case we will eventually need to support for cifs (SMB3) as well. > > > > samba already does server side copy very well without needing any support > from the kernel. > > nfsd also doesn't *need* to use vfs_copy_file_range() it can use kernel APIs > like the loop in ovl_copy_up_data(). But it does, so we should not regress it. > > samba/nfsd can try to use copy_file_range() and it will work if the > source/target > fs support it. Otherwise, the server can perfectly well do the copy via other > available interfaces, just like userspace copy tools. I was thinking about cifsd ("ksmbd") the kernel server from Namjae/Sergey etc. which is making excellent progress. -- Thanks, Steve