2023-09-29 20:25:07

by Luis Henriques

[permalink] [raw]
Subject: [RFC PATCH] fs: add AT_EMPTY_PATH support to unlinkat()

The linkat() syscall has support for the AT_EMPTY_PATH linux-specific flag
for a long time. This flag allows callers to use an empty string in the
'oldpath' parameter, and to create the link to the file descriptor instead.

This patch modifies the unlinkat() syscall to use a similar semantic for
this flag, i.e. to allow for an empty string to indicate that we want to
unlink the file descriptor inode.

Signed-off-by: Luis Henriques <[email protected]>
---
Hi!

I'm sending an early RFC of this patch specially because I'm not sure how
useful it is, and if support for this flag is really welcome.

The code is already a bit messy, and adding support for this extra flag
makes it even worse. Maybe it could be refactored; suggestions are
welcome.

Also, this patch is only lightly tested -- it doesn't seem to break
anything, but I'll need to test it some more. But as I said, I wanted to
get some feedback to make sure this patch is worth the trouble.

To be honest, this patch wasn't my idea: I remember seeing someone
somewhere suggesting or asking this flag to be added. But it was long
time ago, I've written down the idea but I forgot keep a reference to the
source. So, I hope the patch _may_ be useful to someone and that it's
purpose isn't just to make these two syscalls more symmetric (which is a
honourable goal in itself, if you ask my opinion! :-) ).

Cheers,
--
Luís

fs/coredump.c | 2 +-
fs/init.c | 4 +-
fs/internal.h | 4 +-
fs/namei.c | 112 +++++++++++++++++++++++++++++++-------------------
io_uring/fs.c | 4 +-
5 files changed, 76 insertions(+), 50 deletions(-)

diff --git a/fs/coredump.c b/fs/coredump.c
index 9d235fa14ab9..3e0b291fd60f 100644
--- a/fs/coredump.c
+++ b/fs/coredump.c
@@ -672,7 +672,7 @@ void do_coredump(const kernel_siginfo_t *siginfo)
* If it doesn't exist, that's fine. If there's some
* other problem, we'll catch it at the filp_open().
*/
- do_unlinkat(AT_FDCWD, getname_kernel(cn.corename));
+ do_unlinkat(AT_FDCWD, getname_kernel(cn.corename), 0);
}

/*
diff --git a/fs/init.c b/fs/init.c
index 9684406a8416..03ce144b4a63 100644
--- a/fs/init.c
+++ b/fs/init.c
@@ -217,7 +217,7 @@ int __init init_symlink(const char *oldname, const char *newname)

int __init init_unlink(const char *pathname)
{
- return do_unlinkat(AT_FDCWD, getname_kernel(pathname));
+ return do_unlinkat(AT_FDCWD, getname_kernel(pathname), 0);
}

int __init init_mkdir(const char *pathname, umode_t mode)
@@ -241,7 +241,7 @@ int __init init_mkdir(const char *pathname, umode_t mode)

int __init init_rmdir(const char *pathname)
{
- return do_rmdir(AT_FDCWD, getname_kernel(pathname));
+ return do_rmdir(AT_FDCWD, getname_kernel(pathname), 0);
}

int __init init_utimes(char *filename, struct timespec64 *ts)
diff --git a/fs/internal.h b/fs/internal.h
index d64ae03998cc..77018a31812b 100644
--- a/fs/internal.h
+++ b/fs/internal.h
@@ -53,8 +53,8 @@ extern int finish_clean_context(struct fs_context *fc);
*/
extern int filename_lookup(int dfd, struct filename *name, unsigned flags,
struct path *path, struct path *root);
-int do_rmdir(int dfd, struct filename *name);
-int do_unlinkat(int dfd, struct filename *name);
+int do_rmdir(int dfd, struct filename *name, int flags);
+int do_unlinkat(int dfd, struct filename *name, int flags);
int may_linkat(struct mnt_idmap *idmap, const struct path *link);
int do_renameat2(int olddfd, struct filename *oldname, int newdfd,
struct filename *newname, unsigned int flags);
diff --git a/fs/namei.c b/fs/namei.c
index 156a570d7831..4327fffd8330 100644
--- a/fs/namei.c
+++ b/fs/namei.c
@@ -4218,37 +4218,50 @@ int vfs_rmdir(struct mnt_idmap *idmap, struct inode *dir,
}
EXPORT_SYMBOL(vfs_rmdir);

-int do_rmdir(int dfd, struct filename *name)
+int do_rmdir(int dfd, struct filename *name, int flags)
{
int error;
- struct dentry *dentry;
+ struct dentry *dentry, *parent;
struct path path;
struct qstr last;
int type;
unsigned int lookup_flags = 0;
-retry:
- error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
- if (error)
- goto exit1;
+ bool empty_path = (flags & AT_EMPTY_PATH);

- switch (type) {
- case LAST_DOTDOT:
- error = -ENOTEMPTY;
- goto exit2;
- case LAST_DOT:
- error = -EINVAL;
- goto exit2;
- case LAST_ROOT:
- error = -EBUSY;
- goto exit2;
+retry:
+ if (empty_path) {
+ error = filename_lookup(dfd, name, 0, &path, NULL);
+ if (error)
+ goto exit1;
+ parent = path.dentry->d_parent;
+ dentry = path.dentry;
+ } else {
+ error = filename_parentat(dfd, name, lookup_flags, &path, &last,
+ &type);
+ if (error)
+ goto exit1;
+
+ switch (type) {
+ case LAST_DOTDOT:
+ error = -ENOTEMPTY;
+ goto exit2;
+ case LAST_DOT:
+ error = -EINVAL;
+ goto exit2;
+ case LAST_ROOT:
+ error = -EBUSY;
+ goto exit2;
+ }
+ parent = path.dentry;
}

error = mnt_want_write(path.mnt);
if (error)
goto exit2;

- inode_lock_nested(path.dentry->d_inode, I_MUTEX_PARENT);
- dentry = lookup_one_qstr_excl(&last, path.dentry, lookup_flags);
+ inode_lock_nested(parent->d_inode, I_MUTEX_PARENT);
+ if (!empty_path)
+ dentry = lookup_one_qstr_excl(&last, path.dentry, lookup_flags);
error = PTR_ERR(dentry);
if (IS_ERR(dentry))
goto exit3;
@@ -4259,11 +4272,12 @@ int do_rmdir(int dfd, struct filename *name)
error = security_path_rmdir(&path, dentry);
if (error)
goto exit4;
- error = vfs_rmdir(mnt_idmap(path.mnt), path.dentry->d_inode, dentry);
+ error = vfs_rmdir(mnt_idmap(path.mnt), parent->d_inode, dentry);
exit4:
- dput(dentry);
+ if (!empty_path)
+ dput(dentry);
exit3:
- inode_unlock(path.dentry->d_inode);
+ inode_unlock(parent->d_inode);
mnt_drop_write(path.mnt);
exit2:
path_put(&path);
@@ -4278,7 +4292,7 @@ int do_rmdir(int dfd, struct filename *name)

SYSCALL_DEFINE1(rmdir, const char __user *, pathname)
{
- return do_rmdir(AT_FDCWD, getname(pathname));
+ return do_rmdir(AT_FDCWD, getname(pathname), 0);
}

/**
@@ -4357,48 +4371,60 @@ EXPORT_SYMBOL(vfs_unlink);
* writeout happening, and we don't want to prevent access to the directory
* while waiting on the I/O.
*/
-int do_unlinkat(int dfd, struct filename *name)
+int do_unlinkat(int dfd, struct filename *name, int flags)
{
int error;
- struct dentry *dentry;
+ struct dentry *dentry, *parent;
struct path path;
struct qstr last;
int type;
struct inode *inode = NULL;
struct inode *delegated_inode = NULL;
unsigned int lookup_flags = 0;
-retry:
- error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
- if (error)
- goto exit1;
+ bool empty_path = (flags & AT_EMPTY_PATH);

- error = -EISDIR;
- if (type != LAST_NORM)
- goto exit2;
+retry:
+ if (empty_path) {
+ error = filename_lookup(dfd, name, 0, &path, NULL);
+ if (error)
+ goto exit1;
+ parent = path.dentry->d_parent;
+ dentry = path.dentry;
+ } else {
+ error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
+ if (error)
+ goto exit1;
+ error = -EISDIR;
+ if (type != LAST_NORM)
+ goto exit2;
+ parent = path.dentry;
+ }

error = mnt_want_write(path.mnt);
if (error)
goto exit2;
retry_deleg:
- inode_lock_nested(path.dentry->d_inode, I_MUTEX_PARENT);
- dentry = lookup_one_qstr_excl(&last, path.dentry, lookup_flags);
+ inode_lock_nested(parent->d_inode, I_MUTEX_PARENT);
+ if (!empty_path)
+ dentry = lookup_one_qstr_excl(&last, parent, lookup_flags);
error = PTR_ERR(dentry);
if (!IS_ERR(dentry)) {

/* Why not before? Because we want correct error value */
- if (last.name[last.len] || d_is_negative(dentry))
+ if ((!empty_path && last.name[last.len]) || d_is_negative(dentry))
goto slashes;
inode = dentry->d_inode;
ihold(inode);
error = security_path_unlink(&path, dentry);
if (error)
goto exit3;
- error = vfs_unlink(mnt_idmap(path.mnt), path.dentry->d_inode,
+ error = vfs_unlink(mnt_idmap(path.mnt), parent->d_inode,
dentry, &delegated_inode);
exit3:
- dput(dentry);
+ if (!empty_path)
+ dput(dentry);
}
- inode_unlock(path.dentry->d_inode);
+ inode_unlock(parent->d_inode);
if (inode)
iput(inode); /* truncate the inode here */
inode = NULL;
@@ -4429,19 +4455,19 @@ int do_unlinkat(int dfd, struct filename *name)
goto exit3;
}

-SYSCALL_DEFINE3(unlinkat, int, dfd, const char __user *, pathname, int, flag)
+SYSCALL_DEFINE3(unlinkat, int, dfd, const char __user *, pathname, int, flags)
{
- if ((flag & ~AT_REMOVEDIR) != 0)
+ if ((flags & ~(AT_REMOVEDIR | AT_EMPTY_PATH)) != 0)
return -EINVAL;

- if (flag & AT_REMOVEDIR)
- return do_rmdir(dfd, getname(pathname));
- return do_unlinkat(dfd, getname(pathname));
+ if (flags & AT_REMOVEDIR)
+ return do_rmdir(dfd, getname_uflags(pathname, flags), flags);
+ return do_unlinkat(dfd, getname_uflags(pathname, flags), flags);
}

SYSCALL_DEFINE1(unlink, const char __user *, pathname)
{
- return do_unlinkat(AT_FDCWD, getname(pathname));
+ return do_unlinkat(AT_FDCWD, getname(pathname), 0);
}

/**
diff --git a/io_uring/fs.c b/io_uring/fs.c
index f6a69a549fd4..c62e53367072 100644
--- a/io_uring/fs.c
+++ b/io_uring/fs.c
@@ -135,9 +135,9 @@ int io_unlinkat(struct io_kiocb *req, unsigned int issue_flags)
WARN_ON_ONCE(issue_flags & IO_URING_F_NONBLOCK);

if (un->flags & AT_REMOVEDIR)
- ret = do_rmdir(un->dfd, un->filename);
+ ret = do_rmdir(un->dfd, un->filename, 0);
else
- ret = do_unlinkat(un->dfd, un->filename);
+ ret = do_unlinkat(un->dfd, un->filename, 0);

req->flags &= ~REQ_F_NEED_CLEANUP;
io_req_set_res(req, ret, 0);


2023-10-09 02:06:40

by Al Viro

[permalink] [raw]
Subject: Re: [RFC PATCH] fs: add AT_EMPTY_PATH support to unlinkat()

On Fri, Sep 29, 2023 at 03:04:56PM +0100, Luis Henriques wrote:

> -int do_unlinkat(int dfd, struct filename *name)
> +int do_unlinkat(int dfd, struct filename *name, int flags)
> {
> int error;
> - struct dentry *dentry;
> + struct dentry *dentry, *parent;
> struct path path;
> struct qstr last;
> int type;
> struct inode *inode = NULL;
> struct inode *delegated_inode = NULL;
> unsigned int lookup_flags = 0;
> -retry:
> - error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
> - if (error)
> - goto exit1;
> + bool empty_path = (flags & AT_EMPTY_PATH);
>
> - error = -EISDIR;
> - if (type != LAST_NORM)
> - goto exit2;
> +retry:
> + if (empty_path) {
> + error = filename_lookup(dfd, name, 0, &path, NULL);
> + if (error)
> + goto exit1;
> + parent = path.dentry->d_parent;
> + dentry = path.dentry;
> + } else {
> + error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
> + if (error)
> + goto exit1;
> + error = -EISDIR;
> + if (type != LAST_NORM)
> + goto exit2;
> + parent = path.dentry;
> + }
>
> error = mnt_want_write(path.mnt);
> if (error)
> goto exit2;
> retry_deleg:
> - inode_lock_nested(path.dentry->d_inode, I_MUTEX_PARENT);
> - dentry = lookup_one_qstr_excl(&last, path.dentry, lookup_flags);
> + inode_lock_nested(parent->d_inode, I_MUTEX_PARENT);
> + if (!empty_path)
> + dentry = lookup_one_qstr_excl(&last, parent, lookup_flags);

For starters, your 'parent' might have been freed under you, just as you'd
been trying to lock its inode. Or it could have become negative just as you'd
been fetching its ->d_inode, while we are at it.

Races aside, you are changing permissions required for removing files. For
unlink() you need to be able to get to the parent directory; if it's e.g.
outside of your namespace, you can't do anything to it. If file had been
opened there by somebody who could reach it and passed to you (via SCM_RIGHTS,
for example) you currently can't remove the sucker. With this change that
is no longer true.

The same goes for the situation when file is bound into your namespace (or
chroot jail, for that matter). path.dentry might very well be equal to
root of path.mnt; path.dentry->d_parent might be in part of tree that is
no longer visible *anywhere*. rmdir() should not be able to do anything
with it...

IMO it's fundamentally broken; not just implementation, but the concept
itself.

NAKed-by: Al Viro <[email protected]>

2023-10-09 15:16:28

by Luis Henriques

[permalink] [raw]
Subject: Re: [RFC PATCH] fs: add AT_EMPTY_PATH support to unlinkat()

Al Viro <[email protected]> writes:

> On Fri, Sep 29, 2023 at 03:04:56PM +0100, Luis Henriques wrote:
>
>> -int do_unlinkat(int dfd, struct filename *name)
>> +int do_unlinkat(int dfd, struct filename *name, int flags)
>> {
>> int error;
>> - struct dentry *dentry;
>> + struct dentry *dentry, *parent;
>> struct path path;
>> struct qstr last;
>> int type;
>> struct inode *inode = NULL;
>> struct inode *delegated_inode = NULL;
>> unsigned int lookup_flags = 0;
>> -retry:
>> - error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
>> - if (error)
>> - goto exit1;
>> + bool empty_path = (flags & AT_EMPTY_PATH);
>>
>> - error = -EISDIR;
>> - if (type != LAST_NORM)
>> - goto exit2;
>> +retry:
>> + if (empty_path) {
>> + error = filename_lookup(dfd, name, 0, &path, NULL);
>> + if (error)
>> + goto exit1;
>> + parent = path.dentry->d_parent;
>> + dentry = path.dentry;
>> + } else {
>> + error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
>> + if (error)
>> + goto exit1;
>> + error = -EISDIR;
>> + if (type != LAST_NORM)
>> + goto exit2;
>> + parent = path.dentry;
>> + }
>>
>> error = mnt_want_write(path.mnt);
>> if (error)
>> goto exit2;
>> retry_deleg:
>> - inode_lock_nested(path.dentry->d_inode, I_MUTEX_PARENT);
>> - dentry = lookup_one_qstr_excl(&last, path.dentry, lookup_flags);
>> + inode_lock_nested(parent->d_inode, I_MUTEX_PARENT);
>> + if (!empty_path)
>> + dentry = lookup_one_qstr_excl(&last, parent, lookup_flags);
>
> For starters, your 'parent' might have been freed under you, just as you'd
> been trying to lock its inode. Or it could have become negative just as you'd
> been fetching its ->d_inode, while we are at it.
>
> Races aside, you are changing permissions required for removing files. For
> unlink() you need to be able to get to the parent directory; if it's e.g.
> outside of your namespace, you can't do anything to it. If file had been
> opened there by somebody who could reach it and passed to you (via SCM_RIGHTS,
> for example) you currently can't remove the sucker. With this change that
> is no longer true.
>
> The same goes for the situation when file is bound into your namespace (or
> chroot jail, for that matter). path.dentry might very well be equal to
> root of path.mnt; path.dentry->d_parent might be in part of tree that is
> no longer visible *anywhere*. rmdir() should not be able to do anything
> with it...
>
> IMO it's fundamentally broken; not just implementation, but the concept
> itself.
>
> NAKed-by: Al Viro <[email protected]>

Thank you for your review, which made me glad I sent out the patch early
as an RFC. I (think I) understand the issues you pointed out and,
although some of them could be fixed (the races), I guess there's no point
pursuing this any further, since you consider the concept itself to be
broken. Again, thank you for your time.

Cheers,
--
Luís

2023-10-10 05:48:05

by Clay Harris

[permalink] [raw]
Subject: Re: [RFC PATCH] fs: add AT_EMPTY_PATH support to unlinkat()

Apologies, this message was intended as a reply to Al Viro, but I accidentally
deleted that message so I'm replying to the reply instead.

On Mon, Oct 09 2023 at 16:14:27 +0100, Luis Henriques quoth thus:

> Al Viro <[email protected]> writes:
>
> > On Fri, Sep 29, 2023 at 03:04:56PM +0100, Luis Henriques wrote:
> >
> >> -int do_unlinkat(int dfd, struct filename *name)
> >> +int do_unlinkat(int dfd, struct filename *name, int flags)
> >> {
> >> int error;
> >> - struct dentry *dentry;
> >> + struct dentry *dentry, *parent;
> >> struct path path;
> >> struct qstr last;
> >> int type;
> >> struct inode *inode = NULL;
> >> struct inode *delegated_inode = NULL;
> >> unsigned int lookup_flags = 0;
> >> -retry:
> >> - error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
> >> - if (error)
> >> - goto exit1;
> >> + bool empty_path = (flags & AT_EMPTY_PATH);
> >>
> >> - error = -EISDIR;
> >> - if (type != LAST_NORM)
> >> - goto exit2;
> >> +retry:
> >> + if (empty_path) {
> >> + error = filename_lookup(dfd, name, 0, &path, NULL);
> >> + if (error)
> >> + goto exit1;
> >> + parent = path.dentry->d_parent;
> >> + dentry = path.dentry;
> >> + } else {
> >> + error = filename_parentat(dfd, name, lookup_flags, &path, &last, &type);
> >> + if (error)
> >> + goto exit1;
> >> + error = -EISDIR;
> >> + if (type != LAST_NORM)
> >> + goto exit2;
> >> + parent = path.dentry;
> >> + }
> >>
> >> error = mnt_want_write(path.mnt);
> >> if (error)
> >> goto exit2;
> >> retry_deleg:
> >> - inode_lock_nested(path.dentry->d_inode, I_MUTEX_PARENT);
> >> - dentry = lookup_one_qstr_excl(&last, path.dentry, lookup_flags);
> >> + inode_lock_nested(parent->d_inode, I_MUTEX_PARENT);
> >> + if (!empty_path)
> >> + dentry = lookup_one_qstr_excl(&last, parent, lookup_flags);
> >
> > For starters, your 'parent' might have been freed under you, just as you'd
> > been trying to lock its inode. Or it could have become negative just as you'd
> > been fetching its ->d_inode, while we are at it.
> >
> > Races aside, you are changing permissions required for removing files. For
> > unlink() you need to be able to get to the parent directory; if it's e.g.
> > outside of your namespace, you can't do anything to it. If file had been
> > opened there by somebody who could reach it and passed to you (via SCM_RIGHTS,
> > for example) you currently can't remove the sucker. With this change that
> > is no longer true.
> >
> > The same goes for the situation when file is bound into your namespace (or
> > chroot jail, for that matter). path.dentry might very well be equal to
> > root of path.mnt; path.dentry->d_parent might be in part of tree that is
> > no longer visible *anywhere*. rmdir() should not be able to do anything
> > with it...
> >
> > IMO it's fundamentally broken; not just implementation, but the concept
> > itself.
> >
> > NAKed-by: Al Viro <[email protected]>

Al, thank you for this information. It does shine a little light on where
dragons may be hiding. I was wondering if you could comment on a related
issue.

linkat does allow specifing AT_EMPTY_PATH. However, it requires
CAP_DAC_READ_SEARCH. I saw that a patch went into the kernel to remove
this restriction, but was shortly thereafter reverted with a comment
to the effect of "We'll have to think about this a little more". Then,
radio silence. Other than requiring /proc be mounted to bypass, what
problem does this restriction solve?

Also related, the thing I'm even more interested in is the ability to
create an O_TMPFILE, populate it, set permissions, etc, and then make
it appear in a directory. The problem is I almost always don't want it
to just appear, but rather atomically replace an older version of the
file.

dfd = openat(x, "y", O_RDONLY | O_CLOEXEC | O_DIRECTORY, 0)
fd = openat(dfd, ".", O_RDWR | O_CLOEXEC | O_TMPFILE, 0600)
do stuff with fd
fsync(fd)
linkat(fd, "", dfd, "z", AT_EMPTY_PATH | AT_REPLACE?)
close(fd)
fsync(dfd)
close(dfd)

The AT_REPLACE flag has been suggested before to work around the EEXIST
behavior. Alternatively, renameat2 could accept AT_EMPTY_PATH for
olddirfd/oldpath, but fixing up linkat seems a little cleaner. Without
this, it hardly seems worthwhile to use O_TMPFILE at all, and instead
just go through the hassle of creating the file with a random name
(plus exposing that file and having to possibly rm it in case of an error).

I haven't been able to find any explanation for the AT_REPLACE idea not
gaining traction. Is there some security reason for this?

Thanks


> Thank you for your review, which made me glad I sent out the patch early
> as an RFC. I (think I) understand the issues you pointed out and,
> although some of them could be fixed (the races), I guess there's no point
> pursuing this any further, since you consider the concept itself to be
> broken. Again, thank you for your time.
>
> Cheers,
> --
> Lu?s