Received: by 2002:a25:31c3:0:0:0:0:0 with SMTP id x186csp2756706ybx; Fri, 8 Nov 2019 08:54:58 -0800 (PST) X-Google-Smtp-Source: APXvYqyOUbRwZZsXDxu1tICfvLZJkfrnZ50B1/MC4kPYd7VTL3munKvcXE9YBBs/cbq7blZB+dde X-Received: by 2002:a50:9fcb:: with SMTP id c69mr11282676edf.163.1573232098300; Fri, 08 Nov 2019 08:54:58 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1573232098; cv=none; d=google.com; s=arc-20160816; b=DvCCD98PsPcoAq/feX9E9pNnDxheI/3Rg/3jwPl9BoHMQ6JJ5xcFRWciNwUs/LX9ll uywqhNRe/usEv8LKwU8da6ok35kQnwXt49IAvBF1vqhjOMuDMfLQjSQQCEdrVvVKcuex qfpH8pXRZlh0cZN9RpJ0pQqFXNLPh6fh0Z6tdfv4bOaizKX4Z2Pkzmvwhx7rF59mkuXM rlxAzrByGNIKlI0PsvO+8eYITd+JinCbiuTYG0xZm72h0CjFgDSGTu0kAuBMvjijUvKB Uhe6kQT4CnU97a8w3etJBbIzXBCSLf3oqoz6nCuhs2tlbpf5EVVywzgaT7e3cwUNXtzT 45cQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=u277gp2OcEcDdoGTrazYq1mRWPSgI9pjB/vkUkr/NkE=; b=oVX4gWIdLZTLnSCu6rnHIdVTAUpL/egAN9NbG00/vZ2YsdyiYGXmid+ZqpumgIKh/o e9+b1CFPwo6JKFPLVVkBuNz4m1MyxCc/EHC2bfZDJves2Pnb68VsLd2IeM9pQmfn4hES QZ7kjkDEohLc1FpHDNNHx78sehzBt7eAAlZoJQKQ9DyPg0Vr3W6yLnsS8W5o8y40XNrs TKZFPI86YjnM+KfR7oRRANpWnCvGyOX0ExLEaE2FQXsqM1IM4zSLKu7IIryIFh25y+Wo s6xkLWal6Pjvccbj7jZ5eGzwRgIFFeO/xh9s6q6msG5WHBBYfjmOZ3of3kX9WfHvdw0F OmiQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=YEjn6i8U; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id gx24si4258273ejb.429.2019.11.08.08.54.34; Fri, 08 Nov 2019 08:54:58 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=YEjn6i8U; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727256AbfKHQxv (ORCPT + 99 others); Fri, 8 Nov 2019 11:53:51 -0500 Received: from mail-qt1-f193.google.com ([209.85.160.193]:42897 "EHLO mail-qt1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726095AbfKHQxv (ORCPT ); Fri, 8 Nov 2019 11:53:51 -0500 Received: by mail-qt1-f193.google.com with SMTP id t20so7177858qtn.9; Fri, 08 Nov 2019 08:53:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=u277gp2OcEcDdoGTrazYq1mRWPSgI9pjB/vkUkr/NkE=; b=YEjn6i8UYFRvcW+1CLwXFxzJg1ySCTkMjhhh/TJ+tNWcjJplTWJyAi9Npzh6TVlprp wVNq65CFIpgHWmRpYV0x639ITWXZZ7tQlmWQb7xFjytAXGx/jIXUtT2zvEby64Cy5tdf tYhDJezKYriaY6ZK9Zoz33naLmeToDrjXKs5wyInT1+Z8mWvWbR8tHfxiU/X7cwyDGkk noZi1wEi302HEesiyRGriFz7vrG1e7XAYeJJxWF7uGdMNLvUKEDptfu4c5AjIwsAG1Ca nrS/8FJHNBZwXZGQeoKVwmzWfAwn+Y4UiE5B2U3372HA+ybur9QvaD7JDLOcHP9hz/P4 T3RQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=u277gp2OcEcDdoGTrazYq1mRWPSgI9pjB/vkUkr/NkE=; b=jf7y5xpVvg3J5qnNabcgA+HNojO+0H4NxfHLnIg1z0sNb6b5xVrc8Y2/Vb+NWsy7LP a3NQYDix4JBhTkyo/RnZf6Ns66n33WXeIjveTEY8kP/PkR7EV1DapeKlGOrKcebpvP54 11mH9JQ7Lz0nOm6dn9t0aaJQgJJjl6TL8KZ8lek03uklgvpqzAY5J2VRxykCkn75GneV nawC84IajXtfu3NXNmXzX8Y7BkAwF1vzacJGXl/34W6LMjaQFA9mg8ajHwFD5R4sAsM4 1qyJfSJvRELrm2pV/ZXDT0Typ0yyuYPF3ugbjwUNbzAJ9smKClNLACl63XBnm72TJcku op5Q== X-Gm-Message-State: APjAAAXDqeFzEm1pwic2EksXxQ5chuzvXnQt9VS2z+VB1ZffMq4WnBkd m5LhXIV53/auHUZamZ1W1EfE9iq7fc1hAg== X-Received: by 2002:ac8:74c3:: with SMTP id j3mr11274012qtr.113.1573232028996; Fri, 08 Nov 2019 08:53:48 -0800 (PST) Received: from localhost.localdomain ([2804:14d:72b1:8920:a2ce:f815:f14d:bfac]) by smtp.gmail.com with ESMTPSA id v186sm2848588qkb.42.2019.11.08.08.53.46 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 08 Nov 2019 08:53:48 -0800 (PST) From: "Daniel W. S. Almeida" X-Google-Original-From: Daniel W. S. Almeida To: corbet@lwn.net Cc: "Daniel W. S. Almeida" , linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, skhan@linuxfoundation.org, linux-kernel-mentees@lists.linuxfoundation.org Subject: [RFC PATCH] Documentation: filesystems: convert fuse to RST Date: Fri, 8 Nov 2019 13:46:19 -0300 Message-Id: <20191108164619.30401-1-dwlsalmeida@gmail.com> X-Mailer: git-send-email 2.24.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: "Daniel W. S. Almeida" Converts fuse.txt to reStructuredText format, improving the presentation without changing much of the underlying content. Signed-off-by: Daniel W. S. Almeida --- .../filesystems/{fuse.txt => fuse.rst} | 216 ++++++++---------- Documentation/filesystems/index.rst | 1 + 2 files changed, 102 insertions(+), 115 deletions(-) rename Documentation/filesystems/{fuse.txt => fuse.rst} (72%) diff --git a/Documentation/filesystems/fuse.txt b/Documentation/filesystems/fuse.rst similarity index 72% rename from Documentation/filesystems/fuse.txt rename to Documentation/filesystems/fuse.rst index 13af4a49e7db..5741b1071244 100644 --- a/Documentation/filesystems/fuse.txt +++ b/Documentation/filesystems/fuse.rst @@ -1,95 +1,86 @@ -Definitions -~~~~~~~~~~~ +============== +FUSE +============== -Userspace filesystem: +Definitions +=========== +**Userspace filesystem:** A filesystem in which data and metadata are provided by an ordinary userspace process. The filesystem can be accessed normally through the kernel interface. -Filesystem daemon: - +**Filesystem daemon:** The process(es) providing the data and metadata of the filesystem. -Non-privileged mount (or user mount): - +**Non-privileged mount (or user mount):** A userspace filesystem mounted by a non-privileged (non-root) user. The filesystem daemon is running with the privileges of the mounting user. NOTE: this is not the same as mounts allowed with the "user" option in /etc/fstab, which is not discussed here. -Filesystem connection: - +**Filesystem connection:** A connection between the filesystem daemon and the kernel. The connection exists until either the daemon dies, or the filesystem is umounted. Note that detaching (or lazy umounting) the filesystem - does _not_ break the connection, in this case it will exist until + does *not* break the connection, in this case it will exist until the last reference to the filesystem is released. -Mount owner: - +**Mount owner:** The user who does the mounting. -User: - +**User:** The user who is performing filesystem operations. What is FUSE? -~~~~~~~~~~~~~ +============= FUSE is a userspace filesystem framework. It consists of a kernel -module (fuse.ko), a userspace library (libfuse.*) and a mount utility -(fusermount). +module ``(fuse.ko)``, a userspace library ``libfuse.*`` and a mount utility +``fusermount``. One of the most important features of FUSE is allowing secure, non-privileged mounts. This opens up new possibilities for the use of -filesystems. A good example is sshfs: a secure network filesystem +filesystems. A good example is ``sshfs``: a secure network filesystem using the sftp protocol. -The userspace library and utilities are available from the FUSE -homepage: - - http://fuse.sourceforge.net/ +The userspace library and utilities are available from the +`FUSE homepage: `_ Filesystem type -~~~~~~~~~~~~~~~ +=============== The filesystem type given to mount(2) can be one of the following: -'fuse' - - This is the usual way to mount a FUSE filesystem. The first - argument of the mount system call may contain an arbitrary string, - which is not interpreted by the kernel. + **fuse** + + This is the usual way to mount a FUSE filesystem. The first + argument of the mount system call may contain an arbitrary string, + which is not interpreted by the kernel. -'fuseblk' - - The filesystem is block device based. The first argument of the - mount system call is interpreted as the name of the device. + **fuseblk** + + The filesystem is block device based. The first argument of the + mount system call is interpreted as the name of the device. Mount options -~~~~~~~~~~~~~ - -'fd=N' +============= +**fd=N** The file descriptor to use for communication between the userspace filesystem and the kernel. The file descriptor must have been - obtained by opening the FUSE device ('/dev/fuse'). - -'rootmode=M' + obtained by opening the FUSE device *('/dev/fuse')*. +**rootmode=M** The file mode of the filesystem's root in octal representation. -'user_id=N' - +**user_id=N** The numeric user id of the mount owner. -'group_id=N' - +**group_id=N** The numeric group id of the mount owner. -'default_permissions' - +**default_permissions** By default FUSE doesn't check file access permissions, the filesystem is free to implement its access policy or leave it to the underlying file access mechanism (e.g. in case of network @@ -97,32 +88,29 @@ Mount options access based on file mode. It is usually useful together with the 'allow_other' mount option. -'allow_other' - +**allow_other** This option overrides the security measure restricting file access to the user mounting the filesystem. This option is by default only allowed to root, but this restriction can be removed with a (userspace) configuration option. -'max_read=N' - +**max_read=N** With this option the maximum size of read operations can be set. The default is infinite. Note that the size of read requests is limited anyway to 32 pages (which is 128kbyte on i386). -'blksize=N' - +**blksize=N** Set the block size for the filesystem. The default is 512. This option is only valid for 'fuseblk' type mounts. Control filesystem -~~~~~~~~~~~~~~~~~~ +================== -There's a control filesystem for FUSE, which can be mounted by: +There's a control filesystem for FUSE, which can be mounted by: :: mount -t fusectl none /sys/fs/fuse/connections -Mounting it under the '/sys/fs/fuse/connections' directory makes it +Mounting it under the ``'/sys/fs/fuse/connections'`` directory makes it backwards compatible with earlier versions. Under the fuse control filesystem each connection has a directory @@ -130,63 +118,61 @@ named by a unique number. For each connection the following files exist within this directory: - 'waiting' + **waiting** + The number of requests which are waiting to be transferred to + userspace or being processed by the filesystem daemon. If there is + no filesystem activity and 'waiting' is non-zero, then the + filesystem is hung or deadlocked. - The number of requests which are waiting to be transferred to - userspace or being processed by the filesystem daemon. If there is - no filesystem activity and 'waiting' is non-zero, then the - filesystem is hung or deadlocked. - - 'abort' - - Writing anything into this file will abort the filesystem - connection. This means that all waiting requests will be aborted an - error returned for all aborted and new requests. + **abort** + Writing anything into this file will abort the filesystem + connection. This means that all waiting requests will be aborted an + error returned for all aborted and new requests. Only the owner of the mount may read or write these files. Interrupting filesystem operations -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +################################## If a process issuing a FUSE filesystem request is interrupted, the following will happen: - 1) If the request is not yet sent to userspace AND the signal is - fatal (SIGKILL or unhandled fatal signal), then the request is + #. If the request is not yet sent to userspace AND the signal is + fatal (*SIGKILL* or unhandled fatal signal), then the request is dequeued and returns immediately. - 2) If the request is not yet sent to userspace AND the signal is not + #. If the request is not yet sent to userspace AND the signal is not fatal, then an 'interrupted' flag is set for the request. When the request has been successfully transferred to userspace and - this flag is set, an INTERRUPT request is queued. + this flag is set, an *INTERRUPT* request is queued. - 3) If the request is already sent to userspace, then an INTERRUPT + #. If the request is already sent to userspace, then an *INTERRUPT* request is queued. -INTERRUPT requests take precedence over other requests, so the +*INTERRUPT* requests take precedence over other requests, so the userspace filesystem will receive queued INTERRUPTs before any others. -The userspace filesystem may ignore the INTERRUPT requests entirely, -or may honor them by sending a reply to the _original_ request, with -the error set to EINTR. +The userspace filesystem may ignore the *INTERRUPT* requests entirely, +or may honor them by sending a reply to the *original* request, with +the error set to ``EINTR``. It is also possible that there's a race between processing the original request and its INTERRUPT request. There are two possibilities: - 1) The INTERRUPT request is processed before the original request is + #. The *INTERRUPT* request is processed before the original request is processed - 2) The INTERRUPT request is processed after the original request has + #. The *INTERRUPT* request is processed after the original request has been answered If the filesystem cannot find the original request, it should wait for some timeout and/or a number of new requests to arrive, after which it -should reply to the INTERRUPT request with an EAGAIN error. In case -1) the INTERRUPT request will be requeued. In case 2) the INTERRUPT +should reply to the INTERRUPT request with an ``EAGAIN`` error. In case +1) the ``INTERRUPT`` request will be requeued. In case 2) the ``INTERRUPT`` reply will be ignored. Aborting a filesystem connection -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +================================ It is possible to get into certain situations where the filesystem is not responding. Reasons for this may be: @@ -209,14 +195,14 @@ the filesystem. There are several ways to do this: - Kill the filesystem daemon and all users of the filesystem. Works in all cases except some malicious deadlocks - - Use forced umount (umount -f). Works in all cases but only if + - Use forced umount ``(umount -f)``. Works in all cases but only if filesystem is still attached (it hasn't been lazy unmounted) - Abort filesystem through the FUSE control filesystem. Most powerful method, always works. How do non-privileged mounts work? -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +================================== Since the mount() system call is a privileged operation, a helper program (fusermount) is needed, which is installed setuid root. @@ -235,20 +221,18 @@ system. Obvious requirements arising from this are: other users' or the super user's processes How are requirements fulfilled? -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +=============================== A) The mount owner could gain elevated privileges by either: - 1) creating a filesystem containing a device file, then opening - this device + 1. creating a filesystem containing a device file, then opening this device - 2) creating a filesystem containing a suid or sgid application, - then executing this application + 2. creating a filesystem containing a suid or sgid application, then executing this application - The solution is not to allow opening device files and ignore + **The solution is not to allow opening device files and ignore setuid and setgid bits when executing programs. To ensure this fusermount always adds "nosuid" and "nodev" to the mount options - for non-privileged mounts. + for non-privileged mounts.** B) If another user is accessing files or directories in the filesystem, the filesystem daemon serving requests can record the @@ -256,7 +240,7 @@ How are requirements fulfilled? information is otherwise inaccessible to the mount owner, so this counts as an information leak. - The solution to this problem will be presented in point 2) of C). + **The solution to this problem will be presented in point 2) of C).** C) There are several ways in which the mount owner can induce undesired behavior in other users' processes, such as: @@ -275,47 +259,46 @@ How are requirements fulfilled? of other users' processes. i) It can slow down or indefinitely delay the execution of a - filesystem operation creating a DoS against the user or the - whole system. For example a suid application locking a - system file, and then accessing a file on the mount owner's - filesystem could be stopped, and thus causing the system - file to be locked forever. + filesystem operation creating a DoS against the user or the + whole system. For example a suid application locking a + system file, and then accessing a file on the mount owner's + filesystem could be stopped, and thus causing the system + file to be locked forever. ii) It can present files or directories of unlimited length, or - directory structures of unlimited depth, possibly causing a - system process to eat up diskspace, memory or other - resources, again causing DoS. + directory structures of unlimited depth, possibly causing a + system process to eat up diskspace, memory or other + resources, again causing *DoS*. - The solution to this as well as B) is not to allow processes + **The solution to this as well as B) is not to allow processes to access the filesystem, which could otherwise not be - monitored or manipulated by the mount owner. Since if the + monitored or manipulated by the mount owner.** Since if the mount owner can ptrace a process, it can do all of the above without using a FUSE mount, the same criteria as used in ptrace can be used to check if a process is allowed to access the filesystem or not. - Note that the ptrace check is not strictly necessary to + Note that the *ptrace* check is not strictly necessary to prevent B/2/i, it is enough to check if mount owner has enough privilege to send signal to the process accessing the - filesystem, since SIGSTOP can be used to get a similar effect. + filesystem, since *SIGSTOP* can be used to get a similar effect. I think these limitations are unacceptable? -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +=========================================== If a sysadmin trusts the users enough, or can ensure through other measures, that system processes will never enter non-privileged -mounts, it can relax the last limitation with a "user_allow_other" +mounts, it can relax the last limitation with a ``user_allow_other`` config option. If this config option is set, the mounting user can -add the "allow_other" mount option which disables the check for other +add the ``allow_other`` mount option which disables the check for other users' processes. Kernel - userspace interface -~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +============================ The following diagram shows how a filesystem operation (in this -example unlink) is performed in FUSE. +example unlink) is performed in ``FUSE``. :: -NOTE: everything in this description is greatly simplified | "rm /mnt/fuse/file" | FUSE filesystem daemon | | @@ -357,12 +340,15 @@ NOTE: everything in this description is greatly simplified | locked' flag indicates when the copy is +get_user_pages(). The ``'req->locked'`` flag indicates when the copy is taking place, and abort is delayed until this flag is unset. diff --git a/Documentation/filesystems/index.rst b/Documentation/filesystems/index.rst index 2c3a9f761205..03a7c4ed7f15 100644 --- a/Documentation/filesystems/index.rst +++ b/Documentation/filesystems/index.rst @@ -46,4 +46,5 @@ Documentation for filesystem implementations. .. toctree:: :maxdepth: 2 + fuse virtiofs -- 2.24.0