Received: by 2002:a25:6193:0:0:0:0:0 with SMTP id v141csp5252934ybb; Tue, 24 Mar 2020 13:46:56 -0700 (PDT) X-Google-Smtp-Source: ADFU+vsPH+u/383TZDjEHnp3hDrmnv9ivgKZlELotdjjZbwKeY6nhoYQ3+iwAVwaOedzmx0+EYxq X-Received: by 2002:aca:474e:: with SMTP id u75mr122258oia.52.1585082815934; Tue, 24 Mar 2020 13:46:55 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1585082815; cv=none; d=google.com; s=arc-20160816; b=Xu26BGaIcPlqKo4us/glESikGzPR4+nm4GfC4Ggx71Cstg/IbVCBVF4kOAyIXj3bPQ ZmMsdDV5GhEtk9MscgpO5OjI/wjvdjoRErnLpqL4GOE1ozxKCR0dtZhS0oMsYIDqqT48 1uz8pszvvzIbbelt8WVflMzVgxvCHeLArLlTQpsX9Z467r/0wu7kZG7cHk9xnRtQNvxw aRaRLKYAYHbVs2XNPM/KhVWWNheQj255i/qvu9/VH0k9PU1mKSDwex7Xo8xKsdEEKXcY iKFHIJe9ftZ3PH5bqNEzPiLkxJthP1iGc/Soe14iP8S+euHnQvIvLDLjWEtm7AeHFCzN rtHQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from; bh=LVHjG4TveWNFvgxKdRslvttpJN/tu9Uyg3iN7W9n4ak=; b=JhayO2J4rw+2LvHZ6fauKNhzwtLMhhpBF76qE+bcxpO0U0s9hdyGqSNC91z29w8duL mCn4u4l6BQfHL4tYDcrB0wjLEj5DTEGDjS6UpSTxTDWb+eeDaUprtkFR/2Au4uTnj1P2 cEkm2r9GjuEzvj7x3heLsMVJPCsrEqXterTnhESbDdMmNFLs2+iE0B1V5L+uxq0Vac4x p5rGV91p8xE1i5jpGoxoWRDJGUZJkg+Ldqqje0TcVbV9F2y5cYuqh6HSOMUWiYzA/NbJ /Y9C+KE+dUQaVIy+XGE1WnFHzYda5kztO7GGgRBWUe4ACGgQWXqV4/OnyOdCm4KSTXV3 LPcA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id q124si9679352oig.228.2020.03.24.13.46.43; Tue, 24 Mar 2020 13:46:55 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728256AbgCXUqR (ORCPT + 99 others); Tue, 24 Mar 2020 16:46:17 -0400 Received: from monster.unsafe.ru ([5.9.28.80]:38408 "EHLO mail.unsafe.ru" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725941AbgCXUqO (ORCPT ); Tue, 24 Mar 2020 16:46:14 -0400 Received: from comp-core-i7-2640m-0182e6.redhat.com (ip-89-102-33-211.net.upcbroadband.cz [89.102.33.211]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.unsafe.ru (Postfix) with ESMTPSA id B5E57C61AE0; Tue, 24 Mar 2020 20:46:08 +0000 (UTC) From: Alexey Gladkov To: LKML , Kernel Hardening , Linux API , Linux FS Devel , Linux Security Module Cc: Akinobu Mita , Alexander Viro , Alexey Dobriyan , Alexey Gladkov , Andrew Morton , Andy Lutomirski , Daniel Micay , Djalal Harouni , "Dmitry V . Levin" , "Eric W . Biederman" , Greg Kroah-Hartman , Ingo Molnar , "J . Bruce Fields" , Jeff Layton , Jonathan Corbet , Kees Cook , Linus Torvalds , Oleg Nesterov Subject: [PATCH RESEND v9 0/8] proc: modernize proc to support multiple private instances Date: Tue, 24 Mar 2020 21:44:41 +0100 Message-Id: <20200324204449.7263-1-gladkov.alexey@gmail.com> X-Mailer: git-send-email 2.25.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Greetings! Preface: -------- This is patchset v9 to modernize procfs and make it able to support multiple private instances per the same pid namespace. This patchset can be applied on top of: git.kernel.org/pub/scm/linux/kernel/git/ebiederm/user-namespace.git 58a45d79571a Procfs modernization: --------------------- Historically procfs was always tied to pid namespaces, during pid namespace creation we internally create a procfs mount for it. However, this has the effect that all new procfs mounts are just a mirror of the internal one, any change, any mount option update, any new future introduction will propagate to all other procfs mounts that are in the same pid namespace. This may have solved several use cases in that time. However today we face new requirements, and making procfs able to support new private instances inside same pid namespace seems a major point. If we want to to introduce new features and security mechanisms we have to make sure first that we do not break existing usecases. Supporting private procfs instances will allow to support new features and behaviour without propagating it to all other procfs mounts. Today procfs is more of a burden especially to some Embedded, IoT, sandbox, container use cases. In user space we are over-mounting null or inaccessible files on top to hide files and information. If we want to hide pids we have to create PID namespaces otherwise mount options propagate to all other proc mounts, changing a mount option value in one mount will propagate to all other proc mounts. If we want to introduce new features, then they will propagate to all other mounts too, resulting either maybe new useful functionality or maybe breaking stuff. We have also to note that userspace should not workaround procfs, the kernel should just provide a sane simple interface. In this regard several developers and maintainers pointed out that there are problems with procfs and it has to be modernized: "Here's another one: split up and modernize /proc." by Andy Lutomirski [1] Discussion about kernel pointer leaks: "And yes, as Kees and Daniel mentioned, it's definitely not just dmesg. In fact, the primary things tend to be /proc and /sys, not dmesg itself." By Linus Torvalds [2] Lot of other areas in the kernel and filesystems have been updated to be able to support private instances, devpts is one major example [3]. Which will be used for: 1) Embedded systems and IoT: usually we have one supervisor for apps, we have some lightweight sandbox support, however if we create pid namespaces we have to manage all the processes inside too, where our goal is to be able to run a bunch of apps each one inside its own mount namespace, maybe use network namespaces for vlans setups, but right now we only want mount namespaces, without all the other complexity. We want procfs to behave more like a real file system, and block access to inodes that belong to other users. The 'hidepid=' will not work since it is a shared mount option. 2) Containers, sandboxes and Private instances of file systems - devpts case Historically, lot of file systems inside Linux kernel view when instantiated were just a mirror of an already created and mounted filesystem. This was the case of devpts filesystem, it seems at that time the requirements were to optimize things and reuse the same memory, etc. This design used to work but not anymore with today's containers, IoT, hostile environments and all the privacy challenges that Linux faces. In that regards, devpts was updated so that each new mounts is a total independent file system by the following patches: "devpts: Make each mount of devpts an independent filesystem" by Eric W. Biederman [3] [4] 3) Linux Security Modules have multiple ptrace paths inside some subsystems, however inside procfs, the implementation does not guarantee that the ptrace() check which triggers the security_ptrace_check() hook will always run. We have the 'hidepid' mount option that can be used to force the ptrace_may_access() check inside has_pid_permissions() to run. The problem is that 'hidepid' is per pid namespace and not attached to the mount point, any remount or modification of 'hidepid' will propagate to all other procfs mounts. This also does not allow to support Yama LSM easily in desktop and user sessions. Yama ptrace scope which restricts ptrace and some other syscalls to be allowed only on inferiors, can be updated to have a per-task context, where the context will be inherited during fork(), clone() and preserved across execve(). If we support multiple private procfs instances, then we may force the ptrace_may_access() on /proc// to always run inside that new procfs instances. This will allow to specifiy on user sessions if we should populate procfs with pids that the user can ptrace or not. By using Yama ptrace scope, some restricted users will only be able to see inferiors inside /proc, they won't even be able to see their other processes. Some software like Chromium, Firefox's crash handler, Wine and others are already using Yama to restrict which processes can be ptracable. With this change this will give the possibility to restrict /proc// but more importantly this will give desktop users a generic and usuable way to specifiy which users should see all processes and which user can not. Side notes: * This covers the lack of seccomp where it is not able to parse arguments, it is easy to install a seccomp filter on direct syscalls that operate on pids, however /proc// is a Linux ABI using filesystem syscalls. With this change all LSMs should be able to analyze open/read/write/close... on /proc// 4) This will allow to implement new features either in kernel or userspace without having to worry about procfs. In containers, sandboxes, etc we have workarounds to hide some /proc inodes, this should be supported natively without doing extra complex work, the kernel should be able to support sane options that work with today and future Linux use cases. 5) Creation of new superblock with all procfs options for each procfs mount will fix the ignoring of mount options. The problem is that the second mount of procfs in the same pid namespace ignores the mount options. The mount options are ignored without error until procfs is remounted. Before: # grep ^proc /proc/mounts proc /proc proc rw,relatime,hidepid=2 0 0 # strace -e mount mount -o hidepid=1 -t proc proc /tmp/proc mount("proc", "/tmp/proc", "proc", 0, "hidepid=1") = 0 +++ exited with 0 +++ # grep ^proc /proc/mounts proc /proc proc rw,relatime,hidepid=2 0 0 proc /tmp/proc proc rw,relatime,hidepid=2 0 0 # mount -o remount,hidepid=1 -t proc proc /tmp/proc # grep ^proc /proc/mounts proc /proc proc rw,relatime,hidepid=1 0 0 proc /tmp/proc proc rw,relatime,hidepid=1 0 0 After: # grep ^proc /proc/mounts proc /proc proc rw,relatime,hidepid=ptraceable 0 0 # mount -o hidepid=invisible -t proc proc /tmp/proc # grep ^proc /proc/mounts proc /proc proc rw,relatime,hidepid=ptraceable 0 0 proc /tmp/proc proc rw,relatime,hidepid=invisible 0 0 Introduced changes: ------------------- Each mount of procfs creates a separate procfs instance with its own mount options. This series adds few new mount options: * New 'hidepid=ptraceable' or 'hidepid=4' mount option to show only ptraceable processes in the procfs. This allows to support lightweight sandboxes in Embedded Linux, also solves the case for LSM where now with this mount option, we make sure that they have a ptrace path in procfs. * 'subset=pidfs' that allows to hide non-pid inodes from procfs. It can be used in containers and sandboxes, as these are already trying to hide and block access to procfs inodes anyway. ChangeLog: ---------- # v9: * Rebase on top of Eric W. Biederman's procfs changes. * Add human readable values of 'hidepid' as suggested by Andy Lutomirski. # v8: * Started using RCU lock to clean dcache entries as suggested by Linus Torvalds. # v7: * 'pidonly=1' renamed to 'subset=pidfs' as suggested by Alexey Dobriyan. * HIDEPID_* moved to uapi/ as they are user interface to mount(). Suggested-by Alexey Dobriyan # v6: * 'hidepid=' and 'gid=' mount options are moved from pid namespace to superblock. * 'newinstance' mount option removed as suggested by Eric W. Biederman. Mount of procfs always creates a new instance. * 'limit_pids' renamed to 'hidepid=3'. * I took into account the comment of Linus Torvalds [7]. * Documentation added. # v5: * Fixed a bug that caused a problem with the Fedora boot. * The 'pidonly' option is visible among the mount options. # v2: * Renamed mount options to 'newinstance' and 'pids=' Suggested-by: Andy Lutomirski * Fixed order of commit, Suggested-by: Andy Lutomirski * Many bug fixes. # v1: * Removed 'unshared' mount option and replaced it with 'limit_pids' which is attached to the current procfs mount. Suggested-by Andy Lutomirski * Do not fill dcache with pid entries that we can not ptrace. * Many bug fixes. References: ----------- [1] https://lists.linuxfoundation.org/pipermail/ksummit-discuss/2017-January/004215.html [2] http://www.openwall.com/lists/kernel-hardening/2017/10/05/5 [3] https://lwn.net/Articles/689539/ [4] http://lxr.free-electrons.com/source/Documentation/filesystems/devpts.txt?v=3.14 [5] https://lkml.org/lkml/2017/5/2/407 [6] https://lkml.org/lkml/2017/5/3/357 [7] https://lkml.org/lkml/2018/5/11/505 Alexey Gladkov (8): proc: rename struct proc_fs_info to proc_fs_opts proc: allow to mount many instances of proc in one pid namespace proc: move hide_pid, pid_gid from pid_namespace to proc_fs_info proc: instantiate only pids that we can ptrace on 'hidepid=4' mount option proc: add option to mount only a pids subset docs: proc: add documentation for "hidepid=4" and "subset=pidfs" options and new mount behavior proc: move hidepid values to uapi as they are user interface to mount proc: use human-readable values for hidehid Documentation/filesystems/proc.txt | 93 ++++++++++++++++----- fs/proc/base.c | 46 ++++++++--- fs/proc/generic.c | 9 +++ fs/proc/inode.c | 28 +++++-- fs/proc/root.c | 126 +++++++++++++++++++++++------ fs/proc/self.c | 6 +- fs/proc/thread_self.c | 6 +- fs/proc_namespace.c | 14 ++-- include/linux/pid_namespace.h | 8 -- include/linux/proc_fs.h | 22 +++++ include/uapi/linux/proc_fs.h | 13 +++ 11 files changed, 288 insertions(+), 83 deletions(-) create mode 100644 include/uapi/linux/proc_fs.h -- 2.25.2