In Chrome OS, OS-level functionality (such as configuring network interfaces) is implemented by a collection of system services and provided to Chrome over D-Bus. These system services have greater system and hardware access than the Chrome browser.
Separating functionality like this aims to prevent malicious websites from gaining access to OS-level functionality. If Chrome were able to directly control network interfaces, then a compromise in Chrome would give an attacker almost full control over the system. For example, by having a separate network manager, we can reduce the functionality exposed to an attacker to just querying interfaces and performing pre-determined actions on them.
Chrome OS uses a few different mechanisms to isolate system services from Chrome and from each other. We use a helper program called Minijail (executable minijail0). In most cases, Minijail is used in the service's init script. In other cases, Minijail wrappers are used if a service wants to apply restrictions to the programs that it launches, or to itself.
Just remember that code has bugs, and these bugs can be used to take control of the code. An attacker can then do anything the original code was allowed to do. Therefore, code should only be given the absolute minimum level of privilege needed to perform its function.
Aim to keep your code lean, and your privileges low. Don‘t run your service as root. If you need to use third-party code that you didn’t write, you should definitely not run it as root.
Use the libraries provided by the system/SDK. In Chrome OS, libchrome and libbrillo (née libchromeos) offer a lot of functionality to avoid reinventing the wheel, poorly. Don‘t reinvent IPC, use D-Bus or Mojo. Don’t open listening sockets, connect to the required service.
Don't (ab)use shell scripts, shell script logic is harder to reason about and shell command-injection bugs are easy to miss. If you need functionality separated from your main service, use normal C++ binaries, not shell scripts. Moreover, when you execute them, consider further restricting their privileges (see section Minijail wrappers).
exec minijail0 -u <user> /full/path/to/binaryThe first sandboxing mechanism is user ids. We try to run each service as its own user id, different from the root user, which allows us to restrict what files and directories the service can access, and also removes a big chunk of system functionality that‘s only available to the root user. Using the permission_broker service as an example, here’s its Upstart config file (lives in /etc/init):
start on starting system-services stop on stopping system-services respawn # Run as 'devbroker' user. exec minijail0 -u devbroker -c 'cap_chown,cap_fowner+eip' -- \ /usr/bin/permission_broker
Minijail's -u argument forces the target program (in this case permission_broker) to be executed as the devbroker user, instead of the root user. This is equivalent of doing sudo -u devbroker.
The user (devbroker in this example) needs to first be added to the build system database. An example of this (for a different user) can be found in the following CL: https://crrev.com/c/361830
Next, the user needs to be installed on the system. An example of this (again for a different user) can be found in the following CL: https://crrev.com/c/383076
See the Chrome OS user accounts README for more details.
There‘s a test in the CQ that keeps track of the users present on the system that request additional access (e.g. listing more than one user in a group). If your user does that, the test baseline has to be updated at the same time the accounts are added with another CL (e.g. https://crrev.com/c/894192). If you’re unsure whether you need this, the PreCQ/CQ will reject your CL when the test fails, so if the tests pass, you should be good to go!
You can use CQ-DEPEND to land the CLs together (see How do I specify the dependencies of a change?).
Some programs, however, require some of the system access usually granted only to the root user. We use Linux capabilities for this. Capabilities allow us to grant a specific subset of root's privileges to an otherwise unprivileged process. The link above has the full list of capabilities that can be granted to a process. Some of them are equivalent to root, so we avoid granting those. In general, most processes need capabilities to configure network interfaces, access raw sockets, or performing specific file operations. Capabilities are passed to Minijail using the -c switch. permission_broker, for example, needs capabilities to be able to chown(2) device nodes.
start on starting system-services stop on stopping system-services respawn # Run as <devbroker> user. # Grant CAP_CHOWN and CAP_FOWNER. exec minijail0 -u devbroker -c 'cap_chown,cap_fowner+eip' -- \ /usr/bin/permission_broker
Capabilities are expressed using the format that cap_from_text(3) accepts.
Many resources in the Linux world can be isolated now such that a process has its own view of things. For example, it has its own list of mount points, and any changes it makes (unmounting, mounting more devices, etc...) are only visible to it. This helps keep a broken process from messing up the settings of other processes.
For more in-depth details, see the namespaces overview.
In Chromium OS, we like to see every process/daemon run under as many unique namespaces as possible. Many are easy to enable/rationalize about: if you don't use a particular resource, then isolating it is straightforward. If you do rely on it though, it can take more effort.
Here‘s a quick overview. Use the command line option if the description below matches your service (or if you don’t know what functionality it‘s talking about -- most likely you aren’t using it!).
--profile=minimalistic-mountns: This is a good first default that enables mount and process namespaces. This only mounts /proc and creates a few basic device nodes in /dev. If you need more things mounted, you can use the -b (bind-mount) and -k (regular mount) flags.--uts: Just always turn this on. It makes changes to the host / domain name not affect the rest of the system.-e: If your process doesn't need network access. This also isolates netlink and UNIX abstract sockets. Note: D-Bus and syslog use named UNIX sockets, so they will still be usable (as long as you bind mounted them).-l: If your process doesn't use SysV shared memory or IPC.-p: If your process doesn't interact with other process PIDs (other than child processes).The -N option does not work on Linux 3.8 systems. So only enable it if you know your service will run on a newer kernel version otherwise minijail will abort for the older kernels (Chromium bug 729690).
-N: If your process doesn't need to modify common control groups settings.When using many namespaces to isolate a service, there are some resources that the service still reasonably should be able to access.
-d to mount a minimal /dev, you can pass access to the syslog daemon by using -b /dev/log. If your process mounts all of /dev, you need to use -b /run/systemd/journal since /dev/log is a symlink to /run/systemd/journal/dev-log. In either case, you do not need to specify the writable flag to -b for this to work. This will work across all namespaces (including -e network).-b /run/dbus. You do not need to specify the writable flag to -b for this to work. This will work across all namespaces (including -e network and -p pid).-b /run/shill as that daemon maintains the /etc/resolv.conf file.Removing access to the filesystem and to root-only functionality is not enough to completely isolate a system service. A service running as its own user id and with no capabilities has access to a big chunk of the kernel API. The kernel therefore exposes a huge attack surface to non-root processes, and we would like to restrict what kernel functionality is available for sandboxed processes.
The mechanism we use is called Seccomp-BPF. Minijail can take a policy file that describes what syscalls will be allowed, what syscalls will be denied, and what syscalls will only be allowed with specific arguments. The full description of the policy file language can be found in the syscall_filter.c source.
Abridged policy for mtpd on amd64 platforms:
# Copyright (c) 2012 The Chromium OS Authors. All rights reserved. # Use of this source code is governed by a BSD-style license that can be # found in the LICENSE file. read: 1 ioctl: 1 write: 1 timerfd_settime: 1 open: 1 poll: 1 close: 1 mmap: 1 mremap: 1 munmap: 1 mprotect: 1 lseek: 1 # Allow socket(domain==PF_LOCAL) or socket(domain==PF_NETLINK) socket: arg0 == 0x1 || arg0 == 0x10 # Allow PR_SET_NAME from libchrome's base::PlatformThread::SetName() prctl: arg0 == 0xf
Any syscall not explicitly mentioned, when called, results in the process being killed. The policy file can also tell the kernel to fail the system call (returning -1 and setting errno) without killing the process:
# execve: return EPERM execve: return 1
To write a policy file, run the target program under strace and use that to come up with the list of syscalls that need to be allowed during normal execution. The generate_syscall_policy.py script will take strace output files and generate a policy file suitable for use with Minijail. On top of that, the -L option will print the name of the first syscall to be blocked to syslog. The best way to proceed is to combine both approaches: use strace and the script to generate a rough policy, and then use -L if you notice your program is still crashing. Note that the -L option should NOT be used in production.
You should ensure that your service is executing as many of its code paths as possible when executing strace, in particular error paths. In some cases it may be easier to add syscalls manually (for instance, abort) rather than forcing execution of those paths.
The policy file needs to be installed in the system, so we need to add it to the ebuild file:
# Install seccomp policy file. insinto /usr/share/policy use seccomp && newins "mtpd-seccomp-${ARCH}.policy" mtpd-seccomp.policy
And finally, the policy file has to be passed to Minijail, using the -S option:
# use minijail (drop root, set no_new_privs, set seccomp filter). # Mount /proc, /sys, /dev, /run/udev so that USB devices can be # discovered. Also mount /run/dbus to communicate with D-Bus. exec minijail0 -i -I -p -l -r -v -t -u mtp -g mtp -G \ -P /mnt/empty -b / -b /proc -b /sys -b /dev \ -k tmpfs,/run,tmpfs,0xe -b /run/dbus -b /run/udev \ -n -S /usr/share/policy/mtpd-seccomp.policy -- \ /usr/sbin/mtpd -minloglevel="${MTPD_MINLOGLEVEL}"
strace -f -o strace.log <cmd>LD_PRELOAD to install the seccomp filter. This will install the filter after glibc initialization, so remove the syscalls related to glibc initialization to obtain a smaller filter (and a tighter sandbox). Those are normally everything up to and including the following:rt_sigaction(SIGRTMIN, {<sa_handler>, [], SA_RESTORER|SA_SIGINFO, <sa_restorer>}, NULL, 8) = 0
rt_sigaction(SIGRT_1, {<sa_handler>, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, <sa_restorer>}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM64_INFINITY}) = 0
brk(NULL) = <addr>
brk(<addr>) = <addr>
~/chromiumos/src/aosp/external/minijail/tools/generate_seccomp_policy.py strace.log > seccomp.policyminijail0 -S seccomp.policy -L <cmd>-n Minijail flag, privilege-dropping syscalls happen after the filter is installed, and they won‘t show up in normal program execution because they’re called by Minijail itself. They need to be added to the policy:setgroups(2), setresgid(2), and setresuid(2) for dropping root.capget(2), capset(2), and prctl(2) for dropping capabilities.-n flag (no_new_privs), which prevents the sandboxed process from obtaining new privileges and is therefore a good addition for sandboxing.-L option):dmesg | grep "syscall=" to find something similar to:NOTICE kernel: [ 586.706239] audit: type=1326 audit(1484586246.124:6): ... comm="<executable>" exe="/path/to/executable" sig=31 syscall=130 compat=0 ip=0x7f4f214881d6 code=0x0
minijail0 -H | grep <nr>, where <nr> is the syscall= number above, to find the name of the failing syscall.Some daemons store user data on the user‘s cryptohome under /home/.shadow/<user_hash>/mount/root/<daemon_name> or equivalently /home/root/<user_hash>/<daemon_name>. For instance, Session Manager stores user policy under /home/root/<user_hash>/session_manager/policy. This is useful if the data should be protected from other users since the user’s cryptohome is only mounted (and therefore decrypted) when the user logs in. If the user is not logged in, it is encrypted with the user's password.
However, if a daemon is already running inside a mount namespace (minijail0 -v ...) when the user's cryptohome is mounted, it does not see the mount since mount events do not propagate into mount namespaces by default. This propagation can be achieved, though, by making the parent mount a shared mount and the corresponding mount inside the namespace a shared or slave mount, see the shared subtrees doc.
To set up a cryptohome daemon store folder that propagates into your daemon‘s mount namespace, add this code to the src_install section of your daemon’s ebuild:
local daemon_store="/etc/daemon-store/<daemon_name>" dodir "${daemon_store}" fperms 0700 "${daemon_store}" fowners <daemon_user>:<daemon_group> "${daemon_store}"
This directory is never used directly. It merely serves as a secure template for the chromeos_startup script, which picks it up and creates /run/daemon-store/<daemon_name> as a shared mount.
Next, move the user/group setup to pkg_setup() since pkg_preinst(), where this is usually done, runs after src_install():
pkg_setup() { # Has to be done in pkg_setup() instead of pkg_preinst() since # src_install() needs <daemon_user> and <daemon_group>. enewuser <daemon_user> enewgroup <daemon_group> cros-workon_pkg_setup }
In your daemon's init script, mount the daemon store folder as slave in your mount namespace. Be sure not to mount all of /run. Make sure to mount with the MS_REC flag to propagate any already-mounted cryptohome bind mounts into the mount namespace.
minijail0 -v -Kslave \ -k 'tmpfs,/run,tmpfs,MS_NOSUID|MS_NODEV|MS_NOEXEC' \ -k '/run/daemon-store/<daemon_name>,/run/daemon-store/<daemon_name>,none,MS_BIND|MS_REC' \ ...
During sign-in, when the user's cryptohome is mounted, Cryptohome creates /home/.shadow/<user_hash>/mount/root/<daemon_name>, bind-mounts it to /run/daemon-store/<daemon_name>/<user_hash> and copies ownership and mode from /etc/daemon-store/<daemon_name> to the bind target. Since /run/daemon-store/<daemon_name> is a shared mount outside of the mount namespace and a slave mount inside, the mount event propagates into the daemon.
Your daemon can now use /run/daemon-store/<daemon_name>/<user_hash> to store user data once the user's cryptohome is mounted. Note that even though /run/daemon-store is on a tmpfs, your data is actually stored on disk and not lost on reboot.
Be sure not to write to the folder before the cryptohome is mounted. Consider listening to Session Manager's SessionStateChanged signal or similar to detect mount events. Note that /run/daemon-store/<daemon_name>/<user_hash> might exist even though cryptohome is not mounted, so testing existence is not enough (it only works the first time).
The <user_hash> can be retrieved with Cryptohome's GetSanitizedUsername D-Bus method.
The following diagram illustrates the mount event propagation:
TODO(jorgelo)