systemd-tmpfiles-setup.service fails on btrfs
| Affects | Status | Importance | Assigned to | Milestone | ||
|---|---|---|---|---|---|---|
| systemd (Ubuntu) | Status tracked in Disco | |||||
| | Bionic |
Undecided
|
Unassigned | |||
| | Cosmic |
Undecided
|
Unassigned | |||
| | Disco |
Undecided
|
Unassigned | |||
Bug Description
[Impact]
* Last security update introduced a regression on btrfs based systems, causing systemd-
* Cherrypick upstream fixes to resolve this.
[Test Case]
* Install VM using btrfs for /
* Boot, check that systemd-
$ systemctl status systemd-
[Regression Potential]
* btrfs fd doesn't support the set of flags that systemd used, with this patch, a compat set of flags is set instead, thus resolving the introduced regression. The worst case scenario is that creating subvolumes/
[Other Info]
* Example bad output
After update to systemd 237-3ubuntu10.9 systemd-
Nov 21 13:44:12 node-blc49 systemd[1]: Starting Create Volatile Files and Directories...
Nov 21 13:44:12 node-blc49 systemd-
Nov 21 13:44:12 node-blc49 systemd-
Nov 21 13:44:12 node-blc49 systemd-
Nov 21 13:44:12 node-blc49 systemd[1]: systemd-
Nov 21 13:44:12 node-blc49 systemd[1]: systemd-
Nov 21 13:44:12 node-blc49 systemd[1]: Failed to start Create Volatile Files and Directories.
This happens on btrfs root filesystems in real hardware and on our virtualized servers as well. 237-3ubuntu10.6 didnt show this errors and going back to 237-3ubuntu10 removes them as well.
# lsb_release -rd
Description: Ubuntu 18.04.1 LTS
Release: 18.04
# apt-cache policy systemd
systemd:
Installiert: 237-3ubuntu10.9
Installations
Versionstabelle:
*** 237-3ubuntu10.9 500
500 http://
500 http://
100 /var/lib/
237-3ubuntu10 500
500 http://
CVE References
| Renato Lorenzi (renatolorenzi) wrote : | #2 |
I have a similar problem after update from 229-4ubuntu21.2 to 229-4ubuntu21.9 in arm version.
lsb_release -rd
Description: Ubuntu 16.04.4 LTS
Release: 16.04
apt-cache policy systemd
systemd:
Installed: 229-4ubuntu21.2
Candidate: 229-4ubuntu21.9
Version table:
229-
500 http://
500 http://
*** 229-4ubuntu21.2 100
100 /var/lib/
229-4ubuntu4 500
500 http://
| Gannet (ken20001) wrote : | #3 |
The same shit with systemd 237-3ubuntu10.9. How to revert to previous version, could somebody explain?
After last update some servises failed
systemd-
ssh.service loaded failed failed OpenBSD Secure Shell server
If You reboot VPS after update You can't connect via SSH, because SSH service start failed
sshd can be launched via:
1. connect via web console (if VPS)
2. mkdir /run/sshd
3. systemctl start sshd
lsb_release -rd
Description: Ubuntu 16.04.5 LTS
Release: 16.04
apt-cache policy systemd
systemd:
Installed: 229-4ubuntu21.9
Candidate: 229-4ubuntu21.9
Version table:
*** 229-4ubuntu21.9 500
500 http://
500 http://
100 /var/lib/
229-4ubuntu4 500
500 http://
| crush (sgrosser) wrote : | #5 |
Same issue here! No SSH-Daemon will start again! Happens after Shutdown, just a Reboot shouldn't affect the System.
received the package via unattended security updates (?)
2018-11-21 06:55:30 upgrade systemd:amd64 229-4ubuntu21.8 229-4ubuntu21.9
No relevance at all with btrfs, we use ext4
| summary: |
- systemd-tmpfiles-setup.service fails on btrfs + systemd-tmpfiles-setup.service fails |
Now I received a update from 229-4ubuntu21.9 to 229-4ubuntu21.10 and everything worked again.
| Rene Meier (meier.rene) wrote : | #7 |
Yes but only because they have reverted the changes from CVE-2018-6954. This will come back very soon. Have a look at https:/
https:/
| Gannet (ken20001) wrote : | #8 |
In Bionic upgrading to systemd 237-3ubuntu10.10 desn't solves this issue.
| Rene Meier (meier.rene) wrote : | #9 |
I did some tests. This issue is clearly related to btrfs, because I can not reproduce this with ext4. If you have a different filesystem, you have a different issue, maybe the one in https:/
How to reproduce this:
1) clean install from 'ubuntu-
2) system starts fine after reboot
3) issue 'apt install systemd' and get the 'Bad file descriptor' error allready during installation (attached log)
4) reboot with failing systemd-
I will also attach a log of the errors during apt install.
| summary: |
- systemd-tmpfiles-setup.service fails + systemd-tmpfiles-setup.service fails on btrfs |
| Rene Meier (meier.rene) wrote : | #10 |
| Rene Meier (meier.rene) wrote : | #11 |
I just checked 18.10 with systemd 239-7ubuntu10.4 and it fails with the same error message.
| Dimitri John Ledkov (xnox) wrote : | #12 |
yes this is a know regression, not sure where this is tracked. But yes, we do need to fix the tmpfiles on btrfs soon.
| Changed in systemd (Ubuntu Disco): | |
| status: | Confirmed → Fix Released |
| Changed in systemd (Ubuntu Cosmic): | |
| status: | New → In Progress |
| Stanislav Rimsha (slowpokefarm) wrote : | #13 |
Experiencing same issue on 18.04 desktop with btrfs root filesystem, not being able to boot anything except emergency mode. Is there any workaround to boot into functional system?
| description: | updated |
Hello Rene, or anyone else affected,
Accepted systemd into cosmic-proposed. The package will build now and be available at https:/
Please help us by testing this new package. See https:/
If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-
Further information regarding the verification process can be found at https:/
N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.
| Changed in systemd (Ubuntu Cosmic): | |
| status: | In Progress → Fix Committed |
| tags: | added: verification-needed verification-needed-cosmic |
| Rene Meier (meier.rene) wrote : | #15 |
Hi Brian,
thank you for providing this fix. It works fine on a minimal 18.10 server. I installed systemd 239-7ubuntu10.5 on a updated system.
| tags: |
added: verification-done-cosmic removed: verification-needed-cosmic |
| Gannet (ken20001) wrote : | #16 |
I'm confirming 239-7ubuntu10.5 fixed this issue on my system (Kubuntu 18.10). Please, add the fix to Bionic also. Thanks.
| tags: |
added: verification-done removed: verification-needed |
| Launchpad Janitor (janitor) wrote : | #17 |
Status changed to 'Confirmed' because the bug affects multiple users.
| Changed in systemd (Ubuntu Bionic): | |
| status: | New → Confirmed |
| Jurit (juritxyz) wrote : | #18 |
I have server version Ubuntu 18.04.1 LTS bionic systemd 237.
systemd-
systemd-
Problem started some weeks ago after I did apt-get upgrade
| Dirk Schmidtke (dirkschmidtke) wrote : | #19 |
What about a fix for 18.04 LTS. I am experiencing the same probleme for weeks on BTRFS:
journalctl -b 0 -u systemd-
-- Logs begin at Fri 2018-07-06 11:06:42 CEST, end at Thu 2018-12-13 11:48:29 CET. --
Dez 13 11:33:38 Asuspro systemd[1]: Starting Create Volatile Files and Directories...
Dez 13 11:33:38 Asuspro systemd-
Dez 13 11:33:38 Asuspro systemd-
Dez 13 11:33:38 Asuspro systemd-
Dez 13 11:33:38 Asuspro systemd[1]: systemd-
Dez 13 11:33:38 Asuspro systemd[1]: systemd-
Dez 13 11:33:38 Asuspro systemd[1]: Failed to start Create Volatile Files and Directories.
Dez 13 11:33:39 Asuspro systemd[1]: Starting Create Volatile Files and Directories...
Dez 13 11:33:39 Asuspro systemd-
Dez 13 11:33:39 Asuspro systemd-
Dez 13 11:33:39 Asuspro systemd-
Dez 13 11:33:39 Asuspro systemd[1]: systemd-
Dez 13 11:33:39 Asuspro systemd[1]: systemd-
Dez 13 11:33:39 Asuspro systemd[1]: Failed to start Create Volatile Files and Directories.
| fusillator (fusillo) wrote : | #20 |
Hi, same issue here in bionic 18.04 LTS on btrs subvolumes with the following systemd releases:
*** 237-3ubuntu10.10 100
-10 http://
100 /var/lib/
237-
500 http://
500 http://
How can we apply the patch also in bionic?
Regards
Luca
| supersasho (supersasho) wrote : | #21 |
Hi everyone,
right now I've got an emergency mode only with 18.04 (kde neon) and systemd=
Thanks for any suggestions.
| fusillator (fusillo) wrote : | #22 |
hi again, not sure if the most sensible approach
anyway in bionic I tried to revert the last two patches from the source of systemd_
export QUILT_PATCHES=
export QUILT_REFRESH_
quilt pop
quilt pop
sed 's/^CVE-
Then I recompiled and installed the new package and the error disappear.
Anyway the involved patches were there to fix some issues:
$ quilt header patches/
Description: tmpfiles: don't resolve pathnames when traversing recursively
through directory trees
Otherwise we can be fooled if one path component is replaced underneath us.
The patch achieves that by always operating at file descriptor level (by using
*at() helpers) and by making sure we do not any path resolution when traversing
direcotry trees.
However this is not always possible, for instance when listing the content of a
directory or some operations don't provide the *at() helpers or others (such as
fchmodat()) don't have the AT_EMPTY_PATH flag. In such cases we operate on
/proc/self/fd/%i pseudo-symlink instead, which works the same for all kinds of
objects and requires no checking of type beforehand.
Also O_PATH flag is used when opening file objects in order to prevent
undesired behaviors: device nodes from reacting, automounts from
triggering, etc...
Fixes: CVE-2018-6954
Origin: upstream, https:/
Bug: https:/
$ quilt header patches/
Description: Make tmpfiles safe
In addition to backporting the changesets in #8822, this also backports
e04fc13 (test: add tests for systemd-tmpfiles), as well as empty_to_root()
from v239.
Origin: upstream, https:/
Bug: https:/
So I'm not sure if it's a secure/stable workaround
Maybe it would be better mixixing up the releases installing the patched package from cosmic-proposed... I will test on another snapshot to see what happens..
Just a curiosity: is bionic still supported?
| Gannet (ken20001) wrote : | #23 |
Just notice: Bionic is an 18.04 LTS.
| Shelby Cain (alyandon) wrote : | #24 |
Any updates on a work around or patch for this issue in 18.04?
| fusillator (fusillo) wrote : | #25 |
in the previous post I missed the inline option of sed (sorry)...
I will try to merge the patch from cosmic in the we for the sake of experience
Anyway I don't have a good comprehension of the code... and I think there will be conflicts to resolve (the patch was thought to be applied to a differente codebase..)
So if a maintainer or a skilled programmer would provide the patch for bionic it would be better.
| fusillator (fusillo) wrote : | #26 |
I didn't find any conflict or overlap applying the btrfs-util-
So to apply the patch conceived by Brian Murray on bionic
I only had to add the missing macro FLAGS_SET on macro.h and refreshed the patch
here's the missing part to make it compile on bionic
Index: systemd-
=======
--- systemd-
+++ systemd-
@@ -351,6 +351,9 @@ static inline unsigned long ALIGN_POWER2
#define SET_FLAG(v, flag, b) \
(v) = (b) ? ((v) | (flag)) : ((v) & ~(flag))
+#define FLAGS_SET(v, flags) \
+ (((v) & (flags)) == (flags))
+
#define CASE_F(X) case X:
#define CASE_F_1(CASE, X) CASE_F(X)
#define CASE_F_2(CASE, X, ...) CASE(X) CASE_F_1(CASE, __VA_ARGS__)
The error of tmp disappeared at the boot, and the security issues should be patched by the preceding CVE-2018-6954* patches.
Let me know if I should submit the patch. Anyway I'm not a good programmer so wait for hints of maintainers, Brian Murray or other guru.
Regards
| Reto Glauser (rglauser) wrote : | #27 |
Thanks fusillo for the report, documentation and test. I did the same thing but failed since I also tried to get coccinelle/
I assumed (wrongly) this upstream change would be needed as well.
| Launchpad Janitor (janitor) wrote : | #28 |
This bug was fixed in the package systemd - 237-3ubuntu10.11
---------------
systemd (237-3ubuntu10.11) bionic-security; urgency=medium
* SECURITY UPDATE: memory corruption in journald via attacker controlled alloca
- debian/
entry for process commandline on the stack
- CVE-2018-16864
* SECURITY UPDATE: memory corruption in journald via attacker controlled alloca
- debian/
number of fields (1k)
- debian/
number of fields in a message
- CVE-2018-16865
* SECURITY UPDATE: out-of-bounds read in journald
- debian/
- CVE-2018-16866
* Fix LP: #1804603 - btrfs-util: unbreak tmpfiles' subvol creation
- add debian/
- update debian/
* Fix LP: #1804864 - test: Set executable bits on TEST-22-TMPFILES shell scripts
- add debian/
- update debian/
-- Chris Coulson <email address hidden> Wed, 09 Jan 2019 15:11:53 +0000
| Changed in systemd (Ubuntu Bionic): | |
| status: | Confirmed → Fix Released |
| Launchpad Janitor (janitor) wrote : | #29 |
This bug was fixed in the package systemd - 239-7ubuntu10.6
---------------
systemd (239-7ubuntu10.6) cosmic-security; urgency=medium
* SECURITY UPDATE: memory corruption in journald via attacker controlled alloca
- debian/
entry for process commandline on the stack
- CVE-2018-16864
* SECURITY UPDATE: memory corruption in journald via attacker controlled alloca
- debian/
number of fields (1k)
- debian/
number of fields in a message
- CVE-2018-16865
* SECURITY UPDATE: out-of-bounds read in journald
- debian/
- CVE-2018-16866
* Fix LP: #1804603 - btrfs-util: unbreak tmpfiles' subvol creation
- add debian/
- update debian/
* Fix LP: #1804864 - test: Set executable bits on TEST-22-TMPFILES shell scripts
- add debian/
- update debian/
-- Chris Coulson <email address hidden> Wed, 09 Jan 2019 14:37:15 +0000
| Changed in systemd (Ubuntu Cosmic): | |
| status: | Fix Committed → Fix Released |
| Jurit (juritxyz) wrote : | #30 |
Does it fixes also bionic with ext4? If yes, how?
Problem starting some services since november updates
Now I installed these last upgrades with 237-3ubuntu10.11 but this didnt fix error...
● systemd-
● systemd-
Description: Ubuntu 18.04.1 LTS
Release: 18.04
systemd:
Installed: 237-3ubuntu10.11
Candidate: 237-3ubuntu10.11
Version table:
*** 237-3ubuntu10.11 500
500 http://
500 http://
100 /var/lib/
237-3ubuntu10 500
500 http://
Filesystem Type 1K-blocks Used Available Use% Mounted on
udev devtmpfs 8173584 0 8173584 0% /dev
tmpfs tmpfs 1640840 2672 1638168 1% /run
/dev/sda3 ext4 102687672 5534228 91894180 6% /
tmpfs tmpfs 8204192 0 8204192 0% /dev/shm
tmpfs tmpfs 5120 0 5120 0% /run/lock
tmpfs tmpfs 8204192 0 8204192 0% /sys/fs/cgroup
/dev/md0 ext4 5325203376 4998238260 58519832 99% /phototdata
/dev/loop1 squashfs 91648 91648 0 100% /snap/core/6130
/dev/loop0 squashfs 90368 90368 0 100% /snap/core/5897
/dev/loop2 squashfs 91648 91648 0 100% /snap/core/6034
tmpfs tmpfs 1640836 0 1640836 0% /run/user/0
| supersasho (supersasho) wrote : | #31 |
237-3ubuntu10.11 fixed the issue for me on KDE Neon (18.04/Bionic). I've got btrfs on my / lv though.
Thank you all that helped to resolve this. :)
| Andreas Kar (thexmanxyz) wrote : | #32 |
To supplement the issue I will add more relevant links:
https:/
https:/
https:/
For me the issue also appeared with 229-4ubuntu21.9. Was fixed with 229-4ubuntu21.10 and now appeared again with 229-4ubuntu21.15. I'm on Armbian with ext4 and have the issue now again.
Distribution / Kernel
Linux xxx 3.4.113-sun8i #2 SMP PREEMPT Sat Jan 12 15:54:26 CET 2019 armv7l armv7l armv7l GNU/Linux
Distributor ID: Ubuntu
Description: Ubuntu 16.04.5 LTS
Release: 16.04
Codename: xenial
Output of journalctl -b 0 -u systemd-
Jän 14 11:01:51 xxx systemd[1]: Starting Create Volatile Files and Directories...
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd-
Jän 14 11:01:51 xxx systemd[1]: systemd-
Jän 14 11:01:51 xxx systemd[1]: Failed to start Create Volatile Files and Directories.
Jän 14 11:01:51 xxx systemd[1]: systemd-
Jän 14 11:01:51 xxx systemd[1]: systemd-
Affected services:
# dnsmasq.service loaded failed failed dnsmasq - A lightweight DHCP and caching DNS server
# lighttpd.service loaded failed failed Lighttpd Daemon
# <email address hidden> loaded failed failed OpenVPN connection to server
# ssh.service loaded failed failed OpenBSD Secure Shell server
# systemd-
# systemd-
| Andreas Kar (thexmanxyz) wrote : | #33 |
Upgrade to Linux pan 4.19.13-sunxi #5.70 SMP Sat Jan 12 15:43:21 CET 2019 armv7l armv7l armv7l GNU/Linux solved the issue for me.
| Jurit (juritxyz) wrote : | #34 |
Is it realistic, that Bionic also adds this Linux pan 4.19.13-sunxi to their updates? Or have I upgrade it manually, if yes, how?
| Andreas Kar (thexmanxyz) wrote : | #35 |
Jurit (juritxyz) I tested the above kernel on 16.04.05 Xenial. However it has to be said that the 4.19.13-sunxi is an ARM7 kernel (Armbian). I don't know on which platform you are but I can easily upgrade this kernel manually over the Armbian configuration application. I assume you are on x86/x64 which is the latest LTS so I assume you're already on the latest kernel supported for your distro. IDK why 4.19.13-sunxi solves it...I still consider this issue unsolved even if the latest kernel on my distro solves it...
| Andreas Kar (thexmanxyz) wrote : | #36 |
*x86/x64 18.04.01
Status changed to 'Confirmed' because the bug affects multiple users.