NetworkManager daemon segfaults on start in read_one_ip_address_or_route

[Matthias Kretz]

After the update to 13.10 my network didn't come back up. After a bit of investigation I found the following problem:

root@Drazi# gdb --args NetworkManager --no-daemon
(gdb) r
Starting program: /usr/sbin/NetworkManager --no-daemon
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
[New Thread 0x7ffff2706700 (LWP 11458)]
NetworkManager[11454]: <info> NetworkManager (version 0.9.8.0) is starting...
NetworkManager[11454]: <info> Read config file /etc/NetworkManager/NetworkManager.conf
NetworkManager[11454]: <info> WEXT support is enabled
[New Thread 0x7ffff1f05700 (LWP 11459)]
NetworkManager[11454]: <info> VPN: loaded org.freedesktop.NetworkManager.pptp
NetworkManager[11454]: <info> VPN: loaded org.freedesktop.NetworkManager.openvpn
NetworkManager[11454]: <info> DNS: loaded plugin dnsmasq
[New Thread 0x7ffff1704700 (LWP 11460)]
NetworkManager[11454]: SCPlugin-Ifupdown: init!
NetworkManager[11454]: SCPlugin-Ifupdown: update_system_hostname
NetworkManager[11454]: SCPluginIfupdown: management mode: unmanaged
NetworkManager[11454]: SCPlugin-Ifupdown: devices added (path: /sys/devices/pci0000:00/0000:00:19.0/net/eth0, iface: eth0)
NetworkManager[11454]: SCPlugin-Ifupdown: device added (path: /sys/devices/pci0000:00/0000:00:19.0/net/eth0, iface: eth0): no ifupdown configuration found.
NetworkManager[11454]: SCPlugin-Ifupdown: devices added (path: /sys/devices/pci0000:00/0000:00:1c.3/0000:04:00.0/net/wlan0, iface: wlan0)
NetworkManager[11454]: SCPlugin-Ifupdown: device added (path: /sys/devices/pci0000:00/0000:00:1c.3/0000:04:00.0/net/wlan0, iface: wlan0): no ifupdown configuration found.
NetworkManager[11454]: SCPlugin-Ifupdown: devices added (path: /sys/devices/virtual/net/lo, iface: lo)
NetworkManager[11454]: SCPlugin-Ifupdown: device added (path: /sys/devices/virtual/net/lo, iface: lo): no ifupdown configuration found.
NetworkManager[11454]: SCPlugin-Ifupdown: end _init.
NetworkManager[11454]: <info> Loaded plugin ifupdown: (C) 2008 Canonical Ltd. To report bugs please use the NetworkManager mailing list.
NetworkManager[11454]: <info> Loaded plugin keyfile: (c) 2007 - 2010 Red Hat, Inc. To report bugs please use the NetworkManager mailing list.

(NetworkManager:11454): GLib-GObject-CRITICAL **: Object class SCPluginOfono doesn't implement property 'name' from interface 'NMSystemConfigInterface'

(NetworkManager:11454): GLib-GObject-CRITICAL **: Object class SCPluginOfono doesn't implement property 'info' from interface 'NMSystemConfigInterface'

(NetworkManager:11454): GLib-GObject-CRITICAL **: Object class SCPluginOfono doesn't implement property 'hostname' from interface 'NMSystemConfigInterface'

(NetworkManager:11454): GLib-GObject-CRITICAL **: Object class SCPluginOfono doesn't implement property 'capabilities' from interface 'NMSystemConfigInterface'
NetworkManager[11454]: SCPlugin-Ofono: Acquired D-Bus service com.canonical.NMOfono
NetworkManager[11454]: SCPlugin-Ofono: init!

(NetworkManager:11454): GLib-CRITICAL **: g_dir_read_name: assertion 'dir != NULL' failed
NetworkManager[11454]: SCPlugin-Ofono: end _init.

(NetworkManager:11454): GLib-GObject-WARNING **: g_object_get_valist: object class 'SCPluginOfono' has no property named 'name'
NetworkManager[11454]: <info> Loaded plugin (null): (null)
NetworkManager[11454]: Ifupdown: get unmanaged devices count: 0
NetworkManager[11454]: SCPlugin-Ifupdown: (7663872) ... get_connections.
NetworkManager[11454]: SCPlugin-Ifupdown: (7663872) ... get_connections (managed=false): return empty list.
NetworkManager[11454]: keyfile: parsing CarreDor ...
NetworkManager[11454]: keyfile: read connection 'CarreDor'
NetworkManager[11454]: keyfile: parsing kyriad chambres ...
NetworkManager[11454]: file nm-utils.c: line 2584 (nm_utils_hwaddr_type): should not be reached
NetworkManager[11454]: file nm-utils.c: line 2584 (nm_utils_hwaddr_type): should not be reached
NetworkManager[11454]: read_field: assertion '**current' failed

Program received signal SIGSEGV, Segmentation fault.
0x00000000004aec93 in read_one_ip_address_or_route (route=0, ipv6=0, key_name=0x76a130 "addresses", setting_name=0x76a090 "ipv4", file=0x71f5e0) at reader.c:293
293 reader.c: No such file or directory.

(gdb) bt
#0 0x00000000004aec93 in read_one_ip_address_or_route (route=0, ipv6=0, key_name=0x76a130 "addresses", setting_name=0x76a090 "ipv4", file=0x71f5e0) at reader.c:293
#1 ip_address_or_route_parser (setting=0x75f8f0, key=<optimized out>, keyfile=0x71f5e0, keyfile_path=<optimized out>) at reader.c:394
#2 0x00000000004ae34d in read_one_setting_value (setting=setting@entry=0x75f8f0, key=<optimized out>, value=value@entry=0x7fffffffd4f0, flags=<optimized out>, user_data=user_data@entry=0x7fffffffd580) at reader.c:977
#3 0x00007ffff7b91c58 in nm_setting_enumerate_values (setting=setting@entry=0x75f8f0, func=func@entry=0x4ae1d0 <read_one_setting_value>, user_data=user_data@entry=0x7fffffffd580) at nm-setting.c:589
#4 0x00000000004af11e in read_setting (setting_name=<optimized out>, keyfile_path=0x753ed0 "/etc/NetworkManager/system-connections/kyriad chambres", file=0x71f5e0) at reader.c:1082
#5 nm_keyfile_plugin_connection_from_file (filename=filename@entry=0x753ed0 "/etc/NetworkManager/system-connections/kyriad chambres", error=error@entry=0x7fffffffd6d0) at reader.c:1153
#6 0x00000000004ad0eb in nm_keyfile_connection_new (full_path=full_path@entry=0x753ed0 "/etc/NetworkManager/system-connections/kyriad chambres", source=source@entry=0x0, error=error@entry=0x7fffffffd6d0) at nm-keyfile-connection.c:59
#7 0x00000000004a9cec in _internal_new_connection (self=<optimized out>, full_path=0x753ed0 "/etc/NetworkManager/system-connections/kyriad chambres", source=0x0, error=0x7fffffffd6d0) at plugin.c:80
#8 0x00000000004aa5ac in read_connections (config=<optimized out>) at plugin.c:118
#9 get_connections (config=<optimized out>) at plugin.c:382
#10 0x000000000049e6e1 in load_connections (self=0x72b320) at nm-settings.c:176
#11 0x00000000004a0314 in nm_settings_get_unmanaged_specs (self=0x72b320) at nm-settings.c:405
#12 0x00000000004a04aa in get_property (object=<optimized out>, prop_id=1, value=0x751740, pspec=0x72b210) at nm-settings.c:1811
#13 0x00007ffff5d1585b in g_object_get_property () from /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0
#14 0x000000000049d84b in notify (object=0x72b320, pspec=0x72b210) at nm-settings.c:392
#15 0x00007ffff5d0d188 in g_closure_invoke () from /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0
#16 0x00007ffff5d1e337 in ?? () from /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0
#17 0x00007ffff5d26829 in g_signal_emit_valist () from /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0
#18 0x00007ffff5d26ae2 in g_signal_emit () from /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0
#19 0x00007ffff5d11505 in ?? () from /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0
#20 0x00007ffff5d13abb in g_object_notify () from /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0
#21 0x000000000049e67b in unmanaged_specs_changed (config=<optimized out>, user_data=<optimized out>) at nm-settings.c:501
#22 0x00000000004a11a8 in nm_settings_new (config_file=<optimized out>, plugins=plugins@entry=0x721050, error=error@entry=0x7fffffffde90) at nm-settings.c:1732
#23 0x0000000000424d82 in main (argc=1, argv=0x7fffffffe2c8) at main.c:543

(gdb) disas $rip,+1
Dump of assembler code from 0x4aec93 to 0x4aec94:
=> 0x00000000004aec93 <ip_address_or_route_parser+659>: movsbl (%rax),%ecx
End of assembler dump.

(gdb) p/x $rax
$2 = 0xa703f2e2a45f3400

(gdb) info locals
plen_str = <optimized out>
value = 0x76a150 ""
plen = 4156233204
metric = 32767
gateway_str = <optimized out>
metric_str = <optimized out>
current = 0x76a150 ""
result = <optimized out>
address_str = 0x0
error = 0xa703f2e2a45f3400 <Address 0xa703f2e2a45f3400 out of bounds>

ProblemType: Bug
DistroRelease: Ubuntu 13.10
Package: network-manager 0.9.8.0-0ubuntu22
ProcVersionSignature: Ubuntu 3.11.0-12.19-generic 3.11.3
Uname: Linux 3.11.0-12-generic x86_64
NonfreeKernelModules: fglrx
ApportVersion: 2.12.5-0ubuntu2
Architecture: amd64
Date: Fri Oct 18 15:26:36 2013
IfupdownConfig:
 # interfaces(5) file used by ifup(8) and ifdown(8)
 auto lo
 iface lo inet loopback
InstallationDate: Installed on 2012-11-07 (344 days ago)
InstallationMedia: Kubuntu 12.10 "Quantal Quetzal" - Release amd64 (20121017.1)
IpRoute:
 default via 192.168.11.1 dev eth0
 192.168.11.0/24 dev eth0 proto kernel scope link src 192.168.11.15
MarkForUpload: True
NetworkManager.state:
 [main]
 NetworkingEnabled=true
 WirelessEnabled=false
 WWANEnabled=true
 WimaxEnabled=true
SourcePackage: network-manager
UpgradeStatus: Upgraded to saucy on 2013-10-18 (0 days ago)
nmcli-con:
 Error: command ['nmcli', '-f', 'all', 'con'] failed with exit code 9:
 ** (process:11048): WARNING **: Could not initialize NMClient /org/freedesktop/NetworkManager: The name org.freedesktop.NetworkManager was not provided by any .service files
 Error: nmcli (0.9.8.0) and NetworkManager (unknown) versions don't match. Force execution using --nocheck, but the results are unpredictable.
nmcli-dev: Error: command ['nmcli', '-f', 'all', 'dev'] failed with exit code 8: Error: NetworkManager is not running.
nmcli-nm:
 RUNNING VERSION STATE NET-ENABLED WIFI-HARDWARE WIFI WWAN-HARDWARE WWAN
 not running unknown unknown unknown unknown unknown unknown unknown

[Matthias Kretz (mkretz)]

The lines
addresses=
routes=
in [ipv4] lead to the crash.

I tried to attach a file, but Launchpad ignores me...

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Andreas Roth (aroth)]

Thanks Matthias for the quick solution. It helped on my system as well.