/usr/lib/x86_64-linux-gnu/fwupd/fwupd:11:as_store_load_yaml_file:as_store_from_file_internal:as_store_load_app_info_file:as_store_load_app_info:as_store_search_app_info

[errors.ubuntu.com bug bridge]

The Ubuntu Error Tracker has been receiving reports about a problem regarding fwupd. This problem was most recently seen with version 0.7.0-0ubuntu4.2, the problem page at https://errors.ubuntu.com/problem/383fc92e3f070ac2836bf575ac0ddc40814a5427 contains more details.

[Mario Limonciello (superm1)]

There's a bunch of reports of this on the error tracker. Here's the BT from the most recent one (nothing private in there I can see).

Stacktrace

#0 0x00007f5dcd1754a0 in as_store_load_yaml_file (error=0x7ffdd3cfeb40, cancellable=0x0, file=0x55dc2db9a900, store=0x55dc2db4b880) at as-store.c:1135
        tmp = <optimized out>
        ctx = 0x55dc2db8e800
        icon_path = 0x0
        root = 0x55dc2db9be40
        app_n = <optimized out>
        n = <optimized out>
        tok = 0x0
#1 as_store_from_file_internal (store=store@entry=0x55dc2db4b880, file=file@entry=0x55dc2db9a900, id_prefix=id_prefix@entry=0x7f5dcd17e9ae "system", cancellable=cancellable@entry=0x0, error=error@entry=0x7ffdd3cfeb40) at as-store.c:1371
        filename = 0x55dc2db6c890 "/var/lib/app-info/yaml/de.archive.ubuntu.com_ubuntu_dists_xenial-backports_main_dep11_Components-amd64.yml.gz"
        icon_prefix = 0x0
        error_local = 0x0
        root = 0x0
        ptask = 0x55dc2db8e870
        __func__ = "as_store_from_file_internal"
#2 0x00007f5dcd175ab7 in as_store_load_app_info_file (error=0x7ffdd3cfeb40, cancellable=0x0, path_xml=0x55dc2dbebb20 "/var/lib/app-info/yaml/de.archive.ubuntu.com_ubuntu_dists_xenial-backports_main_dep11_Components-amd64.yml.gz", id_prefix=0x7f5dcd17e9ae "system", store=0x55dc2db4b880) at as-store.c:2068
        file = 0x55dc2db9a900
        ptask = 0x55dc2db8ea90
#3 as_store_load_app_info (store=store@entry=0x55dc2db4b880, id_prefix=id_prefix@entry=0x7f5dcd17e9ae "system", path=path@entry=0x55dc2db57700 "/var/lib/app-info/yaml", flags=flags@entry=AS_STORE_LOAD_FLAG_APP_INFO_SYSTEM, cancellable=cancellable@entry=0x0, error=error@entry=0x7ffdd3cfecd8) at as-store.c:2118
        error_store = 0x0
        filename_md = 0x55dc2dbebb20 "/var/lib/app-info/yaml/de.archive.ubuntu.com_ubuntu_dists_xenial-backports_main_dep11_Components-amd64.yml.gz"
        tmp = <optimized out>
        dir = 0x55dc2db6c420
        error_local = 0x0
        tok = 0x55dc2db4b868
#4 0x00007f5dcd176131 in as_store_search_app_info (store=store@entry=0x55dc2db4b880, flags=flags@entry=AS_STORE_LOAD_FLAG_APP_INFO_SYSTEM, id_prefix=id_prefix@entry=0x7f5dcd17e9ae "system", path=path@entry=0x55dc2db4e440 "/var/lib/app-info", cancellable=cancellable@entry=0x0, error=error@entry=0x7ffdd3cfecd8) at as-store.c:2333
        dest = 0x55dc2db57700 "/var/lib/app-info/yaml"
        supported_kinds = {0x7f5dcd180d6d "yaml", 0x7f5dcd17f659 "xmls", 0x0}
        i = <optimized out>
#5 0x00007f5dcd176be4 in as_store_search_per_system (error=<optimized out>, cancellable=0x0, flags=<optimized out>, store=<optimized out>) at as-store.c:2535
        dest1 = 0x55dc2db4e440 "/var/lib/app-info"
        dest2 = 0x0
        data_dirs = 0x55dc2db4e420
        i = <optimized out>
        ptask = 0x55dc2db4e2f0
#6 as_store_load (store=<optimized out>, flags=<optimized out>, cancellable=0x0, error=<optimized out>) at as-store.c:2683
        ptask = 0x55dc2db4e220
        tok = 0x55dc2db4b868
#7 0x000055dc2d1479c7 in main (argc=1, argv=0x7ffdd3cfee98) at fu-main.c:2126
        priv = 0x55dc2db49700
        immediate_exit = 0
        ret = <optimized out>
        timed_exit = 0
        context ...

[Richard Hughes (richard-hughes)]

Can someone upload a copy of /var/lib/app-info/yaml/de.archive.ubuntu.com_ubuntu_dists_xenial-backports_main_dep11_Components-amd64.yml.gz that makes "appstream-util search foo" crash please.

[Mario Limonciello (superm1)]

Unfortunately that part hasn't been captured in the bug tracker. Bug tracking folks, is there a way to configure apport to grab some files like this next time this crashes?

[Sebastien Bacher (seb128)]

you can provide an apport hook that includes files with the reports, see https://wiki.ubuntu.com/Apport/DeveloperHowTo

[Mario Limonciello (superm1)]

ah, so will need a change on the package end that would need to be SRU'ed in to be able to better catch this.

I think we'll need to monitor if there are reports that continue to come in with this after the fix for https://bugs.launchpad.net/ubuntu/+source/appstream-glib/+bug/1591868 is loaded up. If they're continuing then an apport hook should be SRU'ed in to get some more details.

[Mario Limonciello (superm1)]

I do think this has been coming up when there has been bad metadata on the system. Recent reports of it show errors like this:

W:Target Sources (main/source/Sources) is configured multiple times in /etc/apt/sources.list.d/otto-kesselgulasch-ubuntu-gimp-xenial.list:2 and /etc/apt/sources.list.d/otto-kesselgulasch-ubuntu-gimp-xenial.list:3, W:Target Sources (main/source/Sources) is configured multiple times in /etc/apt/sources.list.d/otto-kesselgulasch-ubuntu-gimp-xenial.list:2 and /etc/apt/sources.list.d/otto-kesselgulasch-ubuntu-gimp-xenial.list:4, W:Target Sources (main/source/Sources) is configured multiple times in /etc/apt/sources.list.d/otto-kesselgulasch-ubuntu-gimp-xenial.list:2 and /etc/apt/sources.list.d/otto-kesselgulasch-ubuntu-gimp-xenial.list:5, W:Target Sources (main/source/Sources) is configured multiple times in /etc/apt/sources.list.d/webupd8team-ubuntu-brackets-xenial.list:2 and /etc/apt/sources.list.d/webupd8team-ubuntu-brackets-xenial.list:3, W:Target Sources (main/source/Sources) is configured multiple times in /etc/apt/sources.list.d/webupd8team-ubuntu-brackets-xenial.list:2 and /etc/apt/sources.list.d/webupd8team-ubuntu-brackets-xenial.list:4, E:Encountered a section with no Package: header, E:Problem with MergeList /var/lib/apt/lists/ppa.launchpad.net_pmjdebruijn_darktable-release_ubuntu_dists_xenial_main_i18n_Translation-en, E:As listas de pacotes ou os arquivos de estado não puderam ser analisados ou abertos.

E:Encountered a section with no Package: header, E:Problem with MergeList /var/lib/apt/lists/ppa.launchpad.net_pmjdebruijn_darktable-release_ubuntu_dists_xenial_main_i18n_Translation-en, E:As listas de pacotes ou os arquivos de estado não puderam ser analisados ou abertos.

E:Encountered a section with no Package: header, E:Problem with MergeList /var/lib/apt/lists/za.archive.ubuntu.com_ubuntu_dists_xenial_main_binary-amd64_Packages, E:The package lists or status file could not be parsed or opened.

No reports yet with the appstream-glib fix present, so I think continue to watch this and see if any come in with that fix present still.

[Mario Limonciello (superm1)]

This particular issue hasn't received reports in anything newer than Ubuntu 16.04. The fwupd version in 16.04 is in deep maintenance mode and issues on the branches contained there (0.7.x and 0.8.x) will not be fixed.