| 2016-11-24 10:14:06 |
Thomas A. F. Thorne |
bug |
|
|
added bug |
| 2016-11-24 12:37:52 |
Launchpad Janitor |
appstream (Ubuntu): status |
New |
Confirmed |
|
| 2016-11-24 12:42:13 |
Jay Anderson |
bug |
|
|
added subscriber Jay Anderson |
| 2016-11-24 18:00:17 |
Michael Hipp |
bug |
|
|
added subscriber Michael Hipp |
| 2016-11-24 18:07:03 |
Matthias Klumpp |
appstream (Ubuntu): status |
Confirmed |
In Progress |
|
| 2016-11-24 18:07:03 |
Matthias Klumpp |
appstream (Ubuntu): assignee |
|
Matthias Klumpp (ximion) |
|
| 2016-11-24 18:28:36 |
Peter Amaral |
bug |
|
|
added subscriber Peter Amaral |
| 2016-11-24 20:38:07 |
Rafael C. do Nascimento |
appstream (Ubuntu): status |
In Progress |
Fix Committed |
|
| 2016-11-24 20:38:11 |
Rafael C. do Nascimento |
appstream (Ubuntu): status |
Fix Committed |
In Progress |
|
| 2016-11-25 22:26:20 |
altazar |
bug |
|
|
added subscriber atlazar |
| 2016-11-27 04:55:42 |
Stephen Worthington |
bug |
|
|
added subscriber Stephen Worthington |
| 2016-11-27 14:50:42 |
Matthias Klumpp |
attachment added |
|
appstream_0.9.4-1ubuntu2_LP1644498_v1.debdiff https://bugs.launchpad.net/ubuntu/+source/appstream/+bug/1644498/+attachment/4783779/+files/appstream_0.9.4-1ubuntu2_LP1644498_v1.debdiff |
|
| 2016-11-27 15:02:06 |
Matthias Klumpp |
description |
Periodically I get emails from a machine with the subject:
Cron <root@Jenkins> if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi
And a body of:
AppStream cache update completed, but some metadata was ignored due to errors.
I have a machine monitored by Munin. One of the plugins used on that machine is /etc/munin/plugins/apt which periodically counts the number of packets that can be upgraded. This is achieved by a crontab entry installed from the package which looks like this:
#
# cron-jobs for munin-node
#
MAILTO=root
# If the APT plugin is enabled, update packages databases approx. once
# an hour (12 invokations an hour, 1 in 12 chance that the update will
# happen), but ensure that there will never be more than two hour (7200
# seconds) interval between updates..
*/5 * * * * root if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi
For many months everything has been running smoothly. On the 23rd November 2016 I started getting the "AppStream cache update completed, but some metadata was ignored due to errors." messages at a rate of about ten a day.
I did a quick Google search which turned up a handful of bugs from earlier this year, such as
Bug1575248. That is marked as Fixed Released though, so I am raising this new bug.
If there are any further diagnostic details I can provide, please let me know.
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: appstream 0.9.4-1ubuntu1
ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24
Uname: Linux 4.4.0-47-generic x86_64
ApportVersion: 2.20.1-0ubuntu2.1
Architecture: amd64
Date: Thu Nov 24 09:57:18 2016
InstallationDate: Installed on 2013-05-08 (1295 days ago)
InstallationMedia: Ubuntu 13.10 "Saucy Salamander" - Alpha amd64 (20130508)
JournalErrors:
-- Logs begin at Wed 2016-11-23 19:25:01 GMT, end at Thu 2016-11-24 09:57:24 GMT. --
Nov 24 02:22:17 hostname systemd-tmpfiles[27330]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
ProcEnviron:
TERM=xterm-256color
SHELL=/bin/bash
PATH=(custom, no user)
LANG=en_GB.UTF-8
LANGUAGE=en_GB:en
SourcePackage: appstream
UpgradeStatus: Upgraded to xenial on 2016-08-24 (91 days ago) |
[Impact]
* The recent update of the Ubuntu asgen instance yielded it to generate modern metadata. While we could tell asgen to generate old-style metadata, fixing appstream is the better idea, since we already applied similar patches to appstream-glib (and having this package hold back updates is a bad idea). Currently, the unknown metadata is considered to be broken by appstream and it displays a warning about that issue during an `apt update`
* The attached patch includes a second change to make AppStream more robust against broken YAML data, ensuring LP #1579712 can not be triggered on purpose or due to broken disks creating damaged YAML structure.
[Test Case 1]
* apt update
* Check for errors about metadata being ignored
[Test Case 2]
* appstreamcli refresh --force
* Check for errors about metadata being ignored
* Check if we ignored data that should be present
(search for it via `appstreamcli search <term>`)
* Run `appstreamcli status` and see if we still have information on the same amount of components as prior to the update.
[Regression Potential]
* Medium; The works case would be KDE Discover and GNOME Software loosing information on available software, but this risk is very low and the patch to fix this bug is very simple and has almost no regression potential. The YAML parser fix patch is a bit more complex, but should have no sideeffects.
[Original report]
Periodically I get emails from a machine with the subject:
Cron <root@Jenkins> if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi
And a body of:
AppStream cache update completed, but some metadata was ignored due to errors.
I have a machine monitored by Munin. One of the plugins used on that machine is /etc/munin/plugins/apt which periodically counts the number of packets that can be upgraded. This is achieved by a crontab entry installed from the package which looks like this:
#
# cron-jobs for munin-node
#
MAILTO=root
# If the APT plugin is enabled, update packages databases approx. once
# an hour (12 invokations an hour, 1 in 12 chance that the update will
# happen), but ensure that there will never be more than two hour (7200
# seconds) interval between updates..
*/5 * * * * root if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi
For many months everything has been running smoothly. On the 23rd November 2016 I started getting the "AppStream cache update completed, but some metadata was ignored due to errors." messages at a rate of about ten a day.
I did a quick Google search which turned up a handful of bugs from earlier this year, such as
Bug1575248. That is marked as Fixed Released though, so I am raising this new bug.
If there are any further diagnostic details I can provide, please let me know.
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: appstream 0.9.4-1ubuntu1
ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24
Uname: Linux 4.4.0-47-generic x86_64
ApportVersion: 2.20.1-0ubuntu2.1
Architecture: amd64
Date: Thu Nov 24 09:57:18 2016
InstallationDate: Installed on 2013-05-08 (1295 days ago)
InstallationMedia: Ubuntu 13.10 "Saucy Salamander" - Alpha amd64 (20130508)
JournalErrors:
-- Logs begin at Wed 2016-11-23 19:25:01 GMT, end at Thu 2016-11-24 09:57:24 GMT. --
Nov 24 02:22:17 hostname systemd-tmpfiles[27330]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
ProcEnviron:
TERM=xterm-256color
SHELL=/bin/bash
PATH=(custom, no user)
LANG=en_GB.UTF-8
LANGUAGE=en_GB:en
SourcePackage: appstream
UpgradeStatus: Upgraded to xenial on 2016-08-24 (91 days ago) |
|
| 2016-11-27 15:02:16 |
Matthias Klumpp |
appstream (Ubuntu): importance |
Undecided |
Medium |
|
| 2016-11-27 15:18:59 |
Nikita Rotsky |
bug |
|
|
added subscriber Nikita Rotsky |
| 2016-11-27 16:26:11 |
Ubuntu Foundations Team Bug Bot |
tags |
amd64 apport-bug xenial |
amd64 apport-bug patch xenial |
|
| 2016-11-27 16:26:21 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Ubuntu Sponsors Team |
| 2016-11-27 18:13:40 |
paz |
bug |
|
|
added subscriber paz |
| 2016-11-27 18:18:37 |
Matthias Klumpp |
appstream (Ubuntu): status |
In Progress |
Fix Committed |
|
| 2016-11-28 09:49:05 |
Matthias Klumpp |
attachment added |
|
appstream_0.9.4-1ubuntu2_LP1644498_v2.debdiff https://bugs.launchpad.net/ubuntu/+source/appstream/+bug/1644498/+attachment/4784052/+files/appstream_0.9.4-1ubuntu2_LP1644498_v2.debdiff |
|
| 2016-11-28 09:50:37 |
Matthias Klumpp |
nominated for series |
|
Ubuntu Xenial |
|
| 2016-11-28 11:09:19 |
Iain Lane |
bug task added |
|
appstream (Ubuntu Xenial) |
|
| 2016-11-28 11:09:27 |
Iain Lane |
appstream (Ubuntu Xenial): status |
New |
In Progress |
|
| 2016-11-28 11:09:30 |
Iain Lane |
appstream (Ubuntu): status |
Fix Committed |
Fix Released |
|
| 2016-11-28 11:09:35 |
Iain Lane |
appstream (Ubuntu Xenial): assignee |
|
Matthias Klumpp (ximion) |
|
| 2016-11-28 19:43:19 |
Mathew Hodson |
appstream (Ubuntu Xenial): importance |
Undecided |
Medium |
|
| 2016-11-28 19:46:30 |
Mathew Hodson |
bug watch added |
|
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=820774 |
|
| 2016-11-28 19:46:30 |
Mathew Hodson |
bug task added |
|
appstream (Debian) |
|
| 2016-11-28 20:11:52 |
Matthias Klumpp |
appstream (Debian): importance |
Unknown |
Undecided |
|
| 2016-11-28 20:11:52 |
Matthias Klumpp |
appstream (Debian): status |
Unknown |
New |
|
| 2016-11-28 20:11:52 |
Matthias Klumpp |
appstream (Debian): remote watch |
Debian Bug tracker #820774 |
|
|
| 2016-11-28 20:12:21 |
Matthias Klumpp |
affects |
appstream (Debian) |
debian |
|
| 2016-11-28 20:12:21 |
Matthias Klumpp |
debian: status |
New |
Invalid |
|
| 2016-11-28 22:21:10 |
Krino Hoogestraat |
bug |
|
|
added subscriber Krino Hoogestraat |
| 2016-11-30 08:37:21 |
Andrey Bondarenko |
bug |
|
|
added subscriber Andrey Bondarenko |
| 2016-11-30 11:02:34 |
Adrien Smith |
bug |
|
|
added subscriber Adrien Smith |
| 2016-12-01 12:53:10 |
cascagrossa |
bug |
|
|
added subscriber cascagrossa |
| 2016-12-01 15:29:34 |
Jeremy LaCroix |
bug |
|
|
added subscriber Jeremy LaCroix |
| 2016-12-01 23:12:41 |
Brian Murray |
appstream (Ubuntu Xenial): status |
In Progress |
Fix Committed |
|
| 2016-12-01 23:12:44 |
Brian Murray |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2016-12-01 23:12:49 |
Brian Murray |
bug |
|
|
added subscriber SRU Verification |
| 2016-12-01 23:12:58 |
Brian Murray |
tags |
amd64 apport-bug patch xenial |
amd64 apport-bug patch verification-needed xenial |
|
| 2016-12-01 23:13:55 |
Brian Murray |
removed subscriber Ubuntu Sponsors Team |
|
|
|
| 2016-12-01 23:47:03 |
Mathew Hodson |
bug task deleted |
debian |
|
|
| 2016-12-01 23:49:15 |
Mathew Hodson |
bug watch removed |
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=820774 |
|
|
| 2016-12-02 10:03:16 |
Paddy Landau |
bug |
|
|
added subscriber Paddy Landau |
| 2016-12-03 00:31:10 |
Paul Stumpf |
bug |
|
|
added subscriber Paul Stumpf |
| 2016-12-03 14:22:37 |
Krino Hoogestraat |
removed subscriber Krino Hoogestraat |
|
|
|
| 2016-12-06 04:16:14 |
Mathew Hodson |
tags |
amd64 apport-bug patch verification-needed xenial |
amd64 apport-bug patch verification-done xenial |
|
| 2016-12-09 08:30:05 |
zahzah40 |
bug |
|
|
added subscriber zahzah40 |
| 2016-12-09 08:30:27 |
zahzah40 |
removed subscriber zahzah40 |
|
|
|
| 2016-12-09 08:30:29 |
zahzah40 |
bug |
|
|
added subscriber zahzah40 |
| 2016-12-09 08:30:35 |
zahzah40 |
removed subscriber zahzah40 |
|
|
|
| 2016-12-09 08:30:38 |
zahzah40 |
bug |
|
|
added subscriber zahzah40 |
| 2016-12-18 11:23:19 |
Urijah |
bug |
|
|
added subscriber Urijah |
| 2016-12-27 15:54:43 |
Kostadin Chikov |
bug |
|
|
added subscriber Kostadin Chikov |
| 2016-12-27 18:07:44 |
Dmitry Ershov |
bug |
|
|
added subscriber Dmitry Ershov |
| 2016-12-31 17:31:28 |
Ilias |
bug |
|
|
added subscriber Ilias |
| 2017-01-03 07:53:19 |
Jebus |
bug |
|
|
added subscriber Jebus |
| 2017-01-17 17:56:56 |
Manfred Hampl |
bug |
|
|
added subscriber Manfred Hampl |
| 2017-01-25 10:25:38 |
Robie Basak |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2017-01-25 10:25:32 |
Launchpad Janitor |
appstream (Ubuntu Xenial): status |
Fix Committed |
Fix Released |
|
| 2017-01-25 11:27:03 |
cascagrossa |
removed subscriber cascagrossa |
|
|
|
| 2018-08-02 19:05:09 |
Kamil |
bug |
|
|
added subscriber Kamil |
