/usr/bin/unattended-upgrade:UnicodeDecodeError:/usr/bin/unattended-upgrade@2268:main:run:get_auto_removable:<setcomp>:__iter__:keys:<genexpr>

[errors.ubuntu.com bug bridge]

The Ubuntu Error Tracker has been receiving reports about a problem regarding unattended-upgrades. This problem was most recently seen with package version 1.10ubuntu5, the problem page at https://errors.ubuntu.com/problem/e0067211bd138f2644f4d2a86a6337280970ebe0 contains more details, including versions of packages affected, stacktrace or traceback, and individual crash reports.
If you do not have access to the Ubuntu Error Tracker and are a software developer, you can request it at http://forms.canonical.com/reports/.

Traceback (most recent call last):
  File "/usr/bin/unattended-upgrade", line 2268, in <module>
    sys.exit(main(options))
  File "/usr/bin/unattended-upgrade", line 1732, in main
    install_start_time)
  File "/usr/bin/unattended-upgrade", line 1906, in run
    auto_removable = get_auto_removable(cache)
  File "/usr/bin/unattended-upgrade", line 1557, in get_auto_removable
    return {pkg.name for pkg in cache
  File "/usr/bin/unattended-upgrade", line 1557, in <setcomp>
    return {pkg.name for pkg in cache
  File "/usr/lib/python3/dist-packages/apt/cache.py", line 333, in __iter__
    for pkgname in self.keys():
  File "/usr/lib/python3/dist-packages/apt/cache.py", line 361, in keys
    for p in self._cache.packages
  File "/usr/lib/python3/dist-packages/apt/cache.py", line 362, in <genexpr>
    if self.__is_real_pkg(p))
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe4 in position 16: invalid continuation byte

[Julian Andres Klode (juliank)]

Crazy, who has invalid unicode in package names?

[Julian Andres Klode (juliank)]

Probably a memory corruption somewhere, but this would need some deep digging.

[Balint Reczey (rbalint)]

There are many corruptions reported at
https://errors.ubuntu.com/?package=unattended-upgrades&period=week&version=1.10ubuntu5
:-(

On Wed, Apr 24, 2019 at 1:01 PM Julian Andres Klode
<email address hidden> wrote:
>
> Probably a memory corruption somewhere, but this would need some deep
> digging.
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1826183
>
> Title:
> /usr/bin/unattended-upgrade:UnicodeDecodeError:/usr/bin/unattended-
> upgrade@2268:main:run:get_auto_removable:<setcomp>:__iter__:keys:<genexpr>
>
> Status in python-apt package in Ubuntu:
> New
>
> Bug description:
> The Ubuntu Error Tracker has been receiving reports about a problem regarding unattended-upgrades. This problem was most recently seen with package version 1.10ubuntu5, the problem page at https://errors.ubuntu.com/problem/e0067211bd138f2644f4d2a86a6337280970ebe0 contains more details, including versions of packages affected, stacktrace or traceback, and individual crash reports.
> If you do not have access to the Ubuntu Error Tracker and are a software developer, you can request it at http://forms.canonical.com/reports/.
>
> Traceback (most recent call last):
> File "/usr/bin/unattended-upgrade", line 2268, in <module>
> sys.exit(main(options))
> File "/usr/bin/unattended-upgrade", line 1732, in main
> install_start_time)
> File "/usr/bin/unattended-upgrade", line 1906, in run
> auto_removable = get_auto_removable(cache)
> File "/usr/bin/unattended-upgrade", line 1557, in get_auto_removable
> return {pkg.name for pkg in cache
> File "/usr/bin/unattended-upgrade", line 1557, in <setcomp>
> return {pkg.name for pkg in cache
> File "/usr/lib/python3/dist-packages/apt/cache.py", line 333, in __iter__
> for pkgname in self.keys():
> File "/usr/lib/python3/dist-packages/apt/cache.py", line 361, in keys
> for p in self._cache.packages
> File "/usr/lib/python3/dist-packages/apt/cache.py", line 362, in <genexpr>
> if self.__is_real_pkg(p))
> UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe4 in position 16: invalid continuation byte
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ubuntu/+source/python-apt/+bug/1826183/+subscriptions

--
Balint Reczey
Ubuntu & Debian Developer

[Brian Murray (brian-murray)]

On Wed, Apr 24, 2019 at 10:46:58AM -0000, Julian Andres Klode wrote:
> Crazy, who has invalid unicode in package names?

I think I've seen that before with unofficial repositories.

--
Brian Murray