Please ship a glibc build for profiling in libc6-prof

[Balint Reczey]

[Impact]

* The C library shipped in libc6 is built with GCC's default behavior of omitting the frame pointer that makes tracing and profiling harder. Building GLibc with -fno-omit-frame-pointer and shipping it in an optional libc6-prof binary package would help tracing and profiling efforts.

[Test Case]

* Install libc6-prof and start tracing in one shell:

  sudo bpftrace -e 't:syscalls:sys_enter_clock_nanosleep /comm == "sleep"/ {printf("%s\n", ustack);}'
  Attaching 1 probe...

        clock_nanosleep+94
        __nanosleep+23
        0x5652a2e6b827

* Run the traced program in a different shell
 env LD_LIBRARY_PATH=/lib/libc6-prof/x86_64-linux-gnu sleep 1

* Repeat it without using the libc6-prof library:

 ubuntu@ff-glibc:~$ sleep 1

 ubuntu@ff-glibc:~$ sudo bpftrace -e 't:syscalls:sys_enter_clock_nanosleep /comm == "sleep"/ {printf("%s\n", ustack); }'
 Attaching 1 probe...

        clock_nanosleep+84

[ Where problems could occur ]

* Glibc does not build for some architectures with the additional -fno-omit-frame-pointer option which is tracked in LP: #1898049.
* The -fno-omit-frame-pointer option may sneak in to the regular build, this is convered in the test case.
* Libc6-prof may be slower thanks to the -fno-omit-frame-pointer option, this is expected and this is the reason for shipping it in a separate package.

[Łukasz Zemczak (sil2100)]

Hello Balint, or anyone else affected,

Accepted glibc into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.32-0ubuntu3.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-groovy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Łukasz Zemczak (sil2100)]

Hello Balint, or anyone else affected,

Accepted glibc into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.31-0ubuntu9.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Ubuntu SRU Bot (ubuntu-sru-bot)]

All autopkgtests for the newly accepted glibc (2.31-0ubuntu9.2) for focal have finished running.
The following regressions have been reported in tests triggered by the package:

python-llfuse/1.3.6+dfsg-2build1 (ppc64el)
mercurial/5.3.1-1ubuntu1 (amd64)
datefudge/1.23ubuntu1 (ppc64el)
yade/2020.01a-6build2 (s390x)
raspell/1.3-2build1 (s390x)
burp/2.2.18-2 (arm64)
gnudatalanguage/0.9.9-12build1 (amd64)
threadweaver/5.68.0-0ubuntu1 (amd64)
rancid/3.11-1 (s390x)
r-other-x4r/1.0.1+git20150806.c6bd9bd-2build1 (s390x)
libxmlb/0.1.15-2 (amd64)
feersum/1.407-2 (s390x)
libimage-sane-perl/5-1 (arm64)
gnome-photos/3.34.1-1 (ppc64el)
mbedtls/2.16.4-1ubuntu2 (amd64)
libreoffice/1:6.4.6-0ubuntu0.20.04.1 (armhf)
reprotest/0.7.14 (s390x, arm64)
puma/3.12.4-1ubuntu2 (arm64, s390x)
libdbd-mariadb-perl/1.11-3ubuntu2 (armhf, arm64, amd64, s390x, ppc64el)
python3-lxc/1:3.0.4-1ubuntu6 (s390x)
mpi4py/3.0.3-4build2 (amd64)
nut/2.7.4-11ubuntu4 (s390x)
r-cran-processx/3.4.2-1 (amd64)
boost1.71/1.71.0-6ubuntu6 (amd64)
netplan.io/0.100-0ubuntu4~20.04.3 (amd64)
php-luasandbox/3.0.3-2build2 (armhf)
libtext-markdown-discount-perl/0.12-1 (armhf)
mysql-connector-c++/1.1.12-4ubuntu2 (s390x)
xmobar/0.29.4-2build3 (ppc64el)
golang-github-xenolf-lego/3.2.0-1 (armhf, arm64, amd64, s390x, ppc64el)
cffi/1:0.21.0-1 (amd64)
websocketd/0.3.1-3 (armhf)
cmark-gfm/0.29.0.gfm.0-4 (amd64)
ruby2.7/2.7.0-5ubuntu1.2 (arm64)
golang-github-bmatsuo-lmdb-go/1.8.0+git20170215.a14b5a3-2 (amd64)
lazarus/2.0.6+dfsg-3 (armhf)
gnutls28/3.6.13-2ubuntu1.3 (i386, s390x, ppc64el, armhf, arm64, amd64)
dogtag-pki/10.8.3-1ubuntu1 (armhf, arm64, amd64, s390x, ppc64el)
booth/1.0-174-gce9f821-1 (arm64)
apache2/2.4.41-4ubuntu3.1 (armhf)
libpff/20180714-2 (armhf, arm64, amd64, s390x, ppc64el)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/focal/update_excuses.html#glibc

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

[Ubuntu SRU Bot (ubuntu-sru-bot)]

All autopkgtests for the newly accepted glibc (2.32-0ubuntu3.1) for groovy have finished running.
The following regressions have been reported in tests triggered by the package:

snapd-glib/1.58-0ubuntu0.20.10.0 (armhf)
libcompress-raw-bzip2-perl/unknown (armhf)
node-ws/7.3.0+~cs24.0.3-1build1 (s390x, armhf, ppc64el, amd64, arm64)
austin/unknown (armhf)
r-bioc-rhdf5lib/1.10.1+dfsg-1 (armhf)
tup/0.7.8-3 (arm64)
r-cran-seurat/unknown (armhf)
python-pomegranate/unknown (armhf)
ruby-mysql2/0.5.2-1ubuntu3 (armhf)
libdevel-cover-perl/1.36-1build1 (armhf)
undbx/unknown (armhf)
libtime-warp-perl/0.54-1build1 (ppc64el)
statsprocessor/unknown (armhf)
pycurl/7.43.0.2-7 (armhf)
libhash-fieldhash-perl/unknown (armhf)
reprotest/0.7.15 (s390x)
r-cran-httpuv/1.5.4+dfsg-1 (armhf)
libosinfo/unknown (armhf)
r-cran-batchtools/unknown (armhf)
chiark-tcl/1.3.4ubuntu3 (armhf)
libdbd-mariadb-perl/1.11-3ubuntu2 (s390x, ppc64el, amd64, arm64)
firefox/84.0+build3-0ubuntu0.20.10.1 (arm64)
hilive/2.0a-3build2 (amd64)
etcd/3.2.26+dfsg-8 (amd64)
libdbd-mariadb-perl/unknown (armhf)
prometheus/unknown (armhf)
libticonv/unknown (armhf)
notary/0.6.1~ds2-6 (armhf)
firebird3.0/unknown (armhf)
burrow/unknown (armhf)
ruby-stackprof/0.2.15-2 (arm64)
gnutls28/3.6.15-4ubuntu2 (i386, amd64, s390x, arm64, ppc64el, armhf)
postgresql-plproxy/2.9-2 (armhf)
librg-blast-parser-perl/0.03-6build2 (armhf)
binutils/2.35.1-1ubuntu1 (armhf)
clutter-1.0/1.26.4+dfsg-1 (arm64)
transtermhp/2.09-5 (armhf)
genext2fs/1.5.0-1 (s390x)
python-cmarkgfm/unknown (armhf)
libpff/20180714-2 (s390x, armhf, ppc64el, amd64, arm64)
debsig-verify/unknown (armhf)
bosh/unknown (armhf)
casync/2+20190213-1 (amd64)
golang-github-spf13-cobra/unknown (armhf)
tpm2-tools/unknown (armhf)
umockdev/0.14.3-1 (armhf)
crrcsim/unknown (armhf)
postgis/3.0.2+dfsg-2ubuntu2 (amd64)
r-cran-proc/unknown (armhf)
mercurial/5.5.1-1 (armhf)
r-cran-dqrng/unknown (armhf)
frobby/unknown (armhf)
libcrypt-cast5-perl/unknown (armhf)
drumkv1/0.9.17-1 (ppc64el)
nsf/unknown (armhf)
python3-lxc/1:3.0.4-1ubuntu6 (s390x)
hyphy/2.5.1+dfsg-3build1 (amd64)
fatrace/0.16-1 (arm64)
bio-rainbow/unknown (armhf)
python-fabio/0.10.2+dfsg-2 (armhf)
hhsuite/3.2.0-3 (amd64)
libperlio-layers-perl/0.012-1 (armhf)
postgresql-common/unknown (armhf)
menhir/20200624-1 (s390x)
notify-osd/0.9.35+20.04.20191129-0ubuntu1 (ppc64el)
r-cran-xfun/unknown (armhf)
gifsicle/1.92-2 (armhf)
libunix-processors-perl/unknown (armhf)
freebayes/unknown (armhf)
alertmanager-irc-relay/0.1.0-3 (arm64)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/groovy/update_excuses.html#glibc

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

[Balint Reczey (rbalint)]

Verified 2.31-0ubuntu9.2 on Focal

ubuntu@ff-glibc-prof:~$ env LD_LIBRARY_PATH=/lib/libc6-prof/x86_64-linux-gnu sleep 1
ubuntu@ff-glibc-prof:~$ sleep 1
ubuntu@ff-glibc-prof:~$ dpkg -l libc6-prof
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-================-===============-============-=================================
ii libc6-prof:amd64 2.31-0ubuntu9.2 amd64 GNU C Library: Shared Libraries

---
ubuntu@ff-glibc-prof:~$ sudo bpftrace -e 't:syscalls:sys_enter_clock_nanosleep /comm == "sleep"/ {printf("%s\n", ustack);}'
Attaching 1 probe...

        clock_nanosleep+94
        __nanosleep+23
        0x555f51fbd827

^C

ubuntu@ff-glibc-prof:~$ sudo bpftrace -e 't:syscalls:sys_enter_clock_nanosleep /comm == "sleep"/ {printf("%s\n", ustack);}'
Attaching 1 probe...

        clock_nanosleep+84

^C

ubuntu@ff-glibc-prof:~$

[Balint Reczey (rbalint)]

Verified 2.32-0ubuntu3.1 on Groovy.

ubuntu@gg-glibc-prof:~$ dpkg -l libc6-prof
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-================-===============-============-=================================
ii libc6-prof:amd64 2.32-0ubuntu3.1 amd64 GNU C Library: Shared Libraries
ubuntu@gg-glibc-prof:~$ env LD_LIBRARY_PATH=/lib/libc6-prof/x86_64-linux-gnu sleep 1
ubuntu@gg-glibc-prof:~$ sleep 1
ubuntu@gg-glibc-prof:~$

---

ubuntu@gg-glibc-prof:~$ sudo bpftrace -e 't:syscalls:sys_enter_clock_nanosleep /comm == "sleep"/ {printf("%s\n", ustack);}'
Attaching 1 probe...

        clock_nanosleep+96
        __nanosleep+23
        0x55bbd1167f67

^C

ubuntu@gg-glibc-prof:~$ sudo bpftrace -e 't:syscalls:sys_enter_clock_nanosleep /comm == "sleep"/ {printf("%s\n", ustack);}'
Attaching 1 probe...

        clock_nanosleep+90

^C

ubuntu@gg-glibc-prof:~$

[Łukasz Zemczak (sil2100)]

The verification of the Stable Release Update for glibc has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Launchpad Janitor (janitor)]

This bug was fixed in the package glibc - 2.31-0ubuntu9.2

---------------
glibc (2.31-0ubuntu9.2) focal; urgency=medium

  * Drop check preventing using float128 which breaks new icc (LP: #1895358)
  * Detect debconf consistently in libc6.preinst and do not crash if it is
    not used (LP: #1902955)
  * Ship libc variant compiled for profiling in libc6-prof (LP: #1908307)
  * elf: Add endianness markup to ld.so.cache (Closes: #731082) (LP: #1906250)

 -- Balint Reczey <email address hidden> Wed, 16 Dec 2020 12:04:55 +0100

[Łukasz Zemczak (sil2100)]

Hello Balint, or anyone else affected,

Accepted glibc into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.32-0ubuntu3.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-groovy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Ubuntu SRU Bot (ubuntu-sru-bot)]

All autopkgtests for the newly accepted glibc (2.32-0ubuntu3.2) for groovy have finished running.
The following regressions have been reported in tests triggered by the package:

cyrus-imapd/3.2.3-2ubuntu1 (armhf)
pyqt5/5.15.0+dfsg-1 (s390x)
libsass/3.6.4-3 (s390x)
network-manager/1.26.2-1ubuntu1 (arm64)
reprotest/0.7.15 (s390x)
flatpak/1.8.2-1ubuntu0.1 (arm64)
puma/3.12.4-1ubuntu2 (arm64, s390x)
libtext-charwidth-perl/0.04-10 (ppc64el)
systemd/246.6-1ubuntu1.3 (arm64)
taptempo/1.4.5-1 (arm64)
uftrace/0.9.3-1ubuntu1 (arm64)
libgdata/0.17.12-1 (armhf)
cysignals/1.10.2+ds-4 (amd64)
hyphy/2.5.1+dfsg-3build1 (amd64)
glibc/2.32-0ubuntu3.2 (amd64)
libdate-simple-perl/3.0300-3 (arm64)
netplan.io/0.101-0ubuntu3~20.10.1 (amd64)
libastro-fits-cfitsio-perl/1.14-1 (ppc64el)
fwlogwatch/1.4-2 (arm64)
pandas/1.0.5+dfsg-3 (ppc64el, armhf, s390x, amd64, arm64)
rhonabwy/0.9.12-2build1 (s390x)
jailkit/2.21-2 (ppc64el)
openjdk-lts/11.0.10+9-0ubuntu1~20.10 (s390x)
dbus/1.12.20-1ubuntu1 (arm64)
pymca/5.5.5+dfsg-2build2 (arm64)
euslisp/9.27+dfsg-6 (armhf, amd64)
libflame/5.2.0-2 (amd64)
samtools/1.10-4 (arm64)
syncthing/1.10.0~ds1-1 (amd64, s390x)
endlessh/1.1-4 (armhf)
r-cran-amore/0.2-16-1build1 (ppc64el)
crrcsim/0.9.13-3.2build1 (ppc64el)
samplv1/0.9.17-1 (ppc64el)
hugo/0.74.3-1 (armhf)
libcsfml/2.5-1build1 (ppc64el)
firefox/87.0+build3-0ubuntu0.20.10.1 (armhf)
etcd/3.2.26+dfsg-8 (amd64)
libnxml/0.18.3-8 (s390x)
google-osconfig-agent/20210219.00-0ubuntu1~20.10.0 (armhf)
combblas/1.6.2-5build1 (arm64)
libbio-db-hts-perl/3.01-3 (amd64)
libterm-readkey-perl/2.38-1build1 (s390x)
ruby2.7/2.7.1-3ubuntu1.2 (armhf)
hkl/5.0.0.2620-1build1 (ppc64el)
liblinux-inotify2-perl/1:2.2-2 (ppc64el)
datefudge/1.24 (ppc64el)
libpgplot-perl/1:2.24-1build1 (s390x)
healpy/1.14.0-1 (arm64)
udisks2/2.9.1-2ubuntu1 (amd64)
kopanocore/8.7.0-7ubuntu4 (arm64)
gyoto/1.4.4-3build1 (s390x)
cpdb-libs/1.2.0-0ubuntu8 (armhf)
ruby-concurrent/1.1.6+dfsg-3 (amd64)
postgis/3.0.2+dfsg-2ubuntu2 (armhf)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/groovy/update_excuses.html#glibc

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

[Brian Murray (brian-murray)]

The Groovy Gorilla has reached end of life, so this bug will not be fixed for that release