references to 4.3.9 symbols from Samba 4.3.11 breaking upgrade

[Pavlushka]

The latest update of samba failed to install, failed to execute "samba --configure" while installing.

ProblemType: Package
DistroRelease: Ubuntu 16.04
Package: samba 2:4.3.11+dfsg-0ubuntu0.16.04.1
ProcVersionSignature: Ubuntu 4.4.0-40.60-generic 4.4.21
Uname: Linux 4.4.0-40-generic x86_64
ApportVersion: 2.20.1-0ubuntu2.1
Architecture: amd64
Date: Thu Sep 29 18:01:29 2016
ErrorMessage: subprocess installed post-installation script returned error exit status 1
InstallationDate: Installed on 2016-04-14 (167 days ago)
InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64 (20160412)
RelatedPackageVersions:
 nautilus 1:3.18.4.is.3.14.3-0ubuntu5
 gvfs 1.28.2-1ubuntu1~16.04.1
SambaClientRegression: No
SourcePackage: samba
Title: package samba 2:4.3.11+dfsg-0ubuntu0.16.04.1 failed to install/upgrade: subprocess installed post-installation script returned error exit status 1
UpgradeStatus: No upgrade log present (probably fresh install)

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Christian Ehrhardt  (paelzer)]

I can't find too much in the log, but I've seen more of those bugs that I dup'ed onto this one.

Since the auto attached logs aren't too good for now to spot the issue I'd ask you to provide some more.

Samba in that regard consists of nmbd and smbd.
I'd like to understand what is going on in your case, could you provide the output of:

service smbd status
service nmbd status

If nothing in the following files is confidential it would be great if you could also attach:
/var/log/samba/log.nmbd
/var/log/samba/log.smbd
/etc/samba/smb.conf

[Pavlushka (pavelsayekat)]

# service smbd status
● smbd.service - LSB: start Samba SMB/CIFS daemon (smbd)
   Loaded: loaded (/etc/init.d/smbd; bad; vendor preset: enabled)
   Active: failed (Result: exit-code) since শুক্র 2016-09-30 13:56:17 BDT; 1h 11min ago
     Docs: man:systemd-sysv-generator(8)
  Process: 19385 ExecStart=/etc/init.d/smbd start (code=exited, status=1/FAILURE)

সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/libutil-tdb.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/libsamba-debug.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsam
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/libdbwrap.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-cr
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/libgenrand.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-c
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/libtdb-wrap.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/libcliauth.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-c
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/liberrors.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-cr
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/libkrb5samba.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: /usr/sbin/smbd: /usr/lib/x86_64-linux-gnu/samba/libsamba-security.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/lib
সেপ্টে 30 13:56:18 nowhere-6 smbd[19385]: ...fail!

# service nmbd status
● nmbd.service - LSB: start Samba NetBIOS nameserver (nmbd)
   Loaded: loaded (/etc/init.d/nmbd; bad; vendor preset: enabled)
   Active: failed (Result: exit-code) since শুক্র 2016-09-30 09:33:35 BDT; 5h 34min ago
     Docs: man:systemd-sysv-generator(8)

সেপ্টে 30 09:33:35 nowhere-6 nmbd[1759]: /usr/sbin/nmbd: /usr/lib/x86_64-linux-gnu/samba/libkrb5samba.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamdb.
সেপ্টে 30 09:33:35 nowhere-6 nmbd[1759]: /usr/sbin/nmbd: /usr/lib/x86_64-linux-gnu/samba/libcli-ldap-common.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/lib
সেপ্টে 30 09:33:35 nowhere-6 nmbd[1759]: /usr/sbin/nmbd: /usr/lib/x86_64-linux-gnu/samba/libsamdb-common.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsam
সেপ্টে 30 09:33:35 nowhere-6 systemd[1]: nmbd.service: Unit entered failed state.
সেপ্টে 30 09:33:35 nowhere-6 nmbd[1759]: /usr/sbin/nmbd: /usr/lib/x86_64-linux-gnu/samba/libldbsamba...

[Pavlushka (pavelsayekat)]

if it helps,
# samba --configure
samba: /usr/lib/x86_64-linux-gnu/samba/libsocket-blocking.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-util.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libgenrand.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-util.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libtime-basic.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-util.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libsamba-debug.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-util.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libsamba-security.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libsamdb-common.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libldbsamba.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libauthkrb5.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libutil-tdb.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libsamba-debug.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libdbwrap.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libgenrand.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libtdb-wrap.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libcliauth.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/liberrors.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libkrb5samba.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-credentials.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libserver-role.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-hostconfig.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libsamba-debug.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-hostconfig.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/libgenrand.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libndr.so.0)
samba: /usr/lib/x86_64-linux-gnu/samba/liberrors.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libndr.so.0)
sa...

[Robie Basak (racb)]

Please could you post the output of "dpkg -S /usr/lib/i386-linux-gnu/libndr.so.0"? If this provides a package name, please also post the output of "apt-cache policy package" (replacing "package" with the package name in that command).

Once you've replied, please change the bug status back to New.

[Pavlushka (pavelsayekat)]

# ls /usr/lib/i386-linux-gnu/libndr.so.0
/usr/lib/i386-linux-gnu/libndr.so.0

# dpkg -S /usr/lib/i386-linux-gnu/libndr.so.0
dpkg-query: no path found matching pattern /usr/lib/i386-linux-gnu/libndr.so.0

[Christian Ehrhardt  (paelzer)]

Hi,
so the lib that is missing the other symbols "should" not be installed at all.

I also found that I had only x86_64 versions of it.
$ ll /usr/lib/*/libndr.so.0
lrwxrwxrwx 1 root root 15 Sep 23 19:44 /usr/lib/x86_64-linux-gnu/libndr.so.0 -> libndr.so.0.0.5
$ dpkg -S /usr/lib/*/libndr.so.0
samba-libs:amd64: /usr/lib/x86_64-linux-gnu/libndr.so.0

On i386 the same looks like this:
$ ll /usr/lib/*/libndr.so.0
lrwxrwxrwx 1 root root 15 Sep 23 19:45 /usr/lib/i386-linux-gnu/libndr.so.0 -> libndr.so.0.0.5
$ dpkg -S /usr/lib/*/libndr.so.0
samba-libs:i386: /usr/lib/i386-linux-gnu/libndr.so.0

Both working fine.

I tried to force some chaos by installing i386 packages onto x86_64 system and vice versa.
dpkg --add-architecture i386
apt-get update
# for dependencies I need to install more than just libs
apt-get install samba-libs:i386 python-talloc:i386 python:i386
# apt is smart about conflicts as I see
[...]
The following packages will be REMOVED:
  python python-crypto python-ldb python-minimal python-samba python-talloc python-tdb python2.7 python2.7-minimal samba samba-common-bin samba-dsdb-modules samba-libs
  samba-vfs-modules
[...]
# And afterwards I get a correct working samba:
$ ll /usr/lib/*/libndr.so.0
lrwxrwxrwx 1 root root 15 Sep 23 19:45 /usr/lib/i386-linux-gnu/libndr.so.0 -> libndr.so.0.0.5
$ dpkg -S /usr/lib/*/libndr.so.0
samba-libs:i386: /usr/lib/i386-linux-gnu/libndr.so.0

You seem to have a mixed environment, for that a few questions.
- do you have a 64 or 32 bit setup in general?
- and old experiments around samba libs?
- any experiments around multiarch?
- Did you maybe in the past build a custom 32bit samba that still has libs around interfering with the packaged samba?
- please report "ll /usr/lib/*/libndr.so.0" and "dpkg -S /usr/lib/*/libndr.so.0"
- if your /usr/lib/i386-linux-gnu/libndr.so.0 doesn't belong to a package where did it come from?

[Christian Ehrhardt  (paelzer)]

If none of these reports i386 the libs didn't get to your system out of the archive:
dpkg --print-architecture
dpkg --print-foreign-architectures

According to our IRC discussion I expect the first to be amd64 and the second to be empty - is that correct?

[Christian Ehrhardt  (paelzer)]

Discussion went on and secondary arch was set, so second should be i386

[Christian Ehrhardt  (paelzer)]

got http://paste.ubuntu.com/23343618/ - thanks!

[Christian Ehrhardt  (paelzer)]

update:
[15:17] <pavlushka> # dpkg -S /usr/lib/x86_64-linux-gnu/libndr.so.0
[15:17] <pavlushka> samba-libs:amd64: /usr/lib/x86_64-linux-gnu/libndr.so.0
[15:17] <pavlushka> # dpkg -S /usr/lib/i386-linux-gnu/libndr.so.0
[15:17] <pavlushka> dpkg-query: no path found matching pattern /usr/lib/i386-linux-gnu/libndr.so.0

[Christian Ehrhardt  (paelzer)]

We synced up on IRC and went through the same stages:
overall we did:

1. cleaning all samba bits via apt purge (and rm if stale files were around)
   after that my test container as well as his system were in this state:
   Since on the Desktop there is a dependency chain mplayer -> libsmbclient -> samba-libs I was
   adapting my container to the reported case. The new overview is:
   http://paste.ubuntu.com/23343815/
2. clean out files of samba-libs:i386 as defined by http://packages.ubuntu.com/xenial/i386/samba-libs/filelist
    While we haven't found a reason it should be on the system, it is - so removing those makes apt&reality match again.
3. installing samba via "apt install samba"
   On the apt report before Y/N watch the "The following additional packages will be installed:"
   That should have no i386 packages listed - please report if it does.
   That hopefully gives a clean and working system again like:
   http://paste.ubuntu.com/23343842/

[Pavlushka (pavelsayekat)]

These are the things that might matter, as requested,
http://paste.ubuntu.com/23344195/
http://paste.ubuntu.com/23343728/
http://paste.ubuntu.com/23343765/

[Pavlushka (pavelsayekat)]

and after re-installing which reproduces the bug again,

# dpkg -l '*samba*'; ls -laF /usr/lib/*/libndr.so.0; dpkg --print-architecture; dpkg --print-foreign-architectures
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-==========================================-==========================-==========================-=========================================================================================
un libsamba-credentials0 <none> <none> (no description available)
un libsamba-hostconfig0 <none> <none> (no description available)
un libsamba-policy0 <none> <none> (no description available)
un libsamba-util0 <none> <none> (no description available)
ii python-samba 2:4.3.11+dfsg-0ubuntu0.16. amd64 Python bindings for Samba
un python2.7-samba <none> <none> (no description available)
iF samba 2:4.3.11+dfsg-0ubuntu0.16. amd64 SMB/CIFS file, print, and login server for Unix
un samba-ad-dc <none> <none> (no description available)
un samba-client <none> <none> (no description available)
ii samba-common 2:4.3.11+dfsg-0ubuntu0.16. all common files used by both the Samba server and client
ii samba-common-bin 2:4.3.11+dfsg-0ubuntu0.16. amd64 Samba common files used by both the server and the client
un samba-doc <none> <none> (no description available)
ii samba-dsdb-modules 2:4.3.11+dfsg-0ubuntu0.16. amd64 Samba Directory Services Database
ii samba-libs:amd64 2:4.3.11+dfsg-0ubuntu0.16. amd64 Samba core libraries
un samba-tools <none> <none> (no description available)
ii samba-vfs-modules 2:4.3.11+dfsg-0ubuntu0.16. amd64 Samba Virtual FileSystem plugins
un samba4 <none> <none> (no description available)
un samba4-clients <none> <none> (no description available)
un samba4-common <none> <none> (no description available)
un samba4-common-bin ...

[Christian Ehrhardt  (paelzer)]

Thanks Pavlusshka for the try to clean and update.
But I doubt that the cleaning was complete for two reasons.

In http://paste.ubuntu.com/23344195/ line 7&8 it only reports the 64bit lib would be around.
But in line 10-12 dpkg misses /usr/lib/i386-linux-gnu/libndr.so.0 - why is that?

On http://paste.ubuntu.com/23343728/ in line 25&26 both libs are reported.
And that is supposed to be after the clean right?

Not dropping all on a desktop as of dependencies shown in http://paste.ubuntu.com/23343765/ is fine as discussed on IRC.

Given the current data I'd assume the cleanup before reinstall wasn't complete.
I'd so much like to just come over and do that together :-/

For now I can't reproduce on my side so I have to rely on you.
And I highly appreciate your feedback and work to check my suggestions.

So trying to focus again on comment #16 and what shoudl be done:
1. before installing samba again after cleaning there should be no file described in http://packages.ubuntu.com/xenial/i386/samba-libs/filelist on the system
2. while installing samba again please gather the "to be installed packages". There should be no :i386 in there. Just provide the full output of the "apt install".

If before #2 the bad outdated 32bit libs are really gone and apt is not reporting them to become installed there should be no way they get on the system again.

[Christian Ehrhardt  (paelzer)]

according to our IRC talk it seems that clearing out the old libs got it resolved on the second try.
Yet it all feels a bit messy as:
- it didn't work on the first try
- we still don't know how it happened to be around in the first place

Yet I'd like to invite all reporters of duplicate bugs to try the cleanup-to-update solution as well.

[Christian Ehrhardt  (paelzer)]

Hi,
I still think something on that clean&reinstall isn't right - but can't point out what.

http://paste.ubuntu.com/23388031/

Take this script with a grain of salt - but this should more or less be what I expected you to do to clean up.
You might take and refine it as you think appropriate - take care of the "rm" to not hit something else.

Finally:
- report the version you used here
- run it
- attach the full output of running it here

[Launchpad Janitor (janitor)]

[Expired for samba (Ubuntu) because there has been no activity for 60 days.]

[Franco Runza (franco+runza)]

It still keeps : 1- trying to update
2- saying there was an error
3- When I try to update ( later ) it says it is updated
OR
4- Willing to report error(s) and the result is:
it won't be reported because this error was already
reported....
I just finished trying to update and result was Nr.3
Have a great Year's end!
Franco

2016-09-30 5:48 GMT-03:00 Launchpad Bug Tracker <email address hidden>
:

> Status changed to 'Confirmed' because the bug affects multiple users.
>
> ** Changed in: samba (Ubuntu)
> Status: New => Confirmed
>
> --
> You received this bug notification because you are subscribed to a
> duplicate bug report (1628904).
> https://bugs.launchpad.net/bugs/1629038
>
> Title:
> package samba 2:4.3.11+dfsg-0ubuntu0.16.04.1 failed to
> install/upgrade: subprocess installed post-installation script
> returned error exit status 1
>
> Status in samba package in Ubuntu:
> Confirmed
>
> Bug description:
> The latest update of samba failed to install, failed to execute "samba
> --configure" while installing.
>
> ProblemType: Package
> DistroRelease: Ubuntu 16.04
> Package: samba 2:4.3.11+dfsg-0ubuntu0.16.04.1
> ProcVersionSignature: Ubuntu 4.4.0-40.60-generic 4.4.21
> Uname: Linux 4.4.0-40-generic x86_64
> ApportVersion: 2.20.1-0ubuntu2.1
> Architecture: amd64
> Date: Thu Sep 29 18:01:29 2016
> ErrorMessage: subprocess installed post-installation script returned
> error exit status 1
> InstallationDate: Installed on 2016-04-14 (167 days ago)
> InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64
> (20160412)
> RelatedPackageVersions:
> nautilus 1:3.18.4.is.3.14.3-0ubuntu5
> gvfs 1.28.2-1ubuntu1~16.04.1
> SambaClientRegression: No
> SourcePackage: samba
> Title: package samba 2:4.3.11+dfsg-0ubuntu0.16.04.1 failed to
> install/upgrade: subprocess installed post-installation script returned
> error exit status 1
> UpgradeStatus: No upgrade log present (probably fresh install)
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ubuntu/+source/samba/+bug/
> 1629038/+subscriptions
>

[Gary Acheson (garyacheson)]

Error after every software update

[Christian Ehrhardt  (paelzer)]

Gary (and Franco) - back when debugging this case it was due to multiple mixed libs and binaries installed that didn't work together. After the debugging the solution was to re-clean the system related to those binaries/libraries - but it stays an uncommon case caused by some special local setup/config - at least that was the theory.

So I'm interested if you are really hitting "the same" meaning like:
samba: /usr/lib/x86_64-linux-gnu/samba/libtime-basic.so.0: version `SAMBA_4.3.9_UBUNTU' not found (required by /usr/lib/i386-linux-gnu/libsamba-util.so.0)

Or just some other sort of "failed to install/upgrade: subprocess installed post-installation script returned error exit status 1" as there can be many others.

If you hit really the same, please:
1. add your insight on your systm setup related to sambe where the stale binaries/so's could come from in your case
2. try the workarounds to clean as described above and report if they helped in your case

If you are hitting a different issue on upgrade please report a new bug (https://help.ubuntu.com/community/ReportingBugs)