eglibc source tests are failing in Ubuntu 14.10 guest

[bugproxy]

---Problem Description---
eglibc source tests are failing in Ubuntu 14.10 guest

---uname output---
Linux ubuntu 3.16.0-12-generic #18-Ubuntu SMP Mon Sep 1 13:03:43 UTC 2014 ppc64le ppc64le ppc64le GNU/Linux

Machine Type = P8

---Steps to Reproduce---
Install a P8 system with Power KVM and then install Ubuntu 14.10 guest.
Then try to build and execute the eglibc source test suites as below.

root@ubuntu:~# apt-get source eglibc
root@ubuntu:~# cd eglibc-2.19/
root@ubuntu:~/eglibc-2.19# dpkg-buildpackage -b 2>&1 | tee eglibclog

#
# Testsuite failures, someone should be working towards
# fixing these! They are listed here for the purpose of
# regression testing during builds.
# Format: <Failed test>, Error <Make error code> [(ignored)]
#
annexc.out, Error 1 (ignored)
run-conformtest.out, Error 1 (ignored)
tst-cancelx17.out, Error 1
tst-cpuclock2.out, Error 1
***************
Encountered regressions that don't match expected failures (debian/testsuite-checking/expected-results-powerpc64le-linux-gnu-libc):
tst-cancelx17.out, Error 1
TEST tst-cancelx17.out:
going to cancel tf in-time
going to cancel tf2 in-time
in-time cancellation succeeded
aio_cancel failed
going to cancel tf early
going to cancel tf2 early
early cancellation succeeded
Encountered progressions that don't match expected failures:
check-localplt.out, Error 1
tst-cputimer1.out, Error 1
tst-mqueue5.out, Error 1
tst-waitid.out, Error 1
debian/rules.d/build.mk:123: recipe for target '/root/eglibc-2.19/stamp-dir/check_libc' failed
make: *** [/root/eglibc-2.19/stamp-dir/check_libc] Error 1
dpkg-buildpackage: error: debian/rules build gave error exit status 2

  tried the same steps in the provided VM (192.168.122.70) and dpkg-buildpackage -b completed fine.

ouch /root/eglibc-2.19/stamp-dir/binaryinst_libnss-files-udeb
 dpkg-genchanges -b >../eglibc_2.19-0ubuntu6_ppc64el.changes
dpkg-genchanges: warning: package locales in control file but not in files list
dpkg-genchanges: warning: package locales-all in control file but not in files list
dpkg-genchanges: binary-only upload (no source code included)
 dpkg-source --after-build eglibc-2.19
dpkg-source: info: using options from eglibc-2.19/debian/source/options: --compression=xz
dpkg-buildpackage: binary-only upload (no source included)
root@ubuntu:~/eglibc-2.19#

Hi Rajalakshmi,

If you grep for "Testsuite failures" in the eglibclog file, you get the below failures listed.

#
# Testsuite failures, someone should be working towards
# fixing these! They are listed here for the purpose of
# regression testing during builds.
# Format: <Failed test>, Error <Make error code> [(ignored)]
#
annexc.out, Error 1 (ignored)
run-conformtest.out, Error 1 (ignored)
tst-cpuclock2.out, Error 1
***************
Passed regression testing. No new failures, no changed error values.
TEST annexc.out:
The following identifiers will be ignored since the compiler defines them
by default:
pixel
bool
vector
unix
linux
Tested files:
=== aio.h ===
* invalid macro `SIGEV_THREAD_ID'
* invalid macro `sigev_notify_function'
* invalid macro `sigev_notify_attributes'
** macro `FD_CLOEXEC' not defined
** macro `F_DUPFD' not defined
** macro `F_GETFD' not defined
** macro `F_GETFL' not defined
** macro `F_GETLK' not defined
** macro `F_RDLCK' not defined
** macro `F_SETFD' not defined
** macro `F_SETFL' not defined
** macro `F_SETLK' not defined
** macro `F_SETLKW' not defined
** macro `F_UNLCK' not defined
** macro `F_WRLCK' not defined
** macro `O_ACCMODE' not defined
** macro `O_APPEND' not defined
** macro `O_CREAT' not defined
** macro `O_DSYNC' not defined
** macro `O_EXCL' not defined
** macro `O_NOCTTY' not defined
** macro `O_NONBLOCK' not defined
** macro `O_RDONLY' not defined
** macro `O_RDWR' not defined
** macro `O_RSYNC' not defined
** macro `O_SYNC' not defined
** macro `O_TRUNC' not defined
** macro `O_WRONLY' not defined
** macro `SA_NOCLDSTOP' not defined
** macro `SA_SIGINFO' not defined
** macro `SIGABRT' not defined
** macro `SIGALRM' not defined
** macro `SIGBUS' not defined
** macro `SIGCHLD' not defined
** macro `SIGCONT' not defined
** macro `SIGEV_SIGNAL' not defined
** macro `SIGFPE' not defined
** macro `SIGHUP' not defined
** macro `SIGILL' not defined
** macro `SIGINT' not defined
** macro `SIGKILL' not defined
** macro `SIGPIPE' not defined
** macro `SIGQUIT' not defined
** macro `SIGRTMAX' not defined
** macro `SIGSEGV' not defined
** macro `SIGSTOP' not defined
** macro `SIGTERM' not defined
** macro `SIGTSTP' not defined
** macro `SIGTTIN' not defined
** macro `SIGTTOU' not defined
** macro `SIGUSR1' not defined
** macro `SIGUSR2' not defined
** macro `SIG_BLOCK' not defined
** macro `SIG_DFL' not defined
** macro `SIG_ERR' not defined
** macro `SIG_IGN' not defined
** macro `SIG_SETMASK' not defined
** macro `SIG_UNBLOCK' not defined
** macro `SI_ASYNCIO' not defined
** macro `SI_MESGQ' not defined
** macro `SI_QUEUE' not defined
** macro `SI_TIMER' not defined
** macro `SI_USER' not defined
=== assert.h ===
=== ctype.h ===
=== dirent.h ===
* invalid macro `d_fileno'
=== errno.h ===
=== fcntl.h ===
* invalid macro `F_EXLCK'
* invalid macro `O_NDELAY'
* invalid macro `O_FSYNC'
* invalid macro `F_SHLCK'
* invalid macro `F_SETLKW64'
* invalid macro `F_SETLK64'
* invalid macro `O_ASYNC'
* invalid macro `F_GETLK64'
** macro `O_DSYNC' not defined
** macro `O_RSYNC' not defined
=== float.h ===
=== grp.h ===
=== limits.h ===
* invalid macro `SSIZE_MAX'
* invalid macro `XATTR_SIZE_MAX'
* invalid macro `HOST_NAME_MAX'
* invalid macro `AIO_PRIO_DELTA_MAX'
* invalid macro `XATTR_LIST_MAX'
* invalid macro `TTY_NAME_MAX'
* invalid macro `SEM_VALUE_MAX'
* invalid macro `XATTR_NAME_MAX'
** macro `_POSIX_CLOCKRES_MAX' not defined
** macro `_POSIX_THREAD_DESTRUCTOR_ITERATIONS' not defined
** macro `PAGESIZE' not defined
=== locale.h ===
=== math.h ===
=== mqueue.h ===
* invalid macro `O_NOCTTY'
* invalid macro `O_ACCMODE'
* invalid macro `F_EXLCK'
* invalid macro `F_RDLCK'
* invalid macro `O_APPEND'
* invalid macro `F_GETLK'
* invalid macro `O_NDELAY'
* invalid macro `SIGEV_NONE'
* invalid macro `F_DUPFD'
* invalid macro `O_WRONLY'
* invalid macro `O_FSYNC'
* invalid macro `FD_CLOEXEC'
* invalid macro `O_NONBLOCK'
* invalid macro `F_UNLCK'
* invalid macro `F_SHLCK'
* invalid macro `F_GETFD'
* invalid macro `F_GETFL'
* invalid macro `F_SETLKW64'
* invalid macro `SIGEV_THREAD'
* invalid macro `O_RDWR'
* invalid macro `F_SETFL'
* invalid macro `F_SETLK'
* invalid macro `F_WRLCK'
* invalid macro `F_SETLK64'
* invalid macro `O_SYNC'
* invalid macro `SIGEV_THREAD_ID'
* invalid macro `O_CREAT'
* invalid macro `O_ASYNC'
* invalid macro `F_GETLK64'
* invalid macro `F_SETLKW'
* invalid macro `sigev_notify_function'
* invalid macro `O_RDONLY'
* invalid macro `O_TRUNC'
* invalid macro `SIGEV_SIGNAL'
* invalid macro `O_EXCL'
* invalid macro `sigev_notify_attributes'
* invalid macro `F_SETFD'
=== pthread.h ===
* invalid macro `sched_priority'
** macro `PTHREAD_PRIO_INHERIT' not defined
** macro `PTHREAD_PRIO_NONE' not defined
** macro `PTHREAD_PRIO_PROTECT' not defined
** macro `CLOCK_REALTIME' not defined
** macro `TIMER_ABSTIME' not defined
=== pwd.h ===
=== sched.h ===
* invalid macro `sched_priority'
=== semaphore.h ===
* invalid macro `SEM_FAILED'
=== setjmp.h ===
=== signal.h ===
* invalid macro `SIGPROF'
* invalid macro `SIGSTKFLT'
* invalid macro `SIGURG'
* invalid macro `SIGIO'
* invalid macro `SIGPOLL'
* invalid macro `SIGCLD'
* invalid macro `SIGTRAP'
* invalid macro `SIGVTALRM'
* invalid macro `SIGWINCH'
* invalid macro `SIGXFSZ'
* invalid macro `SIGSYS'
* invalid macro `SIGXCPU'
* invalid macro `SIGUNUSED'
* invalid macro `SIGPWR'
* invalid macro `SA_NOCLDWAIT'
* invalid macro `SIGIOT'
** macro `SIGEV_NONE' not defined
** macro `SIGEV_SIGNAL' not defined
** macro `SIGEV_THREAD' not defined
** macro `SI_ASYNCIO' not defined
** macro `SI_MESGQ' not defined
** macro `SI_QUEUE' not defined
** macro `SI_TIMER' not defined
** macro `SI_USER' not defined
=== stdarg.h ===
* invalid macro `va_copy'
=== stddef.h ===
=== stdio.h ===
** macro `STREAM_MAX' not defined
=== stdlib.h ===
=== string.h ===
=== sys/mman.h ===
* invalid macro `PROT_GROWSDOWN'
* invalid macro `PROT_GROWSUP'
* invalid macro `PROT_SAO'
=== sys/stat.h ===
* invalid macro `S_ISLNK'
** macro `S_TYPEISMQ' not defined
** macro `S_TYPEISSEM' not defined
** macro `S_TYPEISSHM' not defined
=== sys/times.h ===
=== sys/types.h ===
=== sys/utsname.h ===
=== sys/wait.h ===
* invalid macro `SIGBUS'
* invalid macro `SIGTTIN'
* invalid macro `SIGTTOU'
* invalid macro `SIGPROF'
* invalid macro `SIGALRM'
* invalid macro `SIGFPE'
* invalid macro `SIGSTKFLT'
* invalid macro `SIGUSR1'
* invalid macro `SA_SIGINFO'
* invalid macro `WSTOPPED'
* invalid macro `WCONTINUED'
* invalid macro `SIGURG'
* invalid macro `SIGIO'
* invalid macro `SIGQUIT'
* invalid macro `SIGPOLL'
* invalid macro `SIGCLD'
* invalid macro `WIFCONTINUED'
* invalid macro `SIGABRT'
* invalid macro `SIG_BLOCK'
* invalid macro `WEXITED'
* invalid macro `SIGTRAP'
* invalid macro `SIGVTALRM'
* invalid macro `SIG_UNBLOCK'
* invalid macro `SIGSEGV'
* invalid macro `SIG_DFL'
* invalid macro `SIGCONT'
* invalid macro `SIGPIPE'
* invalid macro `SIGWINCH'
* invalid macro `SIGXFSZ'
* invalid macro `SIGHUP'
* invalid macro `SIGRTMAX'
* invalid macro `SIGCHLD'
* invalid macro `SIGSYS'
* invalid macro `SIGSTOP'
* invalid macro `SA_NOCLDSTOP'
* invalid macro `SIGRTMIN'
* invalid macro `WNOWAIT'
* invalid macro `SIGUSR2'
* invalid macro `SIGTSTP'
* invalid macro `SIGKILL'
* invalid macro `SIGXCPU'
* invalid macro `SIGUNUSED'
* invalid macro `SIGPWR'
* invalid macro `SIG_ERR'
* invalid macro `SA_NOCLDWAIT'
* invalid macro `SIGILL'
* invalid macro `SIGINT'
* invalid macro `SIGIOT'
* invalid macro `SIG_IGN'
* invalid macro `SIGTERM'
* invalid macro `SIG_SETMASK'
=== termios.h ===
* invalid macro `VSWTC'
* invalid macro `OFILL'
* invalid macro `N_X25'
* invalid macro `TIOCM_CAR'
* invalid macro `TIOCPKT_FLUSHWRITE'
* invalid macro `N_TTY'
* invalid macro `INLCR'
* invalid macro `TIOCM_CTS'
* invalid macro `N_SMSBLOCK'
* invalid macro `VWERASE'
* invalid macro `VTDLY'
* invalid macro `IUCLC'
* invalid macro `TIOCM_RNG'
* invalid macro `B230400'
* invalid macro `TIOCM_RTS'
* invalid macro `NCC'
* invalid macro `B576000'
* invalid macro `B460800'
* invalid macro `N_STRIP'
* invalid macro `N_MASC'
* invalid macro `N_6PACK'
* invalid macro `TIOCPKT_STOP'
* invalid macro `TIOCM_DSR'
* invalid macro `ONLRET'
* invalid macro `TIOCM_DTR'
* invalid macro `B2500000'
* invalid macro `B500000'
* invalid macro `B3000000'
* invalid macro `TIOCPKT_NOSTOP'
* invalid macro `B1000000'
* invalid macro `OCRNL'
* invalid macro `VLNEXT'
* invalid macro `TIOCPKT_DOSTOP'
* invalid macro `IMAXBEL'
* invalid macro `IUTF8'
* invalid macro `VT0'
* invalid macro `VT1'
* invalid macro `B115200'
* invalid macro `VDISCARD'
* invalid macro `TIOCPKT_START'
* invalid macro `N_SYNC_PPP'
* invalid macro `OLCUC'
* invalid macro `TCION'
* invalid macro `OFDEL'
* invalid macro `N_R3964'
* invalid macro `ONLCR'
* invalid macro `N_AX25'
* invalid macro `B57600'
* invalid macro `IXANY'
* invalid macro `TIOCPKT_FLUSHREAD'
* invalid macro `ONOCR'
* invalid macro `N_HCI'
* invalid macro `N_PROFIBUS_FDL'
* invalid macro `VREPRINT'
* invalid macro `VEOL2'
* invalid macro `N_HDLC'
* invalid macro `TIOCM_CD'
* invalid macro `N_MOUSE'
* invalid macro `TIOCPKT_DATA'
* invalid macro `TIOCM_LE'
* invalid macro `B1152000'
* invalid macro `TIOCM_RI'
* invalid macro `TIOCM_SR'
* invalid macro `TIOCM_ST'
* invalid macro `B921600'
* invalid macro `B3500000'
* invalid macro `B4000000'
* invalid macro `B1500000'
* invalid macro `B2000000'
* invalid macro `N_SLIP'
* invalid macro `TIOCSER_TEMT'
* invalid macro `CSTOPB'
* invalid macro `N_PPP'
* invalid macro `N_IRDA'
** macro `CSTOPN' not defined
** macro `INCLR' not defined
=== time.h ===
** macro `CLOCK_REALTIME' not defined
** macro `TIMER_ABSTIME' not defined
=== unistd.h ===
=== utime.h ===
TEST run-conformtest.out:

ISO
----------------------------------------------------------------------------
  Total number of tests : 722
  Number of failed tests : 0 ( 0%)
  Number of skipped tests : 0 ( 0%)

ISO99
----------------------------------------------------------------------------
  Total number of tests : 2944
  Number of failed tests : 1 ( <1%)
  Number of skipped tests : 0 ( 0%)

ISO11
----------------------------------------------------------------------------
  Total number of tests : 3034
  Number of failed tests : 1 ( <1%)
  Number of skipped tests : 0 ( 0%)

POSIX
----------------------------------------------------------------------------
  Total number of tests : 2585
  Number of failed tests : 50 ( 1%)
  Number of skipped tests : 37 ( 1%)

XPG3
----------------------------------------------------------------------------
  Total number of tests : 3872
  Number of failed tests : 185 ( 4%)
  Number of skipped tests : 91 ( 2%)

XPG4
----------------------------------------------------------------------------
  Total number of tests : 4054
  Number of failed tests : 49 ( 1%)
  Number of skipped tests : 12 ( <1%)

UNIX98
----------------------------------------------------------------------------
  Total number of tests : 4709
  Number of failed tests : 83 ( 1%)
  Number of skipped tests : 50 ( 1%)

XOPEN2K
----------------------------------------------------------------------------
  Total number of tests : 6746
  Number of failed tests : 31 ( <1%)
  Number of skipped tests : 7 ( <1%)
XOPEN2K8
----------------------------------------------------------------------------
  Total number of tests : 7004
  Number of failed tests : 28 ( <1%)
  Number of skipped tests : 3 ( <1%)

POSIX2008
----------------------------------------------------------------------------
  Total number of tests : 6275
  Number of failed tests : 13 ( <1%)
  Number of skipped tests : 1 ( <1%)
TEST tst-cpuclock2.out:
live thread clock fffffffffffe468e resolution 0.000000001
live thread before sleep => 0.003797588
self thread before sleep => 0.000502100
live thread after sleep => 0.503799880
self thread after sleep => 0.000525302
absolute clock_nanosleep on PROCESS_CPUTIME_ID 18446744073709538792 past target (outside reasonable range)
absolute clock_nanosleep on PROCESS_CPUTIME_ID slept 99987176 (outside reasonable range)
Encountered progressions that don't match expected failures:
check-localplt.out, Error 1
tst-cputimer1.out, Error 1
tst-mqueue5.out, Error 1
tst-waitid.out, Error 1
***************
TEST SUMMARY build-tree/log-test-powerpc64le-linux-gnu-libc (5 matching lines)
make[3]: [/root/eglibc-2.19/build-tree/ppc64el-libc/posix/annexc.out] Error 1 (ignored)
make[3]: *** [/root/eglibc-2.19/build-tree/ppc64el-libc/rt/tst-cpuclock2.out] Error 1
make[2]: *** [rt/tests] Error 2
make[3]: [/root/eglibc-2.19/build-tree/ppc64el-libc/conform/run-conformtest.out] Error 1 (ignored)
make[1]: *** [check] Error 2
END TEST SUMMARY build-tree/log-test-powerpc64le-linux-gnu-libc

[bugproxy (bugproxy)]

------- Comment From <email address hidden> 2014-09-17 09:47 EDT-------
Looking at the log file, there are three failures.
annexc.out, Error 1 (ignored)
run-conformtest.out, Error 1 (ignored)
tst-cpuclock2.out, Error 1

And all these are present at expected failures list. (Check file eglibc-2.19/debian/testsuite-checking/expected-results-powerpc64le-linux-gnu-libc)

The following lines are present in eglibclog, because it is diff output between expected and actual results.
These are present at expected failures but they have actually passed which is not an issue.

check-localplt.out, Error 1
tst-cputimer1.out, Error 1
tst-mqueue5.out, Error 1
tst-waitid.out, Error 1

The following diff output is what we see in the eglibclog.
root@ubuntu:~/eglibc-2.19# diff ./build-tree/test-results-powerpc64le-linux-gnu-libc ./debian/testsuite-checking/expected-results-powerpc64le-linux-gnu-libc
2,4c2,3
< # Testsuite failures, someone should be working towards
< # fixing these! They are listed here for the purpose of
< # regression testing during builds.
---
> # Allowed failures for powerpc64le-linux-gnu-libc and the returned make
> # failure number, indicating the signal the process died with.
7a7
> check-localplt.out, Error 1
9a10,12
> tst-cputimer1.out, Error 1
> tst-mqueue5.out, Error 1
> tst-waitid.out, Error 1

Hence there are no new failures other than expected.