stackonexec, stackprofile in test_regression_testsuite from ubuntu_qrt_apparmor failed with J-oem-6.0

[Po-Hsu Lin]

Issue found with J-OEM-6.0.0-1007.7

stackonexec from ApparmorTestsuites.test_regression_testsuite failed with:
Error: transition failed. Test 'STACKONEXEC (stacked with unconfined - file)' was expected to 'fail'. Reason for failure expect errno 13 != 0

Code: https://git.launchpad.net/ubuntu/+source/apparmor/tree/tests/regression/apparmor/stackonexec.sh?h=ubuntu/focal-devel#n70

stackprofile from ApparmorTestsuites.test_regression_testsuite failed with:
Error: transition failed. Test 'STACKPROFILE (stacked with unconfined - file)' was expected to 'fail'. Reason for failure expect errno 13 != 0

Code: https://git.launchpad.net/ubuntu/+source/apparmor/tree/tests/regression/apparmor/stackprofile.sh?h=ubuntu/focal-devel#n69

Test output from ubuntu_qrt_apparmor:
Running test: './test-apparmor.py' distro: 'Ubuntu 22.04' kernel: '6.0.0-1007.7 (Ubuntu 6.0.0-1007.7-oem 6.0.3)' arch: 'amd64' uid: 0/0 SUDO_USER: 'ubuntu')
Skipping private tests
test_regression_testsuite (__main__.ApparmorTestsuites)
Run kernel regression tests ... /home/ubuntu/qa-regression-testing/scripts/./test-apparmor.py:1546: ResourceWarning: unclosed file <_io.TextIOWrapper name='/proc/sys/kernel/yama/ptrace_scope' mode='r' encoding='UTF-8'>
  self.orig_ptrace = open(self.yama_ptrace_scope).read().splitlines()[0]
ResourceWarning: Enable tracemalloc to get the object allocation traceback

  preparing apparmor_3.0.4-2ubuntu2.1.dsc... done

 (disabling ptrace for this test)
FAIL

======================================================================
FAIL: test_regression_testsuite (__main__.ApparmorTestsuites)
Run kernel regression tests
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ubuntu/qa-regression-testing/scripts/./test-apparmor.py", line 1835, in test_regression_testsuite
    self.assertEqual(expected, rc, result + report)
AssertionError: 0 != 2 : Got exit code 2, expected 0

running aa_exec

running access
xfail: ACCESS file rx (r)
xfail: ACCESS file rwx (r)
xfail: ACCESS file r (wx)
xfail: ACCESS file rx (wx)
xfail: ACCESS file rwx (wx)
xfail: ACCESS dir rwx (r)
xfail: ACCESS dir r (wx)
xfail: ACCESS dir rx (wx)
xfail: ACCESS dir rwx (wx)

running at_secure

running introspect

running capabilities
        (ptrace)
        (sethostname)
        (setdomainname)
        (setpriority)
        (setscheduler)
        (reboot)
        (chroot)
        (mlockall)
        (net_raw)
        (ioperm)
        (iopl)

running changeprofile

running onexec

running changehat

running changehat_fork

running changehat_misc

*** A 'Killed' message from bash is expected for the following test
/tmp/testlibce7nm5kp/source/jammy/apparmor-3.0.4/tests/regression/apparmor/prologue.inc: line 264: 45121 Killed $testexec "$@" > $outfile 2>&1

*** A 'Killed' message from bash is expected for the following test
/tmp/testlibce7nm5kp/source/jammy/apparmor-3.0.4/tests/regression/apparmor/prologue.inc: line 264: 45157 Killed $testexec "$@" > $outfile 2>&1

running chdir

running clone

running coredump
*** A 'Segmentation Fault' message from bash is expected for the following test
/tmp/testlibce7nm5kp/source/jammy/apparmor-3.0.4/tests/regression/apparmor/prologue.inc: line 264: 45423 Segmentation fault (core dumped) $testexec "$@" > $outfile 2>&1

*** A 'Segmentation Fault' message from bash is expected for the following test
/tmp/testlibce7nm5kp/source/jammy/apparmor-3.0.4/tests/regression/apparmor/prologue.inc: line 264: 45455 Segmentation fault $testexec "$@" > $outfile 2>&1

*** A 'Segmentation Fault' message from bash is expected for the following test
/tmp/testlibce7nm5kp/source/jammy/apparmor-3.0.4/tests/regression/apparmor/prologue.inc: line 264: 45493 Segmentation fault $testexec "$@" > $outfile 2>&1

*** A 'Segmentation Fault' message from bash is expected for the following test
/tmp/testlibce7nm5kp/source/jammy/apparmor-3.0.4/tests/regression/apparmor/prologue.inc: line 264: 45531 Segmentation fault $testexec "$@" > $outfile 2>&1

*** A 'Segmentation Fault' message from bash is expected for the following test
/tmp/testlibce7nm5kp/source/jammy/apparmor-3.0.4/tests/regression/apparmor/prologue.inc: line 264: 45569 Segmentation fault $testexec "$@" > $outfile 2>&1
XFAIL: Error: corefile present when not expected -- COREDUMP (ix confinement)

running deleted

running environ

running exec

running exec_qual

running fchdir

running fd_inheritance

running fork

running i18n

running link

running link_subset

running mkdir

running mmap

running mount
    using mount rules ...

running mult_mount

running named_pipe

running namespaces

running net_raw

running open

running openat

running pipe

running pivot_root
 kernel does not support pivot_root domain transitions - skipping tests ...

running ptrace
   using ptrace v6 tests ...

running pwrite

running query_label

running regex

running rename

running readdir

running rw

running socketpair

running swap

running sd_flags

running setattr

running symlink

running syscall
 WARNING: syscall sysctl not supported by kernel headers, skipping tests ...

running tcp

running unix_fd_server

running unix_socket_pathname
xpass: AF_UNIX pathname socket (dgram); confined server w/ access (rw)
xpass: AF_UNIX pathname socket (dgram); confined client w/ access (rw)

running unix_socket_abstract

running unix_socket_unnamed
xpass: AF_UNIX unnamed socket (dgram); confined server (peer label w/ implicit perms)
xpass: AF_UNIX unnamed socket (dgram); confined server (peer label w/ explicit perms)
xpass: AF_UNIX unnamed socket (dgram); confined server (peer label, peer addr)
xpass: AF_UNIX unnamed socket (dgram); confined server (type, peer label, peer addr)
xpass: AF_UNIX unnamed socket (dgram); confined server (type, addr, peer label)
xpass: AF_UNIX unnamed socket (dgram); confined server (type, addr, peer label, peer addr)

running unix_socket_autobind

running unlink

running xattrs
Required feature 'file/xattr' not available.. Skipping tests ...

running xattrs_profile

running longpath
XFAIL: This version of AppArmor does not support changing buffer size.

running dbus_eavesdrop

running dbus_message

running dbus_service

running dbus_unrequested_reply

running aa_policy_cache

running exec_stack

running nnp

running stackonexec
Error: transition failed. Test 'STACKONEXEC (stacked with unconfined - file)' was expected to 'fail'. Reason for failure expect errno 13 != 0

running stackprofile
Error: transition failed. Test 'STACKPROFILE (stacked with unconfined - file)' was expected to 'fail'. Reason for failure expect errno 13 != 0
make: *** [Makefile:342: tests] Error 1

----------------------------------------------------------------------
Ran 1 test in 585.897s

FAILED (failures=1)

This is not a regression, this failure can be found with older kernel (6.0.0-1004.4) as well.