ubuntu_lttng_smoke_test failed on Xenial zVM

Bug #1744270 reported by Po-Hsu Lin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Invalid
Medium
Colin Ian King

Bug Description

This test failed with the proposed Xenial kernel 4.4.0-111.134 on zVM

It's not a regression since this can be reproduced with the older 4.4.0-108 on the very same node.

Command returned non-zero exit status
  * Command:
      /home/ubuntu/autotest/client/tests/ubuntu_lttng_smoke_test/ubuntu_lttng_s
      moke_test.sh
  Exit status: 1
  Duration: 0.447135210037

  stdout:
  == lttng smoke test of session create/destroy ==
  Spawning a session daemon
  Session test-kernel-session created.
  Traces will be written in /tmp/lttng-kernel-trace-32862-session
  PASSED (lttng create)
  Session test-kernel-session destroyed
  PASSED (lttng destroy)

  == lttng smoke test list kernel events ==
  FAILED (lttng list --kernel)
  FAILED (lttng list --kernel more output expected)

  lttng smoke test trace open/close system calls SKIPPED for s390x

  == lttng smoke test trace context switches ==
  Session test-kernel-session created.
  Traces will be written in /tmp/lttng-kernel-trace-32862-session
  PASSED (lttng create)
  FAILED (lttng enable-event)
  Session test-kernel-session destroyed

  Summary: 3 passed, 3 failed
  stderr:
  Error: Unable to list kernel events: Kernel tracer not available
  Error: Command error
  Error: Event sched_switch: Kernel tracer not available (channel channel0, session test-kernel-session)

ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-image-4.4.0-111-generic 4.4.0-111.134
ProcVersionSignature: Ubuntu 4.4.0-111.134-generic 4.4.98
Uname: Linux 4.4.0-111-generic s390x
AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access '/dev/snd/': No such file or directory
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.1-0ubuntu2.15
Architecture: s390x
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
CRDA: Error: command ['iw', 'reg', 'get'] failed with exit code 1: nl80211 not found.
CurrentDmesg:

Date: Fri Jan 19 05:11:39 2018
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
Lspci:

Lsusb: Error: command ['lsusb'] failed with exit code 1:
PciMultimedia:

ProcEnviron:
 TERM=xterm-256color
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=C
 SHELL=/bin/bash
ProcFB: Error: [Errno 2] No such file or directory: '/proc/fb'
ProcKernelCmdLine: root=UUID=44b0b919-a1a4-4849-9425-e71d4ac87d85 crashkernel=196M nogmb BOOT_IMAGE=0
RelatedPackageVersions:
 linux-restricted-modules-4.4.0-111-generic N/A
 linux-backports-modules-4.4.0-111-generic N/A
 linux-firmware 1.157.15
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)

Revision history for this message
Po-Hsu Lin (cypressyew) wrote :
Po-Hsu Lin (cypressyew)
description: updated
Po-Hsu Lin (cypressyew)
Changed in linux (Ubuntu):
assignee: nobody → Colin Ian King (colin-king)
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote : Missing required logs.

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1744270

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

Changed in linux (Ubuntu):
status: New → Incomplete
Changed in linux (Ubuntu):
status: Incomplete → In Progress
importance: Undecided → Medium
Revision history for this message
Colin Ian King (colin-king) wrote :

Hi, I still can't reproduce this issue.

ubuntu@s2lp3:~/cking$ uname -a
Linux s2lp3 4.4.0-111-generic #134-Ubuntu SMP Mon Jan 15 14:49:29 UTC 2018 s390x s390x s390x GNU/Linux

sudo autotest/client/autotest-local autotest/client/tests/ubuntu_lttng_smoke_test/control
04:40:32 INFO | Writing results to /home/ubuntu/cking/autotest/client/results/default
04:40:32 INFO | START ---- ---- timestamp=1517218832 localtime=Jan 29 04:40:32
04:40:32 INFO | START ubuntu_lttng_smoke_test.lttng-smoke-test ubuntu_lttng_smoke_test.lttng-smoke-test timestamp=1517218832 localtime=Jan 29 04:40:32
04:40:39 ERROR| [stderr] [warning] Tracer discarded 2940 events between [04:40:36.265199305] and [04:40:36.359210703] in trace UUID d1adcb8ecc1bda4a859c29b06b87f76, at path: "/tmp/lttng-kernel-trace-3437-session/kernel", within stream id 0, at relative path: "channel0_1". You should consider recording a new trace with larger buffers or with fewer events enabled.
04:40:40 INFO | == lttng smoke test of session create/destroy ==
04:40:40 INFO | Spawning a session daemon
04:40:40 INFO | Session test-kernel-session created.
04:40:40 INFO | Traces will be written in /tmp/lttng-kernel-trace-3437-session
04:40:40 INFO | PASSED (lttng create)
04:40:40 INFO | Session test-kernel-session destroyed
04:40:40 INFO | PASSED (lttng destroy)
04:40:40 INFO |
04:40:40 INFO | == lttng smoke test list kernel events ==
04:40:40 INFO | PASSED (lttng list --kernel)
04:40:40 INFO |
04:40:40 INFO | lttng smoke test trace open/close system calls SKIPPED for s390x
04:40:40 INFO |
04:40:40 INFO | == lttng smoke test trace context switches ==
04:40:40 INFO | Session test-kernel-session created.
04:40:40 INFO | Traces will be written in /tmp/lttng-kernel-trace-3437-session
04:40:40 INFO | PASSED (lttng create)
04:40:40 INFO | Kernel event sched_switch created in channel channel0
04:40:40 INFO | PASSED (lttng enable-event)
04:40:40 INFO | Tracing started for session test-kernel-session
04:40:40 INFO | PASSED (lttng start)
04:40:40 INFO | Waiting for data availability.
04:40:40 INFO | Tracing stopped for session test-kernel-session
04:40:40 INFO | PASSED (lttng stop)
04:40:40 INFO | Session test-kernel-session destroyed
04:40:40 INFO | PASSED (lttng destroy)
04:40:40 INFO | Found 19021 dd and 73933 context switches
04:40:40 INFO | PASSED (simple system call tracing with babeltrace)
04:40:40 INFO |
04:40:40 INFO | Summary: 8 passed, 0 failed
04:40:40 INFO | GOOD ubuntu_lttng_smoke_test.lttng-smoke-test ubuntu_lttng_smoke_test.lttng-smoke-test timestamp=1517218840 localtime=Jan 29 04:40:40 completed successfully
04:40:40 INFO | END GOOD ubuntu_lttng_smoke_test.lttng-smoke-test ubuntu_lttng_smoke_test.lttng-smoke-test timestamp=1517218840 localtime=Jan 29 04:40:40
04:40:40 INFO | END GOOD ---- ---- timestamp=1517218840 localtime=Jan 29 04:40:40
04:40:40 INFO | Report successfully generated at /home/ubuntu/cking/autotest/client/results/default/job_report.html

Revision history for this message
Frank Heimes (fheimes) wrote :

colin-king, the name of your system (s2lp3) lets me assume that you are running Ubuntu on LPAR rather than on z/VM.
I assume (and according to the title) this issue is on z/VM guests (only?).

Revision history for this message
Colin Ian King (colin-king) wrote :

Could be, I'll double check that tomorrow morning.

Revision history for this message
Po-Hsu Lin (cypressyew) wrote :

Sorry I should add the hostname here to make it easier to identify the affected one.
Colin, I have your key imported to the affected system.
Thanks

Revision history for this message
Colin Ian King (colin-king) wrote :
Download full text (3.2 KiB)

ubuntu@kernel01:~/cking$ uname -a
Linux kernel01 4.4.0-112-generic #135-Ubuntu SMP Fri Jan 19 11:48:07 UTC 2018 s390x s390x s390x GNU/Linux

Looks like the modules weren't built for the kernel. I tried the 4.4.0-112-generic and it works fine after re-installing the dkms modules:

ubuntu@kernel01:~/cking$ sudo apt-get install --reinstall lttng-modules-dkms

ubuntu@kernel01:~/cking$ sudo autotest/client/autotest-local autotest/client/tests/ubuntu_lttng_smoke_test/control
04:21:01 INFO | Writing results to /home/ubuntu/cking/autotest/client/results/default
04:21:01 INFO | START ---- ---- timestamp=1517304061 localtime=Jan 30 04:21:01
04:21:01 INFO | START ubuntu_lttng_smoke_test.lttng-smoke-test ubuntu_lttng_smoke_test.lttng-smoke-test timestamp=1517304061 localtime=Jan 30 04:21:01
04:21:08 ERROR| [stderr] [warning] Tracer discarded 18895 events between [04:21:04.967791464] and [04:21:05.094587794] in trace UUID edc5397baa392f43a990cbcc29bb2f82, at path: "/tmp/lttng-kernel-trace-36474-session/kernel", within stream id 0, at relative path: "channel0_3". You should consider recording a new trace with larger buffers or with fewer events enabled.
04:21:08 ERROR| [stderr] [warning] Tracer discarded 19530 events between [04:21:05.163582941] and [04:21:05.294597778] in trace UUID edc5397baa392f43a990cbcc29bb2f82, at path: "/tmp/lttng-kernel-trace-36474-session/kernel", within stream id 0, at relative path: "channel0_3". You should consider recording a new trace with larger buffers or with fewer events enabled.
04:21:08 INFO | == lttng smoke test of session create/destroy ==
04:21:08 INFO | Session test-kernel-session created.
04:21:08 INFO | Traces will be written in /tmp/lttng-kernel-trace-36474-session
04:21:08 INFO | PASSED (lttng create)
04:21:08 INFO | Session test-kernel-session destroyed
04:21:08 INFO | PASSED (lttng destroy)
04:21:08 INFO |
04:21:08 INFO | == lttng smoke test list kernel events ==
04:21:08 INFO | PASSED (lttng list --kernel)
04:21:08 INFO |
04:21:08 INFO | lttng smoke test trace open/close system calls SKIPPED for s390x
04:21:08 INFO |
04:21:08 INFO | == lttng smoke test trace context switches ==
04:21:08 INFO | Session test-kernel-session created.
04:21:08 INFO | Traces will be written in /tmp/lttng-kernel-trace-36474-session
04:21:08 INFO | PASSED (lttng create)
04:21:08 INFO | Kernel event sched_switch created in channel channel0
04:21:08 INFO | PASSED (lttng enable-event)
04:21:08 INFO | Tracing started for session test-kernel-session
04:21:08 INFO | PASSED (lttng start)
04:21:08 INFO | Waiting for data availability.
04:21:08 INFO | Tracing stopped for session test-kernel-session
04:21:08 INFO | PASSED (lttng stop)
04:21:08 INFO | Session test-kernel-session destroyed
04:21:08 INFO | PASSED (lttng destroy)
04:21:08 INFO | Found 81105 dd and 95334 context switches
04:21:08 INFO | PASSED (simple system call tracing with babeltrace)
04:21:08 INFO |
04:21:08 INFO | Summary: 8 passed, 0 failed
04:21:08 INFO | GOOD ubuntu_lttng_smoke_test.lttng-smoke-test ubuntu_lttng_smoke_test.lttng-smoke-test timestamp=1517304068 localtime=Jan 30 04:21:08 completed successfully
04:21:08 INFO | END GOOD ubuntu_lttng_smoke_test.l...

Read more...

Revision history for this message
Colin Ian King (colin-king) wrote :
Download full text (3.2 KiB)

And for 4.4.0-111 too:

ubuntu@kernel01:~/cking$ uname -a
Linux kernel01 4.4.0-111-generic #134-Ubuntu SMP Mon Jan 15 14:49:29 UTC 2018 s390x s390x s390x GNU/Linux
ubuntu@kernel01:~/cking$ sudo autotest/client/autotest-local autotest/client/tests/ubuntu_lttng_smoke_test/control
04:31:41 INFO | Writing results to /home/ubuntu/cking/autotest/client/results/default
04:31:41 INFO | START ---- ---- timestamp=1517304701 localtime=Jan 30 04:31:41
04:31:41 INFO | START ubuntu_lttng_smoke_test.lttng-smoke-test ubuntu_lttng_smoke_test.lttng-smoke-test timestamp=1517304701 localtime=Jan 30 04:31:41
04:31:46 ERROR| [stderr] [warning] Tracer discarded 4316 events between [04:31:43.716983490] and [04:31:43.786991226] in trace UUID 92f5c9ff926f97469351d5fcfe55d3f, at path: "/tmp/lttng-kernel-trace-3597-session/kernel", within stream id 0, at relative path: "channel0_6". You should consider recording a new trace with larger buffers or with fewer events enabled.
04:31:47 ERROR| [stderr] [warning] Tracer discarded 828 events between [04:31:44.119735735] and [04:31:44.189824803] in trace UUID 92f5c9ff926f97469351d5fcfe55d3f, at path: "/tmp/lttng-kernel-trace-3597-session/kernel", within stream id 0, at relative path: "channel0_3". You should consider recording a new trace with larger buffers or with fewer events enabled.
04:31:47 INFO | == lttng smoke test of session create/destroy ==
04:31:47 INFO | Session test-kernel-session created.
04:31:47 INFO | Traces will be written in /tmp/lttng-kernel-trace-3597-session
04:31:47 INFO | PASSED (lttng create)
04:31:47 INFO | Session test-kernel-session destroyed
04:31:47 INFO | PASSED (lttng destroy)
04:31:47 INFO |
04:31:47 INFO | == lttng smoke test list kernel events ==
04:31:47 INFO | PASSED (lttng list --kernel)
04:31:47 INFO |
04:31:47 INFO | lttng smoke test trace open/close system calls SKIPPED for s390x
04:31:47 INFO |
04:31:47 INFO | == lttng smoke test trace context switches ==
04:31:47 INFO | Session test-kernel-session created.
04:31:47 INFO | Traces will be written in /tmp/lttng-kernel-trace-3597-session
04:31:47 INFO | PASSED (lttng create)
04:31:47 INFO | Kernel event sched_switch created in channel channel0
04:31:47 INFO | PASSED (lttng enable-event)
04:31:47 INFO | Tracing started for session test-kernel-session
04:31:47 INFO | PASSED (lttng start)
04:31:47 INFO | Waiting for data availability.
04:31:47 INFO | Tracing stopped for session test-kernel-session
04:31:47 INFO | PASSED (lttng stop)
04:31:47 INFO | Session test-kernel-session destroyed
04:31:47 INFO | PASSED (lttng destroy)
04:31:47 INFO | Found 30808 dd and 59265 context switches
04:31:47 INFO | PASSED (simple system call tracing with babeltrace)
04:31:47 INFO |
04:31:47 INFO | Summary: 8 passed, 0 failed
04:31:47 INFO | GOOD ubuntu_lttng_smoke_test.lttng-smoke-test ubuntu_lttng_smoke_test.lttng-smoke-test timestamp=1517304707 localtime=Jan 30 04:31:47 completed successfully
04:31:47 INFO | END GOOD ubuntu_lttng_smoke_test.lttng-smoke-test ubuntu_lttng_smoke_test.lttng-smoke-test timestamp=1517304707 localtime=Jan 30 04:31:47
04:31:47 INFO | END GOOD ---- ---- timestamp=1517304707 localtime=Jan 30 04:31:47
04:31:47 INFO | R...

Read more...

Revision history for this message
Colin Ian King (colin-king) wrote :

@Sam, any ideas? Can you re-test this and ensure the dkms modules are installed with the headers if the test fails?

Revision history for this message
Po-Hsu Lin (cypressyew) wrote :

Hi Colin,
not sure why the kernel didn't get installed at the very beginning.

I will keep an eye on this for the next SRU cycle, if nothing happens I will close this bug.

Thanks for your time!

Changed in linux (Ubuntu):
status: In Progress → Triaged
Revision history for this message
Colin Ian King (colin-king) wrote :

@Sam, are we able to test this again and see if it still fails?

Revision history for this message
Po-Hsu Lin (cypressyew) wrote :

Xenial (zVM) kernel01 has passed with this test in this cycle (4.4.0-117.141).
03/15 00:52:44 INFO |ubuntu_ltt:0033| Summary: 8 passed, 0 failed
Thanks

Changed in linux (Ubuntu):
status: Triaged → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.