tracing doesn't work on focal

Bug #1862708 reported by Seth Arnold
16
This bug affects 2 people
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Fix Released
Undecided
Unassigned
perf-tools-unstable (Ubuntu)
Confirmed
Undecided
Unassigned

Bug Description

Hello, while investigating bug 1861359 I tried to use kprobe-perf to troubleshoot and found that tracing doesn't work on focal:

# kprobe-perf -s 'p:shrink_node'
ERROR: func shrink_node not in /sys/kernel/debug/tracing/available_filter_functions.
Either it doesn't exist, or, it might be unsafe to kprobe. Exiting. Use -F to override.
# ls -l /sys/kernel/debug/tracing/available_filter_functions
ls: cannot access '/sys/kernel/debug/tracing/available_filter_functions': No such file or directory
# find /sys/kernel/debug/tracing
/sys/kernel/debug/tracing
/sys/kernel/debug/tracing/instances
/sys/kernel/debug/tracing/trace_stat
/sys/kernel/debug/tracing/per_cpu
/sys/kernel/debug/tracing/per_cpu/cpu7
/sys/kernel/debug/tracing/per_cpu/cpu6
/sys/kernel/debug/tracing/per_cpu/cpu5
/sys/kernel/debug/tracing/per_cpu/cpu4
/sys/kernel/debug/tracing/per_cpu/cpu3
/sys/kernel/debug/tracing/per_cpu/cpu2
/sys/kernel/debug/tracing/per_cpu/cpu1
/sys/kernel/debug/tracing/per_cpu/cpu0
/sys/kernel/debug/tracing/options

I'm guessing this is due to lockdown:

# dmesg | grep -C2 -i lockdown
[ 0.000000] efi: TPMFinalLog=0x9ff92000 SMBIOS=0x9f05d000 SMBIOS 3.0=0x9f05a000 ACPI=0x9fffe000 ACPI 2.0=0x9fffe014 ESRT=0x9eee7000 MEMATTR=0x99c76018 TPMEventLog=0x931f7018
[ 0.000000] secureboot: Secure boot enabled
[ 0.000000] Kernel is locked down from EFI Secure Boot mode; see man kernel_lockdown.7
[ 0.000000] SMBIOS 3.0.0 present.
[ 0.000000] DMI: LENOVO 20KHCTO1WW/20KHCTO1WW, BIOS N23ET69W (1.44 ) 11/25/2019
--
[ 0.532664] hpet0: 8 comparators, 64-bit 24.000000 MHz counter
[ 0.534731] clocksource: Switched to clocksource tsc-early
[ 0.534737] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534737] Could not create tracefs 'available_events' entry
[ 0.534741] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534741] Could not create tracefs 'set_event' entry
[ 0.534742] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534743] Could not create tracefs 'available_tracers' entry
[ 0.534744] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534745] Could not create tracefs 'current_tracer' entry
[ 0.534745] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534746] Could not create tracefs 'tracing_cpumask' entry
[ 0.534747] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534747] Could not create tracefs 'trace_options' entry
[ 0.534748] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534748] Could not create tracefs 'trace' entry
[ 0.534749] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534750] Could not create tracefs 'trace_pipe' entry
[ 0.534750] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534751] Could not create tracefs 'buffer_size_kb' entry
[ 0.534752] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534752] Could not create tracefs 'buffer_total_size_kb' entry
[ 0.534753] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534754] Could not create tracefs 'free_buffer' entry
[ 0.534754] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534755] Could not create tracefs 'trace_marker' entry
[ 0.534782] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534783] Could not create tracefs 'trace_marker_raw' entry
[ 0.534783] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534784] Could not create tracefs 'trace_clock' entry
[ 0.534785] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534785] Could not create tracefs 'tracing_on' entry
[ 0.534786] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534786] Could not create tracefs 'timestamp_mode' entry
[ 0.534787] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534788] Could not create tracefs 'buffer_percent' entry
[ 0.534816] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534817] Could not create tracefs 'print-parent' entry
[ 0.534817] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534818] Could not create tracefs 'sym-offset' entry
[ 0.534819] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534819] Could not create tracefs 'sym-addr' entry
[ 0.534820] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534820] Could not create tracefs 'verbose' entry
[ 0.534821] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534822] Could not create tracefs 'raw' entry
[ 0.534822] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534823] Could not create tracefs 'hex' entry
[ 0.534824] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534824] Could not create tracefs 'bin' entry
[ 0.534825] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534825] Could not create tracefs 'block' entry
[ 0.534826] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534827] Could not create tracefs 'trace_printk' entry
[ 0.534827] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534828] Could not create tracefs 'annotate' entry
[ 0.534829] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534829] Could not create tracefs 'userstacktrace' entry
[ 0.534830] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534830] Could not create tracefs 'sym-userobj' entry
[ 0.534831] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534832] Could not create tracefs 'printk-msg-only' entry
[ 0.534832] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534833] Could not create tracefs 'context-info' entry
[ 0.534834] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534834] Could not create tracefs 'latency-format' entry
[ 0.534835] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534835] Could not create tracefs 'record-cmd' entry
[ 0.534836] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534837] Could not create tracefs 'record-tgid' entry
[ 0.534837] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534838] Could not create tracefs 'overwrite' entry
[ 0.534838] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534839] Could not create tracefs 'disable_on_free' entry
[ 0.534840] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534840] Could not create tracefs 'irq-info' entry
[ 0.534841] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534841] Could not create tracefs 'markers' entry
[ 0.534842] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534843] Could not create tracefs 'event-fork' entry
[ 0.534843] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534844] Could not create tracefs 'function-trace' entry
[ 0.534844] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534845] Could not create tracefs 'function-fork' entry
[ 0.534846] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534846] Could not create tracefs 'display-graph' entry
[ 0.534847] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534848] Could not create tracefs 'stacktrace' entry
[ 0.534848] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534849] Could not create tracefs 'tracing_max_latency' entry
[ 0.534850] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534850] Could not create tracefs 'snapshot' entry
[ 0.534851] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534851] Could not create tracefs 'error_log' entry
[ 0.534855] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534855] Could not create tracefs 'trace_pipe' entry
[ 0.534856] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534857] Could not create tracefs 'trace' entry
[ 0.534857] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534858] Could not create tracefs 'trace_pipe_raw' entry
[ 0.534858] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534859] Could not create tracefs 'stats' entry
[ 0.534860] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534860] Could not create tracefs 'buffer_size_kb' entry
[ 0.534861] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534862] Could not create tracefs 'snapshot' entry
[ 0.534862] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534863] Could not create tracefs 'snapshot_raw' entry
[ 0.534864] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534865] Could not create tracefs 'trace_pipe' entry
[ 0.534866] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534866] Could not create tracefs 'trace' entry
[ 0.534867] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534867] Could not create tracefs 'trace_pipe_raw' entry
[ 0.534868] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534869] Could not create tracefs 'stats' entry
[ 0.534869] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534870] Could not create tracefs 'buffer_size_kb' entry
[ 0.534870] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534871] Could not create tracefs 'snapshot' entry
[ 0.534872] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534872] Could not create tracefs 'snapshot_raw' entry
[ 0.534874] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534874] Could not create tracefs 'trace_pipe' entry
[ 0.534875] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534875] Could not create tracefs 'trace' entry
[ 0.534876] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534877] Could not create tracefs 'trace_pipe_raw' entry
[ 0.534877] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534878] Could not create tracefs 'stats' entry
[ 0.534879] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534879] Could not create tracefs 'buffer_size_kb' entry
[ 0.534880] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534880] Could not create tracefs 'snapshot' entry
[ 0.534881] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534881] Could not create tracefs 'snapshot_raw' entry
[ 0.534885] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534885] Could not create tracefs 'trace_pipe' entry
[ 0.534886] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534887] Could not create tracefs 'trace' entry
[ 0.534887] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534888] Could not create tracefs 'trace_pipe_raw' entry
[ 0.534888] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534889] Could not create tracefs 'stats' entry
[ 0.534890] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534890] Could not create tracefs 'buffer_size_kb' entry
[ 0.534891] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534891] Could not create tracefs 'snapshot' entry
[ 0.534892] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534893] Could not create tracefs 'snapshot_raw' entry
[ 0.534894] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534895] Could not create tracefs 'trace_pipe' entry
[ 0.534895] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534896] Could not create tracefs 'trace' entry
[ 0.534897] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534897] Could not create tracefs 'trace_pipe_raw' entry
[ 0.534898] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534898] Could not create tracefs 'stats' entry
[ 0.534899] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534900] Could not create tracefs 'buffer_size_kb' entry
[ 0.534900] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534901] Could not create tracefs 'snapshot' entry
[ 0.534901] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534902] Could not create tracefs 'snapshot_raw' entry
[ 0.534904] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534904] Could not create tracefs 'trace_pipe' entry
[ 0.534905] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534905] Could not create tracefs 'trace' entry
[ 0.534906] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534907] Could not create tracefs 'trace_pipe_raw' entry
[ 0.534907] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534908] Could not create tracefs 'stats' entry
[ 0.534908] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534909] Could not create tracefs 'buffer_size_kb' entry
[ 0.534910] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534910] Could not create tracefs 'snapshot' entry
[ 0.534911] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534911] Could not create tracefs 'snapshot_raw' entry
[ 0.534913] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534914] Could not create tracefs 'trace_pipe' entry
[ 0.534914] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534915] Could not create tracefs 'trace' entry
[ 0.534915] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534916] Could not create tracefs 'trace_pipe_raw' entry
[ 0.534917] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534917] Could not create tracefs 'stats' entry
[ 0.534918] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534918] Could not create tracefs 'buffer_size_kb' entry
[ 0.534919] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534920] Could not create tracefs 'snapshot' entry
[ 0.534920] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534921] Could not create tracefs 'snapshot_raw' entry
[ 0.534922] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534923] Could not create tracefs 'trace_pipe' entry
[ 0.534924] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534924] Could not create tracefs 'trace' entry
[ 0.534925] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534925] Could not create tracefs 'trace_pipe_raw' entry
[ 0.534926] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534927] Could not create tracefs 'stats' entry
[ 0.534927] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534928] Could not create tracefs 'buffer_size_kb' entry
[ 0.534928] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534929] Could not create tracefs 'snapshot' entry
[ 0.534930] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534930] Could not create tracefs 'snapshot_raw' entry
[ 0.534931] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534931] Could not create tracefs 'set_ftrace_pid' entry
[ 0.534932] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534933] Could not create tracefs 'available_filter_functions' entry
[ 0.534934] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534934] Could not create tracefs 'enabled_functions' entry
[ 0.534935] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534936] Could not create tracefs 'set_ftrace_filter' entry
[ 0.534936] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534937] Could not create tracefs 'set_ftrace_notrace' entry
[ 0.534937] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534938] Could not create tracefs 'set_graph_function' entry
[ 0.534939] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534939] Could not create tracefs 'set_graph_notrace' entry
[ 0.534942] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.534943] ------------[ cut here ]------------
[ 0.534944] Could not register function stat for cpu 0
--
[ 0.535004] ret_from_fork+0x35/0x40
[ 0.535008] ---[ end trace a9f51a1c2b8afb59 ]---
[ 0.535008] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.535008] Could not create tracefs 'tracing_thresh' entry
[ 0.535008] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.535008] Could not create tracefs 'README' entry
[ 0.535008] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.535008] Could not create tracefs 'saved_cmdlines' entry
[ 0.535008] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.535008] Could not create tracefs 'saved_cmdlines_size' entry
[ 0.535008] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.535008] Could not create tracefs 'saved_tgids' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'dyn_ftrace_total_info' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'funcgraph-overrun' entry
[ 0.536594] ------------[ cut here ]------------
--
[ 0.536594] ret_from_fork+0x35/0x40
[ 0.536594] ---[ end trace a9f51a1c2b8afb5a ]---
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'funcgraph-cpu' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'funcgraph-overhead' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'funcgraph-proc' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'funcgraph-duration' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'funcgraph-abstime' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'funcgraph-irqs' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'funcgraph-tail' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'sleep-time' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'graph-time' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'func_stack_trace' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'test_nop_accept' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'test_nop_refuse' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'printk_formats' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'max_graph_depth' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'synthetic_events' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] trace_kprobe: Could not create tracefs 'kprobe_events' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] trace_kprobe: Could not create tracefs 'kprobe_profile' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'dynamic_events' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'uprobe_events' entry
[ 0.536594] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.536594] Could not create tracefs 'uprobe_profile' entry
[ 0.536594] *** VALIDATE bpf ***
--
[ 0.820588] caller snb_uncore_imc_init_box+0x6c/0xb0 mapping multiple BARs
[ 0.820865] check: Scanning for low memory corruption every 60 seconds
[ 0.823207] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.823208] Could not create tracefs 'stack_max_size' entry
[ 0.823209] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.823209] Could not create tracefs 'stack_trace' entry
[ 0.823210] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.823211] Could not create tracefs 'stack_trace_filter' entry
[ 0.823217] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.823218] Could not create tracefs 'blk_classic' entry
[ 0.823218] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.823219] Could not create tracefs 'blk_cgroup' entry
[ 0.823220] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.823220] Could not create tracefs 'blk_cgname' entry
[ 0.823436] Initialise system trusted keyrings
--
[ 0.952067] sched_clock: Marking stable (951207778, 849693)->(1034265626, -82208155)
[ 0.952144] registered taskstats version 1
[ 0.952149] Lockdown: swapper/0: use of tracefs is restricted; see man kernel_lockdown.7
[ 0.952154] Loading compiled-in X.509 certificates
[ 0.953366] Loaded X.509 cert 'Build time autogenerated kernel key: b859a3f0d1fb97c048eb1e12333684e1db3073ca'
--
[ 1.001913] tty ttyS1: hash matches
[ 1.002134] rtc_cmos 00:04: setting system clock to 2020-02-06T20:44:21 UTC (1581021861)
[ 1.002371] Lockdown: swapper/0: hibernation is restricted; see man kernel_lockdown.7
[ 1.003280] Freeing unused decrypted memory: 2040K
[ 1.003638] Freeing unused kernel image memory: 2680K
--
[ 71.456989] systemd[1]: Detected architecture x86-64.
[ 71.473620] systemd[1]: Set hostname to <millbarge>.
[ 71.475128] Lockdown: systemd: /dev/mem,kmem,port is restricted; see man kernel_lockdown.7
[ 71.583229] systemd[1]: /lib/systemd/system/dbus.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/dbus/system_bus_socket → /run/dbus/system_bus_socket; please update the unit file accordingly.
[ 71.592395] systemd[1]: /lib/systemd/system/virtlogd.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/libvirt/virtlogd-sock → /run/libvirt/virtlogd-sock; please update the unit file accordingly.
--
[ 72.994080] audit: type=1400 audit(1581021933.486:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/tcpdump" pid=2420 comm="apparmor_parser"
[ 73.080322] Adding 2097148k swap on /dev/zd0. Priority:-2 extents:1 across:2097148k SSDscFS
[ 73.791076] Lockdown: rasdaemon: use of tracefs is restricted; see man kernel_lockdown.7
[ 73.791078] Could not create tracefs 'set_event' entry
[ 73.793322] Lockdown: rasdaemon: use of tracefs is restricted; see man kernel_lockdown.7
[ 73.793324] Could not create tracefs 'set_event' entry
[ 73.812049] Lockdown: rasdaemon: use of tracefs is restricted; see man kernel_lockdown.7
[ 73.812050] Could not create tracefs 'set_event' entry
[ 73.887930] Bluetooth: hci0: Waiting for firmware download to complete
--
[ 73.900884] Bluetooth: hci0: Found Intel DDC parameters: intel/ibt-12-16.ddc
[ 73.903619] Bluetooth: hci0: Applying Intel DDC parameters completed
[ 74.166659] Lockdown: Xorg: raw io port access is restricted; see man kernel_lockdown.7
[ 75.423231] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[ 75.424155] virbr0: port 1(virbr0-nic) entered blocking state
--
[ 75.878990] virbr0: port 1(virbr0-nic) entered listening state
[ 75.932525] virbr0: port 1(virbr0-nic) entered disabled state
[ 76.013277] Lockdown: systemd-logind: hibernation is restricted; see man kernel_lockdown.7
[ 76.015903] Lockdown: systemd-logind: hibernation is restricted; see man kernel_lockdown.7
[ 76.016454] Lockdown: systemd-logind: hibernation is restricted; see man kernel_lockdown.7
[ 77.672659] drm: not enough stolen space for compressed buffer (need 36864000 more bytes), disabling. Hint: you may be able to increase stolen memory size in the BIOS to avoid this.
[ 78.458791] e1000e: enp0s31f6 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
#

Thanks

ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: perf-tools-unstable 1.0.1~20200130+git49b8cdf-1ubuntu1
ProcVersionSignature: Ubuntu 5.4.0-12.15-generic 5.4.8
Uname: Linux 5.4.0-12-generic x86_64
NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
ApportVersion: 2.20.11-0ubuntu16
Architecture: amd64
Date: Tue Feb 11 00:57:36 2020
Dependencies:

PackageArchitecture: all
ProcEnviron:
 TERM=rxvt-unicode-256color
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=en_US.UTF-8
 SHELL=/bin/bash
SourcePackage: perf-tools-unstable
UpgradeStatus: Upgraded to focal on 2020-01-24 (17 days ago)
---
ProblemType: Bug
AlsaVersion: Advanced Linux Sound Architecture Driver Version k5.4.0-12-generic.
ApportVersion: 2.20.11-0ubuntu16
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC1: sarnold 4492 F.... pulseaudio
 /dev/snd/controlC0: sarnold 4492 F.... pulseaudio
Card0.Amixer.info:
 Card hw:0 'PCH'/'HDA Intel PCH at 0x2fe1028000 irq 146'
   Mixer name : 'Realtek ALC285'
   Components : 'HDA:10ec0285,17aa225c,00100002 HDA:8086280b,80860101,00100000'
   Controls : 53
   Simple ctrls : 15
Card1.Amixer.info:
 Card hw:1 'Audio'/'Generic ThinkPad Dock USB Audio at usb-0000:00:14.0-4.2.4, high speed'
   Mixer name : 'USB Mixer'
   Components : 'USB17ef:306f'
   Controls : 9
   Simple ctrls : 4
Dependencies:

DistroRelease: Ubuntu 20.04
HibernationDevice: RESUME=none
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig': 'iwconfig'
MachineType: LENOVO 20KHCTO1WW
NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
Package: perf-tools-unstable 1.0.1~20200130+git49b8cdf-1ubuntu1
PackageArchitecture: all
ProcEnviron:
 TERM=rxvt-unicode-256color
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcFB: 0 i915drmfb
ProcKernelCmdLine: BOOT_IMAGE=/BOOT/ubuntu@/vmlinuz-5.4.0-12-generic root=ZFS=rpool/ROOT/ubuntu ro root=ZFS=rpool/ROOT/ubuntu quiet splash acpi_osi=! "acpi_osi=Windows 2015" cgroup_disable=memory vt.handoff=1
ProcVersionSignature: Ubuntu 5.4.0-12.15-generic 5.4.8
RelatedPackageVersions:
 linux-restricted-modules-5.4.0-12-generic N/A
 linux-backports-modules-5.4.0-12-generic N/A
 linux-firmware 1.186
Tags: focal
Uname: Linux 5.4.0-12-generic x86_64
UpgradeStatus: Upgraded to focal on 2020-01-24 (17 days ago)
UserGroups: adm cdrom libvirt lpadmin plugdev sambashare sbuild sudo
_MarkForUpload: True
dmi.bios.date: 11/25/2019
dmi.bios.vendor: LENOVO
dmi.bios.version: N23ET69W (1.44 )
dmi.board.asset.tag: Not Available
dmi.board.name: 20KHCTO1WW
dmi.board.vendor: LENOVO
dmi.board.version: SDK0J40709 WIN
dmi.chassis.asset.tag: No Asset Information
dmi.chassis.type: 10
dmi.chassis.vendor: LENOVO
dmi.chassis.version: None
dmi.modalias: dmi:bvnLENOVO:bvrN23ET69W(1.44):bd11/25/2019:svnLENOVO:pn20KHCTO1WW:pvrThinkPadX1Carbon6th:rvnLENOVO:rn20KHCTO1WW:rvrSDK0J40709WIN:cvnLENOVO:ct10:cvrNone:
dmi.product.family: ThinkPad X1 Carbon 6th
dmi.product.name: 20KHCTO1WW
dmi.product.sku: LENOVO_MT_20KH_BU_Think_FM_ThinkPad X1 Carbon 6th
dmi.product.version: ThinkPad X1 Carbon 6th
dmi.sys.vendor: LENOVO

Revision history for this message
Seth Arnold (seth-arnold) wrote :
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote : Missing required logs.

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1862708

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

Changed in linux (Ubuntu):
status: New → Incomplete
Revision history for this message
Seth Arnold (seth-arnold) wrote : AlsaDevices.txt

apport information

tags: added: apport-collected
description: updated
Revision history for this message
Seth Arnold (seth-arnold) wrote : AplayDevices.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : ArecordDevices.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : CRDA.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : Card0.Amixer.values.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : Card0.Codecs.codec.0.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : Card0.Codecs.codec.2.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : Card1.Amixer.values.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : CurrentDmesg.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : Lspci.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : Lsusb.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : Lsusb-t.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : Lsusb-v.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : PciMultimedia.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : ProcCpuinfoMinimal.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : ProcInterrupts.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : ProcModules.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : PulseList.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : RfKill.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : UdevDb.txt

apport information

Revision history for this message
Seth Arnold (seth-arnold) wrote : WifiSyslog.txt

apport information

Changed in linux (Ubuntu):
status: Incomplete → Confirmed
Revision history for this message
Seth Forshee (sforshee) wrote :

This is an upstream behavior under lockdown "confedentiality" mode:

https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=ccbd54ff54e8b1880456b81c4aea352ebe208843

Possibly there's an argument that the information disclosure isn't severe enough that it needs to be restricted by default under secure boot. Unfortunately the patch description isn't specific about what information is exposed to help assess the impact (e.g. kernel addresses vs key information).

Revision history for this message
Seth Arnold (seth-arnold) wrote :

I couldn't find a way to disable the lockdown functionality short of disabling secure boot in my UEFI system setup.

If we choose to keep lockdown enabled by default then we will need to document a way it can be disabled so users can run applications like https://cilium.io/ or the bcc iovisor tools.

(I wish I could run the iovisor tools. I've come to detest Focal because my computer freezes for a minute or two every few hours and having no way to debug it, at all, is frustrating.)

Thanks

Revision history for this message
Francis Ginther (fginther) wrote :

@seth-arnold,

Lockdown has been relaxed in the latest kernel, 5.4.0-20.24: "SAUCE: (lockdown) Reduce lockdown level to INTEGRITY for secure boot".

Can you please retest with the kernel from focal-proposed or this PPA:
https://launchpad.net/~canonical-kernel-team/+archive/ubuntu/proposed

Revision history for this message
Seth Arnold (seth-arnold) wrote :
Download full text (4.9 KiB)

I'm sorry for the slow response Francis, I've been running custom kernels for:
https://bugs.launchpad.net/bugs/1861359
for a while. Thanks for the reminder.

sarnold@millbarge:~$ dmesg | grep -i lockdown
[ 0.000000] Kernel is locked down from EFI Secure Boot mode; see man kernel_lockdown.7
[ 1.009940] Lockdown: swapper/0: hibernation is restricted; see man kernel_lockdown.7
[ 22.929952] Lockdown: systemd: /dev/mem,kmem,port is restricted; see man kernel_lockdown.7
[ 26.152235] Lockdown: Xorg: raw io port access is restricted; see man kernel_lockdown.7
[ 30.333255] Lockdown: rasdaemon: debugfs access is restricted; see man kernel_lockdown.7
sarnold@millbarge:~$ sudo -s
[sudo] password for sarnold:
root@millbarge:/home/sarnold# kprobe-perf -s 'p:shrink_node'
Tracing kprobe shrink_node. Ctrl-C to end.
^C
Ending tracing...
root@millbarge:/home/sarnold# ls -l /sys/kernel/debug/tracing/available_filter_functions
-r--r--r-- 1 root root 0 Apr 3 02:18 /sys/kernel/debug/tracing/available_filter_functions
root@millbarge:/home/sarnold# uname -a
Linux millbarge 5.4.0-21-generic #25-Ubuntu SMP Sat Mar 28 13:10:28 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
root@millbarge:/home/sarnold# dpkg -l 'linux*' | grep ^ii
ii linux-base 4.5ubuntu3 all Linux image base package
ii linux-firmware 1.187 all Firmware for Linux kernel drivers
ii linux-generic 5.4.0.21.25 amd64 Complete Generic Linux kernel and headers
ii linux-headers-5.4.0-18 5.4.0-18.22 all Header files related to Linux kernel version 5.4.0
ii linux-headers-5.4.0-18-generic 5.4.0-18.22 amd64 Linux kernel headers for version 5.4.0 on 64 bit x86 SMP
ii linux-headers-5.4.0-20 5.4.0-20.24 all Header files related to Linux kernel version 5.4.0
ii linux-headers-5.4.0-20-generic 5.4.0-20.24 amd64 Linux kernel headers for version 5.4.0 on 64 bit x86 SMP
ii linux-headers-5.4.0-21 5.4.0-21.25 all Header files related to Linux kernel version 5.4.0
ii linux-headers-5.4.0-21-generic 5.4.0-21.25 amd64 Linux kernel headers for version 5.4.0 on 64 bit x86 SMP
ii linux-headers-generic 5.4.0.21.25 amd64 Generic Linux kernel headers
ii linux-image-5.4.0-20-generic 5.4.0-20.24 amd64 Signed kernel image generic
ii linux-image-5.4.0-21-generic 5.4.0-21.25 amd64 Signed kernel image generic
ii linux-image-generic 5.4.0.21.25 amd64 Generic Linux kernel image
ii linux-image-unsigned-5.4.0-18-generic 5.4.0-18.22 amd64 Linux kernel image for version 5.4.0 on 64 bit x86 SMP
ii linux-libc-dev:amd64 5.4.0-21.25 amd64 Linux Kernel Headers for development
ii linux-modules-5.4.0-18-generic 5.4.0-18.22 amd64 Linux kernel extra modules for version 5.4.0 on 64 bit x86 SMP
ii linux-modules-5.4.0-20-generic 5.4.0-20.24 amd64 Linux kernel extra modules for version 5.4.0 on 64 bit x86 SMP
ii linux-modules-5.4.0-21-generic 5.4.0-21.25 amd64...

Read more...

Revision history for this message
Francis Ginther (fginther) wrote :

Marking 'Fix Released' after the lockdown changes.

Changed in linux (Ubuntu):
status: Confirmed → Fix Released
Revision history for this message
Seth Arnold (seth-arnold) wrote :

Just to be clear, not *all* tracing tools work, but this is much better:

sarnold@millbarge:/tmp$ uname -a
Linux millbarge 5.4.0-21-generic #25-Ubuntu SMP Sat Mar 28 13:10:28 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
sarnold@millbarge:/tmp$ sudo zfsslower-bpfcc
Traceback (most recent call last):
  File "/usr/sbin/zfsslower-bpfcc", line 265, in <module>
    if BPF.get_kprobe_functions(b'zpl_iter'):
  File "/usr/lib/python3/dist-packages/bcc/__init__.py", line 539, in get_kprobe_functions
    with open("%s/../kprobes/blacklist" % TRACEFS, "rb") as blacklist_f:
PermissionError: [Errno 1] Operation not permitted: '/sys/kernel/debug/tracing/../kprobes/blacklist'

Thanks

Revision history for this message
Bobby B (mustachek) wrote :

Re: PermissionError: [Errno 1] Operation not permitted: '/sys/kernel/debug/tracing/../kprobes/blacklist'

This can be fixed by a patch to the bpfcc libs found at: https://github.com/iovisor/bcc/commit/5558e36bd97ace7bc3efe3a70d0c9d4fc0d34e2a?branch=5558e36bd97ace7bc3efe3a70d0c9d4fc0d34e2a&diff=unified#diff-978dbb2c496647b4b9907f64485be957R614

Please incorporate into next update of python3-bpfcc.

This is ridiculous. Wonder how many other things this breaks.

Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in perf-tools-unstable (Ubuntu):
status: New → Confirmed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.