prio-inv from ubuntu_stress_smoke_test hangs on GCP g1-small with 5.4 / 4.15 / 4.4 lowlatency

[Po-Hsu Lin]

Issue found exclusively on GCP "g1-small" instance with the following kernels:
  * X 4.4.0-252.286 lowlatency (s2024.02.05 cycle)
  * X-hwe 4.15.0-223.235~16.04.1 lowlatency (s2024.02.05 cycle)
  * F 5.4.0-175.195 lowlatency (2024.03.04 cycle)

It looks like it's not 100% reproducible as it has passed with
  * B-lowlatency 4.15.0-223.235 (s2024.02.05 cycle)
  * F 5.4.0-174.193 lowlatency (s2024.02.05 cycle)

When this happens, test will be interrupted:
        START ubuntu_stress_smoke_test.prio-inv ubuntu_stress_smoke_test.prio-inv timestamp=1710402507 timeout=2100 localtime=Mar 14 07:48:27
 Persistent state client._record_indent now set to 2
 Persistent state client.unexpected_reboot now set to ('ubuntu_stress_smoke_test.prio-inv', 'ubuntu_stress_smoke_test.prio-inv')
 Waiting for pid 29277 for 2100 seconds
 System python is too old, crash handling disabled
 Running '/home/ubuntu/autotest/client/tests/ubuntu_stress_smoke_test/ubuntu_stress_single_smoke_test.sh prio-inv'
 [stdout] Free memory: 406 MB
 [stdout] Memory used: 512 MB
 [stdout] Using cgroup version 1
 [stderr] /home/ubuntu/autotest/client/tests/ubuntu_stress_smoke_test/ubuntu_stress_single_smoke_test.sh: line 32: [: too many arguments
 [stdout]
 [stdout] Machine Configuration
 [stdout] Physical Pages: 426053
 [stdout] Pages available: 104124
 [stdout] Page Size: 4096
 [stdout] Zswap enabled: Y
 [stdout]
 [stdout] Free memory:
 [stdout] total used free shared buff/cache available
 [stdout] Mem: 1704212 198912 416496 1000 1088804 1325556
 [stdout] Swap: 1048572 0 1048572
 [stdout]
 [stdout] Number of CPUs: 1
 [stdout] Number of CPUs Online: 1
 [stdout]
 [stdout] Maximum bogo ops: 3000
 [stdout]
 [stdout] prio-inv STARTING
client_loop: send disconnect: Broken pipe

Here is the collected console log:
Mar 14 07:42:15 f-l-ll-5-4-g1sml-u-stress-smk-test systemd[1]: Finished GCE Workload Certificate refresh.^M
Mar 14 07:42:24 f-l-ll-5-4-g1sml-u-stress-smk-test systemd[1]: Started Session 7 of user ubuntu.^M
Mar 14 07:46:04 f-l-ll-5-4-g1sml-u-stress-smk-test PackageKit: daemon quit^M
Mar 14 07:46:04 f-l-ll-5-4-g1sml-u-stress-smk-test systemd[1]: packagekit.service: Succeeded.^M
Mar 14 07:48:28 [ 1847.057112] INFO: task jbd2/sda1-8:280 blocked for more than 123 seconds.^M
[ 1847.067198] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 1847.073489] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 1847.081740] INFO: task kworker/u2:1:17304 blocked for more than 123 seconds.^M
[ 1850.064409] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 1850.070514] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 1973.046096] INFO: task jbd2/sda1-8:280 blocked for more than 249 seconds.^M
[ 1973.061945] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 1976.044464] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 1976.053184] INFO: task systemd-journal:355 blocked for more than 128 seconds.^M
[ 1976.060673] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 1976.066844] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 1982.044713] INFO: task rs:main Q:Reg:719 blocked for more than 134 seconds.^M
[ 1982.052278] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 1982.058451] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 1982.066722] INFO: task kworker/u2:1:17304 blocked for more than 258 seconds.^M
[ 1985.063183] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 1988.047580] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 2114.030688] INFO: task jbd2/sda1-8:280 blocked for more than 390 seconds.^M
[ 2114.038876] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 2114.045149] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 2114.053295] INFO: task systemd-journal:355 blocked for more than 266 seconds.^M
[ 2117.036368] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 2117.042507] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 2117.050832] INFO: task rs:main Q:Reg:719 blocked for more than 269 seconds.^M
[ 2120.034201] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 2120.040333] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M
[ 2120.048505] INFO: task kworker/u2:1:17304 blocked for more than 396 seconds.^M
[ 2123.035654] Not tainted 5.4.0-175-lowlatency #195-Ubuntu^M
[ 2123.041809] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.^M

[Po-Hsu Lin (cypressyew)]

Issue reported upstream https://github.com/ColinIanKing/stress-ng/issues/366

[Po-Hsu Lin (cypressyew)]

Issue fixed upstream.