After applying the patch submitted as a fix for https://bugs.launchpad.net/tripleo/+bug/1882387 in the FFU testing, it failed with the error in $subject.
The problem is that during this stage we have train code in the undercloud, but the overcloud (controllers) are still in queens and ceph is not updated yet (it's still ceph3): we have jq <1.5 and the "try-catch" mechanism is not available.
For this reason the validation failed with the following:
TASK [ceph : set jq osd percentage filter] *************************************
Tuesday 28 July 2020 10:22:16 -0400 (0:00:00.270) 0:01:11.723 **********
ok: [undercloud -> 192.168.24.15] => {"ansible_facts": {"jq_osd_percentage_filter": "( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds))
* 100"}, "changed": false}
TASK [ceph : Get OSD stat percentage] ******************************************
Tuesday 28 July 2020 10:22:17 -0400 (0:00:00.272) 0:01:11.996 **********
fatal: [undercloud -> 192.168.24.15]: FAILED! => {"changed": true, "cmd": "\"docker\" exec \"ceph-mon-controller-0\" ceph --cluster \"ceph\" osd stat -f json | jq '( (try .o
sdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100'", "delta": "0:00:00.404082", "end": "2020-07-27 15:43:28.260232", "msg": "non-zero return code", "rc": 1, "start": "2020-07-27 15:43:27.856150", "stderr": "error: try is not defined\n( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100\n ^^^\nerror: try is not defined\n( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100\n
^^^\nerror: try is not defined\n( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100\n
^^^\nerror: try is not defined\n( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100\n
^^^\n4 compile errors", "stderr_lines": ["error: try is not defined", "( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100", " ^^^", "error: try is not defined", "( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100", "
^^^", "error: try is not defined", "( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100", "
^^^", "error: try is not defined", "( (try .osdmap.num_in_osds + try .num_in_osds) / (try .osdmap.num_osds + try .num_osds)) * 100",
" ^^^", "4 compile errors"], "stdout": "", "stdout_lines": []}
NO MORE HOSTS LEFT *************************************************************
The jq package version found in the controller is:
[root@controller-0 ~]# rpm -qa | grep jq
python-XStatic-jquery-ui-1.10.4.1-1.el7ost.1.noarch
jq-1.3-4.el7ost.x86_64
In master it's ok because we're in V and jq >=1.5 so that change will work, but in in queens => train upgrade we should fix this code.