When I create a instance using a flavor with "hw:cpu_policy=dedicated" "hw:cpu_realtime=yes" and "hw:cpu_realtime_mask=^0-1". The error is "libvirtError:Cannot set scheduler parameters for pid 3666:operation not permitted".

[Qiu Fossen]

When I create a instance using a flavor with "hw:cpu_policy=dedicated" "hw:cpu_realtime=yes" and "hw:cpu_realtime_mask=^0-1".
The error is "libvirtError:Cannot set scheduler parameters for pid 3666:operation not permitted".
The instance xml as following:
 <vcpu placement='static'>4</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='3'/>
    <vcpupin vcpu='1' cpuset='11'/>
    <vcpupin vcpu='2' cpuset='0'/>
    <vcpupin vcpu='3' cpuset='8'/>
    <emulatorpin cpuset='3,11'/>
    <vcpusched vcpus='2' scheduler='fifo' priority='1'/>
    <vcpusched vcpus='3' scheduler='fifo' priority='1'/>
  </cputune>
The nova.compute.manager error log as following:
INFO nova.virt.libvirt.driver [req-57bcb641-90b6-4bf1-a1e9-459d3977c2ae aa46e7b354b4491db8c0a2851b66493c 8890dccd445f4ebead497206a6f89f9a - - -] [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] Deletion of /var/lib/nova/instances/74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0_del complete
 ERROR nova..compute.manager [req-57bcb641-90b6-4bf1-a1e9-459d3977c2ae aa46e7b354b4491db8c0a2851b66493c 8890dccd445f4ebead497206a6f89f9a - - -] [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] Instance failed to spawn: libvirtError: Cannot set scheduler parameters for pid 6504: Operation not permitted
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] Traceback (most recent call last):
 ERROR nova. .compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "build/bdist.linux-x86_64/egg/nova/compute/manager.py", line 666, in _build_resources
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "build/bdist.linux-x86_64/egg/nova/compute/manager.py", line 428, in _build_and_run_instance
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "build/bdist.linux-x86_64/egg/nova/virt/libvirt/driver.py", line 3080, in spawn
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "build/bdist.linux-x86_64/egg/nova/virt/libvirt/driver.py", line 5646, in _create_domain_and_network
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] self.force_reraise()
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] six.reraise(self.type_, self.value, self.tb)
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "build/bdist.linux-x86_64/egg/nova/virt/libvirt/driver.py", line 5615, in _create_domain_and_network
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "build/bdist.linux-x86_64/egg/nova/virt/libvirt/driver.py", line 5550, in _create_domain
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "build/bdist.linux-x86_64/egg/nova/virt/libvirt/guest.py", line 144, in launch
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] self.force_reraise()
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] six.reraise(self.type_, self.value, self.tb)
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "build/bdist.linux-x86_64/egg/nova/virt/libvirt/guest.py", line 139, in launch
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/var/lib/kolla/venv/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] result = proxy_call(self._autowrap, f, *args, **kwargs)
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/var/lib/kolla/venv/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] rv = execute(f, *args, **kwargs)
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/var/lib/kolla/venv/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] six.reraise(c, e, tb)
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/var/lib/kolla/venv/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] rv = meth(*args, **kwargs)
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1099, in createWithFlags
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] libvirtError: Cannot set scheduler parameters for pid 6504: Operation not permitted
 ERROR nova.compute.manager [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0]
 INFO nova.compute.manager [req-57bcb641-90b6-4bf1-a1e9-459d3977c2ae aa46e7b354b4491db8c0a2851b66493c 8890dccd445f4ebead497206a6f89f9a - - -] [instance: 74dcc0a1-9ed4-4d13-bef7-ac9623bca2d0] Terminating instance

[Ghada Khalil (gkhalil)]

@Qui Fossen,
Can you please clarify which build you are using?

[zhipeng liu (zhipengs)]

Hi Fossen,

Have you enabled RT kernel during deployment, and which build are you using.

Thanks!
Zhipeng

[yong hu (yhu6)]

please run it with a RT kernel (on worker nodes) after we get the "Ussuri" upgrade done.

[Ghada Khalil (gkhalil)]

Lowering the priority - the release this issue is seen on is not noted by the reporter and there hasn't been any response to the questions posted by the LP dev prime, Zhipeng.

[zhipeng liu (zhipengs)]

Hi Fossen,

Any update for my comment #2? We have already kept this ticket for several months.
Thanks!

Zhipeng

[Austin Sun (sunausti)]

close since longtime no feedback.