Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' failed when fill root on primary controller
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Invalid
|
Undecided
|
Fuel Library (Deprecated) |
Bug Description
{"release_
Steps to reproduce:
1)Deploy 3 controller, 2 compute 1 cinder +Neutron Vlan
2) Fill root on primary controller to below threshold limit for the corosync disk monitor of 512MB
Free space in root on primary controller - 12288
Need to fill space on root - 11775
fallocate -l 11775M /root/bigfile
3) Check for stopped resources and migrating resources on primary controller
root@node-1:~# pcs status xml |grep "resources_running"
<node name="node-
sysinfo_
Clone Set: clone_p_vrouter [p_vrouter]
Started: [ node-2.
Stopped: [ node-1.
vip__management (ocf::fuel:
vip__vrouter_pub (ocf::fuel:
vip__vrouter (ocf::fuel:
vip__public (ocf::fuel:
Clone Set: clone_p_haproxy [p_haproxy]
Started: [ node-2.
Stopped: [ node-1.
Master/Slave Set: master_p_conntrackd [p_conntrackd]
Masters: [ node-2.
Slaves: [ node-3.
Stopped: [ node-1.
Master/Slave Set: master_
Masters: [ node-2.
Slaves: [ node-3.
Stopped: [ node-1.
Clone Set: clone_p_dns [p_dns]
Started: [ node-2.
Stopped: [ node-1.
Clone Set: clone_p_mysql [p_mysql]
Started: [ node-2.
Stopped: [ node-1.
Clone Set: clone_p_heat-engine [p_heat-engine]
Started: [ node-2.
Stopped: [ node-1.
Clone Set: clone_p_
Started: [ node-2.
Stopped: [ node-1.
Clone Set: clone_p_
Started: [ node-2.
Stopped: [ node-1.
Clone Set: clone_p_
Started: [ node-2.
Stopped: [ node-1.
Clone Set: clone_p_
Started: [ node-2.
Stopped: [ node-1.
sysinfo_
sysinfo_
Clone Set: clone_ping_
Started: [ node-2.
Stopped: [ node-1.
Clone Set: clone_p_ntp [p_ntp]
Started: [ node-2.
Stopped: [ node-1.
4) run ostf sanity, smoke, ha
Expected results:
Only OSTF HA test should fail
Actual results:
"Check that required services are running
Some nova services have not been started.. Please refer to OpenStack logs for more details."
from OSTF logs:
...
fuel_health.
Binary Host Zone Status State Updated_At
nova-scheduler node-1.
nova-cert node-2.
nova-consoleauth node-2.
File "/usr/lib/
from node 1 nova-scheduler logs:
2015-11-10 21:24:33 ERR server on 10.109.7.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 5 seconds.
2015-11-10 21:23:46 ERR Fixed interval looping call 'nova.servicegr
Node2-nova-cert logs:
Fixed interval looping call 'nova.servicegr
node2-nova-
2015-11-10 21:24:32 ERR server on 10.109.7.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 5 seconds.
2015-11-10 21:22:24 ERR Fixed interval looping call 'nova.servicegr
tags: | added: area-library |
Changed in fuel: | |
status: | New → Confirmed |
Changed in fuel: | |
status: | Confirmed → In Progress |
assignee: | Fuel Library Team (fuel-library) → Kyrylo Galanov (kgalanov) |
Changed in fuel: | |
assignee: | Kyrylo Galanov (kgalanov) → MOS Nova (mos-nova) |
Changed in fuel: | |
assignee: | MOS Nova (mos-nova) → Kyrylo Galanov (kgalanov) |
Changed in fuel: | |
assignee: | Kyrylo Galanov (kgalanov) → Fuel Library Team (fuel-library) |
https:/ /drive. google. com/a/mirantis. com/file/ d/0B6hV1ZImNDRV R2MwX1VNcW1DYUU /view?usp= sharing