Storage: Provision fails in a multi-openstack node setup
Affects | Status | Importance | Assigned to | Milestone | ||
---|---|---|---|---|---|---|
Juniper Openstack | Status tracked in Trunk | |||||
R3.0 |
Fix Committed
|
High
|
Jeya ganesh babu J | |||
Trunk |
Fix Committed
|
High
|
Jeya ganesh babu J |
Bug Description
Storage provision fails in a multi-openstack node setup. This was seen when provisioning the staging cluster by Thomas.
On 5/4/16, 11:16 PM, "Thomas Murray" <email address hidden> wrote:
we had a lot of issues provisioning storage in the juniper it staging
cluster with 3.0.2/34. you may want to have a look at the logs on
root@10.163.41.4 (c0ntrail123). most of the time i just re-ran the
setup_storage and it went past the previous issues. twice i had hung
kernels and had to reboot. this one is the last i am seeing:
2016-05-04 23:09:20:327116: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.14] out:
2016-05-04 23:09:20:327146: [root@10.163.254.4] out: [10.163.41.4] out:
2016-05-04 23:09:20:327182: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.1] download: /tmp/contrail-
/etc/init/
2016-05-04 23:09:20:342710: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.8] run: ls /etc/init/
2>/dev/null | wc -l
2016-05-04 23:09:20:342772: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.8] out: 1
2016-05-04 23:09:20:358300: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.8] out:
2016-05-04 23:09:20:358435: [root@10.163.254.4] out: [10.163.41.4] out:
2016-05-04 23:09:20:358463: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.12] run: ls /etc/init/
2>/dev/null | wc -l
2016-05-04 23:09:20:358493: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.12] out: 1
2016-05-04 23:09:20:365921: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.12] out:
2016-05-04 23:09:20:365985: [root@10.163.254.4] out: [10.163.41.4] out:
2016-05-04 23:09:20:366016: [root@10.163.254.4] out: [10.163.41.4] out:
[root@10.163.41.4] run: sudo openstack-config --set
disc_server_ip 10.163.41.241
2016-05-04 23:09:20:366045: [root@10.163.254.4] out: [10.163.41.4] out:
Traceback (most recent call last):
2016-05-04 23:09:20:466371: [root@10.163.254.4] out: [10.163.41.4] out:
File "/usr/bin/
2016-05-04 23:09:20:466466: [root@10.163.254.4] out: [10.163.41.4] out:
load_
'storage-
2016-05-04 23:09:20:467744: [root@10.163.254.4] out: [10.163.41.4] out:
File
"/usr/local/
ragefs/setup.py", line 3770, in main
2016-05-04 23:09:20:467817: [root@10.163.254.4] out: [10.163.41.4] out:
SetupCeph(
2016-05-04 23:09:20:467851: [root@10.163.254.4] out: [10.163.41.4] out:
File
"/usr/local/
ragefs/setup.py", line 3660, in __init__
2016-05-04 23:09:20:467878: [root@10.163.254.4] out: [10.163.41.4] out:
self.
2016-05-04 23:09:20:467906: [root@10.163.254.4] out: [10.163.41.4] out:
File
"/usr/local/
ragefs/setup.py", line 3584, in do_storage_setup
2016-05-04 23:09:20:467961: [root@10.163.254.4] out: [10.163.41.4] out:
self.
2016-05-04 23:09:20:467989: [root@10.163.254.4] out: [10.163.41.4] out:
File
"/usr/local/
ragefs/setup.py", line 3090, in do_configure_
2016-05-04 23:09:20:468015: [root@10.163.254.4] out: [10.163.41.4] out:
for os_entry in zip(self.
2016-05-04 23:09:20:468041: [root@10.163.254.4] out: [10.163.41.4] out:
AttributeError: 'Namespace' object has no attribute 'os_hosts'
2016-05-04 23:09:20:468066: [root@10.163.254.4] out: [10.163.41.4] out:
Exception in thread Thread-2 (most likely raised during interpreter
shutdown):Exception in thread Thread-4 (most likely raised during
interpreter shutdown):Exception in thread Thread-12 (most likely raised
during interpreter shutdown):
2016-05-04 23:09:20:976189: [root@10.163.254.4] out: [10.163.41.4] out:
2016-05-04 23:09:20:976283: [root@10.163.254.4] out:
2016-05-04 23:09:21:007897: [root@10.163.254.4] out:
2016-05-04 23:09:21:007989: [root@10.163.254.4] out: Fatal error: run()
received nonzero return code 1 while executing!
2016-05-04 23:09:21:008021: [root@10.163.254.4] out:
i have not debugged it yet.
we will need to build out an 80 node cluster soon so i have concerns on
the resiliency/
change.
thanks,
‹tom
information type: | Proprietary → Public |
Review in progress for https:/ /review. opencontrail. org/19938
Submitter: Jeya ganesh babu (<email address hidden>)