Juniper Openstack

[4.0.0.0-3038] Centos7.1: fab setup_all fails as contrail-control fails to start

Bug #1663461 reported by Pavana
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
Trunk
Fix Committed
High
Ananth Suryanarayana
Juniper Openstack r4.0.0.0-fcs "r4.0.0.0"

Bug Description

On the above build running centos7.1 kilo, fab provisioning fails with 'fab setup_interface' failing since Service contrail-control is not running.

2017-02-10 02:19:23:235105: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:19:23:235519: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:19:23:418088: [root@10.204.216.232] out:
2017-02-10 02:19:23:418649:
2017-02-10 02:19:23:418934: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:19:23:419255: [root@10.204.216.232] out: contrail-control STARTING
2017-02-10 02:19:23:738638: [root@10.204.216.232] out:
2017-02-10 02:19:23:739172:
2017-02-10 02:19:23:739493: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:19:43:760019: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:19:43:928970: [root@10.204.216.232] out:
2017-02-10 02:19:43:929379:
2017-02-10 02:19:43:929886: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:19:43:930339: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:19:44:265759: [root@10.204.216.232] out:
2017-02-10 02:19:44:266320:
2017-02-10 02:19:44:266594: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:20:04:287120: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:20:04:424040: [root@10.204.216.232] out:
2017-02-10 02:20:04:424546:
2017-02-10 02:20:04:424835: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:20:04:425189: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:20:04:792758: [root@10.204.216.232] out:
2017-02-10 02:20:04:793003:
2017-02-10 02:20:04:793211: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:20:24:813719: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:20:24:982848: [root@10.204.216.232] out:
2017-02-10 02:20:24:983210:
2017-02-10 02:20:24:983488: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:20:24:983839: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:20:25:303153: [root@10.204.216.232] out:
2017-02-10 02:20:25:303487:
2017-02-10 02:20:25:306648: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:20:45:327167: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:20:45:496326: [root@10.204.216.232] out:
2017-02-10 02:20:45:496744:
2017-02-10 02:20:45:497050: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:20:45:497426: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:20:45:833254: [root@10.204.216.232] out:
2017-02-10 02:20:45:833597:
2017-02-10 02:20:45:837014: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:21:05:855786: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:21:06:024650: [root@10.204.216.232] out:
2017-02-10 02:21:06:025158:
2017-02-10 02:21:06:025431: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:21:06:025789: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:21:06:361193: [root@10.204.216.232] out:
2017-02-10 02:21:06:361751:
2017-02-10 02:21:06:362033: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:21:26:377378: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:21:26:546517: [root@10.204.216.232] out:
2017-02-10 02:21:26:546795:
2017-02-10 02:21:26:547057: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:21:26:547473: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:21:26:883178: [root@10.204.216.232] out:
2017-02-10 02:21:26:883709:
2017-02-10 02:21:26:886941: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:21:46:903798: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:21:47:072788: [root@10.204.216.232] out:
2017-02-10 02:21:47:073328:
2017-02-10 02:21:47:073624: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:21:47:073909: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:21:47:409131: [root@10.204.216.232] out:
2017-02-10 02:21:47:409666:
2017-02-10 02:21:47:412611: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:22:07:433095: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:22:07:601925: [root@10.204.216.232] out:
2017-02-10 02:22:07:602535:
2017-02-10 02:22:07:602818: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:22:07:603164: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:22:07:938649: [root@10.204.216.232] out:
2017-02-10 02:22:07:938868:
2017-02-10 02:22:07:942407: [root@10.204.216.232] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-02-10 02:22:27:951572: [root@10.204.216.232] out: ('CentOS Linux', '7.1.1503', 'Core')
2017-02-10 02:22:28:120417: [root@10.204.216.232] out:
2017-02-10 02:22:28:120955:
2017-02-10 02:22:28:121238: [root@10.204.216.232] sudo: service contrail-control status
2017-02-10 02:22:28:121608: [root@10.204.216.232] out: contrail-control FATAL Exited too quickly (process log may have details)
2017-02-10 02:22:28:456999: [root@10.204.216.232] out:
2017-02-10 02:22:28:457557:
2017-02-10 02:22:28:457870: Disconnecting from 10.204.216.232... done.
2017-02-10 02:22:48:480286: Disconnecting from stack@10.204.216.49... done.
2017-02-10 02:22:48:594522: Service contrail-control not running.
2017-02-10 02:22:48:594720: Connection to 10.204.216.232 closed.
+ rv=1
+ return 1
+ debug_and_die 'fab setup_interface or setup_all task failed'
+ local 'message=fab setup_interface or setup_all task failed'

Pavana (pavanap)
information type: Proprietary → Public
Pavana (pavanap)
summary: - [4.0.0.0-3038] Centos7.1: fab setup_interface fails as contrail-control
- fails to start
+ [4.0.0.0-3038] Centos7.1: fab setup_all fails as contrail-control fails
+ to start
Revision history for this message
Pavana (pavanap) wrote :
Download full text (5.0 KiB)

Along with this issue, contrail-control and contrail-dns crashed on build 3039 at 'rapidjson::internal::Stack<rapidjson::CrtAllocator>::Destroy()'

Backtrace -

Core was generated by `/usr/bin/contrail-control'.
Program terminated with signal 6, Aborted.
#0 0x00002b47665715d7 in raise () from /lib64/libc.so.6
#0 0x00002b47665715d7 in raise () from /lib64/libc.so.6
#1 0x00002b4766572cc8 in abort () from /lib64/libc.so.6
#2 0x00002b47665b1e07 in __libc_message () from /lib64/libc.so.6
#3 0x00002b47665b91fd in _int_free () from /lib64/libc.so.6
#4 0x0000000000796c60 in rapidjson::internal::Stack<rapidjson::CrtAllocator>::Destroy() ()
#5 0x0000000000795dec in rapidjson::internal::Stack<rapidjson::CrtAllocator>::~Stack() ()
#6 0x0000000000795a5d in rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>::~GenericDocument() ()
#7 0x00002b4763c86c27 in cass::MetadataBase::add_json_map_field(int, cass::Row const*, std::string const&) () from /lib64/libcassandra.so.2
#8 0x00002b4763c86efa in cass::KeyspaceMetadata::update(int, cass::SharedRefPtr<cass::RefBuffer> const&, cass::Row const*) () from /lib64/libcassandra.so.2
#9 0x00002b4763c87174 in cass::Metadata::InternalData::update_keyspaces(int, cass::ResultResponse*, std::map<std::string, cass::KeyspaceMetadata, std::less<std::string>, std::allocator<std::pair<std::string const, cass::KeyspaceMetadata> > >&) () from /lib64/libcassandra.so.2
#10 0x00002b4763c87300 in cass::Metadata::update_keyspaces(cass::ResultResponse*) () from /lib64/libcassandra.so.2
#11 0x00002b4763c66521 in cass::ControlConnection::on_query_meta_all(cass::ControlConnection*, cass::ControlConnection::QueryMetadataAllData const&, std::vector<cass::SharedRefPtr<cass::Response>, std::allocator<cass::SharedRefPtr<cass::Response> > > const&) () from /lib64/libcassandra.so.2
#12 0x00002b4763c5e77e in cass::Connection::consume(char*, unsigned long) ()
   from /lib64/libcassandra.so.2
#13 0x00002b4763c5f921 in cass::Connection::on_read(uv_stream_s*, long, uv_buf_t const*) () from /lib64/libcassandra.so.2
#14 0x00002b4768f497a4 in uv__read () from /lib64/libuv.so.1
#15 0x00002b4768f49f0c in uv__stream_io () from /lib64/libuv.so.1
#16 0x00002b4768f4ec05 in uv__io_poll () from /lib64/libuv.so.1
#17 0x00002b4768f415d2 in uv_run () from /lib64/libuv.so.1
#18 0x00002b4763caf445 in cass::LoopThread::on_run_internal(void*) ()
   from /lib64/libcassandra.so.2
#19 0x00002b4768f4b937 in uv__thread_start () from /lib64/libuv.so.1
#20 0x00002b47656cbdf5 in start_thread () from /lib64/libpthread.so.0
#21 0x00002b47666321ad in clone () from /lib64/libc.so.6

Core was generated by `/usr/bin/contrail-dns'.
Program terminated with signal 6, Aborted.
#0 0x00002b7426f935d7 in raise () from /lib64/libc.so.6
#0 0x00002b7426f935d7 in raise () from /lib64/libc.so.6
#1 0x00002b7426f94cc8 in abort () from /lib64/libc.so.6
#2 0x00002b7426fd3e07 in __libc_message () from /lib64/libc.so.6
#3 0x00002b7426fdb1fd in _int_free () from /lib64/libc.so.6
#4 0x0000000000d2f9c4 in rapidjson::internal::Stack<rapidjson::CrtAllocator>::Destroy() ()
#5 0x0000000000d2df7c in rapidjson::...

Read more...

Revision history for this message
Pavana (pavanap) wrote :

Verified on build 3040; issue is not seen anymore

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.