SM provisioning of add new controller stuck @ config_started
Affects | Status | Importance | Assigned to | Milestone | ||
---|---|---|---|---|---|---|
Juniper Openstack | Status tracked in Trunk | |||||
Trunk |
Fix Committed
|
Critical
|
Thilak Raj |
Bug Description
Server-manager provisioning of add new controller stuck @ config_started.
Development Thilak debugged the setup and looks possible mysql restarted issue post openstack completion.
Steps Involved in seeing this problem,
1) provision remove 1 existing controller
2) provision add 1 new controller
root@Blaster-
{
"server": [
{
"id": "a5d11e36",
},
{
"id": "a5d11e14",
},
{
"id": "a5d11e13",
},
{
"id": "a5d11e12",
},
{
"id": "a5d11e10",
},
{
"id": "a5d11e09",
}
]
}
root@a5d11e36:~#
root@a5d11e36:~# ps -ef | grep mysql
root 16737 27856 0 15:12 pts/2 00:00:00 grep --color=auto mysql
root 17716 1 0 11:57 ? 00:00:00 /bin/sh /usr/bin/
mysql 19149 17716 1 11:57 ? 00:03:08 /usr/sbin/mysqld --basedir=/usr --datadir=
root@a5d11e36:~#
root@a5d11e36:~#
root@a5d11e36:~#
root@a5d11e36:~# vi /var/log/
160125 17:47:29 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
160125 17:47:29 mysqld_safe WSREP: Running position recovery with --log_error=
160125 17:47:33 mysqld_safe WSREP: Recovered position 00000000-
160125 17:47:33 [Note] WSREP: wsrep_start_
160125 17:47:33 [Note] Plugin 'FEDERATED' is disabled.
160125 17:47:33 InnoDB: The InnoDB memory heap is disabled
160125 17:47:33 InnoDB: Mutexes and rw_locks use GCC atomic builtins
160125 17:47:33 InnoDB: Compressed tables use zlib 1.2.3.3
160125 17:47:33 InnoDB: Using Linux native AIO
160125 17:47:33 InnoDB: Initializing buffer pool, size = 128.0M
160125 17:47:33 InnoDB: Completed initialization of buffer pool
160125 17:47:33 InnoDB: highest supported file format is Barracuda.
160125 17:47:33 InnoDB: Waiting for the background threads to start
160125 17:47:34 InnoDB: 5.5.37 started; log sequence number 1595843
160125 17:47:34 [Warning] Failed to setup SSL
160125 17:47:34 [Warning] SSL error: SSL_CTX_
160125 17:47:34 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306
160125 17:47:34 [Note] - '0.0.0.0' resolves to '0.0.0.0';
160125 17:47:34 [Note] Server socket created on IP: '0.0.0.0'.
160125 17:47:34 [Note] Event Scheduler: Loaded 0 events
160125 17:47:34 [Note] WSREP: Read nil XID from storage engines, skipping position init
160125 17:47:34 [Note] WSREP: wsrep_load(): loading provider library 'none'
160125 17:47:34 [Note] [Debug] WSREP: dummy_init
160125 17:47:34 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.5.37' socket: '/var/run/
160125 17:47:52 [Warning] IP address '10.87.143.92' could not be resolved: Name or service not known
160125 17:47:59 [Warning] IP address '10.87.143.94' could not be resolved: Name or service not known
160126 11:57:36 [Note] /usr/sbin/mysqld: Normal shutdown
160126 11:57:36 [Note] Event Scheduler: Purging the queue. 0 events
160126 11:57:38 [Warning] /usr/sbin/mysqld: Forcing close of thread 785343 user: 'nova'
160126 11:57:38 [Warning] /usr/sbin/mysqld: Forcing close of thread 785341 user: 'nova'
contrail-version
Package Version Build-ID | Repo | Package Name
-------
contrail-analytics 3.0-2697 2697
contrail-config 3.0-2697 2697
contrail-
contrail-control 3.0-2697 2697
contrail-dns 3.0-2697 2697
contrail-docs 3.0-2697 2697
contrail-f5 3.0-2697 2697
contrail-
contrail-heat 3.0-2697 2697
contrail-lib 3.0-2697 2697
contrail-nodemgr 3.0-2697 2697
contrail-
contrail-openstack 3.0-2697 2697
contrail-
contrail-
contrail-
contrail-
contrail-
contrail-
contrail-
contrail-setup 3.0-2697 2697
contrail-utils 3.0-2697 2697
contrail-
contrail-web-core 3.0-2697 2697
ifmap-python-client 0.1-2 2697
ifmap-server 0.3.2-1contrail2 2697
neutron-
nova-api 1:2014.
nova-common 1:2014.
nova-conductor 1:2014.
nova-console 1:2014.
nova-consoleauth 1:2014.
nova-novncproxy 1:2014.
nova-objectstore 1:2014.
nova-scheduler 1:2014.
python-contrail 3.0-2697 2697
python-
python-nova 1:2014.
Logs can be found @
-bash-4.1$ nsarath/ PR/PR-1538357
-bash-4.1$ hostname
centos-build02
-bash-4.1$
-bash-4.1$ pwd
/users/
-bash-4.1$
-bash-4.1$ ls -l
total 5329388
-rwxrwxrwx 1 nsarath test 5435883520 Jan 26 15:52 1-log.tar*
-bash-4.1$