mysql status shown inactive after provisioning and goes down after reboot

Bug #1537945 reported by Sarath
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.0
New
High
Unassigned
R3.0.2.x
Won't Fix
Critical
Unassigned
R3.1
Fix Committed
Critical
Dheeraj Gautam
R3.2
Fix Committed
High
Dheeraj Gautam
Trunk
Fix Committed
Critical
Dheeraj Gautam

Bug Description

mysql status shown inactive after provisioning and goes down after reboot

root@a5d11e14:~#
root@a5d11e14:~# openstack-status
== Nova services ==
openstack-nova-api: active
openstack-nova-compute: inactive (disabled on boot)
openstack-nova-network: inactive (disabled on boot)
openstack-nova-scheduler: active
openstack-nova-volume: inactive (disabled on boot)
openstack-nova-conductor: active
== Glance services ==
openstack-glance-api: active
openstack-glance-registry: active
== Keystone service ==
openstack-keystone: active
== Cinder services ==
openstack-cinder-api: active
openstack-cinder-scheduler: active
openstack-cinder-volume: inactive (disabled on boot)
== Support services ==
mysql: inactive (disabled on boot)
rabbitmq-server: active
memcached: inactive (disabled on boot)
== Keystone users ==
+----------------------------------+----------+---------+--------------------+
| id | name | enabled | email |
+----------------------------------+----------+---------+--------------------+
| a8b42151f2884a4b8fa07d6b3181a99b | admin | True | <email address hidden> |
| 7e99a0675d054f5ebe7d09bb1d9531d5 | cinder | True | cinder@localhost |
| 4380ba96464a4c00ad64aa61772d8e5b | demo | True | <email address hidden> |
| 0a0f9fdd3f064d8f884537612279591e | glance | True | glance@localhost |
| 4b25bd2079b84d33ac651cb05690331f | heat | True | heat@localhost |
| 54f3b91a09ff4271a4eada17e0dd8abe | heat-cfn | True | heat-cfn@localhost |
| 9bea91498612496abf7375c05a0b6e5d | neutron | True | neutron@localhost |
| b58863d788f34b1b9c224f9039d3cbde | nova | True | nova@localhost |
| b3cb958c15f64dac8004f191013f4bca | test | True | <email address hidden> |
+----------------------------------+----------+---------+--------------------+
== Glance images ==
+--------------------------------------+--------+-------------+------------------+---------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+--------------------------------------+--------+-------------+------------------+---------+--------+
| e87da939-446c-4529-8262-cdc856210a5a | cirros | qcow2 | ovf | 9761280 | active |
+--------------------------------------+--------+-------------+------------------+---------+--------+
== Nova instance flavors ==
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| 1 | m1.tiny | 512 | 1 | 0 | | 1 | 1.0 | True |
| 2 | m1.small | 2048 | 20 | 0 | | 1 | 1.0 | True |
| 3 | m1.medium | 4096 | 40 | 0 | | 2 | 1.0 | True |
| 4 | m1.large | 8192 | 80 | 0 | | 4 | 1.0 | True |
| 5 | m1.xlarge | 16384 | 160 | 0 | | 8 | 1.0 | True |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
== Nova instances ==
+--------------------------------------+------+--------+------------+-------------+-------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+------+--------+------------+-------------+-------------------+
| 6d19512b-8a9b-4721-b8b3-f00f5d6c0855 | vm1 | ACTIVE | - | Running | testvn=30.30.30.3 |
+--------------------------------------+------+--------+------------+-------------+-------------------+
root@a5d11e14:~#

root@a5d11e14:~#
root@a5d11e14:~# ps -aux | grep mysql
root 10674 0.0 0.0 4440 776 ? S 12:52 0:00 /bin/sh /usr/bin/mysqld_safe --wsrep_cluster_address=gcomm://
mysql 12063 5.3 0.6 18867372 315192 ? Sl 12:52 6:53 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib/mysql/plugin --user=mysql --wsrep-cluster-address=gcomm:// --log-error=/var/log/mysql/error.log --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/run/mysqld/mysqld.sock --port=3306 --wsrep_start_position=00000000-0000-0000-0000-000000000000:-1
root 14254 0.0 0.0 10464 936 pts/6 S+ 15:01 0:00 grep --color=auto mysql
root@a5d11e14:~#

root@a5d11e14:~# contrail-version
Package Version Build-ID | Repo | Package Name
-------------------------------------- ------------------------------ ----------------------------------
contrail-analytics 3.0-2697 2697
contrail-config 3.0-2697 2697
contrail-config-openstack 3.0-2697 2697
contrail-control 3.0-2697 2697
contrail-dns 3.0-2697 2697
contrail-docs 3.0-2697 2697
contrail-f5 3.0-2697 2697
contrail-fabric-utils 3.0-2697 2697
contrail-heat 3.0-2697 2697
contrail-lib 3.0-2697 2697
contrail-nodemgr 3.0-2697 2697
contrail-nova-networkapi 3.0-2697 2697
contrail-openstack 3.0-2697 2697
contrail-openstack-analytics 3.0-2697 2697
contrail-openstack-config 3.0-2697 2697
contrail-openstack-control 3.0-2697 2697
contrail-openstack-dashboard 3.0-2697 2697
contrail-openstack-database 3.0-2697 2697
contrail-openstack-ha 3.0-2697 2697
contrail-openstack-webui 3.0-2697 2697
contrail-setup 3.0-2697 2697
contrail-utils 3.0-2697 2697
contrail-web-controller 3.0-2697 2697
contrail-web-core 3.0-2697 2697
ifmap-python-client 0.1-2 2697
ifmap-server 0.3.2-1contrail2 2697
neutron-plugin-contrail 3.0-2697 2697
nova-api 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-common 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-conductor 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-console 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-consoleauth 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-novncproxy 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-objectstore 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-scheduler 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
python-contrail 3.0-2697 2697
python-neutronclient 1:2.3.8-0ubuntu1~cloud0.2contrail2697
python-nova 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
root@a5d11e14:~#
root@a5d11e14:~#
root@a5d11e14:~#

Revision history for this message
Sarath (nsarath) wrote :

Logs can be found @

-bash-4.1$
-bash-4.1$ hostname
centos-build02
-bash-4.1$
-bash-4.1$ pwd
/users/nsarath/PR/Bug-1537945
-bash-4.1$
-bash-4.1$ ls -l
total 152480
-rw-r--r-- 1 nsarath test 155525120 Jan 25 15:31 Ctrl-1-log
-bash-4.1$

Sarath (nsarath)
tags: added: server-manager
summary: - mysql status shown inactive but operationally good
+ mysql status shown inactive after provisioning and goes down after
+ reboot
description: updated
Changed in juniperopenstack:
importance: High → Critical
Abhay Joshi (abhayj)
Changed in juniperopenstack:
assignee: nobody → Thilak Raj (tsurendra)
Changed in juniperopenstack:
milestone: r3.0-fcs → none
Revision history for this message
Abhay Joshi (abhayj) wrote :

Sarath,

Please try latest 3.1 and mainline and provide setup to Dheeraj.

Revision history for this message
Dheeraj Gautam (dgautam) wrote :

Findings so far:
================
Two issues reported in this bug are, wrong status reported by openstack-status and mysql not coming up after reboot.

openstack-status reports mysql as inactive (disabled on boot), even though mysql is running.

== Support services ==
mysql: inactive (disabled on boot)
libvirt-bin: active
rabbitmq-server: active
memcached: inactive (disabled on boot)
== Keystone users ==
Warning keystonerc not sourced
root@blaster-dgautam05:~# ps ax | grep mysql
19125 ? SN 0:00 /bin/sh /usr/bin/mysqld_safe
20525 ? SNl 2:59 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib/mysql/plugin --user=mysql --log-error=/var/log/mysql/error.log --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/run/mysqld/mysqld.sock --port=3306 --wsrep_start_position=a8dae4c3-a30a-11e6-8f7f-773b1e577d7d:216982
22721 pts/2 S+ 0:00 grep --color=auto mysql
root@blaster-dgautam05:~#

for mysql not coming up after reboot, This is not a SM related issue as same issue has been reported in fab as well. see https://bugs.launchpad.net/juniperopenstack/+bug/1611566

Revision history for this message
Dheeraj Gautam (dgautam) wrote :

Marking it as fixed based on related fab bug https://bugs.launchpad.net/juniperopenstack/+bug/1611566. Also as of now SM shares a script with fab provisioning.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.