Master node installation failed because keystone-manage could not write to log

[Dmitry Mescheryakov]

Version: 10.0

Steps to reproduce:
1. Install master node

Expected result:
Installation finishes successfully

Actual result:
Installation fails. The earliest error in /var/log/puppet/bootstrap_admin_node.log is keystone-manage failure:
http://paste.openstack.org/show/497038/

The log file is owned by root and interestengly it contains some SQL errors:
[root@nailgun ~]# ls -l /var/log/keystone/keystone-manage.log
-rw-r--r--. 1 root root 35469 May 13 01:14 /var/log/keystone/keystone-manage.log

Both files and /var/lib/pgsql/data/pg_log/postgresql-Fri.log will be attached to the bug.

Here is the failed job:
https://packaging-ci.infra.mirantis.net/job/master-pkg-systest-ubuntu/829/

It is worth noticing that this a single failure, while a number of jobs around that one succeeded.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/316286

[Maksim Malchuk (mmalchuk)]

Mitaka also affected by this floating issue.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/316286
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=ca6143b58aa0c027344f49cab2794f6332574edb
Submitter: Jenkins
Branch: master

commit ca6143b58aa0c027344f49cab2794f6332574edb
Author: Maksim Malchuk <email address hidden>
Date: Fri May 13 23:49:01 2016 +0300

    Fix 'keystone-flush-token' cron job

    This cron job should be executed only if the 'openstack-keystone'
    package installed and under the 'keystone' user rights.
    This commit also contains some styling cleanups.

    Change-Id: If870d160f5efb7ef1e498a2b868726f9c5b7a816
    Closes-Bug: #1581469
    Signed-off-by: Maksim Malchuk <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/316435

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/316435
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=8ae6792edc6a5890c75694275dcc42a67d0dbbaa
Submitter: Jenkins
Branch: stable/mitaka

commit 8ae6792edc6a5890c75694275dcc42a67d0dbbaa
Author: Maksim Malchuk <email address hidden>
Date: Fri May 13 23:49:01 2016 +0300

    Fix 'keystone-flush-token' cron job

    This cron job should be executed only if the 'openstack-keystone'
    package installed and under the 'keystone' user rights.
    This commit also contains some styling cleanups.

    Change-Id: If870d160f5efb7ef1e498a2b868726f9c5b7a816
    Closes-Bug: #1581469
    Signed-off-by: Maksim Malchuk <email address hidden>
    (cherry picked from commit ca6143b58aa0c027344f49cab2794f6332574edb)

[Dmitriy Kruglov (dkruglov)]

Verified on MOS 9.0, ISO #467.
The master deploy has been successfully performed 30 times in a row.