Comment 0 for bug 1884919

Revision history for this message
Malware (swiegand) wrote : Ceilomerter deployment with kolla ansible fails on bootstrap

**Bug Report**

I installed the core services of Openstack(currently eval AIO) using master branch of kolla and kolla ansible.
After first fire up I activated AODH, gnocchi and ceilometer.

What happened:

TASK [ceilometer : Running Ceilometer bootstrap container] **************************************************************************************************************************************************************************************************
fatal: [10.253.90.10 -> 10.253.90.10]: FAILED! => {"changed": true, "msg": "Container exited with non-zero return code 2", "rc": 2, "stderr": "+ sudo -E kolla_set_configs\nINFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json\nINFO:__main__:Validating config file\nINFO:__main__:Kolla config strategy set to: COPY_ALWAYS\nINFO:__main__:Copying service configuration files\nINFO:__main__:Deleting /etc/ceilometer/ceilometer.conf\nINFO:__main__:Copying /var/lib/kolla/config_files/ceilometer.conf to /etc/ceilometer/ceilometer.conf\nINFO:__main__:Setting permission for /etc/ceilometer/ceilometer.conf\nINFO:__main__:Deleting /etc/ceilometer/event_definitions.yaml\nINFO:__main__:Copying /var/lib/kolla/config_files/event_definitions.yaml to /etc/ceilometer/event_definitions.yaml\nINFO:__main__:Setting permission for /etc/ceilometer/event_definitions.yaml\nINFO:__main__:Deleting /etc/ceilometer/event_pipeline.yaml\nINFO:__main__:Copying /var/lib/kolla/config_files/event_pipeline.yaml to /etc/ceilometer/event_pipeline.yaml\nINFO:__main__:Setting permission for /etc/ceilometer/event_pipeline.yaml\nINFO:__main__:Deleting /etc/ceilometer/pipeline.yaml\nINFO:__main__:Copying /var/lib/kolla/config_files/pipeline.yaml to /etc/ceilometer/pipeline.yaml\nINFO:__main__:Setting permission for /etc/ceilometer/pipeline.yaml\nINFO:__main__:Writing out command to execute\n++ cat /run_command\n+ CMD=ceilometer-agent-notification\n+ ARGS=\n+ sudo kolla_copy_cacerts\n+ [[ ! -n '' ]]\n+ . kolla_extend_start\n++ CEILOMETER_LOG_DIR=/var/log/kolla/ceilometer\n++ [[ ! -d /var/log/kolla/ceilometer ]]\n++ mkdir -p /var/log/kolla/ceilometer\n+++ stat -c %U:%G /var/log/kolla/ceilometer\n++ [[ ceilometer:kolla != \\c\\e\\i\\l\\o\\m\\e\\t\\e\\r\\:\\k\\o\\l\\l\\a ]]\n+++ stat -c %a /var/log/kolla/ceilometer\n++ [[ 2755 != \\7\\5\\5 ]]\n++ chmod 755 /var/log/kolla/ceilometer\n++ . /usr/local/bin/kolla_ceilometer_extend_start\n+++ [[ -n 0 ]]\n+++ [[ gnocchi == \\g\\n\\o\\c\\c\\h\\i ]]\n+++ ceilometer-upgrade ''\nusage: ceilometer-upgrade [-h] [--config-dir DIR] [--config-file PATH]\n [--debug] [--log-config-append PATH]\n [--log-date-format DATE_FORMAT] [--log-dir LOG_DIR]\n [--log-file PATH] [--nodebug]\n [--noskip-gnocchi-resource-types]\n [--noskip-metering-database] [--nouse-journal]\n [--nouse-json] [--nouse-syslog] [--nowatch-log-file]\n [--retry RETRY] [--skip-gnocchi-resource-types]\n [--skip-metering-database]\n [--syslog-log-facility SYSLOG_LOG_FACILITY]\n [--use-journal] [--use-json] [--use-syslog]\n [--version] [--watch-log-file]\nceilometer-upgrade: error: unrecognized arguments: \n", "stderr_lines": ["+ sudo -E kolla_set_configs", "INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json", "INFO:__main__:Validating config file", "INFO:__main__:Kolla config strategy set to: COPY_ALWAYS", "INFO:__main__:Copying service configuration files", "INFO:__main__:Deleting /etc/ceilometer/ceilometer.conf", "INFO:__main__:Copying /var/lib/kolla/config_files/ceilometer.conf to /etc/ceilometer/ceilometer.conf", "INFO:__main__:Setting permission for /etc/ceilometer/ceilometer.conf", "INFO:__main__:Deleting /etc/ceilometer/event_definitions.yaml", "INFO:__main__:Copying /var/lib/kolla/config_files/event_definitions.yaml to /etc/ceilometer/event_definitions.yaml", "INFO:__main__:Setting permission for /etc/ceilometer/event_definitions.yaml", "INFO:__main__:Deleting /etc/ceilometer/event_pipeline.yaml", "INFO:__main__:Copying /var/lib/kolla/config_files/event_pipeline.yaml to /etc/ceilometer/event_pipeline.yaml", "INFO:__main__:Setting permission for /etc/ceilometer/event_pipeline.yaml", "INFO:__main__:Deleting /etc/ceilometer/pipeline.yaml", "INFO:__main__:Copying /var/lib/kolla/config_files/pipeline.yaml to /etc/ceilometer/pipeline.yaml", "INFO:__main__:Setting permission for /etc/ceilometer/pipeline.yaml", "INFO:__main__:Writing out command to execute", "++ cat /run_command", "+ CMD=ceilometer-agent-notification", "+ ARGS=", "+ sudo kolla_copy_cacerts", "+ [[ ! -n '' ]]", "+ . kolla_extend_start", "++ CEILOMETER_LOG_DIR=/var/log/kolla/ceilometer", "++ [[ ! -d /var/log/kolla/ceilometer ]]", "++ mkdir -p /var/log/kolla/ceilometer", "+++ stat -c %U:%G /var/log/kolla/ceilometer", "++ [[ ceilometer:kolla != \\c\\e\\i\\l\\o\\m\\e\\t\\e\\r\\:\\k\\o\\l\\l\\a ]]", "+++ stat -c %a /var/log/kolla/ceilometer", "++ [[ 2755 != \\7\\5\\5 ]]", "++ chmod 755 /var/log/kolla/ceilometer", "++ . /usr/local/bin/kolla_ceilometer_extend_start", "+++ [[ -n 0 ]]", "+++ [[ gnocchi == \\g\\n\\o\\c\\c\\h\\i ]]", "+++ ceilometer-upgrade ''", "usage: ceilometer-upgrade [-h] [--config-dir DIR] [--config-file PATH]", " [--debug] [--log-config-append PATH]", " [--log-date-format DATE_FORMAT] [--log-dir LOG_DIR]", " [--log-file PATH] [--nodebug]", " [--noskip-gnocchi-resource-types]", " [--noskip-metering-database] [--nouse-journal]", " [--nouse-json] [--nouse-syslog] [--nowatch-log-file]", " [--retry RETRY] [--skip-gnocchi-resource-types]", " [--skip-metering-database]", " [--syslog-log-facility SYSLOG_LOG_FACILITY]", " [--use-journal] [--use-json] [--use-syslog]", " [--version] [--watch-log-file]", "ceilometer-upgrade: error: unrecognized arguments: "], "stdout": "", "stdout_lines": []}

I as far as I can see the issue is related to gnocchi_upgrade und ceilometer_upgrade.
Both commands are run with '' as parameter which cannot be interpreted ("+++ ceilometer-upgrade ''",).

What you expected to happen:
ceilometer_upgrade and gnocchi_upgrade get no parameter attached if BOOSTRAP_PARAMS is empty.

How to reproduce it (minimal and precise):

set up openstack with "out-of-the-box" Kolla and kolla-ansible while activating ceilometer in globals.yml.

**Environment**:
* OS (e.g. from /etc/os-release): Ubuntu 18.04 Server, Debian 10
* Kernel (e.g. `uname -a`): Ubuntu (4.15.0-106-generic), Debian (4.19.0-9-amd64)
* Docker version if applicable (e.g. `docker version`):
Client: Docker Engine - Community
 Version: 19.03.11
 API version: 1.40
 Go version: go1.13.10
 Git commit: 42e35e61f3
 Built: Mon Jun 1 09:12:22 2020
 OS/Arch: linux/amd64
 Experimental: false
* Kolla version (e.g. `git head or tag or stable branch` or pip package version if using release): master