| 2018-11-16 15:03:27 |
Marek Grudzinski |
description |
Deployed with kolla-ansible==7.0.0, openstack_release="rocky"
Kolla-ansible is being run in a venv.
Deploying a very vanilla multinode setup. External ceph, all core services & some logging. In addition to this all telemetry services, which aren't deploying properly.
#globals.yml
kolla_base_distro: "ubuntu"
kolla_install_type: "source"
openstack_release: "rocky"
node_custom_config: "/etc/kolla/config"
kolla_internal_vip_address: "192.168.9.8"
kolla_external_vip_address: "192.168.9.9"
network_interface: "eno1"
api_interface: "eno1"
storage_interface: "ens4.20"
tunnel_interface: "ens4.40"
neutron_external_interface: "ens4"
neutron_plugin_agent: "openvswitch"
enable_neutron_provider_networks: "yes"
kolla_enable_tls_external: "yes"
kolla_external_fqdn_cert: "{{ node_config_directory }}/certificates/haproxy.pem"
enable_aodh: "yes"
enable_ceilometer: "yes"
enable_central_logging: "yes"
enable_ceph: "no"
enable_chrony: "yes"
enable_cinder: "yes"
enable_cinder_backup: "no"
enable_cinder_backend_hnas_iscsi: "no"
enable_cinder_backend_hnas_nfs: "no"
enable_cinder_backend_iscsi: "no"
enable_cinder_backend_lvm: "no"
enable_cinder_backend_nfs: "no"
enable_fluentd: "yes"
enable_gnocchi: "yes"
enable_haproxy: "yes"
enable_heat: "yes"
enable_horizon: "yes"
enable_openvswitch: "{{ neutron_plugin_agent != 'linuxbridge' }}"
enable_panko: "yes"
enable_redis: "yes"
external_ceph_cephx_enabled: "yes"
enable_ceph_dashboard: "yes"
enable_ceph_rgw_keystone: "yes"
keystone_token_provider: 'fernet'
glance_backend_ceph: "yes"
panko_database_type: "mysql"
gnocchi_backend_storage: "ceph"
gnocchi_pool_name: "metrics"
gnocchi_incoming_storage: "{{ 'redis' if enable_redis | bool else '' }}"
cinder_backend_ceph: "yes"
nova_backend_ceph: "yes"
nova_compute_virt_type: "kvm"
All goes well until kolla-ansible gets to: TASK [gnocchi : Running gnocchi bootstrap container]
This fails with:
2018-11-15 10:58:14,406 [17] INFO gnocchi.service: Gnocchi version 4.3.0
2018-11-15 10:58:14,724 [17] WARNING py.warnings: /var/lib/kolla/venv/local/lib/python2.7/site-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip install psycopg2-binary" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
""")
2018-11-15 10:58:14,898 [17] INFO gnocchi.cli.manage: Upgrading indexer SQLAlchemyIndexer: mysql+pymysql://gnocchi:cti3WaxzusGwKNbVIvaZUB8xPPCC5VMdNtew3ACB@192.168.9.8:3306/gnocchi
2018-11-15 10:58:15,004 [17] INFO gnocchi.common.ceph: Ceph storage backend use 'cradox' python library
2018-11-15 10:58:15,021 [17] INFO gnocchi.cli.manage: Upgrading storage CephStorage: 73f8c334-2b4d-456a-b13c-d691ddd3ce37
2018-11-15 10:58:15,024 [17] ERROR gnocchi.utils: Unable to initialize incoming driver
Traceback (most recent call last):
File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/tenacity/__init__.py", line 333, in call
result = fn(*args, **kwargs)
File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/gnocchi/incoming/__init__.py", line 268, in get_driver
conf.incoming, conf.metricd.greedy)
File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/gnocchi/incoming/redis.py", line 59, in __init__
self._client, self._scripts = redis.get_client(conf, self._SCRIPTS)
File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/redis/client.py", line 986, in __getitem__
raise KeyError(name)
I have also tried using tooz as coordinator but it fails as well, I will try to post those logs a bit later.
I believe the solution is to upgrade the gnocchi pip package that is installed, gnocchi==4.3.0 (in the /va/lib/kolla/venv).
Upgrading this to gnocchi==4.3.2 and rerunning gnocchi-upgrade fixes the problem.
Can someone confirm? I'm still new to kolla-ansible & kolla. I will try to build a new base-image later. |
Deployed with kolla-ansible==7.0.0, openstack_release="rocky"
Kolla-ansible is being run in a venv.
Deploying a very vanilla multinode setup. External ceph (mimic 13.2.2), all core services & some logging. In addition to this all telemetry services, which aren't deploying properly.
#globals.yml
kolla_base_distro: "ubuntu"
kolla_install_type: "source"
openstack_release: "rocky"
node_custom_config: "/etc/kolla/config"
kolla_internal_vip_address: "192.168.9.8"
kolla_external_vip_address: "192.168.9.9"
network_interface: "eno1"
api_interface: "eno1"
storage_interface: "ens4.20"
tunnel_interface: "ens4.40"
neutron_external_interface: "ens4"
neutron_plugin_agent: "openvswitch"
enable_neutron_provider_networks: "yes"
kolla_enable_tls_external: "yes"
kolla_external_fqdn_cert: "{{ node_config_directory }}/certificates/haproxy.pem"
enable_aodh: "yes"
enable_ceilometer: "yes"
enable_central_logging: "yes"
enable_ceph: "no"
enable_chrony: "yes"
enable_cinder: "yes"
enable_cinder_backup: "no"
enable_cinder_backend_hnas_iscsi: "no"
enable_cinder_backend_hnas_nfs: "no"
enable_cinder_backend_iscsi: "no"
enable_cinder_backend_lvm: "no"
enable_cinder_backend_nfs: "no"
enable_fluentd: "yes"
enable_gnocchi: "yes"
enable_haproxy: "yes"
enable_heat: "yes"
enable_horizon: "yes"
enable_openvswitch: "{{ neutron_plugin_agent != 'linuxbridge' }}"
enable_panko: "yes"
enable_redis: "yes"
external_ceph_cephx_enabled: "yes"
enable_ceph_dashboard: "yes"
enable_ceph_rgw_keystone: "yes"
keystone_token_provider: 'fernet'
glance_backend_ceph: "yes"
panko_database_type: "mysql"
gnocchi_backend_storage: "ceph"
gnocchi_pool_name: "metrics"
gnocchi_incoming_storage: "{{ 'redis' if enable_redis | bool else '' }}"
cinder_backend_ceph: "yes"
nova_backend_ceph: "yes"
nova_compute_virt_type: "kvm"
All goes well until kolla-ansible gets to: TASK [gnocchi : Running gnocchi bootstrap container]
This fails with:
2018-11-15 10:58:14,406 [17] INFO gnocchi.service: Gnocchi version 4.3.0
2018-11-15 10:58:14,724 [17] WARNING py.warnings: /var/lib/kolla/venv/local/lib/python2.7/site-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip install psycopg2-binary" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
""")
2018-11-15 10:58:14,898 [17] INFO gnocchi.cli.manage: Upgrading indexer SQLAlchemyIndexer: mysql+pymysql://gnocchi:cti3WaxzusGwKNbVIvaZUB8xPPCC5VMdNtew3ACB@192.168.9.8:3306/gnocchi
2018-11-15 10:58:15,004 [17] INFO gnocchi.common.ceph: Ceph storage backend use 'cradox' python library
2018-11-15 10:58:15,021 [17] INFO gnocchi.cli.manage: Upgrading storage CephStorage: 73f8c334-2b4d-456a-b13c-d691ddd3ce37
2018-11-15 10:58:15,024 [17] ERROR gnocchi.utils: Unable to initialize incoming driver
Traceback (most recent call last):
File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/tenacity/__init__.py", line 333, in call
result = fn(*args, **kwargs)
File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/gnocchi/incoming/__init__.py", line 268, in get_driver
conf.incoming, conf.metricd.greedy)
File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/gnocchi/incoming/redis.py", line 59, in __init__
self._client, self._scripts = redis.get_client(conf, self._SCRIPTS)
File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/redis/client.py", line 986, in __getitem__
raise KeyError(name)
I have also tried using tooz as coordinator but it fails as well, I will try to post those logs a bit later.
I believe the solution is to upgrade the gnocchi pip package that is installed, gnocchi==4.3.0 (in the /va/lib/kolla/venv).
Upgrading this to gnocchi==4.3.2 and rerunning gnocchi-upgrade fixes the problem.
Can someone confirm? I'm still new to kolla-ansible & kolla. I will try to build a new base-image later. |
|
