Error connect to external ceph cluster

Bug #1850008 reported by BN
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
Invalid
Undecided
Unassigned

Bug Description

Hello,

**Bug Report**

What happened: Configured ceph cluster using ceph-ansible. Deployed openstack, once I am trying to add an image, getting an error.

What you expected to happen: Image shall be added.

How to reproduce it (minimal and precise): Following this guide https://docs.openstack.org/kolla-ansible/latest/reference/storage/external-ceph-guide.html

**Environment**:
* OS (e.g. from /etc/os-release): Ubuntu 18.04
* Kernel (e.g. `uname -a`): 4.15.0-45-generic #48-Ubuntu SMP Tue Jan 29 16:28:13 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
* Docker version if applicable (e.g. `docker version`): 19.03.4
* Kolla-Ansible version (e.g. `git head or tag or stable branch` or pip package version if using release):
* Docker image Install type (source/binary): source
* Docker image distribution: ubuntu
* Are you using official images from Docker Hub or self built? official
* If self built - Kolla version and environment used to build:
* Share your inventory file, globals.yml and other configuration files if relevant

globals.yml - https://pastebin.com/eq4Q9BFL

Error glance-api.log - https://pastebin.com/TqSYfEZ0

ceph.conf - https://pastebin.com/HrG3fne3

ls of /etc/kolla/config folders + client.glance key - https://pastebin.com/q2xi3HKM

glance-api.conf - https://pastebin.com/h9Va5v9y

Ceph:

Pools and clients were created using that doc https://docs.ceph.com/docs/master/rbd/rbd-openstack/ ;
I added keyrings and ceph.conf in /etc/kolla/config folder; I could not assign chown to those since those accounts are not associated with the host machine and shall be working inside container therefore, rbd_user=glance,cinder,nova should be working.

ceph osd lspools:

1 volumes
2 images
3 backups
4 vms
5 .rgw.root
6 default.rgw.control
7 default.rgw.meta
8 default.rgw.log

ceph all.yml file:

ceph_origin: repository
ceph_repository: community
ceph_stable_release: nautilus
public_network: "10.0.0.0/16"
monitor_interface: enp2s0f0
radosgw_interface: enp2s0f0
devices:
  - '/dev/sdb'

ceph nodes:
[mons]
localhost ansible_connection=local become=true

[mgrs]
localhost ansible_connection=local become=true

[rgws]
localhost ansible_connection=local become=true
10.0.2.1 ansible_user=root ansible_become=true
10.0.3.1 ansible_user=root ansible_become=true

[osds]
localhost ansible_connection=local become=true
10.0.2.1 ansible_user=root ansible_become=true
10.0.3.1 ansible_user=root ansible_become=true

[grafana-server]
localhost ansible_connection=local become=true

I would really appreciate if you can suggest any debugging steps so I can fix that issue. Thank you

Revision history for this message
Radosław Piliszek (yoctozepto) wrote :

The problem is in ceph.conf:
mon host = [v2:10.0.1.1:3300,v1:10.0.1.1:6789]

Ceph client components (as deployed with kolla) do not yet understand the new syntax. Please use the old, compatible one:
mon host = 10.0.1.1

Changed in kolla-ansible:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.