juju config ceph-fs ceph-public-network=aaaa:bbbb:cccc:dddd::/64 does not update /etc/ceph/ceph.conf

[Doug Parrish]

Pulled the ceph-fs charm from openstack-charmers-next/xenial the afternoon of 2017-01-19 as a local copy.

$ juju deploy /path/to/ceph-fs --constraints 'tags=ceph-fs'
$ juju add-relation ceph-fs ceph-mon

juju status showed unit was active/idle

Realized config settings were not made available during juju deploy, added to config via 'juju config'

$ juju config ceph-fs ceph-public-network=aaaa:bbbb:cccc:dddd::/64
$ juju config ceph-fs ceph-cluster-network=aaaa:bbbb:cccc:eeee::/64

Juju config ceph-fs showed values were stored by Juju, but neither was the ceph-fs unit machine's /etc/ceph/ceph.conf updated nor was ceph-mds.service restarted.

[Chris Holcombe (xfactor973)]

CephFS only makes use of the public network: http://docs.ceph.com/docs/master/rados/configuration/network-config-ref/ I'll add a patch today to support that.

[Jorge Niedbalski (niedbalski)]

@xfactor973

I am seeing the following traceback while deploying from ($ juju deploy cs:~openstack-charmers/ceph-fs)

unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.juju-log server.go:268 ceph-mds:73: Invoking reactive handler: reactive/ceph_fs.py:80:config_changed
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 Traceback (most recent call last):
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 File "/usr/local/lib/python3.5/dist-packages/netaddr/strategy/ipv4.py", line 125, in str_to_int
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 return _struct.unpack('>I', _inet_pton(AF_INET, addr))[0]
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 OSError: illegal IP address string passed to inet_pton
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 During handling of the above exception, another exception occurred:
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 Traceback (most recent call last):
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 File "/usr/local/lib/python3.5/dist-packages/netaddr/ip/__init__.py", line 311, in __init__
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 self._value = self._module.str_to_int(addr, flags)
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 File "/usr/local/lib/python3.5/dist-packages/netaddr/strategy/ipv4.py", line 129, in str_to_int
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 raise AddrFormatError('%r is not a valid IPv4 address string!' % addr)
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 netaddr.core.AddrFormatError: '::1' is not a valid IPv4 address string!
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 During handling of the above exception, another exception occurred:
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 Traceback (most recent call last):
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 File "/usr/local/lib/python3.5/dist-packages/netaddr/ip/__init__.py", line 791, in parse_ip_network
unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 ip = IPAddress(val1, module.version, fla...

[Felipe Reyes (freyes)]

On Mon, Mar 06, 2017 at 09:52:17PM -0000, Jorge Niedbalski wrote:
> unit-ceph-fs-4[2718]: 2017-03-06 20:32:16 INFO unit.ceph-fs/4.ceph-mds-relation-changed logger.go:40 File "/usr/local/lib/python3.5/dist-packages/netaddr/strategy/ipv4.py", line 125, in str_to_int

something that caught my attention, this charm is using netaddr from
/usr/local, probably pulled in via pip, is there any reason to do that?

[Chris Holcombe (xfactor973)]

It's a charmhelpes package. This same code is in the ceph-mon code and I pulled it out of there for ceph-fs. So this problem is likely to happen there also.

[Felipe Reyes (freyes)]

On Tue, Mar 07, 2017 at 05:54:35PM -0000, Chris Holcombe wrote:
> It's a charmhelpes package. This same code is in the ceph-mon code and
> I pulled it out of there for ceph-fs. So this problem is likely to
> happen there also.

Never paid attention to it before, thanks for clarifying this :)

[Jorge Niedbalski (niedbalski)]

I created a separated bug for handling the fix of my comment #3 https://bugs.launchpad.net/charm-ceph-fs/+bug/1671861