Influxdb charm fails to start

Bug #1809457 reported by Domas Monkus
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
InfluxDB Charm
Fix Released
Undecided
Unassigned

Bug Description

Getting this error when running influx db charm on bionic:

2018-12-21 12:42:40 INFO juju-log Initializing Apt Layer
2018-12-21 12:42:45 DEBUG juju-log PGP key found (looks like ASCII Armor format)
2018-12-21 12:42:45 DEBUG juju-log Importing ASCII Armor PGP key
2018-12-21 12:42:45 INFO juju-log Invoking reactive handler: reactive/influxdb.py:153:create_backup_job
2018-12-21 12:42:45 INFO juju-log NOT removing previous backup directory None
2018-12-21 12:42:45 ERROR juju-log Cannot remove /etc/cron.daily/influxdb-charm-backup - ignoring
2018-12-21 12:42:45 INFO juju-log Invoking reactive handler: reactive/apt.py:38:update
2018-12-21 12:42:45 INFO juju-log status-set: maintenance: Updating apt cache
2018-12-21 12:42:47 INFO juju-log Invoking reactive handler: hooks/relations/http/provides.py:13:broken:admin
2018-12-21 12:42:47 INFO juju-log Invoking reactive handler: reactive/apt.py:43:install_queued
2018-12-21 12:42:47 INFO juju-log status-set: maintenance: Installing build-essential,influxdb,jq,python3-setuptools,python3-wheel,python3-yaml
2018-12-21 12:42:47 INFO juju-log Installing ['build-essential', 'influxdb', 'jq', 'python3-setuptools', 'python3-wheel', 'python3-yaml'] with options: ['--option=Dpkg::Options::=--force-confold']
2018-12-21 12:42:48 INFO juju-log Invoking reactive handler: reactive/influxdb.py:31:install_influx_client
2018-12-21 12:42:48 INFO juju-log Invoking reactive handler: reactive/apt.py:49:ensure_package_status
2018-12-21 12:42:48 INFO juju-log Unholding packages influxdb,python3-setuptools,python3-yaml,jq,build-essential,python3-wheel
2018-12-21 12:42:48 INFO juju-log Marking {'influxdb', 'python3-setuptools', 'python3-yaml', 'jq', 'build-essential', 'python3-wheel'} as unhold
2018-12-21 12:42:48 INFO juju-log Invoking reactive handler: reactive/influxdb.py:42:install_influx
2018-12-21 12:42:48 DEBUG juju-log Changing permissions on existing content: 33188 -> 420
2018-12-21 12:42:49 ERROR juju-log Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/connection.py", line 159, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw)
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/util/connection.py", line 80, in create_connection
    raise err
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/util/connection.py", line 70, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/connection.py", line 181, in connect
    conn = self._new_conn()
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/connection.py", line 168, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f414c92ba58>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/urllib3/util/retry.py", line 398, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=8086): Max retries exceeded with url: /query?q=CREATE+USER+%22admin%22+WITH+PASSWORD+%277d71afb1-4b16-4cd9-aafe-bce85c630e80%27+WITH+ALL+PRIVILEGES (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f414c92ba58>: Failed to establish a new connection: [Errno 111] Connection refused',))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/charms/reactive/__init__.py", line 73, in main
    bus.dispatch(restricted=restricted_mode)
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/charms/reactive/bus.py", line 390, in dispatch
    _invoke(other_handlers)
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/charms/reactive/bus.py", line 359, in _invoke
    handler.invoke()
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/charms/reactive/bus.py", line 181, in invoke
    self._action(*args)
  File "/var/lib/juju/agents/unit-influxdb-2/charm/reactive/influxdb.py", line 54, in install_influx
    configure_influxdb_auth()
  File "/var/lib/juju/agents/unit-influxdb-2/charm/reactive/influxdb.py", line 62, in configure_influxdb_auth
    create_influxdb_user(username, admin=True, local_user='root')
  File "lib/influxdbcharmlib.py", line 46, in create_influxdb_user
    raise ex
  File "lib/influxdbcharmlib.py", line 41, in create_influxdb_user
    influx.create_user(username, password, admin=admin)
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/influxdb/client.py", line 786, in create_user
    self.query(text, method="POST")
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/influxdb/client.py", line 416, in query
    expected_response_code=expected_response_code
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/influxdb/client.py", line 267, in request
    timeout=self._timeout
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/var/lib/juju/agents/unit-influxdb-2/.venv/lib/python3.6/site-packages/requests/adapters.py", line 516, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=8086): Max retries exceeded with url: /query?q=CREATE+USER+%22admin%22+WITH+PASSWORD+%277d71afb1-4b16-4cd9-aafe-bce85c630e80%27+WITH+ALL+PRIVILEGES (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f414c92ba58>: Failed to establish a new connection: [Errno 111] Connection refused',))

Revision history for this message
Tom Haddon (mthaddon) wrote :

I'm not able to reproduce this currently. Can you let us know which version of the charm you're deploying, and with what constraints and config options?

Revision history for this message
Domas Monkus (tasdomas) wrote :

Sorry about that - I submitted a change (which was subsequently landed) for the charm that seems to have fixed this.

Tom Haddon (mthaddon)
Changed in influxdb-charm:
status: New → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.