Telegraf Charm

telegraf in jammy in error state with hook failed: "install" due to 403 error

Bug #1992985 reported by Konstantinos Kaskavelis
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Telegraf Charm
Won't Fix
Low
Unassigned

Bug Description

SQA team has a failing run on yoga jammy, using the latest/candidate version of telegraf, where telegraf erros with the message: hook failed: "install"

From the logs:

unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/_browser.py", line 447, in get_wadl_application
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install response, content = self._request(url, media_type=wadl_type)
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/_browser.py", line 389, in _request
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install response, content = self._request_and_retry(
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/_browser.py", line 359, in _request_and_retry
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install response, content = self._connection.request(
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/__init__.py", line 1725, in request
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install (response, content) = self._request(
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/launchpadlib/launchpad.py", line 144, in _request
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install response, content = super(LaunchpadOAuthAwareHttp, self)._request(
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/_browser.py", line 184, in _request
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install return super(RestfulHttp, self)._request(
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/__init__.py", line 1441, in _request
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install (response, content) = self._conn_request(conn, request_uri, method, body, headers)
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/__init__.py", line 1363, in _conn_request
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install conn.connect()
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/__init__.py", line 1153, in connect
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install sock.connect((self.host, self.port))
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/socks.py", line 504, in connect
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install self.__negotiatehttp(destpair[0], destpair[1])
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/socks.py", line 465, in __negotiatehttp
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install raise HTTPError((statuscode, statusline[2]))
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install httplib2.socks.HTTPError: (403, b'Forbidden')
unit-telegraf-37: 10:48:57 ERROR unit.telegraf/37.juju-log Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charms/reactive/__init__.py", line 73, in main
    hookenv._run_atstart()
  File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/core/hookenv.py", line 1348, in _run_atstart
    callback(*args, **kwargs)
  File "/var/lib/juju/agents/unit-telegraf-37/charm/reactive/apt.py", line 132, in configure_sources
    fetch.configure_sources(update=False, sources_var='install_sources', keys_var='install_keys')
  File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/fetch/__init__.py", line 147, in configure_sources
    add_source(source, key)
  File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/fetch/ubuntu.py", line 701, in add_source
    fn(*m.groups())
  File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/fetch/ubuntu.py", line 738, in _add_apt_repository
    _run_with_retries(['add-apt-repository', '--yes', spec],
  File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/fetch/ubuntu.py", line 922, in _run_with_retries
    result = subprocess.check_call(cmd, env=env, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['add-apt-repository', '--yes', 'ppa:telegraf-devs/ppa']' returned non-zero exit status 1.

unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install Traceback (most recent call last):
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/var/lib/juju/agents/unit-telegraf-37/charm/hooks/install", line 22, in <module>
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install main()
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charms/reactive/__init__.py", line 73, in main
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install hookenv._run_atstart()
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/core/hookenv.py", line 1348, in _run_atstart
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install callback(*args, **kwargs)
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/var/lib/juju/agents/unit-telegraf-37/charm/reactive/apt.py", line 132, in configure_sources
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install fetch.configure_sources(update=False, sources_var='install_sources', keys_var='install_keys')
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/fetch/__init__.py", line 147, in configure_sources
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install add_source(source, key)
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/fetch/ubuntu.py", line 701, in add_source
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install fn(*m.groups())
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/fetch/ubuntu.py", line 738, in _add_apt_repository
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install _run_with_retries(['add-apt-repository', '--yes', spec],
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/var/lib/juju/agents/unit-telegraf-37/.venv/lib/python3.10/site-packages/charmhelpers/fetch/ubuntu.py", line 922, in _run_with_retries
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install result = subprocess.check_call(cmd, env=env, **kwargs)
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install raise CalledProcessError(retcode, cmd)
unit-telegraf-37: 10:48:57 WARNING unit.telegraf/37.install subprocess.CalledProcessError: Command '['add-apt-repository', '--yes', 'ppa:telegraf-devs/ppa']' returned non-zero exit status 1.
unit-telegraf-37: 10:48:57 ERROR juju.worker.uniter.operation hook "install" (via explicit, bespoke hook script) failed: exit status 1
unit-telegraf-37: 10:48:57 DEBUG juju.worker.uniter.operation lock released for telegraf/37
unit-telegraf-37: 10:48:57 TRACE juju.worker.uniter.relation create relation resolver next op for new remote relations map[int]remotestate.RelationSnapshot{
    370: {
        Life: "alive",
        Suspended: false,
        Members: {"prometheus/0":0},
        ApplicationMembers: {"prometheus":0},
    },
    371: {
        Life: "alive",
        Suspended: false,
        Members: {"rabbitmq-server/0":0},
        ApplicationMembers: {"rabbitmq-server":0},
    },
}
unit-telegraf-37: 10:48:57 TRACE juju.worker.uniter.relation no create relation operation to run
unit-telegraf-37: 10:49:45 TRACE juju.worker.uniter.relation create relation resolver next op for new remote relations map[int]remotestate.RelationSnapshot{
    370: {
        Life: "alive",
        Suspended: false,
        Members: {"prometheus/0":0},
        ApplicationMembers: {"prometheus":0},
    },
    371: {
        Life: "alive",
        Suspended: false,
        Members: {"rabbitmq-server/0":0},
        ApplicationMembers: {"rabbitmq-server":0},
    },
}
unit-telegraf-37: 10:49:45 TRACE juju.worker.uniter.relation no create relation operation to run
unit-telegraf-37: 10:53:57 TRACE juju.worker.uniter.relation create relation resolver next op for new remote relations map[int]remotestate.RelationSnapshot{
    370: {
        Life: "alive",
        Suspended: false,
        Members: {"prometheus/0":0},
        ApplicationMembers: {"prometheus":0},
    },
    371: {
        Life: "alive",
        Suspended: false,
        Members: {"rabbitmq-server/0":0},
        ApplicationMembers: {"rabbitmq-server":0},
    },
}
unit-telegraf-37: 10:53:57 TRACE juju.worker.uniter.relation no create relation operation to run
unit-telegraf-37: 10:53:57 DEBUG juju.worker.uniter.operation running operation run install hook for telegraf/37
unit-telegraf-37: 10:53:57 DEBUG juju.worker.uniter.operation preparing operation "run install hook" for telegraf/37
unit-telegraf-37: 10:53:57 DEBUG juju.worker.uniter.operation executing operation "run install hook" for telegraf/37
unit-telegraf-37: 10:54:00 WARNING unit.telegraf/37.juju-log Passing NO_PROXY string that includes a cidr. This may not be compatible with software you are running in your shell.
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install Traceback (most recent call last):
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/bin/add-apt-repository", line 364, in <module>
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install sys.exit(0 if addaptrepo.main() else 1)
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/bin/add-apt-repository", line 347, in main
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install shortcut = handler(source, **shortcut_params)
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/softwareproperties/shortcuts.py", line 40, in shortcut_handler
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install return handler(shortcut, **kwargs)
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/softwareproperties/ppa.py", line 82, in __init__
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install if self.lpppa.publish_debug_symbols:
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/softwareproperties/ppa.py", line 120, in lpppa
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install self._lpppa = self.lpteam.getPPAByName(name=self.ppaname)
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/softwareproperties/ppa.py", line 107, in lpteam
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install self._lpteam = self.lp.people(self.teamname)
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/softwareproperties/ppa.py", line 98, in lp
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install self._lp = login_func("%s.%s" % (self.__module__, self.__class__.__name__),
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/launchpadlib/launchpad.py", line 494, in login_anonymously
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install return cls(
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/launchpadlib/launchpad.py", line 230, in __init__
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install super(Launchpad, self).__init__(
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/resource.py", line 472, in __init__
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install self._wadl = self._browser.get_wadl_application(self._root_uri)
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/_browser.py", line 447, in get_wadl_application
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install response, content = self._request(url, media_type=wadl_type)
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/_browser.py", line 389, in _request
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install response, content = self._request_and_retry(
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/_browser.py", line 359, in _request_and_retry
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install response, content = self._connection.request(
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/__init__.py", line 1725, in request
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install (response, content) = self._request(
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/launchpadlib/launchpad.py", line 144, in _request
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install response, content = super(LaunchpadOAuthAwareHttp, self)._request(
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/lazr/restfulclient/_browser.py", line 184, in _request
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install return super(RestfulHttp, self)._request(
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/__init__.py", line 1441, in _request
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install (response, content) = self._conn_request(conn, request_uri, method, body, headers)
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/__init__.py", line 1363, in _conn_request
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install conn.connect()
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/__init__.py", line 1153, in connect
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install sock.connect((self.host, self.port))
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/socks.py", line 504, in connect
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install self.__negotiatehttp(destpair[0], destpair[1])
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install File "/usr/lib/python3/dist-packages/httplib2/socks.py", line 465, in __negotiatehttp
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install raise HTTPError((statuscode, statusline[2]))
unit-telegraf-37: 10:54:02 WARNING unit.telegraf/37.install httplib2.socks.HTTPError: (403, b'Forbidden')

Test run:

https://solutions.qa.canonical.com/testruns/testRun/fc6bbb13-e6c4-475b-b01b-ed4a2a5b23b5

Logs:

https://oil-jenkins.canonical.com/artifacts/fc6bbb13-e6c4-475b-b01b-ed4a2a5b23b5/index.html

Eric Chen (eric-chen)
tags: added: bseng-496
Eric Chen (eric-chen)
Changed in charm-telegraf:
importance: Undecided → Low
Jeffrey Chang (modern911)
tags: added: cdo-qa
Revision history for this message
Eric Chen (eric-chen) wrote :

It’s seldom to encounter this issue.
https://solutions.qa.canonical.com/bugs/bugs/bug/1992985

Change the priority to low unless it becomes worse.

Changed in charm-telegraf:
status: New → Triaged
Revision history for this message
Jeffrey Chang (modern911) wrote :

I see 10 retries from the log today, but ppa is not coming back within 10*10 sec. Should we make that a bit longer?

2023-01-14 02:52:02 INFO unit.telegraf/60.juju-log server.go:316 Failed executing 'add-apt-repository --yes ppa:telegraf-devs/ppa'. Will retry in 10 seconds

Revision history for this message
Eric Chen (eric-chen) wrote :

Soon or later, the monitoring system will migrate to COS.
(https://charmhub.io/topics/canonical-observability-stack)
We won't put effort to fix this issue.

Changed in charm-telegraf:
status: Triaged → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.