ceilometer swift pollster returns 403

[Miguel Alejandro Cantu]

The ceilometer pollster stroage.objects.containers returns a 403 Forbidden. Leads me to believe it's a problem with the way the ceilometer playbooks set up the swift roles.

2016-02-05 16:01:07.196 4205 INFO ceilometer.agent.manager [req-23242dae-a9bb-4eaf-b8ad-d6d91572f277 admin - - - -] Polling pollster storage.objects.containers in the context of meter_source
2016-02-05 16:01:07.228 4205 DEBUG swiftclient [req-23242dae-a9bb-4eaf-b8ad-d6d91572f277 admin - - - -] REQ: curl -i http://162.242.209.104:8080/v1/AUTH_1b34b9ea77a14f55960ba75fd92e85fb -I -H "X-Auth-Token: gAAAAABWtMdCJVH1X7f4ainyime2xtJYpsxEEZzlSLfMF7jxyO1MKzxwjfR0RX_jmsquYP_An9ivY8y2Xv0kjjnPctll3__43vGU0aI-WbKmUfBIYGfEuTP5nn7rdLfxsXnR81THZLqyfMx10em0UH1ECeJkU8DaIwjoBPjNRmlCe0csfvryC0Q" http_log /openstack/venvs/ceilometer-master/lib/python2.7/site-packages/swiftclient/client.py:100
2016-02-05 16:01:07.228 4205 DEBUG swiftclient [req-23242dae-a9bb-4eaf-b8ad-d6d91572f277 admin - - - -] RESP STATUS: 204 No Content http_log /openstack/venvs/ceilometer-master/lib/python2.7/site-packages/swiftclient/client.py:101
2016-02-05 16:01:07.228 4205 DEBUG swiftclient [req-23242dae-a9bb-4eaf-b8ad-d6d91572f277 admin - - - -] RESP HEADERS: [('Content-Length', '0'), ('x-account-project-domain-id', 'default'), ('Accept-Ranges', 'bytes'), ('X-Account-Storage-Policy-Default-Bytes-Used', '13287936'), ('X-Account-Storage-Policy-Default-Object-Count', '1'), ('X-Account-Object-Count', '1'), ('X-Timestamp', '1454525226.70261'), ('X-Trans-Id', 'txc680416ec15c4ea9a18ee-0056b4c743'), ('Date', 'Fri, 05 Feb 2016 16:01:07 GMT'), ('X-Account-Bytes-Used', '13287936'), ('X-Account-Container-Count', '1'), ('Content-Type', 'text/plain; charset=utf-8'), ('X-Account-Storage-Policy-Default-Container-Count', '1')] http_log /openstack/venvs/ceilometer-master/lib/python2.7/site-packages/swiftclient/client.py:102
2016-02-05 16:01:07.254 4205 INFO swiftclient [req-23242dae-a9bb-4eaf-b8ad-d6d91572f277 admin - - - -] REQ: curl -i http://162.242.209.104:8080/v1/AUTH_4dc983705596475d99bba062d6d532c1 -I -H "X-Auth-Token: gAAAAABWtMdCJVH1X7f4ainyime2xtJYpsxEEZzlSLfMF7jxyO1MKzxwjfR0RX_jmsquYP_An9ivY8y2Xv0kjjnPctll3__43vGU0aI-WbKmUfBIYGfEuTP5nn7rdLfxsXnR81THZLqyfMx10em0UH1ECeJkU8DaIwjoBPjNRmlCe0csfvryC0Q"
2016-02-05 16:01:07.254 4205 INFO swiftclient [req-23242dae-a9bb-4eaf-b8ad-d6d91572f277 admin - - - -] RESP STATUS: 403 Forbidden
2016-02-05 16:01:07.255 4205 INFO swiftclient [req-23242dae-a9bb-4eaf-b8ad-d6d91572f277 admin - - - -] RESP HEADERS: [('Date', 'Fri, 05 Feb 2016 16:01:07 GMT'), ('Content-Length', '0'), ('Content-Type', 'text/html; charset=UTF-8'), ('X-Trans-Id', 'txc48008ca95984893abd61-0056b4c743')]
2016-02-05 16:01:07.255 4205 WARNING ceilometer.agent.manager [req-23242dae-a9bb-4eaf-b8ad-d6d91572f277 admin - - - -] Continue after error from storage.objects.containers: Account HEAD failed: http://162.242.209.104:8080/v1/AUTH_4dc983705596475d99bba062d6d532c1 403 Forbidden
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager Traceback (most recent call last):
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager File "/openstack/venvs/ceilometer-master/lib/python2.7/site-packages/ceilometer/agent/manager.py", line 194, in poll_and_notify
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager for sample in samples:
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager File "/openstack/venvs/ceilometer-master/lib/python2.7/site-packages/ceilometer/objectstore/swift.py", line 147, in get_samples
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager cache, tenants):
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager File "/openstack/venvs/ceilometer-master/lib/python2.7/site-packages/ceilometer/objectstore/swift.py", line 83, in _iter_accounts
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager ksclient, tenants))
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager File "/openstack/venvs/ceilometer-master/lib/python2.7/site-packages/ceilometer/objectstore/swift.py", line 95, in _get_account_info
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager keystone_client.get_auth_token(ksclient)))
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager File "/openstack/venvs/ceilometer-master/lib/python2.7/site-packages/swiftclient/client.py", line 620, in head_account
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager http_response_content=body)
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager ClientException: Account HEAD failed: http://162.242.209.104:8080/v1/AUTH_4dc983705596475d99bba062d6d532c1 403 Forbidden
2016-02-05 16:01:07.255 4205 ERROR ceilometer.agent.manager

[Miguel Alejandro Cantu (miguel-cantu)]

Removed Assigined To value. I won't be able to look into this within the next week or two.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/300216

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/300216
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_swift/commit/?id=486adbe215b1693e6627b4262c24ccf791c7b6e8
Submitter: Jenkins
Branch: master

commit 486adbe215b1693e6627b4262c24ccf791c7b6e8
Author: Steve Lewis <email address hidden>
Date: Thu Mar 31 13:54:24 2016 -0700

    Include reseller admin role correctly

    The name of the reseller_admin_role in the proxy config needs
    to map to the correct role within the deploy. It was specified
    manually and inconsistently though a variable exists in the role
    defaults.

    Change-Id: Ib93fc57f1e26e8a0943a7bd7c2212ce94be54f7c
    Closes-Bug: #1542391

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/301042

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/301042
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_swift/commit/?id=bb45f715596d26ec5d9b8d532e05114a0942bead
Submitter: Jenkins
Branch: stable/mitaka

commit bb45f715596d26ec5d9b8d532e05114a0942bead
Author: Steve Lewis <email address hidden>
Date: Thu Mar 31 13:54:24 2016 -0700

    Include reseller admin role correctly

    The name of the reseller_admin_role in the proxy config needs
    to map to the correct role within the deploy. It was specified
    manually and inconsistently though a variable exists in the role
    defaults.

    Change-Id: Ib93fc57f1e26e8a0943a7bd7c2212ce94be54f7c
    Closes-Bug: #1542391
    (cherry picked from commit 486adbe215b1693e6627b4262c24ccf791c7b6e8)

[Doug Hellmann (doug-hellmann)]

This issue was fixed in the openstack/openstack-ansible-os_swift 13.0.1 release.

[Davanum Srinivas (DIMS) (dims-v)]

This issue was fixed in the openstack/openstack-ansible-os_swift 13.0.1 release.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: liberty
Review: https://review.openstack.org/315274

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/315274
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=f4f93fc5441328082fd2fb5d76dfc73d46270b8f
Submitter: Jenkins
Branch: liberty

commit f4f93fc5441328082fd2fb5d76dfc73d46270b8f
Author: Steve Lewis <email address hidden>
Date: Wed May 11 15:04:51 2016 -0700

    Include reseller admin role correctly

    The name of the reseller_admin_role in the proxy config needs
    to map to the correct role within the deploy. It was specified
    manually and inconsistently though a variable exists in the role
    defaults.

    Backported by community request.
    A cherry pick is not possible due to IRR in Mitaka.

    Note that the Keystone catalog has to be adjusted to remove the V3
    endpoint for Swift, replacing it with a V2 endpoint because
    Ceilometer does not support V3 auth in Liberty (fixed in Mitaka)
    before this fix can be used.

    Change-Id: Iacf45828cff5907bf204c35e1d234faacffeab65
    Backport-Of: Ib93fc57f1e26e8a0943a7bd7c2212ce94be54f7c
    Related-Bug: #1542391

[Thierry Carrez (ttx)]

This issue was fixed in the openstack/openstack-ansible-os_swift 14.0.0.0b1 development milestone.