When swift-proxy was seperated from controller, memcached communication error occured

Bug #1774313 reported by ByungYeol Woo
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Medium
Mark Goddard
Queens
Fix Committed
Medium
Unassigned
Rocky
Fix Committed
Medium
Unassigned
Stein
Fix Committed
Medium
Unassigned
Train
Fix Released
Medium
Mark Goddard

Bug Description

When swif-proxy was seperated from controller, memcached ECONNREFUSED error occured.

There are no memchaced in swift-proxy-server. So I think memcache_servers in proxy-server.conf.j2 needs to be changed from 'swift-proxy-server' to 'memcached'.

==== ERROR LOGS:
2018-05-31T02:21:02Zsyslog.local0.err{"Payload":"swift-proxy-server: STDERR: ERROR:root:Error connecting to memcached: 192.168.20.6:11211: [Errno 111] ECONNREFUSED (txn: txd95c7a64e9c4457595832-005b0f5c0e)\u0000","log_level":"err","Hostname":"swift03","programname":"swift"}

==== part of proxy-server.conf.j2
[filter:cache]
use = egg:swift#memcache
memcache_servers = {% for host in groups['swift-proxy-server'] %}{{ hostvars[host]['ansible_' + hostvars[host]['api_interface']]['ipv4']['address'] }}:{{ memcached_port }}{% if not loop.last %},{% endif %}{% endfor %}

Revision history for this message
zibort (zibort) wrote :

May be it will be nice to start memcached container on swift-proxy-server, when swift-proxy-server is not on controller?

Mark Goddard (mgoddard)
summary: - When swif-proxy was seperated from controller, memcached communication
+ When swift-proxy was seperated from controller, memcached communication
error occured
Changed in kolla-ansible:
status: New → Triaged
importance: Undecided → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (master)

Fix proposed to branch: master
Review: https://review.opendev.org/686975

Changed in kolla-ansible:
assignee: nobody → Mark Goddard (mgoddard)
status: Triaged → In Progress
Revision history for this message
Mark Goddard (mgoddard) wrote :

@Lev, memcached doesn't need to be colocated with swift-proxy. We just need to fix the connection string to reference the memcached group.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/686975
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=3488479d06bc9fc39058532d29229b67f25d4ec0
Submitter: Zuul
Branch: master

commit 3488479d06bc9fc39058532d29229b67f25d4ec0
Author: Mark Goddard <email address hidden>
Date: Mon Oct 7 09:22:24 2019 +0100

    Fix swift-proxy-server memcached configuration

    Currently, swift-proxy config uses hosts in the swift-proxy-server group
    to generate the list of memcached servers. However, memcached is
    deployed to hosts in the memcached group.

    This change fixes the memcached_servers option for swift-proxy to be the
    same as other services.

    Change-Id: Ib850a1bb2a504ac3e1396846ca3f1d9a30e8fca0
    Closes-Bug: #1774313

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/687236

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/687237

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/queens)

Fix proposed to branch: stable/queens
Review: https://review.opendev.org/687238

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/queens)

Reviewed: https://review.opendev.org/687238
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=422682006cb98adf1028ed8f29429f0b647960c7
Submitter: Zuul
Branch: stable/queens

commit 422682006cb98adf1028ed8f29429f0b647960c7
Author: Mark Goddard <email address hidden>
Date: Mon Oct 7 09:22:24 2019 +0100

    Fix swift-proxy-server memcached configuration

    Currently, swift-proxy config uses hosts in the swift-proxy-server group
    to generate the list of memcached servers. However, memcached is
    deployed to hosts in the memcached group.

    This change fixes the memcached_servers option for swift-proxy to be the
    same as other services.

    Change-Id: Ib850a1bb2a504ac3e1396846ca3f1d9a30e8fca0
    Closes-Bug: #1774313
    (cherry picked from commit 3488479d06bc9fc39058532d29229b67f25d4ec0)

tags: added: in-stable-queens
tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/rocky)

Reviewed: https://review.opendev.org/687237
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=78b7086605c7f25cc3ca8e14d04836e46d2f0f76
Submitter: Zuul
Branch: stable/rocky

commit 78b7086605c7f25cc3ca8e14d04836e46d2f0f76
Author: Mark Goddard <email address hidden>
Date: Mon Oct 7 09:22:24 2019 +0100

    Fix swift-proxy-server memcached configuration

    Currently, swift-proxy config uses hosts in the swift-proxy-server group
    to generate the list of memcached servers. However, memcached is
    deployed to hosts in the memcached group.

    This change fixes the memcached_servers option for swift-proxy to be the
    same as other services.

    Change-Id: Ib850a1bb2a504ac3e1396846ca3f1d9a30e8fca0
    Closes-Bug: #1774313
    (cherry picked from commit 3488479d06bc9fc39058532d29229b67f25d4ec0)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/stein)

Reviewed: https://review.opendev.org/687236
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=8db18241cb2830d1f158a301f1a0de8b23d42c37
Submitter: Zuul
Branch: stable/stein

commit 8db18241cb2830d1f158a301f1a0de8b23d42c37
Author: Mark Goddard <email address hidden>
Date: Mon Oct 7 09:22:24 2019 +0100

    Fix swift-proxy-server memcached configuration

    Currently, swift-proxy config uses hosts in the swift-proxy-server group
    to generate the list of memcached servers. However, memcached is
    deployed to hosts in the memcached group.

    This change fixes the memcached_servers option for swift-proxy to be the
    same as other services.

    Change-Id: Ib850a1bb2a504ac3e1396846ca3f1d9a30e8fca0
    Closes-Bug: #1774313
    (cherry picked from commit 3488479d06bc9fc39058532d29229b67f25d4ec0)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 6.2.3

This issue was fixed in the openstack/kolla-ansible 6.2.3 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 9.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 9.0.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 7.2.0

This issue was fixed in the openstack/kolla-ansible 7.2.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 8.1.0

This issue was fixed in the openstack/kolla-ansible 8.1.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.