REST create member fails in AmphoraePostNetworkPlug

[Michael Johnson]

stack@devstack:/backups$ neutron lbaas-member-create --subnet tenant-subnet --address 10.100.100.8 --protocol-port 80 pool1
Created a new member:
+----------------+--------------------------------------+
| Field | Value |
+----------------+--------------------------------------+
| address | 10.100.100.8 |
| admin_state_up | True |
| id | 2ced0998-bdbd-4688-9880-a2bc9e20474a |
| protocol_port | 80 |
| subnet_id | cd84b3f7-bebf-4f77-8bf4-943646bbcb1c |
| tenant_id | 8c331df29f704dab9a9818213ebc3b04 |
| weight | 1 |
+----------------+--------------------------------------+
stack@devstack:/backups$ neutron lbaas-member-create --subnet tenant-subnet --address 10.100.100.9 --protocol-port 80 pool1
Invalid state PENDING_UPDATE of loadbalancer resource 4c6fbc12-521b-4fc9-8012-108934b93c78

o-api.log:
43-8914-40da-8ba3-ce8a14b6e533 - - - - -] Sending Creation of Member 2ced0998-bdbd-4688-9880-a2bc9e20474a to handler
127.0.0.1 - - [02/Sep/2015 21:51:01] "POST /v1/loadbalancers/4c6fbc12-521b-4fc9-8012-108934b93c78/listeners/93192bd3-9e70-41c7-93db-5470282ce13e/pools/33cefcea-dcb8-4d17-b654-c6e2cf6527d3/members HTTP/1.1" 202 211
127.0.0.1 - - [02/Sep/2015 21:51:01] "GET /v1/loadbalancers/4c6fbc12-521b-4fc9-8012-108934b93c78 HTTP/1.1" 200 307
127.0.0.1 - - [02/Sep/2015 21:51:04] "GET /v1/loadbalancers/4c6fbc12-521b-4fc9-8012-108934b93c78 HTTP/1.1" 200 307
127.0.0.1 - - [02/Sep/2015 21:51:07] "GET /v1/loadbalancers/4c6fbc12-521b-4fc9-8012-108934b93c78 HTTP/1.1" 200 307
127.0.0.1 - - [02/Sep/2015 21:51:10] "GET /v1/loadbalancers/4c6fbc12-521b-4fc9-8012-108934b93c78 HTTP/1.1" 200 307

o-cw.log:
2015-09-02 21:51:02.139 87784 WARNING octavia.controller.worker.controller_worke
r [-] Task 'octavia.controller.worker.tasks.amphora_driver_tasks.AmphoraePostNet
workPlug' (daabc66b-9f7a-4b8a-8262-fd8de892bc2c) transitioned into state 'FAILUR
E' from state 'RUNNING'
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
Traceback (most recent call last):
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
  File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/ex
ecutor.py", line 67, in _execute_task
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
    result = task.execute(**arguments)
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
  File "/opt/stack/octavia/octavia/controller/worker/tasks/amphora_driver_tasks.
py", line 189, in execute
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
    self.amphora_driver.post_network_plug(amphora)
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
  File "/opt/stack/octavia/octavia/amphorae/drivers/haproxy/rest_api_driver.py",
 line 112, in post_network_plug
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
    self.client.plug_network(amphora)
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
  File "/opt/stack/octavia/octavia/amphorae/drivers/haproxy/rest_api_driver.py",
 line 302, in plug_network
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
    return exc.check_exception(r)
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
  File "/opt/stack/octavia/octavia/amphorae/drivers/haproxy/exceptions.py", line
 31, in check_exception
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
    raise responses[status_code]()
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
NotFound: Not Found
2015-09-02 21:51:02.139 87784 ERROR octavia.controller.worker.controller_worker
2015-09-02 21:51:02.146 87784 WARNING octavia.controller.worker.controller_worke
r [-] Task 'octavia.controller.worker.tasks.amphora_driver_tasks.AmphoraePostNet
workPlug' (daabc66b-9f7a-4b8a-8262-fd8de892bc2c) transitioned into state 'REVERT
ED' from state 'REVERTING'
2015-09-02 21:51:02.150 87784 WARNING octavia.controller.worker.controller_worke
r [-] Flow 'octavia-create-member-flow' (c759b8f5-4e60-43fb-ac47-e6be16c8ffd8) t
ransitioned into state 'FAILURE' from state 'RUNNING'
2015-09-02 21:51:02.150 87784 ERROR oslo_messaging.rpc.dispatcher [-] Exception
during message handling: revert() got an unexpected keyword argument 'flow_failu
res'

[Michael Johnson (johnsom)]

mysql> select * from member;
+-----------+--------------------------------------+--------------------------------------+--------------------------------------+--------------+---------------+--------+------------------+---------+
| tenant_id | id | pool_id | subnet_id | ip_address | protocol_port | weight | operating_status | enabled |
+-----------+--------------------------------------+--------------------------------------+--------------------------------------+--------------+---------------+--------+------------------+---------+
| NULL | 2ced0998-bdbd-4688-9880-a2bc9e20474a | 33cefcea-dcb8-4d17-b654-c6e2cf6527d3 | cd84b3f7-bebf-4f77-8bf4-943646bbcb1c | 10.100.100.8 | 80 | 1 | OFFLINE | 1 |
+-----------+--------------------------------------+--------------------------------------+--------------------------------------+--------------+---------------+--------+------------------+---------+

[Michael Johnson (johnsom)]

root@amphora-7e7c5f80-4e58-4ba7-863d-6bb5b3ced0db:/var/lib/octavia# cat 93192bd3-9e70-41c7-93db-5470282ce13e/haproxy.cfg
# Configuration for lb1
global
    daemon
    user nobody
    group nogroup
    log /dev/log local0
    log /dev/log local1 notice
    stats socket /var/lib/octavia/93192bd3-9e70-41c7-93db-5470282ce13e.sock mode 0666 level user

defaults
    log global
    retries 3
    option redispatch
    timeout connect 5000
    timeout client 50000
    timeout server 50000

frontend 93192bd3-9e70-41c7-93db-5470282ce13e
    option tcplog
    option forwardfor
    bind 10.0.0.3:80
    mode http
    default_backend 33cefcea-dcb8-4d17-b654-c6e2cf6527d3

backend 33cefcea-dcb8-4d17-b654-c6e2cf6527d3
    mode http
    balance roundrobin
    option forwardfor