senlin

Can't detach a lb policy binding in a cluster when lb not exist

Bug #1830152 reported by Bo Tran
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
senlin
Fix Released
Medium
Bo Tran

Bug Description

A Cluster can't detach a LB policy was attached before when i do deleted LB have id is specifying in that LB policy.

It performed the following steps:

1. Create a cluster

openstack cluster create --desired-capacity 2 --profile centos_basic test
+------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field | Value |
+------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| config | {} |
| created_at | None |
| data | {} |
| dependents | {} |
| desired_capacity | 2 |
| domain_id | None |
| id | 1b6c4620-aef8-43d7-b9a7-88dc831234fb |
| init_at |
2019-05-23T02:11:23Z |
| location | Munch({'project': Munch({'domain_id': 'default', 'id': u'4a92824aa74445f28d7cf814a54ee283', 'name': '<email address hidden>', 'domain_name': None}), 'cloud': '', 'region_name': 'RegionOne', 'zone': None}) |
| max_size | -1 |
| metadata | {} |
| min_size | 0 |
| name | test |
| node_ids | |
| profile_id | 7ec8b801-e5dd-4c46-a131-fb85beba294e |
| profile_name | centos_basic |
| project_id | 4a92824aa74445f28d7cf814a54ee283 |
| status | INIT |
| status_reason | Initializing |
| timeout | 3600 |
| updated_at | None |
| user_id | 3502ac4dda5247829c20b6561c5d188a |
+------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

2. I created a cluster have name is 'test' with horizon dashboard

openstack cluster policy create --spec-file lb_policytest.yaml lb_policytest
+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field | Value |
+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| created_at |
2019-05-23T02:22:04.000000 |
| data | {} |
| domain_id | None |
| id | e8e5d06a-9236-4291-b12a-c9bc09500351 |
| location | Munch({'project': Munch({'domain_id': 'default', 'id': u'4a92824aa74445f28d7cf814a54ee283', 'name': '<email address hidden>', 'domain_name': None}), 'cloud': '', 'region_name': 'RegionOne', 'zone': None}) |
| name | lb_policytest |
| project_id | 4a92824aa74445f28d7cf814a54ee283 |
| spec | { |
| | "version": 1.1, |
| | "type": "senlin.policy.loadbalance", |
| | "description": "A policy for load-balancing the nodes in a cluster.", |
| | "properties": { |
| | "pool": { |
| | "subnet": "d1353414-421e-4f17-9614-1997b24d52f5", |
| | "lb_method": "ROUND_ROBIN", |
| | "protocol": "HTTP", |
| | "session_persistence": { |
| | "cookie_name": "whatever", |
| | "type": "SOURCE_IP" |
| | }, |
| | "protocol_port": 80, |
| | "id": "c4f8caf4-a224-496a-a444-55ba8f1d6af7" |
| | }, |
| | "vip": { |
| | "subnet": "2cbd7f45-edaa-4c02-b672-588d36f77698", |
| | "protocol": "HTTP", |
| | "protocol_port": 80, |
| | "connection_limit": 500, |
| | "address": "192.168.58.13" |
| | }, |
| | "loadbalancer": "c4d96fb7-bb8c-476e-9967-ed5adaa0b483", |
| | "lb_status_timeout": 300, |
| | "health_monitor": { |
| | "delay": 10000, |
| | "expected_codes": "200, 202, 300", |
| | "max_retries": 4, |
| | "http_method": "GET", |
| | "timeout": 5000, |
| | "url_path": "/", |
| | "type": "PING" |
| | } |
| | } |
| | } |
| type | senlin.policy.loadbalance-1.1 |
| updated_at | None |
| user_id | 3502ac4dda5247829c20b6561c5d188a |
+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

3. I try attached above policy with cluster 'test'

openstack cluster policy attach --policy lb_policytest test

openstack cluster policy binding list test
+-----------+---------------+-------------------------------+------------+
| policy_id | policy_name | policy_type | is_enabled |
+-----------+---------------+-------------------------------+------------+
| e8e5d06a | lb_policytest | senlin.policy.loadbalance-1.1 | True |
+-----------+---------------+-------------------------------+------------+

4. I was try detele loadbalancer 'test' and detach policy

openstack loadbalancer delete --cascade test
openstack cluster policy detach --policy lb_policytest test

In this step, I was get this log:

2019-05-23 09:25:42.429 40 INFO senlin.engine.service [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Detaching polic y 'lb_policytest' from cluster '1b6c4620-aef8-43d7-b9a7-88dc831234fb'.
2019-05-23 09:25:42.573 40 INFO senlin.engine.service [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Policy detach a ction queued: d1d0734e-3c81-4255-9a1e-6619089d5343.
2019-05-23 09:25:42.693 40 INFO senlin.engine.event [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] test[1b6c4620] CL USTER_DETACH_POLICY[d1d0734e] start: d1d0734e
2019-05-23 09:25:43.857 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:25:53.972 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:26:04.092 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:26:14.254 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:26:24.381 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:26:34.498 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:26:44.607 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:26:54.708 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:27:04.817 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:27:14.944 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:27:25.058 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:27:35.174 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:27:45.278 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:27:55.394 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:28:05.506 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:28:15.625 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:28:25.739 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:28:35.863 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:28:50.976 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:29:01.097 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:29:11.195 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:29:21.288 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:29:31.407 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:29:41.527 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:29:51.637 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:30:01.737 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:30:11.847 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:30:21.956 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:30:32.073 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:30:42.202 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:30:52.203 40 ERROR senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Failed in re moving member f86bbe40-d548-4428-9533-1f7d603515bf from pool c4f8caf4-a224-496a-a444-55ba8f1d6af7: Loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 is not ready.: Error: Loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 is not ready.
2019-05-23 09:30:52.203 40 ERROR senlin.drivers.os.lbaas Traceback (most recent call last):
2019-05-23 09:30:52.203 40 ERROR senlin.drivers.os.lbaas File "/opt/senlin/senlin/drivers/os/lbaas.py", line 350, in member_remove
2019-05-23 09:30:52.203 40 ERROR senlin.drivers.os.lbaas raise exception.Error(msg)
2019-05-23 09:30:52.203 40 ERROR senlin.drivers.os.lbaas Error: Loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 is not ready.
2019-05-23 09:30:52.203 40 ERROR senlin.drivers.os.lbaas
2019-05-23 09:30:52.763 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:31:02.878 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:31:12.989 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:31:23.090 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:31:33.199 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:31:43.298 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:31:53.412 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:32:03.541 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:32:13.690 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:32:23.806 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:32:33.925 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:32:44.052 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:32:54.194 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:33:04.314 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:33:14.431 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:33:24.541 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:33:34.661 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:33:44.774 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:33:59.891 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:34:10.004 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:34:20.117 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:34:30.235 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:34:40.340 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:34:50.456 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:35:00.568 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:35:10.702 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:35:20.809 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:35:30.924 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:35:41.043 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:35:51.146 40 DEBUG senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Waiting for loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 to become ready _wait_for_lb_ready /opt/senlin/senlin/drivers/os/lbaas.py:87
2019-05-23 09:36:01.154 40 ERROR senlin.drivers.os.lbaas [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] Failed in re moving member 6f92fbd5-8cd4-4995-b97a-358c12a80acc from pool c4f8caf4-a224-496a-a444-55ba8f1d6af7: Loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 is not ready.: Error: Loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 is not ready.
2019-05-23 09:36:01.154 40 ERROR senlin.drivers.os.lbaas Traceback (most recent call last):
2019-05-23 09:36:01.154 40 ERROR senlin.drivers.os.lbaas File "/opt/senlin/senlin/drivers/os/lbaas.py", line 350, in member_remove
2019-05-23 09:36:01.154 40 ERROR senlin.drivers.os.lbaas raise exception.Error(msg)
2019-05-23 09:36:01.154 40 ERROR senlin.drivers.os.lbaas Error: Loadbalancer c4d96fb7-bb8c-476e-9967-ed5adaa0b483 is not ready.
2019-05-23 09:36:01.154 40 ERROR senlin.drivers.os.lbaas
2019-05-23 09:36:01.371 40 ERROR senlin.engine.event [req-4b5b1f9b-3b08-46f9-a30f-50ad0243f2a7 3502ac4dda5247829c20b6561c5d188a 4a92824aa74445f28d7cf814a54ee283 - - -] test[1b6c4620] C LUSTER_DETACH_POLICY[d1d0734e] error: Failed to remove servers from existed LB.

5. I was test agains with

openstack cluster policy binding list test
+-----------+---------------+-------------------------------+------------+
| policy_id | policy_name | policy_type | is_enabled |
+-----------+---------------+-------------------------------+------------+
| e8e5d06a | lb_policytest | senlin.policy.loadbalance-1.1 | True |
+-----------+---------------+-------------------------------+------------+

As you see, policy still binding with cluster 'test'

And now, i fixed that with my code in here: https://review.opendev.org/#/c/657564/ and my problem will be resolve

See original description
Bo Tran (ministry.nd)
description: updated
description: updated
XueFeng Liu (jonnary-liu)
Changed in senlin:
status: New → Confirmed
importance: Undecided → Medium
assignee: nobody → Bo Tran (ministry.nd)
OpenStack Infra (hudson-openstack)
Changed in senlin:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to senlin (master)

Reviewed: https://review.opendev.org/657564
Committed: https://git.openstack.org/cgit/openstack/senlin/commit/?id=8cc0503203d811cb1b3cb065681b096025d9825c
Submitter: Zuul
Branch: master

commit 8cc0503203d811cb1b3cb065681b096025d9825c
Author: Bo Tran <email address hidden>
Date: Tue May 7 17:21:27 2019 +0700

    Ignore LB not existed when delete member pool

    A Cluster can't detach a LB policy was attached before
    when i do deleted LB have id is specifying in that LB policy.

    Closes-Bug: #1830152
    Change-Id: Iedc9b65eef35c0f6a16cb7caa34269a9a63c2a87

Changed in senlin:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/senlin 8.0.0.0rc1

This issue was fixed in the openstack/senlin 8.0.0.0rc1 release candidate.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.