| 2022-08-03 11:46:04 |
Marcelo Subtil Marcal |
bug |
|
|
added bug |
| 2022-08-03 11:47:01 |
Marcelo Subtil Marcal |
summary |
Octavia amphora loadbalancer gets stuck at PENDING_CREATE status In a new focal-yoga deployment, the creation of a loadbalancer gets stuck at PENDING_CREATE status. Checking the amphora we could see that it stays at BOOTING status: $ openstack loadbalancer amphora show ef48089d-ba40-46db-92e8-e369f764f017 --format yaml id: ef48089d-ba40-46db-92e8-e369f764f017 loadbalancer_id: dcd17d9e-6a27-43c5-9c3f-eb2b2655556d compute_id: 5efe11a8-93d8-4278-94c2-4efc8b015009 lb_network_ip: fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa vrrp_ip: null ha_ip: null vrrp_port_id: null ha_port_id: null cert_expiration: '2022-09-01T20:27:05' cert_busy: false role: null status: BOOTING vrrp_interface: null vrrp_id: null vrrp_priority: null cached_zone: nova created_at: '2022-08-02T20:27:05' updated_at: '2022-08-02T20:30:13' image_id: 6c6cd911-197f-45d3-a6d5-4ff1789d4ee7 compute_flavor: 638fa4c5-e81b-438f-a12b-1ef7faf81c3e /var/log/octavia/octavia-worker.log shows several warnings about connection failure to the amphora. 2022-08-02 20:30:22.589 149659 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa', port=9443): Max retries exceeded with url: // (Caused by ConnectTimeoutError(<urllib3.connection.VerifiedHTTPSConnection object at 0x7f87a655fc70>, 'Connection to fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa timed out. (connect timeout=10.0)')) It is possible to ping the amphora from an octavia unit: # ping -M do -s 1452 fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa PING fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa(fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa) 1452 data bytes 1460 bytes from fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa: icmp_seq=1 ttl=64 time=2.45 ms 1460 bytes from fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa: icmp_seq=2 ttl=64 time=1.01 ms 1460 bytes from fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa: icmp_seq=3 ttl=64 time=0.532 ms 1460 bytes from fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa: icmp_seq=4 ttl=64 time=0.417 ms Also, the port tcp/22 is reacheable from the octavia unit: # telnet fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa 22 Trying fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa... Connected to fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa. Escape character is '^]'. SSH-2.0-OpenSSH_8.2p1 Ubuntu-4ubuntu0.5 After running the config-changed hook as described at the bug https://bugs.launchpad.net/charm-octavia/+bug/1961088 , the creation of a loadbalancer ends with a ERROR provisioning_status. |
Octavia amphora loadbalancer gets stuck at PENDING_CREATE status |
|
| 2022-08-03 11:53:26 |
Marcelo Subtil Marcal |
bug |
|
|
added subscriber Canonical Field Critical |
| 2022-08-03 12:00:35 |
Alex Kavanagh |
marked as duplicate |
|
1914179 |
|
| 2022-08-05 13:55:26 |
Przemyslaw Hausman |
removed duplicate marker |
1914179 |
|
|
| 2022-08-05 14:37:22 |
Przemyslaw Hausman |
attachment added |
|
octavia-veth.pcap https://bugs.launchpad.net/charm-octavia/+bug/1983468/+attachment/5607148/+files/octavia-veth.pcap |
|
| 2022-08-05 14:37:40 |
Przemyslaw Hausman |
attachment added |
|
octavia-vlan.pcap https://bugs.launchpad.net/charm-octavia/+bug/1983468/+attachment/5607149/+files/octavia-vlan.pcap |
|
| 2022-08-05 14:37:57 |
Przemyslaw Hausman |
attachment added |
|
amphora-vlan.pcap https://bugs.launchpad.net/charm-octavia/+bug/1983468/+attachment/5607150/+files/amphora-vlan.pcap |
|
| 2022-08-05 14:38:13 |
Przemyslaw Hausman |
attachment added |
|
amphora-tap.pcap https://bugs.launchpad.net/charm-octavia/+bug/1983468/+attachment/5607151/+files/amphora-tap.pcap |
|
| 2022-08-12 14:01:06 |
Dmitrii Shcherbakov |
summary |
Octavia amphora loadbalancer gets stuck at PENDING_CREATE status |
tx checksumming offload results in TCP/UDP packet drops (was Octavia amphora loadbalancer gets stuck at PENDING_CREATE status) |
|
| 2022-08-12 14:15:46 |
Dmitrii Shcherbakov |
bug task added |
|
linux (Ubuntu) |
|
| 2022-08-12 14:16:12 |
Dmitrii Shcherbakov |
charm-octavia: status |
New |
Invalid |
|
| 2022-08-12 14:30:08 |
Ubuntu Kernel Bot |
linux (Ubuntu): status |
New |
Incomplete |
|
| 2022-08-12 16:18:11 |
Przemyslaw Hausman |
linux (Ubuntu): status |
Incomplete |
Confirmed |
|
| 2022-08-12 16:56:40 |
Billy Olsen |
removed subscriber Canonical Field Critical |
|
|
|
