tx checksumming offload results in TCP/UDP packet drops (was Octavia amphora loadbalancer gets stuck at PENDING_CREATE status)
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Octavia Charm |
Invalid
|
Undecided
|
Unassigned | ||
linux (Ubuntu) |
Confirmed
|
Undecided
|
Unassigned |
Bug Description
In a new focal-yoga deployment, the creation of a loadbalancer gets stuck at PENDING_CREATE status.
Checking the amphora we could see that it stays at BOOTING status:
$ openstack loadbalancer amphora show ef48089d-
id: ef48089d-
loadbalancer_id: dcd17d9e-
compute_id: 5efe11a8-
lb_network_ip: fc00:b81a:
vrrp_ip: null
ha_ip: null
vrrp_port_id: null
ha_port_id: null
cert_expiration: '2022-09-
cert_busy: false
role: null
status: BOOTING
vrrp_interface: null
vrrp_id: null
vrrp_priority: null
cached_zone: nova
created_at: '2022-08-
updated_at: '2022-08-
image_id: 6c6cd911-
compute_flavor: 638fa4c5-
/var/log/
2022-08-02 20:30:22.589 149659 WARNING octavia.
It is possible to ping the amphora from an octavia unit:
# ping -M do -s 1452 fc00:b81a:
PING fc00:b81a:
1460 bytes from fc00:b81a:
1460 bytes from fc00:b81a:
1460 bytes from fc00:b81a:
1460 bytes from fc00:b81a:
Also, the port tcp/22 is reacheable from the octavia unit:
# telnet fc00:b81a:
Trying fc00:b81a:
Connected to fc00:b81a:
Escape character is '^]'.
SSH-2.0-
After running the config-changed hook as described at the bug https:/
summary: |
- Octavia amphora loadbalancer gets stuck at PENDING_CREATE status In a - new focal-yoga deployment, the creation of a loadbalancer gets stuck at - PENDING_CREATE status. Checking the amphora we could see that it stays - at BOOTING status: $ openstack loadbalancer amphora show - ef48089d-ba40-46db-92e8-e369f764f017 --format yaml id: - ef48089d-ba40-46db-92e8-e369f764f017 loadbalancer_id: - dcd17d9e-6a27-43c5-9c3f-eb2b2655556d compute_id: - 5efe11a8-93d8-4278-94c2-4efc8b015009 lb_network_ip: - fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa vrrp_ip: null ha_ip: null - vrrp_port_id: null ha_port_id: null cert_expiration: - '2022-09-01T20:27:05' cert_busy: false role: null status: BOOTING - vrrp_interface: null vrrp_id: null vrrp_priority: null cached_zone: nova - created_at: '2022-08-02T20:27:05' updated_at: '2022-08-02T20:30:13' - image_id: 6c6cd911-197f-45d3-a6d5-4ff1789d4ee7 compute_flavor: - 638fa4c5-e81b-438f-a12b-1ef7faf81c3e /var/log/octavia/octavia- - worker.log shows several warnings about connection failure to the - amphora. 2022-08-02 20:30:22.589 149659 WARNING - octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect - to instance. Retrying.: requests.exceptions.ConnectTimeout: - HTTPSConnectionPool(host='fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa', - port=9443): Max retries exceeded with url: // (Caused by - ConnectTimeoutError(<urllib3.connection.VerifiedHTTPSConnection object - at 0x7f87a655fc70>, 'Connection to - fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa timed out. (connect - timeout=10.0)')) It is possible to ping the amphora from an octavia - unit: # ping -M do -s 1452 fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa PING - fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa(fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa) - 1452 data bytes 1460 bytes from fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa: - icmp_seq=1 ttl=64 time=2.45 ms 1460 bytes from - fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa: icmp_seq=2 ttl=64 time=1.01 ms - 1460 bytes from fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa: icmp_seq=3 - ttl=64 time=0.532 ms 1460 bytes from - fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa: icmp_seq=4 ttl=64 time=0.417 ms - Also, the port tcp/22 is reacheable from the octavia unit: # telnet - fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa 22 Trying - fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa... Connected to - fc00:b81a:629a:59a6:f816:3eff:fe0a:68fa. Escape character is '^]'. - SSH-2.0-OpenSSH_8.2p1 Ubuntu-4ubuntu0.5 After running the config- - changed hook as described at the bug https://bugs.launchpad.net/charm- - octavia/+bug/1961088 , the creation of a loadbalancer ends with a ERROR - provisioning_status. + Octavia amphora loadbalancer gets stuck at PENDING_CREATE status |
Changed in charm-octavia: | |
status: | New → Invalid |
subscribed ~field-critical