API locks up during serialization, Number of nodes to serialize impacts lockup time
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Fix Released
|
Critical
|
Ihor Kalnytskyi |
Bug Description
We have found that if we deploy 50 nodes, then we can't reach Fuel UI and Fuel API during around 5 minutes after initiating deployment.
cluster configuration:
Baremetal,
Controllers:3 Computes+Ceph:47
api: '1.0'
astute_sha: 34e0493afa22999
auth_required: true
build_id: 2015-07-27_09-24-22
build_number: '98'
feature_groups:
- mirantis
fuel-agent_sha: 2a65f11c10b0aeb
fuel-library_sha: 39c3162ee2e2ff6
fuel-ostf_sha: 94a483c8aba639b
fuelmain_sha: 921918a3bd3d278
nailgun_sha: d5c19f6afc66b5e
openstack_version: 2015.1.0-7.0
production: docker
python-
release: '7.0'
Diagnostic Snapshot:http://
Changed in fuel: | |
status: | New → Confirmed |
importance: | Undecided → High |
milestone: | none → 7.0 |
description: | updated |
Changed in fuel: | |
assignee: | nobody → Fuel Python Team (fuel-python) |
summary: |
- UI and API are unreachable during 5 minutes if deploy 50 nodes + UI and API are unreachable during 5 minutes (50 nodes deploy) and for + 2.5 hours (if 200 nodes are deployed) |
summary: |
- UI and API are unreachable during 5 minutes (50 nodes deploy) and for - 2.5 hours (if 200 nodes are deployed) + API locks up during serialization, Number of nodes to serialize impacts + lock time |
summary: |
API locks up during serialization, Number of nodes to serialize impacts - lock time + lockup time |
Changed in fuel: | |
assignee: | Fuel Python Team (fuel-python) → Sylwester Brzeczkowski (sbrzeczkowski) |
Changed in fuel: | |
assignee: | Sylwester Brzeczkowski (sbrzeczkowski) → Igor Kalnitsky (ikalnitsky) |
Changed in fuel: | |
assignee: | Igor Kalnitsky (ikalnitsky) → Sylwester Brzeczkowski (sbrzeczkowski) |
status: | Confirmed → In Progress |
The same situation is reproducible on 200 nodes cluster. On 200 nodes it hangs for 20 minutes. Sounds like there is some linear dependency on number of nodes.