Activity log for bug #1833420

Date Who What changed Old value New value Message
2019-06-19 13:24:04 Alex Kavanagh bug added bug
2019-06-19 13:24:11 Alex Kavanagh charm-nova-cloud-controller: assignee Alex Kavanagh (ajkavanagh)
2019-06-21 09:28:56 Alex Kavanagh charm-nova-cloud-controller: status New In Progress
2019-06-21 09:31:27 Alex Kavanagh bug task added charm-nova-compute
2019-06-21 09:31:33 Alex Kavanagh charm-nova-compute: assignee Alex Kavanagh (ajkavanagh)
2019-06-21 09:31:36 Alex Kavanagh charm-nova-compute: status New In Progress
2019-07-02 13:59:25 Alex Kavanagh description The current SSH key distribution code in nova-cloud-controller charm takes too long when dealing with large (>10) numbers of nova-compute units. This bug will document the changes that are introduced as a series of patches to the nova-cloud-controller and nova-compute charms to attempt to resolve the performance issues, as they are mandatory for being able to manage large clouds. Note that this bug will not track work associated with resolving inter- nova-cloud-controller ssh key distribution (which is necessary to be able to migrate an instance between two juju nova-cloud-controller applications). Patches will use the gerrit topic: improve-ssh-key-management Patches will use "Related-Bug" and NOT "Closes-Bug" so as to be tracked here. The bug will be closed when agreement has been reached as to whether any more performance can be extracted using the current approach (using relations to move keys around). The main approach taken in rationalising the way SSH keys are managed is to: 1. Ensure that operations on SSH keys are only performed ONCE in any hook execution. 2. Cache expensive operations during a hook execution that aren't going to change. 3. Cache expensive operations between hook executions (nslookup, for example) that aren't going to change during a hook execution. The current SSH key distribution code in nova-cloud-controller charm takes too long when dealing with large (>10) numbers of nova-compute units. This bug will document the changes that are introduced as a series of patches to the nova-cloud-controller and nova-compute charms to attempt to resolve the performance issues, as they are mandatory for being able to manage large clouds. Note that this bug will not track work associated with resolving inter- nova-cloud-controller ssh key distribution (which is necessary to be able to migrate an instance between two juju nova-cloud-controller applications). Patches will use the gerrit topic: improve-ssh-key-management Patches will use "Related-Bug" and NOT "Closes-Bug" so as to be tracked here. The bug will be closed when agreement has been reached as to whether any more performance can be extracted using the current approach (using relations to move keys around). The main approach taken in rationalising the way SSH keys are managed is to: 1. Ensure that operations on SSH keys are only performed ONCE in any hook execution. 2. Cache expensive operations during a hook execution that aren't going to change. 3. Cache expensive operations between hook executions (nslookup, for example) that aren't going to change during a hook execution. 4. Use goal-state to hold off setting known_hosts and authorized_keys to reduce the number of cloud-compute relation change hooks. 5. Add an action to purge the hosts cached if DNS changes to update the known_hosts to each of the compute units.
2019-07-17 13:25:01 Alex Kavanagh charm-nova-cloud-controller: status In Progress Fix Committed
2019-07-17 13:25:10 Alex Kavanagh charm-nova-cloud-controller: milestone 19.07
2019-07-17 13:26:00 Alex Kavanagh charm-nova-cloud-controller: importance Undecided Wishlist
2019-07-17 13:26:04 Alex Kavanagh charm-nova-compute: importance Undecided Wishlist
2019-07-17 13:26:11 Alex Kavanagh charm-nova-compute: milestone 19.07
2019-07-17 13:26:14 Alex Kavanagh charm-nova-compute: status In Progress Fix Committed
2019-08-12 21:16:50 David Ames charm-nova-cloud-controller: status Fix Committed Fix Released
2019-08-12 21:16:51 David Ames charm-nova-compute: status Fix Committed Fix Released