Keys generated by Fuel Master are not deleted when environment is deleted.

Bug #1647189 reported by Javier Diaz Jr
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Won't Fix
High
Alexey Stupnikov
8.0.x
Won't Fix
High
Alexey Stupnikov
Mitaka
Won't Fix
High
Alexey Stupnikov
Newton
Won't Fix
High
Alexey Stupnikov
Ocata
Won't Fix
High
Alexey Stupnikov

Bug Description

Mirantis OpenStack 9.0 tested only.

Detailed bug description:

When an environment is deployed, keys are generated and stored in the location /var/lib/fuel/keys/<env_id>/ at the Fuel master node. When the environment is deleted these keys are not deleted. As a consequence, when the environment is deployed again with different DNS hostname, then deployment will fail.

Steps to reproduce:

- Deploy an environment
- Check that keys are present in Fuel master node at /var/lib/fuel/keys/<env_id>/
- Delete the environment
- Check that keys are still present in Fuel master node at /var/lib/fuel/keys/<env_id>/
- Reset nailgun database (so that next environment will get the same environment ID)
- Create an environment and update the DNS hostname to a different name in the settings tab
- Deploy an environment and it will fail.

Expected results:

When environment is deleted the keys should be deleted as well.

Actual result:

Keys remain.

Reproducibility:

100%

Workaround:

Remove keys manually.

Description of the environment:

MOS 9.0
CentOS 7 (Fuel Master)

Impact:

Depending on use case customer may be affected if the scenario described in the reproduction steps is replicated. Not probable (I think), nonetheless, its a problem.

Revision history for this message
Denis Meltsaykin (dmeltsaykin) wrote :
Changed in mos:
assignee: nobody → Alexey Stupnikov (astupnikov)
Dmitry Pyzhov (dpyzhov)
Changed in mos:
milestone: none → 9.2
importance: Undecided → High
affects: mos → fuel
Changed in fuel:
milestone: 9.2 → none
milestone: none → 9.2
tags: added: ct1
tags: added: support
Revision history for this message
Alexey Stupnikov (astupnikov) wrote :

This issue is similar to the one described in bug #1507361, which reports the same problem during reset process. We can solve this issue in the same fashion: cast additional RemoveClusterKeys call.

Changed in fuel:
status: New → Confirmed
Anton Matveev (amatveev)
tags: added: sla1
removed: ct1
Dmitry Pyzhov (dpyzhov)
no longer affects: fuel/future
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (master)

Fix proposed to branch: master
Review: https://review.openstack.org/408516

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
Vladimir Kozhukalov (kozhukalov) wrote :

"reset database" does not look like a valid procedure in the Fuel workflow. If one does this manually, then one could remove keys manually as well. I don't think we need to delete keys when we delete an environment (the same for logs), but anyway the best way to customize the graph, but not by hardcoding yet another subtask in nailgun.

Revision history for this message
Alexey Stupnikov (astupnikov) wrote :

@vkozhukalov, If you`ll google for 'nailgun manage.py dropdb', some official docs will come up in search results. If there is official documentation, then IMO we should support this kind of workflows.

Another point about graph's customization is totally right, but its realization will make this patch non-backportable and shouldn't be used given that we used the same unconditional call after environment's reset:
https://github.com/openstack/fuel-web/blob/master/nailgun/nailgun/task/manager.py#L920

Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

Database reset is not recommended procedure in any production environment. Please share links to documentation that claims otherwise and we'll fix docs.

As a workaround for your particular case please delete keys manually.

Revision history for this message
Alexey Stupnikov (astupnikov) wrote :

@dpyzhov, sorry, but I haven't seen 'recommended procedure' and 'not recommended procedure' phrases anywhere in Mirantis documentation. You can check links below, no warnings about possible problems there:

[1] https://answers.launchpad.net/fuel/+question/257794

[2] http://docs.openstack.org/developer/fuel-docs/userdocs/fuel-user-guide/file-ref/openstack-yaml.html

Besides, even if it is not recommended unofficially, why it is not legitimate action that we shouldn't support?

Revision history for this message
Javier Diaz Jr (javierdiazcharles) wrote :

@astupnikov

The bug is of high importance to the customer. There is a known workaround to this issue (i.e. manunal delete of keys), however, customer has marked case as severity 2 (high) and considering they deploy environments very frequently it would ease their process in doing so if we address this.

Revision history for this message
Alexey Stupnikov (astupnikov) wrote :

@dpyzhov, it is up to core developers to decide whether to consider this problem as a bug or not to do so for master branch. On the other hand, our team is responsible for stable branches and I discussed this issue with maintenance team before writing a patch. I will re-open this bug for Newton, Mitaka and Liberty releases.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/413597

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/413621

Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

@Alexey, sorry, but this is a community project and your team is not in charge for stable/newton and stable/mitaka branches. According to PTL and core team decision this bug is invalid and it is an expected behaviour. Please use the workaround.

Revision history for this message
Alexey Stupnikov (astupnikov) wrote :

There is no point to fix this only for stable/8.0 as this bug was reported for stable/mitaka. Closing as invalid.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-web (stable/mitaka)

Change abandoned by Alexey Stupnikov (<email address hidden>) on branch: stable/mitaka
Review: https://review.openstack.org/413597
Reason: This patch doesn't fit with Fuel team plans and is not going to be merged.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-web (master)

Change abandoned by Alexey Stupnikov (<email address hidden>) on branch: master
Review: https://review.openstack.org/408516
Reason: This patch doesn't fit with Fuel team plans and is not going to be merged.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-web (stable/newton)

Change abandoned by Alexey Stupnikov (<email address hidden>) on branch: stable/newton
Review: https://review.openstack.org/413621
Reason: This patch doesn't fit with Fuel team plans and is not going to be merged.

Revision history for this message
Javier Diaz Jr (javierdiazcharles) wrote :

Changed to won't fix.

Won't fix: Doesn't fit with the project plans, sorry.

Reason for abandonment: This patch doesn't fit with Fuel team plans and is not going to be merged.

Changed in fuel:
status: Invalid → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.