ubuntu_vlan_ha jobs doesn't update puppets on master node

[Ivan Berezovskiy]

Detailed bug description:
Let's compare test result on the https://review.openstack.org/#/c/321086/ - patch set #1
This patch updated revoke_driver to 'keystone.revoke.backends.dummy.Revoke'

Tests on this patches:
https://ci.fuel-infra.org/job/master.fuel-library.pkgs.ubuntu.smoke_neutron/5369/ - FAILED - and failure catched real problem
https://ci.fuel-infra.org/job/master.fuel-library.pkgs.ubuntu.neutron_vlan_ha/9387/ - PASSED - problem isn't found

if we check snapshot:

for smoke_neutron job we've got /etc/keystone/keystone.conf update with revoke_driver value according to the path

for ubuntu_vlan_ha - revoke_driver value is kept old

From ubuntu_vlan_ha jobs logs we can see that we are reverting snapshot with already deployed and we run OSTF tests. That's it. What's the value of this job if doesn't actually test the patch set?

My suggestion that this job should apply patch on master node, full deploy vlan_ha env and run OSTF. In this case the patch will be actually tested in HA mode and we will have less chances to break BVT.

Fuel CI team, please provide your feedback.

[Bug Checker Bot (bug-checker)]

(This check performed automatically)
Please, make sure that bug description contains the following sections filled in with the appropriate data related to the bug you are describing:

expected result

steps to reproduce

For more detailed information on the contents of each of the listed sections see https://wiki.openstack.org/wiki/Fuel/How_to_contribute#Here_is_how_you_file_a_bug

[Ivan Berezovskiy (iberezovskiy)]

Another 'fresh' example https://review.openstack.org/#/c/325337/

[Aleksandra Fedorova (bookwar)]

As we discussed, this is expected behavior of for neutron_vlan_ha test case.

Please discuss with QA team and come up with a proposal for how to change set of deployment tests we run on every commit.