RFE: track overcloud deployment in ARA database and make nice report afterwards

[Sagi (Sergey) Shnaidman]

I'd like to track ansible deploy of overcloud in ARA. For that we need to insert additional parameters into asible.cfg file. These are:

[default]
callback_plugins = /usr/lib/python2.7/site-packages/ara/plugins/callbacks
action_plugins = /usr/lib/python2.7/site-packages/ara/plugins/actions

[ara]
database=sqlite:////path/to/db/file

where /path/to/db/file is accessible file for writing data there which could be available after a deployment in a known path (for later tracking data parsing).

I have 3 patches:
Support for ARA report for ansible playbooks in deploy - https://review.openstack.org/#/c/565077/ (tripleo-common)
Support ARA report tracking from command line - https://review.openstack.org/#/c/583799/ (python-tripleoclient)
Collect overcloud statistics with ARA - https://review.openstack.org/#/c/578462/ (tripleo-quickstart-extras)

Tripleo client should pass argument "--ara-report" to triple-common ansible.py file with will write its argument as a path:
openstack overcloud deploy --ara-report /var/lib/mistral/overcloud/ara-ansible.sqlite
https://review.openstack.org/#/c/578462/30/roles/overcloud-deploy/templates/overcloud-deploy.sh.j2

3 problems here:

1. Ansible config file in /var/lib/mistral/overcloud doesn't contain required ara parameters, although they are passed in command line.
2. Overcloud deploy is done via container, which has limited set of mapped common volumes with host. One of them is /var/lib/mistral
3. Because ansible runs in container it doesn't have access to installed ara on the host.

Current:

1. Not sure what is lacking for generating a required ansible.cfg file. It worked about two weeks ago, but seems like stopped after some changes in tripleo. Mistral folks checked it and didn't find problems in last patchsets.

2. I use /var/lib/mistral/overcloud as place to put database file, but it might be not present in time of ansible run, so maybe /var/lib/mistral should be the path. All mapped volumes by mistral-executor container are here: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/mistral-executor.yaml#L118-L131

3. I use hack to install ara in mistral-executor container, commit and push it to registry[1] before overcloud deployment, but we need some long range solution for that. ARA doesn't have RPM, only python module. Maybe we can map also python libraries on the host.
[1] https://review.openstack.org/#/c/578462/30/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2

[Alex Schultz (alex-schultz)]

We now have this in CI. It's not currently slated for inclusion in tripleo at this time.