create/document a set of scripts manually run by VMT members to set-up and run devstack and unit tests locally

[James E. Blair]

 affects openstack-ci
 milestone havana
 status triaged
 importance medium

[Jeremy Stanley (fungi)]

After some initial tryouts, I think the sanest method (in order to avoid unnecessary drift from CI) is to add some extra knobs to devstack-vm-gate-wrap.sh so that it can apply locally-supplied patches or maybe refer to a commit in a local git repository on the VM.

The primary deliverable for this task will be trivial patches to devstack-gate scripting to enable running stand-alone (no real Zuul or Gerrit references), along with documentation updates detailing how to recreate the essence of an arbitrary gate-devstack-vm-* job on a single-use VM specially launched for this purpose from a standard provider image.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/32661

[Jeremy Stanley (fungi)]

Turns out I was able to get this working without patching any of the exiting tooling, so this first stab is an all-document solution. We could theoretically script up more of what's there, but the actual code snippets are small enough to be cut-n-paste friendly and will generally need editing to set project name, branch, job parameters and so on.

Thoroughly tested the documented workflow on both Rackspace and HPCloud accounts, and also used it to help troubleshoot failing tempest tests for a nova euca change as a proof-of-concept (turned out to be a devstack bug I later patched).

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/32661
Committed: http://github.com/openstack-infra/devstack-gate/commit/59953b48511c8ca7178248d32ea9b3d121671032
Submitter: Jenkins
Branch: master

commit 59953b48511c8ca7178248d32ea9b3d121671032
Author: Jeremy Stanley <email address hidden>
Date: Tue Jun 11 17:22:52 2013 +0000

    Document how to manually simulate infrastructure.

    Fixes bug 1172428.

    * README.rst: Developers often have a need to recreate gating
    integration tests manually, and this provides a walkthrough of
    making a DG-slave-like throwaway server without the overhead of
    building other CI infrastructure to manage a pool of them. This can
    be useful to reproduce and troubleshoot failures or tease out
    nondeterministic bugs. The driving use case is for pre-testing
    embargoed vulnerability fixes, increasing the chance they can get
    through gating on the first try.

    Change-Id: I0f78011c183f64b894b336eb8e0d25dc5ba00bde