OpenStack workloads stats is incorrect on cluster reset

[Alexander Kislitsky]

After cluster reset we save only last addition date.
Possible fix is changing format of 'added', 'removed', 'modified'. We should use list of dicts.
Also we will have single format for all data in the 'resource_data'.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/161238

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/161645

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/161238
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=4d03494d078518af554db96a6e277dc33d417a30
Submitter: Jenkins
Branch: master

commit 4d03494d078518af554db96a6e277dc33d417a30
Author: Alexander Kislitsky <email address hidden>
Date: Wed Mar 4 16:57:20 2015 +0300

    Data format of workload resource_data changed

    In case of cluster reset we can lose information about adding and
    removing workloads. For prevention format of resource_data is
    changed. Now we have lists of dicts in 'added', 'remove', 'modified'
    and 'current'. On cluster reset we can have several records in the
    'added' with different time of adding. For 'removed' we add full
    data only if it doesn't already added. In other case we add only
    id with removing time.

    Change-Id: I763705b196ec78aa9ed2df1a3fc8f98325377ae0
    Partial-Bug: #1427757
    Implements: blueprint openstack-workload-statistics

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/161645
Committed: https://git.openstack.org/cgit/stackforge/fuel-stats/commit/?id=32a1eb4c932c9528c214d7cbf359cae713c6ceba
Submitter: Jenkins
Branch: master

commit 32a1eb4c932c9528c214d7cbf359cae713c6ceba
Author: Alexander Kislitsky <email address hidden>
Date: Thu Mar 5 12:06:15 2015 +0300

    Data format of workload resource_data changed

    Fuel-stats part of implementation.
    In case of cluster reset we can lose information about adding and
    removing workloads. For prevention format of resource_data is
    changed. Now we have lists of dicts in 'added', 'remove', 'modified'
    and 'current'. On cluster reset we can have several records in the
    'added' with different time of adding. For 'removed' we add full
    data only if it doesn't already added. In other case we add only
    id with removing time.

    Change-Id: I2d57f53fcb1489f177772875464056ef301b16a6
    Closes-Bug: #1427757
    Implements: blueprint openstack-workload-statistics

[Andrey Sledzinskiy (asledzinskiy)]

verified on {

    "build_id": "2015-03-11_22-54-44",
    "ostf_sha": "ecb8e294b0acbdc5b0300d5e39028fb26ecc9088",
    "build_number": "188",
    "release_versions":

{

    "2014.2-6.1":

{

    "VERSION":

{

    "build_id": "2015-03-11_22-54-44",
    "ostf_sha": "ecb8e294b0acbdc5b0300d5e39028fb26ecc9088",
    "build_number": "188",
    "api": "1.0",
    "nailgun_sha": "a720a2da99690eb2d2c19ddc5d739384312a8ac2",
    "production": "docker",
    "python-fuelclient_sha": "0f4ca9c2798da34797dd082130d22cac04c998a9",
    "astute_sha": "5cdd4ae4037aa29f4c876d441af15cad82f5a6cb",
    "feature_groups":

            [
                "mirantis"
            ],
            "release": "6.1",
            "fuelmain_sha": "0791400dd8224647ff9a5cb8051ce82b2c8863b1",
            "fuellib_sha": "e660cbdfc506197e7f79a4bf7caab2990953abe3"
        }
    }

},
"auth_required": true,
"api": "1.0",
"nailgun_sha": "a720a2da99690eb2d2c19ddc5d739384312a8ac2",
"production": "docker",
"python-fuelclient_sha": "0f4ca9c2798da34797dd082130d22cac04c998a9",
"astute_sha": "5cdd4ae4037aa29f4c876d441af15cad82f5a6cb",
"feature_groups":

    [
        "mirantis"
    ],
    "release": "6.1",
    "fuelmain_sha": "0791400dd8224647ff9a5cb8051ce82b2c8863b1",
    "fuellib_sha": "e660cbdfc506197e7f79a4bf7caab2990953abe3"

}