Unable to retrive results in rally for failure in one part of a scenario

[Sunil Mamillapalli]

Hi,

I am unable to retrive results in rally, even if a part of the scenario is failing.

Consider the existing test scenario in Rally - (Nova-Keypair)

Here is my Input json file: -

{
    "NovaKeypair.create_and_delete_keypair": [
        {
            "runner": {
                "type": "constant",
                "times": 1,
                "concurrency": 1
            },
            "context": {
                "users": {
                    "tenants": 1,
                    "users_per_tenant": 1
                }
            }
        }
    ]
}

Please look into my explanation -

In the above scenario, create-keypair action was successful and delete-keypair was failed due to some issue for every iteration.

Eventhough the delete-keypair action was unsuccessful for every iteration, we should be able to get results for create-keypair. But it didn't show any of the results.

Here is the Output-Log:

test scenario NovaKeypair.create_and_delete_keypair
args position 0
args values:
{
  "runner": {
    "type": "constant",
    "concurrency": 1,
    "times": 1
  },
  "context": {
    "users": {
      "project_domain": "default",
      "users_per_tenant": 1,
      "tenants": 1,
      "resource_management_workers": 30,
      "user_domain": "default"
    }
  }
}
+-----------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | 0.0% | 1 |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
Load duration: 2.57646012306
Full duration: 9.18986487389

Observed the same issue in all scenario's with one un-successful part.

Please look into the issue ASAP.

Regards,
Sunil

[zhangzhihui (zhangzhang)]

Does anyone have any ideas about the bug?

[Andriy Kurilin (andreykurilin)]

It looks like this bug was fixed while refactoring of atomic actions. The fix is included in the latest rally