Attempt to auth with deleted project

[Boris Bobrov]

Rally tries to get a project-scoped token using id of a project that it has previously deleted. Partial logs from a run are attached, full logs are available if required. Please note the usage of tenant id 3316926c2db2495997e6b31250ce06a7.

rally==0.0.5.dev205, installed using docker.

[Kun Huang (academicgareth)]

Hi, breton

You could paste full logs in paste.openstack.org

From your partial log, I found user context exits BEFORE benchmarking which is real problem. So I would like to see full log first

[Boris Bobrov (bbobrov)]

Hi,

Sorry, the full logs were available ~month ago and I don't have them now. However, I posted the logs from the beginning of initialization to the first iteration.

[Kun Huang (academicgareth)]

I still can't reproduce it, and hope some one else could verify this.

[Leontii Istomin (listomin)]

I've reproduced the issue. (rally logs and results are attached)
For example GlanceImages.create_image_and_boot_instances rally scenario. From rally log:
http://paste.openstack.org/show/448716/
As we can see user can't be authorized because tenant was deleted

Fuel Diagnostic Snapshot: mos-scale-share.mirantis.com/fuel-snapshot-2015-09-07_14-04-59.tar.xz

[Leontii Istomin (listomin)]

Update for comment #5:
rally version=0.0.4

Fuel Diagnostic Snapshot: http://mos-scale-share.mirantis.com/fuel-snapshot-2015-09-07_14-04-59.tar.xz

[Boris Pavlovic (boris-42)]

What did you exactly run?

[Leontii Istomin (listomin)]

We performed light rally tests. You can find rally logs (and scenarios) and rally results in rally_results_and_logs.tar.gz which has been attached to comment #5

[Kun Huang (academicgareth)]

@Leontiy

http://paste.openstack.org/show/451523/ this is log from of create_image_and_boot_instances, but how did you know the reason of that 401 is to authorizing deleted tenant?

[Boris Bobrov (bbobrov)]

The tenant gets deleted on line 102 and later an exception with this tenant_id in the message occurs.

[Kun Huang (academicgareth)]

@Bobrov

Thanks for your feedback! I find something strange

http://paste.openstack.org/show/451827/

In this version, task enter&exit user context twice. It maybe the problem and I will trace this problem. BTW, this problem can't be reproduced every time? Do you know some certain conditions?

[Boris Bobrov (bbobrov)]

> this problem can't be reproduced every time?

Yep, it reproduces once in a while

> Do you know some certain conditions?

No, sorry. I am in process of looking for such conditions.

[Boris Bobrov (bbobrov)]

The bug happened due to misconfiguration of keystone. Sorry for the hassle folks.

[Kun Huang (academicgareth)]

okay, thanks for you response