Hi,

I met below errors when trying to use keystone v3 endpoint using rally 0.7.0. Could someone help me how to fix or workaround these errors? I plan to use rally benchmark test. Thanks!

Error 1:Here is my rally deploy file:
cat rally_deploy.json
{
  "type": "ExistingCloud",
  "auth_url": "http://**.**.**.**:35357/v3/",
  "region_name": "nova",
  "admin": {
    "username": "admin",
    "password": "admin",
    "project_name": "admin",
    "project_domain_name": "Default",
    "user_domain_name": "Default"
  },
  "users": [
    {
      "username": "tenant4_user1",
      "password": "***",
      "project_name": "tenant4"
    },
    {
      "username": "tenant3_user1",
      "password": "***",
      "project_name": "tenant3"
    },
    {
      "username": "tenant2_user1",
      "password": "***",
      "project_name": "tenant2"
    },
    {
      "username": "tenant1_user1",
      "password": "**",
      "project_name": "tenant1"
    }
  ],
  "https_insecure": True,
  "https_cacert": ""
}
rally deployment create succeeded, but rally  deployment check  failed as below.
rally@e2bfc2794a2a:~$ rally  deployment check
2016-11-22 06:13:19.501 475 CRITICAL rally [-] BadRequest: Expecting to find domain in project - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b4902bc-5e8e-4b5c-8dee-17bf75990b3f)
2016-11-22 06:13:19.501 475 ERROR rally Traceback (most recent call last):
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/bin/rally", line 10, in <module>
2016-11-22 06:13:19.501 475 ERROR rally     sys.exit(main())
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/cli/main.py", line 40, in main
2016-11-22 06:13:19.501 475 ERROR rally     return cliutils.run(sys.argv, categories)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/cli/cliutils.py", line 581, in run
2016-11-22 06:13:19.501 475 ERROR rally     ret = fn(*fn_args, **fn_kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "<decorator-gen-17>", line 2, in check
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/cli/envutils.py", line 67, in default_from_global
2016-11-22 06:13:19.501 475 ERROR rally     return f(*args, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/cli/commands/deployment.py", line 227, in check
2016-11-22 06:13:19.501 475 ERROR rally     services = api.Deployment.check(deployment)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/api.py", line 144, in check
2016-11-22 06:13:19.501 475 ERROR rally     osclients.Clients(objects.Credential(**endpoint_dict)).keystone()
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/osclients.py", line 208, in __call__
2016-11-22 06:13:19.501 475 ERROR rally     self.cache[key] = self.create_client(*args, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/osclients.py", line 323, in create_client
2016-11-22 06:13:19.501 475 ERROR rally     return client.Client(**kw)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneclient/client.py", line 62, in Client
2016-11-22 06:13:19.501 475 ERROR rally     d = discover.Discover(session=session, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2016-11-22 06:13:19.501 475 ERROR rally     return wrapped(*args, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneclient/discover.py", line 185, in __init__
2016-11-22 06:13:19.501 475 ERROR rally     authenticated=authenticated)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2016-11-22 06:13:19.501 475 ERROR rally     return wrapped(*args, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneclient/_discover.py", line 147, in __init__
2016-11-22 06:13:19.501 475 ERROR rally     authenticated=authenticated)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2016-11-22 06:13:19.501 475 ERROR rally     return wrapped(*args, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneclient/_discover.py", line 41, in get_version_data
2016-11-22 06:13:19.501 475 ERROR rally     resp = session.get(url, headers=headers, authenticated=authenticated)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 667, in get
2016-11-22 06:13:19.501 475 ERROR rally     return self.request(url, 'GET', **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2016-11-22 06:13:19.501 475 ERROR rally     return wrapped(*args, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 462, in request
2016-11-22 06:13:19.501 475 ERROR rally     auth_headers = self.get_auth_headers(auth)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 727, in get_auth_headers
2016-11-22 06:13:19.501 475 ERROR rally     return auth.get_headers(self, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/plugin.py", line 90, in get_headers
2016-11-22 06:13:19.501 475 ERROR rally     token = self.get_token(session)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 90, in get_token
2016-11-22 06:13:19.501 475 ERROR rally     return self.get_access(session).auth_token
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 136, in get_access
2016-11-22 06:13:19.501 475 ERROR rally     self.auth_ref = self.get_auth_ref(session)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/generic/base.py", line 181, in get_auth_ref
2016-11-22 06:13:19.501 475 ERROR rally     return self._plugin.get_auth_ref(session, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref
2016-11-22 06:13:19.501 475 ERROR rally     authenticated=False, log=False, **rkwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 675, in post
2016-11-22 06:13:19.501 475 ERROR rally     return self.request(url, 'POST', **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
2016-11-22 06:13:19.501 475 ERROR rally     return wrapped(*args, **kwargs)
2016-11-22 06:13:19.501 475 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 570, in request
2016-11-22 06:13:19.501 475 ERROR rally     raise exceptions.from_response(resp, method, url)
2016-11-22 06:13:19.501 475 ERROR rally BadRequest: Expecting to find domain in project - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b4902bc-5e8e-4b5c-8dee-17bf75990b3f)

____________________________________________________________________________

Error 2: According to above error, I changed rally deploy file as below:
 "admin": {
    "username": "admin",
    "password": "admin",
    "project_name": "admin",
    "project_domain_name": "Default",
    "user_domain_name": "Default",
    "domain_name": "Default"
  }

rally deployment create succeeded, but rally  deployment check  failed as below.
rally@e2bfc2794a2a:~$ rally  deployment check
2016-11-22 03:35:37.052 428 RALLYDEBUG rally.cli.cliutils [-] INFO logs from urllib3 and requests module are hide.
2016-11-22 03:35:37.052 428 RALLYDEBUG rally.cli.cliutils [-] urllib3 insecure warnings are hidden.
2016-11-22 03:35:37.053 428 RALLYDEBUG rally.cli.cliutils [-] ERROR log from boto module is hide.
Command failed, please check log for more info
2016-11-22 03:35:37.265 428 CRITICAL rally [-] AuthorizationFailure: Authentication cannot be scoped to multiple targets. Pick one of: project, domain, trust or unscoped
2016-11-22 03:35:37.265 428 ERROR rally Traceback (most recent call last):
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/bin/rally", line 10, in <module>
2016-11-22 03:35:37.265 428 ERROR rally     sys.exit(main())
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/cli/main.py", line 40, in main
2016-11-22 03:35:37.265 428 ERROR rally     return cliutils.run(sys.argv, categories)
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/cli/cliutils.py", line 581, in run
2016-11-22 03:35:37.265 428 ERROR rally     ret = fn(*fn_args, **fn_kwargs)
2016-11-22 03:35:37.265 428 ERROR rally   File "<decorator-gen-17>", line 2, in check
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/cli/envutils.py", line 67, in default_from_global
2016-11-22 03:35:37.265 428 ERROR rally     return f(*args, **kwargs)
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/cli/commands/deployment.py", line 227, in check
2016-11-22 03:35:37.265 428 ERROR rally     services = api.Deployment.check(deployment)
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/api.py", line 141, in check
2016-11-22 03:35:37.265 428 ERROR rally     services = cls.service_list(deployment)
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/api.py", line 125, in service_list
2016-11-22 03:35:37.265 428 ERROR rally     return clients.services()
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/osclients.py", line 756, in services
2016-11-22 03:35:37.265 428 ERROR rally     available_services = self.keystone.service_catalog.get_endpoints()
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/osclients.py", line 226, in service_catalog
2016-11-22 03:35:37.265 428 ERROR rally     return self.auth_ref.service_catalog
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/rally/osclients.py", line 232, in auth_ref
2016-11-22 03:35:37.265 428 ERROR rally     self.cache["keystone_auth_ref"] = plugin.get_access(sess)
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 136, in get_access
2016-11-22 03:35:37.265 428 ERROR rally     self.auth_ref = self.get_auth_ref(session)
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/generic/base.py", line 181, in get_auth_ref
2016-11-22 03:35:37.265 428 ERROR rally     return self._plugin.get_auth_ref(session, **kwargs)
2016-11-22 03:35:37.265 428 ERROR rally   File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/v3/base.py", line 137, in get_auth_ref
2016-11-22 03:35:37.265 428 ERROR rally     'Authentication cannot be scoped to multiple targets. Pick '
2016-11-22 03:35:37.265 428 ERROR rally AuthorizationFailure: Authentication cannot be scoped to multiple targets. Pick one of: project, domain, trust or unscoped
2016-11-22 03:35:37.265 428 ERROR rally
_____________________________________________________________

Error 3: Change rally deploy file as below:
  "admin": {
    "username": "admin",
    "password": "admin",
    "project_name": "admin",
    "admin_domain_name": "Default",
    "user_domain_name": "Default"
  }

rally deployment create failed as below.
rally@e2bfc2794a2a:~$ rally deployment create --name vio --filename .rally/rally_deploy.json
2016-11-22 05:56:47.747 440 RALLYDEBUG rally.cli.cliutils [-] INFO logs from urllib3 and requests module are hide.
2016-11-22 05:56:47.747 440 RALLYDEBUG rally.cli.cliutils [-] urllib3 insecure warnings are hidden.
2016-11-22 05:56:47.747 440 RALLYDEBUG rally.cli.cliutils [-] ERROR log from boto module is hide.
2016-11-22 05:56:48.112 440 INFO rally.common.plugin.discover [-] Loading plugins from directories /home/rally/.rally/plugins/*
2016-11-22 05:56:48.115 440 INFO rally.common.plugin.discover [-]        Loaded module with plugins: /home/rally/.rally/plugins/scenario/stack_seeding.py
2016-11-22 05:56:48.120 440 INFO rally.common.plugin.discover [-]        Loaded module with plugins: /home/rally/.rally/plugins/scenario/nova_seeding.py
2016-11-22 05:56:48.123 440 INFO rally.common.plugin.discover [-]        Loaded module with plugins: /home/rally/.rally/plugins/scenario/vmtasks_seeding.py
2016-11-22 05:56:48.321 440 ERROR rally.api [-] Deployment 2b32ff68-5e20-40e8-acf2-d63720911826: Schema validation error.
Config schema validation error: {'username': 'admin', 'project_name': 'admin', 'password': 'admin', 'user_domain_name': 'Default', 'admin_domain_name': 'Default'} is not valid under any of the given schemas

Failed validating 'oneOf' in schema['properties']['admin']:
    {'oneOf': [{'additionalProperties': False,
                'properties': {'password': {'type': 'string'},
                               'tenant_name': {'type': 'string'},
                               'username': {'type': 'string'}},
                'required': ['username', 'password', 'tenant_name']},
               {'additionalProperties': False,
                'properties': {'domain_name': {'type': 'string'},
                               'password': {'type': 'string'},
                               'project_domain_name': {'type': 'string'},
                               'project_name': {'type': 'string'},
                               'user_domain_name': {'type': 'string'},
                               'username': {'type': 'string'}},
                'required': ['username', 'password', 'project_name']}],
     'type': 'object'}

On instance['admin']:
    {'admin_domain_name': 'Default',
     'password': 'admin',
     'project_name': 'admin',
     'user_domain_name': 'Default',
     'username': 'admin'}.