magnum functional test_create_list_and_delete_bays only with swarm backend

[Michal Jura]

{1} magnum.tests.functional.api.v1.test_bay.BayTest.test_create_list_and_delete_bays [28.951078s] ... FAILED

    Traceback (most recent call last):
      File "/usr/lib/python2.7/site-packages/magnum/tests/functional/api/v1/test_bay.py", line 210, in test_certificate_sign_and_show
        _, bay_model = self._create_bay(first_model)
      File "/usr/lib/python2.7/site-packages/magnum/tests/functional/api/v1/test_bay.py", line 95, in _create_bay
        resp, model = self.bay_client.post_bay(bay_model)
      File "/usr/lib/python2.7/site-packages/magnum/tests/functional/api/v1/clients/bay_client.py", line 84, in post_bay
        body=model.to_json(), **kwargs)
      File "/usr/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 259, in post
        return self.request('POST', url, extra_headers, headers, body)
      File "/usr/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 642, in request
        resp, resp_body)
      File "/usr/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 761, in _error_checker
        message=message)
    ServerFault: Got server fault
    Details: [{u'status': 500, u'code': u'server', u'links': [], u'title': u'Bay type (vm, opensuse, swarm) not supported', u'detail': u'Bay type (vm, opensuse, swarm) not supported.', u'request_id': u''}]
    Traceback (most recent call last):
    _StringException: Empty attachments:
      pythonlogging:''
      stderr
      stdout

And probably this is because magnum/tests/functional/api/v1/test_bay.py has hardcoded validation swarm backend
https://github.com/openstack/magnum/blob/master/magnum/tests/functional/api/v1/test_bay.py#L61

I think we would like to have also possibility to run functional tests against kubernetes backend too

[Jaycen Grant (jaycen-v-grant)]

would these cover something that is missed in the other k8s, swarm, ironic, etc.. functional test sections other than the api? I think the api tests are hardcoded but are covered in the targeted functional tests.

[hongbin (hongbin034)]

The hard-coded of 'swarm' is intended, since magnum.tests.functional.api.* is not designed to test specific COE.

For opensuse, I guess you want to add tests to magnum.tests.functional.k8s.* (under a folder magnum/tests/functional/k8s_<YOUR_OS>/)