image search error 500

[Robert Duncan]

Zun as deployed by kolla-ansible 8 stein on Ubuntu from source

when searching for an image I get error 500

zun image-search --image_driver docker ubuntu
ERROR: Internal Server Error (HTTP 500) (Request-ID: req-a9e965aa-8957-4f08-b3cd-9ae2b8b2793f)

zun --debug image-search --image_driver docker ubuntu

((tl:dr TypeError: image_search() takes at least 6 arguments (5 given)))

DEBUG (connectionpool:813) Starting new HTTPS connection (1): openstack:9517
DEBUG (connectionpool:393) https://openstack:9517 "GET /v1/images/ubuntu/search?exact_match=False&image_driver=docker HTTP/1.1" 500 261
DEBUG (session:479) RESP: [500] Content-Length: 261 Content-Type: application/json Date: Fri, 27 Sep 2019 12:36:44 GMT OpenStack-API-Maximum-Version: container 1.32 OpenStack-API-Minimum-Version: container 1.1 OpenStack-API-Version: container 1.25 Server: Apache vary: OpenStack-API-Version x-openstack-request-id: req-3ca36b5c-b184-432a-9890-654f4a73468c
DEBUG (session:511) RESP BODY: {"errors": [{"status": 500, "code": "container.", "links": [], "title": "Internal Server Error", "detail": "Your request could not be handled because of a problem in the server. Error Correlation id is: 69a80383-b8e5-48af-b4c8-51dc7c1e604a", "request_id": ""}]}
DEBUG (session:844) GET call to container for https://openstack:9517/v1/images/ubuntu/search?exact_match=False&image_driver=docker used request id req-3ca36b5c-b184-432a-9890-654f4a73468c
DEBUG (shell:715) Internal Server Error (HTTP 500) (Request-ID: req-3ca36b5c-b184-432a-9890-654f4a73468c)
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/zunclient/shell.py", line 713, in main
    map(encodeutils.safe_decode, sys.argv[1:]))
  File "/usr/local/lib/python2.7/dist-packages/zunclient/shell.py", line 650, in main
    args.func(self.cs, args)
  File "/usr/local/lib/python2.7/dist-packages/zunclient/v1/images_shell.py", line 100, in do_image_search
    images = cs.images.search_image(args.image, **opts)
  File "/usr/local/lib/python2.7/dist-packages/zunclient/v1/images.py", line 114, in search_image
    return self._search(self._path(image) + '/search', image_query)
  File "/usr/local/lib/python2.7/dist-packages/zunclient/common/base.py", line 152, in _search
    resp, body = self.api.json_request('GET', url, body=body)
  File "/usr/local/lib/python2.7/dist-packages/zunclient/common/httpclient.py", line 367, in json_request
    resp = self._http_request(url, method, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/zunclient/common/httpclient.py", line 350, in _http_request
    error_json.get('debuginfo'), method, url)
InternalServerError: Internal Server Error (HTTP 500) (Request-ID: req-3ca36b5c-b184-432a-9890-654f4a73468c)
ERROR: Internal Server Error (HTTP 500) (Request-ID: req-3ca36b5c-b184-432a-9890-654f4a73468c)

from the api logs:

Calling compute.image_search with ubuntu search /var/lib/kolla/venv/local/lib/python2.7/site-packages/zun/api/controllers/v1/images.py:170
2019-09-27 12:36:44.247 16 ERROR zun.common.exception [req-d10dd889-5474-4aa3-8e5e-cfdedaa065b4 cf33767e3f784f01abd7515fc431f395 634cbbb62667443f8bc929d5bb515966 default - -] 69a80383-b8e5-48af-b4c8-51dc7c1e604a:image_search() takes at least 6 arguments (5 given): TypeError: image_search() takes at least 6 arguments (5 given)
2019-09-27 12:36:44.247 16 ERROR zun.common.exception Traceback (most recent call last):
2019-09-27 12:36:44.247 16 ERROR zun.common.exception File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/zun/common/exception.py", line 110, in wrapped
2019-09-27 12:36:44.247 16 ERROR zun.common.exception return func(*args, **kwargs)
2019-09-27 12:36:44.247 16 ERROR zun.common.exception File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/zun/api/validation/__init__.py", line 55, in wrapper
2019-09-27 12:36:44.247 16 ERROR zun.common.exception return func(*args, **kwargs)
2019-09-27 12:36:44.247 16 ERROR zun.common.exception File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/zun/api/controllers/v1/images.py", line 184, in search
2019-09-27 12:36:44.247 16 ERROR zun.common.exception exact_match)
2019-09-27 12:36:44.247 16 ERROR zun.common.exception File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/osprofiler/profiler.py", line 160, in wrapper
2019-09-27 12:36:44.247 16 ERROR zun.common.exception result = f(*args, **kwargs)
2019-09-27 12:36:44.247 16 ERROR zun.common.exception File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/zun/compute/api.py", line 209, in image_search
2019-09-27 12:36:44.247 16 ERROR zun.common.exception exact_match, *args)
2019-09-27 12:36:44.247 16 ERROR zun.common.exception File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/osprofiler/profiler.py", line 160, in wrapper
2019-09-27 12:36:44.247 16 ERROR zun.common.exception result = f(*args, **kwargs)
2019-09-27 12:36:44.247 16 ERROR zun.common.exception TypeError: image_search() takes at least 6 arguments (5 given)
2019-09-27 12:36:44.247 16 ERROR zun.common.exception

I have tried to give extra args like zun image-search --image_driver docker --exact-match true ubuntu etc - same result

weirdly I can pull images from horizon, but cannot pull the cloud shell image (image not found)
however, if I go to the containers>>images within the admin panel in horizon I can pull the cloud shell image?
from the containers panel in the project I can only pull official images like centos debian ubuntu I cannot find images like publisher/image which includes the cloud shell image

I presume these are all symptoms of image-search failing but image-pull working

here is an image pull (I have to give the host arg?)
zun --debug pull centos nova1
DEBUG (extension:189) found extension EntryPoint.parse('noauth = cinderclient.contrib.noauth:CinderNoAuthLoader')
DEBUG (extension:189) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
DEBUG (extension:189) found extension EntryPoint.parse('none = keystoneauth1.loading._plugins.noauth:NoAuth')
DEBUG (extension:189) found extension EntryPoint.parse('v3oauth1 = keystoneauth1.extras.oauth1._loading:V3OAuth1')
DEBUG (extension:189) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
DEBUG (extension:189) found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode')
DEBUG (extension:189) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
DEBUG (extension:189) found extension EntryPoint.parse('v3samlpassword = keystoneauth1.extras._saml2._loading:Saml2Password')
DEBUG (extension:189) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
DEBUG (extension:189) found extension EntryPoint.parse('v3adfspassword = keystoneauth1.extras._saml2._loading:ADFSPassword')
DEBUG (extension:189) found extension EntryPoint.parse('v3oidcaccesstoken = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAccessToken')
DEBUG (extension:189) found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword')
DEBUG (extension:189) found extension EntryPoint.parse('v3kerberos = keystoneauth1.extras.kerberos._loading:Kerberos')
DEBUG (extension:189) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
DEBUG (extension:189) found extension EntryPoint.parse('v3oidcclientcredentials = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectClientCredentials')
DEBUG (extension:189) found extension EntryPoint.parse('v3tokenlessauth = keystoneauth1.loading._plugins.identity.v3:TokenlessAuth')
DEBUG (extension:189) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
DEBUG (extension:189) found extension EntryPoint.parse('v3totp = keystoneauth1.loading._plugins.identity.v3:TOTP')
DEBUG (extension:189) found extension EntryPoint.parse('v3applicationcredential = keystoneauth1.loading._plugins.identity.v3:ApplicationCredential')
DEBUG (extension:189) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
DEBUG (extension:189) found extension EntryPoint.parse('v3fedkerb = keystoneauth1.extras.kerberos._loading:MappedKerberos')
DEBUG (session:448) REQ: curl -g -i -X GET http://172.25.20.100:35357/v3 -H "Accept: application/json" -H "User-Agent: zun keystoneauth1/3.11.2 python-requests/2.21.0 CPython/2.7.12"
DEBUG (connectionpool:205) Starting new HTTP connection (1): 172.25.20.100:35357
DEBUG (connectionpool:393) http://172.25.20.100:35357 "GET /v3 HTTP/1.1" 200 254
DEBUG (session:479) RESP: [200] Content-Length: 254 Content-Type: application/json Date: Fri, 27 Sep 2019 12:52:10 GMT Server: Apache Vary: X-Auth-Token x-openstack-request-id: req-90f9cc38-5984-481c-bde4-cbccab934553
DEBUG (session:511) RESP BODY: {"version": {"status": "stable", "updated": "2019-01-22T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.12", "links": [{"href": "http://172.25.20.100:35357/v3/", "rel": "self"}]}}
DEBUG (session:853) GET call to http://172.25.20.100:35357/v3 used request id req-90f9cc38-5984-481c-bde4-cbccab934553
DEBUG (base:176) Making authentication request to http://172.25.20.100:35357/v3/auth/tokens
DEBUG (connectionpool:393) http://172.25.20.100:35357 "POST /v3/auth/tokens HTTP/1.1" 201 10992
DEBUG (base:181) {"token": {"is_domain": false, "methods": ["password"], "roles": [{"id": "04cc8567e3684eb89854227ef7527d42", "name": "heat_stack_owner"}, {"id": "02561ddbb29744aebf2c3a5a5b4d83ce", "name": "member"}, {"id": "565dafdf4fd147cfae22930710a0f069", "name": "admin"}, {"id": "06f8115e539641a7a3af3b442b0d6b72", "name": "reader"}], "expires_at": "2019-09-28T12:52:10.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "634cbbb62667443f8bc929d5bb515966", "name": "admin"}, "catalog": [{"endpoints": [{"url": "http://172.25.20.100:8070/v2.0", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "49441cbc1a5b472484a47a273a129700"}, {"url": "http://172.25.20.100:8070/v2.0", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "9bff87b394b94deb86ebbdfcfe7dec14"}, {"url": "https://openstack:8070/v2.0", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "ffeb74ea33a947e4aed58dcfaa457594"}], "type": "monitoring", "id": "06259157272b4f0890b863f382a28306", "name": "monasca-api"}, {"endpoints": [{"url": "https://openstack:9001", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "2b52c142178e4272a4c09cf7d04b267f"}, {"url": "http://172.25.20.100:9001", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "3a7cdc9101324d559a035928b6abbb81"}, {"url": "http://172.25.20.100:9001", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "e921a9ae05fc4df6b93a8a0b3bb8db4d"}], "type": "dns", "id": "09fb01abcbff44089b400200c06704b1", "name": "designate"}, {"endpoints": [{"url": "http://172.25.20.100:6780/swift/v1", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "02161a9b7fee4aaaaf3dde74c8ab7ca3"}, {"url": "http://172.25.20.100:6780/swift/v1", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "29c82b94b22e48a3a553a41c1b071d69"}, {"url": "https://openstack:6780/swift/v1", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "9beda01d4e394ce28488051ad6b143d5"}], "type": "object-store", "id": "18d22aa68f3c49c7b732b5b3a4a8ae6f", "name": "swift"}, {"endpoints": [{"url": "http://172.25.20.100:9696", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "d3ecf06f123748e3a595d1aff28d97db"}, {"url": "https://openstack:9696", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "e00b8055036647fca1ffece893f2536c"}, {"url": "http://172.25.20.100:9696", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "e4d61806dc1b4809a7bf1e7ab6d15d2b"}], "type": "network", "id": "33b9b3e8d8264807823b43ea5cc03865", "name": "neutron"}, {"endpoints": [{"url": "http://172.25.20.100:8780", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "0b488874c03a47689af7fb8e86ac2111"}, {"url": "https://openstack:8780", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "17e15f7908dc443198bbce7400498c0e"}, {"url": "http://172.25.20.100:8780", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "4b80f77598824e60ad51b52de98ab563"}], "type": "placement", "id": "36b0913bf65646278d4f77d2ef45f1b2", "name": "placement"}, {"endpoints": [{"url": "http://172.25.20.100:35357", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "208bff56d0184b4f92881e9a4b58954f"}, {"url": "https://openstack:5000", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "f1b592737af94698880e9dcab34257df"}, {"url": "http://172.25.20.100:5000", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "f2d19e6f3b41458dae664d5167d5d528"}], "type": "identity", "id": "4d700eb182a24d52902e9daabe81632e", "name": "keystone"}, {"endpoints": [{"url": "http://172.25.20.100:8776/v3/634cbbb62667443f8bc929d5bb515966", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "420565de43d042f282a26768c9230ac7"}, {"url": "https://openstack:8776/v3/634cbbb62667443f8bc929d5bb515966", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "66feab009e674dd7af04988b89a3697e"}, {"url": "http://172.25.20.100:8776/v3/634cbbb62667443f8bc929d5bb515966", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "d073f8be43de4dabb3c14c48f763009a"}], "type": "volumev3", "id": "5692d91d1b36476e8d4e1637d9df8fd9", "name": "cinderv3"}, {"endpoints": [{"url": "https://openstack:8000/v1", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "27658a02ab8342d0bb263a73df7bfe9f"}, {"url": "http://172.25.20.100:8000/v1", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "b639271dbeba4266aca5aecaa5c9f711"}, {"url": "http://172.25.20.100:8000/v1", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "ea5339e432a04995ae40e189690d1911"}], "type": "cloudformation", "id": "64ab587b68df45d4ad7c09e6e955cbe9", "name": "heat-cfn"}, {"endpoints": [{"url": "http://172.25.20.100:9517/v1/", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "15c37e8fa5e5437cb855f327a00d6aa5"}, {"url": "https://openstack:9517/v1/", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "80930c11b0304b669fa5d41b5effe57b"}, {"url": "http://172.25.20.100:9517/v1/", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "88bc89ad135a4eb899d5418ce6a2b032"}], "type": "container", "id": "663aa18bab2641c1bd73cb67b2b6f66e", "name": "zun"}, {"endpoints": [{"url": "https://openstack:8774/v2/634cbbb62667443f8bc929d5bb515966", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "b7517ea1c02c4b60b0a8ba36095e9154"}, {"url": "http://172.25.20.100:8774/v2/634cbbb62667443f8bc929d5bb515966", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "beccb0a228c1446581dc52780396c91e"}, {"url": "http://172.25.20.100:8774/v2/634cbbb62667443f8bc929d5bb515966", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "c868363e930c47a2be4439d8c7f5b5e7"}], "type": "compute_legacy", "id": "674a0ddc6e06481483cbff53205cc4bf", "name": "nova_legacy"}, {"endpoints": [{"url": "http://172.25.20.100:8776/v2/634cbbb62667443f8bc929d5bb515966", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "0799634dcdf145e284aab1702e36d5df"}, {"url": "https://openstack:8776/v2/634cbbb62667443f8bc929d5bb515966", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "4a8cee86efda47ef90fd43c4cec7bdc9"}, {"url": "http://172.25.20.100:8776/v2/634cbbb62667443f8bc929d5bb515966", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "5d266b50173e4c1cbb70b40ff99665c9"}], "type": "volumev2", "id": "76a0095da0c94156944e4efb501ba5e9", "name": "cinderv2"}, {"endpoints": [{"url": "https://openstack:9292", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "3a0c460ba58440a4ac5f992b1996a3a0"}, {"url": "http://172.25.20.100:9292", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "7196d2c880cc4bf085b61b283096a9ec"}, {"url": "http://172.25.20.100:9292", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "f7bf26d9dced42ceb29ba663a910ee92"}], "type": "image", "id": "7c0eb75477c14f22a13f7f05b5d5a41c", "name": "glance"}, {"endpoints": [{"url": "http://172.25.20.100:9511/v1", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "636ab8e0089547008ac295ece85d4a13"}, {"url": "https://openstack:9511/v1", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "bef7d2ea9f584e4d8df0f8bed307b323"}, {"url": "http://172.25.20.100:9511/v1", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "e3d050af08fb4c8294464fb7fc86b41c"}], "type": "container-infra", "id": "984a983b1d1a41f6a81a50299d5cc263", "name": "magnum"}, {"endpoints": [{"url": "http://172.25.20.100:9311", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "64e6b7de68754e2aa638eb97c66544df"}, {"url": "https://openstack:9311", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "a08d84b07c014e01868f5bc1b2c95e24"}, {"url": "http://172.25.20.100:9311", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "f6072fedc40240aeb2c6d20082907ec2"}], "type": "key-manager", "id": "a81681ed42f6422da85a8c247a4656ac", "name": "barbican"}, {"endpoints": [{"url": "http://172.25.20.100:8004/v1/634cbbb62667443f8bc929d5bb515966", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "33348537f3e04db782eaa882bffb5411"}, {"url": "https://openstack:8004/v1/634cbbb62667443f8bc929d5bb515966", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "81960a8d48a04303a5918818d9aa83ed"}, {"url": "http://172.25.20.100:8004/v1/634cbbb62667443f8bc929d5bb515966", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "88adf71c69eb413e9be7cb9d398a13ed"}], "type": "orchestration", "id": "c7af9740ec4c4d1f9bb44733842dbe25", "name": "heat"}, {"endpoints": [{"url": "http://172.25.20.100:5607", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "7a7c343b177c4bd4ae068124baf637dd"}, {"url": "http://172.25.20.100:5607", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "979013c3af0d4f2d92f08ef053a03cd7"}, {"url": "https://openstack:5607", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "c795489da8c741f8aeeeb9ffa1f667cc"}], "type": "logging", "id": "f3aac3c8be514e3d85ee3a2890bed82f", "name": "monasca-log-api"}, {"endpoints": [{"url": "http://172.25.20.100:8774/v2.1/634cbbb62667443f8bc929d5bb515966", "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "a1d5bb55f2eb44559478f060e6cb841e"}, {"url": "https://openstack:8774/v2.1/634cbbb62667443f8bc929d5bb515966", "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "e6f83003c1154f46be9b54644bfa4204"}, {"url": "http://172.25.20.100:8774/v2.1/634cbbb62667443f8bc929d5bb515966", "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "f5493f2b18054de194b67b9b2e96a312"}], "type": "compute", "id": "fe4ddfb292c7498080be3b81bfab31d4", "name": "nova"}], "user": {"domain": {"id": "default", "name": "Default"}, "password_expires_at": null, "name": "admin", "id": "cf33767e3f784f01abd7515fc431f395"}, "audit_ids": ["2Z8sDFB_QYa3J8mWVB4Qhg"], "issued_at": "2019-09-27T12:52:10.000000Z"}}
DEBUG (session:448) REQ: curl -g -i -X POST https://openstack:9517/v1/images/ -H "Accept: application/json" -H "Content-Type: application/json" -H "OpenStack-API-Version: container 1.25" -H "User-Agent: None" -H "X-Auth-Token: {SHA256}9812326b3080da93c13a138859b3695bbb03efa534eaa1f3b151e258d2898d14" -d '{"repo": "centos", "host": "nova1"}'
DEBUG (connectionpool:813) Starting new HTTPS connection (1): openstack:9517
DEBUG (connectionpool:393) https://openstack:9517 "POST /v1/images/ HTTP/1.1" 202 414
DEBUG (session:479) RESP: [202] Content-Length: 414 Content-Type: application/json Date: Fri, 27 Sep 2019 12:52:10 GMT Location: http://openstack:9517/v1/images/631b508c-f835-494e-9600-9908012fbd9a OpenStack-API-Maximum-Version: container 1.32 OpenStack-API-Minimum-Version: container 1.1 OpenStack-API-Version: container 1.25 Server: Apache vary: OpenStack-API-Version x-openstack-request-id: req-85b806b9-5578-42a2-9308-f7d309ce9076
DEBUG (session:511) RESP BODY: {"uuid": "631b508c-f835-494e-9600-9908012fbd9a", "links": [{"href": "http://openstack:9517/v1/images/631b508c-f835-494e-9600-9908012fbd9a", "rel": "self"}, {"href": "http://openstack:9517/images/631b508c-f835-494e-9600-9908012fbd9a", "rel": "bookmark"}], "repo": "centos", "image_id": null, "host": "nova1", "tag": "latest", "project_id": "634cbbb62667443f8bc929d5bb515966", "size": null}
DEBUG (session:844) POST call to container for https://openstack:9517/v1/images/ used request id req-85b806b9-5578-42a2-9308-f7d309ce9076
+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property | Value |
+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| uuid | 631b508c-f835-494e-9600-9908012fbd9a |
| links | ["{u'href': u'http://openstack:9517/v1/images/631b508c-f835-494e-9600-9908012fbd9a', u'rel': u'self'}", "{u'href': u'http://openstack:9517/images/631b508c-f835-494e-9600-9908012fbd9a', u'rel': u'bookmark'}"] |
| repo | centos |
| image_id | None |
| host | nova1 |
| tag | latest |
| project_id | 634cbbb62667443f8bc929d5bb515966 |
| size | None |
+------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

is there any way not not give the host arg?

zun service-list
+----+----------+-------------+-------+----------+-----------------+---------------------+-------------------+
| Id | Host | Binary | State | Disabled | Disabled Reason | Updated At | Availability Zone |
+----+----------+-------------+-------+----------+-----------------+---------------------+-------------------+
| 3 | nova1 | zun-compute | up | False | None | 2019-09-27 13:09:25 | nova |
| 6 | nova6 | zun-compute | up | False | None | 2019-09-27 13:08:50 | nova |
| 9 | nova2 | zun-compute | up | False | None | 2019-09-27 13:09:22 | nova |
| 12 | nova3 | zun-compute | up | False | None | 2019-09-27 13:09:03 | nova |
| 15 | nova8 | zun-compute | up | False | None | 2019-09-27 13:08:34 | nova |
| 18 | nova4 | zun-compute | up | False | None | 2019-09-27 13:08:51 | nova |
| 21 | nova5 | zun-compute | up | False | None | 2019-09-27 13:09:02 | nova |
| 24 | nova12 | zun-compute | up | False | None | 2019-09-27 13:08:37 | nova |
| 27 | nova7 | zun-compute | up | False | None | 2019-09-27 13:08:38 | nova |
| 30 | nova9 | zun-compute | up | False | None | 2019-09-27 13:08:53 | nova |
| 33 | nova10 | zun-compute | up | False | None | 2019-09-27 13:08:56 | nova |
| 36 | nova11 | zun-compute | up | False | None | 2019-09-27 13:08:43 | nova |
| 39 | nova13 | zun-compute | up | False | None | 2019-09-27 13:09:06 | nova |
| 42 | nova14 | zun-compute | up | False | None | 2019-09-27 13:09:22 | nova |
| 45 | nova15 | zun-compute | up | False | None | 2019-09-27 13:08:32 | nova |
| 48 | nova16 | zun-compute | up | False | None | 2019-09-27 13:09:24 | nova |
| 51 | nova17 | zun-compute | up | False | None | 2019-09-27 13:08:53 | nova |
| 54 | rac4 | zun-compute | up | False | None | 2019-09-27 13:09:12 | nova |
| 57 | nova18 | zun-compute | up | False | None | 2019-09-27 13:08:32 | nova |
| 60 | rac2 | zun-compute | up | False | None | 2019-09-27 13:08:35 | nova |
| 63 | rac5 | zun-compute | up | False | None | 2019-09-27 13:08:58 | nova |
| 66 | nova20 | zun-compute | up | False | None | 2019-09-27 13:08:56 | nova |
| 69 | nova19 | zun-compute | up | False | None | 2019-09-27 13:08:59 | nova |
| 72 | opteron2 | zun-compute | up | False | None | 2019-09-27 13:09:13 | nova |
| 75 | opteron1 | zun-compute | up | False | None | 2019-09-27 13:08:34 | nova |
+----+----------+-------------+-------+----------+-----------------+---------------------+-------------------+

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/685613

[hongbin (hongbin034)]

On Fri, Sep 27, 2019 at 9:20 AM Robert Duncan <email address hidden> wrote:

> Public bug reported:
>
> Zun as deployed by kolla-ansible 8 stein on Ubuntu from source
>
> when searching for an image I get error 500
>
> zun image-search --image_driver docker ubuntu
> ERROR: Internal Server Error (HTTP 500) (Request-ID:
> req-a9e965aa-8957-4f08-b3cd-9ae2b8b2793f)
>
> zun --debug image-search --image_driver docker ubuntu
>
> ((tl:dr TypeError: image_search() takes at least 6 arguments (5 given)))
>

Thanks for reporting this issue. It should be fixed by:
https://review.opendev.org/#/c/685613/

>
> DEBUG (connectionpool:813) Starting new HTTPS connection (1):
> openstack:9517
> DEBUG (connectionpool:393) https://openstack:9517 "GET
> /v1/images/ubuntu/search?exact_match=False&image_driver=docker HTTP/1.1"
> 500 261
> DEBUG (session:479) RESP: [500] Content-Length: 261 Content-Type:
> application/json Date: Fri, 27 Sep 2019 12:36:44 GMT
> OpenStack-API-Maximum-Version: container 1.32
> OpenStack-API-Minimum-Version: container 1.1 OpenStack-API-Version:
> container 1.25 Server: Apache vary: OpenStack-API-Version
> x-openstack-request-id: req-3ca36b5c-b184-432a-9890-654f4a73468c
> DEBUG (session:511) RESP BODY: {"errors": [{"status": 500, "code":
> "container.", "links": [], "title": "Internal Server Error", "detail":
> "Your request could not be handled because of a problem in the server.
> Error Correlation id is: 69a80383-b8e5-48af-b4c8-51dc7c1e604a",
> "request_id": ""}]}
> DEBUG (session:844) GET call to container for
> https://openstack:9517/v1/images/ubuntu/search?exact_match=False&image_driver=docker
> used request id req-3ca36b5c-b184-432a-9890-654f4a73468c
> DEBUG (shell:715) Internal Server Error (HTTP 500) (Request-ID:
> req-3ca36b5c-b184-432a-9890-654f4a73468c)
> Traceback (most recent call last):
> File "/usr/local/lib/python2.7/dist-packages/zunclient/shell.py", line
> 713, in main
> map(encodeutils.safe_decode, sys.argv[1:]))
> File "/usr/local/lib/python2.7/dist-packages/zunclient/shell.py", line
> 650, in main
> args.func(self.cs, args)
> File
> "/usr/local/lib/python2.7/dist-packages/zunclient/v1/images_shell.py", line
> 100, in do_image_search
> images = cs.images.search_image(args.image, **opts)
> File "/usr/local/lib/python2.7/dist-packages/zunclient/v1/images.py",
> line 114, in search_image
> return self._search(self._path(image) + '/search', image_query)
> File "/usr/local/lib/python2.7/dist-packages/zunclient/common/base.py",
> line 152, in _search
> resp, body = self.api.json_request('GET', url, body=body)
> File
> "/usr/local/lib/python2.7/dist-packages/zunclient/common/httpclient.py",
> line 367, in json_request
> resp = self._http_request(url, method, **kwargs)
> File
> "/usr/local/lib/python2.7/dist-packages/zunclient/common/httpclient.py",
> line 350, in _http_request
> error_json.get('debuginfo'), method, url)
> InternalServerError: Internal Server Error (HTTP 500) (Request-ID:
> req-3ca36b5c-b184-432a-9890-654f4a73468c)
> ERROR: Internal Server Error (HTTP 500) (Request-ID:
> req-3ca36b5c-b184-432a-9890-654f4a73468c)
>
> from the api logs:
>
> Calling compute.image_search with ...

[hongbin (hongbin034)]

On Fri, Sep 27, 2019 at 9:20 AM Robert Duncan <email address hidden> wrote:

> Public bug reported:
>
> Zun as deployed by kolla-ansible 8 stein on Ubuntu from source
>
> when searching for an image I get error 500
>
> zun image-search --image_driver docker ubuntu
> ERROR: Internal Server Error (HTTP 500) (Request-ID:
> req-a9e965aa-8957-4f08-b3cd-9ae2b8b2793f)
>
> zun --debug image-search --image_driver docker ubuntu
>
> ((tl:dr TypeError: image_search() takes at least 6 arguments (5 given)))
>
> DEBUG (connectionpool:813) Starting new HTTPS connection (1):
> openstack:9517
> DEBUG (connectionpool:393) https://openstack:9517 "GET
> /v1/images/ubuntu/search?exact_match=False&image_driver=docker HTTP/1.1"
> 500 261
> DEBUG (session:479) RESP: [500] Content-Length: 261 Content-Type:
> application/json Date: Fri, 27 Sep 2019 12:36:44 GMT
> OpenStack-API-Maximum-Version: container 1.32
> OpenStack-API-Minimum-Version: container 1.1 OpenStack-API-Version:
> container 1.25 Server: Apache vary: OpenStack-API-Version
> x-openstack-request-id: req-3ca36b5c-b184-432a-9890-654f4a73468c
> DEBUG (session:511) RESP BODY: {"errors": [{"status": 500, "code":
> "container.", "links": [], "title": "Internal Server Error", "detail":
> "Your request could not be handled because of a problem in the server.
> Error Correlation id is: 69a80383-b8e5-48af-b4c8-51dc7c1e604a",
> "request_id": ""}]}
> DEBUG (session:844) GET call to container for
> https://openstack:9517/v1/images/ubuntu/search?exact_match=False&image_driver=docker
> used request id req-3ca36b5c-b184-432a-9890-654f4a73468c
> DEBUG (shell:715) Internal Server Error (HTTP 500) (Request-ID:
> req-3ca36b5c-b184-432a-9890-654f4a73468c)
> Traceback (most recent call last):
> File "/usr/local/lib/python2.7/dist-packages/zunclient/shell.py", line
> 713, in main
> map(encodeutils.safe_decode, sys.argv[1:]))
> File "/usr/local/lib/python2.7/dist-packages/zunclient/shell.py", line
> 650, in main
> args.func(self.cs, args)
> File
> "/usr/local/lib/python2.7/dist-packages/zunclient/v1/images_shell.py", line
> 100, in do_image_search
> images = cs.images.search_image(args.image, **opts)
> File "/usr/local/lib/python2.7/dist-packages/zunclient/v1/images.py",
> line 114, in search_image
> return self._search(self._path(image) + '/search', image_query)
> File "/usr/local/lib/python2.7/dist-packages/zunclient/common/base.py",
> line 152, in _search
> resp, body = self.api.json_request('GET', url, body=body)
> File
> "/usr/local/lib/python2.7/dist-packages/zunclient/common/httpclient.py",
> line 367, in json_request
> resp = self._http_request(url, method, **kwargs)
> File
> "/usr/local/lib/python2.7/dist-packages/zunclient/common/httpclient.py",
> line 350, in _http_request
> error_json.get('debuginfo'), method, url)
> InternalServerError: Internal Server Error (HTTP 500) (Request-ID:
> req-3ca36b5c-b184-432a-9890-654f4a73468c)
> ERROR: Internal Server Error (HTTP 500) (Request-ID:
> req-3ca36b5c-b184-432a-9890-654f4a73468c)
>
> from the api logs:
>
> Calling compute.image_search with ubuntu search
> /var/lib/kolla/venv/local/lib/python2.7/site-packages/zun/api/controllers/v1/images....

[Robert Duncan (rduncan-t)]

Thanks hongbin, I can confirm that this works and I can now search for images without experiencing error 500, however there is one remaining issue, I cannot find any images when the search term includes a forward /

i.e

ubuntu@kolla:~$ openstack appcontainer image search openstack-client
+----+-----------------------------------+------+--------+------+-------------------------------------------+
| ID | Name | Tags | Status | Size | Metadata |
+----+-----------------------------------+------+--------+------+-------------------------------------------+
| | ullbergm/openstack-client | | | | {u'is_official': False, u'star_count': 5} |
| | cftoolsmiths/openstack-clients | | | | {u'is_official': False, u'star_count': 1} |
| | cloudwattfr/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | jmcvea/openstack-client | | | | {u'is_official': False, u'star_count': 3} |
| | kpms/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | sapcc/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | oxeva/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | digitalr00ts/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | port/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | gbraad/openstack-client | | | | {u'is_official': False, u'star_count': 2} |
| | 42bv/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | chamerling/openstack-client | | | | {u'is_official': False, u'star_count': 1} |
| | usacys/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | anguslees/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | timfreund/openstack-client-centos | | | | {u'is_official': False, u'star_count': 0} |
| | anmoljh/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | sspreitzer/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | attila123/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | luckpenugin/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | baselibrary/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | redhatcop/openstack-client-centos | | | | {u'is_official': False, u'star_count': 0} |
| | booleancandy/openstack-clients | | | | {u'is_official': False, u'star_count': 0} |
| | phymatopus/openstack-client | | | | {u'is_official': False, u'star_count': 0} |
| | fsoppelsa/openstack-clients | | ...

[hongbin (hongbin034)]

On Mon, Sep 30, 2019 at 4:21 AM Robert Duncan <email address hidden> wrote:

> Thanks hongbin, I can confirm that this works and I can now search for
> images without experiencing error 500, however there is one remaining
> issue, I cannot find any images when the search term includes a forward
> /
>
> i.e
>
> ubuntu@kolla:~$ openstack appcontainer image search openstack-client
>
> +----+-----------------------------------+------+--------+------+-------------------------------------------+
> | ID | Name | Tags | Status | Size |
> Metadata |
>
> +----+-----------------------------------+------+--------+------+-------------------------------------------+
> | | ullbergm/openstack-client | | | |
> {u'is_official': False, u'star_count': 5} |
> | | cftoolsmiths/openstack-clients | | | |
> {u'is_official': False, u'star_count': 1} |
> | | cloudwattfr/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | jmcvea/openstack-client | | | |
> {u'is_official': False, u'star_count': 3} |
> | | kpms/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | sapcc/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | oxeva/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | digitalr00ts/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | port/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | gbraad/openstack-client | | | |
> {u'is_official': False, u'star_count': 2} |
> | | 42bv/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | chamerling/openstack-client | | | |
> {u'is_official': False, u'star_count': 1} |
> | | usacys/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | anguslees/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | timfreund/openstack-client-centos | | | |
> {u'is_official': False, u'star_count': 0} |
> | | anmoljh/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | sspreitzer/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | attila123/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | luckpenugin/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | baselibrary/openstack-client | | | |
> {u'is_official': False, u'star_count': 0} |
> | | redhatcop/openstack-client-centos | | | |
> {u'is_official': False, u'star_count': 0} |
> | | booleancandy/openstack-clients | | | |
> {u'is_official': ...

[Robert Duncan (rduncan-t)]

But the zun-ui seems to search for the cloud shell image instead of simply pulling the image

this works:
zun image-pull gbraad/openstack-client:alpine host1

but clicking the >_Cloud Shell link in horizon seems to invoke an image search for gbraad/openstack-client:alpine

2019-10-01 07:59:05.030 18 DEBUG zun.common.exception [req-28a9438b-4822-4a95-bc18-42ca82da82c3 cf33767e3f784f01abd7515fc431f395 634cbbb62667443f8bc929d5bb515966 default - -] Image gbraad/openstack-client:alpine could not be found. wrapped /var/lib/kolla/venv/local/lib/python2.7/site-packages/zun/common/exception.py:128

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/686317

[hongbin (hongbin034)]

On Tue, Oct 1, 2019 at 4:41 AM Robert Duncan <email address hidden> wrote:

> But the zun-ui seems to search for the cloud shell image instead of
> simply pulling the image
>

Right. The easiest fix is to turn off image validation via config. See
https://bugs.launchpad.net/zun/+bug/1840629 . That option is on by default
in stable/stein and we changed the default to off afterward [1]. I will
propose a patch to Kolla to allow users to turn it off.

[1]
https://github.com/openstack/zun/commit/b00bba2483a372c76c2d64c06c701a7c8d9e3a7b

>
> this works:
> zun image-pull gbraad/openstack-client:alpine host1
>
> but clicking the >_Cloud Shell link in horizon seems to invoke an image
> search for gbraad/openstack-client:alpine
>
> 2019-10-01 07:59:05.030 18 DEBUG zun.common.exception [req-
> 28a9438b-4822-4a95-bc18-42ca82da82c3 cf33767e3f784f01abd7515fc431f395
> 634cbbb62667443f8bc929d5bb515966 default - -] Image gbraad/openstack-
> client:alpine could not be found. wrapped
> /var/lib/kolla/venv/local/lib/python2.7/site-
> packages/zun/common/exception.py:128
>
> --
> You received this bug notification because you are a bug assignee.
> Matching subscriptions: zun
> https://bugs.launchpad.net/bugs/1845650
>
> Title:
> image search error 500
>
> Status in Zun:
> In Progress
>
> Bug description:
> Zun as deployed by kolla-ansible 8 stein on Ubuntu from source
>
> when searching for an image I get error 500
>
> zun image-search --image_driver docker ubuntu
> ERROR: Internal Server Error (HTTP 500) (Request-ID:
> req-a9e965aa-8957-4f08-b3cd-9ae2b8b2793f)
>
> zun --debug image-search --image_driver docker ubuntu
>
> ((tl:dr TypeError: image_search() takes at least 6 arguments (5
> given)))
>
> DEBUG (connectionpool:813) Starting new HTTPS connection (1):
> openstack:9517
> DEBUG (connectionpool:393) https://openstack:9517 "GET
> /v1/images/ubuntu/search?exact_match=False&image_driver=docker HTTP/1.1"
> 500 261
> DEBUG (session:479) RESP: [500] Content-Length: 261 Content-Type:
> application/json Date: Fri, 27 Sep 2019 12:36:44 GMT
> OpenStack-API-Maximum-Version: container 1.32
> OpenStack-API-Minimum-Version: container 1.1 OpenStack-API-Version:
> container 1.25 Server: Apache vary: OpenStack-API-Version
> x-openstack-request-id: req-3ca36b5c-b184-432a-9890-654f4a73468c
> DEBUG (session:511) RESP BODY: {"errors": [{"status": 500, "code":
> "container.", "links": [], "title": "Internal Server Error", "detail":
> "Your request could not be handled because of a problem in the server.
> Error Correlation id is: 69a80383-b8e5-48af-b4c8-51dc7c1e604a",
> "request_id": ""}]}
> DEBUG (session:844) GET call to container for
> https://openstack:9517/v1/images/ubuntu/search?exact_match=False&image_driver=docker
> used request id req-3ca36b5c-b184-432a-9890-654f4a73468c
> DEBUG (shell:715) Internal Server Error (HTTP 500) (Request-ID:
> req-3ca36b5c-b184-432a-9890-654f4a73468c)
> Traceback (most recent call last):
> File "/usr/local/lib/python2.7/dist-packages/zunclient/shell.py", line
> 713, in main
> map(encodeutils.safe_decode, sys.argv[1:]))
> File "/usr/local/lib/python2.7/dist-packages/zunclient/shell.py", line
> 650, in ...

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/685613
Committed: https://git.openstack.org/cgit/openstack/zun/commit/?id=1712f184fcc621c9e32c845dba8d6dcf05f7f6cf
Submitter: Zuul
Branch: master

commit 1712f184fcc621c9e32c845dba8d6dcf05f7f6cf
Author: Hongbin Lu <email address hidden>
Date: Sun Sep 29 15:54:11 2019 +0000

    Fix image search 500 error

    Change-Id: Ie90e1ebde833938662e2ea3c5f953ed57db918a0
    Closes-Bug: #1845650

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/686317
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=74ff528d93456fda2d265115641d6799a1a9c2a3
Submitter: Zuul
Branch: stable/stein

commit 74ff528d93456fda2d265115641d6799a1a9c2a3
Author: Hongbin Lu <email address hidden>
Date: Thu Oct 3 00:59:56 2019 +0000

    Bump zun-ui package to 3.0.1

    Change-Id: Ie8c533cff44e185116d803f4858652f747cc5878
    Closes-Bug: #1845650

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/train
Review: https://review.opendev.org/686898

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/686898
Committed: https://git.openstack.org/cgit/openstack/zun/commit/?id=cb0cb901bc76175b0ec7f0cda37e3883c2d6842d
Submitter: Zuul
Branch: stable/train

commit cb0cb901bc76175b0ec7f0cda37e3883c2d6842d
Author: Hongbin Lu <email address hidden>
Date: Sun Sep 29 15:54:11 2019 +0000

    Fix image search 500 error

    Change-Id: Ie90e1ebde833938662e2ea3c5f953ed57db918a0
    Closes-Bug: #1845650
    (cherry picked from commit 1712f184fcc621c9e32c845dba8d6dcf05f7f6cf)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 8.0.2 release.