[victoria] 5xx Server error - Table 'barbican.secrets' doesn't exist

[Aurelien Lourot]

The functional tests are failing on groovy-victoria with:

5xx Server error: Internal Server Error: Secret creation failure seen - please contact site administrator.

https://review.opendev.org/#/c/761540/

barbican-api.log shows:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context
    self.dialect.do_execute(
  File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 593, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/lib/python3/dist-packages/pymysql/cursors.py", line 170, in execute
    result = self._query(query)
  File "/usr/lib/python3/dist-packages/pymysql/cursors.py", line 328, in _query
    conn.query(q)
  File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 517, in query
    self._affected_rows = self._read_query_result(unbuffered=unbuffered)
  File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 732, in _read_query_result
    result.read()
  File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 1075, in read
    first_packet = self.connection._read_packet()
  File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 684, in _read_packet
    packet.check_error()
  File "/usr/lib/python3/dist-packages/pymysql/protocol.py", line 220, in check_error
    err.raise_mysql_exception(self._data)
  File "/usr/lib/python3/dist-packages/pymysql/err.py", line 109, in raise_mysql_exception
    raise errorclass(errno, errval)
pymysql.err.ProgrammingError: (1146, "Table 'barbican.secrets' doesn't exist")

[Alex Kavanagh (ajkavanagh)]

Also affects focal-victoria run as well in exactly the same way; suspect it is probably a db migration issue.

[Aurelien Lourot (aurelien-lourot)]

I think this is because on Ussuri [0] the default Barbican config was:

# Create the Barbican database on service startup. (boolean value)
#db_auto_create = true

but on Victoria in because `false` by default. Validating locally.

[0]: https://docs.openstack.org/barbican/ussuri/sample_config.html

[Aurelien Lourot (aurelien-lourot)]

^ but on Victoria it became `false` by default

[David Ames (thedac)]

These are also related bugs.

Ultimately we want [0] due to [1] but this is blocked by [2].

Let's see if the workaround works without running into [1].

[0] https://review.opendev.org/756931
[1] https://bugs.launchpad.net/charm-barbican/+bug/1827690
[2] https://bugs.launchpad.net/ubuntu/+source/barbican/+bug/1899104

[Aurelien Lourot (aurelien-lourot)]

https://review.opendev.org/c/openstack/charm-barbican/+/771005