Master branch failing py27 tests (oslo_db.exception.DBNonExistentTable:)

[Joshua Cornutt]

Description
===========
When working with the latest master branch (commit 002128208cdfb238568acea74a0d8b03492d714d), the py27 tests report 18 failed tests with no changes made to the project/code. The test output is much larger than I remember from other projects (Nova / Cinder) at a whopping 8.9MB (63,634 lines) and ultimately seems to be complaining (repeatedly) with:

oslo_db.exception.DBNonExistentTable: (sqlite3.OperationalError) error in trigger federated_user_insert_trigger: no such table: main.migration_tmp [SQL: u'ALTER TABLE federated_user RENAME TO migration_tmp'] (Background on this error at: http://sqlalche.me/e/e3q8)

Possible related bug report - https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=909989

Steps to reproduce
==================
virtualenv keystone-venv
source keystone-venv/bin/activate
pip install tox flake8
sudo zypper in openssl-devel python-devel openldap2-devel sqlite3
git clone https://git.openstack.org/openstack/keystone.git
cd keystone
pip install -r test-requirements.txt
tox -e pep8 # succeeded
tox -r -e py27 # failed

Expected result
===============
All py27 tests pass

Actual result
=============
18 tests failed

Environment
===========

(keystone-venv) cerealkiller@thegibson:~/Desktop/Dev/python/keystone> cat /etc/SUSE-brand
openSUSE
VERSION = 15.0

(keystone-venv) cerealkiller@thegibson:~/Desktop/Dev/python/keystone> uname -a
Linux thegibson 4.18.14-1-default #1 SMP PREEMPT Sat Oct 13 18:49:22 UTC 2018 (ce1c446) x86_64 x86_64 x86_64 GNU/Linux

(keystone-venv) cerealkiller@thegibson:~/Desktop/Dev/python/keystone> git show
commit 002128208cdfb238568acea74a0d8b03492d714d (HEAD -> master, origin/master, origin/HEAD)
Merge: 96a39282a 9c38bb5bd
Author: Zuul <email address hidden>
Date: Tue Nov 6 21:23:19 2018 +0000

    Merge "Delete PKI middleware debugging section"

(keystone-venv) cerealkiller@thegibson:~/Desktop/Dev/python/keystone> pip list --not-required
Package Version
----------------- -----------
bashate 0.6.0
configparser 3.5.0
coverage 4.5.1
flake8-docstrings 0.2.1.post1
freezegun 0.3.11
hacking 0.12.0
lxml 4.2.5
os-testr 1.0.0
oslo.db 4.42.0
oslotest 3.7.0
pip 18.1
psycopg2 2.7.5
pycodestyle 2.4.0
PyMySQL 0.9.2
python-ldap 3.1.0
tempest 19.0.0
tox 3.5.3
WebTest 2.0.32
wheel 0.32.2

(keystone-venv) cerealkiller@thegibson:~/Desktop/Dev/python/keystone> rpm -qa | grep "libopenssl-devel\|python-devel\|openldap2-devel\|sqlite3"
libopenssl-devel-1.1.0h-1.1.noarch
python-devel-2.7.15-2.1.x86_64
sqlite3-3.25.2-1.1.x86_64
libsqlite3-0-3.25.2-1.1.x86_64
openldap2-devel-2.4.46-37.1.x86_64

[wangxiyuan (wangxiyuan)]

All the migration test which verion > 13 failed. An example: https://pastebin.com/JuETy1F8

I wander if this relate to the foreign key enable work : https://review.openstack.org/#/c/126030

Tried many ways, while I still can't reproduce locally

[Colleen Murphy (krinkle)]

I'm running opensuse tumbleweed and I haven't seen this issue.

I don't think it's the cause of your problem, but why are you pip installing test-requirements.txt? Running tox will install all the requirements in a venv in .tox/py27, so you don't need to install anything directly except tox itself.

[Morgan Fainberg (mdrnstm)]

I cannot duplicate this issue locally in Ubuntu or Fedora (docker containers).

Marking this incomplete until we get further information.

[Morgan Fainberg (mdrnstm)]

It appears colleen has been unable to duplicate in Suse.

[Joshua Cornutt (oioooioi)]

I've tried using Python3 with the py36 test suite in a fresh virtualenv, but still the same errors. I've also tried reinstalling sqlite3, pulling a fresh copy of Keystone master, running tox without install test-requirements.txt first, etc... but the result is always the same. I'm even on a different kernel since my initial post.

[Launchpad Janitor (janitor)]

[Expired for OpenStack Identity (keystone) because there has been no activity for 60 days.]