neutron stadium: functional test coverage: db migration and sync validation

[Isaku Yamahata]

> C3. Does the project have CI for functional coverage? If so, does it include
> DB migration and sync validation?
>
> No. There seems there is no DB migration and sync validation as the project
> introduces its own data models. `Review <https://review.openstack.org/#/c/384509/>`_
> is eloquent.

add functional tests and db migration, sync validation.

- add test_migrations: done
- update tox.ini and script if necessary
- add gate-networking-odl-dsvm-functional
- make it voting

[Isaku Yamahata (yamahata)]

http://docs.openstack.org/developer/neutron/devref/template_model_sync_test.html

[Isaku Yamahata (yamahata)]

http://docs.openstack.org/developer/neutron/devref/db_layer.html#module-neutron.tests.functional.db.test_migrations

[Isaku Yamahata (yamahata)]

https://review.openstack.org/#/c/390017/
db migration and sync validation is done.
The next step is to make openstack CI run functional test as gate-networking-odl-dsvm-functional

[Federico Ressi (federico-ressi-9)]

I have tried to run functional tests on a Ubuntu 16.04 where I just stacked before an I had all functional tests skipped. What should I do to have it working?

ubuntu@networking-odl:/opt/stack/networking-odl$ tox -v -e functional
using tox.ini: /opt/stack/networking-odl/tox.ini
using tox-2.4.1 from /usr/local/lib/python2.7/dist-packages/tox/__init__.pyc
functional create: /opt/stack/networking-odl/.tox/functional
  /opt/stack/networking-odl/.tox$ /usr/bin/python -m virtualenv --python /usr/bin/python functional >/opt/stack/networking-odl/.tox/functional/log/functional-0.log
functional installdeps: -r/opt/stack/networking-odl/requirements.txt, -r/opt/stack/networking-odl/test-requirements.txt, -r/opt/stack/networking-odl/networking_odl/tests/functional/requirements.txt
  /opt/stack/networking-odl$ /opt/stack/networking-odl/tools/tox_install.sh https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt -r/opt/stack/networking-odl/requirements.txt -r/opt/stack/networking-odl/test-requirements.txt -r/opt/stack/networking-odl/networking_odl/tests/functional/requirements.txt >/opt/stack/networking-odl/.tox/functional/log/functional-1.log
functional develop-inst: /opt/stack/networking-odl
  /opt/stack/networking-odl$ /opt/stack/networking-odl/tools/tox_install.sh https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt -e /opt/stack/networking-odl >/opt/stack/networking-odl/.tox/functional/log/functional-2.log
  /opt/stack/networking-odl$ /opt/stack/networking-odl/.tox/functional/bin/pip freeze >/opt/stack/networking-odl/.tox/functional/log/functional-3.log
functional installed: alabaster==0.7.9,alembic==0.8.8,amqp==1.4.9,anyjson==0.3.3,appdirs==1.4.0,Babel==2.3.4,beautifulsoup4==4.5.1,cachetools==2.0.0,cffi==1.8.3,chardet==2.3.0,cliff==2.2.0,cmd2==0.6.9,contextlib2==0.5.4,coverage==4.2,cryptography==1.5.2,debtcollector==1.9.0,decorator==4.0.10,doc8==0.7.0,docutils==0.12,dogpile.cache==0.6.2,enum34==1.1.6,eventlet==0.19.0,extras==1.0.0,fasteners==0.14.1,fixtures==3.0.0,flake8==2.2.4,funcsigs==1.0.2,functools32==3.2.3.post2,futures==3.0.5,futurist==0.19.0,greenlet==0.4.10,hacking==0.10.2,httplib2==0.9.2,idna==2.1,ipaddress==1.0.17,iso8601==0.1.11,Jinja2==2.8,jsonpatch==1.14,jsonpointer==1.10,jsonschema==2.5.1,keystoneauth1==2.15.0,keystonemiddleware==4.10.0,kombu==3.0.37,linecache2==1.0.0,logutils==0.3.3,Mako==1.0.5,MarkupSafe==0.23,mccabe==0.2.1,mock==2.0.0,monotonic==1.2,mox3==0.18.0,msgpack-python==0.4.8,netaddr==0.7.18,netifaces==0.10.5,-e git+https://git.openstack.org/openstack/networking-l2gw.git@cf641ee23a413b08fabb5459c73fe9ded0ced09d#egg=networking_l2gw,-e git+https://review.openstack.org:443/openstack/networking-odl.git@6957992e30a5f1f56b1400579f6b0378f87d6c1f#egg=networking_odl,-e git+https://git.openstack.org/openstack/networking-sfc.git@a2a5ec7366d6a2f6cfd4ba5a5ac1de8b1f2b0d5c#egg=networking_sfc,-e git+https://git.openstack.org/openstack/neutron.git@04bee5befc785cb44eb8c0284776867e4eba518b#egg=neutron,-e git+https://git.openstack.org/openstack/neutron-fwaas.git@6363beea200eba197291e852e1b9f7120ca1cbf2#egg=neutron_fwaas,-e git+https://git.openstack.org/openstack/neutron-lbaas.git@48a0470d564...

[Waldemar Znoinski (wznoinsk)]

https://review.openstack.org/#/c/394476/ and its dependency will enable functional testing upstream

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/395107
Committed: https://git.openstack.org/cgit/openstack/networking-odl/commit/?id=eb8877de1d881743ea7db67e8b532283683a8539
Submitter: Jenkins
Branch: master

commit eb8877de1d881743ea7db67e8b532283683a8539
Author: Waldemar Znoinski <email address hidden>
Date: Tue Nov 8 18:14:38 2016 +0000

    add dsvm-functional tests tox and gate_hook

    Closes-bug: #1635694
    Change-Id: I5bbdeb4fa98e7532191f7d6ea3e5bd2837947610

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/networking-odl 3.1.0 release.