[SR-IOV] Instance creation fails if there are few sriov nics with same physical network name

[Artem Panchenko]

Fuel version info (9.0 liberty): http://paste.openstack.org/show/490838/

Nova fails to spawn instance with SR-IOV port:

"No valid host was found. There are not enough hosts available."

nova-compute: http://paste.openstack.org/show/490892/
neutron: http://paste.openstack.org/show/490893/

After I changed sriov_agent.ini, so physnet2 has only one NIC and restarted the agent, Nova successfully booted new instance:

http://paste.openstack.org/show/490917/

root@node-1:~# nova list
+--------------------------------------+------------+--------+------------+-------------+-----------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+------------+--------+------------+-------------+-----------------------------------+
| 21890316-1160-42e2-84de-9c10f876625f | sriov-test | ACTIVE | - | Running | admin_internal_net=192.168.111.14 |
+--------------------------------------+------------+--------+------------+-------------+-----------------------------------+

Steps to reproduce:

1. Create environment with VLAN for Neutron
2. Add 1 controller node and 1 compute node which has NIC(s) with SR-IOV support
3. Enable SR-IOV for some NICs on compute node
4. Deploy changes
5. Run new instance with SR-IOV port (for example http://paste.openstack.org/show/490921/)

Expected result: instance is launched and has ACTIVE status

Actual result: boot fails, instance has ERROR status

Diagnostic snapshot: https://drive.google.com/file/d/0BzaZINLQ8-xkMzhwd1pRNW1hNGs/view?usp=sharing

[Atsuko Ito (yottatsa)]

Upstream bug https://bugs.launchpad.net/neutron/+bug/1558626

[Atsuko Ito (yottatsa)]

I have a patch to neutron, where 4 files changed, 21 insertions(+), 8 deletions(-), + tests. Could we apply this?

[Atsuko Ito (yottatsa)]

https://review.openstack.org/294188

[Igor Yozhikov (iyozhikov)]

If this code would not landed in upstream it should be landed in downstream Neutron.

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/19544
Submitter: Pkgs Jenkins <email address hidden>
Branch: 9.0/mitaka

Commit: 9e90051f07e35d29848e7f679a02d0cd992d541a
Author: Jenkins <email address hidden>
Date: Wed Apr 13 13:22:17 2016

Merge the tip of origin/stable/mitaka into origin/9.0/mitaka

05a4a34 Notify resource_versions from agents only when needed
fff909e Values for [ml2]/physical_network_mtus should not be unique
6814411 Imported Translations from Zanata
a2d1c46 firewall: don't warn about a driver that does not accept bridge
fa5eb53 Add uselist=True to subnet rbac_entries relationship
c178bd9 Fix race conditions in IP availability API tests
ee32ea5 Switched from fixtures to mock to mock out starting RPC consumers
77696d8 Imported Translations from Zanata
3190494 Fix zuul_cloner errors during tox job setup
04fb147 Refactor and fix dummy process fixture
844cae4 Switches metering agent to stateless iptables
19ea6ba Remove obsolete keepalived PID files before start
aafa702 Add IPAllocation object to session info to stop GC
005d49d Ensure metadata agent doesn't use SSL for UNIX socket
905fd05 DVR: Increase the link-local address pair range
93d719a SG protocol validation to allow numbers or names
33d3b8c L3 agent: match format used by iptables
7b2fcaa Use right class method in IP availability tests
93cdf8e Make L3 HA interface creation concurrency safe
d934669 ovsfw: Remove vlan tag before injecting packets to port
33c01f4 Imported Translations from Zanata
05ac012 test_network_ip_availability: Skip IPv6 tests when configured so
38894cc Retry updating agents table in case of deadlock
aac460b Allow to use several nics for physnet with SR-IOV
90b9cd3 port security: gracefully handle resources with no bindings
7174bc4 Ignore exception when deleting linux bridge if doesn't exist
93d29d1 Don't delete br-int to br-tun patch on startup
211e0a6 functional: Update ref used from ovs branch-2.5.
c6ef57a ovs-fw: Mark conntrack entries invalid if no rule is matched
ef6ea62 l3: Send notify on router_create when ext gw is specified
eb8ddb9 Move db query to fetch down bindings under try/except
da1eee3 Close XenAPI sessions in neutron-rootwrap-xen-dom0
1d51172 Watch for 'new' events in ovsdb monitor for ofport
bd3e9c3 Removes host file contents from DHCP agent logs

Closes-Bug: #1569735
Closes-Bug: #1569738
Closes-Bug: #1539664
Closes-Bug: #1560727
Closes-Bug: #1558613
Closes-Bug: #1545756

Change-Id: Ia30076744f13666f950fee78a86a8c81f7207206

[Mikhail Chernik (mchernik)]

Verified on MOS 9.0 ISO 232, fixed