Fuel for OpenStack

ERR: DuplicateVlan: Detected existing vlan with id 103

Series 5.0.x
Bug #1348664

Bug #1348664 reported by Anastasia Palkina on 2014-07-25

This bug affects 2 people

Affects		Status	Importance	Assigned to	Milestone
	Fuel for OpenStack	Fix Released	Critical	Vladimir Kuklin	Fuel for OpenStack 5.1
	5.0.x	Fix Committed	Critical	Vladimir Kuklin	Fuel for OpenStack 5.0.1

Bug Description

"build_id": "2014-07-25_12-51-13",
"ostf_sha": "58e892e8404abe567f7a35fc9c6f1d66182733e8",
"build_number": "359",
"auth_required": true,
"api": "1.0",
"nailgun_sha": "4cb2bb5375b6b7e6312b771ea4410b25285c41b1",
"production": "docker",
"fuelmain_sha": "e1c3e59d9bcc6bcdc42d7ec0f616dfd8b1eeb691",
"astute_sha": "d78574a5433a84f672dd14effe69d9e54919366b",
"feature_groups": ["mirantis"],
"release": "5.1",
"fuellib_sha": "9e86bb101f45111995986b2999fe52e6464577f8"

1. Create new environment (Ubuntu, HA mode)
2. Choose Nova network, vlan manager
3. Choose Ceph for images
4. Choose Ceilometer
5. Add 3 controller+mongo, compute, cinder, 2 ceph
6. Start deployment. First node (node-1) is ready and there is traceback in puppet.log:

2014-07-25T14:36:01.585409+01:00 err: 2014-07-25 13:35:46.498 24424 CRITICAL nova [req-1a374357-c884-4bb8-8978-53af0ac262d6 None] DuplicateVlan: Detected existing vlan with id 103
2014-07-25T14:36:01.586406+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova Traceback (most recent call last):
2014-07-25T14:36:01.587879+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/bin/nova-manage", line 10, in <module>
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova sys.exit(main())
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/cmd/manage.py", line 1376, in main
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova ret = fn(*fn_args, **fn_kwargs)
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/cmd/manage.py", line 530, in create
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova net_manager.create_networks(context.get_admin_context(), **kwargs)
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1865, in create_networks
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova self, context, vpn=True, **kwargs)
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1094, in create_networks
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova return self._do_create_networks(context, **kwargs)
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1232, in _do_create_networks
2014-07-25T14:36:01.590470+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova net.create()
2014-07-25T14:36:01.591199+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/objects/base.py", line 151, in wrapper
2014-07-25T14:36:01.591668+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova return fn(self, ctxt, *args, **kwargs)
2014-07-25T14:36:01.591668+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/objects/network.py", line 131, in create
2014-07-25T14:36:01.591668+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova db_network = db.network_create_safe(context, updates)
2014-07-25T14:36:01.597489+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 929, in network_create_safe
2014-07-25T14:36:01.599947+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova return IMPL.network_create_safe(context, values)
2014-07-25T14:36:01.600366+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 146, in wrapper
2014-07-25T14:36:01.600366+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova return f(*args, **kwargs)
2014-07-25T14:36:01.622888+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 2519, in network_create_safe
2014-07-25T14:36:01.622888+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova raise exception.DuplicateVlan(vlan=values['vlan'])
2014-07-25T14:36:01.622888+01:00 err: 2014-07-25 13:35:46.498 24424 TRACE nova DuplicateVlan: Detected existing vlan with id 103

Tags:

Revision history for this message

Anastasia Palkina (apalkina) wrote on 2014-07-25:

fuel-snapshot-2014-07-25_15-10-33.tgz Edit (10.1 MiB, application/x-tar)

Changed in fuel:
importance:	High → Critical

Revision history for this message

Anastasia Palkina (apalkina) wrote on 2014-07-25:

fuel-snapshot-2014-07-25_15-46-29.tgz Edit (13.8 MiB, application/x-tar)

Deployment has failed.
Here full logs

Vladimir Kuklin (vkuklin) on 2014-07-25

Changed in fuel:
assignee:	Fuel Library Team (fuel-library) → MOS Neutron (mos-neutron)
assignee:	MOS Neutron (mos-neutron) → MOS Nova (mos-nova)

Vladimir Kuklin (vkuklin) on 2014-07-26

Changed in fuel:
status:	New → Confirmed

Revision history for this message

Vladimir Kuklin (vkuklin) wrote on 2014-07-26:

Download full text (4.0 KiB)

Interesting:

we experience this problem even if we have empty list of networks.

root@node-1:~# nova-manage network list
id IPv4 IPv6 start address DNS1 DNS2 VlanID project uuid
No networks found
root@node-1:~# /usr/bin/nova-manage network create novanetwork 10.0.0.0/16 8 32 --dns2 8.8.8.8 --vlan 103 --dns1 8.8.4.4
2014-07-26 08:59:09.356 31454 INFO nova.network.driver [-] Loading network driver 'nova.network.linux_net'
2014-07-26 08:59:09.357 31454 DEBUG nova.servicegroup.api [-] ServiceGroup driver defined as an instance of db __new__ /usr/lib/python2.7/dist-packages/nova/servicegroup/api.py:65
2014-07-26 08:59:09.401 31454 DEBUG stevedore.extension [-] found extension EntryPoint.parse('file = nova.image.download.file') _load_plugins /usr/lib/python2.7/dist-packages/stevedore/extension.py:156
2014-07-26 08:59:09.412 31454 DEBUG stevedore.extension [-] found extension EntryPoint.parse('file = nova.image.download.file') _load_plugins /usr/lib/python2.7/dist-packages/stevedore/extension.py:156
/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/session.py:379: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
match = pattern.match(integrity_error.message)
Command failed, please check log for more info
2014-07-26 08:59:09.733 31454 CRITICAL nova [req-57790599-5bf4-4c18-9fc6-c81d12a889d1 None] DuplicateVlan: Detected existing vlan with id 103
2014-07-26 08:59:09.733 31454 TRACE nova Traceback (most recent call last):
2014-07-26 08:59:09.733 31454 TRACE nova File "/usr/bin/nova-manage", line 10, in <module>
2014-07-26 08:59:09.733 31454 TRACE nova sys.exit(main())
2014-07-26 08:59:09.733 31454 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/cmd/manage.py", line 1376, in main
2014-07-26 08:59:09.733 31454 TRACE nova ret = fn(*fn_args, **fn_kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/cmd/manage.py", line 530, in create
2014-07-26 08:59:09.733 31454 TRACE nova net_manager.create_networks(context.get_admin_context(), **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1865, in create_networks
2014-07-26 08:59:09.733 31454 TRACE nova self, context, vpn=True, **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1094, in create_networks
2014-07-26 08:59:09.733 31454 TRACE nova return self._do_create_networks(context, **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1232, in _do_create_networks
2014-07-26 08:59:09.733 31454 TRACE nova net.create()
2014-07-26 08:59:09.733 31454 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/objects/base.py", line 151, in wrapper
2014-07-26 08:59:09.733 31454 TRACE nova return fn(self, ctxt, *args, **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova File "/usr/lib/python2.7/dist-packages/nova/objects/network.py", line 131, in create
2014-07-26 08:59:09.733 31454 TRACE nova db...

Interesting:

we experience this problem even if we have empty list of networks.

root@node-1:~# nova-manage network list
id      IPv4                    IPv6            start address   DNS1            DNS2           VlanID           project         uuid           
No networks found
root@node-1:~# /usr/bin/nova-manage network create novanetwork 10.0.0.0/16 8 32 --dns2 8.8.8.8 --vlan 103 --dns1 8.8.4.4
2014-07-26 08:59:09.356 31454 INFO nova.network.driver [-] Loading network driver 'nova.network.linux_net'
2014-07-26 08:59:09.357 31454 DEBUG nova.servicegroup.api [-] ServiceGroup driver defined as an instance of db __new__ /usr/lib/python2.7/dist-packages/nova/servicegroup/api.py:65
2014-07-26 08:59:09.401 31454 DEBUG stevedore.extension [-] found extension EntryPoint.parse('file = nova.image.download.file') _load_plugins /usr/lib/python2.7/dist-packages/stevedore/extension.py:156
2014-07-26 08:59:09.412 31454 DEBUG stevedore.extension [-] found extension EntryPoint.parse('file = nova.image.download.file') _load_plugins /usr/lib/python2.7/dist-packages/stevedore/extension.py:156
/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/session.py:379: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
  match = pattern.match(integrity_error.message)
Command failed, please check log for more info
2014-07-26 08:59:09.733 31454 CRITICAL nova [req-57790599-5bf4-4c18-9fc6-c81d12a889d1 None] DuplicateVlan: Detected existing vlan with id 103
2014-07-26 08:59:09.733 31454 TRACE nova Traceback (most recent call last):
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/bin/nova-manage", line 10, in <module>
2014-07-26 08:59:09.733 31454 TRACE nova     sys.exit(main())
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/manage.py", line 1376, in main
2014-07-26 08:59:09.733 31454 TRACE nova     ret = fn(*fn_args, **fn_kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/manage.py", line 530, in create
2014-07-26 08:59:09.733 31454 TRACE nova     net_manager.create_networks(context.get_admin_context(), **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1865, in create_networks
2014-07-26 08:59:09.733 31454 TRACE nova     self, context, vpn=True, **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1094, in create_networks
2014-07-26 08:59:09.733 31454 TRACE nova     return self._do_create_networks(context, **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1232, in _do_create_networks
2014-07-26 08:59:09.733 31454 TRACE nova     net.create()
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/objects/base.py", line 151, in wrapper
2014-07-26 08:59:09.733 31454 TRACE nova     return fn(self, ctxt, *args, **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/objects/network.py", line 131, in create
2014-07-26 08:59:09.733 31454 TRACE nova     db_network = db.network_create_safe(context, updates)
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 929, in network_create_safe
2014-07-26 08:59:09.733 31454 TRACE nova     return IMPL.network_create_safe(context, values)
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 146, in wrapper
2014-07-26 08:59:09.733 31454 TRACE nova     return f(*args, **kwargs)
2014-07-26 08:59:09.733 31454 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 2519, in network_create_safe
2014-07-26 08:59:09.733 31454 TRACE nova     raise exception.DuplicateVlan(vlan=values['vlan'])
2014-07-26 08:59:09.733 31454 TRACE nova DuplicateVlan: Detected existing vlan with id 103
2014-07-26 08:59:09.733 31454 TRACE nova

Revision history for this message

Vladimir Kuklin (vkuklin) wrote on 2014-07-26:

looks like our novaclient misses this fix: https://review.openstack.org/#/c/26726/1/novaclient/v1_1/shell.py

there are two options:

1) fix novaclient (the best option)
2) fix manifests to use vlan_start option instead of vlan for novaclient

Revision history for this message

Vladimir Kuklin (vkuklin) wrote on 2014-07-26:

ok, it contains this "fix" and that's why it is broken

Revision history for this message

Vladimir Kuklin (vkuklin) wrote on 2014-07-26:

looks like there is some ambiguation between vlan and vlan_start parameters

Revision history for this message

Vladimir Kuklin (vkuklin) wrote on 2014-07-26:

the best option is to change manifests.

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-07-26: Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/109812

Changed in fuel:
assignee:	MOS Nova (mos-nova) → Vladimir Kuklin (vkuklin)
status:	Triaged → In Progress

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-07-26: Fix proposed to fuel-library (stable/5.0)

Fix proposed to branch: stable/5.0
Review: https://review.openstack.org/109813

Revision history for this message

Roman Podoliaka (rpodolyaka) wrote on 2014-07-26:

#10

Vladimir uploaded the fix, but gerrit didn't change the bug status to 'in progress' for some reason

tags:

added: nova

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-07-28: Fix merged to fuel-library (master)

#11

Reviewed: https://review.openstack.org/109812
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=8db65ae64d7664ddb4bf38c2161f5dcc4601703e
Submitter: Jenkins
Branch: master

commit 8db65ae64d7664ddb4bf38c2161f5dcc4601703e
Author: Vladimir Kuklin <email address hidden>
Date: Sat Jul 26 17:24:07 2014 +0400

Modify nova_network vlan provider

Set vlan_start option to be --vlan_start
instead of vlan

Change-Id: Ic65a6d5488938df5df544487dcfb8b29480645eb
Closes-bug: #1348664

Changed in fuel:
status:	In Progress → Fix Committed

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2014-07-28: Fix merged to fuel-library (stable/5.0)

#12

Reviewed: https://review.openstack.org/109813
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=6e6bf6cba3dd8a105f7e7f52f8de68c5b4bc32fe
Submitter: Jenkins
Branch: stable/5.0

commit 6e6bf6cba3dd8a105f7e7f52f8de68c5b4bc32fe
Author: Vladimir Kuklin <email address hidden>
Date: Sat Jul 26 17:24:07 2014 +0400

Modify nova_network vlan provider

Set vlan_start option to be --vlan_start
instead of vlan

Change-Id: Ic65a6d5488938df5df544487dcfb8b29480645eb
Closes-bug: #1348664

Revision history for this message

Anastasia Palkina (apalkina) wrote on 2014-08-07:

#13

Verified on ISO #408
"build_id": "2014-08-07_02-01-17",
"ostf_sha": "e33390c275e225d648b36997460dc29b1a3c20ae",
"build_number": "408",
"auth_required": true,
"api": "1.0",
"nailgun_sha": "67c4f1c18ab0833175f6dc7f0f9c49c3eb722287",
"production": "docker",
"fuelmain_sha": "7b2e7ef083f239bd47b5c47aecb1f815c009521f",
"astute_sha": "b52910642d6de941444901b0f20e95ebbcb2b2e9",
"feature_groups": ["mirantis"],
"release": "5.1",
"fuellib_sha": "53633cd9bb149f6c1b9d5ee8321efc85c71cee68"