Instance does not get ip address

[Egor Kotko]

{"build_id": "2014-04-17_12-02-07", "mirantis": "yes", "build_number": "436", "nailgun_sha": "8d2fecba6f69f4e9fc7a0811a74608cdffcbc4fd", "production": "dev", "ostf_sha": "1ac04769cc8034438ccf1176860b25d0f5601c4a", "fuelmain_sha": "889ee10d33fc0a4436ab405a8b7d1c1d41e33f1e", "astute_sha": "29b274b72add200120d5f4824a197f77c3d29701", "release": "5.0", "fuellib_sha": "aa17523f335f115e4bae751f9de2cec2a2f616f2"}

Instance does not get ip address
Steps to reproduce:
1 Create environment:
Centos, HA, Neutron GRE, 3 Controlles, 2 Computes, 2 Cephs
2. Create instance

Expected result:
Instance should get the ip address from dhcp server

Actual result:
Instance can not get ip address.

Starting network...
udhcpc (v1.20.1) started
Sending discover...
Sending discover...
Sending discover...
No lease, failing
WARN: /etc/rc3.d/S40-network failed
cirros-ds 'net' up at 192.91
checking http://169.254.169.254/2009-04-04/instance-id
failed 1/20: up 193.29. request failed
failed 2/20: up 195.54. request failed
failed 3/20: up 197.84. request failed
failed 4/20: up 200.37. request failed
failed 5/20: up 202.62. request failed
failed 6/20: up 204.87. request failed
failed 7/20: up 207.14. request failed
failed 8/20: up 209.39. request failed
failed 9/20: up 211.67. request failed
failed 10/20: up 214.17. request failed
failed 11/20: up 216.46. request failed
failed 12/20: up 218.83. request failed
failed 13/20: up 221.16. request failed
failed 14/20: up 223.44. request failed
failed 15/20: up 225.74. request failed
failed 16/20: up 228.33. request failed
failed 17/20: up 230.60. request failed
failed 18/20: up 232.90. request failed
failed 19/20: up 235.19. request failed
failed 20/20: up 237.52. request failed
failed to read iid from metadata. tried 20
no results found for mode=net. up 239.86. searched: nocloud configdrive ec2
failed to get instance-id of datasource
Starting murano-agent:OK
Starting dropbear sshd: generating rsa key... generating dsa key... OK
=== network info ===
if-info: lo,up,127.0.0.1,8,::1
if-info: eth0,up,,8,fe80::f816:3eff:fe08:b3e7
=== datasource: None None ===
=== cirros: current=0.3.1 uptime=244.99 ===
route: fscanf
=== pinging gateway failed, debugging connection ===
############ debug start ##############
### /etc/init.d/sshd start
Starting dropbear sshd: OK
route: fscanf
### ifconfig -a
eth0 Link encap:Ethernet HWaddr FA:16:3E:08:B3:E7
          inet6 addr: fe80::f816:3eff:fe08:b3e7/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:10 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:756 (756.0 B) TX bytes:1112 (1.0 KiB)

lo Link encap:Local Loopback
          inet addr:127.0.0.1 Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING MTU:16436 Metric:1
          RX packets:14 errors:0 dropped:0 overruns:0 frame:0
          TX packets:14 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1120 (1.0 KiB) TX bytes:1120 (1.0 KiB)

[Vladimir Kuklin (vkuklin)]

please, test if this behaviour exists on the latest development icehouse iso. it looks like all the neutron issues were fixed there

[Vladimir Kuklin (vkuklin)]

looks pretty much like a duplicate of https://bugs.launchpad.net/fuel/+bug/1309087

[Vladimir Kuklin (vkuklin)]

my bad, this is centos environment. then we need openvswitch agent logs from the nodes

[Tatyanka (tatyana-leontovich)]

reproduced on Centos simple + neutron gre on 129 iso

{"build_id": "2014-04-23_03-41-25", "mirantis": "yes", "build_number": "127", "nailgun_sha": "ead54af79fb8d798bdf8b7cfc08ee60103c9292f", "production": "prod", "ostf_sha": "134765fcb5a07dce0cd1bb399b2290c988c3c63b", "fuelmain_sha": "a864e28fff841b40c3b4a53f00e622002f300b19", "astute_sha": "6e8fa4cc12968d7b468fc590b2f06bb59bf74511", "release": "5.0", "fuellib_sha": "646e52b7a34a0027b43c46aa5b525fe7674a8059"}

Starting network...
udhcpc (v1.20.1) started
Sending discover...
Sending discover...
Sending discover...
No lease, failing
WARN: /etc/rc3.d/S40-network failed
cirros-ds 'net' up at 184.34
checking http://169.254.169.254/2009-04-04/instance-id
failed 1/20: up 184.53. request failed
failed 2/20: up 186.68. request failed
failed 3/20: up 188.79. request failed
failed 4/20: up 190.91. request failed
failed 5/20: up 193.04. request failed
failed 6/20: up 195.16. request failed
failed 7/20: up 197.29. request failed
failed 8/20: up 199.42. request failed
failed 9/20: up 201.56. request failed
failed 10/20: up 203.70. request failed
failed 11/20: up 205.83. request failed
failed 12/20: up 207.96. request failed
failed 13/20: up 210.09. request failed
failed 14/20: up 212.23. request failed
failed 15/20: up 214.37. request failed
failed 16/20: up 216.50. request failed
failed 17/20: up 218.65. request failed
failed 18/20: up 220.80. request failed
failed 19/20: up 222.93. request failed
failed 20/20: up 225.07. request failed

[root@node-1 openvswitch]# ip netns list
qrouter-b8b6316e-4983-497a-8eec-99c243fbb81e
qdhcp-d98b1bfa-dfc7-478e-be5f-1ea7864232fd
[root@node-1 openvswitch]#

in openswitch agent:
2014-04-23 16:56:46.562 19723 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device 928168db-20a9-4ee8-8eca-7dd2a4140f92 completed.
2014-04-23 17:00:02.930 19723 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-90b8f0f8-2478-4a8c-ae99-25b486280113 None] Failed to set-up gre tunnel port to 10.108.2.3

[Mike Scherbakov (mihgen)]

It sounds critical to me, please prove me if it is not...
If instance doesn't get IP in Neutron GRE, I consider this as critical issue.

[Vladimir Kuklin (vkuklin)]

looks pretty much like duplicate of these to bugs:

https://bugs.launchpad.net/neutron/+bug/1311804
https://bugs.launchpad.net/fuel/+bug/1311634

both commits merged into packages and manifests

[Vladimir Kuklin (vkuklin)]

reopen, if bug reproduces with this code

[Tatyanka (tatyana-leontovich)]

verified on 135 - works as a charm ) Thanks guys!!!

[Tatyanka (tatyana-leontovich)]

{u'build_id': u'2014-04-24_15-01-23', u'mirantis': u'yes', u'build_number': u'135', u'ostf_sha': u'134765fcb5a07dce0cd1bb399b2290c988c3c63b', u'nailgun_sha': u'dcaed120b34dd2c8cf817463a243eedfb844f096', u'production': u'prod', u'fuelmain_sha': u'387d2e931ee14d5773f21f1e2860a13b50b37d04', u'astute_sha': u'6e8fa4cc12968d7b468fc590b2f06bb59bf74511', u'release': u'5.0', u'fuellib_sha': u'fa57b98344e7cdd342b7c08a5e692525b102af8b'}

[Tatyanka (tatyana-leontovich)]

Sorry to say but I am was too fast with decision :(

[Andrey Sledzinskiy (asledzinskiy)]

verified on {"build_id": "2014-05-22_01-10-31", "mirantis": "yes", "build_number": "216", "ostf_sha": "5c479f04c35127576d35526650ec83b104f9a33d", "nailgun_sha": "31fcb161ff8d6bfb861b041467440752c0e9c537", "production": "docker", "api": "1.0", "fuelmain_sha": "dda9cff27999e74b80e8e6a9e665e7e9677ab994", "astute_sha": "9a0d86918724c1153b5f70bdae008dea8572fd3e", "release": "5.0", "fuellib_sha": "872b6a7a968b619a493ad46c504910020ea2edae"}