link local service tests failing on Build 1.10 48
Affects | Status | Importance | Assigned to | Milestone | ||
---|---|---|---|---|---|---|
Juniper Openstack | Status tracked in Trunk | |||||
R1.1 |
Fix Committed
|
High
|
Divakar Dharanalakota | |||
Trunk |
Invalid
|
High
|
Divakar Dharanalakota |
Bug Description
R1.10 Build 48
All tests related to link local service failed on build 48
http://
2014-10-07 13:50:10,889 [ INFO ] =======
2014-10-07 13:50:10,889 [ INFO ] STARTING TEST : test_generic_
2014-10-07 13:50:10,889 [ INFO ] TEST DESCRIPTION :
3.Try wget to jenkins - passes if successful else fails
2014-10-07 13:50:13,164 [ ERROR ] VR mem stats not available, skipping check, needs to be debugged...
2014-10-07 13:50:13,164 [ DEBUG ] Requesting: http://
2014-10-07 13:50:13,169 [ INFO ] nodeb9 compute is subscribed to ['10.204.216.2'] bgp nodes
2014-10-07 13:50:13,169 [ INFO ] Actual XmppServer for nodeb9 : ['10.204.216.2']
2014-10-07 13:50:13,169 [ INFO ] Expected XmppServer for nodeb9 : ['10.204.216.2']
2014-10-07 13:50:13,169 [ DEBUG ] Requesting: http://
2014-10-07 13:50:13,178 [ DEBUG ] Requesting: http://
2014-10-07 13:50:13,195 [ DEBUG ] Requesting: http://
2014-10-07 13:50:13,228 [ INFO ] 10.204.216.2 bgp node subscribed by ['10.204.216.2'] xmpp-clients
2014-10-07 13:50:13,228 [ INFO ] From control node introspect, xmpp-clients: ['10.204.216.2']
2014-10-07 13:50:13,229 [ INFO ] Creating vn vn2_metadata..
2014-10-07 13:50:13,403 [ DEBUG ] Project ['default-domain', 'admin'] already present.Not creating it
2014-10-07 13:50:14,436 [ DEBUG ] Response for create_network : {u'network': {u'status': u'ACTIVE', u'router:external': False, u'subnets': [], u'name': u'vn2_metadata', u'admin_state_up': True, u'tenant_id': u'e1de503bcf6e4
2014-10-07 13:50:15,170 [ DEBUG ] Response for create_subnet : {u'subnet': {u'name': u'', u'enable_dhcp': True, u'network_id': u'21dfd8ea-
2014-10-07 13:50:15,245 [ DEBUG ] Created VN vn2_metadata
2014-10-07 13:50:15,536 [ DEBUG ] Project ['default-domain', 'admin'] already present.Not creating it
2014-10-07 13:50:18,217 [ INFO ] Servies List from the nova obj: [<Service: nova-compute>]
2014-10-07 13:50:21,492 [ INFO ] VM Object: ([<Server: nova_client_vm>]) Nodename: (None) Zone: (nova:nodeb9)
2014-10-07 13:50:27,559 [ INFO ] VM nova_client_vm launched on Node nodeb9
2014-10-07 13:50:27,823 [ INFO ] VM nova_client_vm ID is d46d952a-
2014-10-07 13:50:28,143 [ INFO ] VM <Server: nova_client_vm> is ACTIVE now
2014-10-07 13:50:28,144 [ DEBUG ] Requesting: http://
2014-10-07 13:50:28,309 [ DEBUG ] Requesting: http://
2014-10-07 13:50:28,381 [ DEBUG ] Requesting: http://
2014-10-07 13:50:28,397 [ DEBUG ] Requesting: http://
2014-10-07 13:50:28,409 [ INFO ] Verifying in api server 10.204.216.2
2014-10-07 13:50:28,410 [ INFO ] API Server validations for VM nova_client_vm passed in api server 10.204.216.2
2014-10-07 13:50:28,410 [ INFO ] API Server validations for VM nova_client_vm passed
2014-10-07 13:50:29,183 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,187 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,194 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,200 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,203 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,209 [ DEBUG ] Active route in agent is present for VMI tap238513fd-5d
2014-10-07 13:50:29,209 [ DEBUG ] VM nova_client_vm labels in tap-interface and the route do match
2014-10-07 13:50:29,209 [ DEBUG ] VM nova_client_vm : Tap interface tap238513fd-5d is set to Active
2014-10-07 13:50:29,209 [ DEBUG ] VM nova_client_vm : Tap interface tap238513fd-5d is set to Active
2014-10-07 13:50:29,209 [ DEBUG ] Tap interface tap238513fd-5d detail : {'sg_uuid_list': None, 'ip_addr': '11.1.1.2', 'vxlan_id': '11', 'vm_project_uuid': 'e1de503b-
2014-10-07 13:50:29,209 [ INFO ] Starting Layer 2 verification in Agent
2014-10-07 13:50:29,209 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,214 [ INFO ] Layer 2 path is seen for VM MAC 02:23:85:13:fd:5d in agent 10.204.216.2
2014-10-07 13:50:29,214 [ INFO ] Active layer 2 route in agent is present for VMI tap238513fd-5d
2014-10-07 13:50:29,214 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,217 [ DEBUG ] VN default-
2014-10-07 13:50:29,217 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,255 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,261 [ DEBUG ] VRF IDs of VN default-
2014-10-07 13:50:29,261 [ DEBUG ] Route for VM IP 11.1.1.2 is consistent in agent 10.204.216.2
2014-10-07 13:50:29,261 [ DEBUG ] VN default-
2014-10-07 13:50:29,261 [ INFO ] Starting all layer 2 verification in agent 10.204.216.2
2014-10-07 13:50:29,261 [ DEBUG ] Requesting: http://
2014-10-07 13:50:29,265 [ INFO ] Route for VM MAC 02:23:85:13:fd:5d is consistent in agent 10.204.216.2
2014-10-07 13:50:30,188 [ DEBUG ] Requesting: http://
2014-10-07 13:50:30,193 [ INFO ] Starting all layer2 verification in 10.204.216.2 Control Node
2014-10-07 13:50:30,193 [ DEBUG ] Requesting: http://
2014-10-07 13:50:30,197 [ INFO ] Layer2 route found for VM MAC 02:23:85:13:fd:5d in Control-node 10.204.216.2
2014-10-07 13:50:30,198 [ INFO ] L2 Label for VM nova_client_vm same between Control-node 10.204.216.2 and Agent, Expected: 17, Seen: 17
2014-10-07 13:50:30,198 [ INFO ] Verification in Control-nodes for VM nova_client_vm passed
2014-10-07 13:50:31,152 [ INFO ] Verifying the vm in opserver
2014-10-07 13:50:31,152 [ INFO ] Verifying in collector 10.204.216.2 ...
2014-10-07 13:50:31,152 [ DEBUG ] Requesting: http://
2014-10-07 13:50:31,196 [ DEBUG ] Requesting: http://
2014-10-07 13:50:31,203 [ INFO ] Verifying vm in vn uve
2014-10-07 13:50:31,203 [ INFO ] vm uve shows interface as default-
2014-10-07 13:50:31,203 [ INFO ] vm uve shows ip address as 11.1.1.2
2014-10-07 13:50:31,203 [ INFO ] vm uve shows virtual netowrk as default-
2014-10-07 13:50:31,203 [ INFO ] Verifying through opserver in 10.204.216.2
2014-10-07 13:50:31,204 [ DEBUG ] Requesting: http://
2014-10-07 13:50:31,222 [ INFO ] expected vm list d46d952a-
2014-10-07 13:50:31,223 [ INFO ] Extracted vm list [u'd46d952a-
2014-10-07 13:50:31,223 [ INFO ] d46d952a-
2014-10-07 13:50:31,223 [ INFO ] Verifying vm in vrouter uve
2014-10-07 13:50:31,223 [ INFO ] Getting info from collector 10.204.216.2..
2014-10-07 13:50:31,223 [ DEBUG ] Requesting: http://
2014-10-07 13:50:31,230 [ INFO ] vm uve shows vrouter as [u'nodeb9']
2014-10-07 13:50:31,230 [ DEBUG ] Requesting: http://
2014-10-07 13:50:33,442 [ DEBUG ] Requesting: http://
2014-10-07 13:50:34,633 [ INFO ] vm d46d952a-
2014-10-07 13:50:34,633 [ INFO ] Verifying vm tap interface/vn in vrouter uve
2014-10-07 13:50:34,633 [ DEBUG ] Requesting: http://
2014-10-07 13:50:34,640 [ INFO ] expected tap interface of vm uuid d46d952a-
2014-10-07 13:50:34,640 [ INFO ] expected virtual network of vm uuid d46d952a-
2014-10-07 13:50:34,640 [ DEBUG ] Requesting: http://
2014-10-07 13:50:36,876 [ DEBUG ] Requesting: http://
2014-10-07 13:50:38,076 [ INFO ] vm d46d952a-
2014-10-07 13:50:38,077 [ INFO ] tap interface default-
2014-10-07 13:50:38,077 [ INFO ] Connected nwtwork default-
2014-10-07 13:50:38,077 [ INFO ] Verifying the d46d952a-
2014-10-07 13:50:38,077 [ DEBUG ] Requesting: http://
2014-10-07 13:50:38,082 [ INFO ] vm link and name as {u'href': u'http://
2014-10-07 13:50:38,083 [ INFO ] VM nova_client_vm validation in Opserver passed
2014-10-07 13:50:39,317 [ DEBUG ] PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.
--- 169.254.0.3 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 10000ms
2014-10-07 13:50:39,317 [ WARNING ] Ping to Metadata IP 169.254.0.3 of VM nova_client_vm failed!
2014-10-07 13:50:39,369 [ DEBUG ] PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.
64 bytes from 169.254.0.3: icmp_seq=1 ttl=64 time=1.19 ms
--- 169.254.0.3 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 1ms
rtt min/avg/max/mdev = 1.191/1.
2014-10-07 13:50:39,369 [ INFO ] Ping to Metadata IP 169.254.0.3 of VM nova_client_vm passed
2014-10-07 13:50:39,370 [ INFO ] The local IP is 169.254.0.3
2014-10-07 13:50:39,370 [ INFO ] VM nova_client_vm Verifications in Agent is fine
2014-10-07 13:50:40,611 [ INFO ] VM nova_client_vm launched on Node nodeb9
2014-10-07 13:50:40,932 [ INFO ] VM nova_client_vm ID is d46d952a-
2014-10-07 13:50:41,189 [ DEBUG ] Requesting: http://
2014-10-07 13:50:41,198 [ DEBUG ] Requesting: http://
2014-10-07 13:50:41,242 [ DEBUG ] PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.
64 bytes from 169.254.0.3: icmp_seq=1 ttl=64 time=1.15 ms
--- 169.254.0.3 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 1ms
rtt min/avg/max/mdev = 1.150/1.
2014-10-07 13:50:41,242 [ INFO ] Ping to Metadata IP 169.254.0.3 of VM nova_client_vm passed
2014-10-07 13:50:41,242 [ INFO ] Waiting to SSH to VM nova_client_vm, IP 11.1.1.2
2014-10-07 13:50:41,291 [ DEBUG ] COMMAND: (fab -u ubuntu -p "ubuntu" -H 169.254.0.3 -D -w --hide status,user,running wait_for_ssh:)
2014-10-07 13:50:49,372 [ DEBUG ] True
2014-10-07 13:50:49,373 [ INFO ] VM nova_client_vm is ready for SSH connections
2014-10-07 13:50:49,931 [ INFO ] Updated.
2014-10-07 13:50:49,932 [ INFO ] Retry 0
2014-10-07 13:50:50,226 [ DEBUG ] Running Cmd on 10.204.216.2: wget http://
2014-10-07 13:52:56,953 [ DEBUG ] --2014-10-07 20:50:55-- http://
Connecting to 169.254.1.2:80... failed: Connection timed out.
Retrying.
--2014-10-07 20:51:59-- (try: 2) http://
Connecting to 169.254.1.2:80... Traceback (most recent call last):
File "/usr/lib/
*args, **kwargs
File "/usr/lib/
multiprocessing
File "/usr/lib/
return task.run(*args, **kwargs)
File "/usr/lib/
return self.wrapped(*args, **kwargs)
File "/root/fabfile.py", line 13, in command
run(cmd)
File "/usr/lib/
return func(*args, **kwargs)
File "/usr/lib/
shell_
File "/usr/lib/
stderr=stderr, timeout=timeout)
File "/usr/lib/
worker.
File "/usr/lib/
callable(*args, **kwargs)
File "/usr/lib/
OutputLoope
File "/usr/lib/
raise CommandTimeout
fabric.
2014-10-07 13:52:56,953 [ WARNING ] Generic metadata did NOT work
2014-10-07 13:52:57,507 [ INFO ] Updated.
2014-10-07 13:52:57,508 [ DEBUG ] Skipping the deletion of Project ['default-domain', 'admin']
2014-10-07 13:52:57,509 [ INFO ] Deleting the VM nova_client_vm
2014-10-07 13:53:02,772 [ INFO ] Verifying in api server 10.204.216.2
2014-10-07 13:53:02,773 [ DEBUG ] Requesting: http://
2014-10-07 13:53:02,782 [ DEBUG ] Response Code: 404
2014-10-07 13:53:02,782 [ DEBUG ] Requesting: http://
2014-10-07 13:53:02,791 [ DEBUG ] Response Code: 404
2014-10-07 13:53:02,791 [ DEBUG ] Requesting: http://
2014-10-07 13:53:02,800 [ DEBUG ] Response Code: 404
2014-10-07 13:53:02,801 [ INFO ] VM nova_client_vm information is fully removed in API-Server
2014-10-07 13:53:04,777 [ DEBUG ] Requesting: http://
2014-10-07 13:53:04,786 [ DEBUG ] Requesting: http://
2014-10-07 13:53:04,789 [ INFO ] Routes for VM nova_client_vm is removed in all control-nodes
2014-10-07 13:53:05,160 [ DEBUG ] Requesting: http://
2014-10-07 13:53:05,164 [ DEBUG ] Requesting: http://
2014-10-07 13:53:05,170 [ DEBUG ] Requesting: http://
2014-10-07 13:53:05,173 [ INFO ] VM nova_client_vm is removed in Compute, and routes are removed in all agent nodes
2014-10-07 13:53:06,780 [ DEBUG ] COMMAND: (flow -l )
2014-10-07 13:53:06,917 [ DEBUG ] Flow table
Index Source:Port Destination:Port Proto(V)
-------
2014-10-07 13:53:06,917 [ INFO ] All flows for the VM deleted on Compute node
2014-10-07 13:53:07,781 [ DEBUG ] Requesting: http://
2014-10-07 13:53:10,009 [ DEBUG ] Requesting: http://
2014-10-07 13:53:11,235 [ INFO ] vm d46d952a-
2014-10-07 13:53:11,236 [ INFO ] Verifying if the vm interface deleted from vroter uve...
2014-10-07 13:53:11,236 [ INFO ] interface for vm d46d952a-
2014-10-07 13:53:11,236 [ INFO ] deleted interface not in error interface list ...
2014-10-07 13:53:11,237 [ INFO ] Verifying through opserver in 10.204.216.2
2014-10-07 13:53:11,237 [ DEBUG ] Requesting: http://
2014-10-07 13:53:11,256 [ INFO ] d46d952a-
2014-10-07 13:53:11,256 [ INFO ] Verifying the d46d952a-
2014-10-07 13:53:11,257 [ DEBUG ] Requesting: http://
2014-10-07 13:53:11,261 [ INFO ] d46d952a-
2014-10-07 13:53:11,261 [ DEBUG ] Skipping the deletion of Project ['default-domain', 'admin']
2014-10-07 13:53:11,262 [ INFO ] Deleting the VN vn2_metadata
2014-10-07 13:53:11,436 [ DEBUG ] Response for deleting network
2014-10-07 13:53:13,712 [ ERROR ]
File "/root/
result = function(self, *args, **kwargs)
File "/root/
assert result
AssertionError:
2014-10-07 13:53:13,712 [ INFO ]
2014-10-07 13:53:13,712 [ INFO ] END TEST : test_generic_
2014-10-07 13:53:13,713 [ INFO ] -------
Fixed with https:/ /github. com/Juniper/ contrail- controller/ commit/ 9ad9bac6ede441b f0152ba9b857839 c895d78385