Juniper Openstack

[ocata-master-414]JobException seen during the discovery of prouters in the fabric

Series trunk
Bug #1806614

Bug #1806614 reported by Ganesha HV on 2018-12-04

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Juniper Openstack	Status tracked in Trunk
	Trunk	New	High	Atul Moghe	Juniper Openstack r5.1.0

Bug Description

1]. Brought up contrail-command cluster using ocata-master-414.
2]. Added a fabric with /24 subnet.
3]. During the fabric onboarding task, while discovering the prouters, below errors were seen.
FabricAnsible complains about Invalid marked output: PLAYBOOK_OUTPUT as :

Error Logs
==========
12/04/2018 10:22:56.078 [ansible] pid=673 [WARNING]: PLAY [get node profile hint for physical routers in the fabric] ****************
12/04/2018 10:22:56.091 [ansible] pid=673 [WARNING]: TASK [Gathering Facts] *********************************************************
12/04/2018 10:22:57.593 [ansible] pid=673 [WARNING]: ok: [localhost]
12/04/2018 10:22:57.608 [ansible] pid=673 [WARNING]: TASK [discover_role : set_fact] ************************************************
12/04/2018 10:22:57.649 [ansible] pid=673 [WARNING]: ok: [localhost]
12/04/2018 10:22:57.656 [ansible] pid=673 [WARNING]: TASK [discover_role : Start discovering roles for prouters in the fabric] ******
12/04/2018 10:22:57.673 [ansible] pid=673 [ERROR]: fatal: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: {{playbook_input.product_name}}: 'dict object' has no attribute 'product_name'\n\nThe error appears to have been in '/opt/contrail/fabric_ansible_playbooks/roles/discover_role/tasks/main.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Start discovering roles for prouters in the fabric\n ^ here\n\nexception type: <class 'ansible.errors.AnsibleUndefinedVariable'>\nexception: {{playbook_input.product_name}}: 'dict object' has no attribute 'product_name'"}
12/04/2018 10:22:57.675 [ansible] pid=673 [WARNING]: to retry, use: --limit @/opt/contrail/fabric_ansible_playbooks/discover_role.retry

12/04/2018 10:22:57.675 [ansible] pid=673 [WARNING]: PLAY RECAP *********************************************************************
12/04/2018 10:22:57.675 [ansible] pid=673 [WARNING]: ^[[0;31mlocalhost^[[0m : ^[[0;32mok=2 ^[[0m changed=0 unreachable=0 ^[[0;31mfailed=1 ^[[0m
12/04/2018 10:22:57.675 [ansible] pid=673 [WARNING]: localhost : ok=2 changed=0 unreachable=0 failed=1

12/04/2018 10:22:54 AM [FabricAnsible] [ERROR]: Invalid marked output: PLAYBOOK_OUTPUT##{"status": "SUCCESS", "message": "Completed device discovery", "device_json": {"277cda90-397e-46f3-8f7b-a7c4a396faa4": {"device_username": "root", "device_serial_number": "WS3717450018", "device_management_ip": "10.204.216.131", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "contrail-qfx5110-1"], "device_product": "qfx5110-48s-4c", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "20baf2ea-2c41-439e-a3a7-752330c4e8b1": {"device_username": "root", "device_serial_number": "DV141", "device_management_ip": "10.204.216.185", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "bng-contrail-qfx-1k2-1"], "device_product": "qfx10002-36q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "7167ee39-4f35-4cc6-8244-e888c441657b": {"device_username": "root", "device_serial_number": "DU391", "device_management_ip": "10.204.216.122", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "bng-contrail-qfx-1k2-4"], "device_product": "qfx10002-36q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "16a394cf-b449-40df-832f-d85895ad1de8": {"device_username": "root", "device_serial_number": "VF3714470098", "device_management_ip": "10.204.216.189", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "qfx51-6"], "device_product": "qfx5100-48s-6q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "9d0c89cf-6d29-41a3-ba83-f052aeae33f9": {"device_username": "root", "device_serial_number": "JN1222E77AFC", "device_management_ip": "10.204.216.247", "device_family": "junos", "device_fqname": ["default-global-system-config", "ishant"], "device_product": "mx240", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "68a7d5c7-9249-4876-8e84-4f070b86f4cb": {"device_username": "root", "device_serial_number": "DV016", "device_management_ip": "10.204.216.202", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "bng-contrail-qfx-1k2-2"], "device_product": "qfx10002-36q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "74864d4f-0580-4f38-ae5d-4bf863f2f0a8": {"device_username": "root", "device_serial_number": "VF3714500076", "device_management_ip": "10.204.216.188", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "qfx51-5"], "device_product": "qfx5100-48s-6q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "dd5a7390-a010-4c41-a6cd-b9b477279e5c": {"device_username": "root", "device_serial_number": "JN1223185AFC", "device_management_ip": "10.204.216.246", "device_family": "junos", "device_fqname": ["default-global-system-config", "dhawan"], "device_product": "mx240", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "d91b2c96-2df0-45cb-ab6b-f011fdd18a17": {"device_username": "root", "device_serial_number": "WS3717450116", "device_management_ip": "10.204.216.132", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "contrail-qfx5110-2"], "device_product": "qfx5110-48s-4c", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "c6f4239d-2432-40b3-b00b-d3897cc5ca48": {"device_username": "root", "device_serial_number": "VF3714500053", "device_management_ip": "10.204.216.211", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "bng-contrail-qfx51-12"], "device_product": "qfx5100-48s-6q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "10a6541d-7c3d-4765-b3e0-ffe98ed0cfcb": {"device_username": "root", "device_serial_number": "F5070", "device_management_ip": "10.204.216.253", "device_family": "junos", "device_fqname": ["default-global-system-config", "blr-mx1"], "device_product": "mx80", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "41f24eb9-9801-43d2-acb1-dc5eef3c5ca9": {"device_username": "root", "device_serial_number": "JN1222611AFC", "device_management_ip": "10.204.216.245", "device_family": "junos", "device_fqname": ["default-globa
12/04/2018 10:22:54 AM [FabricAnsible] [ERROR]: Invalid marked output: PLAYBOOK_OUTPUT##{"status": "SUCCESS", "message": "Completed device discovery", "device_json": {"277cda90-397e-46f3-8f7b-a7c4a396faa4": {"device_username": "root", "device_serial_number": "WS3717450018", "device_management_ip": "10.204.216.131", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "contrail-qfx5110-1"], "device_product": "qfx5110-48s-4c", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "20baf2ea-2c41-439e-a3a7-752330c4e8b1": {"device_username": "root", "device_serial_number": "DV141", "device_management_ip": "10.204.216.185", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "bng-contrail-qfx-1k2-1"], "device_product": "qfx10002-36q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "7167ee39-4f35-4cc6-8244-e888c441657b": {"device_username": "root", "device_serial_number": "DU391", "device_management_ip": "10.204.216.122", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "bng-contrail-qfx-1k2-4"], "device_product": "qfx10002-36q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "16a394cf-b449-40df-832f-d85895ad1de8": {"device_username": "root", "device_serial_number": "VF3714470098", "device_management_ip": "10.204.216.189", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "qfx51-6"], "device_product": "qfx5100-48s-6q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "9d0c89cf-6d29-41a3-ba83-f052aeae33f9": {"device_username": "root"
, "device_serial_number": "JN1222E77AFC", "device_management_ip": "10.204.216.247", "device_family": "junos", "device_fqname": ["default-global-system-config", "ishant"], "device_product": "mx240", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "68a7d5c7-9249-4876-8e84-4f070b86f4cb": {"device_username": "root", "device_serial_number": "DV016", "device_management_ip": "10.204.216.202", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "bng-contrail-qfx-1k2-2"], "device_product": "qfx10002-36q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "74864d4f-0580-4f38-ae5d-4bf863f2f0a8": {"device_username": "root", "device_serial_number": "VF3714500076", "device_management_ip": "10.204.216.188", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "qfx51-5"], "device_product": "qfx5100-48s-6q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "dd5a7390-a010-4c41-a6cd-b9b477279e5c": {"device_username": "root", "device_serial_number": "JN1223185AFC", "device_management_ip": "10.204.216.246", "device_family": "junos", "device_fqname": ["default-global-system-config", "dhawan"], "device_product": "mx240", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "d91b2c96-2df0-45cb-ab6b-f011fdd18a17": {"device_username": "root", "device_serial_number": "WS3717450116", "device_management_ip": "10.204.216.132", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "contrail-qfx5110-2"], "device_product": "qfx5110-48s-4c", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "c6f4239d-2432-40b3-b00b-d3897cc5ca48": {"device_username": "root", "device_serial_number": "VF3714500053", "device_management_ip": "10.204.216.211", "device_family": "junos-qfx", "device_fqname": ["default-global-system-config", "bng-contrail-qfx51-12"], "device_product": "qfx5100-48s-6q", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "10a6541d-7c3d-4765-b3e0-ffe98ed0cfcb": {"device_username": "root", "device_serial_number": "F5070", "device_management_ip": "10.204.216.253", "device_family": "junos", "device_fqname": ["default-global-system-config", "blr-mx1"], "device_product": "mx80", "device_vendor": "Juniper", "device_password": "c0ntrail123"}, "41f24eb9-9801-43d2-acb1-dc5eef3c5ca9": {"device_username": "root", "device_serial_number": "JN1222611AFC", "device_management_ip": "10.204.216.245", "device_family": "junos", "device_fqname": ["default-globa
12/04/2018 10:22:57 AM [FabricAnsible] [ERROR]: Exception in playbook process for playbook "./opt/contrail/fabric_ansible_playbooks/discover_role.yml" (exec_id: 1543899106671_af686fdf-4759-44fb-b134-f176a45ffe4d): Exception('Playbook returned with error',)
Playbook returned with error
12/04/2018 10:22:57 AM [FabricAnsible] [ERROR]: Playbook "./opt/contrail/fabric_ansible_playbooks/discover_role.yml" exited with error.
12/04/2018 10:22:57 AM [FabricAnsible] [ERROR]: Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/job_manager/job_handler.py", line 64, in handle_job
    result_handler.percentage_completed)
  File "/usr/lib/python2.7/site-packages/job_manager/job_handler.py", line 446, in run_playbook
    playbook_output = self.run_playbook_process(playbook_info, percentage_completed)
  File "/usr/lib/python2.7/site-packages/job_manager/job_handler.py", line 417, in run_playbook_process
    raise JobException(msg, self._execution_id)
JobException: JobException in execution (1543899106671_af686fdf-4759-44fb-b134-f176a45ffe4d): Playbook "./opt/contrail/fabric_ansible_playbooks/discover_role.yml" exited with error.

I have placed the log-files at 10.204.216.50:/home/bhushana/Documents/technical/bugs/<bug-ID>

Tags:

Sudheendra Rao (sudheendra-k) on 2018-12-09

information type:

Proprietary → Public

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.