Hi Marcin

Magda had access to the this environment.Could you check with her.She once accessed my setup.

Response inline….

Regards
Sandip

From: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>
Date: Monday, August 20, 2018 at 9:44 PM
To: Sandip Dey <<email address hidden><mailto:<email address hidden>>>, Ram Yadav <<email address hidden><mailto:<email address hidden>>>, Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>, Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>
Cc: Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>, Artur Dębski <<email address hidden><mailto:<email address hidden>>>, Krzysztof Gromadzki <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Hi Sandip,

Could you please check on your test environment the following issues?
1. Verify if hostnames on ContrailVM virtual machines are unique - hostname as in the name of the host as reported by the OS, not vCenter VM name (verify the output of 'hostname' command on ContrailVM shell, and the content of /etc/hostname file)

+++sandipd:The hostnames are different in 3 contrail-vms.If hostnames are same,vrouter agent does  not come up.Just pasting output from one contrail-vm


[root@nodek4-compute-vm ~]#

[root@nodek4-compute-vm ~]# docker ps

CONTAINER ID        IMAGE                                                        COMMAND                  CREATED             STATUS              PORTS               NAMES

be477c351f85        10.204.217.152:5000/contrail-vcenter-manager:ocata-5.0-168   "/entrypoint.sh /b..."   4 hours ago         Up 4 hours                              vcenter_manager_vcenter-manager_1

9f2ae0c8d086        10.204.217.152:5000/contrail-vrouter-agent:ocata-5.0-168     "/entrypoint.sh /u..."   4 hours ago         Up 4 hours                              vrouter_vrouter-agent_1

f39c578866e8        10.204.217.152:5000/contrail-nodemgr:ocata-5.0-168           "/entrypoint.sh /b..."   4 hours ago         Up 4 hours                              vrouter_nodemgr_1

[root@nodek4-compute-vm ~]# docker exec -it 9f2ae0c8d086 bash

(vrouter-agent)[root@nodek4-compute-vm /]$ hostname

nodek4-compute-vm

(vrouter-agent)[root@nodek4-compute-vm /]$ cat /etc/hostname

nodek4-compute-vm

(vrouter-agent)[root@nodek4-compute-vm /]$

2. Verify if docker containers of contrail-vrouter-agent on ContrailVMs also have unique hostnames (run bash inside the container and check output of 'hostname' command and the content of /etc/hostname file inside the container)

+++sandipd: Replied as above

3. Verify if there are port errors (vrf-name) in vrouter-agent introspect on ContrailVMs (http://localhost:8085/Snh_ItfReq<https://urldefense.proofpoint.com/v2/url?u=http-3A__localhost-3A8085_Snh-5FItfReq&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=G2xQ10HGwQGpf-IwUZQV_zS937NlqD4DZYOyNLhpsEA&e=>)
The above issues may cause problems with assigning IP addresses to the VMs (we came across such cases during development).
Could you let us know if the above issues are correct?
(+cc Krzysztof Gromadzki and Artur Debski)

+++sandipd:Ports are created properly.There is no problem from contrail side.

Also, we could help in more detail, if we could look at the failing testing environment, but we have trouble getting in via VPN.
We want to access the vCenter at 10.204.217.246:9443<https://urldefense.proofpoint.com/v2/url?u=http-3A__10.204.217.246-3A9443&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=INwBnVwPgnPhbZZpsBuxyKWw0AGL-8q7QVorPedqknQ&e=> and Contrail Controller at 10.204.216.61.
Those machines respond to ping but we are unable to access the UIs via browser or login via SSH.
Do you have the possibility to verify if this access works?

Thanks,
--
Marcin Orkiszewski

Project Manager

+48 736 658 288

<email address hidden><mailto:<email address hidden>>

[id:image001.png@01D32D81.76629680]<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.codilime.com_-3Futm-5Fsource-3DStopka-26utm-5Fmedium-3DEmail-26utm-5Fcampaign-3DStopka&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=2WcInuJGws6LmAzsP-5nTxbIG1tIwdT7MSCPAVWvuEU&e=>

[id:image002.png@01D32D81.76629680]<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.facebook.com_codilime_&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=MBa4dzY1dGi7b790FE86EbrXTyuXBlCU8xb6yOcFBro&e=> [id:image003.png@01D32D81.76629680] <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.linkedin.com_company_codilime&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=GAyAbSN4dxoXjOmZccMCGTdTYe0NSxowYhDkPpJKncc&e=>  [id:image004.png@01D32D81.76629680] <https://urldefense.proofpoint.com/v2/url?u=https-3A__twitter.com_codilime&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=YCs4p-MkaxwqCTuFtGPg_4tJCmss4D1bnpbZTvqFKeQ&e=>

CodiLime Sp. z o.o. - Ltd. company with its registered office in Poland, 02-493 Warsaw, ul. Krancowa 5.
Registered by The District Court for the Capital City of Warsaw, XII Commercial Department of the National Court Register.
Entered into National Court Register under No. KRS 0000388871. Tax identification number (NIP) 5272657478. Statistical number (REGON) 142974628.



Od: Sandip Dey <<email address hidden><mailto:<email address hidden>>>
Data: poniedziałek, 20 sierpnia 2018 14:25
Do: Ram Yadav <<email address hidden><mailto:<email address hidden>>>, Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>, Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>
DW: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Temat: Re: steps to run sanity on vCenter local setup's

Hi Ram

We could not reproduce the problem in your setup.

Then we tried in our setup and its easily reproducible.Out of 3 vms, 2 did not get ips.

In your setup you have  contrail-master + vcenter Version 6.5.0.13000 Build 7515524

I am running  contrail ocata-5.0-168 + vcenter Version 6.5.0 Build 5705665

You can use my setup to compare if needed


https://10.204.217.246:9443/<https://urldefense.proofpoint.com/v2/url?u=https-3A__10.204.217.246-3A9443_&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=iA88TuxaTuC-Uxybid9Xq_THM5U-jl8uXiykS-qgcK4&e=>

username:<email address hidden><mailto:<email address hidden>>

password: Contrail123!



The config files are https://github.com/Juniper/contrail-tools/tree/R5.0/yamls/vcenter/c4_clutser/multi-interface<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Juniper_contrail-2Dtools_tree_R5.0_yamls_vcenter_c4-5Fclutser_multi-2Dinterface&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=206i3a-QFcQEDef4L1lorAXVdFeqGAGj6GRKvbejOQQ&e=>

Regards
Sandip

From: Sandip Dey <<email address hidden><mailto:<email address hidden>>>
Date: Monday, August 20, 2018 at 12:03 PM
To: Ram Yadav <<email address hidden><mailto:<email address hidden>>>, Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>, Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>
Cc: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Hi Ram

We are trying in your setup.Will let you know.

Regards
Sandip

From: Ram Yadav <<email address hidden><mailto:<email address hidden>>>
Date: Monday, August 20, 2018 at 11:58 AM
To: Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>, Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>
Cc: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Single ping test passed.

[root@ab0e1c12eb88 contrail-test]# python -m testtools.run scripts.vm_regression.test_vm_basic.TestBasicVMVN.test_ping_within_vn
Tests running...


2018-08-19 22:46:07,024 - INFO - Ping to IP 92.231.138.250 from VM ctest-vm1-09003512 passed
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] sudo: ping -s 56 -c 5 -W 1  92.231.138.252
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: PING 92.231.138.252 (92.231.138.252) 56(84) bytes of data.
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: 64 bytes from 92.231.138.252: icmp_req=1 ttl=64 time=0.967 ms
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: 64 bytes from 92.231.138.252: icmp_req=2 ttl=64 time=0.601 ms
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: 64 bytes from 92.231.138.252: icmp_req=3 ttl=64 time=0.938 ms
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: 64 bytes from 92.231.138.252: icmp_req=4 ttl=64 time=0.544 ms
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: 64 bytes from 92.231.138.252: icmp_req=5 ttl=64 time=0.769 ms
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out:
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: --- 92.231.138.252 ping statistics ---
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: 5 packets transmitted, 5 received, 0% packet loss, time 4000ms
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out: rtt min/avg/max/mdev = 0.544/0.763/0.967/0.174 ms
[ubuntu@169.254.0.7<mailto:ubuntu@169.254.0.7>] out:

2018-08-19 22:46:22,340 - INFO - Ping to IP 92.231.138.252 from VM ctest-vm3-08653530 passed
2018-08-19 22:46:22,341 - INFO - Deleting VM ctest-vm3-08653530
2018-08-19 22:46:26,430 - INFO - Deleting VM ctest-vm2-81074936
2018-08-19 22:46:30,578 - INFO - Deleting VM ctest-vm1-09003512
2018-08-19 22:46:34,666 - INFO - Deleting VN ctest-vn30-93720575
2018-08-19 22:46:39,465 - INFO - END TEST : test_ping_within_vn : PASSED[0:22:14]
2018-08-19 22:46:39,465 - INFO - --------------------------------------------------------------------------------

Ran 1 test in 1369.229s
OK

We are not able to recreate the DHCP issue.

Thanks,
Ram

From: Ram Yadav <<email address hidden><mailto:<email address hidden>>>
Date: Sunday, August 19, 2018 at 10:26 PM
To: Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>, Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>
Cc: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

I rebooted both contrailVM’s to get the IP back. But still the question remain what caused it.
Only thing run before getting into this state was sanity.

From: Ram Yadav <<email address hidden><mailto:<email address hidden>>>
Date: Sunday, August 19, 2018 at 10:19 PM
To: Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>, Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>
Cc: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Aswani,
Looks like the IP address for contrail VM got changed messed up.
Does the sanity run play around with contrailVM IP’s?
IP address got unassigned for both VM’s.

Thanks,
Ram

From: Ram Yadav <<email address hidden><mailto:<email address hidden>>>
Date: Sunday, August 19, 2018 at 10:08 PM
To: Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>, Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>
Cc: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Aswani,
In the same container I’m running single test case and it fails:
[root@a3s10 ~]# docker attach ab0e1c12eb88
[root@ab0e1c12eb88 contrail-test]# export PYTHONPATH=$PATH:$PWD:$PWD/fixtures:$PWD/scripts
[root@ab0e1c12eb88 contrail-test]# export TEST_CONFIG_FILE=contrail_test_input.yaml
[root@ab0e1c12eb88 contrail-test]# python -m testtools.run scripts.vm_regression.test_vm_basic.TestBasicVMVN.test_ping_within_vn
Tests running...
======================================================================
ERROR: setUpClass (scripts.vm_regression.test_vm_basic.TestBasicVMVN)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "scripts/vm_regression/test_vm_basic.py", line 27, in setUpClass
    super(TestBasicVMVN, cls).setUpClass()
  File "scripts/vm_regression/base.py", line 12, in setUpClass
    super(BaseVnVmTest, cls).setUpClass()
  File "test_v1.py", line 13, in setUpClass
    super(BaseTestCase_v1, cls).setUpClass()
  File "test.py", line 79, in setUpClass
    cls.inputs = ContrailTestInit(cls.input_file,logger = cls.logger)
  File "common/contrail_test_init.py", line 853, in __init__
    self.inputs = TestInputs(input_file, self.logger)
  File "tcutils/util.py", line 997, in __call__
    Singleton, cls).__call__(*args, **kwargs)
  File "common/contrail_test_init.py", line 102, in __init__
    self.parse_yml_file()
  File "common/contrail_test_init.py", line 450, in parse_yml_file
    self.parse_topo()
  File "common/contrail_test_init.py", line 302, in parse_topo
    hostname = self.run_cmd_on_server(host_data['host_ip'], 'hostname')
  File "common/contrail_test_init.py", line 834, in run_cmd_on_server
    shell_prefix=shell_prefix)
  File "tcutils/util.py", line 814, in run_cmd_on_server
    output = _run(updated_cmd, pty=pty)
  File "/usr/lib/python2.7/site-packages/fabric/network.py", line 633, in host_prompting_wrapper
    return func(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/fabric/operations.py", line 1095, in sudo
    stderr=stderr, timeout=timeout, shell_escape=shell_escape,
  File "/usr/lib/python2.7/site-packages/fabric/operations.py", line 909, in _run_command
    channel=default_channel(), command=wrapped_command, pty=pty,
  File "/usr/lib/python2.7/site-packages/fabric/state.py", line 387, in default_channel
    chan = _open_session()
  File "/usr/lib/python2.7/site-packages/fabric/state.py", line 379, in _open_session
    return connections[env.host_string].get_transport().open_session()
  File "/usr/lib/python2.7/site-packages/fabric/network.py", line 154, in __getitem__
    self.connect(key)
  File "/usr/lib/python2.7/site-packages/fabric/network.py", line 146, in connect
    user, host, port, cache=self, seek_gateway=seek_gateway)
  File "/usr/lib/python2.7/site-packages/fabric/network.py", line 559, in connect
    raise NetworkError(msg, e)
NetworkError: Timed out trying to connect to 10.84.16.23 (tried 1 time)

Ran 0 tests in 10.044s
FAILED (failures=1)



What could be the issue.
But similar ping test case passed in the sanity run.

Thanks,
Ram

From: Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>
Date: Saturday, August 18, 2018 at 9:44 AM
To: Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>, Ram Yadav <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>
Cc: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Sachin,

I triggered the sanity in the following container and its running now

[root@a3s10 ~]# docker attach ab0e1c12eb88

[root@ab0e1c12eb88 contrail-test]# bash -x run_tests.sh  -T vcenter --send-mail -U



2018-08-18 09:41:56,829 - INFO - ================================================================================

2018-08-18 09:41:56,829 - INFO - STARTING TEST    : test_contrail_alarms

2018-08-18 09:41:56,831 - INFO - TEST DESCRIPTION :  Test to check if alarms are present





2018-08-18 09:42:00,114 - INFO - Initial checks done. Running the testcase now

2018-08-18 09:42:00,115 - INFO -

2018-08-18 09:42:03,333 - INFO - END TEST : test_contrail_alarms : PASSED[0:00:07]

2018-08-18 09:42:03,334 - INFO - --------------------------------------------------------------------------------

2018-08-18 09:42:03,339 - INFO - ================================================================================

2018-08-18 09:42:03,339 - INFO - STARTING TEST    : test_contrail_status

2018-08-18 09:42:03,339 - INFO - TEST DESCRIPTION :  Test to verify that all services are running and active



Thanks,
Aswani Kumar

From: Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>
Date: Saturday, 18 August 2018 at 10:03 PM
To: Madhava Rao Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>, Ram Yadav <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>, Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>
Cc: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Ok. Single Sanity run passed.
2018-08-18 08:53:06,766 - INFO - END TEST : test_ping_within_vn : PASSED[0:26:42]
2018-08-18 08:53:06,766 - INFO - --------------------------------------------------------------------------------

But I’m trying to run complete Sanity using following command:
[root@ab0e1c12eb88 contrail-test]# ./run_tests.sh -T venter --send-mail -

The run was over immediately..
Sandip/ Sudhee, can you pls let us what the error is here ?

I have attached complete log to the mail. Relevant logs are included :

[root@10.84.16.10<mailto:root@10.84.16.10>] sudo: systemctl enable nfs-server.service
[root@10.84.16.10<mailto:root@10.84.16.10>] sudo: systemctl start nfs-server.service
[root@10.84.16.11<mailto:root@10.84.16.11>] run: vim-cmd hostsvc/vmotion/vnic_set vmk0
[root@10.84.16.12<mailto:root@10.84.16.12>] run: vim-cmd hostsvc/vmotion/vnic_set vmk0
Exception in thread Thread-8 (most likely raised during interpreter shutdown):Exception in thread Thread-3 (most likely raised during interpreter shutdown):
Traceback (most recent call last):
[localhost] local: rpm -q --queryformat '%{VERSION}-' contrail-test; rpm -q --queryformat '%{RELEASE}' contrail-test | awk -F'.' '{print $1}'
Exception in thread Thread-3 (most likely raised during interpreter shutdown):Generated report_details* file: report_details_2018_08_18_09_29_40.ini
could not change test cases names
could not change test cases names
Buildfile: /contrail-test/build.xml

junit-report:
   [delete] Deleting directory /contrail-test/report
[junitreport] Processing /contrail-test/report/TESTS-TestSuites.xml to /contrail-test/report/junit-noframes.html
[junitreport] Loading stylesheet /contrail-test/junit-noframes.xsl
[junitreport] Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property 'http://javax.xml.XMLConstants/property/accessExternalDTD<https://urldefense.proofpoint.com/v2/url?u=http-3A__javax.xml.XMLConstants_property_accessExternalDTD&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=EmR-z25iOQ-0SSLY-u7ktrsRIfY7SIazWdI-GfOlNGE&e=>' is not recognized.
[junitreport] Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.oracle.com_xml_jaxp_properties_entityExpansionLimit&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=bhOAS7-hcN53JWsjVeT_mkuuVL6GGcA81vbgag8SgQs&e=>' is not recognized.
[junitreport] Transform time: 324ms

BUILD SUCCESSFUL
Total time: 0 seconds
Generate HTML reports in report/ folder : report/junit-noframes.html
logs/tcutils.util.log
logs/tcutils.config.vcenter_verification.log
logs/__main__.log
logs/tcutils.collector.opserver_results.log
logs/introspect.log
logs/a3s10-tracebacks.log
logs/a3s10-ignored_tracebacks.log
logs/a3s10-traceback_parse_failures.log
logs/common.contrail_test_init.log
logs/testbasicvmvn.log
Converted log files to html files
[root@10.84.16.10<mailto:root@10.84.16.10>] put: tools/search-bt.py -> /tmp/search-bt.py
Traceback details will be in /tmp/a3s10-tracebacks.log
Ignored Traceback details will be in /tmp/a3s10-ignored_tracebacks.log
Traceback parse errors will be in /tmp/a3s10-traceback_parse_failures.log
Done looking for tracebacks
[root@10.84.16.10<mailto:root@10.84.16.10>] download: /contrail-test/logs/a3s10-tracebacks.log <- /tmp/a3s10-tracebacks.log

Warning: Local file /contrail-test/logs/a3s10-tracebacks.log already exists and is being overwritten.


Warning: get() encountered an exception while downloading '/tmp/a3s10-tracebacks.log'

Underlying exception:
    No such file

[root@10.84.16.10<mailto:root@10.84.16.10>] download: /contrail-test/logs/a3s10-ignored_tracebacks.log <- /tmp/a3s10-ignored_tracebacks.log

Warning: Local file /contrail-test/logs/a3s10-ignored_tracebacks.log already exists and is being overwritten.


Warning: get() encountered an exception while downloading '/tmp/a3s10-ignored_tracebacks.log'

Underlying exception:
    No such file

[root@10.84.16.10<mailto:root@10.84.16.10>] download: /contrail-test/logs/a3s10-traceback_parse_failures.log <- /tmp/a3s10-traceback_parse_failures.log

Warning: Local file /contrail-test/logs/a3s10-traceback_parse_failures.log already exists and is being overwritten.


Warning: get() encountered an exception while downloading '/tmp/a3s10-traceback_parse_failures.log'

Underlying exception:
    No such file

Exception in thread Thread-3 (most likely raised during interpreter shutdown):
Uploaded reports
Not all mail server details are available. Skipping mail send.
Sent mail to interested parties
[root@ab0e1c12eb88 contrail-test]#


Thanks,
Sachin
From: Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>
Date: Saturday, August 18, 2018 at 8:30 AM
To: Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>, Ram Yadav <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>, Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>
Cc: Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

After removing nfs-ds from ESXI hosts datastore, test is running now.
I will post the result once the tests are run.

Thanks
Sachin

From: Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>
Date: Saturday, August 18, 2018 at 4:15 AM
To: Ram Yadav <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>, Aswani Kumar Gaddam <<email address hidden><mailto:<email address hidden>>>
Cc: Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Hi Ram,

    Sandip had already mentioned that automation code expects that vcenter_vars.yaml has ‘server1’ only under ‘vcenter_servers’, anything else will result in error.

Change all occurrence of SRV1 in vcenter_vars.yaml to server1 and launch new test container using test_runner.sh
I tried and it got past that stage, but seeing below error, I don’t understand this, please check – the test container is ab0e1c12eb88

[root@ab0e1c12eb88 contrail-test]# python -m testtools.run scripts.vm_regression.test_vm_basic.TestBasicVMVN.test_ping_within_vn
:
:

[root@10.84.16.10<mailto:root@10.84.16.10>] out: Created symlink from /etc/systemd/system/multi-user.target.wants/nfs-server.service to /usr/lib/systemd/system/nfs-server.service.
[root@10.84.16.10<mailto:root@10.84.16.10>] out:

[root@10.84.16.10<mailto:root@10.84.16.10>] sudo: systemctl start nfs-server.service
======================================================================
ERROR: setUpClass (scripts.vm_regression.test_vm_basic.TestBasicVMVN)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "scripts/vm_regression/test_vm_basic.py", line 27, in setUpClass
    super(TestBasicVMVN, cls).setUpClass()
  File "scripts/vm_regression/base.py", line 12, in setUpClass
    super(BaseVnVmTest, cls).setUpClass()
  File "test_v1.py", line 38, in setUpClass
    cls.admin_isolated_creds.setUp()
  File "common/isolated_creds.py", line 132, in setUp
    password=self.password)
  File "common/connections.py", line 68, in __init__
    self.vnc_lib = self.get_vnc_lib_h()
  File "common/connections.py", line 167, in get_vnc_lib_h
    env[attr].setUp()
  File "/contrail-test/fixtures/vnc_api_test.py", line 113, in setUp
    if self.orch:
  File "/contrail-test/fixtures/vnc_api_test.py", line 178, in orch
    self._orch = self.get_orch_h()
  File "/contrail-test/fixtures/vnc_api_test.py", line 201, in get_orch_h
    logger=self.logger)
  File "/contrail-test/fixtures/vcenter.py", line 144, in __init__
    self._nfs_ds = NFSDatastore(self._inputs, self)
  File "tcutils/util.py", line 997, in __call__
    Singleton, cls).__call__(*args, **kwargs)
  File "/contrail-test/fixtures/vcenter.py", line 92, in __init__
    host.configManager.datastoreSystem.CreateNasDatastore(spec)
  File "/usr/lib/python2.7/site-packages/pyVmomi/VmomiSupport.py", line 580, in <lambda>
    self.f(*(self.args + (obj,) + args), **kwargs)
  File "/usr/lib/python2.7/site-packages/pyVmomi/VmomiSupport.py", line 386, in _InvokeMethod
    return self._stub.InvokeMethod(self, info, args)
  File "/usr/lib/python2.7/site-packages/pyVmomi/SoapAdapter.py", line 1366, in InvokeMethod
    raise obj # pylint: disable-msg=E0702
vim.fault.DuplicateName: (vim.fault.DuplicateName) {
   dynamicType = <unset>,
   dynamicProperty = (vmodl.DynamicProperty) [],
   msg = "The name 'nfs-ds' already exists.",
   faultCause = <unset>,
   faultMessage = (vmodl.LocalizableMessage) [],
   name = 'nfs-ds',
   object = 'vim.Datastore:10.84.16.10:/nfs'
}

Ran 0 tests in 25.285s
FAILED (failures=1)


Thanks,
Sudhee.

From: Ram Yadav <<email address hidden><mailto:<email address hidden>>>
Date: Saturday, 18 August 2018 at 6:21 AM
To: Sandip Dey <<email address hidden><mailto:<email address hidden>>>
Cc: Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>, Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>, Sudheendra Rao <<email address hidden><mailto:<email address hidden>>>, Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Subject: Re: steps to run sanity on vCenter local setup's

Hi Sandip,
I pulled in the docker image:
contrail-test-test:master-221

And followed the steps for single sanity test case run.
I’m getting the following error:

ERROR: setUpClass (scripts.vm_regression.test_vm_basic.TestBasicVMVN)

----------------------------------------------------------------------

Traceback (most recent call last):

  File "scripts/vm_regression/test_vm_basic.py", line 27, in setUpClass

    super(TestBasicVMVN, cls).setUpClass()

  File "scripts/vm_regression/base.py", line 12, in setUpClass

    super(BaseVnVmTest, cls).setUpClass()

  File "test_v1.py", line 13, in setUpClass

    super(BaseTestCase_v1, cls).setUpClass()

  File "test.py", line 79, in setUpClass

    cls.inputs = ContrailTestInit(cls.input_file,logger = cls.logger)

  File "common/contrail_test_init.py", line 853, in __init__

    self.inputs = TestInputs(input_file, self.logger)

  File "tcutils/util.py", line 997, in __call__

    Singleton, cls).__call__(*args, **kwargs)

  File "common/contrail_test_init.py", line 102, in __init__

    self.parse_yml_file()

  File "common/contrail_test_init.py", line 589, in parse_yml_file

    self.vcenter_dc = _parse_vcenter.vcenter_dc

  File "common/contrail_test_init.py", line 1466, in vcenter_dc




















Test container is spawned on 10.84.16.10.

/root/contrail-ansible-deployer has the contrail_test_input.yml and vcenter_vars.yml











Thanks,

Ram










From: Ram Yadav <<email address hidden><mailto:<email address hidden>>>
Date: Tuesday, August 14, 2018 at 4:31 PM
To: Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Cc: Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>, Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>
Subject: steps to run sanity on vCenter local setup's

Hello,

Below is the instruction to run sanity

1.wget https://github.com/Juniper/contrail-test/raw/master/testrunner.sh<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Juniper_contrail-2Dtest_raw_master_testrunner.sh&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=VYk9euXis0vzLBQwvN2IJlIaI_uMIC5tJyJ6-FcljjI&e=>
2.docker pull 10.204.217.152:5000/contrail-test-test:ocata-5.0-<build-id>
3../testrunner.sh run -s -P contrail_test_input.yml,vcenter_vars.yml 10.204.217.152:5000/contrail-test-test:ocata-5.0-<build-id>
4.cd contrail-test
5.export TEST_CONFIG_FILE=contrail_test_input_useit.yaml
6./run_tests.sh -T venter --send-mail -













To run a single test case
1.wget https://github.com/Juniper/contrail-test/raw/master/testrunner.sh<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Juniper_contrail-2Dtest_raw_master_testrunner.sh&d=DwMFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=b7PJzRwbDQaU6gBbFUYQ2YG2JQ38BVg-K_abJhaqVYI&m=tyJaHogLeLlbq3r0o8Eqv7PnQ2hklWrz2GhiR-qPhOU&s=VYk9euXis0vzLBQwvN2IJlIaI_uMIC5tJyJ6-FcljjI&e=>
2.docker pull 10.204.217.152:5000/contrail-test-test:ocata-5.0-<build-id>
3../testrunner.sh run -s -P contrail_test_input.yml,vcenter_vars.yml 10.204.217.152:5000/contrail-test-test:ocata-5.0-<build-id>
4.cd contrail-test
5.export PYTHONPATH=$PATH:$PWD:$PWD/fixtures:$PWD/scripts
6.export TEST_CONFIG_FILE=contrail_test_input_useit.yaml
7.python -m testtools.run scripts.vm_regression.test_vm_basic.TestBasicVMVN.test_ping_within_vn

Docker pull needs to be done on ci-repo.englab.juniper.net or local repo as mentioned in the above step which is Bangalore local repo.

Apart from this you will need set of vmdk file which was copied by Sandip Dey at some sunnyvale location.

Sandip,
Can provide detail on the file’s that we need to copy say to codilime’s server locally for sanity to run on there setup?

Thanks,
Ram


[X]

-------------------------------
The information in this email is confidential and may be legally privileged, it may contain information that is confidential in CodiLime Sp. z o. o. It is intended solely for the addressee. Any access to this email by third parties is unauthorized. If you are not the intended recipient of this message, any disclosure, copying, distribution or any action undertaken or neglected in reliance thereon is prohibited and may result in your liability for damages.