Ram,

All testcases failed due to vn_verifications in collector has failed
Your setup is not intact
We will try to reproduce the dhcp issue on your setup

Setup is not intact
== Contrail database ==
kafka: active
nodemgr: initializing (Disk for DB is too low. )
zookeeper: active
cassandra: active

== Contrail analytics ==
snmp-collector: active
query-engine: active
api: initializing (Redis-UVE:10.84.16.10:6379[None] connection down)
alarm-gen: initializing (Redis-UVE:10.84.16.10:6379[None] connection down)
nodemgr: active
collector: active
topology: active

2018-08-18 11:48:01,489 - DEBUG - Verifying the vn in opserver
2018-08-18 11:48:01,489 - DEBUG - Verifying the default-domain:vCenter:VN1 virtual network link  through opserver 10.84.16.10
2018-08-18 11:48:04,496 - DEBUG - Verifying the default-domain:vCenter:VN1 virtual network link  through opserver 10.84.16.10
2018-08-18 11:48:46,756 - ERROR - One or more verifications in OpServer for VN VN1 failed
2018-08-18 11:48:46,761 - INFO - Deleting VN VN3
2018-08-18 11:48:46,884 - INFO - Deleting VN VN2

Thanks,
Aswani Kumar

From: Madhava Rao Sudheendra Rao <email address hidden>
Date: Monday, 20 August 2018 at 11:10 AM
To: Ram Yadav <email address hidden>, Sachchidanand Vaidya <email address hidden>, Aswani Kumar Gaddam <email address hidden>, Sandip Dey <email address hidden>
Cc: Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Hi Ram,

   We are checking the logs, will get back to you with the analysis.

Thanks,
Sudhee.

From: Ram Yadav <email address hidden>
Date: Monday, 20 August 2018 at 10:03 AM
To: Sachchidanand Vaidya <email address hidden>, Aswani Kumar Gaddam <email address hidden>, Sudheendra Rao <email address hidden>, Sandip Dey <email address hidden>
Cc: Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Looks like there are many failures in sanity, but could be setup issue.
For our immediate concern of reproducing the DHCP issue with vlan override I’m unable to reproduce the issue in my setup.

Below are sanity test report from my setup.
Hi Sudhee,
Can you have someone from your team replicate the DHCP issue on my setup?
Also can someone look at the cause of the sanity test cases failure and see what are due to setup and which are genuine?

Thanks,
Ram

Test Results

Designed for use with JUnit<http://www.junit.org> and Ant<http://jakarta.apache.org/ant>.

________________________________
Properties
Build : 5.1.0-241
cores : {'10.84.16.10': [], '10.84.16.24': [], '10.84.16.23': []}
LogsLocation : http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/
Report : http://None/None/5.1.0-241_2018_08_18_09_41_28/junit-noframes.html
Topology :
DISTRO : CentOS Linux release 7.5.1804 Core
SKU :
Config Nodes : ['a3s10']
Control Nodes : ['a3s10']
Compute Nodes : ['a3s11vrouter', 'a3s11vrouter12']
WebUI Node : ['a3s10']
Analytics Nodes : ['a3s10']
Database Nodes : ['a3s10']
Physical Devices : [u'']



________________________________
Summary
Tests

Failures

Errors

Skipped

Success rate

Time

61

43

0

10

15.69%

21983.085


Note: failures are anticipated and checked for with assertions while errors are unanticipated.

________________________________
Packages
Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.
Name

Tests

Errors

Failures

Skipped

Time(s)


61

0

43

10

21983.085

________________________________
Package
Name

Tests

Errors

Failures

Skipped

Time(s)


11

0

7

3

6194.420

scripts<file:///Users/ryadav/Documents/work/junit-noframes.html#scripts>

50

0

36

7

15788.665

Back to top<file:///Users/ryadav/Documents/work/junit-noframes.html#top>
________________________________
TestCase
Name

Status

Type

Time(s)

LogFile

.setUpClass (serial_scripts.analytics.test_analytics_resource.AnalyticsTestSanityWithMin)

Failure

Details

0.000

Log File

.setUpClass (serial_scripts.analytics.test_analytics_resource.AnalyticsTestSanityWithResource)

Failure

Details

0.000

Log File

TestEncapCases.test_apply_policy_fip_on_same_vn_gw_mx[sanity,serial,vcenter]

Skipped

Skipping Test. Env variable MX_TEST is not set. Skipping the testSkipping Test. Env variable MX_TEST is not set. Skipping the test

6.933

TestEvpnCasesRestart.test_with_vxlan_encap_agent_restart[sanity,serial,vcenter,vcenter_compute]

Failure

Details

1006.328

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testevpncasesrestart.html#test_with_vxlan_encap_agent_restart>

TestFirewallBasic.test_global_scope[sanity,vcenter]

Success

216.315

TestSerialSanity_MX.test_change_of_rt_in_vn[mx_test,sanity,serial,vcenter,vcenter_compute]

Skipped

Skipping Test. Env variable MX_GW_TEST is not setSkipping Test. Env variable MX_GW_TEST is not set

7.291

TestGWLessFWD.test_gw_less_fwd_single_vn_ip_fab[cb_sanity,sanity,vcenter]

Skipped

Skipping Test. Fabric gateway is required to run the testSkipping Test. Fabric gateway is required to run the test

7.318

TestVcenterSerial.test_vcenter_compute_vm_reboot[vcenter]

Failure

Details

695.222

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testvcenterserial.html#test_vcenter_compute_vm_reboot>

TestVcenterSerial.test_vcenter_plugin_restart[vcenter]

Failure

Details

78.683

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testvcenterserial.html#test_vcenter_plugin_restart>

TestVcenterSerial.test_vcenter_vrouter_agent_restart[vcenter]

Failure

Details

720.838

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testvcenterserial.html#test_vcenter_vrouter_agent_restart>

TestBasicVMVN0.test_underlay_broadcast_traffic_handling[sanity,vcenter,vcenter_compute]

Failure

Details

42.442

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testbasicvmvn0.html#test_underlay_broadcast_traffic_handling>

Properties »
Back to top<file:///Users/ryadav/Documents/work/junit-noframes.html#top>
TestCase scripts
Name

Status

Type

Time(s)

LogFile

AnalyticsTestSanity.test_contrail_alarms[vcenter]

Success

6.825

AnalyticsTestSanity.test_contrail_status[cb_sanity,ci_sanity,sanity,vcenter,vcenter_compute]

Failure

Details

17.174

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/analyticstestsanity.html#test_contrail_status>

AnalyticsTestSanity3.test_db_nodemgr_status[sanity,vcenter,vcenter_compute]

Failure

Details

66.543

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/analyticstestsanity3.html#test_db_nodemgr_status>

AnalyticsTestSanity3.test_verify_generator_collector_connections[sanity,vcenter,vcenter_compute]

Failure

Details

568.749

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/analyticstestsanity3.html#test_verify_generator_collector_connections>

AnalyticsTestSanity3.test_verify_generator_connections_to_collector_node[sanity,vcenter]

Failure

Details

77.214

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/analyticstestsanity3.html#test_verify_generator_connections_to_collector_node>

AnalyticsTestSanity3.test_verify_process_status_agent[cb_sanity,sanity,vcenter,vcenter_compute]

Failure

Details

6.539

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/analyticstestsanity3.html#test_verify_process_status_agent>

AnalyticsTestSanity3.test_verify_process_status_analytics_node[cb_sanity,sanity,vcenter,vcenter_compute]

Failure

Details

6.325

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/analyticstestsanity3.html#test_verify_process_status_analytics_node>

AnalyticsTestSanity3.test_verify_process_status_config[cb_sanity,sanity,vcenter,vcenter_compute]

Failure

Details

6.641

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/analyticstestsanity3.html#test_verify_process_status_config>

AnalyticsTestSanity3.test_verify_process_status_control_node[cb_sanity,sanity,vcenter,vcenter_compute]

Failure

Details

6.976

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/analyticstestsanity3.html#test_verify_process_status_control_node>

AnalyticsBasicTestSanity.test_verify_object_logs[ci_sanity,sanity,suite1,vcenter,vcenter_compute]

Success

321.308

TestECMPConfigHashFeature.test_ecmp_hash_src_ip[sanity,vcenter]

Skipped

Skipped as test requires at least 3 nodes, but only 2 foundSkipped as test requires at least 3 nodes, but only 2 found

6.721

TestECMPFeature.test_ecmp_svc_v2_in_network_nat_with_3_instance[cb_sanity,sanity,vcenter]

Skipped

Skipped as test requires at least 3 nodes, but only 2 foundSkipped as test requires at least 3 nodes, but only 2 found

6.637

TestECMPSanity.test_ecmp_svc_in_network_with_static_route_no_policy[sanity,vcenter]

Failure

Details

44.476

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testecmpsanity.html#test_ecmp_svc_in_network_with_static_route_no_policy>

TestECMPwithSVMChange.test_ecmp_with_svm_deletion[sanity,vcenter]

Skipped

Skipped as test requires at least 3 nodes, but only 2 foundSkipped as test requires at least 3 nodes, but only 2 found

6.596

TestMultiInlineSVC.test_svc_fate_sharing_basic[sanity,vcenter]

Failure

Details

30.847

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testmultiinlinesvc.html#test_svc_fate_sharing_basic>

TestMultiInlineSVC.test_three_stage_v2_SC[sanity,vcenter]

Skipped

Skipped as test requires at least 3 nodes, but only 2 foundSkipped as test requires at least 3 nodes, but only 2 found

6.539

FloatingipBasicTestSanity.test_floating_ip[cb_sanity,ci_sanity,quick_sanity,sanity,suite1,vcenter,vcenter_compute,vrouter_gw]

Failure

Details

77.229

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/floatingipbasictestsanity.html#test_floating_ip>

TestSanity_MX.test_mx_gateway[mx_test,sanity,vcenter,vcenter_compute]

Skipped

Skipping Test. Env variable MX_GW_TEST is not setSkipping Test. Env variable MX_GW_TEST is not set

6.751

TestLBaaSV2.test_lbaas_with_different_fip[cb_sanity,sanity,vcenter]

Failure

Details

2093.910

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testlbaasv2.html#test_lbaas_with_different_fip>

TestPolicyAcl.test_policy_cidr_src_cidr_dst_any[cb_sanity,sanity,vcenter,vcenter_compute]

Failure

Details

141.050

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testpolicyacl.html#test_policy_cidr_src_cidr_dst_any>

TestPolicyAcl.test_policy_cidr_src_vn_dst_cidr[cb_sanity,vcenter]

Failure

Details

136.480

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testpolicyacl.html#test_policy_cidr_src_vn_dst_cidr>

TestPolicyAcl.test_policy_inheritance_src_pol_dst_any[cb_sanity,vcenter]

Failure

Details

141.221

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testpolicyacl.html#test_policy_inheritance_src_pol_dst_any>

TestPolicyAcl.test_policy_inheritance_src_vn_dst_pol[cb_sanity,sanity,vcenter,vcenter_compute,vrouter_gw]

Failure

Details

135.402

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testpolicyacl.html#test_policy_inheritance_src_vn_dst_pol>

TestBasicPolicy.test_policy[suite1,vcenter]

Failure

Details

77.560

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testbasicpolicy.html#test_policy>

TestBasicPolicyModify.test_policy_modify_vn_policy[suite1,vcenter]

Failure

Details

79.790

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testbasicpolicymodify.html#test_policy_modify_vn_policy>

TestBasicPolicyNegative.test_remove_policy_with_ref[suite1,vcenter]

Failure

Details

78.383

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testbasicpolicynegative.html#test_remove_policy_with_ref>

TestDetailedPolicy0.test_repeated_policy_modify[suite1,vcenter]

Failure

Details

79.832

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testdetailedpolicy0.html#test_repeated_policy_modify>

TestDetailedPolicy1.test_multi_vn_repeated_policy_update_with_ping[sanity,vcenter]

Failure

Details

81.838

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testdetailedpolicy1.html#test_multi_vn_repeated_policy_update_with_ping>

TestDetailedPolicy1Ipv4v6.test_multi_vn_repeated_policy_update_with_ping[sanity,vcenter]

Skipped

Skipping IPv6 Test on vcenter setupSkipping IPv6 Test on vcenter setup

7.389

TestBasicRTFilter.test_user_def_rt_entry[cb_sanity,sanity,vcenter,vcenter_compute]

Failure

Details

78.341

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testbasicrtfilter.html#test_user_def_rt_entry>

SecurityGroupBasicRegressionTests1_contrail.test_sec_group_basic[sanity,suite1,vcenter]

Failure

Details

81.171

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/securitygroupbasicregressiontests1_contrail.html#test_sec_group_basic>

SecurityGroupBasicRegressionTests1.test_sec_group_basic[cb_sanity,ci_sanity,sanity,suite1,vcenter]

Failure

Details

81.196

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/securitygroupbasicregressiontests1.html#test_sec_group_basic>

TestStaticRouteTables.test_interface_static_table[sanity,vcenter]

Success

1571.197

TestStaticRouteTables.test_network_route_table[cb_sanity,sanity,vcenter]

Success

966.079

TestSvcRegr.test_svc_in_net_nat_with_static_routes[sanity,vcenter]

Failure

Details

496.756

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testsvcregr.html#test_svc_in_net_nat_with_static_routes>

TestSvcRegr.test_svc_in_network_datapath[ci_sanity,vcenter]

Failure

Details

77.732

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testsvcregr.html#test_svc_in_network_datapath>

TestSvcRegr.test_svc_in_network_datapath[ci_sanity_WIP,quick_sanity,sanity,suite1,vcenter,vcenter_compute]

Failure

Details

75.806

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testsvcregr.html#test_svc_in_network_datapath>

TestSvcHC.test_svc_hc_basic[sanity,vcenter]

Failure

Details

77.918

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testsvchc.html#test_svc_hc_basic>

TestvDNSBasic0.test_vdns_ping_same_vn[sanity,suite1,vcenter,vcenter_compute]

Success

1055.953

TestVcenter.test_vcenter_static_ip[vcenter]

Failure

Details

80.265

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testvcenter.html#test_vcenter_static_ip>

TestVcenter.test_vcenter_vm_interface_change[vcenter]

Failure

Details

76.299

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testvcenter.html#test_vcenter_vm_interface_change>

TestVcenter.test_vcenter_vm_moveout_and_backin[vcenter]

Failure

Details

77.937

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testvcenter.html#test_vcenter_vm_moveout_and_backin>

TestVcenter2.test_vcenter_vm_migrate[vcenter]

Failure

Details

75.818

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testvcenter2.html#test_vcenter_vm_migrate>

TestVcenter2.test_vcenter_vm_on_diff_host[vcenter]

Failure

Details

78.279

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testvcenter2.html#test_vcenter_vm_on_diff_host>

TestVcenter3.test_vcenter_vm_on_diff_cluster[vcenter]

Skipped

Skipping Test. Require more than cluster in the setupSkipping Test. Require more than cluster in the setup

7.353

TestBasicVMVNx.test_vm_file_trf_tftp_tests[sanity,vcenter,vcenter_compute,vrouter_gw]

Failure

Details

78.065

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testbasicvmvnx.html#test_vm_file_trf_tftp_tests>

TestBasicVMVN.test_generic_link_local_service[cb_sanity,ci_sanity,sanity,suite1,vcenter,vcenter_compute]

Success

824.422

TestBasicVMVN.test_ping_within_vn[suite1,vcenter,vcenter_compute,vrouter_gw]

Success

1200.122

TestBasicVMVN.test_vm_add_delete[suite1,vcenter]

Failure

Details

80.208

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testbasicvmvn.html#test_vm_add_delete>

TestBasicVMVN.test_vn_add_delete[suite1,vcenter]

Failure

Details

75.984

Log File<http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/testbasicvmvn.html#test_vn_add_delete>




From: Sachchidanand Vaidya <email address hidden>
Date: Saturday, August 18, 2018 at 5:55 PM
To: Ram Yadav <email address hidden>, Aswani Kumar Gaddam <email address hidden>, Sudheendra Rao <email address hidden>, Sandip Dey <email address hidden>
Cc: Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Ram,
   Did this test-case always use to fail ?
 Can you run this test in a loop and see if it fails.
Also Aswini has started all Sanity tests, how many have failed ? Did some of them has passed last time we ran with Centralized plugin ?

Thanks,
Sachin
From: Ram Yadav <email address hidden>
Date: Saturday, August 18, 2018 at 3:20 PM
To: Sachchidanand Vaidya <email address hidden>, Aswani Kumar Gaddam <email address hidden>, Sudheendra Rao <email address hidden>, Sandip Dey <email address hidden>
Cc: Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Looks like the basic ping between VM within a VN are passing on my setup.
This testcase used to fail on Sandip Dey setup since not all VM’s used to get IP’s.
So we are not able to re-produce the DHCP issue.
This setup is using distributed plugin from build master-221.

Sandip,
Can you look at this setup and try to recreate DHCP issue?

Thanks,
Ram

From: Sachchidanand Vaidya <email address hidden>
Date: Saturday, August 18, 2018 at 12:09 PM
To: Aswani Kumar Gaddam <email address hidden>, Sudheendra Rao <email address hidden>, Ram Yadav <email address hidden>, Sandip Dey <email address hidden>
Cc: Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Thanks Aswani. How did you get it to work ?

Is it the command “ bash -x run_tests.sh  -T vcenter --send-mail -U”

Thanks,
Sachin
From: Aswani Kumar Gaddam <email address hidden>
Date: Saturday, August 18, 2018 at 9:44 AM
To: Sachchidanand Vaidya <email address hidden>, Sudheendra Rao <email address hidden>, Ram Yadav <email address hidden>, Sandip Dey <email address hidden>
Cc: Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Sachin,

I triggered the sanity in the following container and its running now

[root@a3s10 ~]# docker attach ab0e1c12eb88

[root@ab0e1c12eb88 contrail-test]# bash -x run_tests.sh  -T vcenter --send-mail -U



2018-08-18 09:41:56,829 - INFO - ================================================================================

2018-08-18 09:41:56,829 - INFO - STARTING TEST    : test_contrail_alarms

2018-08-18 09:41:56,831 - INFO - TEST DESCRIPTION :  Test to check if alarms are present





2018-08-18 09:42:00,114 - INFO - Initial checks done. Running the testcase now

2018-08-18 09:42:00,115 - INFO -

2018-08-18 09:42:03,333 - INFO - END TEST : test_contrail_alarms : PASSED[0:00:07]

2018-08-18 09:42:03,334 - INFO - --------------------------------------------------------------------------------

2018-08-18 09:42:03,339 - INFO - ================================================================================

2018-08-18 09:42:03,339 - INFO - STARTING TEST    : test_contrail_status

2018-08-18 09:42:03,339 - INFO - TEST DESCRIPTION :  Test to verify that all services are running and active



Thanks,
Aswani Kumar

From: Sachchidanand Vaidya <email address hidden>
Date: Saturday, 18 August 2018 at 10:03 PM
To: Madhava Rao Sudheendra Rao <email address hidden>, Ram Yadav <email address hidden>, Sandip Dey <email address hidden>, Aswani Kumar Gaddam <email address hidden>
Cc: Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Ok. Single Sanity run passed.
2018-08-18 08:53:06,766 - INFO - END TEST : test_ping_within_vn : PASSED[0:26:42]
2018-08-18 08:53:06,766 - INFO - --------------------------------------------------------------------------------

But I’m trying to run complete Sanity using following command:
[root@ab0e1c12eb88 contrail-test]# ./run_tests.sh -T venter --send-mail -

The run was over immediately..
Sandip/ Sudhee, can you pls let us what the error is here ?

I have attached complete log to the mail. Relevant logs are included :

[root@10.84.16.10] sudo: systemctl enable nfs-server.service
[root@10.84.16.10] sudo: systemctl start nfs-server.service
[root@10.84.16.11] run: vim-cmd hostsvc/vmotion/vnic_set vmk0
[root@10.84.16.12] run: vim-cmd hostsvc/vmotion/vnic_set vmk0
Exception in thread Thread-8 (most likely raised during interpreter shutdown):Exception in thread Thread-3 (most likely raised during interpreter shutdown):
Traceback (most recent call last):
[localhost] local: rpm -q --queryformat '%{VERSION}-' contrail-test; rpm -q --queryformat '%{RELEASE}' contrail-test | awk -F'.' '{print $1}'
Exception in thread Thread-3 (most likely raised during interpreter shutdown):Generated report_details* file: report_details_2018_08_18_09_29_40.ini
could not change test cases names
could not change test cases names
Buildfile: /contrail-test/build.xml

junit-report:
   [delete] Deleting directory /contrail-test/report
[junitreport] Processing /contrail-test/report/TESTS-TestSuites.xml to /contrail-test/report/junit-noframes.html
[junitreport] Loading stylesheet /contrail-test/junit-noframes.xsl
[junitreport] Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property 'http://javax.xml.XMLConstants/property/accessExternalDTD' is not recognized.
[junitreport] Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized.
[junitreport] Transform time: 324ms

BUILD SUCCESSFUL
Total time: 0 seconds
Generate HTML reports in report/ folder : report/junit-noframes.html
logs/tcutils.util.log
logs/tcutils.config.vcenter_verification.log
logs/__main__.log
logs/tcutils.collector.opserver_results.log
logs/introspect.log
logs/a3s10-tracebacks.log
logs/a3s10-ignored_tracebacks.log
logs/a3s10-traceback_parse_failures.log
logs/common.contrail_test_init.log
logs/testbasicvmvn.log
Converted log files to html files
[root@10.84.16.10] put: tools/search-bt.py -> /tmp/search-bt.py
Traceback details will be in /tmp/a3s10-tracebacks.log
Ignored Traceback details will be in /tmp/a3s10-ignored_tracebacks.log
Traceback parse errors will be in /tmp/a3s10-traceback_parse_failures.log
Done looking for tracebacks
[root@10.84.16.10] download: /contrail-test/logs/a3s10-tracebacks.log <- /tmp/a3s10-tracebacks.log

Warning: Local file /contrail-test/logs/a3s10-tracebacks.log already exists and is being overwritten.


Warning: get() encountered an exception while downloading '/tmp/a3s10-tracebacks.log'

Underlying exception:
    No such file

[root@10.84.16.10] download: /contrail-test/logs/a3s10-ignored_tracebacks.log <- /tmp/a3s10-ignored_tracebacks.log

Warning: Local file /contrail-test/logs/a3s10-ignored_tracebacks.log already exists and is being overwritten.


Warning: get() encountered an exception while downloading '/tmp/a3s10-ignored_tracebacks.log'

Underlying exception:
    No such file

[root@10.84.16.10] download: /contrail-test/logs/a3s10-traceback_parse_failures.log <- /tmp/a3s10-traceback_parse_failures.log

Warning: Local file /contrail-test/logs/a3s10-traceback_parse_failures.log already exists and is being overwritten.


Warning: get() encountered an exception while downloading '/tmp/a3s10-traceback_parse_failures.log'

Underlying exception:
    No such file

Exception in thread Thread-3 (most likely raised during interpreter shutdown):
Uploaded reports
Not all mail server details are available. Skipping mail send.
Sent mail to interested parties
[root@ab0e1c12eb88 contrail-test]#


Thanks,
Sachin
From: Sachchidanand Vaidya <email address hidden>
Date: Saturday, August 18, 2018 at 8:30 AM
To: Sudheendra Rao <email address hidden>, Ram Yadav <email address hidden>, Sandip Dey <email address hidden>, Aswani Kumar Gaddam <email address hidden>
Cc: Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

After removing nfs-ds from ESXI hosts datastore, test is running now.
I will post the result once the tests are run.

Thanks
Sachin

From: Sudheendra Rao <email address hidden>
Date: Saturday, August 18, 2018 at 4:15 AM
To: Ram Yadav <email address hidden>, Sandip Dey <email address hidden>, Aswani Kumar Gaddam <email address hidden>
Cc: Sachchidanand Vaidya <email address hidden>, Marcin Orkiszewski <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Hi Ram,

    Sandip had already mentioned that automation code expects that vcenter_vars.yaml has ‘server1’ only under ‘vcenter_servers’, anything else will result in error.

Change all occurrence of SRV1 in vcenter_vars.yaml to server1 and launch new test container using test_runner.sh
I tried and it got past that stage, but seeing below error, I don’t understand this, please check – the test container is ab0e1c12eb88

[root@ab0e1c12eb88 contrail-test]# python -m testtools.run scripts.vm_regression.test_vm_basic.TestBasicVMVN.test_ping_within_vn
:
:

[root@10.84.16.10] out: Created symlink from /etc/systemd/system/multi-user.target.wants/nfs-server.service to /usr/lib/systemd/system/nfs-server.service.
[root@10.84.16.10] out:

[root@10.84.16.10] sudo: systemctl start nfs-server.service
======================================================================
ERROR: setUpClass (scripts.vm_regression.test_vm_basic.TestBasicVMVN)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "scripts/vm_regression/test_vm_basic.py", line 27, in setUpClass
    super(TestBasicVMVN, cls).setUpClass()
  File "scripts/vm_regression/base.py", line 12, in setUpClass
    super(BaseVnVmTest, cls).setUpClass()
  File "test_v1.py", line 38, in setUpClass
    cls.admin_isolated_creds.setUp()
  File "common/isolated_creds.py", line 132, in setUp
    password=self.password)
  File "common/connections.py", line 68, in __init__
    self.vnc_lib = self.get_vnc_lib_h()
  File "common/connections.py", line 167, in get_vnc_lib_h
    env[attr].setUp()
  File "/contrail-test/fixtures/vnc_api_test.py", line 113, in setUp
    if self.orch:
  File "/contrail-test/fixtures/vnc_api_test.py", line 178, in orch
    self._orch = self.get_orch_h()
  File "/contrail-test/fixtures/vnc_api_test.py", line 201, in get_orch_h
    logger=self.logger)
  File "/contrail-test/fixtures/vcenter.py", line 144, in __init__
    self._nfs_ds = NFSDatastore(self._inputs, self)
  File "tcutils/util.py", line 997, in __call__
    Singleton, cls).__call__(*args, **kwargs)
  File "/contrail-test/fixtures/vcenter.py", line 92, in __init__
    host.configManager.datastoreSystem.CreateNasDatastore(spec)
  File "/usr/lib/python2.7/site-packages/pyVmomi/VmomiSupport.py", line 580, in <lambda>
    self.f(*(self.args + (obj,) + args), **kwargs)
  File "/usr/lib/python2.7/site-packages/pyVmomi/VmomiSupport.py", line 386, in _InvokeMethod
    return self._stub.InvokeMethod(self, info, args)
  File "/usr/lib/python2.7/site-packages/pyVmomi/SoapAdapter.py", line 1366, in InvokeMethod
    raise obj # pylint: disable-msg=E0702
vim.fault.DuplicateName: (vim.fault.DuplicateName) {
   dynamicType = <unset>,
   dynamicProperty = (vmodl.DynamicProperty) [],
   msg = "The name 'nfs-ds' already exists.",
   faultCause = <unset>,
   faultMessage = (vmodl.LocalizableMessage) [],
   name = 'nfs-ds',
   object = 'vim.Datastore:10.84.16.10:/nfs'
}

Ran 0 tests in 25.285s
FAILED (failures=1)


Thanks,
Sudhee.

From: Ram Yadav <email address hidden>
Date: Saturday, 18 August 2018 at 6:21 AM
To: Sandip Dey <email address hidden>
Cc: Sachchidanand Vaidya <email address hidden>, Sandip Dey <email address hidden>, Marcin Orkiszewski <email address hidden>, Sudheendra Rao <email address hidden>, Adrian Szczepański <email address hidden>, Amudha R <email address hidden>
Subject: Re: steps to run sanity on vCenter local setup's

Hi Sandip,
I pulled in the docker image:
contrail-test-test:master-221

And followed the steps for single sanity test case run.
I’m getting the following error:

ERROR: setUpClass (scripts.vm_regression.test_vm_basic.TestBasicVMVN)

----------------------------------------------------------------------

Traceback (most recent call last):

  File "scripts/vm_regression/test_vm_basic.py", line 27, in setUpClass

    super(TestBasicVMVN, cls).setUpClass()

  File "scripts/vm_regression/base.py", line 12, in setUpClass

    super(BaseVnVmTest, cls).setUpClass()

  File "test_v1.py", line 13, in setUpClass

    super(BaseTestCase_v1, cls).setUpClass()

  File "test.py", line 79, in setUpClass

    cls.inputs = ContrailTestInit(cls.input_file,logger = cls.logger)

  File "common/contrail_test_init.py", line 853, in __init__

    self.inputs = TestInputs(input_file, self.logger)

  File "tcutils/util.py", line 997, in __call__

    Singleton, cls).__call__(*args, **kwargs)

  File "common/contrail_test_init.py", line 102, in __init__

    self.parse_yml_file()

  File "common/contrail_test_init.py", line 589, in parse_yml_file

    self.vcenter_dc = _parse_vcenter.vcenter_dc

  File "common/contrail_test_init.py", line 1466, in vcenter_dc






















Test container is spawned on 10.84.16.10.

/root/contrail-ansible-deployer has the contrail_test_input.yml and vcenter_vars.yml












Thanks,

Ram











From: Ram Yadav <<email address hidden><mailto:<email address hidden>>>
Date: Tuesday, August 14, 2018 at 4:31 PM
To: Adrian Szczepański <<email address hidden><mailto:<email address hidden>>>, Amudha R <<email address hidden><mailto:<email address hidden>>>
Cc: Sachchidanand Vaidya <<email address hidden><mailto:<email address hidden>>>, Sandip Dey <<email address hidden><mailto:<email address hidden>>>, Marcin Orkiszewski <<email address hidden><mailto:<email address hidden>>>
Subject: steps to run sanity on vCenter local setup's

Hello,

Below is the instruction to run sanity

1.wget https://github.com/Juniper/contrail-test/raw/master/testrunner.sh
2.docker pull 10.204.217.152:5000/contrail-test-test:ocata-5.0-<build-id>
3../testrunner.sh run -s -P contrail_test_input.yml,vcenter_vars.yml 10.204.217.152:5000/contrail-test-test:ocata-5.0-<build-id>
4.cd contrail-test
5.export TEST_CONFIG_FILE=contrail_test_input_useit.yaml
6./run_tests.sh -T venter --send-mail -














To run a single test case
1.wget https://github.com/Juniper/contrail-test/raw/master/testrunner.sh
2.docker pull 10.204.217.152:5000/contrail-test-test:ocata-5.0-<build-id>
3../testrunner.sh run -s -P contrail_test_input.yml,vcenter_vars.yml 10.204.217.152:5000/contrail-test-test:ocata-5.0-<build-id>
4.cd contrail-test
5.export PYTHONPATH=$PATH:$PWD:$PWD/fixtures:$PWD/scripts
6.export TEST_CONFIG_FILE=contrail_test_input_useit.yaml
7.python -m testtools.run scripts.vm_regression.test_vm_basic.TestBasicVMVN.test_ping_within_vn

Docker pull needs to be done on ci-repo.englab.juniper.net or local repo as mentioned in the above step which is Bangalore local repo.

Apart from this you will need set of vmdk file which was copied by Sandip Dey at some sunnyvale location.

Sandip,
Can provide detail on the file’s that we need to copy say to codilime’s server locally for sanity to run on there setup?

Thanks,
Ram