Looks like there are many failures in sanity, but could be setup issue. For our immediate concern of reproducing the DHCP issue with vlan override I’m unable to reproduce the issue in my setup. Below are sanity test report from my setup. Hi Sudhee, Can you have someone from your team replicate the DHCP issue on my setup? Also can someone look at the cause of the sanity test cases failure and see what are due to setup and which are genuine? Thanks, Ram Test Results Designed for use with JUnit and Ant. ________________________________ Properties Build : 5.1.0-241 cores : {'10.84.16.10': [], '10.84.16.24': [], '10.84.16.23': []} LogsLocation : http://None/None/5.1.0-241_2018_08_18_09_41_28/logs/ Report : http://None/None/5.1.0-241_2018_08_18_09_41_28/junit-noframes.html Topology : DISTRO : CentOS Linux release 7.5.1804 Core SKU : Config Nodes : ['a3s10'] Control Nodes : ['a3s10'] Compute Nodes : ['a3s11vrouter', 'a3s11vrouter12'] WebUI Node : ['a3s10'] Analytics Nodes : ['a3s10'] Database Nodes : ['a3s10'] Physical Devices : [u''] ________________________________ Summary Tests Failures Errors Skipped Success rate Time 61 43 0 10 15.69% 21983.085 Note: failures are anticipated and checked for with assertions while errors are unanticipated. ________________________________ Packages Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers. Name Tests Errors Failures Skipped Time(s) 61 0 43 10 21983.085 ________________________________ Package Name Tests Errors Failures Skipped Time(s) 11 0 7 3 6194.420 scripts 50 0 36 7 15788.665 Back to top ________________________________ TestCase Name Status Type Time(s) LogFile .setUpClass (serial_scripts.analytics.test_analytics_resource.AnalyticsTestSanityWithMin) Failure Details 0.000 Log File .setUpClass (serial_scripts.analytics.test_analytics_resource.AnalyticsTestSanityWithResource) Failure Details 0.000 Log File TestEncapCases.test_apply_policy_fip_on_same_vn_gw_mx[sanity,serial,vcenter] Skipped Skipping Test. Env variable MX_TEST is not set. Skipping the testSkipping Test. Env variable MX_TEST is not set. Skipping the test 6.933 TestEvpnCasesRestart.test_with_vxlan_encap_agent_restart[sanity,serial,vcenter,vcenter_compute] Failure Details 1006.328 Log File TestFirewallBasic.test_global_scope[sanity,vcenter] Success 216.315 TestSerialSanity_MX.test_change_of_rt_in_vn[mx_test,sanity,serial,vcenter,vcenter_compute] Skipped Skipping Test. Env variable MX_GW_TEST is not setSkipping Test. Env variable MX_GW_TEST is not set 7.291 TestGWLessFWD.test_gw_less_fwd_single_vn_ip_fab[cb_sanity,sanity,vcenter] Skipped Skipping Test. Fabric gateway is required to run the testSkipping Test. Fabric gateway is required to run the test 7.318 TestVcenterSerial.test_vcenter_compute_vm_reboot[vcenter] Failure Details 695.222 Log File TestVcenterSerial.test_vcenter_plugin_restart[vcenter] Failure Details 78.683 Log File TestVcenterSerial.test_vcenter_vrouter_agent_restart[vcenter] Failure Details 720.838 Log File TestBasicVMVN0.test_underlay_broadcast_traffic_handling[sanity,vcenter,vcenter_compute] Failure Details 42.442 Log File Properties » Back to top TestCase scripts Name Status Type Time(s) LogFile AnalyticsTestSanity.test_contrail_alarms[vcenter] Success 6.825 AnalyticsTestSanity.test_contrail_status[cb_sanity,ci_sanity,sanity,vcenter,vcenter_compute] Failure Details 17.174 Log File AnalyticsTestSanity3.test_db_nodemgr_status[sanity,vcenter,vcenter_compute] Failure Details 66.543 Log File AnalyticsTestSanity3.test_verify_generator_collector_connections[sanity,vcenter,vcenter_compute] Failure Details 568.749 Log File AnalyticsTestSanity3.test_verify_generator_connections_to_collector_node[sanity,vcenter] Failure Details 77.214 Log File AnalyticsTestSanity3.test_verify_process_status_agent[cb_sanity,sanity,vcenter,vcenter_compute] Failure Details 6.539 Log File AnalyticsTestSanity3.test_verify_process_status_analytics_node[cb_sanity,sanity,vcenter,vcenter_compute] Failure Details 6.325 Log File AnalyticsTestSanity3.test_verify_process_status_config[cb_sanity,sanity,vcenter,vcenter_compute] Failure Details 6.641 Log File AnalyticsTestSanity3.test_verify_process_status_control_node[cb_sanity,sanity,vcenter,vcenter_compute] Failure Details 6.976 Log File AnalyticsBasicTestSanity.test_verify_object_logs[ci_sanity,sanity,suite1,vcenter,vcenter_compute] Success 321.308 TestECMPConfigHashFeature.test_ecmp_hash_src_ip[sanity,vcenter] Skipped Skipped as test requires at least 3 nodes, but only 2 foundSkipped as test requires at least 3 nodes, but only 2 found 6.721 TestECMPFeature.test_ecmp_svc_v2_in_network_nat_with_3_instance[cb_sanity,sanity,vcenter] Skipped Skipped as test requires at least 3 nodes, but only 2 foundSkipped as test requires at least 3 nodes, but only 2 found 6.637 TestECMPSanity.test_ecmp_svc_in_network_with_static_route_no_policy[sanity,vcenter] Failure Details 44.476 Log File TestECMPwithSVMChange.test_ecmp_with_svm_deletion[sanity,vcenter] Skipped Skipped as test requires at least 3 nodes, but only 2 foundSkipped as test requires at least 3 nodes, but only 2 found 6.596 TestMultiInlineSVC.test_svc_fate_sharing_basic[sanity,vcenter] Failure Details 30.847 Log File TestMultiInlineSVC.test_three_stage_v2_SC[sanity,vcenter] Skipped Skipped as test requires at least 3 nodes, but only 2 foundSkipped as test requires at least 3 nodes, but only 2 found 6.539 FloatingipBasicTestSanity.test_floating_ip[cb_sanity,ci_sanity,quick_sanity,sanity,suite1,vcenter,vcenter_compute,vrouter_gw] Failure Details 77.229 Log File TestSanity_MX.test_mx_gateway[mx_test,sanity,vcenter,vcenter_compute] Skipped Skipping Test. Env variable MX_GW_TEST is not setSkipping Test. Env variable MX_GW_TEST is not set 6.751 TestLBaaSV2.test_lbaas_with_different_fip[cb_sanity,sanity,vcenter] Failure Details 2093.910 Log File TestPolicyAcl.test_policy_cidr_src_cidr_dst_any[cb_sanity,sanity,vcenter,vcenter_compute] Failure Details 141.050 Log File TestPolicyAcl.test_policy_cidr_src_vn_dst_cidr[cb_sanity,vcenter] Failure Details 136.480 Log File TestPolicyAcl.test_policy_inheritance_src_pol_dst_any[cb_sanity,vcenter] Failure Details 141.221 Log File TestPolicyAcl.test_policy_inheritance_src_vn_dst_pol[cb_sanity,sanity,vcenter,vcenter_compute,vrouter_gw] Failure Details 135.402 Log File TestBasicPolicy.test_policy[suite1,vcenter] Failure Details 77.560 Log File TestBasicPolicyModify.test_policy_modify_vn_policy[suite1,vcenter] Failure Details 79.790 Log File TestBasicPolicyNegative.test_remove_policy_with_ref[suite1,vcenter] Failure Details 78.383 Log File TestDetailedPolicy0.test_repeated_policy_modify[suite1,vcenter] Failure Details 79.832 Log File TestDetailedPolicy1.test_multi_vn_repeated_policy_update_with_ping[sanity,vcenter] Failure Details 81.838 Log File TestDetailedPolicy1Ipv4v6.test_multi_vn_repeated_policy_update_with_ping[sanity,vcenter] Skipped Skipping IPv6 Test on vcenter setupSkipping IPv6 Test on vcenter setup 7.389 TestBasicRTFilter.test_user_def_rt_entry[cb_sanity,sanity,vcenter,vcenter_compute] Failure Details 78.341 Log File SecurityGroupBasicRegressionTests1_contrail.test_sec_group_basic[sanity,suite1,vcenter] Failure Details 81.171 Log File SecurityGroupBasicRegressionTests1.test_sec_group_basic[cb_sanity,ci_sanity,sanity,suite1,vcenter] Failure Details 81.196 Log File TestStaticRouteTables.test_interface_static_table[sanity,vcenter] Success 1571.197 TestStaticRouteTables.test_network_route_table[cb_sanity,sanity,vcenter] Success 966.079 TestSvcRegr.test_svc_in_net_nat_with_static_routes[sanity,vcenter] Failure Details 496.756 Log File TestSvcRegr.test_svc_in_network_datapath[ci_sanity,vcenter] Failure Details 77.732 Log File TestSvcRegr.test_svc_in_network_datapath[ci_sanity_WIP,quick_sanity,sanity,suite1,vcenter,vcenter_compute] Failure Details 75.806 Log File TestSvcHC.test_svc_hc_basic[sanity,vcenter] Failure Details 77.918 Log File TestvDNSBasic0.test_vdns_ping_same_vn[sanity,suite1,vcenter,vcenter_compute] Success 1055.953 TestVcenter.test_vcenter_static_ip[vcenter] Failure Details 80.265 Log File TestVcenter.test_vcenter_vm_interface_change[vcenter] Failure Details 76.299 Log File TestVcenter.test_vcenter_vm_moveout_and_backin[vcenter] Failure Details 77.937 Log File TestVcenter2.test_vcenter_vm_migrate[vcenter] Failure Details 75.818 Log File TestVcenter2.test_vcenter_vm_on_diff_host[vcenter] Failure Details 78.279 Log File TestVcenter3.test_vcenter_vm_on_diff_cluster[vcenter] Skipped Skipping Test. Require more than cluster in the setupSkipping Test. Require more than cluster in the setup 7.353 TestBasicVMVNx.test_vm_file_trf_tftp_tests[sanity,vcenter,vcenter_compute,vrouter_gw] Failure Details 78.065 Log File TestBasicVMVN.test_generic_link_local_service[cb_sanity,ci_sanity,sanity,suite1,vcenter,vcenter_compute] Success 824.422 TestBasicVMVN.test_ping_within_vn[suite1,vcenter,vcenter_compute,vrouter_gw] Success 1200.122 TestBasicVMVN.test_vm_add_delete[suite1,vcenter] Failure Details 80.208 Log File TestBasicVMVN.test_vn_add_delete[suite1,vcenter] Failure Details 75.984 Log File From: Sachchidanand Vaidya