[3058-mainline] All deleted VNs are showing in Analytics UVE

[musharani]

In Analytics UVE all the deleted networks are showing. But the same thing got removed from config-api server.

root@nodec59:~# neutron net-list --all
+--------------------------------------+-------------------------+---------+
| id | name | subnets |
+--------------------------------------+-------------------------+---------+
| 187f0db3-49f9-43f0-a2f9-1f622a1ebea8 | ip-fabric | |
| 295b182d-270a-4489-82a2-54bc65280300 | default-virtual-network | |
| d8a0bcb3-be49-4ddd-a6eb-43d39a2c7b47 | __link_local__ | |
+--------------------------------------+-------------------------+---------+

From config api server:
------------------------
{
virtual-networks: [
{
href: "http://nodec59.englab.juniper.net:8080/proxy?proxyURL=http://10.204.217.99:8082/virtual-network/187f0db3-49f9-43f0-a2f9-1f622a1ebea8",
fq_name: [
"default-domain",
"default-project",
"ip-fabric"
],
uuid: "187f0db3-49f9-43f0-a2f9-1f622a1ebea8"
},
{
href: "http://nodec59.englab.juniper.net:8080/proxy?proxyURL=http://10.204.217.99:8082/virtual-network/295b182d-270a-4489-82a2-54bc65280300",
fq_name: [
"default-domain",
"default-project",
"default-virtual-network"
],
uuid: "295b182d-270a-4489-82a2-54bc65280300"
},
{
href: "http://nodec59.englab.juniper.net:8080/proxy?proxyURL=http://10.204.217.99:8082/virtual-network/d8a0bcb3-be49-4ddd-a6eb-43d39a2c7b47",
fq_name: [
"default-domain",
"default-project",
"__link_local__"
],
uuid: "d8a0bcb3-be49-4ddd-a6eb-43d39a2c7b47"
}
]
}

But if you check the analytics uve it is showing more than 40 vns. All those vns are deleted from UI.
http://nodec59.englab.juniper.net:8080/proxy?proxyURL=http://10.204.217.99:8081/analytics/uves/virtual-networks

Setup is in the same state. You can use the setup to debug if you need.

Setup details:
--------------
nodec59 - root/c0ntrail123

Build:
------
3058 -ubuntu-mitaka

[Raj Reddy (rajreddy)]

This is most likely related to
https://bugs.launchpad.net/juniperopenstack/+bug/1685334

we will verify once that's fixed and 'dup' this.

[musharani (musharani)]

Still the issue is seen. So it is not related to the bug https://bugs.launchpad.net/juniperopenstack/+bug/1685334. So remove the dup bug link

[Sundaresan Rajangam (srajanga)]

This seem to be same as https://bugs.launchpad.net/juniperopenstack/+bug/1709161
Can you please verify this in the latest build? If you see this issue in the latest build, please provide the setup.

[Sundaresan Rajangam (srajanga)]

When you see the issue next time, can you get the output of /analytics/uves/virtual-network/*?flat

[musharani (musharani)]

Still the issue is seen in the 4.0 - 31

output of /analytics/uves/virtual-network/*?flat/:
{
value: [ ]
}

Please find the attached uve link
https://nodec41.englab.juniper.net:8143/proxy?proxyURL=http://10.204.217.81:8081/analytics/uves/virtual-networks

vn-test network got deleted from config page. But still it is showing on analytics.

Analytics is having all the deleted vns from different projects which are all deleted. Setup is in failed state. You can use the setup nodec41.

[musharani (musharani)]

Still the issue is seen in the 4.0 - 31

output of /analytics/uves/virtual-network/*?flat/:
{
value: [ ]
}

Please find the attached uve link
https://nodec41.englab.juniper.net:8143/proxy?proxyURL=http://10.204.217.81:8081/analytics/uves/virtual-networks

vn-test network got deleted from config page. But still it is showing on analytics.

Analytics is having all the deleted vns from different projects which are all deleted. Setup is in failed state. You can use the setup nodec41.

[Sundaresan Rajangam (srajanga)]

If the virtual-network is deleted, the derived stats of the corresponding virtual-network doesn't get deleted.

root@nodec41(analytics):/# curl -u admin:contrail123 localhost:8181/analytics/uves/virtual-network/default-domain:ctest-WebuiTestSanity-08644118:left_vn?flat | python -m json.tool
  % Total % Received % Xferd Average Speed Time Time Time Current
                                 Dload Upload Total Spent Left Speed
100 1218 0 1218 0 0 75333 0 --:--:-- --:--:-- --:--:-- 76125
{
    "AggProxySum-UveVirtualNetworkAgent-egress_flow_count": {
        "deleted": false,
        "proxy": "UveVirtualNetworkAgent-egress_flow_count",
        "value": {
            "value": 0
        }
    },
    "AggProxySum-UveVirtualNetworkAgent-ingress_flow_count": {
        "deleted": false,
        "proxy": "UveVirtualNetworkAgent-ingress_flow_count",
        "value": {
            "value": 0
        }
    },
    "RoutingInstanceStatsData": {
        "ermvpn_stats": {
            "nodec41:Control:contrail-control:0:\"default-domain:ctest-WebuiTestSanity-08644118:left_vn:left_vn\"": {
                "infeasible_paths": 0,
                "prefixes": 0,
                "primary_paths": 0,
                "secondary_paths": 0,
                "total_paths": 0
            }
        },
        "evpn_stats": {
            "nodec41:Control:contrail-control:0:\"default-domain:ctest-WebuiTestSanity-08644118:left_vn:left_vn\"": {
                "infeasible_paths": 0,
                "prefixes": 0,
                "primary_paths": 0,
                "secondary_paths": 0,
                "total_paths": 0
            }
        },
        "ipv4_stats": {
            "nodec41:Control:contrail-control:0:\"default-domain:ctest-WebuiTestSanity-08644118:left_vn:left_vn\"": {
                "infeasible_paths": 0,
                "prefixes": 0,
                "primary_paths": 0,
                "secondary_paths": 0,
                "total_paths": 0
            }
        },
        "ipv6_stats": {
            "nodec41:Control:contrail-control:0:\"default-domain:ctest-WebuiTestSanity-08644118:left_vn:left_vn\"": {
                "infeasible_paths": 0,
                "prefixes": 0,
                "primary_paths": 0,
                "secondary_paths": 0,
                "total_paths": 0
            }
        }
    }
}

root@nodec41(analytics):/# curl -u admin:contrail123 localhost:8181/analytics/uves/virtual-network/default-domain:ctest-WebuiTestSanity-84112158:vn-test?flat | python -m json.tool
  % Total % Received % Xferd Average Speed Time Time Time Current
                                 Dload Upload Total Spent Left Speed
100 912 0 912 0 0 127k 0 --:--:-- --:--:-- --:--:-- 148k
{
    "RoutingInstanceStatsData": {
        "ermvpn_stats": {
            "nodec41:Control:contrail-control:0:\"default-domain:ctest-WebuiTestSanity-84112158:vn-test:vn-test\"": {
                "infeasible_paths": 0,
                "prefixes": 0,
                "primary_paths": 0,
                "secondary_paths": 0,
                "total_paths": 0
            }
        },
        "evpn_stats": {
        ...

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/36115
Submitter: Jack Jonnalagadda (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/36207
Submitter: Jack Jonnalagadda (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/36115
Committed: http://github.com/Juniper/contrail-sandesh/commit/91e89a8f5cf04e6ff077532a63da0d7a8712d6d8
Submitter: Zuul (<email address hidden>)
Branch: master

commit 91e89a8f5cf04e6ff077532a63da0d7a8712d6d8
Author: VS Jagannadham Jonnalagadda <email address hidden>
Date: Thu Sep 28 18:30:45 2017 -0700

Delete UVEs that are timedout
Closes-Bug: 1686668

Change-Id: I1e2c304d5eacb02aed068ca4bf80936ebccb8288

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/36207
Committed: http://github.com/Juniper/contrail-sandesh/commit/d1d9c9f58ee9e2538dd3545b691e613eff9aaf92
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit d1d9c9f58ee9e2538dd3545b691e613eff9aaf92
Author: VS Jagannadham Jonnalagadda <email address hidden>
Date: Thu Sep 28 18:30:45 2017 -0700

Delete UVEs that are timedout
Closes-Bug: 1686668

Change-Id: I1e2c304d5eacb02aed068ca4bf80936ebccb8288

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/36939
Submitter: Jack Jonnalagadda (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/36939
Committed: http://github.com/Juniper/contrail-sandesh/commit/a428d456ada67805a2f1061e6c16e875fefea7a5
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit a428d456ada67805a2f1061e6c16e875fefea7a5
Author: VS Jagannadham Jonnalagadda <email address hidden>
Date: Thu Sep 28 18:30:45 2017 -0700

Delete UVEs that are timedout
Closes-Bug: 1686668

Change-Id: I1e2c304d5eacb02aed068ca4bf80936ebccb8288
(cherry picked from commit 91e89a8f5cf04e6ff077532a63da0d7a8712d6d8)