Build 2712 : Not all active VMs are seen in VM UVE

Bug #1545949 reported by Ankit Jain
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Invalid
Low
Raj Reddy

Bug Description

I could see only 4 out 14 VMs in the VM UVE http://nodeg32:8081/analytics/uves/virtual-machines

[

{

    "href": "http://nodeg32:8081/analytics/uves/virtual-machine/84c4a199-cc05-4892-93a1-aa451932f058?flat",
    "name": "84c4a199-cc05-4892-93a1-aa451932f058"

},
{

    "href": "http://nodeg32:8081/analytics/uves/virtual-machine/f43d9e5a-c5da-43ea-9b61-408c953204ad?flat",
    "name": "f43d9e5a-c5da-43ea-9b61-408c953204ad"

},
{

    "href": "http://nodeg32:8081/analytics/uves/virtual-machine/34575800-cd81-4c66-b854-198954759256?flat",
    "name": "34575800-cd81-4c66-b854-198954759256"

},

    {
        "href": "http://nodeg32:8081/analytics/uves/virtual-machine/0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c?flat",
        "name": "0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c"
    }

]

root@nodeg32:~# nova --os-tenant-name demo list
+--------------------------------------+-----------+--------+------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+-----------+--------+------------+-------------+---------------+
| f43d9e5a-c5da-43ea-9b61-408c953204ad | vmtraffic | ACTIVE | - | Running | vn1=10.1.1.3 |
| 98f98673-8ec7-4508-b22e-dfc181432519 | vn1-vm-10 | ACTIVE | - | Running | vn1=10.1.1.12 |
| aaa7f5e4-b819-4a4d-8c82-cf97a70f7afe | vn1-vm-3 | ACTIVE | - | Running | vn1=10.1.1.6 |
| db96c012-239c-4cec-bc57-17a22823beff | vn1-vm-4 | ACTIVE | - | Running | vn1=10.1.1.7 |
| 18e01ade-cf57-4e7b-a6a9-7d11f3cd9d6d | vn1-vm-9 | ACTIVE | - | Running | vn1=10.1.1.11 |
| d3918e04-11d1-4e9b-b0bb-df5a715138ba | vn2-vm-1 | ACTIVE | - | Running | vn2=20.1.1.4 |
| 34575800-cd81-4c66-b854-198954759256 | vn2-vm-2 | ACTIVE | - | Running | vn2=20.1.1.7 |
| 8e0de660-6996-47be-a78d-fcaf3218c335 | vn2-vm-3 | ACTIVE | - | Running | vn2=20.1.1.10 |
| 84c4a199-cc05-4892-93a1-aa451932f058 | vn2-vm-4 | ACTIVE | - | Running | vn2=20.1.1.3 |
| 5118a769-1893-49cc-92e6-dff0dca880e0 | vn2-vm-5 | ACTIVE | - | Running | vn2=20.1.1.9 |
| 0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c | vn2-vm-6 | ACTIVE | - | Running | vn2=20.1.1.8 |
| 261ca9e9-3797-4ad7-8e76-bf11db4c449c | vn2-vm-7 | ACTIVE | - | Running | vn2=20.1.1.11 |
| 96361890-f708-4a67-9055-7fed009df74c | vn2-vm-8 | ACTIVE | - | Running | vn2=20.1.1.5 |
| d4e3d302-2391-4e4c-90ab-b1082899a697 | vn2-vm-9 | ACTIVE | - | Running | vn2=20.1.1.12 |
+--------------------------------------+-----------+--------+------------+-------------+---------------+
root@nodeg32:~#

However they were present In api-server, following the output from api=server:

root@nodeg32:~# curl --user admin:contrail123 localhost:8095/virtual-machines | python -mjson.tool | grep uuid | wc -l
  % Total % Received % Xferd Average Speed Time Time Time Current
                                 Dload Upload Total Spent Left Speed
100 2668 100 2668 0 0 317k 0 --:--:-- --:--:-- --:--:-- 325k
14
root@nodeg32:~# curl --user admin:contrail123 localhost:8095/virtual-machines | python -mjson.tool
  % Total % Received % Xferd Average Speed Time Time Time Current
                                 Dload Upload Total Spent Left Speed
100 2668 100 2668 0 0 320k 0 --:--:-- --:--:-- --:--:-- 372k
{
    "virtual-machines": [
        {
            "fq_name": [
                "aaa7f5e4-b819-4a4d-8c82-cf97a70f7afe"
            ],
            "href": "http://localhost:8095/virtual-machine/aaa7f5e4-b819-4a4d-8c82-cf97a70f7afe",
            "uuid": "aaa7f5e4-b819-4a4d-8c82-cf97a70f7afe"
        },
        {
            "fq_name": [
                "84c4a199-cc05-4892-93a1-aa451932f058"
            ],
            "href": "http://localhost:8095/virtual-machine/84c4a199-cc05-4892-93a1-aa451932f058",
            "uuid": "84c4a199-cc05-4892-93a1-aa451932f058"
        },
        {
            "fq_name": [
                "d4e3d302-2391-4e4c-90ab-b1082899a697"
            ],
            "href": "http://localhost:8095/virtual-machine/d4e3d302-2391-4e4c-90ab-b1082899a697",
            "uuid": "d4e3d302-2391-4e4c-90ab-b1082899a697"
        },
        {
            "fq_name": [
                "5118a769-1893-49cc-92e6-dff0dca880e0"
            ],
            "href": "http://localhost:8095/virtual-machine/5118a769-1893-49cc-92e6-dff0dca880e0",
            "uuid": "5118a769-1893-49cc-92e6-dff0dca880e0"
        },
        {
            "fq_name": [
                "261ca9e9-3797-4ad7-8e76-bf11db4c449c"
            ],
            "href": "http://localhost:8095/virtual-machine/261ca9e9-3797-4ad7-8e76-bf11db4c449c",
            "uuid": "261ca9e9-3797-4ad7-8e76-bf11db4c449c"
        },
        {
            "fq_name": [
                "34575800-cd81-4c66-b854-198954759256"
            ],
            "href": "http://localhost:8095/virtual-machine/34575800-cd81-4c66-b854-198954759256",
            "uuid": "34575800-cd81-4c66-b854-198954759256"
        },
        {
            "fq_name": [
                "18e01ade-cf57-4e7b-a6a9-7d11f3cd9d6d"
            ],
            "href": "http://localhost:8095/virtual-machine/18e01ade-cf57-4e7b-a6a9-7d11f3cd9d6d",
            "uuid": "18e01ade-cf57-4e7b-a6a9-7d11f3cd9d6d"
        },
        {
            "fq_name": [
                "98f98673-8ec7-4508-b22e-dfc181432519"
            ],
            "href": "http://localhost:8095/virtual-machine/98f98673-8ec7-4508-b22e-dfc181432519",
            "uuid": "98f98673-8ec7-4508-b22e-dfc181432519"
        },
        {
            "fq_name": [
                "f43d9e5a-c5da-43ea-9b61-408c953204ad"
            ],
            "href": "http://localhost:8095/virtual-machine/f43d9e5a-c5da-43ea-9b61-408c953204ad",
            "uuid": "f43d9e5a-c5da-43ea-9b61-408c953204ad"
        },
        {
            "fq_name": [
                "96361890-f708-4a67-9055-7fed009df74c"
            ],
            "href": "http://localhost:8095/virtual-machine/96361890-f708-4a67-9055-7fed009df74c",
            "uuid": "96361890-f708-4a67-9055-7fed009df74c"
        },
        {
            "fq_name": [
                "8e0de660-6996-47be-a78d-fcaf3218c335"
            ],
            "href": "http://localhost:8095/virtual-machine/8e0de660-6996-47be-a78d-fcaf3218c335",
            "uuid": "8e0de660-6996-47be-a78d-fcaf3218c335"
        },
        {
            "fq_name": [
                "0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c"
            ],
            "href": "http://localhost:8095/virtual-machine/0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c",
            "uuid": "0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c"
        },
        {
            "fq_name": [
                "d3918e04-11d1-4e9b-b0bb-df5a715138ba"
            ],
            "href": "http://localhost:8095/virtual-machine/d3918e04-11d1-4e9b-b0bb-df5a715138ba",
            "uuid": "d3918e04-11d1-4e9b-b0bb-df5a715138ba"
        },
        {
            "fq_name": [
                "db96c012-239c-4cec-bc57-17a22823beff"
            ],
            "href": "http://localhost:8095/virtual-machine/db96c012-239c-4cec-bc57-17a22823beff",
            "uuid": "db96c012-239c-4cec-bc57-17a22823beff"
        }
    ]
}

Tags: analytics
Revision history for this message
Raj Reddy (rajreddy) wrote : Re: [Bug 1545949] [NEW] Build 2712 : Not all active VMs are seen in VM UVE
Download full text (16.1 KiB)

Ankit,
- this may have been side effect something else, like generators not connecting to collector etc..
- Have you seen any RED bubbles (or down nodes) in the UI dashboard?
- if not, we may need to introspect into the vrouter where the VM is launched and look at it's UVE cache,
please ping us when you have the system in this state..

> On Feb 15, 2016, at 11:13 PM, Ankit Jain <email address hidden> wrote:
>
> Public bug reported:
>
> I could see only 4 out 14 VMs in the VM UVE
> http://nodeg32:8081/analytics/uves/virtual-machines
>
> [
>
> {
>
> "href": "http://nodeg32:8081/analytics/uves/virtual-machine/84c4a199-cc05-4892-93a1-aa451932f058?flat",
> "name": "84c4a199-cc05-4892-93a1-aa451932f058"
>
> },
> {
>
> "href": "http://nodeg32:8081/analytics/uves/virtual-machine/f43d9e5a-c5da-43ea-9b61-408c953204ad?flat",
> "name": "f43d9e5a-c5da-43ea-9b61-408c953204ad"
>
> },
> {
>
> "href": "http://nodeg32:8081/analytics/uves/virtual-machine/34575800-cd81-4c66-b854-198954759256?flat",
> "name": "34575800-cd81-4c66-b854-198954759256"
>
> },
>
> {
> "href": "http://nodeg32:8081/analytics/uves/virtual-machine/0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c?flat",
> "name": "0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c"
> }
>
> ]
>
>
> root@nodeg32:~# nova --os-tenant-name demo list
> +--------------------------------------+-----------+--------+------------+-------------+---------------+
> | ID | Name | Status | Task State | Power State | Networks |
> +--------------------------------------+-----------+--------+------------+-------------+---------------+
> | f43d9e5a-c5da-43ea-9b61-408c953204ad | vmtraffic | ACTIVE | - | Running | vn1=10.1.1.3 |
> | 98f98673-8ec7-4508-b22e-dfc181432519 | vn1-vm-10 | ACTIVE | - | Running | vn1=10.1.1.12 |
> | aaa7f5e4-b819-4a4d-8c82-cf97a70f7afe | vn1-vm-3 | ACTIVE | - | Running | vn1=10.1.1.6 |
> | db96c012-239c-4cec-bc57-17a22823beff | vn1-vm-4 | ACTIVE | - | Running | vn1=10.1.1.7 |
> | 18e01ade-cf57-4e7b-a6a9-7d11f3cd9d6d | vn1-vm-9 | ACTIVE | - | Running | vn1=10.1.1.11 |
> | d3918e04-11d1-4e9b-b0bb-df5a715138ba | vn2-vm-1 | ACTIVE | - | Running | vn2=20.1.1.4 |
> | 34575800-cd81-4c66-b854-198954759256 | vn2-vm-2 | ACTIVE | - | Running | vn2=20.1.1.7 |
> | 8e0de660-6996-47be-a78d-fcaf3218c335 | vn2-vm-3 | ACTIVE | - | Running | vn2=20.1.1.10 |
> | 84c4a199-cc05-4892-93a1-aa451932f058 | vn2-vm-4 | ACTIVE | - | Running | vn2=20.1.1.3 |
> | 5118a769-1893-49cc-92e6-dff0dca880e0 | vn2-vm-5 | ACTIVE | - | Running | vn2=20.1.1.9 |
> | 0b5bc39d-5ee5-4903-9fb1-5e83d81aae6c | vn2-vm-6 | ACTIVE | - | Running | vn2=20.1.1.8 |
> | 261ca9e9-3797-4ad7-8e76-bf11db4c449c | vn2-vm-7 | ACTIVE | - | Running | vn2=20.1.1.11 |
> | 96361890-f708-4a67-9055-7fed009df74c | vn2-vm-8 | ACTIVE | - | Running | vn2=20.1.1.5 |
> | d4e3d302-2391-4e4c-90ab-b1082899a697 | vn2-vm-9 | ACTIVE | - | Running | vn2=20.1.1.12 |
> +--------------------------------------+-----------+...

Raj Reddy (rajreddy)
Changed in juniperopenstack:
importance: Undecided → High
Revision history for this message
Ankit Jain (ankitja) wrote :

Hi Raj,

My setup is not in the same state. Did not see it again.
Will provide you the setup when it happens again.

Raj Reddy (rajreddy)
Changed in juniperopenstack:
importance: High → Medium
Raj Reddy (rajreddy)
Changed in juniperopenstack:
importance: Medium → Low
Revision history for this message
Raj Reddy (rajreddy) wrote :

since it's not reproducible and we don't have 'unreproducible' state, marking it as 'invalid'

Changed in juniperopenstack:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.