One of tor-agents uves in analytics is not right on scale setup

Bug #1463462 reported by Vedamurthy Joshi
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
New
High
Raj Reddy
R2.20
New
High
Raj Reddy

Bug Description

R2.20 Build 45 Ubuntu 14.04 Juno multi-node setup

On my 128-ToR scale setup, I see that the UVE is not reflecting the current state of the tor-agent. Could you please take a look..
The tor-agent is nodei30-80 (http://nodei30.englab.juniper.net:9217)

http://nodei30:9217/Snh_SandeshUVECacheReq?x=VrouterAgent shows downinterfacecount is 0, but http://nodei34:8081/analytics/uves/vrouter/nodei30-80?flat shows that it is 305

Sundar did take an initial look with below analysis :
It seems nodei30-80 was connected to nodei36 [collector] initially, later it was rebooted
Then it connected to collector nodei34, but the UVEs originated by it was not cleaned by collector nodei36..Therefore we see the old UVEs

http://nodei35:8081/analytics/uves/generator/nodei30:Compute:contrail-tor-agent:80?flat
nodei30-80 is connected to both nodei34 and nodei36 collectors which is incorrect.

"generator_info": [

{

    "gen_attr":

    {
        "resets": 0,
        "connect_time": 1433792236694682,
        "in_clear": false,
        "connects": 1,
        "reset_time": 0
    },
    "hostname": "nodei36"

},
{

    "gen_attr":

    {
        "resets": 1,
        "connect_time": 1433788836751898,
        "in_clear": false,
        "connects": 1,
        "reset_time": 1433789020650738
    },
    "hostname": "nodei35"

},
{

    "gen_attr":

            {
                "resets": 0,
                "connect_time": 1433844701811884,
                "in_clear": false,
                "connects": 1,
                "reset_time": 0
            },
            "hostname": "nodei34"
        }
    ]

},

env.roledefs = {
    'all': [host2, host3, host4, host5, host6, host7, host8, host9],
    'cfgm': [host2, host3, host4],
    'openstack': [host2, host3, host4],
    'webui': [host3],
    'control': [host2, host3, host4],
    'compute': [host5, host6, host7, host8, host9],
    'collector': [host2, host3, host4],
    'database': [host2, host3, host4],
    'toragent': [host5, host6, host7, host9 ],
    'tsn': [host5, host6, host7,host9 ],
    'build': [host_build],
}

env.hostnames = {
    'all': ['nodei34', 'nodei35', 'nodei36', 'nodei37', 'nodei38', 'nodei28', 'nodei27', 'nodei30']
}

Changed in juniperopenstack:
milestone: none → r2.30-fcs
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.