[R4.1-41-newton]: few info missing in session reverse flow info randomly

Bug #1731452 reported by alok kumar
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.1
Fix Committed
Undecided
Ashok Singh
Trunk
Fix Committed
Undecided
Ashok Singh

Bug Description

4 fields are missing in reverse flow info in sessions logged.

However sometime I do see all the info in reverse flow too but right now I don't have exact steps.

missing fields are: sampled_bytes, sampled_pkts, tcp_flags, underlay_source_port.
forward flow info seems to be correct all the time.

In current case, I started ping with 2 packets from vm on nodec62 to vm on nodec12.
below are the sessions logged for client and server for sessions creation and teardown.

session creation:

on client node nodec62:

2017-11-10 Fri 15:04:41:358.371 IST nodec62 [Thread 139774794905344, Pid 9910]: [SYS_INFO]: SessionEndpointObject: session_data= [ [ [ vmi = default-domain:admin:bf8f6cc0-ee17-46b2-80d4-76f7e62e9c4e vn = default-domain:admin:vn1 application = default-domain:admin:application=1 site = default-domain:admin:site=India remote_application = default-domain:admin:application=1 remote_site = default-domain:admin:site=India security_policy_rule = default-domain:admin:fp1:c826b695-11cb-49a1-9753-9f697b8113c4 remote_vn = default-domain:admin:vn2 is_client_session = 1 is_si = 0 vrouter_ip = 10.204.217.102 sess_agg_info= [ [ [ ip = 1.1.1.3 port = 0 protocol = 1 ] [ sampled_forward_bytes = 98 sampled_forward_pkts = 1 sampled_reverse_bytes = 0 sampled_reverse_pkts = 0 sessionMap= [ [ [ ip = 2.2.2.3 port = 14136 ] [ forward_flow_info= [ sampled_bytes = 98 sampled_pkts = 1 flow_uuid = 2a79a2c7-72ea-4ebe-9f03-651e17571d43 tcp_flags = 0 setup_time = 1510306480969685 action = pass sg_rule_uuid = 4e260eee-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef underlay_source_port = 62082 ] reverse_flow_info= [ flow_uuid = 56425440-51f7-4725-8bc0-f327bc02348d setup_time = 1510306480969685 action = pass sg_rule_uuid = 4e260eee-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef ] vm = 7cde62dc-5aa3-4ca4-bb86-110c588a9381 other_vrouter_ip = 10.204.216.69 underl
ay_proto = 2 ], ] ] ], ] ] ], ] ]2017-11-10 Fri 15:04:42:358.565 IST nodec62 [Thread 139774885267200, Pid 9910]: [SYS_INFO]: SessionEndpointObject: session_data= [ [ [ vmi = default-domai
n:admin:bf8f6cc0-ee17-46b2-80d4-76f7e62e9c4e vn = default-domain:admin:vn1 application = default-domain:admin:application=1 site = default-domain:admin:site=India remote_application = default-domain:admin:application=1 remote_site = default-domain:admin:site=India security_policy_rule = default-domain:admin:fp1:c826b695-11cb-49a1-9753-9f697b8113c4 remote_vn = default-domain:admin:vn2 is_client_session = 1 is_si = 0 vrouter_ip = 10.204.217.102 sess_agg_info= [ [ [ ip = 1.1.1.3 port = 0 protocol = 1 ] [ sampled_forward_bytes = 98 sampled_forward_pkts = 1 sampled_reverse_bytes = 0 sampled_reverse_pkts = 0 sessionMap= [ [ [ ip = 2.2.2.3 port = 14136 ] [ forward_flow_info= [ sampled_bytes = 98 sampled_pkts = 1 flow_uuid = 2a79a2c7-72ea-4ebe-9f03-651e17571d43 tcp_flags = 0 setup_time = 1510306480969685 action = pass sg_rule_uuid = 4e260eee-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef underlay_source_port = 62082 ] reverse_flow_info= [ flow_uuid = 56425440-51f7-4725-8bc0-f327bc02348d setup_time = 1510306480969685 action = pass sg_rule_uuid = 4e260eee-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef ] vm = 7cde62dc-5aa3-4ca4-bb86-110c588a9381 other_vrouter_ip = 10.204.216.69 underlay_proto = 2 ], ] ] ], ] ] ], ] ]

on server node nodec12:

2017-11-10 Fri 15:04:37:539.812 IST nodec12 [Thread 139625785034496, Pid 9176]: [SYS_INFO]: EndpointSecurityStats: name = default-global-system-config:nodec12:vhost0 eps= [ [ ] ] file = controller/src/vnsw/agent/uve/interface_uve_stats_table.cc line = 135
2017-11-10 Fri 15:04:41:551.652 IST nodec12 [Thread 139625768240896, Pid 9176]: [SYS_INFO]: SessionEndpointObject: session_data= [ [ [ vmi = default-domain:admin:5d0c77e5-51dc-43b3-973a-3fc0961654f1 vn = default-domain:admin:vn2 application = default-domain:admin:application=1 site = default-domain:admin:site=India remote_application = default-domain:admin:application=1 remote_site = default-domain:admin:site=India security_policy_rule = default-domain:admin:fp1:c826b695-11cb-49a1-9753-9f697b8113c4 remote_vn = default-domain:admin:vn1 is_client_session = 0 is_si = 0 vrouter_ip = 10.204.216.69 sess_agg_info= [ [ [ ip = 2.2.2.3 port = 0 protocol = 1 ] [ sampled_forward_bytes = 84 sampled_forward_pkts = 1 sampled_reverse_bytes = 0 sampled_reverse_pkts = 0 sessionMap= [ [ [ ip = 1.1.1.3 port = 14136 ] [ forward_flow_info= [ sampled_bytes = 84 sampled_pkts = 1 flow_uuid = 5bdb25c7-047f-457d-aad1-b1d26d30322c tcp_flags = 0 setup_time = 1510306480970890 action = pass sg_rule_uuid = 4e260cdc-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef underlay_source_port = 60230 ] reverse_flow_info= [ flow_uuid = 13fb4bca-548d-4b21-a561-0a6d78135958 setup_time = 1510306480970890 action = pass sg_rule_uuid = 4e260cdc-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef ] vm = 3022c484-ead9-464c-b63b-7636b447f4ac other_vrouter_ip = 10.204.217.102 underlay_proto = 2 ], ] ] ], ] ] ], ] ]
2017-11-10 Fri 15:04:42:551.745 IST nodec12 [Thread 139625780836096, Pid 9176]: [SYS_INFO]: SessionEndpointObject: session_data= [ [ [ vmi = default-domain:admin:5d0c77e5-51dc-43b3-973a-3fc0961654f1 vn = default-domain:admin:vn2 application = default-domain:admin:application=1 site = default-domain:admin:site=India remote_application = default-domain:admin:application=1 remote_site = default-domain:admin:site=India security_policy_rule = default-domain:admin:fp1:c826b695-11cb-49a1-9753-9f697b8113c4 remote_vn = default-domain:admin:vn1 is_client_session = 0 is_si = 0 vrouter_ip = 10.204.216.69 sess_agg_info= [ [ [ ip = 2.2.2.3 port = 0 protocol = 1 ] [ sampled_forward_bytes = 84 sampled_forward_pkts = 1 sampled_reverse_bytes = 0 sampled_reverse_pkts = 0 sessionMap= [ [ [ ip = 1.1.1.3 port = 14136 ] [ forward_flow_info= [ sampled_bytes = 84 sampled_pkts = 1 flow_uuid = 5bdb25c7-047f-457d-aad1-b1d26d30322c tcp_flags = 0 setup_time = 1510306480970890 action = pass sg_rule_uuid = 4e260cdc-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef underlay_source_port = 60230 ] reverse_flow_info= [ flow_uuid = 13fb4bca-548d-4b21-a561-0a6d78135958 setup_time = 1510306480970890 action = pass sg_rule_uuid = 4e260cdc-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef ] vm = 3022c484-ead9-464c-b63b-7636b447f4ac other_vrouter_ip = 10.204.217.102 underlay_proto = 2 ], ] ] ], ] ] ], ] ]

session teardown(flow aged out):

on client node nodec62:

2017-11-10 Fri 15:07:09:378.647 IST nodec62 [Thread 139774794905344, Pid 9910]: [SYS_INFO]: SessionEndpointObject: session_data= [ [ [ vmi = default-domain:admin:bf8f6cc0-ee17-46b2-80d4-76f7e62e9c4e vn = default-domain:admin:vn1 application = default-domain:admin:application=1 site = default-domain:admin:site=India remote_application = default-domain:admin:application=1 remote_site = default-domain:admin:site=India security_policy_rule = default-domain:admin:fp1:c826b695-11cb-49a1-9753-9f697b8113c4 remote_vn = default-domain:admin:vn2 is_client_session = 1 is_si = 0 vrouter_ip = 10.204.217.102 sess_agg_info= [ [ [ ip = 1.1.1.3 port = 0 protocol = 1 ] [ sampled_forward_bytes = 0 sampled_forward_pkts = 0 sampled_reverse_bytes = 0 sampled_reverse_pkts = 0 sessionMap= [ [ [ ip = 2.2.2.3 port = 14136 ] [ forward_flow_info= [ flow_uuid = 2a79a2c7-72ea-4ebe-9f03-651e17571d43 setup_time = 1510306480969685 teardown_time = 1510306628526118 action = pass sg_rule_uuid = 4e260eee-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef ] reverse_flow_info= [ flow_uuid = 56425440-51f7-4725-8bc0-f327bc02348d setup_time = 1510306480969685 teardown_time = 1510306628526118 action = pass sg_rule_uuid = 4e260eee-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef ] vm = 7cde62dc-5aa3-4ca4-bb86-110c588a9381 other_vrouter_ip = 10.204.216.69 ], ] ] ], ] ] ], ] ]

on server node nodec12:

2017-11-10 Fri 15:07:03:569.793 IST nodec12 [Thread 139625785034496, Pid 9176]: [SYS_INFO]: SessionEndpointObject: session_data= [ [ [ vmi = default-domain:admin:5d0c77e5-51dc-43b3-973a-3fc0961654f1 vn = default-domain:admin:vn2 application = default-domain:admin:application=1 site = default-domain:admin:site=India remote_application = default-domain:admin:application=1 remote_site = default-domain:admin:site=India security_policy_rule = default-domain:admin:fp1:c826b695-11cb-49a1-9753-9f697b8113c4 remote_vn = default-domain:admin:vn1 is_client_session = 0 is_si = 0 vrouter_ip = 10.204.216.69 sess_agg_info= [ [ [ ip = 2.2.2.3 port = 0 protocol = 1 ] [ sampled_forward_bytes = 0 sampled_forward_pkts = 0 sampled_reverse_bytes = 0 sampled_reverse_pkts = 0 sessionMap= [ [ [ ip = 1.1.1.3 port = 14136 ] [ forward_flow_info= [ flow_uuid = 5bdb25c7-047f-457d-aad1-b1d26d30322c setup_time = 1510306480970890 teardown_time = 1510306623568174 action = pass sg_rule_uuid = 4e260cdc-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef ] reverse_flow_info= [ flow_uuid = 13fb4bca-548d-4b21-a561-0a6d78135958 setup_time = 1510306480970890 teardown_time = 1510306623568174 action = pass sg_rule_uuid = 4e260cdc-c526-11e7-992b-0242ac110002 nw_ace_uuid = 6e2ae15c-dde7-412b-ada3-d0a75a28e3ef ] vm = 3022c484-ead9-464c-b63b-7636b447f4ac other_vrouter_ip = 10.204.217.102 ], ] ] ], ] ] ], ] ]

Tags: vrouter
Revision history for this message
alok kumar (kalok) wrote :

underlay_proto is also missing in teardown session log.

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/37404
Submitter: Ashok Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/37404
Committed: http://github.com/Juniper/contrail-controller/commit/5bc4e3b5c99f84ad35d964ed0fa970b7535f0b6b
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit 5bc4e3b5c99f84ad35d964ed0fa970b7535f0b6b
Author: Ashok Singh R <email address hidden>
Date: Fri Nov 10 22:33:53 2017 +0530

Export missing fields for reverse flow.

Update flow-handle and gen-id, before reading stats. When flow-handle
is invalid, we cannot read stats for these fields.

Change-Id: I426668b562312e81721d1e342ad058c4de5d0338
Closes-Bug: #1731452

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/37429
Submitter: Ashok Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/37429
Committed: http://github.com/Juniper/contrail-controller/commit/22a87e46f0ad199d09be71aaa049cbe4f7e32bb4
Submitter: Zuul (<email address hidden>)
Branch: master

commit 22a87e46f0ad199d09be71aaa049cbe4f7e32bb4
Author: Ashok Singh R <email address hidden>
Date: Fri Nov 10 22:33:53 2017 +0530

Export missing fields for reverse flow.

Update flow-handle and gen-id, before reading stats. When flow-handle
is invalid, we cannot read stats for these fields.

Closes-Bug: #1731452
(cherry picked from commit 5bc4e3b5c99f84ad35d964ed0fa970b7535f0b6b)

Change-Id: I1780677aae2f9e8c8fff248dc79581d0e39d1f04

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.