[Helm_deployer] [r5.0.1] vrouter agent crash @ void KSyncMemory::Mmap(bool)

[Prabhjot Singh Sethi]

vrouter agent keeps crashing for r5.0.1, deployed with contrail helm deployer.

seems like for helm it fails to locate /dev/flow for mmap.

Config file </etc/contrail/contrail-vrouter-agent.conf> parsing completed.
log4cplus:ERROR No appenders could be found for logger (SANDESH).
log4cplus:ERROR Please initialize the log4cplus system properly.
contrail-vrouter-agent: controller/src/vnsw/agent/vrouter/ksync/ksync_memory.cc:107: void KSyncMemory::Mmap(bool): Assertion `0' failed.
/entrypoint.sh: line 360: 19585 Aborted (core dumped) $@

2018-09-18 Tue 15:11:15:890.047 UTC ats-nodea3 [Thread 140214299346688, Pid 703]: KsyncTxQueue CPU pinning policy <>. KsyncTxQueuen not pinned to CPU
2018-09-18 Tue 15:11:15:902.549 UTC ats-nodea3 [Thread 140214316140288, Pid 703]: Error sending Huge Page configuration to VROUTER. Skipping KSync Start
2018-09-18 Tue 15:11:15:904.191 UTC ats-nodea3 [Thread 140214316140288, Pid 703]: Error mapping KSync memory. Device: /dev/flow; /dev/flow: Invalid argument
2018-09-18 Tue 15:16:24:297.833 UTC ats-nodea3 [Thread 140360113428224, Pid 22516]: KsyncTxQueue CPU pinning policy <>. KsyncTxQueuen not pinned to CPU
2018-09-18 Tue 15:16:24:305.703 UTC ats-nodea3 [Thread 140360105031424, Pid 22516]: Error sending Huge Page configuration to VROUTER. Skipping KSync Start
2018-09-18 Tue 15:16:24:313.764 UTC ats-nodea3 [Thread 140360105031424, Pid 22516]: Error mapping KSync memory. Device: /dev/flow; /dev/flow: Invalid argument

[sagarkchitnis (sagarc)]

emailed Prabhjot requesting more information about the setup so it can be reproduced:

Thank you for reporting this bug.
https://bugs.launchpad.net/juniperopenstack/r5.0/+bug/1793191

I am looking into it.
Superficially it looks like a memory issue. Please can you give details about your compute environment(RAM etc)?Also, please can you give any any steps to reproduce it?
Thanks,
Sagar

[sagarkchitnis (sagarc)]

we are using following documentation from link https://github.com/Juniper/contrail-helm-deployer/blob/master/doc/contrail-osh-aio-install.md

are you suggesting that helm deployment works for you guys ?

this is attempted on a VM where ansible deployment succeeded without any issue.

VM resources
vCPU: 8
RAM: 32GB
HDD: 200 GB

OS Ubuntu 16.04.3 LTS
kernel version : 4.4.0-98-generic

[sagarkchitnis (sagarc)]

Hi Prabhjot,
Please can we get this file?

/opt/contrail-helm-deployer/contrail-vrouter/values.yaml

  contrail_env_vrouter_dpdk:
    AGENT_MODE: dpdk
    CPU_CORE_MASK: "0xff"
    DPDK_UIO_DRIVER: uio_pci_generic
    HUGE_PAGES: 48000

Also, please send the following from the compute

 cat /proc/meminfo | grep -i Huge

Thanks,
Sagar