Contrail-vrouter-agent Pod stuck in CrashLoopBackOff after triggering compute-kit.sh (nova and neutron charts)

Bug #1747997 reported by bk160f
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
Trunk
Invalid
High
alexey-mr

Bug Description

Contrail-vrouter-agent Pod is stuck in "CrashLoopBackoff" once the openstack compute and neutron charts are installed (compute-kit.sh) in AIO setup.

ubuntu@gbk-osh-aio-contrail:~/openstack-helm$ kubectl describe pods contrail-vrouter-agent-vwdq5 -n openstack
Name: contrail-vrouter-agent-vwdq5
Namespace: openstack
Node: gbk-osh-aio-contrail/172.17.0.1
Start Time: Wed, 07 Feb 2018 16:34:26 +0000
Labels: application=opencontrail
                component=contrail-vrouter-agent
                controller-revision-hash=2206812872
                pod-template-generation=1
                release_group=contrail-vrouter
Annotations: kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"DaemonSet","namespace":"openstack","name":"contrail-vrouter-agent","uid":"c2807570-0c24-11e8-9704-fa163e52...
Status: Running
IP: 172.17.0.1
Created By: DaemonSet/contrail-vrouter-agent
Controlled By: DaemonSet/contrail-vrouter-agent
Init Containers:
  init:
    Container ID: docker://a823c57d98fbe2530b1928d01a52fe6e528bb7c0797de76c81f41c50acec805f
    Image: quay.io/stackanetes/kubernetes-entrypoint:v0.2.1
    Image ID: docker-pullable://quay.io/stackanetes/kubernetes-entrypoint@sha256:cd8758c539501cd3d4c2b3029d2e774ce1f2260584c0c8d3d8d8c473ba4285bb
    Port: <none>
    Command:
      kubernetes-entrypoint
    State: Terminated
      Reason: Completed
      Exit Code: 0
      Started: Wed, 07 Feb 2018 16:34:29 +0000
      Finished: Wed, 07 Feb 2018 16:34:32 +0000
    Ready: True
    Restart Count: 0
    Environment:
      POD_NAME: contrail-vrouter-agent-vwdq5 (v1:metadata.name)
      NAMESPACE: openstack (v1:metadata.namespace)
      INTERFACE_NAME: eth0
      DEPENDENCY_SERVICE:
      DEPENDENCY_JOBS:
      DEPENDENCY_DAEMONSET: contrail-config
      DEPENDENCY_CONTAINER:
      COMMAND: echo done
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-pbrgn (ro)
  contrail-agent-init-kernel:
    Container ID: docker://75883d10384aa510d71e49790ced3a134af86cfe8ef0cc5f0ab07a697bc58e5c
    Image: docker.io/opencontrail/contrail-agent-vrouter-init-kernel:5.0.0-175-ubuntu16-newton
    Image ID: docker-pullable://opencontrail/contrail-agent-vrouter-init-kernel@sha256:2f9bd9fe892c309b9e9e8e39a5e5f4dec722c6b154c671d80f7d4853da75d6d4
    Port: <none>
    State: Terminated
      Reason: Completed
      Exit Code: 0
      Started: Wed, 07 Feb 2018 16:34:35 +0000
      Finished: Wed, 07 Feb 2018 16:34:36 +0000
    Ready: True
    Restart Count: 0
    Environment Variables from:
      configmap-vrouter ConfigMap Optional: false
      configmap-vrouter-auth ConfigMap Optional: false
    Environment: <none>
    Mounts:
      /lib/modules from lib-modules (rw)
      /usr/src from usr-src (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-pbrgn (ro)
Containers:
  contrail-vrouter-agent:
    Container ID: docker://c7a1d8f3ba0e27784c2b63611eccc82d3cce99387af9ed2d411f61273924be02
    Image: docker.io/opencontrail/contrail-agent-vrouter:5.0.0-175-centos7-newton
    Image ID: docker-pullable://20.20.20.6:5000/opencontrail/contrail-agent-vrouter@sha256:93f944a592004f4563f7e0bec4b83442243926990f6dc3e895b002eaa4512609
    Port: <none>
    State: Waiting
      Reason: CrashLoopBackOff
    Last State: Terminated
      Reason: Completed
      Exit Code: 0
      Started: Wed, 07 Feb 2018 19:43:36 +0000
      Finished: Wed, 07 Feb 2018 19:43:40 +0000
    Ready: False
    Restart Count: 41
    Environment Variables from:
      configmap-vrouter ConfigMap Optional: false
      configmap-vrouter-auth ConfigMap Optional: false
    Environment:
      PHYSICAL_INTERFACE: eth0
    Mounts:
      /lib/modules from lib-modules (rw)
      /usr/src from usr-src (rw)
      /var/lib/contrail/ from var-lib-contrail (rw)
      /var/log/contrail from var-log-contrail (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-pbrgn (ro)
Conditions:
  Type Status
  Initialized True
  Ready False
  PodScheduled True
Volumes:
  usr-src:
    Type: HostPath (bare host directory volume)
    Path: /usr/src
  lib-modules:
    Type: HostPath (bare host directory volume)
    Path: /lib/modules
  var-lib-contrail:
    Type: HostPath (bare host directory volume)
    Path: /var/lib/contrail/
  var-log-contrail:
    Type: HostPath (bare host directory volume)
    Path: /var/log/contrail/
  default-token-pbrgn:
    Type: Secret (a volume populated by a Secret)
    SecretName: default-token-pbrgn
    Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node-role.kubernetes.io/master:NoSchedule
                 node.alpha.kubernetes.io/notReady:NoExecute
                 node.alpha.kubernetes.io/unreachable:NoExecute
                 node.kubernetes.io/disk-pressure:NoSchedule
                 node.kubernetes.io/memory-pressure:NoSchedule
Events:
  Type Reason Age From Message
  ---- ------ ---- ---- -------
  Warning FailedSync 6m (x718 over 3h) kubelet, gbk-osh-aio-contrail Error syncing pod
  Warning BackOff 1m (x736 over 3h) kubelet, gbk-osh-aio-contrail Back-off restarting failed container

ubuntu@gbk-osh-aio-contrail:~/openstack-helm$ kubectl logs -f contrail-vrouter-agent-vwdq5 -n openstack
++ tr -d '"'
++ awk -F= '/^ID=/{print $2}' /etc/os-release
INFO: detected linux id: centos
+ linux=centos
+ echo 'INFO: detected linux id: centos'
+ [[ centos == \u\b\u\n\t\u ]]
+ [[ centos == \c\e\n\t\o\s ]]
+ src_path=/usr/lib/python2.7/site-packages
+ mkdir -p /opt/plugin/site-packages
+ for module in neutron_plugin_contrail vnc_api cfgm_common neutron_lbaas
++ ls -d /usr/lib/python2.7/site-packages/neutron_plugin_contrail /usr/lib/python2.7/site-packages/neutron_plugin_contrail-0.1dev-py2.7.egg-info
+ for item in '`ls -d $src_path/${module}*`'
+ cp -r /usr/lib/python2.7/site-packages/neutron_plugin_contrail /opt/plugin/site-packages/
+ for item in '`ls -d $src_path/${module}*`'
+ cp -r /usr/lib/python2.7/site-packages/neutron_plugin_contrail-0.1dev-py2.7.egg-info /opt/plugin/site-packages/
+ for module in neutron_plugin_contrail vnc_api cfgm_common neutron_lbaas
++ ls -d /usr/lib/python2.7/site-packages/vnc_api /usr/lib/python2.7/site-packages/vnc_api-5.0.0-py2.7.egg-info
+ for item in '`ls -d $src_path/${module}*`'
+ cp -r /usr/lib/python2.7/site-packages/vnc_api /opt/plugin/site-packages/
+ for item in '`ls -d $src_path/${module}*`'
+ cp -r /usr/lib/python2.7/site-packages/vnc_api-5.0.0-py2.7.egg-info /opt/plugin/site-packages/
+ for module in neutron_plugin_contrail vnc_api cfgm_common neutron_lbaas
++ ls -d /usr/lib/python2.7/site-packages/cfgm_common /usr/lib/python2.7/site-packages/cfgm_common-0.1dev-py2.7.egg-info
+ for item in '`ls -d $src_path/${module}*`'
+ cp -r /usr/lib/python2.7/site-packages/cfgm_common /opt/plugin/site-packages/
+ for item in '`ls -d $src_path/${module}*`'
+ cp -r /usr/lib/python2.7/site-packages/cfgm_common-0.1dev-py2.7.egg-info /opt/plugin/site-packages/
+ for module in neutron_plugin_contrail vnc_api cfgm_common neutron_lbaas
++ ls -d /usr/lib/python2.7/site-packages/neutron_lbaas /usr/lib/python2.7/site-packages/neutron_lbaas-9.2.2-py2.7.egg-info
+ for item in '`ls -d $src_path/${module}*`'
+ cp -r /usr/lib/python2.7/site-packages/neutron_lbaas /opt/plugin/site-packages/
+ for item in '`ls -d $src_path/${module}*`'
+ cp -r /usr/lib/python2.7/site-packages/neutron_lbaas-9.2.2-py2.7.egg-info /opt/plugin/site-packages/
ubuntu@gbk-osh-aio-contrail:~/openstack-helm$

Qasim Arham (qarham-h)
information type: Proprietary → Public
tags: added: csg
Jeba Paulaiyan (jebap)
tags: added: helm
removed: contrail-helm
Revision history for this message
alexey-mr (alexey-morlang) wrote :

For now you should use containers from opencontrailnightly,
Could you recheck with contrainers from https://hub.docker.com/u/opencontrailnightly/?page=1

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.