Ceph octopus incompatible with containerised chrony

Bug #1885689 reported by Mark Goddard
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Medium
Radosław Piliszek
Ussuri
Won't Fix
Medium
Unassigned
Victoria
Won't Fix
Medium
Radosław Piliszek
Wallaby
Fix Released
Medium
Radosław Piliszek
Xena
Fix Released
Medium
Radosław Piliszek

Bug Description

CentOS 8 appears to have chrony enabled and started by default. The chronyd service is disabled and packages uninstalled during kolla-ansible bootstrap-servers, if enable_chrony is true.

The problem with Kolla-containerised chrony is that Ceph Octopus node health checks don’t see it and this puts the node into a warning state. Also, Ceph Orchestrator does a check for time sync during pre-flight checks, and Ceph deployment normally runs before the containerised service is deployed by kolla-ansible.

Related kayobe bug: https://storyboard.openstack.org/#!/story/2007872

Mark Goddard (mgoddard)
Changed in kolla-ansible:
importance: Undecided → Medium
Revision history for this message
Radosław Piliszek (yoctozepto) wrote :

I'm +1 on stopping containerizing chrony - NTP service is a critical part of the base host for its many functions, usually related to synchronization and security.

Revision history for this message
Pierre Riteau (priteau) wrote :

Indeed, it feels odd to deploy a containerised chronyd when it comes enabled by default on CentOS 8. And it would be one fewer image for the Kolla project to build and maintain.

Revision history for this message
Radosław Piliszek (yoctozepto) wrote :

Honestly, I think it was usually on by default on 7 as well, not to mention Ubuntu Bionic.

Revision history for this message
Mark Goddard (mgoddard) wrote :

Agreed in kolla IRC meeting 2020/7/1:

* support configuration of an NTP client/server on the host
* add (timedatectl check?) to prechecks
* switch default of enable_chrony to false, enable host daemon by default

Revision history for this message
Mark Goddard (mgoddard) wrote :

> * support configuration of an NTP client/server on the host

Seems this was not unanimous.

Revision history for this message
Radosław Piliszek (yoctozepto) wrote :

enable_host_ntp looks brokenish too, at least stop advertising this part.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to kolla-ansible (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/738877

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (master)

Fix proposed to branch: master
Review: https://review.opendev.org/740585

Changed in kolla-ansible:
assignee: nobody → Radosław Piliszek (yoctozepto)
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.opendev.org/740586

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/740585
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=3018199f0b57cbab35b06ab84292519ab374fb87
Submitter: Zuul
Branch: master

commit 3018199f0b57cbab35b06ab84292519ab374fb87
Author: Radosław Piliszek <email address hidden>
Date: Sun Jul 12 10:33:24 2020 +0200

    Add timesync prechecks

    If not running containerised chrony, we need to check that host
    has its own means of system clock synchronization.

    Change-Id: I31b3e9ed625d63a4bf82c674593522268c20ec4c
    Partial-Bug: #1885689

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on kolla-ansible (master)

Change abandoned by Radosław Piliszek (<email address hidden>) on branch: master
Review: https://review.opendev.org/738877
Reason: not needed

Mark Goddard (mgoddard)
Changed in kolla-ansible:
milestone: 11.0.0 → none
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 12.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 12.0.0.0rc1 release candidate.

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on kolla-ansible (master)

Change abandoned by "Doug Szumski <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/764355

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.