Fail to scale up openshift master nodes

Bug #1802319 reported by Martin André
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
High
Martin André

Bug Description

Scaling out the openshift deployment adding a new master node fails with:

TASK [etcd : Ensure CA certificate exists on etcd_ca_host] *********************
ok: [openshift-openshiftmaster-1 -> 192.168.24.24]

TASK [etcd : fail] *************************************************************
fatal: [openshift-openshiftmaster-1]: FAILED! => {"changed": false, "msg": "CA certificate /etc/etcd/ca/ca.crt doesn't exist on CA host openshift-openshiftmaster-1. Apply 'etcd_ca' action from `etcd` role to openshift-openshiftmaster-1.\n"}

NO MORE HOSTS LEFT *************************************************************

PLAY RECAP *********************************************************************
localhost : ok=39 changed=0 unreachable=0 failed=0
openshift-openshiftinfra-0 : ok=27 changed=5 unreachable=0 failed=0
openshift-openshiftinfra-1 : ok=27 changed=5 unreachable=0 failed=0
openshift-openshiftinfra-2 : ok=27 changed=5 unreachable=0 failed=0
openshift-openshiftmaster-0 : ok=53 changed=7 unreachable=0 failed=0
openshift-openshiftmaster-1 : ok=242 changed=71 unreachable=0 failed=1
openshift-openshiftworker-0 : ok=27 changed=5 unreachable=0 failed=0
openshift-openshiftworker-1 : ok=27 changed=5 unreachable=0 failed=0
openshift-openshiftworker-2 : ok=27 changed=5 unreachable=0 failed=0

INSTALLER STATUS ***************************************************************
Initialization : Complete (0:01:14)
Node Bootstrap Preparation : Complete (0:04:51)

Failure summary:

  1. Hosts: openshift-openshiftmaster-1
     Play: Create etcd client certificates for master hosts
     Task: etcd : fail
     Message: CA certificate /etc/etcd/ca/ca.crt doesn't exist on CA host openshift-openshiftmaster-1. Apply 'etcd_ca' action from `etcd` role to openshift-openshiftmaster-1.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (master)

Fix proposed to branch: master
Review: https://review.openstack.org/616584

Changed in tripleo:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/617660

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tripleo-heat-templates (master)

Change abandoned by Martin André (<email address hidden>) on branch: master
Review: https://review.openstack.org/617660
Reason: Dup of I523ed32681818112b7570aeab3ede32ed4ec322b

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (master)

Reviewed: https://review.openstack.org/616584
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=4702ad329d1ad1624a4b43c3487dc614f833839c
Submitter: Zuul
Branch: master

commit 4702ad329d1ad1624a4b43c3487dc614f833839c
Author: Martin André <email address hidden>
Date: Thu Nov 8 16:01:53 2018 +0100

    Call etcd scaleup playbook when adding master nodes

    We're collocating the etcd and master nodes, we should also be run the
    etcd scaleup playbook when adding new master nodes to the cluster.
    However, this needs to happen in a separate ansible run as the master
    node scale up and etcd scale up use different inventory files.

    Change-Id: I523ed32681818112b7570aeab3ede32ed4ec322b
    Closes-Bug: #1802319

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.openstack.org/625163

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/rocky)

Reviewed: https://review.openstack.org/625163
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=f36adbc3efdb608a7d587df29bf5f5b33f0378b6
Submitter: Zuul
Branch: stable/rocky

commit f36adbc3efdb608a7d587df29bf5f5b33f0378b6
Author: Martin André <email address hidden>
Date: Thu Nov 8 16:01:53 2018 +0100

    Call etcd scaleup playbook when adding master nodes

    We're collocating the etcd and master nodes, we should also be run the
    etcd scaleup playbook when adding new master nodes to the cluster.
    However, this needs to happen in a separate ansible run as the master
    node scale up and etcd scale up use different inventory files.

    Change-Id: I523ed32681818112b7570aeab3ede32ed4ec322b
    Closes-Bug: #1802319
    (cherry picked from commit 4702ad329d1ad1624a4b43c3487dc614f833839c)

tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 9.2.0

This issue was fixed in the openstack/tripleo-heat-templates 9.2.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 10.3.0

This issue was fixed in the openstack/tripleo-heat-templates 10.3.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.