[pike->queens] (OS::TripleO::Services::FluentdClient) could not be found.

[Jose Luis Franco]

When running the new upgrades workflow to upgrade from Pike to Queens an error is being displayed after the init-update command:
openstack overcloud upgrade --init-update --container-registry-file containers-default-parameters.yaml -e init-repo.yaml

u'message': u"Failed to run action [action_ex_id=d2f90517-0e7c-4efd-841b-b4f7ed991800, action_cls='<class 'mistral.actions.action_factory.UpdateStackAction'>', attributes='{}', params='{u'ceph_ansible_playbook'
: u'/usr/share/ceph-ansible/site-docker.yml.sample', u'container': u'overcloud', u'environments': {u'resource_registry': {u'OS::TripleO::Services::FluentdClient': u'OS::Heat::None'}}, u'timeout': 240, u'containe
r_registry': {u'parameter_defaults': {u'DockerNeutronApiImage': u'192.168.24.1:8787/rhosp13/openstack-neutron-server:13.0-20180126.1', u'DockerAodhListenerImage': u'192.168.24.1:8787/rhosp13/openstack-aodh-liste
ner:13.0-20180126.1', u'DockerGnocchiStatsdImage': u'192.168.24.1:8787/rhosp13/openstack-gnocchi-statsd:13.0-20180126.1', u'DockerCeilometerNotificationImage': u'192.168.24.1:8787/rhosp13/openstack-ceilometer-no
tification:13.0-20180126.1', u'DockerHAProxyConfigImage': u'192.168.24.1:8787/rhosp13/openstack-haproxy:13.0-20180126.1', u'DockerRabbitmqImage': u'192.168.24.1:8787/rhosp13/openstack-rabbitmq:13.0-20180126.1',
u'DockerNovaConsoleauthImage': u'192.168.24.1:8787/rhosp13/openstack-nova-consoleauth:13.0-20180126.1', u'DockerAodhConfigImage': u'192.168.24.1:8787/rhosp13/openstack-aodh-api:13.0-20180126.1', u'DockerInsecure
RegistryAddress': [u'192.168.24.1:8787'], u'DockerIscsidImage': u'192.168.24.1:8787/rhosp13/openstack-iscsid:13.0-20180126.1', u'DockerGnocchiMetricdImage': u'192.168.24.1:8787/rhosp13/openstack-gnocchi-metricd:
13.0-20180126.1', u'DockerIscsidConfigImage': u'192.168.24.1:8787/rhosp13/openstack-iscsid:13.0-20180126.1', u'DockerNovaMetadataImage': u'192.168.24.1:8787/rhosp13/openstack-nova-api:13.0-20180126.1', u'DockerC
inderApiImage': u'192.168.24.1:8787/rhosp13/openstack-cinder-api:13.0-20180126.1', u'DockerNovaComputeImage': u'192.168.24.1:8787/rhosp13/openstack-nova-compute:13.0-20180126.1', u'DockerGnocchiConfigImage': u'1
92.168.24.1:8787/rhosp13/openstack-gnocchi-api:13.0-20180126.1', u'DockerCeilometerCentralImage': u'192.168.24.1:8787/rhosp13/openstack-ceilometer-central:13.0-20180126.1', u'DockerNeutronL3AgentImage': u'192.16
8.24.1:8787/rhosp13/openstack-neutron-l3-agent:13.0-20180126.1', u'DockerCeilometerComputeImage': u'192.168.24.1:8787/rhosp13/openstack-ceilometer-compute:13.0-20180126.1', u'DockerRedisImage': u'192.168.24.1:87
87/rhosp13/openstack-redis:13.0-20180126.1', u'DockerClustercheckImage': u'192.168.24.1:8787/rhosp13/openstack-mariadb:13.0-20180126.1', u'DockerHorizonImage': u'192.168.24.1:8787/rhosp13/openstack-horizon:13.0-
20180126.1', u'DockerCinderConfigImage': u'192.168.24.1:8787/rhosp13/openstack-cinder-api:13.0-20180126.1', u'DockerSwiftContainerImage': u'192.168.24.1:8787/rhosp13/openstack-swift-container:13.0-20180126.1', u
'DockerGnocchiApiImage': u'192.168.24.1:8787/rhosp13/openstack-gnocchi-api:13.0-20180126.1', u'DockerMysqlImage': u'192.168.24.1:8787/rhosp13/openstack-mariadb:13.0-20180126.1', u'DockerAodhEvaluatorImage': u'19
2.168.24.1:8787/rhosp13/openstack-aodh-evaluator:13.0-20180126.1', u'DockerPankoApiImage': u'192.168.24.1:8787/rhosp13/openstack-panko-api:13.0-20180126.1', u'DockerNovaApiImage': u'192.168.24.1:8787/rhosp13/ope
nstack-nova-api:13.0-20180126.1', u'DockerMysqlClientConfigImage': u'192.168.24.1:8787/rhosp13/openstack-mariadb:13.0-20180126.1', u'DockerNovaVncProxyImage': u'192.168.24.1:8787/rhosp13/openstack-nova-novncprox
y:13.0-20180126.1', u'DockerClustercheckConfigImage': u'192.168.24.1:8787/rhosp13/openstack-mariadb:13.0-20180126.1', u'DockerNeutronMetadataImage': u'192.168.24.1:8787/rhosp13/openstack-neutron-metadata-agent:1
3.0-20180126.1', u'DockerKeystoneImage': u'192.168.24.1:8787/rhosp13/openstack-keystone:13.0-20180126.1', u'DockerCephDaemonImage': u'192.168.24.1:8787/rhceph/rhceph-3-rhel7:latest', u'DockerNovaConductorImage':
 u'192.168.24.1:8787/rhosp13/openstack-nova-conductor:13.0-20180126.1', u'DockerNovaPlacementConfigImage': u'192.168.24.1:8787/rhosp13/openstack-nova-placement-api:13.0-20180126.1', u'DockerNovaLibvirtImage': u'
192.168.24.1:8787/rhosp13/openstack-nova-libvirt:13.0-20180126.1', u'DockerMysqlConfigImage': u'192.168.24.1:8787/rhosp13/openstack-mariadb:13.0-20180126.1', u'DockerRabbitmqConfigImage': u'192.168.24.1:8787/rho
sp13/openstack-rabbitmq:13.0-20180126.1', u'DockerKeystoneConfigImage': u'192.168.24.1:8787/rhosp13/openstack-keystone:13.0-20180126.1', u'DockerAodhApiImage': u'192.168.24.1:8787/rhosp13/openstack-aodh-api:13.0
-20180126.1', u'DockerCinderSchedulerImage': u'192.168.24.1:8787/rhosp13/openstack-cinder-scheduler:13.0-20180126.1', u'DockerMemcachedImage': u'192.168.24.1:8787/rhosp13/openstack-memcached:13.0-20180126.1', u'
DockerHeatApiCfnImage': u'192.168.24.1:8787/rhosp13/openstack-heat-api-cfn:13.0-20180126.1', u'DockerNovaConfigImage': u'192.168.24.1:8787/rhosp13/openstack-nova-api:13.0-20180126.1', u'DockerSwiftAccountImage':
 u'192.168.24.1:8787/rhosp13/openstack-swift-account:13.0-20180126.1', u'DockerGlanceApiImage': u'192.168.24.1:8787/rhosp13/openstack-glance-api:13.0-20180126.1', u'DockerGlanceApiConfigImage': u'192.168.24.1:87
87/rhosp13/openstack-glance-api:13.0-20180126.1', u'DockerNeutronConfigImage': u'192.168.24.1:8787/rhosp13/openstack-neutron-server:13.0-20180126.1', u'DockerMemcachedConfigImage': u'192.168.24.1:8787/rhosp13/op
enstack-memcached:13.0-20180126.1', u'DockerHeatApiCfnConfigImage': u'192.168.24.1:8787/rhosp13/openstack-heat-api-cfn:13.0-20180126.1', u'DockerHeatConfigImage': u'192.168.24.1:8787/rhosp13/openstack-heat-api:1
3.0-20180126.1', u'DockerAodhNotifierImage': u'192.168.24.1:8787/rhosp13/openstack-aodh-notifier:13.0-20180126.1', u'DockerSwiftProxyImage': u'192.168.24.1:8787/rhosp13/openstack-swift-proxy-server:13.0-20180126
.1', u'DockerCrondImage': u'192.168.24.1:8787/rhosp13/openstack-cron:13.0-20180126.1', u'DockerHeatApiConfigImage': u'192.168.24.1:8787/rhosp13/openstack-heat-api:13.0-20180126.1', u'DockerSwiftObjectImage': u'1
92.168.24.1:8787/rhosp13/openstack-swift-object:13.0-20180126.1', u'DockerHorizonConfigImage': u'192.168.24.1:8787/rhosp13/openstack-horizon:13.0-20180126.1', u'DockerNovaLibvirtConfigImage': u'192.168.24.1:8787
/rhosp13/openstack-nova-compute:13.0-20180126.1', u'DockerRedisConfigImage': u'192.168.24.1:8787/rhosp13/openstack-redis:13.0-20180126.1', u'DockerPankoConfigImage': u'192.168.24.1:8787/rhosp13/openstack-panko-a
pi:13.0-20180126.1', u'DockerHeatApiImage': u'192.168.24.1:8787/rhosp13/openstack-heat-api:13.0-20180126.1', u'DockerNovaSchedulerImage': u'192.168.24.1:8787/rhosp13/openstack-nova-scheduler:13.0-20180126.1', u'
DockerNovaPlacementImage': u'192.168.24.1:8787/rhosp13/openstack-nova-placement-api:13.0-20180126.1', u'DockerSwiftConfigImage': u'192.168.24.1:8787/rhosp13/openstack-swift-proxy-server:13.0-20180126.1', u'Docke
rCrondConfigImage': u'192.168.24.1:8787/rhosp13/openstack-cron:13.0-20180126.1', u'DockerCeilometerConfigImage': u'192.168.24.1:8787/rhosp13/openstack-ceilometer-central:13.0-20180126.1', u'DockerHeatEngineImage
': u'192.168.24.1:8787/rhosp13/openstack-heat-engine:13.0-20180126.1', u'DockerOpenvswitchImage': u'192.168.24.1:8787/rhosp13/openstack-neutron-openvswitch-agent:13.0-20180126.1', u'DockerNeutronDHCPImage': u'19
2.168.24.1:8787/rhosp13/openstack-neutron-dhcp-agent:13.0-20180126.1', u'DockerHAProxyImage': u'192.168.24.1:8787/rhosp13/openstack-haproxy:13.0-20180126.1', u'DockerCinderVolumeImage': u'192.168.24.1:8787/rhosp
13/openstack-cinder-volume:13.0-20180126.1'}}}']\n ERROR: resources.CephStorageServiceChain<https://192.168.24.2:13808/v1/AUTH_9cf3b65b76234773a1ce897bd47dcdcf/overcloud/common/services.yaml>: : The Resource Typ
e (OS::TripleO::Services::FluentdClient) could not be found.",
 u'status': u'FAILED'}

[Jose Luis Franco (jfrancoa)]

FluentdClient service name has been changed from pike to queens to OS::TripleO::Services::Fluentd: https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml#L69

[Thomas Herve (therve)]

The code tested here is not merged...

[Zane Bitter (zaneb)]

It looks like the error occurs when validating a new template/environment at the beginning of a stack update. The error would be consistent with building a fresh (Queens) environment while keeping the same Pike templates. That would be the first thing to check.

[Yurii Prokulevych (yprokule)]

Other services that produce same error:

OS::TripleO::Services::CeilometerApi
OS::TripleO::Services::CeilometerCollector
OS::TripleO::Services::CeilometerExpirer
OS::TripleO::Services::ManilaBackendGeneric

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/559317

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/560835

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/560835
Committed: https://git.openstack.org/cgit/openstack/tripleo-upgrade/commit/?id=67aa778890f5f3e203f9278f5bf71172c2931ca0
Submitter: Zuul
Branch: stable/queens

commit 67aa778890f5f3e203f9278f5bf71172c2931ca0
Author: Yurii Prokulevych <email address hidden>
Date: Thu Apr 12 10:56:05 2018 +0200

    Adjust roles-data file for P->Q upgrade.

    As described in rhbz-1540546 and rhbz-1541382 services available
     during P deployment got renamed/removed in Q.
    This change modifies custom roles-data file wrt aforementioned
     changes.

    Partial-Bug: 1708680
    Partial-Bug: 1746493

    Depends-On: I9b488d84fa6e86ed9ce03c7b5fda5d42f713724d
    Change-Id: I8dc672d3b909afc781c3f62a77c16aa1445bec40

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/562142

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/559317
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=3ed0be0a1f8e89622dafbda002e42ec06bcbb94c
Submitter: Zuul
Branch: master

commit 3ed0be0a1f8e89622dafbda002e42ec06bcbb94c
Author: Jose Luis Franco Arza <email address hidden>
Date: Fri Apr 6 13:54:40 2018 +0200

    Disable FluentClient service for ffwd/upgrades.

    FluentClient service has been renamed
    into Fluentd [0] for queens. This patch
    handles the disabling of the old FluentdClient
    service.

    [0] Idb9886f04d56ffc75a78c4059ff319b58b4acf9f

    Change-Id: I085973f3d23fd78c16cba94a91692421956b301b
    Closes-Bug: #1746493

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/562142
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=eff22ee2dab6983a6b06d4d1237cba27472ff296
Submitter: Zuul
Branch: stable/queens

commit eff22ee2dab6983a6b06d4d1237cba27472ff296
Author: Jose Luis Franco Arza <email address hidden>
Date: Fri Apr 6 13:54:40 2018 +0200

    Disable FluentClient service for ffwd/upgrades.

    FluentClient service has been renamed
    into Fluentd [0] for queens. This patch
    handles the disabling of the old FluentdClient
    service.

    [0] Idb9886f04d56ffc75a78c4059ff319b58b4acf9f
    (cherry picked from commit I085973f3d23fd78c16cba94a91692421956b301b)
    Change-Id: I085973f3d23fd78c16cba94a91692421956b301b
    Closes-Bug: #1746493

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 8.0.2 release.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/564969

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/564969
Committed: https://git.openstack.org/cgit/openstack/tripleo-upgrade/commit/?id=38e9f537f14a1d518ec29c0794730728d4fca365
Submitter: Zuul
Branch: master

commit 38e9f537f14a1d518ec29c0794730728d4fca365
Author: Yurii Prokulevych <email address hidden>
Date: Thu Apr 12 10:56:05 2018 +0200

    Adjust roles-data file for P->Q upgrade.

    As described in rhbz-1540546 and rhbz-1541382 services available
     during P deployment got renamed/removed in Q.
    This change modifies custom roles-data file wrt aforementioned
     changes.

    Partial-Bug: 1708680
    Partial-Bug: 1746493

    Depends-On: I9b488d84fa6e86ed9ce03c7b5fda5d42f713724d
    Change-Id: I8dc672d3b909afc781c3f62a77c16aa1445bec40
    (cherry picked from commit 67aa778890f5f3e203f9278f5bf71172c2931ca0)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 9.0.0.0b3 development milestone.