Fuel for OpenStack

Deployment failed due to logging.pp: did not find expected key while parsing a block mapping at line 2 column 3

Bug #1525014 reported by Maksym Strukov on 2015-12-10

This bug affects 3 people

Affects		Status	Importance	Assigned to	Milestone
	Fuel for OpenStack	Fix Released	High	Alex Schultz	Fuel for OpenStack 8.0

Bug Description

Scenario:
1. Install detach-rabbitmq [0] plugin
2. Create cluster
3. Add 3 nodes with controller role
4. Add 3 nodes with rabbit role
5. Add 1 compute and cinder
6. Verify networks
7. Deploy the cluster

Actual:
'Deployment has failed. Method granular_deploy. Deployment failed on nodes 1.

All nodes puppet logs contains following error:

'''
2015-12-10 01:20:05 +0000 Scope(Class[main]) (notice): MODULAR: logging.pp
2015-12-10 01:20:05 +0000 Puppet (err): Could not run: (<unknown>): did not find expected key while parsing a block mapping at line 2 column 3
/usr/lib/ruby/1.9.1/psych.rb:203:in `parse'
/usr/lib/ruby/1.9.1/psych.rb:203:in `parse_stream'
/usr/lib/ruby/1.9.1/psych.rb:151:in `parse'
/usr/lib/ruby/1.9.1/psych.rb:127:in `load'
/usr/lib/ruby/vendor_ruby/safe_yaml.rb:48:in `block in unsafe_load_file'
/usr/lib/ruby/vendor_ruby/safe_yaml.rb:48:in `open'
/usr/lib/ruby/vendor_ruby/safe_yaml.rb:48:in `unsafe_load_file'
/usr/lib/ruby/vendor_ruby/safe_yaml.rb:24:in `load_file_with_options'
/usr/lib/ruby/vendor_ruby/hiera/config.rb:70:in `yaml_load_file'
/usr/lib/ruby/vendor_ruby/hiera/config.rb:20:in `load'
/usr/lib/ruby/vendor_ruby/hiera_puppet.rb:62:in `hiera_config'
/usr/lib/ruby/vendor_ruby/hiera_puppet.rb:55:in `hiera'
/usr/lib/ruby/vendor_ruby/hiera_puppet.rb:11:in `lookup'
/usr/lib/ruby/vendor_ruby/puppet/parser/functions/hiera.rb:32:in `block in <module:Functions>'
/usr/lib/ruby/vendor_ruby/puppet/parser/functions.rb:164:in `block (2 levels) in newfunction'
/usr/lib/ruby/vendor_ruby/puppet/util/profiler/around_profiler.rb:58:in `profile'
/usr/lib/ruby/vendor_ruby/puppet/util/profiler.rb:51:in `profile'
/usr/lib/ruby/vendor_ruby/puppet/parser/functions.rb:157:in `block in newfunction'
/usr/lib/ruby/vendor_ruby/puppet/parser/ast/function.rb:42:in `evaluate'
/usr/lib/ruby/vendor_ruby/puppet/parser/ast.rb:61:in `safeevaluate'
/usr/lib/ruby/vendor_ruby/puppet/parser/ast/vardef.rb:14:in `evaluate'
/usr/lib/ruby/vendor_ruby/puppet/parser/ast.rb:61:in `safeevaluate'
/usr/lib/ruby/vendor_ruby/puppet/parser/ast/block_expression.rb:11:in `block in evaluate'
/usr/lib/ruby/vendor_ruby/puppet/parser/ast/block_expression.rb:10:in `each'
/usr/lib/ruby/vendor_ruby/puppet/parser/ast/block_expression.rb:10:in `evaluate'
/usr/lib/ruby/vendor_ruby/puppet/parser/ast.rb:61:in `safeevaluate'
/usr/lib/ruby/vendor_ruby/puppet/resource/type.rb:129:in `evaluate_code'
/usr/lib/ruby/vendor_ruby/puppet/parser/resource.rb:81:in `block in evaluate'
/usr/lib/ruby/vendor_ruby/puppet/util/profiler/around_profiler.rb:58:in `profile'
/usr/lib/ruby/vendor_ruby/puppet/util/profiler.rb:51:in `profile'
/usr/lib/ruby/vendor_ruby/puppet/parser/resource.rb:77:in `evaluate'
/usr/lib/ruby/vendor_ruby/puppet/parser/compiler.rb:426:in `evaluate_main'
/usr/lib/ruby/vendor_ruby/puppet/parser/compiler.rb:135:in `block (2 levels) in compile'
/usr/lib/ruby/vendor_ruby/puppet/util/profiler/around_profiler.rb:58:in `profile'
/usr/lib/ruby/vendor_ruby/puppet/util/profiler.rb:51:in `profile'
/usr/lib/ruby/vendor_ruby/puppet/parser/compiler.rb:135:in `block in compile'
/usr/lib/ruby/vendor_ruby/puppet/context.rb:64:in `override'
/usr/lib/ruby/vendor_ruby/puppet.rb:244:in `override'
/usr/lib/ruby/vendor_ruby/puppet/parser/compiler.rb:121:in `compile'
/usr/lib/ruby/vendor_ruby/puppet/parser/compiler.rb:34:in `compile'
/usr/lib/ruby/vendor_ruby/puppet/indirector/catalog/compiler.rb:95:in `block (2 levels) in compile'
/usr/lib/ruby/vendor_ruby/puppet/util/profiler/around_profiler.rb:58:in `profile'
/usr/lib/ruby/vendor_ruby/puppet/util/profiler.rb:51:in `profile'
/usr/lib/ruby/vendor_ruby/puppet/indirector/catalog/compiler.rb:93:in `block in compile'
/usr/lib/ruby/vendor_ruby/puppet/util.rb:161:in `block in benchmark'
/usr/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
/usr/lib/ruby/vendor_ruby/puppet/util.rb:160:in `benchmark'
/usr/lib/ruby/vendor_ruby/puppet/indirector/catalog/compiler.rb:92:in `compile'
/usr/lib/ruby/vendor_ruby/puppet/indirector/catalog/compiler.rb:52:in `find'
/usr/lib/ruby/vendor_ruby/puppet/indirector/indirection.rb:201:in `find'
/usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:222:in `block in main'
/usr/lib/ruby/vendor_ruby/puppet/context.rb:64:in `override'
/usr/lib/ruby/vendor_ruby/puppet.rb:244:in `override'
/usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:198:in `main'
/usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:159:in `run_command'
/usr/lib/ruby/vendor_ruby/puppet/application.rb:381:in `block (2 levels) in run'
/usr/lib/ruby/vendor_ruby/puppet/application.rb:507:in `plugin_hook'
/usr/lib/ruby/vendor_ruby/puppet/application.rb:381:in `block in run'
/usr/lib/ruby/vendor_ruby/puppet/util.rb:496:in `exit_on_fail'
/usr/lib/ruby/vendor_ruby/puppet/application.rb:381:in `run'
/usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:146:in `run'
/usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:92:in `execute'
/usr/bin/puppet:8:in `<main>'
'''

Env: 8.0-277
https://product-ci.infra.mirantis.net/job/8.0.system_test.ubuntu.plugins.thread_2_separate_services/69/testReport/(root)/separate_rabbit_service/separate_rabbit_service/

[0] - http://jenkins-product.srt.mirantis.net:8080/job/build-fuel-plugins/lastSuccessfulBuild/artifact/built_plugins/detach-rabbitmq-1.0-1.0.1-1.noarch.rpm

See original description

Tags:

Revision history for this message

Maksym Strukov (unbelll) wrote on 2015-12-10:

fail_error_separate_rabbit_service-fuel-snapshot-2015-12-10_01-20-34.tar.xz Edit (6.1 MiB, application/octet-stream)

Nastya Urlapova (aurlapova) on 2015-12-11

Changed in fuel:
milestone:	none → 8.0
status:	New → Confirmed
assignee:	nobody → Fuel Library Team (fuel-library)

Maksim Malchuk (mmalchuk) on 2015-12-11

Changed in fuel:
assignee:	Fuel Library Team (fuel-library) → Maksim Malchuk (mmalchuk)
status:	Confirmed → In Progress

Maksym Strukov (unbelll) on 2015-12-11

description:	updated
description:	updated

Revision history for this message

Maksim Malchuk (mmalchuk) wrote on 2015-12-11:

same bug: https://bugs.launchpad.net/fuel/+bug/1525180

Andrey Maximov (maximov) on 2015-12-15

tags:

added: area-library team-bugfix

Nastya Urlapova (aurlapova) on 2015-12-16

tags:

added: swarm-fail-driver

Revision history for this message

Maksim Malchuk (mmalchuk) wrote on 2015-12-18:

I think this is fix for this bug:
https://review.openstack.org/#/c/259224/
https://review.openstack.org/#/c/259220/

Changed in fuel:
assignee:	Maksim Malchuk (mmalchuk) → Alex Schultz (alex-schultz)

Matthew Mosesohn (raytrac3r) on 2015-12-18

Changed in fuel:
status:	In Progress → Fix Committed

Revision history for this message

Sergey Shevorakov (sshevorakov) wrote on 2015-12-21:

Changing tag from swarm-fail-driver to swarm-blocker since this bug fails 6 test cases (1.9% of all).

tags:

added: swarm-blocker
removed: swarm-fail-driver

Dmitriy Kruglov (dkruglov) on 2015-12-21

tags:

added: on-verification

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-21: Related fix proposed to fuel-plugin-detach-rabbitmq (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/260073

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-21: Related fix proposed to fuel-plugin-detach-database (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/260074

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-21: Related fix proposed to fuel-plugin-detach-keystone (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/260075

Dmitriy Kruglov (dkruglov) on 2015-12-21

tags:

removed: on-verification

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-22: Related fix merged to fuel-plugin-detach-rabbitmq (master)

Reviewed: https://review.openstack.org/260073
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-detach-rabbitmq/commit/?id=f4de3f6f2977a6c521445db50684255527283850
Submitter: Jenkins
Branch: master

commit f4de3f6f2977a6c521445db50684255527283850
Author: Alex Schultz <email address hidden>
Date: Mon Dec 21 09:03:27 2015 -0700

Put plugin hiera in place

This change updates corrects the sed used to update the hiera.yaml for
the plugin to ensure the plugin hiera is actually defined.

    Change-Id: I246332de532b287b92ab308f031e42f9cca83d40
    Closes-Bug: #1528215
    Related-Bug: #1525014

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-22: Related fix merged to fuel-plugin-detach-database (master)

Reviewed: https://review.openstack.org/260074
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-detach-database/commit/?id=4a4b68cc3cf9b2139bf790803d954fb582fdb47b
Submitter: Jenkins
Branch: master

commit 4a4b68cc3cf9b2139bf790803d954fb582fdb47b
Author: Alex Schultz <email address hidden>
Date: Mon Dec 21 09:05:55 2015 -0700

Put plugin hiera in place

This change updates corrects the sed used to update the hiera.yaml for
the plugin to ensure the plugin hiera is actually defined.

    Change-Id: Iba038921724809198e93b7d37760bac1019af891
    Closes-Bug: #1528215
    Related-Bug: #1525014

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-22: Related fix merged to fuel-plugin-detach-keystone (master)

#10

Reviewed: https://review.openstack.org/260075
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-detach-keystone/commit/?id=1b52cf830adf67d5700affedfd68c6177ce32367
Submitter: Jenkins
Branch: master

commit 1b52cf830adf67d5700affedfd68c6177ce32367
Author: Alex Schultz <email address hidden>
Date: Mon Dec 21 09:06:44 2015 -0700

Put plugin hiera in place

This change updates corrects the sed used to update the hiera.yaml for
the plugin to ensure the plugin hiera is actually defined.

    Change-Id: I56b8e6447e201af3378826c539056ec5d8cca795
    Closes-Bug: #1528215
    Related-Bug: #1525014

Revision history for this message

Dmitriy Kruglov (dkruglov) wrote on 2015-12-23:

#11

Verified on MOS 8.0, build 339. The issue is fixed.

ISO details:
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "8.0"
  api: "1.0"
  build_number: "339"
  build_id: "339"
  fuel-nailgun_sha: "bad4d014df29beaf3708f1a050e808d20542b878"
  python-fuelclient_sha: "268847aa06e16f42bb3a3bf851a1869adfc36c46"
  fuel-agent_sha: "1d3a2b8d9e8961ebcdfa5db55e2e809f7dd404a8"
  fuel-nailgun-agent_sha: "92ebd5ade6fab60897761bfa084aefc320bff246"
  astute_sha: "c7ca63a49216744e0bfdfff5cb527556aad2e2a5"
  fuel-library_sha: "7a7c93e8b55d0e3e9ffd64b0b0e29451cdc0cfb0"
  fuel-ostf_sha: "d8cbc4f65361e034193479b19f84747d1c33894e"
  fuel-mirror_sha: "d15edd2128b9a4644f1db8089b0ecdf7954a2e57"
  fuelmenu_sha: "2942a85796d37f09ba8c8c6d762d8813292cf0d4"
  shotgun_sha: "bf79f1ac08a256160f2835a71808ec4f8d2bbf9e"
  network-checker_sha: "d443ef47abeda58d319bc8d33d5005dd09440a02"
  fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b"
  fuelmain_sha: "796125856c2325743124092a52f28e26c013c058"