IHA template fails to send heartbeat due to no credentials

Bug #1100719 reported by Steven Hardy
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Heat
Fix Released
High
Steven Hardy
Grizzly
Fix Released
High
Steven Hardy

Bug Description

The IHA template gets stuck in a bad loop continuously replacing the instance, because cfn-push-stats cannot authenticate with the CloudWatch API, since there is no /etc/cfn/cfn-credentials file - the template needs credentials adding similar to the HA template

Steven Hardy (shardy)
Changed in heat:
status: New → In Progress
importance: Undecided → High
assignee: nobody → Steven Hardy (shardy)
milestone: none → grizzly-3
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to heat (master)

Fix proposed to branch: master
Review: https://review.openstack.org/19935

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/19936

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/19937

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to heat (master)

Reviewed: https://review.openstack.org/19935
Committed: http://github.com/openstack/heat/commit/d1b3cb40434135cf9fd207effd6397d9aecaebaa
Submitter: Jenkins
Branch: master

commit d1b3cb40434135cf9fd207effd6397d9aecaebaa
Author: Steven Hardy <email address hidden>
Date: Thu Jan 17 11:13:48 2013 +0000

    heat templates : add missing credentials to IHA template

    WordPress_Single_Instance_With_IHA lacks credentials so
    cfn-push-stats can't authenticate with the cloudwatch api

    ref bug 1100719

    Change-Id: I218eea927a00b6cef58a4a1ee5d930c57ebb8a2e
    Signed-off-by: Steven Hardy <email address hidden>

Changed in heat:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/19936
Committed: http://github.com/openstack/heat/commit/8d5d9a908d614c251da8de56acb088848d8106aa
Submitter: Jenkins
Branch: master

commit 8d5d9a908d614c251da8de56acb088848d8106aa
Author: Steven Hardy <email address hidden>
Date: Thu Jan 17 11:19:05 2013 +0000

    heat templates : IHA HeartbeatFailureAlarm should be Ref

    cfn-push-stats reference to HeartbeatFailureAlarm should be a
    Ref not a hard-coded string, or the engine fails to find the
    watch because the name lacks the stack prefix

    ref bug 1100719

    Change-Id: I0fbec026b883348b674327ae6e097a9452ce375f
    Signed-off-by: Steven Hardy <email address hidden>

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/19937
Committed: http://github.com/openstack/heat/commit/42f2134ff723be5b3539224ab8f33aac63a71965
Submitter: Jenkins
Branch: master

commit 42f2134ff723be5b3539224ab8f33aac63a71965
Author: Steven Hardy <email address hidden>
Date: Thu Jan 17 11:22:09 2013 +0000

    heat templates : fix IHA HeartbeatFailureAlarm during instance build

    The HeartbeatFailureAlarm triggers prematurely while the instance is
    building, because cfn-init doesn't create the files (hence the
    heartbeat cron-job) until after the packges are all installed.
    If we make the HeartbeatFailureAlarm depend on the WaitCondition, it
    won't be created until the instance is fully built.

    fixes bug 1100719

    Change-Id: Iae73aa0974a3061f56aa3ee52598687f32c0f19b
    Signed-off-by: Steven Hardy <email address hidden>

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to heat (master)

Fix proposed to branch: master
Review: https://review.openstack.org/19953

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to heat (master)

Reviewed: https://review.openstack.org/19953
Committed: http://github.com/openstack/heat/commit/b0af0b1894e40eef4c9a560c85deffcd5df06564
Submitter: Jenkins
Branch: master

commit b0af0b1894e40eef4c9a560c85deffcd5df06564
Author: Steven Hardy <email address hidden>
Date: Thu Jan 17 17:32:25 2013 +0000

    heat engine : watchrule don't run rule for every SampleCount

    We should not be triggering a run_rule (which is an alarm action)
    for every datapoint when the SampleCount statistic is specified,
    otherwise e.g IHA instances get replaced every heartbeat signal!
    run_rule should only be called in response to a rule evaluate(),
    or an explicit override via set_watch_state()

    ref bug 1100719

    Change-Id: I91b144f24b542f48aa7fa98d8d8c404479e13483
    Signed-off-by: Steven Hardy <email address hidden>

Thierry Carrez (ttx)
Changed in heat:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in heat:
milestone: grizzly-3 → 2013.1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.