wedged unit state error but can't be resolved

Bug #1175031 reported by Kapil Thangavelu
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
juju-core
Fix Released
Critical
William Reade

Bug Description

$ juju-status snippet

  cache-lb:
    charm: local:precise/haproxy-42
    exposed: false
    relations:
      reverseproxy:
      - wordpress
    units:
      cache-lb/0:
        agent-state: error
        agent-state-info: 'hook failed: "relation-changed"'
        agent-version: 1.10.0
        machine: "6"
        public-address: ec2-184-72-139-129.compute-1.amazonaws.com

$ juju resolved cache-lb/0
  error: cannot set resolved mode for unit "cache-lb/0": already resolved

I was trying some automated resolved retry logic in deployer as can be seen in the unit log, but after a few retries it gets wedged.

http://paste.ubuntu.com/5621395/

incidentally the rel hook error is due to the lack of -r support (reported separately).

Related branches

Revision history for this message
William Reade (fwereade) wrote :

Next time you encounter this, please report back what happens if you ssh to the machine and bounce the unit agent process (something like `sudo restart jujud-unit-cache-lb-0`). If this resolves the issue, it should eliminate the possibility of serious state brokenness and isolate it to the unit agent itself.

Changed in juju-core:
importance: Undecided → Critical
status: New → Triaged
William Reade (fwereade)
Changed in juju-core:
assignee: nobody → William Reade (fwereade)
William Reade (fwereade)
Changed in juju-core:
status: Triaged → In Progress
William Reade (fwereade)
Changed in juju-core:
status: In Progress → Fix Committed
Tim Penhey (thumper)
Changed in juju-core:
milestone: none → 1.11.1
Changed in juju-core:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.