actions kicked off by juju remove-service not finishing

[Eric Snow]

After deploying a charm it settled into an error state (which I'm handling in a separate bug report). I tried removing the service that was created and nothing happened (even after +/- 1 hour). The failed service simply would not go away. I also tried to remove the unit and the machine. Neither worked. Eventually I destroyed the environment to clean everything up.

[Eric Snow (ericsnowcurrently)]

Here's a more specific breakdown of what I did:

$ juju bootstrap # local
...
$ juju deploy postgresql
$ juju status
environment: local
machines:
  "0":
    agent-state: started
    agent-version: 1.21-alpha1.1
    dns-name: localhost
    instance-id: localhost
    series: trusty
    state-server-member-status: has-vote
  "1":
    agent-state: started
    agent-version: 1.21-alpha1.1
    dns-name: 10.0.3.58
    instance-id: esnow-local-machine-1
    series: trusty
    hardware: arch=amd64
services:
  postgresql:
    charm: cs:trusty/postgresql-3
    exposed: false
    relations:
      replication:
      - postgresql
    units:
      postgresql/0:
        agent-state: error
        agent-state-info: 'hook failed: "install"'
        agent-version: 1.21-alpha1.1
        machine: "1"
        open-ports:
        - 5432/tcp
        public-address: 10.0.3.58
$ juju remove-service postgresql
# Nothing written to std*.
$ juju status
environment: local
machines:
  "0":
    agent-state: started
    agent-version: 1.21-alpha1.1
    dns-name: localhost
    instance-id: localhost
    series: trusty
    state-server-member-status: has-vote
  "1":
    agent-state: started
    agent-version: 1.21-alpha1.1
    dns-name: 10.0.3.58
    instance-id: esnow-local-machine-1
    series: trusty
    hardware: arch=amd64
services:
  postgresql:
    charm: cs:trusty/postgresql-3
    exposed: false
    life: dying
    units:
      postgresql/0:
        agent-state: error
        agent-state-info: 'hook failed: "install"'
        agent-version: 1.21-alpha1.1
        life: dying
        machine: "1"
        open-ports:
        - 5432/tcp
        public-address: 10.0.3.58

Removing the unit:

$ juju remove-unit postgresql/0
$ juju status
environment: local
machines:
  "0":
    agent-state: started
    agent-version: 1.21-alpha1.1
    dns-name: localhost
    instance-id: localhost
    series: trusty
    state-server-member-status: has-vote
  "1":
    agent-state: started
    agent-version: 1.21-alpha1.1
    dns-name: 10.0.3.58
    instance-id: esnow-local-machine-1
    series: trusty
    hardware: arch=amd64
services:
  postgresql:
    charm: cs:trusty/postgresql-3
    exposed: false
    life: dying
    units:
      postgresql/0:
        agent-state: error
        agent-state-info: 'hook failed: "install"'
        agent-version: 1.21-alpha1.1
        life: dying
        machine: "1"
        open-ports:
        - 5432/tcp
        public-address: 10.0.3.58

Removing the machine:

$ juju remove-machine 1
ERROR no machines were destroyed: machine 1 has unit "postgresql/0" assigned

[Kapil Thangavelu (hazmat)]

use juju remove-machine --force 1 will kill the unit and the machine.

[Kapil Thangavelu (hazmat)]

alternatively you can juju resolved postgresql/0 and wait, and do it again if there's another hook error (likely given the failure to install).

[Eric Snow (ericsnowcurrently)]

Good to know, Kapil. Feel free to close this ticket in lieu of #1219902.