status: provisioning error during remove-machine

[Aaron Bentley]

After running remove-machine, status reported:

    machine-status:
      current: provisioning error
      message: Canceled

For the machine that was being removed.

This is an apparent error, so it makes testing hard.

Due to an unrelated issue, I don't have any logs to offer.

2016-12-07 14:39:44 INFO juju --debug remove-machine -m assess-azure:assess-azure 1
14:39:44 INFO juju.cmd supercommand.go:63 running juju [2.1-rc1 gc go1.7.3]
14:39:44 DEBUG juju.cmd supercommand.go:64 args: []string{"juju", "--debug", "remove-machine", "-m", "assess-azure:assess-azure", "1"}
14:39:44 INFO juju.juju api.go:72 connecting to API addresses: [13.92.41.60:17070 192.168.16.4:17070]
14:39:44 INFO juju.api apiclient.go:570 dialing "wss://13.92.41.60:17070/model/0c979215-aa2a-4a41-8546-0c6cc951e760/api"
14:39:44 INFO juju.api apiclient.go:570 dialing "wss://192.168.16.4:17070/model/0c979215-aa2a-4a41-8546-0c6cc951e760/api"
14:39:44 INFO juju.api apiclient.go:501 connection established to "wss://13.92.41.60:17070/model/0c979215-aa2a-4a41-8546-0c6cc951e760/api"
14:39:44 DEBUG juju.juju api.go:263 API hostnames unchanged - not resolving
14:39:44 DEBUG juju.api monitor.go:35 RPC connection died
14:39:44 INFO cmd supercommand.go:465 command finished
still-present: 1
still-present: 0
still-present: 1
2016-12-07 14:39:57 ERROR ('0', 'Canceled')
Traceback (most recent call last):
  File "/home/ubuntu/juju-ci-tools/utility.py", line 553, in logged_exception
    yield
  File "/home/ubuntu/juju-ci-tools/deploy_stack.py", line 871, in runtime_context
    yield
  File "/home/ubuntu/juju-ci-tools/deploy_stack.py", line 978, in booted_context
    yield machines
  File "./assess_cloud.py", line 74, in assess_cloud_combined
    for n in new_machines], timeout=600)
  File "/home/ubuntu/juju-ci-tools/jujupy.py", line 2308, in wait_for
    status.raise_highest_error(ignore_recoverable=True)
  File "/home/ubuntu/juju-ci-tools/jujupy.py", line 956, in raise_highest_error
    raise errors[0]
ProvisioningError: ('0', 'Canceled')
2016-12-07 14:39:57 INFO juju --debug show-status -m assess-azure:controller --format yaml
14:39:57 INFO juju.cmd supercommand.go:63 running juju [2.1-rc1 gc go1.7.3]
14:39:57 DEBUG juju.cmd supercommand.go:64 args: []string{"juju", "--debug", "show-status", "-m", "assess-azure:controller", "--format", "yaml"}
14:39:57 INFO juju.juju api.go:72 connecting to API addresses: [13.92.41.60:17070 192.168.16.4:17070]
14:39:57 INFO juju.api apiclient.go:570 dialing "wss://13.92.41.60:17070/model/d2ad9400-b2ef-4376-822a-35c080bb664b/api"
14:39:57 INFO juju.api apiclient.go:570 dialing "wss://192.168.16.4:17070/model/d2ad9400-b2ef-4376-822a-35c080bb664b/api"
14:39:58 INFO juju.api apiclient.go:501 connection established to "wss://13.92.41.60:17070/model/d2ad9400-b2ef-4376-822a-35c080bb664b/api"
14:39:58 DEBUG juju.juju api.go:263 API hostnames unchanged - not resolving
model:
  name: controller
  controller: assess-azure
  cloud: azure
  region: eastus
  version: 2.1-rc1
machines:
  "0":
    juju-status:
      current: started
      since: 07 Dec 2016 14:33:48Z
      version: 2.1-rc1
    dns-name: 13.92.41.60
    ip-addresses:
    - 192.168.16.4
    - 13.92.41.60
    instance-id: machine-0
    machine-status:
      current: running
      since: 07 Dec 2016 14:33:50Z
    series: xenial
    hardware: arch=amd64 cores=1 mem=3584M root-disk=30720M
    controller-member-status: has-vote
applications: {}
14:39:58 DEBUG juju.api monitor.go:35 RPC connection died
14:39:58 INFO cmd supercommand.go:465 command finished
2016-12-07 14:39:58 INFO juju --debug show-status -m assess-azure:assess-azure --format yaml
14:39:58 INFO juju.cmd supercommand.go:63 running juju [2.1-rc1 gc go1.7.3]
14:39:58 DEBUG juju.cmd supercommand.go:64 args: []string{"juju", "--debug", "show-status", "-m", "assess-azure:assess-azure", "--format", "yaml"}
14:39:58 INFO juju.juju api.go:72 connecting to API addresses: [13.92.41.60:17070 192.168.16.4:17070]
14:39:58 INFO juju.api apiclient.go:570 dialing "wss://13.92.41.60:17070/model/0c979215-aa2a-4a41-8546-0c6cc951e760/api"
14:39:58 INFO juju.api apiclient.go:570 dialing "wss://192.168.16.4:17070/model/0c979215-aa2a-4a41-8546-0c6cc951e760/api"
14:39:58 INFO juju.api apiclient.go:501 connection established to "wss://13.92.41.60:17070/model/0c979215-aa2a-4a41-8546-0c6cc951e760/api"
14:39:58 DEBUG juju.juju api.go:263 API hostnames unchanged - not resolving
model:
  name: assess-azure
  controller: assess-azure
  cloud: azure
  region: eastus
  version: 2.1-rc1
machines:
  "0":
    juju-status:
      current: error
      message: Canceled
      since: 07 Dec 2016 14:39:56Z
      version: 2.1-rc1
      life: dead
    dns-name: 13.68.247.228
    ip-addresses:
    - 13.68.247.228
    - 192.168.0.4
    - 2001:0:4137:9e76:14d9:40d:3f57:fffb
    instance-id: machine-0
    machine-status:
      current: provisioning error
      message: Canceled
      since: 07 Dec 2016 14:39:56Z
    series: win2012r2
    hardware: arch=amd64 cores=1 mem=3584M root-disk=130048M
  "1":
    juju-status:
      current: stopped
      since: 07 Dec 2016 14:39:48Z
      version: 2.1-rc1
      life: dead
    dns-name: 13.68.241.12
    ip-addresses:
    - 13.68.241.12
    - 192.168.0.5
    instance-id: machine-1
    machine-status:
      current: running
      since: 07 Dec 2016 14:36:22Z
    series: trusty
    hardware: arch=amd64 cores=1 mem=3584M root-disk=30720M
applications: {}

[Anastasia (anastasia-macmood)]

As this is a very old report and a lot has changed and most recently has been addressed in the machine removal area, I'll mark it as Fix Committed for current Juju 2.6.

If there are any further issues, please file a separate report with a reproduction steps and relevant logs.