unit agent hangs when storage attached immediately after charm deploy

[Casey Marshall]

juju snap: installed: 2.6-beta1+develop-e6c607e (6472) 71MB classic
Using localhost provider.

If I deploy a charm and immediately attach storage, I sometimes get into a state where the unit with storage attached is stuck 'agent initializing'. For example, I do something like:

juju deploy zookeeper zk && juju deploy ../charm_output/builds/kafka && juju relate zk kafka && juju add-storage kafka/0 logs=1G

The kafka unit sometimes gets stuck like this:

kafka/0* waiting allocating 1 10.130.222.52 agent initializing

and unit-kafka-0.log shows errors like:

2019-01-30 16:09:51 ERROR juju.worker.dependency engine.go:632 "uniter" manifold worker returned unexpected error: watching storage attachment: getting storage filesystem: filesystem for storage instance "logs/0"
not found

This is all in LXD, and I've confirmed the machine isn't in error like it was in LP:#1809478 due to cinder volume quota exceeded.

[Heather Lanigan (hmlanigan)]

Use cs:~cmars/xenial/kafka-5 for storage attach to work.

[Heather Lanigan (hmlanigan)]

Reproduced. Additional detail of logs:

unit-kafka-0: 15:01:03 DEBUG juju.worker.dependency "uniter" manifold worker stopped: watching storage attachment: getting storage filesystem: filesystem for storage insta
nce "logs/0" not found
unit-kafka-0: 15:01:03 ERROR juju.worker.dependency "uniter" manifold worker returned unexpected error: watching storage attachment: getting storage filesystem: filesystem
 for storage instance "logs/0" not found
unit-kafka-0: 15:01:03 DEBUG juju.worker.dependency stack trace:
getting storage filesystem: filesystem for storage instance "logs/0" not found
/home/heather/work/src/github.com/juju/juju/worker/uniter/remotestate/watcher.go:863: watching storage attachment
/home/heather/work/src/github.com/juju/juju/worker/uniter/remotestate/watcher.go:509:

[Heather Lanigan (hmlanigan)]

juju config kafka bigtop_version=1.3.0 is required for install to succeed.

[Canonical Juju QA Bot (juju-qa-bot)]

This bug has not been updated in 2 years, so we're marking it Low importance. If you believe this is incorrect, please update the importance.