cmd/jujud/agent: sporadic test failure in UnitSuite.TestWorkers

[Roger Peppe]

Example failure:

http://juju-ci.vapour.ws:8080/job/github-merge-juju/9463/artifact/artifacts/windows-out.log

It seems to fail waiting for the metric-sender worker to come up.

From looking at the difference between a successful run and a failed run, it
looks like this might point towards the culprit. This from the failed run:

    [LOG] 0:00.904 DEBUG juju.worker.proxyupdater new proxy settings proxy.Settings{Http:"", Https:"", Ftp:"", NoProxy:"localhost"}
    [LOG] 0:00.920 DEBUG juju.worker.dependency "metric-collect" manifold worker stopped: failed to read charm from: c:\users\admini~1\appdata\local\temp\tmpnn6opb\gogo\tmp-juju-testcskhkx\check-8642650913302256328\130\var\lib\juju\agents\unit-wordpress-0\charm: GetFileAttributesEx c:\users\admini~1\appdata\local\temp\tmpnn6opb\gogo\tmp-juju-testcskhkx\check-8642650913302256328\130\var\lib\juju\agents\unit-wordpress-0\charm: The system cannot find the file specified.
    [LOG] 0:00.920 ERROR juju.worker.dependency "metric-collect" manifold worker returned unexpected error: failed to read charm from: c:\users\admini~1\appdata\local\temp\tmpnn6opb\gogo\tmp-juju-testcskhkx\check-8642650913302256328\130\var\lib\juju\agents\unit-wordpress-0\charm: GetFileAttributesEx c:\users\admini~1\appdata\local\temp\tmpnn6opb\gogo\tmp-juju-testcskhkx\check-8642650913302256328\130\var\lib\juju\agents\unit-wordpress-0\charm: The system cannot find the file specified.
    [LOG] 0:00.920 DEBUG juju.worker.dependency "metric-sender" manifold worker stopped: Access is denied.
    [LOG] 0:00.920 ERROR juju.worker.dependency "metric-sender" manifold worker returned unexpected error: Access is denied.

This is the equivalent section from a successful run:

 [LOG] 0:00.579 DEBUG juju.worker.proxyupdater new proxy settings proxy.Settings{Http:"", Https:"", Ftp:"", NoProxy:"localhost"}
 [LOG] 0:00.580 DEBUG juju.mongo dialled mongodb server at "127.0.0.1:44943"
 [LOG] 0:00.581 DEBUG juju.mongo dialled mongodb server at "127.0.0.1:44943"
 [LOG] 0:00.582 DEBUG juju.network "lxcbr0" has addresses [10.0.3.1/24 fe80::6076:edff:fe87:80c3/64]
 [LOG] 0:00.582 DEBUG juju.network not filtering address localhost for machine
 [LOG] 0:00.582 DEBUG juju.network addresses after filtering: [localhost]
 [LOG] 0:00.582 WARNING juju.network cannot get "lxdbr0" addresses: route ip+net: no such network interface (ignoring)
 [LOG] 0:00.582 DEBUG juju.worker.apiaddressupdater updating API hostPorts to [[localhost:36993]]
 [LOG] 0:00.582 INFO juju.agent API server address details [["localhost:36993"]] written to agent config as ["localhost:36993"]
 [LOG] 0:00.584 DEBUG juju.worker.dependency "TEST-TRACKER" manifold worker stopped: dependency not available
 [LOG] 0:00.584 DEBUG juju.worker.dependency "uniter" manifold worker started
 [LOG] 0:00.584 DEBUG juju.worker.dependency "metric-sender" manifold worker started
 [LOG] 0:00.584 DEBUG juju.worker.dependency "TEST-TRACKER" manifold worker stopped: <nil>
 [LOG] 0:00.584 DEBUG juju.worker.dependency "metric-collect" manifold worker stopped: failed to read charm from: /tmp/check-5691370262237322481/4/var/lib/juju/agents/unit-wordpress-0/charm: stat /tmp/check-5691370262237322481/4/var/lib/juju/agents/unit-wordpress-0/charm: no such file or directory
 [LOG] 0:00.585 ERROR juju.worker.dependency "metric-collect" manifold worker returned unexpected error: failed to read charm from: /tmp/check-5691370262237322481/4/var/lib/juju/agents/unit-wordpress-0/charm: stat /tmp/check-5691370262237322481/4/var/lib/juju/agents/unit-wordpress-0/charm: no such file or directory
 [LOG] 0:00.586 ERROR juju.worker.proxyupdater error writing proxy environment file: fork/exec /bin/bash: no such file or directory
 [LOG] 0:00.586 DEBUG juju.worker.proxyupdater new apt proxy settings proxy.Settings{Http:"", Https:"", Ftp:"", NoProxy:""}
 [LOG] 0:00.586 ERROR juju.worker.proxyupdater error writing apt proxy config file: open /etc/apt/apt.conf.d/42-juju-proxy-settings: permission denied
 [LOG] 0:00.588 DEBUG juju.worker.logger reconfiguring logging from "<root>=DEBUG" to "<root>=DEBUG;unit=DEBUG"
 [LOG] 0:00.589 DEBUG juju.worker.meterstatus got meter status change signal from watcher
 [LOG] 0:00.595 DEBUG juju.worker.dependency "TEST-TRACKER" manifold worker stopped: dependency not available

[Anastasia (anastasia-macmood)]

metric-sender has an intermittent failure condition that has been addressed since this report was filed. I can no longer reproduce this failure, so I assume that the cause of it has been addressed as part of that work and the report was not closed.

I am marking it as Fix Released now.