test_create_server_with_personality fails on the gate

[Ken'ichi Ohmichi]

http://logs.openstack.org/54/264354/8/check/gate-tempest-dsvm-neutron-full-ssh/2e7adb0/logs/testr_results.html.gz

Traceback (most recent call last):
  File "tempest/api/compute/servers/test_server_personality.py", line 69, in test_create_server_with_personality
    'sudo cat %s' % file_path))
  File "tempest/common/utils/linux/remote_client.py", line 56, in exec_command
    return self.ssh_client.exec_command(cmd)
  File "/opt/stack/new/tempest/.tox/full/local/lib/python2.7/site-packages/tempest_lib/common/ssh.py", line 167, in exec_command
    stderr=err_data, stdout=out_data)
tempest_lib.exceptions.SSHExecCommandFailed: Command 'set -eu -o pipefail; PATH=$PATH:/sbin; sudo cat /test.txt', exit status: 1, stderr:
cat: can't open '/test.txt': No such file or directory

[Ken'ichi Ohmichi (oomichi)]

This seems to happen on gate-tempest-dsvm-neutron-full-ssh only.

[Matthew Treinish (treinish)]

it only will happen on the full ssh job. This failure is occurring during the additional ssh checks which are enabled by setting run_validation to true in the tempest config file. When that is set to false (which is the default and the case for every other job) tempest will not ssh into the guest to verify the personality file.

Has this been confirmed to ever be working? I know Ianded the modifications to this test to make it actually do something fairly recently and since the job is non-voting I wouldn't be surprised if there was a mistake in it.

[Matthew Treinish (treinish)]

Well I was gonna suggest the dashboard because it will show this information, but the job is non-voting check only when it would fail so that doesn't help. As a cool aside it does show that the change: https://review.openstack.org/#/c/257493/ makes it noticeably slower:

http://status.openstack.org/openstack-health/#/test/tempest.api.compute.servers.test_server_personality.ServerPersonalityTestJSON.test_create_server_with_personality

[Ghanshyam Mann (ghanshyammann)]

Yea, i was also checking dashboard to know the failure rate but as this is non voting job.

It pass in many cases like-

http://logs.openstack.org/96/244996/33/check/gate-tempest-dsvm-neutron-full-ssh/5718769/logs/testr_results.html.gz

Even when it fails, other tests trying with /etc/test.txt file patch pass successfully. not sure why it fail on /test.txt as both place tests use sudo.

[Ken'ichi Ohmichi (oomichi)]

Now this report doesn't block the gate, so it is fine to skip here.

[Matt Riedemann (mriedem)]

This is still happening and failing CI runs now that ssh validation is enabled, at least on master (since pike):

http://logs.openstack.org/61/503161/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/cb56d6f/console.html#_2017-09-12_21_11_08_911065

[Matt Riedemann (mriedem)]

Doesn't seem to be happening anymore, or the e-r query is stale.