File injection doesn't work with Ceph

[Alexander Gubanov]

Env: MOS 6.1 (build 525 RC3) Ubuntu - HA - Neutron VLAN
3 controllers, 2 compute with Ceph for volumes/images/ephemeral volumes

Steps to reproduce:

1. Prepare settings on compute nodes because of bug https://bugs.launchpad.net/fuel/+bug/1467579

compute:
# install python-guestfs and python-guestfs
apt-get install libguestfs-tools

# set inject_partition=-1
root@node-4:~# grep '^inject_partition' /etc/nova/nova.conf
inject_partition=-1

# set permissions for kernel
chmod 644 /boot/vmlinuz-3.13.0-55-generic

# restart compute service
service nova-compute restart

# run test
libguestfs-test-tool

2. Create instance with metadata

neutron net-list
nova boot --flavor m1.micro --image TestVM --meta key555=val555 --nic net-id=944808e4-300c-40e3-8cd1-404a89df04ec test3453

3. Ssh to instance and verify /meta.js

ip netns exec qdhcp-944808e4-300c-40e3-8cd1-404a89df04ec ssh cirros@192.168.111.8
cat /meta.js

Expected result:

Metadata arrive into instance in "/meta.js" file

Actual result:

root@node-1:~# ip netns exec qdhcp-944808e4-300c-40e3-8cd1-404a89df04ec ssh cirros@192.168.111.8
Warning: Permanently added '192.168.111.8' (RSA) to the list of known hosts.
cirros@192.168.111.8's password:
$ cat /meta.js
cat: can't open '/meta.js': No such file or directory

Log/details here: http://pastebin.com/3irWEjSA

[Alexander Gubanov (ogubanov)]

The same error for CentOS
Details: http://pastebin.com/5mf5YAK1

[Roman Podoliaka (rpodolyaka)]

File injection is explicitly disabled for Ceph, so this is intended.

Though we could possibly teach Nova how to inject files with ephemeral partitions stored in Ceph, as there should be no problems with that (http://libguestfs.org/guestfs.3.html#ceph)

[Roman Podoliaka (rpodolyaka)]

The best we can do is Mitaka, thus marking as Won't Fix for 8.0

[Alexander Gubanov (ogubanov)]

Some additional info:
I've also tested on devstack, if we want that metadata arrives to /meta.js needs:
1. confurated inject_partition: inject_partition=1 (nova.conf) and modprobe nbd
2. boot instance with config_drive=False or set force_config_drive = False in nova.conf

[Roman Podoliaka (rpodolyaka)]

Fixed in https://review.openstack.org/#/c/322434/