[Update] Glance crashes swift permissions to '/var/lib/glance/node' folder

[slava valyavskiy]

Steps to reproduce:
1. create fuel environment [5.1] - ubuntu release, ha mode (swift as object store by default), neutron/gre
2. deploy fuel environment [5.1]
3. update fuel master node from 5.1 to 5.1.1 version
4. update deployed environment from 5.1 to 5.1.1

Result:

Image cannot be uploaded to the swift due to permissions reason. Piece of trace from account container.

<43>Dec 18 12:10:51 node-46 swift-container-server: ERROR reading db /var/lib/glance/node/1/containers/1120/47c/8c0a85fad73bd06afebdb3cc719e447c/8c0a85fad73bd06afebdb3cc719e447c.db: #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/common/db_replicator.py", line 417, in _replicate_object#012 now - (self.reclaim_age * 2))#012 File "/usr/lib/python2.7/dist-packages/swift/common/db.py", line 695, in reclaim#012 self._commit_puts()#012 File "/usr/lib/python2.7/dist-packages/swift/common/db.py", line 545, in _commit_puts#012 self.merge_items(item_list)#012 File "/usr/lib/python2.7/dist-packages/swift/container/backend.py", line 488, in merge_items#012 rec['content_type'], rec['etag'], rec['deleted']]))#012 File "/usr/lib/python2.7/dist-packages/swift/common/db.py", line 126, in execute#012 self.timeout, self.db_file, lambda: sqlite3.Cursor.execute(#012 File "/usr/lib/python2.7/dist-packages/swift/common/db.py", line 64, in _db_timeout#012 return call()#012 File "/usr/lib/python2.7/dist-packages/swift/common/db.py", line 127, in <lambda>#012 self, *args, **kwargs))#012OperationalError: unable to open database file

Comment:
As you know glance package change owner/group permissions of the /var/lib/glance to the glance/glance recursively . It was considered in puppet manifests during the classic deployment - https://github.com/stackforge/fuel-library/blob/5.1.1/deployment/puppet/osnailyfacter/manifests/cluster_ha.pp#L420-L425 , but it's not operational for updating.

[Stanislaw Bogatkin (sbogatkin)]

Slava, can you attach diagnostic snapshot?

[slava valyavskiy (slava-val-al)]

We perfomed a lot deployments on this fuel node, so fuel snapshot generation takes a lot of time. I collect logs of nodes what beloned to invalid environment manually. Also, I attached nailgun, astute, rabbitmq and mcollective logs.

[Stanislaw Bogatkin (sbogatkin)]

We will not support such type of patching for 6.1.

[Ryan Moe (rmoe)]

Medium priority bugs are not backported to stable releases.