Tempest test test_swift_middleware_notifies is failed

[Sofiia Andriichenko]

Detailed bug description:
tempest.scenario.test_object_storage_telemetry_middleware.TestObjectStorageTelemetry

Configuration:
    ISO: http://paste.openstack.org/show/495771/
  Settings:
  Compute - QEMU.
  Network - Neutron with VLAN segmentation.
  Storage Backends - Ceph RBD for volumes (Cinder), Ceph RBD for ephemeral volumes (Nova), Ceph RBD for images (Glance), Ceph RadosGW for objects (Swift API)
  Additional services - Install Ironic

  In tab Settings->Compute check Nova quotas
  In tab Settings->OpenStack Services check enable Install Ceilometer and Aodh
  In tab Networks->Other check enable Neutron DVR

  Nodes: controller, compute, ironic, ceph-osd, Telemetry - MongoDB

Steps to reproduce:
    1. Deploy ISO in configuration see (Detailed bug description)
    2. Navigate to controller node
    3. Install git (use apt-get install git)
    4. Clone script to deploy rally + tempest
       # git clone https://github.com/obutenko/mos-rally-verify.git
    5. Navigate to the https://github.com/obutenko/mos-rally-verify
    6. Execute necessary steps to deploy tempest
    7. Tun test in debug mode
        #rally --debug verify start --regex tempest.scenario.test_object_storage_telemetry_middleware.TestObjectStorageTelemetry

Expected results:
Test is passed

Actual result:
Test is Failed
(see comments)

Reproducibility:
See attachment

Workaround:
---

Impact:
---

Description of the environment:
See (Detailed bug description)

Additional information:
Error Message

test failed

Stacktrace

Traceback (most recent call last):
  File "/home/rally/.rally/tempest/for-deployment-dccda43a-9014-4a1f-a069-52c940eedebe/tempest/test.py", line 113, in wrapper
    return f(self, *func_args, **func_kwargs)
  File "/home/rally/.rally/tempest/for-deployment-dccda43a-9014-4a1f-a069-52c940eedebe/tempest/scenario/test_object_storage_telemetry_middleware.py", line 102, in test_swift_middleware_notifies
    self._confirm_notifications(container_name, obj_name)
  File "/home/rally/.rally/tempest/for-deployment-dccda43a-9014-4a1f-a069-52c940eedebe/tempest/scenario/test_object_storage_telemetry_middleware.py", line 95, in _confirm_notifications
    '%s seconds.' % NOTIFICATIONS_WAIT)
  File "/usr/local/lib/python2.7/dist-packages/unittest2/case.py", line 702, in assertTrue
    raise self.failureException(msg)
AssertionError: False is not true : Correct notifications were not received after 120 seconds.

[Sofiia Andriichenko (sandriichenko)]

snapshot https://drive.google.com/file/d/0B8hkiEm94sEtSmM1emJiZGlXSms/view?usp=sharing

[Roman Podoliaka (rpodolyaka)]

Ceph team, could you please take a closer look?

[Kostiantyn Danylov (kdanylov)]

RGW doesn't support notification

[Kostiantyn Danylov (kdanylov)]

In case if there an application, required by custoner, which rely on this feature - please contact me/rzarginsky/hnarkatis