fuel-web tests hang on test_migration_fuel_6_1.py

Bug #1431381 reported by Aleksandra Fedorova
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Ihor Kalnytskyi
6.0.x
Invalid
Undecided
Ihor Kalnytskyi

Bug Description

fuel-web master can not pass the ci due to hanging migrations:

https://fuel-jenkins.mirantis.com/job/verify-fuel-web/6247/console

Snippet from logs:

nailgun/test/unit/test_migration_cluster_replaced_info.py::TestReplacedDataMigration::test_migration_passed_successfully
[gw0] PASSED nailgun/test/unit/test_migration_cluster_replaced_info.py::TestReplacedDataMigration::test_migration_passed_successfully ]
nailgun/test/unit/test_migration_fuel_6_1.py::TestRepoMetadataToRepoSetup::test_puppets_in_cluster_attributes Build timed out (after 60 minutes). Marking the build as failed.

See snippets from
  select * from pg_stat_activity order by query_start;
and
  /var/log/postgresql/postgresql-9.3-main.log

in attached file

Revision history for this message
Aleksandra Fedorova (bookwar) wrote :
Revision history for this message
Aleksandra Fedorova (bookwar) wrote :

Test has been triggered with in one thred, with TEST_WORKERS=1

Revision history for this message
Aleksandra Fedorova (bookwar) wrote :
Changed in fuel:
status: New → Confirmed
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Igor Kalnitsky (ikalnitsky)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (master)

Fix proposed to branch: master
Review: https://review.openstack.org/163862

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
Ihor Kalnytskyi (ikalnytskyi) wrote :

Hm.. it's really strange situation. The process is blocked in performing "dropdb" call in "TestRepoMetadataToRepoSetup" class and the reason is that we have locked "nodes" table. Looks like one of our test doesn't end transaction and loose its connection, so lock is still alive.

Changed in fuel:
assignee: Igor Kalnitsky (ikalnitsky) → Przemyslaw Kaminski (pkaminski)
Changed in fuel:
assignee: Przemyslaw Kaminski (pkaminski) → Igor Kalnitsky (ikalnitsky)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-web (master)

Reviewed: https://review.openstack.org/163862
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=8482fb2977c353eea0b42945c22574f7e474e451
Submitter: Jenkins
Branch: master

commit 8482fb2977c353eea0b42945c22574f7e474e451
Author: Igor Kalnitsky <email address hidden>
Date: Thu Mar 12 16:51:33 2015 +0200

    Close transaction in BaseAlembicMigrationTest

    We have to close transaction when the test case is over, otherwise
    connection pool may became empty and we'll wait for free connection.

    Change-Id: I60a37663598b92f94c0019f10045ea5d7fe77a94
    Closes-Bug: #1431381

Changed in fuel:
status: In Progress → Fix Committed
Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.