tests failing with "no such table" on stable/icehouse 2014.1.2

Bug #1355805 reported by Corey Bryant
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Heat
Expired
Undecided
Unassigned

Bug Description

A number of tests are failing (a minimum of 28) with various "no such table" errors on stable/icehouse 2014.1.2.

This is blocking the Ubuntu release of 2014.1.2 stable/icehouse.

This can be reproduced by running 'testr init' and 'testr run' on the stable/icehouse branch.

I've pasted the output of my first test run below. I attempted two more test runs after this with the failing tests commented out and more and more tests failed with similar results.

1st failure running against upstream git
-----------------------------------------------------------------------------------------------------------------------------------------
$ testr init; testr run
No handlers could be found for logger "heat.common.config"
    INFO [migrate.versioning.api] 14 -> 15...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 15 -> 16...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 16 -> 17...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 17 -> 18...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 18 -> 19...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 19 -> 20...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 20 -> 21...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 21 -> 22...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 22 -> 23...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 23 -> 24...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 24 -> 25...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 25 -> 26...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 26 -> 27...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 27 -> 28...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 28 -> 29...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 29 -> 30...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 30 -> 31...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 31 -> 32...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 32 -> 33...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 33 -> 34...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 34 -> 35...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 35 -> 36...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 36 -> 37...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 37 -> 38...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 38 -> 39...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 39 -> 40...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 40 -> 41...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 41 -> 42...
    INFO [migrate.versioning.api] done
    INFO [migrate.versioning.api] 42 -> 43...
    INFO [migrate.versioning.api] done
running=
PYTHON=$(echo ${PYTHON:-python} | sed 's/--source heat//g')
${PYTHON} -m subunit.run discover -s .
for plugin in contrib/*; do ${PYTHON} -m subunit.run discover -s $plugin ; done
======================================================================
FAIL: heat.tests.test_autoscaling.AutoScalingTest.test_scaling_group_percent
tags: worker-0
----------------------------------------------------------------------
pythonlogging:'': {{{
Loading repository /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo...
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/015_grizzly.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/015_grizzly.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/016_timeout_nullable.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/016_timeout_nullable.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/017_event_state_status.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/017_event_state_status.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/018_resource_id_uuid.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/018_resource_id_uuid.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/019_resource_action_status.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/019_resource_action_status.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/020_stack_action.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/020_stack_action.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/021_resource_data.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/021_resource_data.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/022_stack_event_soft_delete.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/022_stack_event_soft_delete.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/023_raw_template_mysql_longtext.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/023_raw_template_mysql_longtext.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/024_event_resource_name.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/024_event_resource_name.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/025_user_creds_drop_service.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/025_user_creds_drop_service.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/026_user_creds_drop_aws.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/026_user_creds_drop_aws.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/027_user_creds_trusts.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/027_user_creds_trusts.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/028_text_mysql_longtext.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/028_text_mysql_longtext.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/029_event_id_to_uuid.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/029_event_id_to_uuid.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/030_remove_uuidutils.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/030_remove_uuidutils.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/031_stack_lock.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/031_stack_lock.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/032_decrypt_method.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/032_decrypt_method.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/033_software_config.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/033_software_config.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/034_raw_template_files.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/034_raw_template_files.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/035_event_uuid_to_id.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/035_event_uuid_to_id.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/036_stack_domain_project.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/036_stack_domain_project.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/037_migrate_hot_template.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/037_migrate_hot_template.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/038_software_config_json_config.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/038_software_config_json_config.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/039_user_creds_nullable.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/039_user_creds_nullable.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/040_software_deployment_no_signal_id.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/040_software_deployment_no_signal_id.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/041_migrate_hot_template_resources.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/041_migrate_hot_template_resources.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/042_software_deployment_domain_project.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/042_software_deployment_domain_project.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/043_migrate_template_versions.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/043_migrate_template_versions.py loaded successfully
Repository /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo loaded successfully
Config: OrderedDict([('db_settings', OrderedDict([('__name__', 'db_settings'), ('repository_id', 'heat'), ('version_table', 'migrate_version'), ('required_dbs', '[]'), ('use_timestamp_numbering', 'False')]))])
Loading repository /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo...
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/015_grizzly.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/015_grizzly.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/016_timeout_nullable.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/016_timeout_nullable.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/017_event_state_status.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/017_event_state_status.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/018_resource_id_uuid.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/018_resource_id_uuid.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/019_resource_action_status.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/019_resource_action_status.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/020_stack_action.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/020_stack_action.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/021_resource_data.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/021_resource_data.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/022_stack_event_soft_delete.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/022_stack_event_soft_delete.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/023_raw_template_mysql_longtext.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/023_raw_template_mysql_longtext.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/024_event_resource_name.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/024_event_resource_name.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/025_user_creds_drop_service.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/025_user_creds_drop_service.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/026_user_creds_drop_aws.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/026_user_creds_drop_aws.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/027_user_creds_trusts.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/027_user_creds_trusts.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/028_text_mysql_longtext.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/028_text_mysql_longtext.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/029_event_id_to_uuid.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/029_event_id_to_uuid.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/030_remove_uuidutils.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/030_remove_uuidutils.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/031_stack_lock.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/031_stack_lock.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/032_decrypt_method.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/032_decrypt_method.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/033_software_config.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/033_software_config.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/034_raw_template_files.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/034_raw_template_files.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/035_event_uuid_to_id.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/035_event_uuid_to_id.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/036_stack_domain_project.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/036_stack_domain_project.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/037_migrate_hot_template.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/037_migrate_hot_template.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/038_software_config_json_config.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/038_software_config_json_config.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/039_user_creds_nullable.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/039_user_creds_nullable.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/040_software_deployment_no_signal_id.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/040_software_deployment_no_signal_id.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/041_migrate_hot_template_resources.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/041_migrate_hot_template_resources.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/042_software_deployment_domain_project.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/042_software_deployment_domain_project.py loaded successfully
Loading script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/043_migrate_template_versions.py...
Script /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo/versions/043_migrate_template_versions.py loaded successfully
Repository /home/ubuntu/heat-git/heat/db/sqlalchemy/migrate_repo loaded successfully
Config: OrderedDict([('db_settings', OrderedDict([('__name__', 'db_settings'), ('repository_id', 'heat'), ('version_table', 'migrate_version'), ('required_dbs', '[]'), ('use_timestamp_numbering', 'False')]))])
Validating LaunchConfiguration "LaunchConfig" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6]
Task create from LaunchConfiguration "LaunchConfig" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] starting
creating LaunchConfiguration "LaunchConfig" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6]
Task create from LaunchConfiguration "LaunchConfig" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] running
Task create from LaunchConfiguration "LaunchConfig" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] complete
Validating AutoScalingGroup "WebServerGroup" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6]
Task create from AutoScalingGroup "WebServerGroup" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] starting
creating AutoScalingGroup "WebServerGroup" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6]
Task create from AutoScalingGroup "WebServerGroup" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] running
Registering OS::Heat::ScaledResource -> AWS::EC2::Instance
Task stack_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] starting
Task stack_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] running
Task resource_action starting
creating Instance "abfk3qdrt4pj" Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082]
Task resource_action running
Task resource_action starting
creating Instance "6xic3gorh7xu" Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082]
Task resource_action running
Task create from AutoScalingGroup "WebServerGroup" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] running
Task stack_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] running
Task resource_action running
Task resource_action running
Task resource_action complete
Task create from AutoScalingGroup "WebServerGroup" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] running
Task stack_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] running
Task resource_action running
Task resource_action complete
Task stack_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] complete
Task update from LoadBalancer "ElasticLoadBalancer" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] starting
Task update from LoadBalancer "ElasticLoadBalancer" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] running
updating LoadBalancer "ElasticLoadBalancer" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6]
Task update from LoadBalancer "ElasticLoadBalancer" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] running
Task update from LoadBalancer "ElasticLoadBalancer" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] complete
Task create from AutoScalingGroup "WebServerGroup" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] complete
Task update_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] starting
Task update_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] running
Created new backup stack
Task Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update starting
Task Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update running
Task _remove_backup_resource from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update starting
Task _remove_backup_resource from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update running
Task _remove_backup_resource from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update complete
Task _remove_backup_resource from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update starting
Task _remove_backup_resource from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update running
Task _remove_backup_resource from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update complete
Task update_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] running
Task Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update running
Task _resource_update from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update starting
Task _resource_update from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update running
Resource abfk3qdrt4pj for stack test_stack-WebServerGroup-hwo3eikcdpwh updated
Task _resource_update from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update complete
Task _resource_update from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update starting
Task _resource_update from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update running
deleting Instance "6xic3gorh7xu" Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082]
stack_user_domain ID not set in heat.conf falling back to using default
Using stack domain None
Making authentication request to http://server.test:5000/v3/auth/tokens
Starting new HTTP connection (1): server.test
DB error (OperationalError) no such table: event u'SELECT count(*) AS count_1 \nFROM (SELECT event.resource_status_reason AS event_resource_status_reason, event.created_at AS event_created_at, event.updated_at AS event_updated_at, event.id AS event_id, event.stack_id AS event_stack_id, event.uuid AS event_uuid, event.resource_action AS event_resource_action, event.resource_status AS event_resource_status, event.resource_name AS event_resource_name, event.physical_resource_id AS event_physical_resource_id, event.resource_type AS event_resource_type, event.resource_properties AS event_resource_properties \nFROM event \nWHERE event.stack_id = ?) AS anon_1' ('07b35188-dad4-4293-b9b5-3b3957118082',)
Task update_task from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] running
Task Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update running
Task _resource_update from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update running
DB error (OperationalError) no such table: resource u'SELECT resource.status_reason AS resource_status_reason, resource.created_at AS resource_created_at, resource.action AS resource_action, resource.status AS resource_status, resource.id AS resource_id, resource.name AS resource_name, resource.nova_instance AS resource_nova_instance, resource.rsrc_metadata AS resource_rsrc_metadata, resource.stack_id AS resource_stack_id, resource.updated_at AS resource_updated_at \nFROM resource \nWHERE resource.id = ?' ('f6dfec4b-5ff1-4ad2-8445-b21562e1a977',)
stack_user_domain ID not set in heat.conf falling back to using default
Using stack domain None
Making authentication request to http://server.test:5000/v3/auth/tokens
Starting new HTTP connection (1): server.test
DB error (OperationalError) no such table: event u'SELECT count(*) AS count_1 \nFROM (SELECT event.resource_status_reason AS event_resource_status_reason, event.created_at AS event_created_at, event.updated_at AS event_updated_at, event.id AS event_id, event.stack_id AS event_stack_id, event.uuid AS event_uuid, event.resource_action AS event_resource_action, event.resource_status AS event_resource_status, event.resource_name AS event_resource_name, event.physical_resource_id AS event_physical_resource_id, event.resource_type AS event_resource_type, event.resource_properties AS event_resource_properties \nFROM event \nWHERE event.stack_id = ?) AS anon_1' ('07b35188-dad4-4293-b9b5-3b3957118082',)
Task _resource_update from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update cancelled
Task _resource_update from Stack "test_stack-WebServerGroup-hwo3eikcdpwh" [07b35188-dad4-4293-b9b5-3b3957118082] Update cancelled
Task update from LoadBalancer "ElasticLoadBalancer" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] starting
Task update from LoadBalancer "ElasticLoadBalancer" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] running
Task update from LoadBalancer "ElasticLoadBalancer" Stack "test_stack" [7de85596-7b77-4a04-8300-00c1f56cc6d6] complete
}}}

Traceback (most recent call last):
  File "/home/ubuntu/heat-git/heat/tests/test_autoscaling.py", line 956, in test_scaling_group_percent
    self._do_test_scaling_group_percent(-50, 1, 200, 2, 3)
  File "/home/ubuntu/heat-git/heat/tests/test_autoscaling.py", line 941, in _do_test_scaling_group_percent
    rsrc.adjust(decrease, 'PercentChangeInCapacity')
  File "/home/ubuntu/heat-git/heat/engine/resources/autoscaling.py", line 686, in adjust
    logger.exception(_('Failed sending error notification'))
  File "/home/ubuntu/heat-git/heat/openstack/common/excutils.py", line 68, in __exit__
    six.reraise(self.type_, self.value, self.tb)
  File "/home/ubuntu/heat-git/heat/engine/resources/autoscaling.py", line 677, in adjust
    self.resize(new_capacity)
  File "/home/ubuntu/heat-git/heat/engine/resources/autoscaling.py", line 375, in resize
    updater.run_to_completion()
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 203, in run_to_completion
    while not self.step():
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 189, in step
    next(self._runner)
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 285, in wrapper
    subtask = next(parent)
  File "/home/ubuntu/heat-git/heat/engine/parser.py", line 574, in update_task
    while not updater.step():
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 189, in step
    next(self._runner)
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 283, in wrapper
    subtask = parent.throw(Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/lib/python2.7/dist-packages/subunit/run.py", line 131, in <module>
    main()
  File "/usr/lib/python2.7/dist-packages/subunit/run.py", line 127, in main
    stdout=sys.stdout)
  File "/usr/lib/python2.7/dist-packages/testtools/run.py", line 220, in __init__
    self.runTests()
  File "/usr/lib/python2.7/dist-packages/testtools/run.py", line 371, in runTests
    self.result = testRunner.run(self.test)
  File "/usr/lib/python2.7/dist-packages/subunit/run.py", line 62, in run
    test(result)
  File "/usr/lib/python2.7/unittest/suite.py", line 70, in __call__
    return self.run(*args, **kwds)
  File "/usr/lib/python2.7/unittest/suite.py", line 108, in run
    test(result)
  File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__
    return self.run(*args, **kwds)
  File "/usr/lib/python2.7/dist-packages/testscenarios/testcase.py", line 65, in run
    return super(WithScenarios, self).run(result)
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 568, in run
    return self.__RunTest(self, self.exception_handlers).run(result)
  File "/usr/lib/python2.7/dist-packages/testtools/runtest.py", line 74, in run
    return self._run_one(actual_result)
  File "/usr/lib/python2.7/dist-packages/testtools/runtest.py", line 88, in _run_one
    return self._run_prepared_result(ExtendedToOriginalDecorator(result))
  File "/usr/lib/python2.7/dist-packages/testtools/runtest.py", line 100, in _run_prepared_result
    self._run_core()
  File "/usr/lib/python2.7/dist-packages/testtools/runtest.py", line 125, in _run_core
    self.case._run_test_method, self.result):
  File "/usr/lib/python2.7/dist-packages/testtools/runtest.py", line 172, in _run_user
    return fn(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 616, in _run_test_method
    return self._get_test_method()()
  File "/home/ubuntu/heat-git/heat/tests/test_autoscaling.py", line 374, in test_scaling_group_resume
    i.state_set(rsrc.SUSPEND, rsrc.COMPLETE)
  File "/home/ubuntu/heat-git/heat/engine/resource.py", line 847, in state_set
    self._add_event(action, status, reason)
  File "/home/ubuntu/heat-git/heat/engine/resource.py", line 786, in _add_event
    self.name, self.type())
  File "/home/ubuntu/heat-git/heat/engine/event.py", line 44, in __init__
    self.resource_properties = dict(resource_properties)
  File "/home/ubuntu/heat-git/heat/engine/properties.py", line 337, in __getitem__
    return prop.validate_data(value)
  File "/home/ubuntu/heat-git/heat/engine/properties.py", line 276, in validate_data
    self.schema.validate_constraints(value, self.context)
  File "/home/ubuntu/heat-git/heat/engine/constraints.py", line 163, in validate_constraints
    constraint.validate(value, context)
  File "/home/ubuntu/heat-git/heat/engine/constraints.py", line 248, in validate
    if not self._is_valid(value, context):
  File "/home/ubuntu/heat-git/heat/engine/constraints.py", line 519, in _is_valid
    return constraint.validate(value, context)
  File "/home/ubuntu/heat-git/heat/engine/resources/image.py", line 23, in validate
    nova_client = clients.Clients(context).nova()
  File "/home/ubuntu/heat-git/heat/engine/clients.py", line 126, in nova
    endpoint_type=endpoint_type)
  File "/home/ubuntu/heat-git/heat/engine/clients.py", line 96, in url_for
    return self.keystone().url_for(**kwargs)
  File "/home/ubuntu/heat-git/heat/common/heat_keystoneclient.py", line 529, in url_for
    return self.client.service_catalog.url_for(**kwargs)
  File "/home/ubuntu/heat-git/heat/common/heat_keystoneclient.py", line 107, in client
    self._client = self._v3_client_init()
  File "/home/ubuntu/heat-git/heat/common/heat_keystoneclient.py", line 166, in _v3_client_init
    client.authenticate()
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/utils.py", line 318, in inner
    return func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/httpclient.py", line 407, in authenticate
    resp = self.get_raw_token_from_identity_service(**kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/v3/client.py", line 252, in get_raw_token_from_identity_service
    return plugin.get_auth_ref(self.session)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/auth/identity/v3.py", line 110, in get_auth_ref
    authenticated=False, log=False)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/session.py", line 398, in post
    return self.request(url, 'POST', **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/utils.py", line 318, in inner
    return func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/session.py", line 324, in request
    resp = self._send_request(url, method, redirect, log, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/session.py", line 350, in _send_request
    resp = self.session.request(method, url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/session.py", line 65, in request
    return requests.request(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/api.py", line 44, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 383, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 486, in send
    r = adapter.send(request, **kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/adapters.py", line 330, in send
    timeout=timeout
  File "/usr/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 542, in urlopen
    body=body, headers=headers)
  File "/usr/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 367, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python2.7/httplib.py", line 973, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 1007, in _send_request
    self.endheaders(body)
  File "/usr/lib/python2.7/httplib.py", line 969, in endheaders
    self._send_output(message_body)
  File "/usr/lib/python2.7/httplib.py", line 829, in _send_output
    self.send(msg)
  File "/usr/lib/python2.7/httplib.py", line 791, in send
    self.connect()
  File "/usr/lib/python2.7/httplib.py", line 772, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 562, in create_connection
    sock.connect(sa)
  File "/usr/lib/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
KeyboardInterrupt
*sys.exc_info())
  File "/home/ubuntu/heat-git/heat/engine/update.py", line 68, in __call__
    yield update()
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 274, in wrapper
    step = next(subtask)
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 345, in __call__
    r.cancel()
  File "/home/ubuntu/heat-git/heat/openstack/common/excutils.py", line 68, in __exit__
    six.reraise(self.type_, self.value, self.tb)
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 335, in __call__
    if r.step():
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 189, in step
    next(self._runner)
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 283, in wrapper
    subtask = parent.throw(*sys.exc_info())
  File "/home/ubuntu/heat-git/heat/engine/update.py", line 172, in _process_existing_resource_update
    yield existing_res.destroy()
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 274, in wrapper
    step = next(subtask)
  File "/home/ubuntu/heat-git/heat/engine/scheduler.py", line 285, in wrapper
    subtask = next(parent)
  File "/home/ubuntu/heat-git/heat/engine/resource.py", line 746, in destroy
    db_api.resource_get(self.context, self.id).delete()
  File "/home/ubuntu/heat-git/heat/db/api.py", line 79, in resource_get
    return IMPL.resource_get(context, resource_id)
  File "/home/ubuntu/heat-git/heat/db/sqlalchemy/api.py", line 91, in resource_get
    result = model_query(context, models.Resource).get(resource_id)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 820, in get
    return loading.load_on_ident(self, key)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/loading.py", line 231, in load_on_ident
    return q.one()
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2369, in one
    ret = list(self)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2412, in __iter__
    return self._execute_and_instances(context)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2427, in _execute_and_instances
    result = conn.execute(querycontext.statement, self._params)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 729, in execute
    return meth(self, multiparams, params)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 321, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 826, in _execute_clauseelement
    compiled_sql, distilled_params
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 958, in _execute_context
    context)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1160, in _handle_dbapi_exception
    exc_info
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 951, in _execute_context
    context)
  File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 436, in do_execute
    cursor.execute(statement, parameters)
OperationalError: (OperationalError) no such table: resource u'SELECT resource.status_reason AS resource_status_reason, resource.created_at AS resource_created_at, resource.action AS resource_action, resource.status AS resource_status, resource.id AS resource_id, resource.name AS resource_name, resource.nova_instance AS resource_nova_instance, resource.rsrc_metadata AS resource_rsrc_metadata, resource.stack_id AS resource_stack_id, resource.updated_at AS resource_updated_at \nFROM resource \nWHERE resource.id = ?' ('f6dfec4b-5ff1-4ad2-8445-b21562e1a977',)
Ran 323 tests in 5094.841s
FAILED (id=0, failures=2)
Traceback (most recent call last):
  File "/usr/bin/testr", line 26, in <module>
    sys.exit(run_argv(sys.argv, sys.stdin, sys.stdout, sys.stderr))
  File "/usr/lib/python2.7/dist-packages/testrepository/commands/__init__.py", line 188, in run_argv
    result = cmd.execute()
  File "/usr/lib/python2.7/dist-packages/testrepository/commands/__init__.py", line 143, in execute
    result = self.run()
  File "/usr/lib/python2.7/dist-packages/testrepository/commands/run.py", line 213, in run
    return self._run_tests(cmd)
  File "/usr/lib/python2.7/dist-packages/testrepository/commands/run.py", line 358, in _run_tests
    return run_tests()
  File "/usr/lib/python2.7/dist-packages/testrepository/commands/run.py", line 356, in run_tests
    return load_cmd.execute()
  File "/usr/lib/python2.7/dist-packages/testrepository/commands/__init__.py", line 143, in execute
    result = self.run()
  File "/usr/lib/python2.7/dist-packages/testrepository/commands/load.py", line 151, in run
    case.run(result)
  File "/usr/lib/python2.7/dist-packages/testtools/testsuite.py", line 167, in run
    event_dict = queue.get()
  File "/usr/lib/python2.7/Queue.py", line 168, in get
    self.not_empty.wait()
  File "/usr/lib/python2.7/threading.py", line 339, in wait
    waiter.acquire()
KeyboardInterrupt

Revision history for this message
Pavlo Shchelokovskyy (pshchelo) wrote :

I just tried it with clean fresh venv and can not reproduce it (Ubuntu 14.04). That's what I did:

mkvirtualenv heat-icehouse
git clone <email address hidden>:openstack/heat.git heat-icehouse
cd heat-icehouse
git checkout 2014.1.2
pip install -r requirements.txt -r test-requirements.txt
testr init
testr run

Revision history for this message
Corey Bryant (corey.bryant) wrote :

Thanks Pavlo. I haven't been able to recreate this in the past few days. I didn't figure out what the root cause was, as I'm successfully running the same steps as before, even on fresh installs of 14.04. Nonetheless I'm able to consistently run tests successfully now.

Zane Bitter (zaneb)
Changed in heat:
status: New → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for heat because there has been no activity for 60 days.]

Changed in heat:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.