Rollback not work cause apache2 cannot start

Bug #1366712 reported by Stanislaw Bogatkin
14
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Vladimir Kuklin
5.0.x
Fix Committed
High
Vladimir Kuklin
6.0.x
Fix Committed
High
Vladimir Kuklin

Bug Description

{

    "build_id": "2014-09-05_00-01-17",
    "ostf_sha": "f7b5d9d0d1cfaba5f1fe1e2c634493e92bce11db",
    "build_number": "499",
    "auth_required": true,
    "api": "1.0",
    "nailgun_sha": "b36dccbc28584532ca1bdb679b096cc3f5f6f80a",
    "production": "docker",
    "fuelmain_sha": "b3afef75675ae3ab251a4f990f3432968eb746eb",
    "astute_sha": "b622d9b36dbdd1e03b282b9ee5b7435ba649e711",
    "feature_groups": [
        "mirantis"
    ],
    "release": "5.1",
    "fuellib_sha": "6ebadd157c5153e9bb3ed53fa73507a5c73572c3"

}

Ubuntu, HA, NeutronVLAN

Steps to reproduce:
1. Install 5.0 node (26 build).
2. Deploy env: ubuntu, HA, NeutronVLAN, 3 controllers, compute, storage.
3. Upgrade Fuel to 5.1
4. Patch env to 5.0.2
5. Try to rollback env.

Expect: all is ok

Result:
Rollback failed due to errors:

Mon Sep 08 07:56:19 +0000 2014 Puppet (err): Could not update: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold --force-yes install openstack-dashboard=1:2014.1.fuel5.0~mira4' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
The following extra packages will be installed:
  libapache2-mod-wsgi openstack-dashboard-ubuntu-theme python-appconf
  python-ceilometerclient python-cloudfiles python-compressor python-django
  python-django-horizon python-openstack-auth python-troveclient
Suggested packages:
  python-psycopg2 python-psycopg python-flup python-sqlite
  geoip-database-contrib gettext python-lesscpy
The following NEW packages will be installed:
  libapache2-mod-wsgi openstack-dashboard openstack-dashboard-ubuntu-theme
  python-appconf python-ceilometerclient python-cloudfiles python-compressor
  python-django python-django-horizon python-openstack-auth python-troveclient
0 upgraded, 11 newly installed, 0 to remove and 0 not upgraded.
Need to get 9274 kB of archives.
After this operation, 42.1 MB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
  python-django python-appconf python-compressor libapache2-mod-wsgi
  python-ceilometerclient python-cloudfiles python-openstack-auth
  python-troveclient python-django-horizon openstack-dashboard
  openstack-dashboard-ubuntu-theme
Authentication warning overridden.
Get:1 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main python-django all 1.5.4-ubuntu0 [5463 kB]
Get:2 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main python-appconf all 0.5-2~cloud0 [8070 B]
Get:3 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main python-compressor all 1.3-0ubuntu1~cloud0 [60.5 kB]
Get:4 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main libapache2-mod-wsgi amd64 3.3-4build1 [72.7 kB]
Get:5 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main python-ceilometerclient all 1.0.9.fuel5.0~mira0 [63.0 kB]
Get:6 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main python-cloudfiles all 1.7.9.2-1 [20.6 kB]
Get:7 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main python-openstack-auth all 1.1.1-0ubuntu1~cloud0 [23.0 kB]
Get:8 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main python-troveclient all 1:1.0.3.fuel5.0~mira0 [96.6 kB]
Get:9 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main python-django-horizon all 1:2014.1.fuel5.0~mira4 [725 kB]
Get:10 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main openstack-dashboard all 1:2014.1.fuel5.0~mira4 [2697 kB]
Get:11 http://10.108.0.2/ubuntu/fuelweb/x86_64/ precise/main openstack-dashboard-ubuntu-theme all 1:2014.1.fuel5.0~mira4 [44.8 kB]
Fetched 9274 kB in 1s (5931 kB/s)
Selecting previously unselected package python-django.
(Reading database ... 108899 files and directories currently installed.)
Unpacking python-django (from .../python-django_1.5.4-ubuntu0_all.deb) ...
Selecting previously unselected package python-appconf.
Unpacking python-appconf (from .../python-appconf_0.5-2~cloud0_all.deb) ...
Selecting previously unselected package python-compressor.
Unpacking python-compressor (from .../python-compressor_1.3-0ubuntu1~cloud0_all.deb) ...
Selecting previously unselected package libapache2-mod-wsgi.
Unpacking libapache2-mod-wsgi (from .../libapache2-mod-wsgi_3.3-4build1_amd64.deb) ...
Selecting previously unselected package python-ceilometerclient.
Unpacking python-ceilometerclient (from .../python-ceilometerclient_1.0.9.fuel5.0~mira0_all.deb) ...
Selecting previously unselected package python-cloudfiles.
Unpacking python-cloudfiles (from .../python-cloudfiles_1.7.9.2-1_all.deb) ...
Selecting previously unselected package python-openstack-auth.
Unpacking python-openstack-auth (from .../python-openstack-auth_1.1.1-0ubuntu1~cloud0_all.deb) ...
Selecting previously unselected package python-troveclient.
Unpacking python-troveclient (from .../python-troveclient_1%3a1.0.3.fuel5.0~mira0_all.deb) ...
Selecting previously unselected package python-django-horizon.
Unpacking python-django-horizon (from .../python-django-horizon_1%3a2014.1.fuel5.0~mira4_all.deb) ...
Selecting previously unselected package openstack-dashboard.
Unpacking openstack-dashboard (from .../openstack-dashboard_1%3a2014.1.fuel5.0~mira4_all.deb) ...
Selecting previously unselected package openstack-dashboard-ubuntu-theme.
Unpacking openstack-dashboard-ubuntu-theme (from .../openstack-dashboard-ubuntu-theme_1%3a2014.1.fuel5.0~mira4_all.deb) ...
Processing triggers for man-db ...
Setting up python-django (1.5.4-ubuntu0) ...
Setting up python-appconf (0.5-2~cloud0) ...
Setting up python-compressor (1.3-0ubuntu1~cloud0) ...
Setting up libapache2-mod-wsgi (3.3-4build1) ...
Setting up python-ceilometerclient (1.0.9.fuel5.0~mira0) ...
Setting up python-cloudfiles (1.7.9.2-1) ...
Setting up python-openstack-auth (1.1.1-0ubuntu1~cloud0) ...
Setting up python-troveclient (1:1.0.3.fuel5.0~mira0) ...
Setting up python-django-horizon (1:2014.1.fuel5.0~mira4) ...
Setting up openstack-dashboard (1:2014.1.fuel5.0~mira4) ...

Configuration file `/etc/openstack-dashboard/local_settings.py'
 ==> Modified (by you or by a script) since installation.
 ==> Package distributor has shipped an updated version.
 ==> Using current old file as you requested.
Syntax error on line 6 of /etc/apache2/conf.d/openstack-dashboard.conf:
Invalid command 'WSGIScriptAlias', perhaps misspelled or defined by a module not included in the server configuration
Action 'configtest' failed.
The Apache error log may have more information.
   ...fail!
dpkg: error processing openstack-dashboard (--configure):
 subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of openstack-dashboard-ubuntu-theme:
 openstack-dashboard-ubuntu-theme depends on openstack-dashboard (= 1:2014.1.fuel5.0~mira4); however:
  Package openstack-dashboard is not configured yet.
dpkg: error processing openstack-dashboard-ubuntu-theme (--configure):
 dependency problems - leaving unconfigured
No apport report written because MaxReports is reached already
No apport report written because MaxReports is reached already
Errors were encountered while processing:
 openstack-dashboard
 openstack-dashboard-ubuntu-theme
E: Sub-process /usr/bin/dpkg returned an error code (1)
/usr/lib/ruby/vendor_ruby/puppet/util/errors.rb:97:in `fail'
/etc/puppet/modules/package/lib/puppet/type/package.rb:108
/usr/lib/ruby/vendor_ruby/puppet/property.rb:209:in `instance_eval'
/usr/lib/ruby/vendor_ruby/puppet/property.rb:209:in `call_valuemethod'
/usr/lib/ruby/vendor_ruby/puppet/property.rb:498:in `set'
/usr/lib/ruby/vendor_ruby/puppet/property.rb:581:in `sync'
/usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:193:in `sync'
/usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:130:in `sync_if_needed'
/usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:107:in `manage_via_ensure_if_possible'
/usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:77:in `perform_changes'
/usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:18:in `evaluate'
/usr/lib/ruby/vendor_ruby/puppet/transaction.rb:174:in `apply'
/usr/lib/ruby/vendor_ruby/puppet/transaction.rb:187:in `eval_resource'
/usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `call'
/usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `evaluate'
/usr/lib/ruby/vendor_ruby/puppet/util.rb:327:in `thinmark'
/usr/lib/ruby/1.8/benchmark.rb:308:in `realtime'
/usr/lib/ruby/vendor_ruby/puppet/util.rb:326:in `thinmark'
/usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `evaluate'
/usr/lib/ruby/vendor_ruby/puppet/graph/relationship_graph.rb:118:in `traverse'
/usr/lib/ruby/vendor_ruby/puppet/transaction.rb:108:in `evaluate'
/usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:164:in `apply'
/usr/lib/ruby/vendor_ruby/puppet/util/log.rb:149:in `with_destination'
/usr/lib/ruby/vendor_ruby/puppet/transaction/report.rb:108:in `as_logging_destination'
/usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:163:in `apply'
/usr/lib/ruby/vendor_ruby/puppet/configurer.rb:125:in `apply_catalog'
/usr/lib/ruby/vendor_ruby/puppet/util.rb:161:in `benchmark'
/usr/lib/ruby/1.8/benchmark.rb:308:in `realtime'
/usr/lib/ruby/vendor_ruby/puppet/util.rb:160:in `benchmark'
/usr/lib/ruby/vendor_ruby/puppet/configurer.rb:124:in `apply_catalog'
/usr/lib/ruby/vendor_ruby/puppet/configurer.rb:192:in `run'
/usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:268:in `apply_catalog'
/usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:218:in `main'
/usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:146:in `run_command'
/usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
/usr/lib/ruby/vendor_ruby/puppet/application.rb:470:in `plugin_hook'
/usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
/usr/lib/ruby/vendor_ruby/puppet/util.rb:478:in `exit_on_fail'
/usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
/usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:137:in `run'
/usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:91:in `execute'
/usr/bin/puppet:4

Revision history for this message
Stanislaw Bogatkin (sbogatkin) wrote :
Revision history for this message
Stanislaw Bogatkin (sbogatkin) wrote :

simple workaround is to manually enable wsgi module on apache:

# a2enmod wsgi

Changed in fuel:
status: New → Confirmed
importance: Undecided → High
importance: High → Critical
importance: Critical → High
assignee: nobody → Stanislaw Bogatkin (sbogatkin)
Dmitry Ilyin (idv1985)
Changed in fuel:
assignee: Stanislaw Bogatkin (sbogatkin) → Dmitry Ilyin (idv1985)
status: Confirmed → Incomplete
Changed in fuel:
status: Incomplete → Confirmed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/120576

Changed in fuel:
assignee: Dmitry Ilyin (idv1985) → Vladimir Kuklin (vkuklin)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/5.1)

Fix proposed to branch: stable/5.1
Review: https://review.openstack.org/120578

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/5.0)

Fix proposed to branch: stable/5.0
Review: https://review.openstack.org/120579

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (stable/5.1)

Change abandoned by Vladimir Kuklin (<email address hidden>) on branch: stable/5.1
Review: https://review.openstack.org/120578

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (stable/5.0)

Change abandoned by Vladimir Kuklin (<email address hidden>) on branch: stable/5.0
Review: https://review.openstack.org/120579

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/120576
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=91f7e4c790be9a65c84f017c91c967affc7647d8
Submitter: Jenkins
Branch: master

commit 91f7e4c790be9a65c84f017c91c967affc7647d8
Author: Vladimir Kuklin <email address hidden>
Date: Thu Sep 11 00:45:21 2014 +0400

    Enable wsgi module at right time

    Enable wsgi module after apache2 package
    installation and before dashboard package installation.

    Change-Id: Icb7c8525f5de4e0225fcab9ce203be2d3646858b
    Closes-bug: #1366712

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/5.0)

Reviewed: https://review.openstack.org/120579
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=66266e113ce2e883b5a35a9148837e9ec86d08df
Submitter: Jenkins
Branch: stable/5.0

commit 66266e113ce2e883b5a35a9148837e9ec86d08df
Author: Vladimir Kuklin <email address hidden>
Date: Thu Sep 11 00:45:21 2014 +0400

    Enable wsgi module at right time

    Enable wsgi module after apache2 package
    installation and before dashboard package installation.

    Change-Id: Icb7c8525f5de4e0225fcab9ce203be2d3646858b
    Closes-bug: #1366712

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/5.1)

Reviewed: https://review.openstack.org/120578
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=84b3a123ecf8f19b3a2b98aeaa5d5065dc46c785
Submitter: Jenkins
Branch: stable/5.1

commit 84b3a123ecf8f19b3a2b98aeaa5d5065dc46c785
Author: Vladimir Kuklin <email address hidden>
Date: Thu Sep 11 00:45:21 2014 +0400

    Enable wsgi module at right time

    Enable wsgi module after apache2 package
    installation and before dashboard package installation.

    Change-Id: Icb7c8525f5de4e0225fcab9ce203be2d3646858b
    Closes-bug: #1366712

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.