Fuel for OpenStack

Cannot login to WEB UI: FATAL: password authentication failed for user "keystone"

Bug #1385132 reported by Anastasia Palkina
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Confirmed
Critical
Fuel Library (Deprecated)
Fuel for OpenStack 6.0

Bug Description

"build_id": "2014-10-24_00-01-06",
"ostf_sha": "de177931b53fbe9655502b73d03910b8118e25f1",
"build_number": "46",
"auth_required": true,
"api": "1.0",
"nailgun_sha": "31b5e4e591926633e45384a0a817e90d190806f3",
"production": "docker",
"fuelmain_sha": "7b34d04edb929659dad5fa4ddb224346d4e74ec3",
"astute_sha": "97eea90efe0a1f17b4934919d6e459d270c10372",
"feature_groups": ["mirantis", "techpreview"], "release": "6.0", "release_versions": {"2014.2-6.0": {"VERSION": {"build_id": "2014-10-24_00-01-06", "ostf_sha": "de177931b53fbe9655502b73d03910b8118e25f1", "build_number": "46", "api": "1.0", "nailgun_sha": "31b5e4e591926633e45384a0a817e90d190806f3", "production": "docker", "fuelmain_sha": "7b34d04edb929659dad5fa4ddb224346d4e74ec3", "astute_sha": "97eea90efe0a1f17b4934919d6e459d270c10372", "feature_groups": ["mirantis", "techpreview"], "release": "6.0", "fuellib_sha": "cf39a7503c5a6006ed7a4f2b46b2ef43d7d4dda8"}}}, "fuellib_sha": "cf39a7503c5a6006ed7a4f2b46b2ef43d7d4dda8"

1. Install fuel master
2. Cannot login to WEB UI
3. There is error in /var/log/docker-keystone.log

ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 CRITICAL keystone [-] OperationalError: (OperationalError) FATAL: password authentication failed for user "keystone"ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: None NoneESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone Traceback (most recent call last):ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/bin/keystone-manage", line 44, in <module>ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone cli.main(argv=sys.argv, config_files=config_files)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/keystone/cli.py", line 307, in mainESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone CONF.command.cmd_class.main()ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/keystone/cli.py", line 74, in mainESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone migration_helpers.sync_database_to_version(extension, version)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/keystone/common/sql/migration_helpers.py", line 204, in sync_database_to_versionESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone _sync_common_repo(version)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/keystone/common/sql/migration_helpers.py", line 157, in _sync_common_repoESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone engine = sql.get_engine()ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/keystone/common/sql/core.py", line 188, in get_engineESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone return _get_engine_facade().get_engine()ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/keystone/common/sql/core.py", line 176, in _get_engine_facadeESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone _engine_facade = db_session.EngineFacade.from_config(CONF)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/oslo/db/sqlalchemy/session.py", line 808, in from_configESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone retry_interval=conf.database.retry_interval)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/oslo/db/sqlalchemy/session.py", line 724, in __init__ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone **engine_kwargs)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/oslo/db/sqlalchemy/session.py", line 409, in create_engineESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone _test_connection(engine, max_retries, retry_interval)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/oslo/db/sqlalchemy/session.py", line 541, in _test_connectionESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone return exc_filters.handle_connect_error(engine)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/oslo/db/sqlalchemy/exc_filters.py", line 352, in handle_connect_errorESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone handler(ctx)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/oslo/db/sqlalchemy/exc_filters.py", line 324, in handlerESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone context.is_disconnect)ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone File "/usr/lib/python2.6/site-packages/oslo/db/sqlalchemy/exc_filters.py", line 254, in _raise_operational_errors_directly_filterESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone raise operational_errorESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone OperationalError: (OperationalError) FATAL: password authentication failed for user "keystone"ESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone None NoneESC[0m
ESC[mNotice: /Stage[main]/Keystone/Exec[keystone-manage db_sync]/returns: 2014-10-24 07:36:19.772 556 TRACE keystone ESC[0m

Revision history for this message
Anastasia Palkina (apalkina) wrote :
Sebastian Kalinowski (prmtl)
Changed in fuel:
status: New → Confirmed
Revision history for this message
Sebastian Kalinowski (prmtl) wrote :

Postgres doesn't have all accounts (like keystone, ostf, etc.)

postgres=# \du
            List of roles
 Role name | Attributes | Member of
-----------+-------------+-----------
 nailgun | | {}
 postgres | Superuser | {}
           : Create role
           : Create DB

Revision history for this message
Sebastian Kalinowski (prmtl) wrote :
Revision history for this message
Sebastian Kalinowski (prmtl) wrote :
Revision history for this message
Sebastian Kalinowski (prmtl) wrote :

Puppet simply didn't wait for postgresql to be start:

      message: "createdb: could not connect to database postgres: could not connect to server: No such file or directory"
      source: "/Stage[main]/Main/Postgresql::Db[ostf]/Postgresql::Database[ostf]/Exec[/usr/bin/createdb --template=template0 --encoding 'utf8' --locale=C 'ostf']/returns"
      time: 2014-10-24 11:23:43.064254 +00:00

Our current puppet manifest for postgresql do not check if after starting postgresql service, database is ready for connections. Ideally would be to upgrade postgresql manifest to the newest version.

Changed in fuel:
assignee: Sebastian Kalinowski (prmtl) → Fuel Library Team (fuel-library)
Revision history for this message
Matthew Mosesohn (raytrac3r) wrote :

This is related to the package upgrade of PostgreSQL to 9.3. Our puppet manifests are incompatible. I'm addressing this in: https://bugs.launchpad.net/fuel/+bug/1386118 but it's still WIP

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.